Anxiety, aggression, reward sensitivity, and forebrain dopamine receptor expression in a laboratory rat model of early-life disadvantage

Despite early-life disadvantage (ELD) in humans being a highly heterogenous construct, it consistently predicts negative neurobehavioral outcomes. The numerous environmental contributors and neural mechanisms underlying ELD remain unclear, though. We used a laboratory rat model to evaluate the effects of limited resources and/or heavy metal exposure on mothers and their adult male and female offspring. Dams and litters were chronically exposed to restricted (1-cm deep) or ample (4-cm deep) home cage bedding postpartum, with or without lead acetate (0.1%) in their drinking water from insemination through 1-week postweaning. Restricted-bedding mothers showed more pup-directed behaviors and behavioral fragmentation, while lead-exposed mothers showed more nestbuilding. Restricted bedding-raised male offspring showed higher anxiety and aggression. Either restricted bedding or lead exposure impaired goal-directed performance in a reinforcer devaluation task in females, whereas restricted bedding alone disrupted it in males. Lead exposure, but not limited bedding, also reduced sucrose reward sensitivity in a progressive ratio task in females. D1 and D2 receptor mRNA in the medial prefrontal cortex and nucleus accumbens (NAc) were each affected by the early-life treatments and differently between the sexes. Most notably, adult males (but not females) exposed to both early-life treatments had greatly increased D1 receptor mRNA in the NAc core. These results illuminate neural mechanisms through which ELD threatens neurobehavioral development and highlight forebrain dopamine as a factor.

Not all discounts are created equal: Regional activity and brain networks in temporal and effort discounting

Reward outcomes associated with costs like time delay and effort investment are generally discounted in decision-making. Standard economic models predict rewards associated with different types of costs are devalued in a similar manner. However, our review of rodent lesion studies indicated partial dissociations between brain regions supporting temporal- and effort-based decision-making. Another debate is whether options involving low and high costs are processed in different brain substrates (dual-system) or in the same regions (single-system). This research addressed these issues using coordinate-based, connectivity-based, and activation network-based meta-analyses to identify overlapping and separable neural systems supporting temporal (39 studies) and effort (20 studies) discounting. Coordinate-based activation likelihood estimation and resting-state connectivity analyses showed immediate-small reward and delayed-large reward choices engaged distinct regions with unique connectivity profiles, but their activation network mapping was found to engage the default mode network. For effort discounting, salience and sensorimotor networks supported low-effort choices, while the frontoparietal network supported high-effort choices. There was little overlap between the temporal and effort networks. Our findings underscore the importance of differentiating different types of costs in decision-making and understanding discounting at both regional and network levels.

Relationship between insulin and Netrin-1/DCC guidance cue pathway regulation in the prefrontal cortex of rodents exposed to prenatal dietary restriction

Fetal restriction (FR) alters insulin sensitivity, but it is unknown how the metabolic profile associated with restriction affects development of the dopamine (DA) system and DA-related behaviors. The Netrin-1/DCC guidance cue system participates in maturation of the mesocorticolimbic DA circuitry. Therefore, our objective was to identify if FR modifies Netrin-1/DCC receptor protein expression in the prefrontal cortex (PFC) at birth and mRNA in adulthood in rodent males. We used cultured HEK293 cells to assess if levels of miR-218, microRNA regulator of DCC, are sensitive to insulin. To assess this, pregnant dams were subjected to a 50% FR diet from gestational day 10 until birth. Medial PFC (mPFC) DCC/Netrin-1 protein expression was measured at P0 at baseline and Dcc/Netrin-1 mRNA levels were quantified in adults 15 min after a saline/insulin injection. miR-218 levels in HEK-293 cells were measured in response to insulin exposure. At P0, Netrin-1 levels are downregulated in FR animals in comparison to controls. In adult rodents, insulin administration results in an increase in Dcc mRNA levels in control but not FR rats. In HEK293 cells, there is a positive correlation between insulin concentration and miR-218 levels. Since miR-218 is a Dcc gene expression regulator and our in vitro results show that insulin regulates miR-218 levels, we suggest that FR-induced changes in insulin sensitivity could be affecting Dcc expression via miR-218, impacting DA system maturation and organization. As fetal adversity is linked to nonadaptive behaviors later in life, this may contribute to early identification of vulnerability to chronic diseases associated with fetal adversity.

Flexible coding schemes in dorsomedial prefrontal cortex underlie decision-making during delay discounting

Determining how an agent decides between a small, immediate versus a larger, delayed reward has provided insight into the psychological and neural basis of decision-making. The tendency to excessively discount the value of delayed rewards is thought to reflect deficits in brain regions critical for impulse control such as the prefrontal cortex (PFC). This study tested the hypothesis that dorsomedial PFC (dmPFC) is critically involved in flexibly managing neural representations of strategies that limit impulsive choices. Optogenetic silencing of neurons in the rat dmPFC increased impulsive choices at an 8 sec, but not 4 sec, delay. Neural recordings from dmPFC ensembles revealed that, at the 8-sec delay, the encoding landscape transitions to reflect a deliberative-like process rather than the schema-like processes observed at the 4-sec delay. These findings show that changes in the encoding landscape reflect changes in task demands and that dmPFC is uniquely involved in decisions requiring deliberation.

Concurrent measures of impulsive action and choice are partially related and differentially modulated by dopamine D1- and D2-like receptors in a rat model of impulsivity

Impulsivity is a multidimensional construct, but the relationships between its constructs and their respective underlying dopaminergic underpinnings in the general population remain unclear. A cohort of Roman high- (RHA) and low- (RLA) avoidance rats were tested for impulsive action and risky decision-making in the rat gambling task, and then for delay discounting in the delay-discounting task to concurrently measure the relationships among the three constructs of impulsivity using a within-subject design. Then, we evaluated the effects of dopaminergic drugs on the three constructs of impulsivity, considering innate differences in impulsive behaviors at baseline. Risky decision-making and delay-discounting were positively correlated, indicating that both constructs of impulsive choice are related. Impulsive action positively correlated with risky decision-making but not with delay discounting, suggesting partial overlap between impulsive action and impulsive choice. RHAs showed a more impulsive phenotype in the three constructs of impulsivity compared to RLAs, demonstrating the comorbid nature of impulsivity in a population of rats. Amphetamine increased impulsive action and had no effect on risky decision-making regardless of baseline levels of impulsivity, but it decreased delay discounting only in high impulsive RHAs. In contrast, while D₁R and D₃R agonism as well as D_2/3R partial agonism decreased impulsive action regardless of baseline levels of impulsivity, D_2/3R agonism decreased impulsive action exclusively in high impulsive RHAs. Irrespective of baseline levels of impulsivity, risky decision-making was increased by D₁R and D_2/3R agonism but not by D₃R agonism or D_2/3R partial agonism. Finally, while D₁R and D₃R agonism, D_2/3R partial agonism and D₂R blockade increased delay discounting irrespective of baseline levels of impulsivity, D_2/3R agonism decreased it in low impulsive RLAs only. These findings indicate that the acute effects of dopamine drugs were partially overlapping across dimensions of impulsivity, and that only D_2/3R agonism showed baseline-dependent effects on impulsive action and impulsive choice.

Adolescent alcohol exposure reduces dopamine 1 receptor modulation of prelimbic neurons projecting to the nucleus accumbens and basolateral amygdala

Binge drinking during adolescence is highly prevalent despite increasing evidence of its long-term impact on behaviors associated with modulation of behavioral flexibility by the medial prefrontal cortex (mPFC). In the present study, male and female rats underwent adolescent intermittent ethanol (AIE) exposure by vapor inhalation. After aging to adulthood, retrograde bead labelling and viral tagging were used to identify populations of neurons in the prelimbic region (PrL) of the mPFC that project to specific subcortical targets. Electrophysiological recording from bead-labelled neurons in PrL slices revealed that AIE did not alter the intrinsic excitability of PrL neurons that projected to either the NAc or the BLA. Similarly, recordings of spontaneous inhibitory and excitatory post-synaptic currents revealed no AIE-induced changes in synaptic drive onto either population of projection neurons. In contrast, AIE exposure was associated with a loss of dopamine receptor 1 (D1), but no change in dopamine receptor 2 (D2), modulation of evoked firing of both populations of projection neurons. Lastly, confocal imaging of proximal and apical dendritic tufts of viral-labelled PrL neurons that projected to the nucleus accumbens (NAc) revealed AIE did not alter the density of dendritic spines. Together, these observations provide evidence that AIE exposure results in disruption of D1 receptor modulation of PrL inputs to at least two major subcortical target regions that have been implicated in AIE-induced long-term changes in behavioral control.

Value-free random exploration is linked to impulsivity

Deciding whether to forgo a good choice in favour of exploring a potentially more rewarding alternative is one of the most challenging arbitrations both in human reasoning and in artificial intelligence. Humans show substantial variability in their exploration, and theoretical (but only limited empirical) work has suggested that excessive exploration is a critical mechanism underlying the psychiatric dimension of impulsivity. In this registered report, we put these theories to test using large online samples, dimensional analyses, and computational modelling. Capitalising on recent advances in disentangling distinct human exploration strategies, we not only demonstrate that impulsivity is associated with a specific form of exploration—value-free random exploration—but also explore links between exploration and other psychiatric dimensions.

The Stage 1 protocol for this Registered Report was accepted in principle on 19/03/2021. The protocol, as accepted by the journal, can be found at 10.6084/m9.figshare.14346506.v1.

Deciding between known rewarding options and exploring novel avenues is central to decision making. Humans show variability in their exploration. Here, the authors show that impulsivity is associated to an increased usage of a cognitively cheap (and sometimes sub-optimal) exploration strategy.

Dopamine modulates social behaviour in cooperatively breeding fish

Dopamine is part of the reward system triggering the social decision-making network in the brain. It has hence great potential importance in the regulation of social behaviour, but its significance in the control of behaviour in highly social animals is currently limited. We studied the role of the dopaminergic system in social decision-making in the cooperatively breeding cichlid fish, Neolamprologus pulcher, by blocking or stimulating the dopaminergic D1-like and D2-like receptors. We first tested the effects of different dosages and timing of administration on subordinate group members' social behaviour within the group in an unchallenging environment. In a second experiment we pharmacologically manipulated D1-like and D2-like receptors while experimentally challenging N. pulcher groups by presenting an egg predator, and by increasing the need for territory maintenance through digging out sand from the shelter. Our results show that the D1-like and D2-like receptor pathways are differently involved in the modulation of aggressive, submissive and affiliative behaviours. Interestingly, the environmental context seems particularly crucial regarding the role of the D2-like receptors in behavioural regulation of social encounters among group members, indicating a potential pathway in agonistic and cooperative interactions in a pay-to-stay scenario. We discuss the importance of environmental information in mediating the role of dopamine for the modulation of social behaviour.

The effects of early life stress on impulsivity

Elevated impulsivity is a symptom shared by various psychiatric disorders such as substance use disorder, bipolar disorder, and attention-deficit/hyperactivity disorder. However, impulsivity is not a unitary construct and impulsive behaviors fall into two subcategories: impulsive action and impulsive choice. Impulsive choice refers to the tendency to prefer immediate, small rewards over delayed, large rewards, whereas impulsive action involves difficulty inhibiting rash, premature, or mistimed behaviors. These behaviors are mediated by the mesocorticolimbic dopamine (DA) system, which consists of projections from the ventral tegmental area to the nucleus accumbens and prefrontal cortex. Early life stress (ELS) alters both impulsive choice and impulsive action in rodents. ELS also changes DA receptor expression, transmission, and activity within the mesocorticolimbic system. This review integrates the dopamine, impulsivity, and ELS literature to provide evidence that ELS alters impulsivity via inducing changes in the mesocorticolimbic DA system. Understanding how ELS affects brain circuits associated with impulsivity can help advance treatments aimed towards reducing impulsivity symptoms in a variety of psychiatric disorders.

Neurochemical substrates linked to impulsive and compulsive phenotypes in addiction: A preclinical perspective

Drug compulsion manifests in some but not all individuals and implicates multifaceted processes including failures in top-down cognitive control as drivers for the hazardous pursuit of drug use in some individuals. As a closely related construct, impulsivity encompasses rash or risky behaviour without foresight and underlies most forms of drug taking behaviour, including drug use during adverse emotional states (i.e., negative urgency). While impulsive behavioural dimensions emerge from drug-induced brain plasticity, burgeoning evidence suggests that impulsivity also predates the emergence of compulsive drug use. Although the neural substrates underlying the apparently causal relationship between trait impulsivity and drug compulsion are poorly understood, significant advances have come from the interrogation of defined limbic cortico-striatal circuits involved in motivated behaviour and response inhibition, together with chemical neuromodulatory influences from the ascending neurotransmitter systems. We review what is presently known about the neurochemical mediation of impulsivity, in its various forms, and ask whether commonalities exist in the neurochemistry of compulsive drug-motivated behaviours that might explain individual risk for addiction.

Genetic Architecture and Molecular Neuropathology of Human Cocaine Addiction

We integrated genomic and bioinformatic analyses, using data from the largest genome-wide association study of cocaine dependence (CD; n = 6546; 82.37% with CD; 57.39% male) and the largest postmortem gene-expression sample of individuals with cocaine use disorder (CUD; n = 36; 51.35% with CUD; 100% male). Our genome-wide analyses identified one novel gene (NDUFB9) associated with the genetic predisposition to CD in African-Americans. The genetic architecture of CD was similar across ancestries. Individual genes associated with CD demonstrated modest overlap across European-Americans and African-Americans, but the genetic liability for CD converged on many similar tissue types (brain, heart, blood, liver) across ancestries. In a separate sample, we investigated the neuronal gene expression associated with CUD by using RNA sequencing of dorsal-lateral prefrontal cortex neurons. We identified 133 genes differentially expressed between CUD case patients and cocaine-free control subjects, including previously implicated candidates for cocaine use/addiction (FOSB, ARC, KCNJ9/GIRK3, NR4A2, JUNB, and MECP2). Differential expression analyses significantly correlated across European-Americans and African-Americans. While genes significantly associated with CD via genome-wide methods were not differentially expressed, two of these genes (NDUFB9 and C1qL2) were part of a robust gene coexpression network associated with CUD involved in neurotransmission (GABA, acetylcholine, serotonin, and dopamine) and drug addiction. We then used a "guilt-by-association" approach to unravel the biological relevance of NDUFB9 and C1qL2 in the context of CD. In sum, our study furthers the understanding of the genetic architecture and molecular neuropathology of human cocaine addiction and provides a framework for translating biological meaning into otherwise obscure genome-wide associations.SIGNIFICANCE STATEMENT Our study further clarifies the genetic and neurobiological contributions to cocaine addiction, provides a rapid approach for generating testable hypotheses for specific candidates identified by genome-wide research, and investigates the cross-ancestral biological contributions to cocaine use disorder/dependence for individuals of European-American and African-American ancestries.

Dopaminergic D1 Receptor Stimulation Affects Effort and Risk Preferences

BACKGROUND

Activation of D₁ receptors has been related to successful goal-directed behavior, but it remains unclear whether D₁ receptor activation causally tips the balance of weighing costs and benefits in humans. Here, we tested the impact of pharmacologically stimulated D₁ receptors on sensitivity to risk, delay, and effort costs in economic choice and investigated whether D₁ receptor stimulation would bias preferences toward options with increased costs in a cost-specific manner.

METHODS

In a randomized, double-blind, placebo-controlled, parallel-group phase 1 study, 120 healthy young volunteers received either placebo or 1 of 3 doses (6 mg, 15 mg, or 30 mg) of a novel, selective D₁ agonist (PF-06412562). After drug administration, participants performed decision tasks measuring their preferences for risky, delayed, and effortful outcomes.

RESULTS

Higher doses of the D₁ agonist increased the willingness to exert physical effort for reward as well as reduced the preference for risky outcomes. We observed no effects on preferences for delayed rewards.

CONCLUSIONS

The current results provide evidence that D₁ receptor stimulation causally affects core aspects of cost-benefit decision making in humans.

The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

The Neuropharmacology of Impulsive Behaviour, an Update

Neuropharmacological interventions in preclinical translational models of impulsivity have tremendously contributed to a better understanding of the neurochemistry and neural basis of impulsive behaviour. In this regard, much progress has been made over the last years, also due to the introduction of novel techniques in behavioural neuroscience such as optogenetics and chemogenetics. In this chapter, we will provide an update of how the behavioural pharmacology field has progressed and built upon existing data since an earlier review we wrote in 2008. To this aim, we will first give a brief background on preclinical translational models of impulsivity. Next, recent interesting evidence of monoaminergic modulation of impulsivity will be highlighted with a focus on the neurotransmitters dopamine and noradrenaline. Finally, we will close the chapter by discussing some novel directions and drug leads in the neuropharmacological modulation of impulsivity.

The use of laser capture microdissection to identify specific pathways and mechanisms involved in impulsive choice in rats

Background

Microinjections, lesions, viral-mediated gene transfer, or designer receptors exclusively activated by designer drugs (DREADDs) can identify brain signaling pathways and their pharmacology in research animals. Genetically modified animals are used for more precise assessment of neural circuits. However, only a few of the gene-based pathway modifications are available for use in outbred rat strains.

New method

Behaviorally characterized Sprague-Dawley rats undergo tract tracing through microinjection of fluorospheres, followed by laser capture microdissection (LCM) and qPCR for detecting mRNA of pathway-associated gene products. Correlations between mRNA expression and behavior identify specific involvement of pharmacologically relevant molecules within cells of interest. Here, we examined this methodology in an impulsive choice paradigm and targeted projections from the orbital and medial prefrontal cortex.

Results

In this proof of concept study, we demonstrate relationships between measures of impulsive choice with distinct neurotransmitter receptor expression in cell populations from four different signaling pathways.

Comparisons with existing methods

Combining behavior, tract tracing, LCM, and gene expression profiling provides more cellular selectivity than localized lesions and DREADDs, and greater pharmacological specificity than microinjections and viral-mediated gene transfer due to targeting identified neurons. Furthermore, the assessment of inter-individual pathways provides insight into the complex nature of underlying mechanisms involved in typical and atypical behavior.

Conclusions

The novel combination of behavior, tract tracing, LCM, and single gene or potential whole genome transcriptome analysis allows for a more targeted understanding of the interconnection of neural circuitry with behavior, and holds promise to identify more specific drug targets that are relevant to behavioral phenotypes.

Intrauterine growth restriction increases impulsive behavior and is associated with altered dopamine transmission in both medial prefrontal and orbitofrontal cortex in female rats

Recent studies have implicated a role for impulsivity in the altered eating behaviors and the increased risk for obesity consistently associated with intrauterine growth restriction (IUGR). Changes in dopamine transmission within prefrontal areas are believed to contribute to these adverse outcomes. Here we investigated the impulsive behavior toward a delayed reward and evaluated dopamine levels and its receptors in the medial prefrontal (mPFC) and orbitofrontal (OFC) cortex of female adult rats exposed to IUGR. From day 10 of pregnancy and until birth, Sprague-Dawley dams received either an ad libitum (Adlib) or a 50% food-restricted (FR) diet. At birth, all pups were adopted by Adlib mothers, generating the groups Adlib/Adlib (control) and FR/Adlib (intrauterine growth-restricted). Adult impulsive behavior was evaluated using a Tolerance to Delay of Reward Task. In vivo dopamine responses to sweet food intake were measured by voltammetry, and D1, D2 and DAT levels were accessed by Western Blot. Animals from FR group showed a pronounced aversion to delayed rewards. DA response to sweet food was found to be blunted in the mPFC of FR animals, whereas in the OFC, the DA levels appear to be unaffected by reward consumption. Moreover, FR animals presented reduced D1 receptors in the OFC and a later increase in the mPFC D2 levels. These findings suggest that IUGR female rats are more impulsive and that the associated mechanism involves changes in the dopamine signaling in both the mPFC and OFC.

Brain and Cognition for Addiction Medicine: From Prevention to Recovery Neural Substrates for Treatment of Psychostimulant-Induced Cognitive Deficits

Addiction to psychostimulants like cocaine, methamphetamine, and nicotine poses a continuing medical and social challenge both in the United States and all over the world. Despite a desire to quit drug use, return to drug use after a period of abstinence is a common problem among individuals dependent on psychostimulants. Recovery for psychostimulant drug-dependent individuals is particularly challenging because psychostimulant drugs induce significant changes in brain regions associated with cognitive functions leading to cognitive deficits. These cognitive deficits include impairments in learning/memory, poor decision making, and impaired control of behavioral output. Importantly, these drug-induced cognitive deficits often impact adherence to addiction treatment programs and predispose abstinent addicts to drug use relapse. Additionally, these cognitive deficits impact effective social and professional rehabilitation of abstinent addicts. The goal of this paper is to review neural substrates based on animal studies that could be pharmacologically targeted to reverse psychostimulant-induced cognitive deficits such as impulsivity and impairment in learning and memory. Further, the review will discuss neural substrates that could be used to facilitate extinction learning and thus reduce emotional and behavioral responses to drug-associated cues. Moreover, the review will discuss some non-pharmacological approaches that could be used either alone or in combination with pharmacological compounds to treat the above-mentioned cognitive deficits. Psychostimulant addiction treatment, which includes treatment for cognitive deficits, will help promote abstinence and allow for better rehabilitation and integration of abstinent individuals into society.

Contributions of medial prefrontal cortex to decision making involving risk of punishment

The prefrontal cortex (PFC) plays an important role in several forms of cost-benefit decision making. Its contributions to decision making under risk of explicit punishment, however, are not well understood. A rat model was used to investigate the role of the medial PFC (mPFC) and its monoaminergic innervation in a Risky Decision-making Task (RDT), in which rats chose between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of mild footshock punishment. Inactivation of mPFC increased choice of the large, risky reward when the punishment probability increased across the session ("ascending RDT"), but decreased choice of the large, risky reward when the punishment probability decreased across the session ("descending RDT"). In contrast, enhancement of monoamine availability via intra-mPFC amphetamine reduced choice of the large, risky reward only in the descending RDT. Systemic administration of amphetamine reduced choice of the large, risky reward in both the ascending and descending RDT; however, this reduction was not attenuated by concurrent mPFC inactivation, indicating that mPFC is not a critical locus of amphetamine's effects on risk taking. These findings suggest that mPFC plays an important role in adapting choice behavior in response to shifting risk contingencies, but not necessarily in risk-taking behavior per se.

Mice lacking cyclin-dependent kinase-like 5 manifest autistic and ADHD-like behaviors

Neurodevelopmental disorders frequently share common clinical features and appear high rate of comorbidity, such as those present in patients with attention-deficit hyperactivity disorder (ADHD) and autism spectrum disorders (ASD). While characterizing behavioral phenotypes in the mouse model of cyclin-dependent kinase-like 5 (CDKL5) disorder, a neurodevelopmental disorder caused by mutations in the X-linked gene encoding CDKL5, we found that these mice manifested behavioral phenotypes mimicking multiple key features of ASD, such as impaired social interaction and communication, as well as increased stereotypic digging behaviors. These mice also displayed hyper-locomotion, increased aggressiveness and impulsivity, plus deficits in motor and associative learning, resembling primary symptoms of ADHD. Through brain region-specific biochemical analysis, we uncovered that loss of CDKL5 disrupts dopamine synthesis and the expression of social communication-related key genes, such as forkhead-box P2 and mu-opioid receptor, in the corticostriatal circuit. Together, our findings support that CDKL5 plays a role in the comorbid features of autism and ADHD, and mice lacking CDKL5 may serve as an animal model to study the molecular and circuit mechanisms underlying autism-ADHD comorbidity.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Androgen Regulation of the Mesocorticolimbic System and Executive Function

Multiple lines of evidence indicate that androgens, such as testosterone, modulate the mesocorticolimbic system and executive function. This review integrates neuroanatomical, molecular biological, neurochemical, and behavioral studies to highlight how endogenous and exogenous androgens alter behaviors, such as behavioral flexibility, decision making, and risk taking. First, we briefly review the neuroanatomy of the mesocorticolimbic system, which mediates executive function, with a focus on the ventral tegmental area (VTA), nucleus accumbens (NAc), medial prefrontal cortex (mPFC), and orbitofrontal cortex (OFC). Second, we present evidence that androgen receptors (AR) and other steroid receptors are expressed in the mesocorticolimbic system. Using sensitive immunohistochemistry and quantitative polymerase chain reaction (qPCR) techniques, ARs are detected in the VTA, NAc, mPFC, and OFC. Third, we describe recent evidence for local androgens ("neuroandrogens") in the mesocorticolimbic system. Steroidogenic enzymes are expressed in mesocorticolimbic regions. Furthermore, following long-term gonadectomy, testosterone is nondetectable in the blood but detectable in the mesocorticolimbic system, using liquid chromatography tandem mass spectrometry. However, the physiological relevance of neuroandrogens remains unknown. Fourth, we review how anabolic-androgenic steroids (AAS) influence the mesocorticolimbic system. Fifth, we describe how androgens modulate the neurochemistry and structure of the mesocorticolimbic system, particularly with regard to dopaminergic signaling. Finally, we discuss evidence that androgens influence executive functions, including the effects of androgen deprivation therapy and AAS. Taken together, the evidence indicates that androgens are critical modulators of executive function. Similar to dopamine signaling, there might be optimal levels of androgen signaling within the mesocorticolimbic system for executive functioning. Future studies should examine the regulation and functions of neurosteroids in the mesocorticolimbic system, as well as the potential deleterious and enduring effects of AAS use.

Animal models for bipolar disorder: from bedside to the cage

Bipolar disorder is characterized by recurrent manic and depressive episodes. Patients suffering from this disorder experience dramatic mood swings with a wide variety of typical behavioral facets, affecting overall activity, energy, sexual behavior, sense of self, self-esteem, circadian rhythm, cognition, and increased risk for suicide. Effective treatment options are limited and diagnosis can be complicated. To overcome these obstacles, a better understanding of the neurobiology underlying bipolar disorder is needed. Animal models can be useful tools in understanding brain mechanisms associated with certain behavior. The following review discusses several pathological aspects of humans suffering from bipolar disorder and compares these findings with insights obtained from several animal models mimicking diverse facets of its symptomatology. Various sections of the review concentrate on specific topics that are relevant in human patients, namely circadian rhythms, neurotransmitters, focusing on the dopaminergic system, stressful environment, and the immune system. We then explain how these areas have been manipulated to create animal models for the disorder. Even though several approaches have been conducted, there is still a lack of adequate animal models for bipolar disorder. Specifically, most animal models mimic only mania or depression and only a few include the cyclical nature of the human condition. Future studies could therefore focus on modeling both episodes in the same animal model to also have the possibility to investigate the switch from mania-like behavior to depressive-like behavior and vice versa. The use of viral tools and a focus on circadian rhythms and the immune system might make the creation of such animal models possible.

Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats

Nucleus accumbens core (NAcc) has been implicated in impulsive choice, as measured in delay discounting. The role of dopamine (DA) in impulsive choice has received considerable attention, whereas glutamate (Glu) has recently been shown to be an important mediator of discounting. However, research has not examined how DA or Glu receptors in NAcc mediate different aspects of delay discounting performance, that is, (a) sensitivity to reinforcer magnitude and (b) sensitivity to delayed reinforcement. Adult male Sprague-Dawley rats were first trained in a delay discounting task, in which the delay to a large magnitude food reinforcer increased across blocks of trials. Following behavioral training, rats received bilateral implantation of guide cannulas into NAcc. Half of the rats (n = 12) received infusions of the DA-selective ligands SKF 38393 (D1-like agonist: 0.03 or 0.1 μg), SCH 23390 (D1-like antagonist: 0.3 or 1.0 μg), quinpirole (D2-like agonist: 0.3 or 1.0 μg), and eticlopride (D2-like antagonist: 0.3 or 1.0 μg). The other half received infusions of the ionotropic Glu ligands MK-801 (NMDA uncompetitive antagonist: 0.3 or 1.0 μg), AP-5 (NMDA competitive antagonist: 0.3 or 1.0 μg), ifenprodil (noncompetitive antagonist at NR2B-containing NMDA receptors: 0.3 or 1.0 μg), and CNQX (AMPA competitive antagonist: 0.2 or 0.5 μg). Results showed that SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude without altering impulsive choice, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement (i.e., impulsive choice). The current results show that DA and NMDA receptors in NAcc mediate distinct aspects of discounting performance. (PsycINFO Database Record

Distinct Roles of Dopamine Receptors in the Lateral Thalamus in a Rat Model of Decisional Impulsivity

The thalamus and central dopamine signaling have been shown to play important roles in high-level cognitive processes including impulsivity. However, little is known about the role of dopamine receptors in the thalamus in decisional impulsivity. In the present study, rats were tested using a delay discounting task and divided into three groups: high impulsivity (HI), medium impulsivity (MI), and low impulsivity (LI). Subsequent in vivo voxel-based magnetic resonance imaging revealed that the HI rats displayed a markedly reduced density of gray matter in the lateral thalamus compared with the LI rats. In the MI rats, the dopamine D1 receptor antagonist SCH23390 or the D2 receptor antagonist eticlopride was microinjected into the lateral thalamus. SCH23390 significantly decreased their choice of a large, delayed reward and increased their omission of lever presses. In contrast, eticlopride increased the choice of a large, delayed reward but had no effect on the omissions. Together, our results indicate that the lateral thalamus is involved in decisional impulsivity, and dopamine D1 and D2 receptors in the lateral thalamus have distinct effects on decisional impulsive behaviors in rats. These results provide a new insight into the dopamine signaling in the lateral thalamus in decisional impulsivity.

[Effect of baicalin on ATPase and LDH and its regulatory effect on the AC/cAMP/PKA signaling pathway in rats with attention deficit hyperactivity disorder]

OBJECTIVE

To study the effect of baicalin on synaptosomal adenosine triphosphatase (ATPase) and lactate dehydrogenase (LDH) and its regulatory effect on the adenylate cyclase (AC)/cyclic adenosine monophosphate (cAMP)/protein kinase A (PKA) signaling pathway in rats with attention deficit hyperactivity disorder (ADHD).

METHODS

A total of 40 SHR rats were randomly divided into five groups: ADHD model, methylphenidate hydrochloride treatment (0.07 mg/mL), and low-dose (3.33 mg/mL), medium-dose (6.67 mg/mL), and high-dose (10 mg/mL) baicalin treatment (n=8 each). Eight WKY rats were selected as normal control group. Percoll density gradient centrifugation was used to prepare brain synaptosomes and an electron microscope was used to observe their structure. Colorimetry was used to measure the activities of ATPase and LDH in synaptosomes. ELISA was used to measure the content of AC, cAMP, and PKA.

RESULTS

Compared with the normal control group, the ADHD model group had a significant reduction in the ATPase activity, a significant increase in the LDH activity, and significant reductions in the content of AC, cAMP, and PKA (P<0.05). Compared with the ADHD model group, the methylphenidate hydrochloride group and the medium- and high-dose baicalin groups had a significant increase in the ATPase activity (P<0.05), a significant reduction in the LDH activity (P<0.05), and significant increases in the content of AC, cAMP, and PKA (P<0.05). Compared with the methylphenidate hydrochloride group, the high-dose baicalin group had significantly greater changes in these indices (P<0.05). Compared with the low-dose baicalin group, the high-dose baicalin group had a significant increase in the ATPase activity (P<0.05); the medium- and high-dose baicalin groups had a significant reduction in the LDH activity (P<0.05) and significant increases in the content of AC, cAMP, and PKA (P<0.05). Compared with the medium-dose baicalin group, the high-dose baicalin group had a significant increase in the ATPase activity (P<0.05).

CONCLUSIONS

Both methylphenidate hydrochloride and baicalin can improve synaptosomal ATPase and LDH activities in rats with ADHD. The effect of baicalin is dose-dependent, and high-dose baicalin has a significantly greater effect than methylphenidate hydrochloride. Baicalin exerts its therapeutic effect possibly by upregulating the AC/cAMP/PKA signaling pathway.

Frontal Traumatic Brain Injury Increases Impulsive Decision Making in Rats: A Potential Role for the Inflammatory Cytokine Interleukin-12

Traumatic brain injury (TBI) is associated with the development of numerous psychiatric diseases. Of particular concern for TBI patients is the impact of chronic impulsivity on daily functioning. Despite the scope of the human problem, little has been done to address impulsivity in animal models of brain injury. In the current study, we examined the effects of either a severe or a milder bilateral frontal controlled cortical impact injury on impulsivity using the Delay Discounting Task (DDT), in which preference for smaller-sooner over larger-later rewards is indicative of greater impulsive choice. Both milder and severe TBI caused a significant, chronic increase in impulsive decision making. Despite these pronounced changes in performance of the DDT, memory function, as assessed by the Morris Water Maze, was not impaired in more mildly injured rats and only transiently impacted in the severe TBI group. Whereas a significant lesion was only evident in severely injured rats, analysis of cytokine levels within the frontal cortex revealed a selective increase in interleukin (IL)-12 that was associated with the magnitude of the change in impulsive choice caused by both milder and severe TBI. These findings suggest that tissue loss alone cannot explain the increased impulsivity observed, and that inflammatory pathways mediated by IL-12 may be a contributing factor. The findings from this study highlight the sensitivity of sophisticated behavioral measures designed to assess neuropsychiatric dysfunction in the detection of TBI-induced cognitive impairments and their utility in identifying potential mechanistic pathways and therapeutic targets.

Deep Brain Stimulation of the Nucleus Accumbens Core Affects Trait Impulsivity in a Baseline-Dependent Manner

Deep brain stimulation (DBS) of the nucleus accumbens (NA) is explored as a treatment for refractory psychiatric disorders, such as obsessive-compulsive disorder (OCD), depressive disorder (MDD), and substance use disorder (SUD). A common feature of some of these disorders is pathological impulsivity. Here, the effects of NAcore DBS on impulsive choice and impulsive action, two distinct forms of impulsive behavior, were investigated in translational animal tasks, the delayed reward task (DRT) and five-choice serial reaction time task (5-CSRTT), respectively. In both tasks, the effects of NAcore DBS were negatively correlated with baseline impulsive behavior, with more pronounced effects in the 5-CSRTT. To further examine the effects of DBS on trait impulsive action, rats were screened for high (HI) and low (LI) impulsive responding in the 5-CSRTT. NAcore DBS decreased impulsive, premature responding in HI rats under conventional conditions. However, upon challenged conditions to increase impulsive responding, NAcore DBS did not alter impulsivity. These results strongly suggest a baseline-dependent effect of DBS on impulsivity, which is in line with clinical observations.

Impulsive Rats Exhibit Blunted Dopamine Release Dynamics during a Delay Discounting Task Independent of Cocaine History

The inability to wait for a large, delayed reward when faced with a small, immediate one, known as delay discounting, has been implicated in a number of disorders including substance abuse. Individual differences in impulsivity on the delay discounting task are reflected in differences in neural function, including in the nucleus accumbens (NAc) core. We examined the role of a history of cocaine self-administration, as well as individual differences in impulsivity, on rapid dopamine (DA) release dynamics in the NAc core. Rats with a history of cocaine or water/saline self-administration were tested on delay discounting while being simultaneously assayed for rapid DA release using electrochemical methods. In controls, we found that cue DA release was modulated by reward delay and magnitude, consistent with prior reports. A history of cocaine had no effect on either delay discounting or DA release dynamics. Nonetheless, independent of drug history, individual differences in impulsivity were related to DA release in the NAc core. First, high impulsive animals exhibited dampened cue DA release during the delay discounting task. Second, reward delay and magnitude in high impulsive animals failed to robustly modulate changes in cue DA release. Importantly, these two DAergic mechanisms were uncorrelated with each other and, together, accounted for a high degree of variance in impulsive behavior. Collectively, these findings demonstrate two distinct mechanisms by which rapid DA signaling may influence impulsivity, and illustrate the importance of NAc core DA release dynamics in impulsive behavior.

The Role of Dopamine D1 and D3 Receptors in N-Methyl-D-Aspartate (NMDA)/GlycineB Site-Regulated Complex Cognitive Behaviors following Repeated Morphine Administration

BACKGROUND

Opiate addiction is associated with complex cognitive impairment, which contributes to the development of compulsive drug use and relapses. Dopamine and N-methyl-D-aspartate receptors play critical roles in opiate-induced cognitive deficits. However, the roles of D1 and D3 receptors in the N-methyl-D-aspartate/glycineB receptor-regulated cognitive behaviors induced by morphine remain unknown.

METHODS

The 5-choice serial reaction time task was used to investigate the cognitive profiles associated with repeated morphine administration in D1 (D1-/-)- and D3 (D3-/-)-receptor knockout mice. The expression of phosphorylated NR1, Ca2+/calmodulin-dependent protein kinase II (CaMKII), and cAMP response element-binding protein (CREB) in the brain was examined by western blotting. D1-/- and D3-/- mice were treated with the N-methyl-D-aspartate/glycineB site agonist l-aminocyclopropanecarboxylic acid and the antagonist L-701,324 to chronically disrupt N-methyl-D-aspartate receptor function and investigate their effects on morphine-induced cognitive changes.

RESULTS

Repeated morphine administration impaired attentional function and caused impulsive and compulsive behaviors. D1-/- mice exhibited hardly any premature nosepokes. D3-/- mice showed robustly increased morphine-induced impulsive behavior. The numbers of premature responses were decreased by L-701,324 administration and increased by ACPC administration; these effects were completely abolished in D1-/- mice due to their inability to perform reward-based tasks. In contrast, the inhibitory effects of L-701,324 on impulsive behavior were significantly augmented in D3-/- mice.

CONCLUSIONS

N-methyl-D-aspartate/glycineB site functions may contribute to morphine-induced cognitive deficits, especially those related to impulsive behavior. D1 and D3 receptors may have contrasting effects with respect to modulating impulsive behavior. D3 receptors have inhibitory effects on impulsive behaviors, and these effects are clearly mediated by N-methyl-D-aspartate/glycineB receptor and μ-opioid receptor interactions.

A framework for understanding and advancing intertemporal choice research using rodent models

Intertemporal choices are common and consequential to private and public life. Thus, there is considerable interest in understanding the neural basis of intertemporal decision making. In this minireview, we briefly describe conceptual and psychological perspectives on intertemporal choice and then provide a comprehensive evaluation of the neural structures and signals that comprise the underlying cortico-limbic-striatal circuit. Even though great advances have been made, our understanding of the neurobiology of intertemporal choice is still in its infancy because of the complex and dynamic nature of this form of decision making. We close by briefly discussing recommendations for the future study of intertemporal choice research.

Dopamine D1 and D3 Receptors Modulate Heroin-Induced Cognitive Impairment through Opponent Actions in Mice

BACKGROUND

Chronic abuse of heroin leads to long-lasting and complicated cognitive impairment. Dopamine receptors are critically involved in the impulsive drug-driven behavior and the altered attention, processing speed, and mental flexibility that are associated with higher relapse rates. However, the effects of the different dopamine receptors and their possible involvement in heroin-induced cognitive impairment remain unclear.

METHODS

The 5-choice serial reaction time task was used to investigate the profiles of heroin-induced cognitive impairment in mice. The expression levels of dopamine D1- and D2-like receptors in the prefrontal cortex, nucleus accumbens, and caudate-putamen were determined. The effects of dopamine receptors on heroin-induced impulsivity in the 5-choice serial reaction time task were examined by agonist/antagonist treatment on D1 or D3 receptor mutant mice.

RESULTS

Systemic heroin administration influences several variables in the 5-choice serial reaction time task, most notably premature responses, a measure of motor impulsivity. These behavioral impairments are associated with increased D1 receptor and decreased D3 receptor mRNA and protein levels in 3 observed brain areas. The heroin-evoked increase in premature responses is mimicked by a D1 agonist and prevented by a D1 antagonist or genetic ablation of the D1 receptor gene. In contrast, a D3 agonist decreases both basal and heroin-evoked premature responses, while genetic ablation of the D3 receptor gene results in increased basal and heroin-evoked premature responses.

CONCLUSIONS

Heroin-induced impulsive behavior in the 5-choice serial reaction time task is oppositely modulated by D1 and D3 receptor activation. The D1 receptors in the cortical-mesolimbic region play an indispensable role in modulating such behaviors.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

Preventative treatment in an animal model of ADHD: Behavioral and biochemical effects of methylphenidate and its interactions with ovarian hormones in female rats

Clinical and preclinical studies on attention deficit hyperactivity disorder (ADHD) show that juvenile males that are exposed to methylphenidate (MPH) show reduced risk for substance use later in life. In contrast, little is known about whether females have the same enduring treatment response to stimulants and how gonadal hormones influence their behavior later in life. Females received either a sham or 6-hydroxydopamine (6-OHDA) microinjection in the prefrontal cortex (PFC) at postnatal day (P)10. Subjects were then treated with Vehicle or MPH (2mg/kg, p.o.) between P20-35 and tested during late adolescence/young adulthood (P60); half of these subjects underwent ovariectomy at P55 to determine hormonal influences. Females with 6-OHDA were depleted of PFC dopamine by 61% and demonstrated increased impulsive choice (delayed discounting) and preferences for cocaine-associated environments relative to control females. Both MPH and ovariectomy reduced impulsive choice and cocaine preferences in 6-OHDA females, but had no enduring effect in Sham females. Ovariectomy itself did not significantly affect impulsivity. Juvenile MPH interacted strongly with 6-OHDA to increase D4, D5, Alpha-1A, Alpha-2A, and 5-HT-1A mRNA receptor expression in the PFC. MPH alone effected D1 mRNA, while 6-OHDA increased BDNF; all markers were decreased by ovariectomy. Together, these data suggest that 6-OHDA changes in dopamine are not only relevant for ADHD-like behaviors, but their long-term modulation by treatment and the influence of cyclical differences in menstrual cycle.

Methylphenidate has nonlinear dose effects on cued response inhibition in adults but not adolescents

Ongoing development of the dopamine system during adolescence may provide a partial mechanism for behavioral and psychiatric vulnerabilities. Despite early evidence for a hyperactive adolescent dopaminergic system, recent data suggest that adolescent dopamine may be functionally hypoactive compared to in adults. While this distinction has been established in response to dopaminergic drugs and natural rewards, little is known about age-related differences in cognitive efficacy of dopaminergic drugs. Using a recently established Cued Response Inhibition Task, we tested the effects of acute systemic methylphenidate, commonly known as Ritalin, on response inhibition and response initiation in adolescent and adults rats. First, we replicated previous data that adolescents are able to inhibit a response to a cue on par with adults, but are slower to produce a rewarded response after a stop cue. Next, we observed that methylphenidate modulated response inhibition in adult rats, with low dose (0.3mg/kg) improving inhibition, and high dose (3mg/kg) impairing performance. This dose-response pattern is commonly observed with psychostimulant cognitive modulation. In adolescents, however, methylphenidate had no effect on response inhibition at any dose. Latency of response initiation after the stop cue was not affected by methylphenidate in either adult or adolescent rats. These data establish that dose-response of a commonly prescribed psychostimulant medication is different in adolescents and adults. They further demonstrate that healthy adolescent response inhibition is not as sensitive to psychostimulants as in adults, supporting the idea that the dopamine system is hypoactive in adolescence. This article is part of a Special Issue entitled SI: Adolescent plasticity.

Dopamine D1 and D2 Receptors Make Dissociable Contributions to Dorsolateral Prefrontal Cortical Regulation of Rule-Guided Oculomotor Behavior

Studies of neuromodulation of spatial short-term memory have shown that dopamine D1 receptor (D1R) stimulation in dorsolateral prefrontal cortex (DLPFC) dose-dependently modulates memory activity, whereas D2 receptors (D2Rs) selectively modulate activity related to eye movements hypothesized to encode movement feedback. We examined localized stimulation of D1Rs and D2Rs on DLPFC neurons engaged in a task involving rule representation in memory to guide appropriate eye movements toward or away from a visual stimulus. We found dissociable effects of D1R and D2R on DLPFC physiology. D1R stimulation degrades memory activity for the task rule and increases stimulus-related selectivity. In contrast, D2R stimulation affects motor activity tuning only when eye movements are made to the stimulus. Only D1R stimulation degrades task performance and increases impulsive responding. Our results suggest that D1Rs regulate rule representation and impulse control, whereas D2Rs selectively modulate eye-movement-related dynamics and not rule representation in the DLPFC.

When the party is over: depressive-like states in rats following termination of cortical D1 receptor overexpression

RATIONALE

Increased activity of prefrontal D1 dopamine receptors (D1R) is involved in reward-related behavior found in bipolar disorder and drug addiction. While the effects of elevated D1R are known, depressive-like behaviors also occur in these disorders after reward-seeking ends.

OBJECTIVES

The goal is to characterize how termination of D1R overexpression influences depressive-like behaviors.

METHODS

An inducible (Tet.On), lentiviral vector was used to manipulate the expression of the DRD1 gene in glutamate neurons within the prefrontal cortex in male, adult rats. Sexual activity and sucrose preference were studied in both D1R elevated ON and relatively reduced OFF states. Following termination of the D1R ON state, depressive-like behavior was determined in the OFF state. Expression of the transcriptional regulator, cyclic AMP-responsive element-binding protein (CREB), was used as an indication of downstream effects in the nucleus accumbens (NA).

RESULTS

ON D1R expression increased sexual activity that returned to baseline in the OFF state. Sucrose preferences increased ~6 % in ON state but fell 11 % below control levels when OFF. Consistent with a depressive-like phenotype, D1R OFF decreased activity by 40 %, impaired the ability to control (43 %) and motivation to escape shock (27 % more impaired) relative to dsRed OFF. CREB increased 29 % in the NA in the D1R OFF state relative to the ON state.

CONCLUSIONS

This novel approach demonstrates that elevated D1R expression increased hedonic behavior, whereas the termination of D1R overexpression often resulted in depressive-like behavior. These observations support a role for D1R expression cycling in bipolar-associated behaviors and addiction.

Testing the Relations Among Family Disorganization, Delay Discounting, and Adolescent Alcohol Use: A Genetically Informed Study

BACKGROUND

Delay discounting is a potential etiological factor in adolescents' alcohol use, making it important to understand its antecedents. Family disorganization might contribute to delay discounting, but few studies have tested this relation. Moreover, because delay discounting is heritable, the effects of family disorganization on delay discounting might be moderated by adolescents' genetic risk for delay discounting. Thus, the current study examined the role of family disorganization, in interaction with genetic risk, in predicting adolescents' delay discounting and subsequent alcohol use.

METHODS

Adolescents participated in 4 waves of data collection. Adolescents self-reported their family disorganization at T1, completed a delay discounting questionnaire at T3, and self-reported their alcohol use both at T2 (covariate) and T4 (outcome). Using results from an independent sample, we created a polygenic risk score consisting of dopaminergic genes to index genetic risk for delay discounting.

RESULTS

Greater family disorganization predicted adolescents' greater delay discounting, but only for adolescents with low levels of genetic risk for delay discounting. Adolescents with high and mean levels of genetic risk for delay discounting showed elevated delay discounting regardless of their family's disorganization. Greater delay discounting prospectively predicted adolescents' greater alcohol use. Finally, the effects of family disorganization on adolescents' alcohol use were mediated through delay discounting, but only for adolescents with low levels of genetic risk.

CONCLUSIONS

Results suggest multiple pathways to delay discounting. Although there are genetically influenced pathways to delay discounting, family disorganization might represent an environmental pathway to delay discounting (and subsequent alcohol use) for a subset of adolescents at low genetic risk. These findings reinforce the utility of family interventions for reducing adolescents' delay discounting and alcohol use, at least for a subgroup of adolescents. Because higher family organization did not buffer against delay discounting among adolescents with high genetic risk, future research should explore other early environmental influences that could protect these high-risk adolescents from developing these risky behaviors.

Differential effects of co-administration of oxotremorine with SCH 23390 on impulsive choice in high-impulsive rats and low-impulsive rats

The effect of acetylcholine on impulsive choice is thought to be due to interactions between cholinergic and dopaminergic systems, but this hypothesis has not been proven. This study investigated whether D1-like receptors were involved in the effects of the muscarinic cholinergic agonist oxotremorine on impulsive choice in high-impulsive rats (HI rats, n=8) and low-impulsive rats (LI rats, n=8) characterized by basal levels of impulsive choice in a delay-discounting task. The results revealed that oxotremorine (0.05mg/kg) significantly increased the choice of the large reinforcer in HI rats, whereas decreased the choice of the large reinforcer in LI rats. The D1-like antagonist SCH 23390 produced significant reductions in the large-reinforcer choice in HI rats (0.01mg/kg) and LI rats (0.005, 0.0075, and 0.01mg/kg). SCH 23390 significantly inhibited the increase in the choice of the large reinforcer induced by oxotremorine (0.05mg/kg) in HI rats at doses of 0.005 and 0.0075mg/kg, but enhanced the effect of oxotremorine in LI rats only at the dose of 0.0075mg/kg. These findings suggested that D1-like receptors might be involved in the differential effects of oxotremorine on impulsive choice between HI rats and LI rats.

Impulsivity trait in the early symptomatic BACHD transgenic rat model of Huntington disease

Impulsivity trait was characterized in 3-5 months old BACHD rats, a transgenic model of Huntington disease, using (1) the delay discounting task to assess cognitive/choice impulsivity, and (2) the Differential Reinforcement of Low Rate of Responding task to evaluate motor/action impulsivity. Transgenic animals showed a high level of choice impulsivity and, to a lesser extent, action impulsivity. Our results provide the first evidence that the transgenic BACHD rat (TG5 line) displays impulsivity disorder as early as 3 months old, as described in early symptomatic HD patients, thus adding to the face validity of the rat model.

Mesocorticolimbic dopamine functioning in primary psychopathy: A source of within-group heterogeneity

Despite similar emotional deficiencies, primary psychopathic individuals can be situated on a continuum that spans from controlled to disinhibited. The constructs on which primary psychopaths are found to diverge, such as self-control, cognitive flexibility, and executive functioning, are crucially regulated by dopamine (DA). As such, the goal of this review is to examine which specific alterations in the meso-cortico-limbic DA system and corresponding genes (e.g., TH, DAT, COMT, DRD2, DRD4) might bias development towards a more controlled or disinhibited expression of primary psychopathy. Based on empirical data, it is argued that primary psychopathy is generally related to a higher tonic and population activity of striatal DA neurons and lower levels of D2-type DA receptors in meso-cortico-limbic projections, which may boost motivational drive towards incentive-laden goals, dampen punishment sensitivity, and increase future reward-expectancy. However, increasingly higher levels of DA activity in the striatum (moderate versus pathological elevations), lower levels of DA functionality in the prefrontal cortex, and higher D1-to-D2-type receptor ratios in meso-cortico-limbic projections may lead to increasingly disinhibited and impetuous phenotypes of primary psychopathy. Finally, in order to provide a more coherent view on etiological mechanisms, we discuss interactions between DA and serotonin that are relevant for primary psychopathy.

Dopamine Receptors and Neurodegeneration

Dopamine (DA) is one of the major neurotransmitters and participates in a number of functions such as motor coordination, emotions, memory, reward mechanism, neuroendocrine regulation etc. DA exerts its effects through five DA receptors that are subdivided in 2 families: D1-like DA receptors (D1 and D5) and the D2-like (D2, D3 and D4). All DA receptors are widely expressed in the central nervous system (CNS) and play an important role in not only in physiological conditions but also pathological scenarios. Abnormalities in the DAergic system and its receptors in the basal ganglia structures are the basis Parkinson's disease (PD), however DA also participates in other neurodegenerative disorders such as Huntington disease (HD) and multiple sclerosis (MS). Under pathological conditions reorganization of DAergic system has been observed and most of the times, those changes occur as a mechanism of compensation, but in some cases contributes to worsening the alterations. Here we review the changes that occur on DA transmission and DA receptors (DARs) at both levels expression and signals transduction pathways as a result of neurotoxicity, inflammation and in neurodegenerative processes. The better understanding of the role of DA receptors in neuropathological conditions is crucial for development of novel therapeutic approaches to treat alterations related to neurodegenerative diseases.

Mechanisms of impulsive choice: II. Time-based interventions to improve self-control

Impulsive choice behavior has been proposed as a primary risk factor for other maladaptive behaviors (e.g., gambling, substance abuse). Recent research has suggested that timing processes may play a key role in impulsive choice behavior, and could provide an avenue for altering impulsive choice. Accordingly, the current experiments assessed a set of time-based behavioral interventions to increase self-control while simultaneously assessing effects on timing processes within the impulsive choice task. Three experiments assessed temporal interventions using a differential reinforcement of low rates task (Experiment 1) and exposure to either a variable or fixed interval schedule (Experiments 2-3). The efficacy of the interventions was assessed in Sprague-Dawley (Experiments 1-2) and Lewis (Experiment 3) rat strains. Impulsive choice behavior was assessed by measuring preferences of a smaller-sooner (SS) versus a larger-later (LL) reward, while timing of the SS and LL durations was measured during peak trials within the impulsive choice procedure. The rats showed an increased preference for the LL following all three time-based interventions and also displayed increased temporal precision. These results add to the increasing evidence that supports a possible role for temporal processing in impulsive choice behavior and supply novel behavioral interventions to decrease impulsive behavior.

Do the adjusting-delay and increasing-delay tasks measure the same construct: delay discounting?

Delay discounting describes the subjective devaluation of a reward when it is delayed. In animals, the adjusting-delay (AD) and increasing-delay (ID) tasks often are used to assess individual differences in, and drug effects on, delay discounting. No study to date, however, has compared systematically the measures of discounting produced in these tasks. The current study examined the correlation between measures of delay discounting derived from AD and ID procedures. Twenty rats completed 30 sessions under each task (order counterbalanced across rats). Quantitative measures of delay discounting produced by the two tasks were positively correlated, suggesting that the AD and ID tasks measure the same underlying facet of impulsive choice (i.e. individual or conjoint sensitivities to reward delay and magnitude). The measures derived from either task, however, depended on the sequences in which the tasks were experienced. That is, pre-exposure to one task decreased discounting of delayed rewards in the second task. Consistent with other published findings, exposure to delayed consequences during the initial discounting assessment might explain this effect. Despite the observed correlation between ID and AD indifference delays, we suggest that the ID procedure might be a more appropriate procedure for pharmacological studies.

Convergent pharmacological mechanisms in impulsivity and addiction: insights from rodent models

Research over the last two decades has widely demonstrated that impulsivity, in its various forms, is antecedent to the development of drug addiction and an important behavioural trait underlying the inability of addicts to refrain from continued drug use. Impulsivity describes a variety of rapidly and prematurely expressed behaviours that span several domains from impaired response inhibition to an intolerance of delayed rewards, and is a core symptom of attention deficit hyperactivity disorder (ADHD) and other brain disorders. Various theories have been advanced to explain how impulsivity interacts with addiction both causally and as a consequence of chronic drug abuse; these acknowledge the strong overlaps in neural circuitry and mechanisms between impulsivity and addiction and the seemingly paradoxical treatment of ADHD with stimulant drugs with high abuse potential. Recent years have witnessed unprecedented progress in the elucidation of pharmacological mechanisms underpinning impulsivity. Collectively, this work has significantly improved the prospect for new therapies in ADHD as well as our understanding of the neural mechanisms underlying the shift from recreational drug use to addiction. In this review, we consider the extent to which pharmacological interventions that target impulsive behaviour are also effective in animal models of addiction. We highlight several promising examples of convergence based on empirical findings in rodent-based studies.

Recent Insights into the Neurobiology of Impulsivity

Impulsivity is associated with various psychopathologies, and elevated impulsivity is typically disadvantageous. This manuscript reviews recent investigations into the neurobiology of impulsivity using human imaging techniques and animal models. Both human imaging and preclinical pharmacological manipulations have yielded important insights into the neurobiological underpinnings of impulsivity. A more thorough understanding of the complex neurobiology underlying aspects of impulsivity may provide insight into new treatment options that target elevated impulsivity and psychopathologies such as addictions.

Intake-dependent effects of cocaine self-administration on impulsive choice in a delay discounting task

Cocaine use is associated with high levels of impulsive choice (greater discounting of delayed rewards) in humans, but the cause/effect relationships between cocaine use and impulsive choice are not fully understood. In previous work, we found that both experimenter- and self-administration of fixed quantities of cocaine caused lasting increases in impulsive choice in rats. The present study extended these findings by taking into account baseline impulsive choice prior to self-administration and by allowing rats free access to cocaine. Male Long-Evans rats were trained in a delay discounting task in which they made discrete-trial choices between small immediate and large delayed food rewards. Half of the rats were then implanted with intravenous catheters and, following recovery, allowed to self-administer cocaine HCl (1.0 mg/kg/infusion) in 6-hr sessions over 14 days. Control rats orally self-administered a sucrose solution under similar conditions. Upon completion of self-administration, rats remained abstinent for 3 weeks before retesting in the delay discounting task. Cocaine and control groups did not differ prior to self-administration, but afterward, the cocaine group showed greater impulsive choice (fewer choices of large, delayed rewards) than controls. Additional analyses revealed that the effects of cocaine on impulsive choice were intake-dependent; rats classified as "low intake" did not differ from controls, whereas rats classified as "high intake" were significantly more impulsive than both controls and their precocaine baseline. These findings are consistent with the idea that cocaine-induced, pharmacologically based neural adaptations promote the development of impulsive decision making.

Partial inactivation of nucleus accumbens core decreases delay discounting in rats without affecting sensitivity to delay or magnitude

Increased preference for smaller, sooner rewards (delay discounting) is associated with several behavioral disorders, including ADHD and substance use disorders. However, delay discounting is a complex cognitive process and the relationship is unclear between the pathophysiology of the disorders and the component processes underlying delay discounting, including sensitivity to reinforcer delay and sensitivity to reinforcer magnitude. To investigate these processes, male Long Evans rats were trained in one of three tasks measuring sensitivity to delay, sensitivity to magnitude, or both (typical delay discounting task). After learning the task, animals were implanted with bilateral cannulae into either the nucleus accumbens core (AcbC) or the lateral orbitofrontal cortex (lOFC), both of which have been implicated in delay discounting. Upon recovering from the surgery, a baclofen/muscimol cocktail was infused to temporarily inactivate each of these two regions and task performance was assessed. Unlike previous studies showing that lesions of the AcbC increased delay discounting, partial inactivation of the AcbC decreased delay discounting, although it had no effects on the tasks independently assessing either sensitivity to delay or magnitude. The effects of AcbC inactivation were larger in animals that had low levels of delay discounting at baseline. Inactivation of the lOFC had no effects on behavior in any task. These findings suggest that the AcbC may act to promote impulsive choice in individuals with low impulsivity. Furthermore, the data suggest that the AcbC is able to modulate delay and magnitude sensitivity together, but not either of the two in isolation.

Role of medial prefrontal and orbitofrontal monoamine transporters and receptors in performance in an adjusting delay discounting procedure

Performance in an adjusting delay discounting procedure is predictive of drug abuse vulnerability; however, the shared underlying specific prefrontal neural systems linking delay discounting and increased addiction-like behaviors are unclear. Rats received direct infusions of methylphenidate (MPH; 6.25, 25.0, or 100μg), amphetamine (AMPH; 0.25, 1.0, or 4.0μg), or atomoxetine (ATO; 1.0, 4.0, or 16.0μg) into either medial prefrontal cortex (mPFC) or orbitofrontal cortex (OFC) immediately prior to performance in an adjusting delay task. These drugs were examined because they are efficacious in treating impulse control disorders. Because dopamine (DA) and serotonin (5-HT) receptors are implicated in impulsive behavior, separate groups of rats received microinfusions of the DA receptor-selective drugs SKF 81297 (0.1 or 0.4µg), SCH 23390 (0.25 or 1.0µg), quinpirole (1.25 or 5.0µg), and eticlopride (0.25 or 1.0µg), or received microinfusions of the 5-HT receptor-selective drugs 8-OH-DPAT (0.025 or 0.1μg), WAY 100635 (0.01 or 0.04μg), DOI (2.5 or 10.0μg), and ketanserin (0.1 or 0.4μg). Impulsive choice was not altered significantly by MPH, AMPH, or ATO into either mPFC or OFC, indicating that neither of these prefrontal regions alone may mediate the systemic effect of ADHD medications on impulsive choice. However, quinpriole (1.25μg) and eticlopride infused into mPFC increased impulsive choice, whereas 8-OH-DPAT infused into OFC decreased impulsive choice. These latter results demonstrate that blockade of DA D2 receptors in mPFC or activation of 5-HT1A receptors in OFC increases impulsive choice in the adjusting delay procedure.

Environmental rearing effects on impulsivity and reward sensitivity

Previous research has indicated that rearing in an enriched environment may promote self-control in an impulsive choice task. To further assess the effects of rearing environment on impulsivity, 2 experiments examined locomotor activity, impulsive action, impulsive choice, and different aspects of reward sensitivity and discrimination. In Experiment 1, rats reared in isolated or enriched conditions were tested on an impulsive choice procedure with a smaller-sooner versus a larger-later reward, revealing that the isolated rats valued the smaller-sooner reward more than the enriched rats. A subsequent reward challenge was presented in which the delay to the 2 rewards was the same but the magnitude difference remained. The enriched rats did not choose the larger reward as often as the isolated rats, reflecting poorer reward discrimination. Impulsive action was assessed using a differential-reinforcement-of-low-rate task, which revealed deficits in the enriched rats. In Experiment 2, rats reared in isolated, standard, or enriched conditions were tested on reward contrast and reward magnitude sensitivity procedures. The rats were presented with 2 levers that delivered different magnitudes of food on variable interval 30-s schedules. Across all tests, the enriched and social rats displayed more generalized responding to the small-reward lever, but a similar response to the large-reward lever, compared with the isolated rats. This confirmed the results of Experiment 1, indicating poorer reward discrimination in the enriched condition compared with the isolated condition. The results suggest that enrichment may moderate reward generalization/discrimination processes through alterations in incentive motivational processes.