Effects of nucleus accumbens amphetamine administration on performance in a delay discounting task

Effects of reproductive experience on cost-benefit decision making in female rats

Many individuals undergo mating and/or other aspects of reproductive experience at some point in their lives, and pregnancy and childbirth in particular are associated with alterations in the prevalence of several psychiatric disorders. Research in rodents shows that maternal experience affects spatial learning and other aspects of hippocampal function. In contrast, there has been little work in animal models concerning how reproductive experience affects cost-benefit decision making, despite the relevance of this aspect of cognition for psychiatric disorders. To begin to address this issue, reproductively experienced (RE) and reproductively naïve (RN) female Long-Evans rats were tested across multiple tasks that assess different forms of cost-benefit decision making. In a risky decision-making task, in which rats chose between a small, safe food reward and a large food reward accompanied by variable probabilities of punishment, RE females chose the large risky reward significantly more frequently than RN females (greater risk taking). In an intertemporal choice task, in which rats chose between a small, immediate food reward and a large food reward delivered after a variable delay period, RE females chose the large reward less frequently than RN females. Together, these results show distinct effects of reproductive experience on different forms of cost-benefit decision making in female rats, and highlight reproductive status as a variable that could influence aspects of cognition relevant for psychiatric disorders.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Cognitive mechanisms underlying decision making involving risk of explicit punishment in male and female rats

Individuals engage in the process of risk-based decision making on a daily basis to navigate various aspects of life. There are, however, individual differences in this form of decision making, with some individuals exhibiting preference for riskier choices (risk taking) and others exhibiting preference for safer choices (risk aversion). Recent work has shown that extremes in risk taking (e.g., excessive risk taking or risk aversion) are not only cognitive features of neuropsychiatric diseases, but may in fact predispose individuals to the development of such diseases. To better understand individual differences in risk taking, and thus the mechanisms by which they confer disease vulnerability, the current study investigated the cognitive contributions to risk taking in both males and females. Rats were first behaviorally characterized in a decision-making task involving risk of footshock punishment and then tested on a battery of cognitive behavioral assays. Individual variability in risk taking was compared with performance on these tasks. Consistent with prior work, females were more risk averse than males. With the exception of the Set-shifting Task, there were no sex differences in performance on other cognitive assays. There were, however, sex-dependent associations between risk taking and specific cognitive measures. Greater risk taking was associated with better cognitive flexibility in males whereas greater risk aversion was associated with better working memory in females. Collectively, these findings reveal that distinct cognitive mechanisms are associated with risk taking in males and females, which may account for sex differences in this form of decision making.

The Effects of Drug Treatments for ADHD in Measures of Cognitive Performance

Based on core symptoms of inattention and deficient impulse control, and the identification of effective pharmacotherapies such as amphetamine (AMP; Adderall^®), methylphenidate (MPH; Ritalin^®), and atomoxetine (ATX; Strattera^®), ADHD is a clinical condition which provides opportunity for translational research. Neuropsychological tests such as the 5-Choice and Continuous Performance Tasks, which measure aspects of attention and impulse control in animals and humans, provide scope for both forward (animal to human) and reverse (human to animal) translation. Rodent studies support pro-attentive effects of AMP and MPH and effectiveness in controlling some forms of impulsive behavior. In contrast, any pro-attentive effects of ATX appear to be less consistent, the most reliable effects of ATX are recorded in tests of impulsivity. These differences may account for AMP and MPH being recognized as first-line treatments for ADHD with a higher efficacy relative to ATX. DSM-5 classifies three "presentations" of ADHD: predominantly inattentive type (ADHD-I), predominantly hyperactive/impulsive type (ADHD-HI), or combined (ADHD-C). Presently, it is unclear whether AMP, MPH, or ATX has differential levels of efficacy across these presentation types. Nonetheless, these studies encourage confidence for the forward translation of NCEs in efforts to identify newer pharmacotherapies for ADHD.

Contrasting effects of d-amphetamine and atomoxetine on measures of impulsive action and choice

Amphetamine (AMP) and atomoxetine (ATX) represent two of the most widely studied drug treatments used in the investigation of impulsive behaviour. While both drugs have relatively well defined effects in tests designed to investigate impulsive action (e.g. 5-choice task; 5-CSRTT), the effects of both drugs in tests of impulsive choice (e.g. delay discounting) are less consistent. In the present study both AMP and ATX were tested in a rodent gambling task (rGT) and delay discounting in rats separately trained to either an ascending or descending delay schedule. Effects of both drugs were compared to measures of impulsive action (premature (PREM) responses) and perseverative (PSV) responses measured in the 5-choice and rGT tasks. Consistent with previous studies, AMP (0.1-1 mg/kg) increased both PREM and PSV responses, and ATX (0.5-2 mg/kg) reduced both measures in the 5-choice and rGT tasks. At equivalent doses ATX had no reliable effect on choice behaviour in either the rGT or delay discounting suggesting a null effect of this drug on impulsive choice and risky decision making. The effects of AMP were more complex, with a subtle shift in preference to a low risk (P1) choice in the rGT, and an effect on discounting that was unrelated to reinforcer value, but instead dependent on delay sequence and baseline choice preference. One aspect to these outcomes is to highlight the importance of multiple methodological factors when assessing drug effects on complex behaviours such as impulsive choice, and question what are the most appropriate test conditions under which to examine these drugs on discounting.

Dopaminergic modulation of reward discounting in healthy rats: a systematic review and meta-analysis

RATIONALE

Although numerous studies have suggested that pharmacological alteration of the dopamine (DA) system modulates reward discounting, these studies have produced inconsistent findings.

OBJECTIVES

Here, we conducted a systematic review and pre-registered meta-analysis to evaluate DA drug-mediated effects on reward discounting of time, probability, and effort costs in studies of healthy rats. This produced a total of 1343 articles to screen for inclusion/exclusion. From the literature, we identified 117 effects from approximately 1549 individual rats.

METHODS

Using random effects with maximum-likelihood estimation, we meta-analyzed placebo-controlled drug effects for (1) DA D1-like receptor agonists and (2) antagonists, (3) D2-like agonists and (4) antagonists, and (5) DA transporter-modulating drugs.

RESULTS

Meta-analytic effects showed that DAT-modulating drugs decreased reward discounting. While D1-like and D2-like antagonists both increased discounting, agonist drugs for those receptors had no significant effect on discounting behavior. A number of these effects appear contingent on study design features like cost type, rat strain, and microinfusion location.

CONCLUSIONS

These findings suggest a nuanced relationship between DA and discounting behavior and urge caution when drawing generalizations about the effects of pharmacologically manipulating dopamine on reward-based decision-making.

Effects of a high-fat diet on impulsive choice in rats

INTRODUCTION

Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice.

METHODS

Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward.

RESULTS

There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward.

CONCLUSIONS

These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.

Involvement of noradrenergic and serotonergic systems in risk-based decisions between options of equivalent expected value in rats

Risk perception is an important factor that may mediate risk-based decision-making processes regulated by noradrenergic (NA) and serotonergic (5-HT) systems. Most risk-based decision-making models involve complex factors, such as risk perception or reward value, such that the final decision is the result of the interactions among these factors. However, the contribution of risk perception per se in risk decisions has remained unclear. Therefore, in the present study, we made some modifications to the classical probabilistic discounting task (PDT) to focus on the impact of risk perception and noradrenergic/serotonergic systems on decision-making behavior. Meanwhile, we conducted an elevated plus-maze (EPM) test to detect the correlation between anxiety and choice behavior. In the current study, rats had to choose between a "certain" lever that delivered a certain number of pellets and a "risky" lever that delivered eight pellets in a probabilistic manner (descending: 50%, 25%, 12.5% or ascending 12.5%, 25%, 50% of the time). The long-term rewarding values of the two levers were always identical in each block within each session. According to their baseline performances in choosing the risky lever, rats were divided into the risk-prefer group and risk-averse group. The results showed that there was a significant correlation between open arm time in EPM and risky choice for both descending order and ascending order, indicating that highly anxious rats more often preferred the safe option under risk. Pharmacological stimulation of α2-adrenergic receptors via dexmedetomidine (0.01 mg/kg) decreased the preference of probabilistic rewards in the risk-prefer group, while blocking α2 receptors by atipamezole (0.3 mg/kg) also reduced risky choices. The NA reuptake inhibitor, atomoxetine, increased the preference for risky choices in the risk-prefer group, the effect of which was attained via multiple superimposed doses. Administration of the 5-HT_2A receptor agonist, DOI (0.1 mg/kg), increased risk-taking behavior in the risk-prefer group. Taken together, these results suggest that NA may be more inclined to process negative information such as loss or uncertainty in the regulation of risk-related decision making, whereas 5-HT may function primarily to increase risk-taking behavior. Our findings may help to further elucidate how noradrenergic and serotonergic systems differentially affect individuals with different risk preferences in terms of regulating risk perception in risk-related decision making.

Dopaminergic contributions to behavioral control under threat of punishment in rats

RATIONALE

Excessive intake of rewards, such as food and drugs, often has explicit negative consequences, including the development of obesity and addiction, respectively. Thus, choosing not to pursue reward is the result of a cost/benefit decision, proper execution of which requires inhibition of behavior. An extensive body of preclinical and clinical evidence implicates dopamine in certain forms of inhibition of behavior, but it is not fully known how it contributes to behavioral inhibition under threat of explicit punishment.

OBJECTIVES

To assess the involvement of midbrain dopamine neurons and their corticostriatal output regions, the ventral striatum and prefrontal cortex, in control over behavior under threat of explicit (foot shock) punishment in rats.

METHODS

We used a recently developed behavioral inhibition task, which assesses the ability of rats to exert behavioral restraint at the mere sight of food reward, under threat of foot shock punishment. Using in vivo fiber photometry, chemogenetics, c-Fos immunohistochemistry, and behavioral pharmacology, we investigated how dopamine neurons in the ventral tegmental area, as well as its output areas, the ventral striatum and prefrontal cortex, contribute to behavior in this task.

RESULTS

Using this multidisciplinary approach, we found little evidence for a direct involvement of ascending midbrain dopamine neurons in inhibitory control over behavior under threat of punishment. For example, photometry recordings suggested that VTA DA neurons do not directly govern control over behavior in the task, as no differences were observed in neuronal population activity during successful versus unsuccessful behavioral control. In addition, chemogenetic and pharmacological manipulations of the mesocorticolimbic DA system had little or no effect on the animals' ability to exert inhibitory control over behavior. Rather, the dopamine system appeared to have a role in the motivational components of reward pursuit.

CONCLUSIONS

Together, our data provide insight into the mesocorticolimbic mechanisms behind motivated behaviors by showing a modulatory role of dopamine in the expression of cost/benefit decisions. In contrast to our expectations, dopamine did not appear to directly mediate the type of behavioral control that is tested in our task.

Effects of d-amphetamine and MK-801 on impulsive choice: Modulation by schedule of reinforcement and delay length

Procedural modifications can modulate drug effects in delay discounting, such as signaling the delay to reinforcement and altering the order in which delays are presented. Although the schedule of reinforcement can alter the rate at which animals discount a reinforcer, research has not determined if animals trained on different schedules of reinforcement are differentially affected by pharmacological manipulations. Similarly, research has not determined if using different delays to reinforcement can modulate drug effects in delay discounting. Male Sprague Dawley rats (n = 36) were split into four groups and were trained in a delay-discounting procedure. The schedule of reinforcement (fixed ratio [FR] 1 vs. FR 10) and delays to reinforcement (0, 5, 10, 20, and 50 s vs. 0, 10, 30, 60, 100 s) were manipulated for each group. Following behavioral training, rats were treated with d-amphetamine (0, 0.25, 0.5, and 1.0 mg/kg) and MK-801 (0, 0.03, and 0.06 mg/kg). Results showed that amphetamine decreased impulsive choice when a FR 1 schedule was used, but only when the short delay sequence was used. Conversely, amphetamine decreased impulsive choice when a FR 10 schedule was used, but only when rats were trained on the long delay sequence. MK-801 decreased impulsive choice in rats trained on a FR 1 schedule, regardless of delay sequence, but did not alter choice in rats trained on a FR 10 schedule. These results show that schedule of reinforcement and delay length can modulate drug effects in delay discounting.

Sex Differences and Effects of Predictive Cues on Delayed Punishment Discounting

The majority of the research studying punishment has focused on an aversive stimulus delivered immediately after an action. However, in real-world decision-making, negative consequences often occur long after a decision has been made. This can engender myopic decisions that fail to appropriately respond to consequences. Whereas discounting of delayed rewards has been well studied in both human and animal models, systematic discounting of delayed consequences remains largely unexplored. To address this gap in the literature, we developed the delayed punishment decision-making task. Rats chose between a small, single-pellet reinforcer and a large, three-pellet reinforcer accompanied by a mild foot shock. The shock was preceded by a delay, which systematically increased throughout the session (0, 4, 8, 12, 16 s). On average, rats discounted the negative value of delayed punishment, as indicated by increased choice of the large, punished reward as the delay preceding the shock lengthened. Female rats discounted delayed punishment less than males, and this behavior was not influenced by estrous cycling. The addition of a cue light significantly decreased the undervaluation of delayed consequences for both sexes. Finally, there was no correlation between the discounting of delayed punishments and a traditional reward delay discounting task for either sex. These data indicate that the ability of punishment to regulate decision-making is attenuated when punishment occurs later in time. This task provides an avenue for exploration of the neural circuitry underlying the devaluation of delayed punishment and may assist in developing treatments for substance use disorders.

Contributions of medial prefrontal cortex to decision making involving risk of punishment

The prefrontal cortex (PFC) plays an important role in several forms of cost-benefit decision making. Its contributions to decision making under risk of explicit punishment, however, are not well understood. A rat model was used to investigate the role of the medial PFC (mPFC) and its monoaminergic innervation in a Risky Decision-making Task (RDT), in which rats chose between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of mild footshock punishment. Inactivation of mPFC increased choice of the large, risky reward when the punishment probability increased across the session ("ascending RDT"), but decreased choice of the large, risky reward when the punishment probability decreased across the session ("descending RDT"). In contrast, enhancement of monoamine availability via intra-mPFC amphetamine reduced choice of the large, risky reward only in the descending RDT. Systemic administration of amphetamine reduced choice of the large, risky reward in both the ascending and descending RDT; however, this reduction was not attenuated by concurrent mPFC inactivation, indicating that mPFC is not a critical locus of amphetamine's effects on risk taking. These findings suggest that mPFC plays an important role in adapting choice behavior in response to shifting risk contingencies, but not necessarily in risk-taking behavior per se.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Pharmacotherapies for decreasing maladaptive choice in drug addiction: Targeting the behavior and the drug

Drug addiction can be conceptualized as a disorder of maladaptive decision making in which drugs are chosen at the expense of pro-social, nondrug alternatives. The study of decision making in drug addiction has focused largely on the role of impulsivity as a facilitator of addiction, in particular the tendency for drug abusers to choose small, immediate gains over larger but delayed outcomes (i.e., delay discounting). A parallel line of work, also focused on decision making in drug addiction, has focused on identifying the determinants underlying the choice to take drugs over nondrug alternatives (i.e., drug vs. nondrug choice). Both tracks of research have been valuable tools in the development of pharmacotherapies for treating maladaptive decision making in drug addiction, and a number of common drugs have been studied in both designs. However, we have observed that there is little uniformity in the administration regimens of potential treatments between the designs, which hinders congruence in the development of single treatment strategies to reduce both impulsive behavior and drug choice. The current review provides an overview of the drugs that have been tested in both delay-discounting and drug-choice designs, and focuses on drugs that reduced the maladaptive choice in both designs. Suggestions to enhance congruence between the findings in future studies are provided. Finally, we propose the use of a hybridized, experimental approach that may enable researchers to test the effectiveness of therapeutics at decreasing impulsive and drug choice in a single design.

Effects of a cafeteria diet on delay discounting in adolescent and adult rats: Alterations on dopaminergic sensitivity

Diet-induced obesity is a laboratory procedure in which nonhuman animals are chronically exposed to a high-fat, high-sugar diet (i.e. cafeteria diet), which results in weight gain, altered sensitivity to reward, and alterations in the dopamine D₂ system. To date, few (if any) studies have examined age-related diet-induced obesity effects in a rat model or have used an impulsive choice task to characterize diet-induced behavioral alterations in reward processes. We exposed rats to a cafeteria-style diet for eight weeks starting at age 21 or 70 days. Following the diet exposures, the rats were tested on a delay discounting task - a measure of impulsive choice in which preference for smaller, immediate vs larger, delayed food reinforcers was assessed. Acute injections of haloperidol (0.03-0.3 mg/kg) were administered to assess the extent to which diet-induced changes in dopamine D₂ influence impulsive food choice. Across both age groups, rats fed a cafeteria diet gained the most weight and consumed more calories than rats fed a standard diet, with rats exposed during development showing the highest weight gain. No age- or diet-related baseline differences in delay discounting were revealed, however, haloperidol unmasked subtle diet-related differences by dose-dependently reducing choice for the larger, later reinforcer. Rats fed a cafeteria diet showed a leftward shift in the dose-response curve, suggesting heightened sensitivity to haloperidol, regardless of age, compared to rats fed a standard diet. Results indicate that chronic exposure to a cafeteria diet resulted in changes in underlying dopamine D₂ that manifested as greater impulsivity independent of age at diet exposure.

Individual differences in voluntary alcohol intake in rats: relationship with impulsivity, decision making and Pavlovian conditioned approach

RATIONALE

Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood.

OBJECTIVES

This study aims to assess decision making, impulsivity, and Pavlovian-conditioned approach in rats that voluntarily consume low (LD) or high (HD) amounts of alcohol.

METHODS

LD and HD were tested in the rat gambling task (rGT) or the delayed reward task (DRT). Next, the effect of alcohol (0-1.0 g/kg) was tested in these tasks. Pavlovian-conditioned approach (PCA) was assessed both prior to and after intermittent alcohol access (IAA). Principal component analyses were performed to identify relationships between the most important behavioral parameters.

RESULTS

HD showed more optimal decision making in the rGT. In the DRT, HD transiently showed reduced impulsive choice. In both LD and HD, alcohol treatment increased optimal decision making in the rGT and increased impulsive choice in the DRT. PCA prior to and after IAA was comparable for LD and HD. When PCA was tested after IAA only, HD showed a more sign-tracking behavior. The principal component analyses indicated dimensional relationships between alcohol intake, impulsivity, and sign-tracking behavior in the PCA task after IAA.

CONCLUSIONS

HD showed a more efficient performance in the rGT and DRT. Moreover, alcohol consumption enhanced approach behavior to reward-predictive cues, but sign-tracking did not predict the level of alcohol consumption. Taken together, these findings suggest that high levels of voluntary alcohol intake are associated with enhanced cue- and reward-driven behavior.