Lateral Orbitofrontal Cortex Encodes Presence of Risk and Subjective Risk Preference During Decision-Making

Adaptive decision-making requires consideration of objective risks and rewards associated with each option, as well as subjective preference for risky/safe alternatives. Inaccurate risk/reward estimations can engender excessive risk-taking, a central trait in many psychiatric disorders. The lateral orbitofrontal cortex (lOFC) has been linked to many disorders associated with excessively risky behavior and is ideally situated to mediate risky decision-making. Here, we used single-unit electrophysiology to measure neuronal activity from lOFC of freely moving rats performing in a punishment-based risky decision-making task. Subjects chose between a small, safe reward and a large reward associated with either 0% or 50% risk of concurrent punishment. lOFC activity repeatedly encoded current risk in the environment throughout the decision-making sequence, signaling risk before, during, and after a choice. In addition, lOFC encoded reward magnitude, although this information was only evident during action selection. A Random Forest classifier successfully used neural data accurately to predict the risk of punishment in any given trial, and the ability to predict choice via lOFC activity differentiated between and risk-preferring and risk-averse rats. Finally, risk preferring subjects demonstrated reduced lOFC encoding of risk and increased encoding of reward magnitude. These findings suggest lOFC may serve as a central decision-making hub in which external, environmental information converges with internal, subjective information to guide decision-making in the face of punishment risk.

Dopaminergic modulation of sensitivity to immediate and delayed punishment during decision-making

Effective decision-making involves careful consideration of all rewarding and aversive outcomes. Importantly, negative outcomes often occur later in time, leading to underestimation, or "discounting," of these consequences. Despite the frequent occurrence of delayed outcomes, little is known about the neurobiology underlying sensitivity to delayed punishment during decision-making. The Delayed Punishment Decision-making Task (DPDT) addresses this by assessing sensitivity to delayed versus immediate punishment in rats. Rats initially avoid punished reinforcers, then select this option more frequently when delay precedes punishment. We used DPDT to examine effects of acute systemic administration of catecholaminergic drugs on sensitivity to delayed punishment in male and female adult rats. Cocaine did not affect choice of rewards with immediate punishment but caused a dose-dependent reduction in choice of delayed punishment. Neither activation nor blockade of D1-like dopamine receptor affected decision-making, but activation of D2-like dopamine receptors reduced choice of delayed punishment. D2 blockade did not attenuate cocaine's effects on decision-making, suggesting that cocaine's effects are not dependent on D2 receptor activation. Increasing synaptic norepinephrine via atomoxetine also reduced choice of delayed (but not immediate) punishment. Notably, when DPDT was modified from ascending to descending pre-punishment delays, these drugs did not affect choice of delayed or immediate punishment, although high-dose quinpirole impaired behavioral flexibility. In summary, sensitivity to delayed punishment is regulated by both dopamine and norepinephrine transmission in task-specific fashion. Understanding the neurochemical modulation of decision-making with delayed punishment is a critical step toward treating disorders characterized by aberrant sensitivity to negative consequences.

Divergent risky decision-making and impulsivity behaviors in Lewis rat substrains with low genetic difference

Substance use disorder (SUD) is associated with a cluster of cognitive disturbances that engender vulnerability to ongoing drug seeking and relapse. Two of these endophenotypes-risky decision-making and impulsivity-are amplified in individuals with SUD and are augmented by repeated exposure to illicit drugs. Identifying genetic factors underlying variability in these behavioral patterns is critical for early identification, prevention, and treatment of SUD-vulnerable individuals. Here, we compared risky decision-making and different facets of impulsivity between two fully inbred substrains of Lewis rats-LEW/NCrl and LEW/NHsd. We performed whole genome sequencing of both substrains to identify almost all relevant variants. We observed substantial differences in risky decision-making and impulsive behaviors. Relative to LEW/NHsd, the LEW/NCrl substrain accepts higher risk options in a decision-making task and higher rates of premature responses in the differential reinforcement of low rates of responding task. These phenotypic differences were more pronounced in females than males. We defined a total of ∼9,000 polymorphisms between these substrains at 40× whole genome short-read coverage. Roughly half of variants are located within a single 1.5 Mb region of Chromosome 8, but none impact protein-coding regions. In contrast, other variants are widely distributed, and of these, 38 are predicted to cause protein-coding variants. In conclusion, Lewis rat substrains differ significantly in risk-taking and impulsivity and only a small number of easily mapped variants are likely to be causal. Sequencing combined with a reduced complexity cross should enable identification of one or more variants underlying multiple complex addiction-relevant behaviors. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Effort-related decision making and cannabis use among college students

Cannabis exerts an indirect effect on dopamine (DA) output in the mesolimbic projection, a circuit implicated in reward processing and effort expenditure, and thus may be associated with aberrant effort-based decision making. The "amotivation syndrome" hypothesis suggests that regular cannabis use results in impaired capacity for goal-directed behavior. However, investigations of this hypothesis have used divergent methodology and have not controlled for key confounding variables. The present study extends these findings by examining the relation between cannabis use and effort-related decision making in a sample of college students. Cannabis using (n = 25; 68% meeting criteria for Cannabis Use Disorder) and noncannabis using (n = 22) students completed the Effort Expenditure for Rewards Task (EEfRT). In generalized estimating equation models, reward magnitude, reward probability, and expected value predicted greater likelihood of selecting a high-effort trial. Furthermore, past-month cannabis days and cannabis use disorder symptoms predicted the likelihood of selecting a high-effort trial, such that greater levels of both cannabis use days and symptoms were associated with an increased likelihood after controlling for Attention Deficit/Hyperactivity Disorder (ADHD) symptoms, distress tolerance, income, and delay discounting. The results provide preliminary evidence suggesting that college students who use cannabis are more likely to expend effort to obtain reward, even after controlling for the magnitude of the reward and the probability of reward receipt. Thus, these results do not support the amotivational syndrome hypothesis. Future research with a larger sample is required to evaluate possible associations between cannabis use and patterns of real-world effortful behavior over time. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Lateral Orbitofrontal Cortex and Basolateral Amygdala Regulate Sensitivity to Delayed Punishment during Decision-making

In real-world decision-making scenarios, negative consequences do not always occur immediately after a choice. This delay between action and outcome drives the underestimation, or "delay discounting", of punishment. While the neural substrates underlying sensitivity to immediate punishment have been well-studied, there has been minimal investigation of delayed consequences. Here, we assessed the role of lateral orbitofrontal cortex (LOFC) and basolateral amygdala (BLA), two regions implicated in cost/benefit decision-making, in sensitivity to delayed vs immediate punishment. The delayed punishment decision-making task (DPDT) was used to measure delay discounting of punishment in rodents. During DPDT, rats choose between a small, single pellet reward and a large, three pellet reward accompanied by a mild foot shock. As the task progresses, the shock is preceded by a delay that systematically increases or decreases throughout the session. We observed that rats avoid choices associated with immediate punishment, then shift preference toward these options when punishment is delayed. LOFC inactivation did not influence choice of rewards with immediate punishment, but decreased choice of delayed punishment. We also observed that BLA inactivation reduced choice of delayed punishment for ascending but not descending delays. Inactivation of either brain region produced comparable effects on decision-making in males and females, but there were sex differences observed in omissions and latency to make a choice. In summary, both LOFC and BLA contribute to the delay discounting of punishment and may serve as promising therapeutic targets to improve sensitivity to delayed punishment during decision-making.Significance StatementNegative consequences occurring after a delay are often underestimated, which can lead to maladaptive decision-making. While sensitivity to immediate punishment during reward-seeking has been well-studied, the neural substrates underlying sensitivity to delayed punishment remain unclear. Here, we used the Delayed Punishment Decision-making Task to determine that lateral orbitofrontal cortex and basolateral amygdala both regulate the discounting of delayed punishment, suggesting that these regions may be potential targets to improve decision-making in psychopathology.

Effects of the psychoactive compounds in green tea on risky decision-making

Epigallocatechin-3-gallate (EGCG) and caffeine are the two primary compounds found in green tea. While EGCG has anxiolytic and anti-inflammatory effects, its acute effects on cognition are not well understood. Furthermore, despite widespread green tea consumption, little is known about how EGCG and caffeine co-administration impacts behavior. Here, we investigated the effects of multiple doses of either EGCG or caffeine on a rat model of risk-taking. This was assessed using the risky decision-making task (RDT), in which rats choose between a small, well-tolerated reward and a large reward with escalating risk of mild footshock. Rats were tested in RDT after acute systemic administration of EGCG, caffeine or joint EGCG and caffeine. EGCG caused a dose-dependent reduction in risk-taking without affecting reward discrimination or task engagement. Caffeine did not impact risk-taking, but elevated locomotor activity and reduced task engagement at high doses. Finally, exposure to both EGCG and caffeine had no effect on risk-taking, suggesting that low-dose caffeine is sufficient to mask the risk-aversion caused by EGCG. These data suggest EGCG as a potential therapeutic treatment for psychological disorders that induce compulsive risky decision-making.

Reward/Punishment-Based Decision Making in Rodents

Deficits in decision making are at the heart of many psychiatric diseases, such as substance abuse disorders and attention deficit hyperactivity disorder. Consequently, rodent models of decision making are germane to understanding the neural mechanisms underlying adaptive choice behavior and how such mechanisms can become compromised in pathological conditions. A critical factor that must be integrated with reward value to ensure optimal decision making is the occurrence of consequences, which can differ based on probability (risk of punishment) and temporal contiguity (delayed punishment). This article will focus on two models of decision making that involve explicit punishment, both of which recapitulate different aspects of consequences during human decision making. We will discuss each behavioral protocol, the parameters to consider when designing an experiment, and finally how such animal models can be utilized in studies of psychiatric disease. © 2020 Wiley Periodicals LLC. Basic Protocol 1: Behavioral training Support Protocol: Equipment testing Alternate Protocol: Reward discrimination Basic Protocol 2: Risky decision-making task (RDT) Basic Protocol 3: Delayed punishment decision-making task (DPDT).

Dopamine receptors regulate preference between high-effort and high-risk rewards

RATIONALE

Optimal decision-making necessitates evaluation of multiple rewards that are each offset by distinct costs, such as high effort requirement or high risk of failure. The neurotransmitter dopamine is fundamental toward these cost-benefit analyses, and D1-like and D2-like dopamine receptors differently modulate the reward-discounting effects of both effort and risk. However, measuring the role of dopamine in regulating decision-making between options associated with distinct costs exceeds the scope of traditional rodent economic decision-making paradigms.

OBJECTIVES

We developed the effort vs probability economic conflict task (EvP) to model multimodal economic decision-making in rats. This task measures choice between two rewards of uniform magnitude associated with either a high effort requirement or risk of reward omission. We then tested the modulatory effects of systemic cocaine and D1/D2 blockade or activation on the preference between high-effort and high-risk alternatives.

METHODS

In the EvP, two reinforcers of equal magnitude are associated with either (1) an effort requirement that increases throughout the session (1, 5, 10, and 20 lever presses), or (2) a low probability of reward receipt (25% of probabilistic choices). Critically, the reinforcer for each choice is comparable (one pellet), which eliminates the influence of magnitude discrimination on the decision-making process. After establishing the task, the dopamine transporter blocker cocaine and D1/D2 antagonists and agonists were administered prior to EvP performance.

RESULTS

Preference shifted away from either effortful or probabilistic choice when either option became more costly, and this preference was highly variable between subjects and stable over time. Cocaine, D1 activation, and D2 blockade produced limited, dose-dependent shifts in choice preference contingent on high or low effort conditions. In contrast, D2 activation across multiple doses evoked a robust shift from effortful to risky choice that was evident even when clearly disadvantageous.

CONCLUSIONS

The EvP clearly demonstrates that rats can evaluate distinct effortful or risky costs associated with rewards of comparable magnitude, and shift preference away from either option with increasing cost. This preference is more tightly linked to D2 than D1 receptor manipulation, suggesting D2-like receptors as a possible therapeutic target for maladaptive biases toward risk-taking over effort.

Risky decision-making predicts dopamine release dynamics in nucleus accumbens shell

The risky decision-making task (RDT) measures risk-taking in a rat model by assessing preference between a small, safe reward and a large reward with increasing risk of punishment (mild foot shock). It is well-established that dopaminergic drugs modulate risk-taking; however, little is known about how differences in baseline phasic dopamine signaling drive individual differences in risk preference. Here, we used in vivo fixed potential amperometry in male Long-Evans rats to test if phasic nucleus accumbens shell (NACs) dopamine dynamics are associated with risk-taking. We observed a positive correlation between medial forebrain bundle-evoked dopamine release in the NACs and risky decision-making, suggesting that risk-taking is associated with elevated dopamine sensitivity. Moreover, "risk-taking" subjects were found to demonstrate greater phasic dopamine release than "risk-averse" subjects. Risky decision-making also predicted enhanced sensitivity to the dopamine reuptake inhibitor nomifensine, and elevated autoreceptor function. Importantly, this hyperdopaminergic phenotype was selective for risky decision-making, as delay discounting performance was not predictive of phasic dopamine release or dopamine supply. These data identify phasic NACs dopamine release as a possible therapeutic target for alleviating the excessive risk-taking observed across multiple forms of psychopathology.

Recent Updates in Modeling Risky Decision Making in Rodents

Excessive preference for risky over safe options is a hallmark of several psychiatric disorders. Here we describe a behavioral task that models such risky decision making in rats. In this task, rats are given choices between small, safe rewards and large rewards accompanied by risk of footshock punishment. The risk of punishment changes within a test session, allowing quantification of decision making at different levels of risk. Importantly, this task can yield a wide degree of reliable individual variability, allowing the characterization of rats as "risk-taking" or "risk-averse." The task has been demonstrated to be effective for testing the effects of pharmacological agents and neurobiological manipulations, and the individual variability (which mimics the human population) allows assessment of behavioral and neurobiological distinctions among subjects based on their risk-taking profile.

Networks of VTA Neurons Encode Real-Time Information about Uncertain Numbers of Actions Executed to Earn a Reward

Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.

Repeated Nicotine Strengthens Gamma Oscillations in the Prefrontal Cortex and Improves Visual Attention

Nicotine has strong addictive as well as procognitive properties. While a large body of research on nicotine continues to inform us about mechanisms related to its reinforcing effects, less is known about clinically relevant mechanisms that subserve its cognitive-enhancing properties. Understanding the latter is critical for developing optimal strategies for treating cognitive deficits. The primary brain region implicated in cognitive functions improved by nicotine is the prefrontal cortex (PFC). Here we assessed the impact of nicotine on unit activity and local field potential oscillations in the PFC of behaving rats. An acute dose of nicotine produced a predominantly inhibitory influence on population activity, a small increase in gamma oscillations, and a decrease in theta and beta oscillations. After a daily dosing regimen, a shift to excitatory-inhibitory balance in single-unit activity and stronger gamma oscillations began to emerge. This pattern of plasticity was specific to the gamma band as lower frequency oscillations were suppressed consistently across daily nicotine treatments. Gamma oscillations are associated with enhanced attentional capacity. Consistent with this mechanism, the repeat dosing regimen in a separate cohort of subjects led to improved performance in an attention task. These data suggest that procognitive effects of nicotine may involve development of enhanced gamma oscillatory activity and a shift to excitatory-inhibitory balance in PFC neural activity. In the context of the clinical use of nicotine and related agonists for treating cognitive deficits, these data suggest that daily dosing may be critical to allow for development of robust gamma oscillations.

Methylphenidate has nonlinear dose effects on cued response inhibition in adults but not adolescents

Ongoing development of the dopamine system during adolescence may provide a partial mechanism for behavioral and psychiatric vulnerabilities. Despite early evidence for a hyperactive adolescent dopaminergic system, recent data suggest that adolescent dopamine may be functionally hypoactive compared to in adults. While this distinction has been established in response to dopaminergic drugs and natural rewards, little is known about age-related differences in cognitive efficacy of dopaminergic drugs. Using a recently established Cued Response Inhibition Task, we tested the effects of acute systemic methylphenidate, commonly known as Ritalin, on response inhibition and response initiation in adolescent and adults rats. First, we replicated previous data that adolescents are able to inhibit a response to a cue on par with adults, but are slower to produce a rewarded response after a stop cue. Next, we observed that methylphenidate modulated response inhibition in adult rats, with low dose (0.3mg/kg) improving inhibition, and high dose (3mg/kg) impairing performance. This dose-response pattern is commonly observed with psychostimulant cognitive modulation. In adolescents, however, methylphenidate had no effect on response inhibition at any dose. Latency of response initiation after the stop cue was not affected by methylphenidate in either adult or adolescent rats. These data establish that dose-response of a commonly prescribed psychostimulant medication is different in adolescents and adults. They further demonstrate that healthy adolescent response inhibition is not as sensitive to psychostimulants as in adults, supporting the idea that the dopamine system is hypoactive in adolescence. This article is part of a Special Issue entitled SI: Adolescent plasticity.

Reward Anticipation Is Encoded Differently by Adolescent Ventral Tegmental Area Neurons

BACKGROUND

Elucidating the neurobiology of the adolescent brain is fundamental to our understanding of the etiology of psychiatric disorders such as schizophrenia and addiction, the symptoms of which often manifest during this developmental period. Dopamine neurons in the ventral tegmental area (VTA) are strongly implicated in adolescent behavioral and psychiatric vulnerabilities, but little is known about how adolescent VTA neurons encode information during motivated behavior.

METHODS

We recorded daily from VTA neurons in adolescent and adult rats during learning and maintenance of a cued, reward-motivated instrumental task and extinction from this task.

RESULTS

During performance of the same motivated behavior, identical events were encoded differently by adult and adolescent VTA neurons. Adolescent VTA neurons with dopamine-like characteristics lacked a reward anticipation signal and showed a smaller response to reward delivery compared with adults. After extinction, however, these neurons maintained a strong phasic response to cues formerly predictive of reward opportunity.

CONCLUSIONS

Anticipatory neuronal activity in the VTA supports preparatory attention and is implicated in error prediction signaling. Absence of this activity, combined with persistent representations of previously rewarded experiences, may provide a mechanism for rash decision making in adolescents.

Action-outcome relationships are represented differently by medial prefrontal and orbitofrontal cortex neurons during action execution

Internal representations of action-outcome relationships are necessary for flexible adaptation of motivated behavior in dynamic environments. Prefrontal cortex (PFC) is implicated in flexible planning and execution of goal-directed actions, but little is known about how information about action-outcome relationships is represented across functionally distinct regions of PFC. Here, we observe distinct patterns of action-evoked single unit activity in the medial prefrontal cortex (mPFC) and orbitofrontal cortex (OFC) during a task in which the relationship between outcomes and actions was independently manipulated. The mPFC encoded changes in the number of actions required to earn a reward, but not fluctuations in outcome magnitude. In contrast, OFC neurons decreased firing rates as outcome magnitude was increased, but were insensitive to changes in action requirement. A subset of OFC neurons also tracked outcome availability. Pre-outcome anticipatory activity in both mPFC and OFC was altered when reward expectation was reduced, but did not differ with outcome magnitude. These data provide novel evidence that PFC regions encode distinct information about the relationship between actions and impending outcomes during action execution.

Neural processing of reward in adolescent rodents

•

The adolescent brain processes rewards differently than in adults.

•

These differences occur even when behavior is similar between age groups.

•

DS was the locus of substantial developmental differences in reward activity.

•

Surprisingly, differences were not as pronounced in VS.

•

These differences may have implications for adolescent psychiatric vulnerability.

Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

Differences in response initiation and behavioral flexibility between adolescent and adult rats

Adolescence is a period of increased vulnerability to psychiatric illnesses such as addiction, mood disorders, and schizophrenia. Rats provide a useful animal model for investigating the differences in behavior and biology between adults and adolescents that stem from ongoing brain development. We developed the Cued Response Inhibition Task, or CRIT, to assess response inhibition and initiation processes by measuring the ability of rodents to withhold a response during an inhibitory cue and then to respond promptly after cue termination. We found no difference between adult and adolescent rats in the ability to appropriately inhibit a response during cue presentation. Adolescents, however, were unable to initiate a response as quickly as adults after cue termination. Further, we observed that this difference in responding was abolished after adolescent rats aged to adulthood with no additional training. In a separate experiment, adult and adolescent rats were trained in CRIT and then trained in another protocol in which the response inhibitory cue from CRIT was used as a Pavlovian cue predictive of reward. Adolescents demonstrated more reward-seeking behavior during the previously inhibitory Pavlovian cue than adults, indicative of greater behavioral flexibility. Taken together, these data suggest that, compared with adults, adolescent rats (a) are less able to initiate a response after response inhibition, (b) equally inhibit behavioral responses, and (c) are more adept at flexibly switching behavioral patterns. Furthermore, this study characterizes a task that is well suited for future pharmacological and electrophysiological investigations for assessing neuronal processing differences between adolescents and adults.

Prefrontal cortical-striatal dopamine receptor mRNA expression predicts distinct forms of impulsivity

Variation in dopamine receptor levels has been associated with different facets of impulsivity. To further delineate the neural substrates underlying impulsive action (inability to withhold a prepotent motor response) and impulsive choice (delay aversion), we characterised rats in the Differential Reinforcement of Low Rates of Responding task and a delay discounting task. We also measured performance on an effort-based discounting task. We then assessed D1 and D2 dopamine receptor mRNA expression in subregions of the prefrontal cortex and nucleus accumbens using in situ hybridisation, and compared these data with behavioral performance. Expression of D1 and D2 receptor mRNA in distinct brain regions was predictive of impulsive action. A dissociation within the nucleus accumbens was observed between subregions and receptor subtypes; higher D1 mRNA expression in the shell predicted greater impulsive action, whereas lower D2 mRNA expression in the core predicted greater impulsive action. We also observed a negative correlation between impulsive action and D2 mRNA expression in the prelimbic cortex. Interestingly, a similar relationship was present between impulsive choice and prelimbic cortex D2 mRNA, despite the fact that behavioral indices of impulsive action and impulsive choice were uncorrelated. Finally, we found that both high D1 mRNA expression in the insular cortex and low D2 mRNA expression in the infralimbic cortex were associated with willingness to exert effort for rewards. Notably, dopamine receptor mRNA in these regions was not associated with either facet of impulsivity. The data presented here provide novel molecular and neuroanatomical distinctions between different forms of impulsivity, as well as effort-based decision-making.

Risk, reward, and decision-making in a rodent model of cognitive aging

Impaired decision-making in aging can directly impact factors (financial security, health care) that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5–7 months) and aged (23–25 months) male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (one food pellet) and a large but uncertain reward (two food pellets with varying probabilities of delivery ranging from 100 to 0%). Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the small but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was also certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for reward costs (i.e., delay or probability). These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct mechanisms that can impact cost–benefit decision-making.

Effects of acute administration of nicotine, amphetamine, diazepam, morphine, and ethanol on risky decision-making in rats

RATIONALE

Most individuals can accurately assess the risks and rewards associated with choice alternatives and decide accordingly; however, drug users often display maladaptive decision-making, such that choices are biased toward excessively risky options.

OBJECTIVE

The purpose of this study was to investigate the effects of a range of drugs of abuse on risky decision-making.

METHODS

Male Long-Evans rats were trained in the Risky Decision-Making Task, in which they chose between two levers, one which produced a small, "safe" food reward and the other which produced a large, "risky" food reward. The large reward was accompanied by the risk of a mild footshock, the probability of which increased over the course of each test session (0%, 25%, 50%, 75%, and 100%).

RESULTS

Nicotine (0.6 mg/kg) and amphetamine (1.5 mg/kg) caused a significant decrease in choice of the large risky reward (decreased risk taking). Diazepam (1.0 mg/kg) caused a significant increase in choice of the large risky reward (increased risk taking), whereas morphine (3.0 mg/kg) caused only a trend toward increased choice of the large risky reward. Ethanol had no effect on choice behavior.

CONCLUSIONS

These results show that acute administration of drugs of abuse can modulate risk taking in a drug-specific manner, either increasing or decreasing preference for highly rewarding, but risky, options.

Self-administered cocaine causes long-lasting increases in impulsive choice in a delay discounting task

Cocaine use is associated with high levels of impulsive choice (preference for immediate over delayed rewards), but it is not clear whether cocaine use causes elevated impulsive choice, or whether elevated impulsive choice is solely a predisposing factor for cocaine use. This study examined the effects of prior cocaine self-administration on rats performing a delay discounting task commonly used to measure impulsive choice. Male Long-Evans rats were implanted with intravenous catheters, and following recovery, were trained to self-administer 30 mg/kg/day cocaine HCl (approx. 0.5 mg/kg/infusion) for 14 consecutive days (a control group received yoked intravenous saline infusions). Following three weeks of withdrawal, all rats were food-restricted and began training on the delay discounting task in standard operant chambers. On each trial, rats were given a choice between two levers. A press on one lever delivered a small food reward immediately, and a press on the other delivered a large food reward after a variable delay period. Rats that self-administered cocaine displayed greater impulsive choice (enhanced preference for the small immediate over the large delayed reward, as reflected by shorter indifference points) compared to controls, but were no different from controls on a "probabilistic discounting" task in which they chose between small certain and large uncertain rewards. These data suggest that self-administered cocaine can cause lasting elevations in impulsive choice, and that the high levels of impulsive choice observed in human cocaine users may be due in part to long-term effects of cocaine on brain function.

Effects of chronic administration of drugs of abuse on impulsive choice (delay discounting) in animal models

Drug-addicted individuals show high levels of impulsive choice, characterized by preference for small immediate over larger but delayed rewards. Although the causal relationship between chronic drug use and elevated impulsive choice in humans has been unclear, a small but growing body of literature over the past decade has shown that chronic drug administration in animal models can cause increases in impulsive choice, suggesting that a similar causal relationship may exist in human drug users. This article reviews this literature, with a particular focus on the effects of chronic cocaine administration, which have been most thoroughly characterized. The potential mechanisms of these effects are described in terms of drug-induced neural alterations in ventral striatal and prefrontal cortical brain systems. Some implications of this research for pharmacological treatment of drug-induced increases in impulsive choice are discussed, along with suggestions for future research in this area.

Effects of prior amphetamine exposure on approach strategy in appetitive Pavlovian conditioning in rats

RATIONALE

Pavlovian conditioning with a discrete reward-predictive visual cue can elicit two classes of behaviors: "sign-tracking" (approach toward and contact with the cue) and "goal-tracking" (approach toward the site of reward delivery). Sign-tracking has been proposed to be linked to behavioral disorders involving compulsive reward-seeking, such as addiction. Prior exposure to psychostimulant drugs of abuse can facilitate reward-seeking behaviors through enhancements in incentive salience attribution. Thus, it was predicted that a sensitizing regimen of amphetamine exposure would increase sign-tracking behavior.

OBJECTIVE

The purpose of these experiments was to determine how a regimen of exposure to amphetamine affects subsequent sign-tracking behavior.

MATERIALS AND METHODS

Male Long-Evans rats were given daily injections of d-amphetamine (2.0 mg/kg) or saline for 5 days, then given a 7-day drug-free period followed by testing in a Pavlovian conditioning task. In experiment 1, rats were presented with a visual cue (simultaneous illumination of a light and extension of a lever) located either to the left or right of a centrally located food trough. One cue (CS+) was always followed by food delivery, whereas the other (CS-) was not. In experiment 2, rats were tested in a nondiscriminative (CS+ only) version of the task.

RESULTS

In both experiments, amphetamine-exposed rats showed less sign-tracking and more goal-tracking compared to saline controls.

CONCLUSIONS

Contrary to predictions, prior amphetamine exposure decreased sign-tracking and increased goal-tracking behavior. However, these results do support the hypothesis that psychostimulant exposure and incentive sensitization enhance behavior directed toward reward-proximal cues at the expense of reward-distal cues.

Good things come to those who wait: attenuated discounting of delayed rewards in aged Fischer 344 rats

The ability to make advantageous choices among outcomes that differ in magnitude, probability, and delay until their arrival is critical for optimal survival and well-being across the lifespan. Aged individuals are often characterized as less impulsive in their choices than their young adult counterparts, demonstrating an increased ability to forgo immediate in favor of delayed (and often more beneficial) rewards. Such "wisdom" is usually characterized as a consequence of learning and life experience. However, aging is also associated with prefrontal cortical dysfunction and concomitant impairments in advantageous choice behavior. Animal models afford the opportunity to isolate the effects of biological aging on decision-making from experiential factors. To model one critical component of decision-making, young adult and aged Fischer 344 rats were trained on a two-choice delay discounting task in which one choice provided immediate delivery of a small reward and the other provided a large reward delivered after a variable delay period. Whereas young adult rats showed a characteristic pattern of choice behavior (choosing the large reward at short delays and shifting preference to the small reward as delays increased), aged rats maintained a preference for the large reward at all delays (i.e., attenuated "discounting" of delayed rewards). This increased preference for the large reward in aged rats was not due to perceptual, motor, or motivational factors. The data strongly suggest that, independent of life experience, there are underlying neurobiological factors that contribute to age-related changes in decision-making, and particularly the ability to delay gratification.

Cocaine exposure causes long-term increases in impulsive choice

In this study, the authors examined the long-term effects of prior exposure to cocaine on a delay-discounting task commonly used to measure impulsive choice. Male Long-Evans rats received daily intraperitoneal injections of 30 mg/kg cocaine HCl or saline for 14 days. Following 3 weeks of withdrawal, rats began training. On each trial, rats were given a choice between 2 levers. A press on 1 lever resulted in immediate delivery of a single 45-mg food pellet, and a press on the other resulted in delivery of 4 pellets after a delay period. Impulsive choice was defined as preference for the small immediate over the large delayed reward. Three months after treatment, cocaine-exposed rats displayed increased impulsive choice behavior. They also showed less anticipatory responding (entries into the food trough) during the delays prior to reward delivery, indicating that the enhanced impulsive choice in these rats may be related to deficits in bridging the delay between response and reward. These data demonstrate that cocaine exposure can cause enduring increases in impulsive choice behavior, consistent with observations in human subjects with drug addictions.

Long-term effects of prior cocaine exposure on Morris water maze performance

Cocaine addiction is associated with long-term cognitive alterations including deficits on tests of declarative/spatial learning and memory. To determine the extent to which cocaine exposure plays a causative role in these deficits, adult male Long-Evans rats were given daily injections of cocaine (30 mg/kg/day x 14 days) or saline vehicle. Three months later, rats were trained for 6 sessions on a Morris water maze protocol adapted from Gallagher, Burwell, and Burchinal [Gallagher, M., Burwell, R., & Burchinal, M. (1993). Severity of spatial learning impairment in aging: development of a learning index for performance in the Morris water maze. Behavioral Neuroscience, 107, 618-626]. Rats given prior cocaine exposure performed similarly to controls on training trials, but searched farther from the platform location on probe trials interpolated throughout the training sessions and showed increased thigmotaxis. The results demonstrate that a regimen of cocaine exposure can impair Morris water maze performance as long as 3 months after exposure. Although the impairments were not consistent with major deficits in spatial learning and memory, they may have resulted from cocaine-induced increases in stress responsiveness and/or anxiety. Increased stress and anxiety would be expected to increase thigmotaxis as well as cause impairments in searching for the platform location, possibly through actions on ventral striatal dopamine signaling.

Post-training amphetamine administration enhances memory consolidation in appetitive Pavlovian conditioning: Implications for drug addiction

It has been suggested that some of the addictive potential of psychostimulant drugs of abuse such as amphetamine may result from their ability to enhance memory for drug-related experiences through actions on memory consolidation. This experiment examined whether amphetamine can specifically enhance consolidation of memory for a Pavlovian association between a neutral conditioned stimulus (CS-a light) and a rewarding unconditioned stimulus (US-food), as Pavlovian conditioning of this sort plays a major role in drug addiction. Male Long-Evans rats were given six training sessions consisting of 8 CS presentations followed by delivery of the food into a recessed food cup. After the 1st, 3rd, and 5th session, rats received subcutaneous injections of amphetamine (1.0 or 2.0 mg/kg) or saline vehicle immediately following training. Conditioned responding was assessed using the percentage of time rats spent in the food cup during the CS relative to a pre-CS baseline period. Both amphetamine-treated groups showed significantly more selective conditioned responding than saline controls. In a control experiment, there were no differences among groups given saline, 1.0 or 2.0 mg/kg amphetamine 2 h post-training, suggesting that immediate post-training amphetamine enhanced performance specifically through actions on memory consolidation rather than through non-mnemonic processes. This procedure modeled Pavlovian learning involved in drug addiction, in which the emotional valence of a drug reward is transferred to neutral drug-predictive stimuli such as drug paraphernalia. These data suggest that amphetamine may contribute to its addictive potential through actions specifically on memory consolidation.