Pharmacological evidence that 5-HT2C receptor blockade selectively improves decision making when rewards are paired with audiovisual cues in a rat gambling task

Insight into differing decision-making strategies that underlie cognitively effort-based decision making using computational modeling in rats

RATIONALE

The rat cognitive effort task (rCET), a rodent model of cognitive rather than physical effort, requires animals to choose between an easy or hard visuospatial discrimination, with a correct hard choice more highly rewarded. Like in humans, there is stable individual variation in choice behavior. In previous reports, animals were divided into two groups-workers and slackers-based on their mean preference for the harder option. Although these groups differed in their response to pharmacological challenges, the rationale for using this criterion for grouping was not robust.

METHODS

We collated experimental data from multiple cohorts of male and female rats performing the rCET and used a model-based framework combining drift diffusion modeling with cluster analysis to identify the decision-making processes underlying variation in choice behavior.

RESULTS

We verified that workers and slackers are statistically different groups but also found distinct intra-group profiles. These subgroups exhibited dissociable performance during the attentional phase, linked to distinct decision-making profiles during choice. Reanalysis of previous pharmacology data using this model-based framework showed that serotonergic drug effects were explained by changes in decision boundaries and non-decision times, while scopolamine's effects were driven by changes in decision starting points and rates of evidence accumulation.

CONCLUSIONS

Modeling revealed the decision-making processes that are associated with cognitive effort costs, and how these differ across individuals. Reanalysis of drug data provided insight into the mechanisms through which different neurotransmitter systems impact cognitively effortful attention and decision-making processes, with relevance to multiple psychiatric disorders.

Risk-promoting effects of reward-paired cues in human sign- and goal-trackers

Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences.

D2/3 Agonist during Learning Potentiates Cued Risky Choice

Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos+ neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues.SIGNIFICANCE STATEMENT D2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this.

Concurrent measures of impulsive action and choice are partially related and differentially modulated by dopamine D1- and D2-like receptors in a rat model of impulsivity

Impulsivity is a multidimensional construct, but the relationships between its constructs and their respective underlying dopaminergic underpinnings in the general population remain unclear. A cohort of Roman high- (RHA) and low- (RLA) avoidance rats were tested for impulsive action and risky decision-making in the rat gambling task, and then for delay discounting in the delay-discounting task to concurrently measure the relationships among the three constructs of impulsivity using a within-subject design. Then, we evaluated the effects of dopaminergic drugs on the three constructs of impulsivity, considering innate differences in impulsive behaviors at baseline. Risky decision-making and delay-discounting were positively correlated, indicating that both constructs of impulsive choice are related. Impulsive action positively correlated with risky decision-making but not with delay discounting, suggesting partial overlap between impulsive action and impulsive choice. RHAs showed a more impulsive phenotype in the three constructs of impulsivity compared to RLAs, demonstrating the comorbid nature of impulsivity in a population of rats. Amphetamine increased impulsive action and had no effect on risky decision-making regardless of baseline levels of impulsivity, but it decreased delay discounting only in high impulsive RHAs. In contrast, while D₁R and D₃R agonism as well as D_2/3R partial agonism decreased impulsive action regardless of baseline levels of impulsivity, D_2/3R agonism decreased impulsive action exclusively in high impulsive RHAs. Irrespective of baseline levels of impulsivity, risky decision-making was increased by D₁R and D_2/3R agonism but not by D₃R agonism or D_2/3R partial agonism. Finally, while D₁R and D₃R agonism, D_2/3R partial agonism and D₂R blockade increased delay discounting irrespective of baseline levels of impulsivity, D_2/3R agonism decreased it in low impulsive RLAs only. These findings indicate that the acute effects of dopamine drugs were partially overlapping across dimensions of impulsivity, and that only D_2/3R agonism showed baseline-dependent effects on impulsive action and impulsive choice.

Exploring decision-making strategies in the Iowa gambling task and rat gambling task

Decision-making requires that individuals perceive the probabilities and risks associated with different options. Experimental human and animal laboratory testing provide complimentary insights on the psychobiological underpinnings of decision-making. The Iowa gambling task (IGT) is a widely used instrument that assesses decision-making under uncertainty and risk. In the task participants are faced with a choice conflict between cards with varying monetary reinforcer/loss contingencies. The rat gambling task (rGT) is a pre-clinical version using palatable reinforcers as wins and timeouts mimicking losses. However, interspecies studies elaborating on human and rat behavior in these tasks are lacking. This study explores decision-making strategies among young adults (N = 270) performing a computerized version of the IGT, and adult outbred male Lister Hooded rats (N = 72) performing the rGT. Both group and individual data were explored by normative scoring approaches and subgroup formations based on individual choices were investigated. Overall results showed that most humans and rats learned to favor the advantageous choices, but to a widely different extent. Human performance was characterized by both exploration and learning as the task progressed, while rats showed relatively consistent pronounced preferences for the advantageous choices throughout the task. Nevertheless, humans and rats showed similar variability in individual choice preferences during end performance. Procedural differences impacting on the performance in both tasks and their potential to study different aspects of decision-making are discussed. This is a first attempt to increase the understanding of similarities and differences regarding decision-making processes in the IGT and rGT from an explorative perspective.

Functional connectivity in reward-related networks is associated with individual differences in gambling strategies in male Lister hooded rats

Individuals with gambling disorder display deficits in decision-making in the Iowa Gambling Task. The rat Gambling Task (rGT) is a rodent analogue that can be used to investigate the neurobiological mechanisms underlying gambling behaviour. The aim of this explorative study was to examine individual strategies in the rGT and investigate possible behavioural and neural correlates associated with gambling strategies. Thirty-two adult male Lister hooded rats underwent behavioural testing in the multivariate concentric square field™ (MCSF) and the novel cage tests, were trained on and performed the rGT and subsequently underwent resting-state functional magnetic resonance imaging (R-fMRI). In the rGT, stable gambling strategies were found with subgroups of rats that preferred the suboptimal safest choice as well as the disadvantageous choice, that is, the riskiest gambling strategy. R-fMRI results revealed associations between gambling strategies and brain regions central for reward networks. Moreover, rats with risky gambling strategies differed from those with strategic and intermediate strategies in brain functional connectivity. No differences in behavioural profiles, as assessed with the MCSF and novel cage tests, were observed between the gambling strategy groups. In conclusion, stable individual differences in gambling strategies were found. Intrinsic functional connectivity using R-fMRI provides novel evidence to support the notion that individual differences in gambling strategies are associated with functional connectivity in brain regions important for reward networks.

5-HT2C receptor perturbation has bidirectional influence over instrumental vigour and restraint

The serotonin (5-HT) system, particularly the 5-HT2C receptor, has consistently been implicated in behavioural control. However, while some studies have focused on the role 5-HT2C receptors play in regulating motivation to work for reward, others have highlighted its importance in response restraint. To date, it is unclear how 5-HT transmission at this receptor regulates the balance of response invigoration and restraint in anticipation of future reward. In addition, it remains to be established how 5-HT2C receptors gate the influence of internal versus cue-driven processes over reward-guided actions. To elucidate these issues, we investigated the effects of administering the 5-HT2C receptor antagonist SB242084, both systemically and directly into the nucleus accumbens core (NAcC), in rats performing a Go/No-Go task for small or large rewards. The results were compared to the administration of d-amphetamine into the NAcC, which has previously been shown to promote behavioural activation. Systemic perturbation of 5-HT2C receptors-but crucially not intra-NAcC infusions-consistently boosted rats' performance and instrumental vigour on Go trials when they were required to act. Concomitantly, systemic administration also reduced their ability to withhold responding for rewards on No-Go trials, particularly late in the holding period. Notably, these effects were often apparent only when the reward on offer was small. By contrast, inducing a hyperdopaminergic state in the NAcC with d-amphetamine strongly impaired response restraint on No-Go trials both early and late in the holding period, as well as speeding action initiation. Together, these findings suggest that 5-HT2C receptor transmission, outside the NAcC, shapes the vigour of ongoing goal-directed action as well as the likelihood of responding as a function of expected reward.

Executive function in obesity and anorexia nervosa: Opposite ends of a spectrum of disordered feeding behaviour?

Higher-order executive functions such as decision-making, cognitive flexibility and behavioural control are critical to adaptive success in all aspects of life, including the maintenance of a healthy body weight by regulating food intake. Performance on tasks designed to assess these aspects of cognition is impaired in individuals with obesity and anorexia nervosa (AN); conditions at either end of a spectrum of body weight disturbance. While the conceptualisation of obesity and AN as mirror images of each other makes some sense from a metabolic point of view, whether or not these conditions also reflect opposing states of executive function is less clear. Here, we review evidence from neurocognitive and neuroimaging studies to compare the direction and extent of executive dysfunction in subjects with obesity and AN and how these are underpinned by changes in structure and function of subregions of the prefrontal cortex (PFC). Both conditions of extreme body weight disturbance are associated with impaired decision-making and cognitive inflexibility, however, impulsive behaviour presents in opposing directions; obesity being associated with reduced behavioural control and AN being associated with elevated control over behaviour with respect to food and feeding. Accordingly, the subregions of the PFC that guide inhibitory control and valuation of action outcomes (dorsolateral prefrontal cortex and orbitofrontal cortex) show opposite patterns of activation in subjects with obesity compared to those with AN, whereas the subregions implicated in cognitive and behavioural flexibility (ventromedial prefrontal cortex and anterior cingulate cortex) show alterations in the same direction in both conditions but with differential extent of dysfunction. We synthesise these findings in the context of the utility of animal models of obesity and AN to interrogate the detail of the neurobiological contributions to cognition in patient populations and the utility of such detail to inform future treatment strategies that specifically target executive dysfunction.

Serotonin 2C Antagonism in the Lateral Orbitofrontal Cortex Ameliorates Cue-Enhanced Risk Preference and Restores Sensitivity to Reinforcer Devaluation in Male Rats

Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long–Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT_2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT_2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT_2C antagonism may optimize choice by facilitating exploration.

Pharmacological evidence of a cholinergic contribution to elevated impulsivity and risky decision-making caused by adding win-paired cues to a rat gambling task

BACKGROUND

Pairing rewards with sensory stimulation, in the form of auditory and visual cues, increases risky decision-making in both rats and humans. Understanding the neurobiological basis of this effect could help explain why electronic gambling machines are so addictive, and inform treatment development for compulsive gambling and gaming. Numerous studies implicate the dopamine system in mediating the motivational influence of reward-paired cues; recent data suggest the cholinergic system also plays a critical role. Previous work also indicates that cholinergic drugs alter decision-making under uncertainty.

AIMS

We investigated whether the addition of reward-concurrent cues to the rat gambling task (crGT) altered the effects of peripherally administered cholinergic compounds.

METHODS

Muscarinic and nicotinic agonists and antagonists were administered to 16 male, Long-Evans rats trained on the crGT. Measures of optimal/risky decision-making and motor impulsivity were the main dependent variables of interest.

RESULTS

The muscarinic receptor antagonist scopolamine improved decision-making overall, decreasing selection of one of the risky options while increasing choice of the more advantageous options. The muscarinic agonist oxotremorine increased choice latency but did not significantly affect option preference. Neither the nicotinic antagonist mecamylamine nor the agonist nicotine affected choice patterns, but mecamylamine decreased premature responding, an index of motor impulsivity.

CONCLUSIONS

These results contrast sharply from those obtained previously using the uncued rGT, and suggest that the deleterious effects of win-paired cues on decision-making and impulse control may result from elevated cholinergic tone.

Acute Lysergic Acid Diethylamide Does Not Influence Reward-Driven Decision Making of C57BL/6 Mice in the Iowa Gambling Task

While interest in psychedelic drugs in the fields of psychiatry and neuroscience has re-emerged in recent last decades, the general understanding of the effects of these drugs remains deficient. In particular, there are gaps in knowledge on executive functions and goal-directed behaviors both in humans and in commonly used animal models. The effects of acute doses of psychedelic lysergic acid diethylamide (LSD) on reward-driven decision making were explored using the mouse version of the Iowa Gambling Task. A total of 15 mice were trained to perform in a touch-screen adaptation of the rodent version of the Iowa Gambling Task, after which single acute doses of LSD (0.025, 0.1, 0.2, 0.4 mg/kg), serotonin 2A receptor-selective agonist 25CN-NBOH (1.5 mg/kg), d-amphetamine (2.0 mg/kg), and saline were administered before the trial. 25CN-NBOH and the three lowest doses of LSD showed no statistically significant changes in option selection or in general functioning during the gambling task trials. The highest dose of LSD (0.4 mg/kg) significantly decreased premature responding and increased the omission rate, but had no effect on option selection in comparison with the saline control. Amphetamine significantly decreased the correct responses and premature responding while increasing the omission rate. In conclusion, mice can perform previously learned, reward-driven decision-making tasks while under the acute influence of LSD at a commonly used dose range.

Investigating serotonergic contributions to cognitive effort allocation, attention, and impulsive action in female rats

BACKGROUND

Individuals must frequently evaluate whether it is worth allocating cognitive effort for desired outcomes. Motivational deficits are a common feature of psychiatric illness such as major depression. Selective serotonin reuptake inhibitors are commonly used to treat this disorder, yet some data suggest these compounds are ineffective at treating amotivation, and may even exacerbate it.

AIMS

Here we used the rodent Cognitive Effort Task (rCET) to assess serotonergic (5-hydroxytryptamine, 5-HT) contributions to decision-making with cognitive effort costs.

METHODS

The rCET is a modified version of the 5-choice serial reaction time task, a well-validated test of visuospatial attention and impulse control. At the start of each rCET trial, rats chose one of two levers, which set the difficulty of an attentional challenge, namely the localization of a visual stimulus illuminated for 0.2 or 1 s on hard versus easy trials. Successful completion of hard trials was rewarded with double the sugar pellets. Twenty-four female Long-Evans rats were trained on the rCET and systemically administered the 5-HT_1A agonist 8-OH-DPAT, the 5-HT_2A antagonist M100907, the 5-HT_2C agonist Ro-60-0175, as well as the 5-HT_2C antagonist SB 242, 084.

RESULTS

5-HT_2A antagonism dose-dependently reduced premature responding, while 5-HT_2C antagonism had the opposite effect. 8-OH-DPAT impaired accuracy of target detection at higher doses, while Ro-60-0175 dose-dependently improved accuracy on difficult trials. However, none of the drugs affected the rats' choice of the harder option.

CONCLUSION

When considered with existing work evaluating decision-making with physical effort costs, it appears that serotonergic signalling plays a minor role in guiding effort allocation.

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Challenges and Opportunities in Animal Models of Gambling-like Behavior

In the past several years, there has been an explosion of interest in animal models of risk-based decision-making, a fundamental process associated with gambling disorder. While early work focused on establishing various tasks for assaying decision-making, current studies are determining the (subtle and not-so-subtle) influence of cues in driving risky decisions to better understand problem gambling. In addition, these decision-making paradigms are now being used to investigate comorbid conditions such as substance dependence or brain injury and replicating observations from human patients. These animal models have now developed to a point where therapeutic interventions may be assessed for not just gambling disorder, but also a number of other conditions which engender risky decision-making.

Exposure to uncertainty mediates the effects of traumatic brain injury on probabilistic decision-making in rats

Primary Objective: Traumatic brain injury (TBI) is associated with numerous psychiatric comorbidities, and subclinical psychiatric symptoms. While many symptoms have been replicated in animal models of brain injury, a vast majority of studies utilize naïve rats as subjects, which fail to mimic the complex learning history of human patients.Methods and Procedures: In the current study, we evaluated the effects of a brain injury in animals with early exposure to uncertainty on post-injury decision-making in a probabilistic task, the rodent gambling task (RGT).Main Outcomes and Results: Exposure to uncertainty resulted in a heterogeneous sample relative to prior publications, and brain-injured rats showed no deficits in choice behavior compared to shams which contrasts with large, pervasive deficits in previously published work. However, TBI increased impulsivity and caused transient changes in behavioral variables indicative of initial motivational deficits (pellets earned, omitted responses). Notably, effects of amphetamine were similar on this heterogeneous sample of rats relative to a number of other published reports, suggesting consistent effects of gross monoaminergic manipulations on choice behavior, independent of experience.Conclusions: Going forward, translational studies need to consider the heterogeneity that exists at the clinical level and account for these problems when modeling diseases in animals.

Investigating the influence of 'losses disguised as wins' on decision making and motivation in rats

Multiline slot machines encourage continued play through 'losses disguised as wins' (LDWs), outcomes in which the money returned is less than that wagered. Individuals with gambling problems may be susceptible to this game feature. The cognitive and neurobiological mechanisms through which LDWs act are unknown. In a novel rat operant task, animals chose between a 'certain' lever, which always delivered two sugar pellets, or an 'uncertain' lever, resulting in four sugar pellets on 50% of trials. LDWs were then introduced as a return of three sugar pellets on 30-40% of uncertain rewarded trials. For half the rats, winning outcomes were paired with audiovisual feedback (cues). In a second study, the basolateral amygdala (BLA) was inactivated during initial presentation of LDWs. While LDWs shifted most rats' choice toward the certain lever, a subgroup of LDW vulnerable rats continued to choose the uncertain option, when the reward rate diminished. This profile of LDW vulnerability was reproduced after inactivating the BLA. Persistent choice of uncertain outcomes despite lower reward rates may reflect impaired functioning within the BLA. Future work using this model may provide insight into the neurobiological mechanisms contributing to the motivational properties of LDWs and their contribution to problematic gambling.

Monoaminergic modulation of decision-making under risk of punishment in a rat model

The ability to decide advantageously among options that vary in both their risks and rewards is critical for survival and well-being. Previous work shows that some forms of risky decision-making are robustly modulated by monoamine signaling, but it is less clear how monoamine signaling modulates decision-making under risk of explicit punishment. The goal of these experiments was to determine how this form of decision-making is modulated by dopamine, serotonin, and norepinephrine signaling, using a task in which rats choose between a small, 'safe' food reward and a large food reward associated with variable risks of punishment. Preference for the large, risky reward (risk-taking) was reduced by administration of a D2/3 dopamine receptor agonist (bromocriptine) and a selective D2 agonist (sumanirole). The selective D3 agonist PD128907 appeared to attenuate reward discrimination abilities but did not affect risk-taking per se. In contrast, drugs targeting serotonergic and noradrenergic signaling had few if any effects on choice behavior. These data suggest that in contrast to other forms of risky decision-making, decision-making under risk of punishment is selectively modulated by dopamine signaling, predominantly through D2 receptors.

Relative insensitivity to time-out punishments induced by win-paired cues in a rat gambling task

RATIONALE

Pairing rewarding outcomes with audiovisual cues in simulated gambling games increases risky choice in both humans and rats. However, the cognitive mechanism through which this sensory enhancement biases decision-making is unknown.

OBJECTIVES

To assess the computational mechanisms that promote risky choice during gambling, we applied a series of reinforcement learning models to a large dataset of choices acquired from rats as they each performed one of two variants of a rat gambling task (rGT), in which rewards on "win" trials were delivered either with or without salient audiovisual cues.

METHODS

We used a sampling technique based on Markov chain Monte Carlo to obtain posterior estimates of model parameters for a series of RL models of increasing complexity, in order to assess the relative contribution of learning about positive and negative outcomes to the latent valuation of each choice option on the cued and uncued rGT.

RESULTS

Rats which develop a preference for the risky options on the rGT substantially down-weight the equivalent cost of the time-out punishments during these tasks. For each model tested, the reduction in learning from the negative time-outs correlated with the degree of risk preference in individual rats. We found no apparent relationship between risk preference and the parameters that govern learning from the positive rewards.

CONCLUSIONS

The emergence of risk-preferring choice on the rGT derives from a relative insensitivity to the cost of the time-out punishments, as opposed to a relative hypersensitivity to rewards. This hyposensitivity to punishment is more likely to be induced in individual rats by the addition of salient audiovisual cues to rewards delivered on win trials.

Fluoxetine adjunct to therapeutic exercise promotes motor recovery in rats with cerebral ischemia: Roles of nucleus accumbens

The study aimed to explore the molecular mechanism of fluoxetine as an adjunct to therapeutic exercise to improve motor recovery using a rat cerebral ischemic model with middle cerebral artery occlusion (MCAO). We hypothesized that the nucleus accumbens (NAc) may be one of the responding areas to fluoxetine where relevant elevations in 5-hydroxytryptamine (5-HT) and ΔFosB were associated with motor behavioral recovery. Male Sprague-Dawley rats were randomly divided into five groups: rats without intervention; rats that underwent MCAO without exercise or fluoxetine; rats that underwent MCAO treated only with fluoxetine; rats that underwent MCAO treated only with exercise; and rats that underwent MCAO treated with both exercise and fluoxetine. Motor function and motivation were assessed by the fault footsteps test and the forced swimming test. 5-HT level in the bilateral NAc and the expression of 5-HT_2C receptor (5-HT_2CR) and ΔFosB in the ipsilesional (left) NAc were measured. Correlation was explored by Pearson correlation analysis. Our results indicated that either treatment helped improve the grasp dexterity of the affected limb, motor motivation, and resilience to adverse environment in MCAO rats. The dual treatment with fluoxetine and exercise may hasten the recovery process. The dual treatment helped restore the balance of 5-HT level between the bilateral NAc by significantly increasing its level in the ipsilesional side. Either treatment could resume the expression of 5-HT_2CR in the ipsilesional side of the NAc close to the normal level, which was correlated with motor recovery. The dual treatment significantly increased the expression of ΔFosB in the ipsilesional side of the NAc, which was correlated with the balance of 5-HT in the bilateral NAc, but not directly with motor recovery. In conclusion, the NAc may play an important role in driving physical motivation, which was possibly related to motor recovery after stroke. Fluoxetine may hasten the effectiveness of therapeutic exercise, possibly via regulating 5-HT and its receptors in the NAc.

Increased motor impulsivity in a rat gambling task during chronic ropinirole treatment: potentiation by win-paired audiovisual cues

RATIONALE

Chronic administration of D_2/3 receptor agonists ropinirole or pramipexole can increase the choice of uncertain rewards in rats, theoretically approximating iatrogenic gambling disorder (iGD).

OBJECTIVES

We aimed to assess the effect of chronic ropinirole in animal models that attempt to capture critical aspects of commercial gambling, including the risk of losing rather than failing to gain, and the use of win-paired sensory stimuli heavily featured in electronic gambling machines (EGMs).

METHODS

Male Long-Evans rats learned the rat gambling task (rGT; n = 24), in which animals sample between four options that differ in the magnitude and probability of rewards and time-out punishments. In the cued rGT (n = 40), reward-concurrent audiovisual cues were added that scaled in complexity with win size. Rats were then implanted with an osmotic pump delivering ropinirole (5 mg/kg/day) or saline for 28 days.

RESULTS

Chronic ropinirole did not unequivocally increase preference for more uncertain outcomes in either the cued or uncued rGT. Ropinirole transiently increased premature responses, a measure of motor impulsivity, and this change was larger and more long-lasting in the cued task.

CONCLUSIONS

These data suggest that explicitly signaling loss prevents the increase in preference for uncertain rewards caused by D_2/3 receptor agonists observed previously. The ability of win-paired cues to amplify ropinirole-induced increases in motor impulsivity may explain why compulsive use of EGMs is particularly common in iGD. These data offer valuable insight into the cognitive-behavioral mechanisms through which chronic dopamine agonist treatments may induce iGD and related impulse control disorders.

Examining the neurochemical underpinnings of animal models of risky choice: Methodological and analytic considerations

Because risky choice is associated with several psychiatric conditions, recent research has focused on examining the underlying neurochemical processes that control risk-based decision-making. Not surprisingly, several tasks have been developed to study the neural mechanisms involved in risky choice. The current review will briefly discuss the major tasks used to measure risky choice and will summarize the contribution of several major neurotransmitter systems to this behavior. To date, the most common measures of risky choice are the probability discounting task, the risky decision task, and the rat gambling task. Across these three tasks, the contribution of the dopaminergic system has been most studied, although the effects of serotonergic, adrenergic, cholinergic, and glutamatergic ligands will be discussed. Drug effects across these tasks have been inconsistent, which makes determining the precise role of neurotransmitter systems in risky choice somewhat difficult. Furthermore, procedural differences can modulate drug effects in these procedures, and the way data are analyzed can alter the interpretations one makes concerning pharmacological manipulations. By taking these methodological/analytic considerations into account, we may better elucidate the neurochemistry of risky decision-making. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Prior Exposure to Salient Win-Paired Cues in a Rat Gambling Task Increases Sensitivity to Cocaine Self-Administration and Suppresses Dopamine Efflux in Nucleus Accumbens: Support for the Reward Deficiency Hypothesis of Addiction

Rats trained to perform a version of the rat gambling task (rGT) in which salient audiovisual cues accompany reward delivery, similar to commercial gambling products, show greater preference for risky options. Given previous demonstrations that probabilistic reinforcement schedules can enhance psychostimulant-induced increases in accumbal DA and locomotor activity, we theorized that performing this cued task could perpetuate a proaddiction phenotype. Significantly more rats developed a preference for the risky options in the cued versus uncued rGT at baseline, and this bias was further exacerbated by cocaine self-administration, whereas the choice pattern of optimal decision-makers was unaffected. The addition of reward-paired cues therefore increased the proportion of rats exhibiting a maladaptive cognitive response to cocaine self-administration. Risky choice was not associated with responding for conditioned reinforcement or a marker of goal/sign-tracking, suggesting that reward-concurrent cues precipitate maladaptive choice via a unique mechanism unrelated to simple approach toward, or responding for, conditioned stimuli. Although "protected" from any resulting decision-making impairment, optimal decision-makers trained on the cued rGT nevertheless self-administered more cocaine than those trained on the uncued task. Collectively, these data suggest that repeated engagement with heavily cued probabilistic reward schedules can drive addiction vulnerability through multiple behavioral mechanisms. Rats trained on the cued rGT also exhibited blunted locomotor sensitization and lower basal accumbal DA levels, yet greater cocaine-induced increases in accumbal DA efflux. Gambling in the presence of salient cues may therefore result in an adaptive downregulation of the mesolimbic DA system, rendering individuals more sensitive to the deleterious effects of taking cocaine.SIGNIFICANCE STATEMENT Impaired cost/benefit decision making, exemplified by preference for the risky, disadvantageous options on the Iowa Gambling Task, is associated with greater risk of relapse and treatment failure in substance use disorder. Understanding factors that enhance preference for risk may help elucidate the neurobiological mechanisms underlying maladaptive decision making in addiction, thereby improving treatment outcomes. Problem gambling is also highly comorbid with substance use disorder, and many commercial gambling products incorporate salient win-paired cues. Here we show that adding reward-concurrent cues to a rat analog of the IGT precipitates a hypodopaminergic state, characterized by blunted accumbal DA efflux and attenuated locomotor sensitization, which may contribute to the enhanced responsivity to uncertain rewards or the reinforcing effects of cocaine we observed.

Brain and Cognition for Addiction Medicine: From Prevention to Recovery Neural Substrates for Treatment of Psychostimulant-Induced Cognitive Deficits

Addiction to psychostimulants like cocaine, methamphetamine, and nicotine poses a continuing medical and social challenge both in the United States and all over the world. Despite a desire to quit drug use, return to drug use after a period of abstinence is a common problem among individuals dependent on psychostimulants. Recovery for psychostimulant drug-dependent individuals is particularly challenging because psychostimulant drugs induce significant changes in brain regions associated with cognitive functions leading to cognitive deficits. These cognitive deficits include impairments in learning/memory, poor decision making, and impaired control of behavioral output. Importantly, these drug-induced cognitive deficits often impact adherence to addiction treatment programs and predispose abstinent addicts to drug use relapse. Additionally, these cognitive deficits impact effective social and professional rehabilitation of abstinent addicts. The goal of this paper is to review neural substrates based on animal studies that could be pharmacologically targeted to reverse psychostimulant-induced cognitive deficits such as impulsivity and impairment in learning and memory. Further, the review will discuss neural substrates that could be used to facilitate extinction learning and thus reduce emotional and behavioral responses to drug-associated cues. Moreover, the review will discuss some non-pharmacological approaches that could be used either alone or in combination with pharmacological compounds to treat the above-mentioned cognitive deficits. Psychostimulant addiction treatment, which includes treatment for cognitive deficits, will help promote abstinence and allow for better rehabilitation and integration of abstinent individuals into society.

The putative lithium-mimetic ebselen reduces impulsivity in rodent models

BACKGROUND

Deficits in impulse control feature in many psychiatric conditions including bipolar disorder, suicidality and addictions. Lithium lowers impulsivity in clinical populations and decreases pathological gambling in experimental medicine studies, but suffers from adverse effects, poor compliance and a low therapeutic index.

AIMS

Recently we identified that the neuroprotective agent ebselen, which is reportedly safe in humans, inhibited inositol monophosphatase (IMPase), a candidate lithium mechanism. Ebselen also reduced 5-HT receptor (5-HT_2A) function which predicts impulsivity lowering properties. Here we investigated the effect of ebselen in rat models of impulsive behaviour.

METHODS

Ebselen was tested in two models of impulsivity with human analogues: the five-choice serial reaction time task (5-CSRTT) and rodent gambling task (rGT). The main outcome measures were premature responses (5-CSRTT and rGT) and choice behaviour (rGT), which model motor impulsivity and choice impulsivity, respectively.

RESULTS

At doses that decreased 5-HT_2A receptor function (DOI-induced wet dog shakes), ebselen decreased premature responding in the 5-CSRTT both in the absence and presence of cocaine. The 5-HT_2A receptor antagonist MDL 100,907 also reduced premature responding in the 5-CSRTT although not in the presence of cocaine. In the rGT ebselen showed a tendency to reduce premature responding but had no effect on choice behaviour.

CONCLUSIONS

These findings suggest that ebselen preferentially reduces motor impulsivity over choice impulsivity, and that inhibition of 5-HT_2A receptor function is a contributing mechanism. Collectively, these data support the repurposing of ebselen as an anti-impulsive treatment and fast-tracking to clinical trials in patient groups characterised by poor impulse control.

Role of impulsivity and reward in the anti-obesity actions of 5-HT2C receptor agonists

The selective 5-HT_2C receptor agonist lorcaserin entered clinical obesity trials with the prevalent view that satiety was a primary mechanism of action. Subsequent Phase II and III trials demonstrated efficacy in terms of weight loss, although the overall effect size (~3% placebo-corrected change) is considered modest. Lorcaserin has been approved by the FDA for the treatment of obesity with lifestyle modification, but since its introduction in 2013 its sales are in decline, probably due to its overall modest effect. However, in some individuals, lorcaserin has a much more clinically significant effect (i.e. >10% placebo-corrected change), although what common features, if any, define these high responders is presently unknown. In the present article we highlight the evidence that alternative mechanisms to satiety may contribute to the anti-obesity effect of lorcaserin, namely effects on constructs of primary and conditioned reward and impulsivity. This may better inform the clinical evaluation of lorcaserin (and any future 5-HT_2C receptor agonists) to subgroups of obese subjects characterized by overeating due to maladaptive impulsivity and reward mechanisms. One such population might be individuals diagnosed with binge eating disorder.