Pharmacological evidence of a cholinergic contribution to elevated impulsivity and risky decision-making caused by adding win-paired cues to a rat gambling task

The neuropharmacological profile of interval responding during operant tasks

Responses occurring during intervals of operant tasks have been subdivided as interim, facultative, and terminal, depending on the time between response onset and reward. Although interval responses, also known as adjunctive responses, have been described in pigeons, rats, mice, monkeys, and humans, most experiments have been conducted in rats. We review the neurochemical basis of interval responses and examine the hypothesis that these responses modulate operant performance. Preliminary experiments indicate the involvement of biogenic amines, acetylcholine, and GABA during interval responding associated with operant tasks. In particular, catecholaminergic deafferentation of the basal ganglia modulated interval responses as did the peripheral injection of catecholamine reuptake blockers. Under the influence of amphetamine, interval responding may either increase or decrease, so that a wide range of responses must be selected to gauge drug effects. In non-drugged pigeons and rats, the expression of interval responses facilitates operant training.

Phase synchrony between prefrontal noradrenergic and cholinergic signals indexes inhibitory control

Inhibitory control is a critical executive function that allows animals to suppress their impulsive behavior in order to achieve certain goals or avoid punishment. We investigated norepinephrine (NE) and acetylcholine (ACh) dynamics and population neuronal activity in the prefrontal cortex during inhibitory control. Using fluorescent sensors to measure extracellular levels of NE and ACh, we simultaneously recorded the dynamics of prefrontal NE and ACh in mice performing an inhibitory control task. The prefrontal NE and ACh signals exhibited strong coherence at 0.4-0.8 Hz. Chemogenetic inhibition of locus coeruleus (LC) neurons that project to the basal forebrain region reduced inhibitory control performance to chance levels. However, this manipulation did not diminish the difference in NE/ACh signals between successful and failed trials; instead, it abolished the difference in NE-ACh phase synchrony between the successful and failed trials, indicating that NE-ACh phase synchrony is a task-relevant neuromodulatory feature. Chemogenetic inhibition of cholinergic neurons that project to the LC region did not impair the inhibitory control performance, nor did it abolish the difference in NE-ACh phase synchrony between successful or failed trials, further confirming the relevance of NE-ACh phase synchrony to inhibitory control. To understand the possible effect of NE-ACh synchrony on prefrontal population activity, we employed Neuropixels to record from the prefrontal cortex with and without inhibiting LC neurons that project to the basal forebrain during inhibitory control. The LC inhibition reduced the number of prefrontal neurons encoding inhibitory control. Demixed principal component analysis (dPCA) further revealed that population firing patterns representing inhibitory control were impaired by the LC inhibition. Disparities in NE-ACh phase synchrony relevant to inhibitory control occurred only in the prefrontal cortex, but not in the parietal cortex, somatosensory cortex, and the somatosensory thalamus. Taken together, these findings suggest that the LC modulates inhibitory control through its collective effect with cholinergic systems on population activity in the prefrontal cortex. Our results further revealed that NE-ACh phase synchrony is a critical neuromodulatory feature with important implications for cognitive control.

Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions

RATIONALE

Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding.

OBJECTIVE

The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance.

RESULTS

When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine.

CONCLUSIONS

These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

Adaptive decision-making depends on pupil-linked arousal in rats performing tactile discrimination tasks

Perceptual decision-making is a dynamic cognitive process and is shaped by many factors, including behavioral state, reward contingency, and sensory environment. To understand the extent to which adaptive behavior in decision-making is dependent on pupil-linked arousal, we trained head-fixed rats to perform perceptual decision-making tasks and systematically manipulated the probability of Go and No-go stimuli while simultaneously measuring their pupil size in the tasks. Our data demonstrated that the animals adaptively modified their behavior in response to the changes in the sensory environment. The response probability to both Go and No-go stimuli decreased as the probability of the Go stimulus being presented decreased. Analyses within the signal detection theory framework showed that while the animals' perceptual sensitivity was invariant, their decision criterion increased as the probability of the Go stimulus decreased. Simulation results indicated that the adaptive increase in the decision criterion will increase possible water rewards during the task. Moreover, the adaptive decision-making is dependent on pupil-linked arousal as the increase in the decision criterion was the largest during low pupil-linked arousal periods. Taken together, our results demonstrated that the rats were able to adjust their decision-making to maximize rewards in the tasks, and that adaptive behavior in perceptual decision-making is dependent on pupil-linked arousal.NEW & NOTEWORTHY Perceptual decision-making is a dynamic cognitive process and is shaped by many factors. However, the extent to which changes in sensory environment result in adaptive decision-making remains poorly understood. Our data provided new experimental evidence demonstrating that the rats were able to adaptively modify their decision criterion to maximize water reward in response to changes in the statistics of the sensory environment. Furthermore, the adaptive decision-making is dependent on pupil-linked arousal.

Exploring the underlying mechanisms of drug-induced impulse control disorders: a pharmacovigilance-pharmacodynamic study

INTRODUCTION

Impulse control disorders (e.g. pathological gambling, hypersexuality) may develop as adverse reactions to drugs. Pathogenetic hypotheses have mainly focused on D3-receptor agonism, and switching to alternatives with different pharmacologic mechanisms represents a common management strategy. Nonetheless, treatment failure is common and gaining pathophysiological insights is needed.

AIM

We aimed to identify targets potentially contributing to pathologic impulsivity.

METHOD

We performed a pharmacovigilance-pharmacodynamic study on dopamine agonists and antipsychotics using the Food and Drug Administration Adverse Event Reporting System (January 2004-December 2021). We estimated disproportionate reporting using the Bayesian information component. Using online public databases (IUPHAR, ChEMBL, PDSP, DrugBank), we calculated drug occupancies. To identify the targets potentially contributing to impulsivity, we fitted univariate regression models interpolating information components and occupancies within dopamine agonists and antipsychotics. Sensitivity analyses were performed to check for the robustness of the results.

RESULTS

Among 19 887 reports of impulsivity, 5898 recorded an antipsychotic, and 3100 a dopamine agonist. The more robust signals concerned aripiprazole (N = 3091; median information component [95% confidence interval] = 4.51[4.45-4.55]) and brexpiprazole (229; 4.00[3.78-4.16]) for antipsychotics, pergolide (105; 5.82[5.50-6.06]) and pramipexole (2009; 5.43[5.36-5.48]) for dopamine agonists. Robust, significant positive associations between drug occupancy and impulsivity reporting were found for D3 within dopamine agonists (beta = 1.52; P-value = 0.047) and 5-HT1a within antipsychotics (1.92, 0.029).

CONCLUSION

Our results supported the role of D3-receptor agonism in inducing impulsivity in dopamine receptor agonists and identified a potential role of 5-HT1a receptor agonism in antipsychotics. Investigating these receptors may drive towards a better management of drug-induced impulsivity.

D2/3 Agonist during Learning Potentiates Cued Risky Choice

Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos+ neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues.SIGNIFICANCE STATEMENT D2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this.

Increased Risky Choice and Reduced CHRNB2 Expression in Adult Male Rats Exposed to Nicotine Vapor

While the cognitive enhancing effects of nicotine use have been well documented, it has also been shown to impair decision making. The goal of this study was to determine if exposure to nicotine vapor increases risky decision making. The study also aims to investigate possible long-term effects of nicotine vapor exposure on the expression of genes coding for cholinergic and dopaminergic receptors in brain. Thirty-two adult male Sprague Dawley rats were exposed to 24 mg/mL nicotine vapor or vehicle control, immediately followed by testing in the probability discounting task for 10 consecutive days. Fifty-four days after the 10-day vapor exposure, animals were sacrificed and expression of genes coding for the α4 and β2 cholinergic receptor subunits, and dopamine D1 and D2 receptors, were analyzed using RT-PCR. Exposure to nicotine vapor caused an immediate and transient increase in risky choice. Analyses of gene expression identified significant reductions in CHRNB2 and DRD1 in the nucleus accumbens core and CHRNB2 and DRD2 in the medial prefrontal cortex of rats previously exposed to nicotine vapor, relative to vehicle controls. Results provide data on the negative cognitive effects of nicotine vapor exposure and identify cholinergic and dopaminergic mechanisms that may affected with repeated use.

Serotonin 2C Antagonism in the Lateral Orbitofrontal Cortex Ameliorates Cue-Enhanced Risk Preference and Restores Sensitivity to Reinforcer Devaluation in Male Rats

Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long–Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT_2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT_2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT_2C antagonism may optimize choice by facilitating exploration.

Noradrenergic contributions to cue-driven risk-taking and impulsivity

RATIONALE

The flashing lights and sounds of modern casinos are alluring and may contribute to the addictive nature of gambling. Such cues can have a profound impact on the noradrenaline (NA) system, which could therefore be a viable therapeutic target for gambling disorder (GD). While there is substantial evidence to support the involvement of NA in the impulsive symptoms of GD, its function in mediating the "pro-addictive" impact of cues is less understood.

OBJECTIVE

We wished to investigate the role of NA in our rodent assay of decision making and impulsivity, the cued rat gambling task (crGT). Given that sex differences are prominent in addiction disorders, and increasingly reported in the monoaminergic regulation of behaviour, we also prioritised evaluating noradrenergic drugs in both sexes.

METHODS

Female and male rats were trained to stability on the crGT and then given intraperitoneal injections of the noradrenaline reuptake inhibitor atomoxetine, the α_2A receptor agonist guanfacine, the beta receptor antagonist propranolol, and the α₂ receptor antagonist yohimbine.

RESULTS

Atomoxetine dose-dependently improved decision-making score. Guanfacine selectively enhanced decision making in risk-preferring males and optimal performing females. Propranolol and yohimbine did not influence decision making. Atomoxetine and guanfacine reduced premature responses, while yohimbine bi-phasically affected this index of motor impulsivity.

CONCLUSIONS

These results support the hypothesis that NA is an important neuromodulator of the cue-induced deficits in decision making observed in laboratory-based gambling paradigms, and suggest that NAergic drugs like atomoxetine and guanfacine may be useful in treating GD.