Effects of low to moderate acute doses of pramipexole on impulsivity and cognition in healthy volunteers

Dopamine and acetylcholine have distinct roles in delay- and effort-based decision-making in humans

In everyday life, we encounter situations that require tradeoffs between potential rewards and associated costs, such as time and (physical) effort. The literature indicates a prominent role for dopamine in discounting of both delay and effort, with mixed findings for delay discounting in humans. Moreover, the reciprocal antagonistic interaction between dopaminergic and cholinergic transmission in the striatum suggests a potential opponent role of acetylcholine in these processes. We found opposing effects of dopamine D2 (haloperidol) and acetylcholine M1 receptor (biperiden) antagonism on specific components of effort-based decision-making in healthy humans: haloperidol decreased, whereas biperiden increased the willingness to exert physical effort. In contrast, delay discounting was reduced under haloperidol, but not affected by biperiden. Together, our data suggest that dopamine, acting at D2 receptors, modulates both effort and delay discounting, while acetylcholine, acting at M1 receptors, appears to exert a more specific influence on effort discounting only.

Pharmacological Modulation of Temporal Discounting: A Systematic Review

Temporal discounting is a phenomenon where a reward loses its value as a function of time (e.g., a reward is more valuable immediately than when it delays in time). This is a type of intertemporal decision-making that has an association with impulsivity and self-control. Many pathologies exhibit higher discounting rates, meaning they discount more the values of rewards, such as addictive behaviors, bipolar disorder, attention-deficit/hyperactivity disorders, social anxiety disorders, and major depressive disorder, among others; thus, many studies look for the mechanism and neuromodulators of these decisions. This systematic review aims to investigate the association between pharmacological administration and changes in temporal discounting. A search was conducted in PubMed, Scopus, Web of Science, Science Direct and Cochrane. We used the PICO strategy: healthy humans (P-Participants) that received a pharmacological administration (I-Intervention) and the absence of a pharmacological administration or placebo (C-Comparison) to analyze the relationship between the pharmacological administration and the temporal discounting (O-outcome). Nineteen studies fulfilled the inclusion criteria. The most important findings were the involvement of dopamine modulation in a U-shape for choosing the delayed outcome (metoclopradime, haloperidol, and amisulpride). Furthermore, administration of tolcapone and high doses of d-amphetamine produced a preference for the delayed option. There was a time-dependent hydrocortisone effect in the preference for the immediate reward. Thus, it can be concluded that dopamine is a crucial modulator for temporal discounting, especially the D2 receptor, and cortisol also has an important time-dependent role in this type of decision. One of the limitations of this systematic review is the heterogeneity of the drugs used to assess the effect of temporal discounting.

Enhanced Taste Recognition Following Subacute Treatment With The Dopamine D2/D3 Receptor Agonist Pramipexole in Healthy Volunteers

BACKGROUND

Patients with Parkinson's disease (PD) show impaired performance in taste recognition tests, which suggests a possible dopaminergic influence on gustatory functioning. To experimentally test this hypothesis, we assessed whether pharmacological manipulation of dopaminergic signaling in healthy volunteers can affect performance in a standardized taste recognition test.

METHODS

Physically and mentally healthy volunteers (n = 40, age 18-43 years) were randomly allocated to treatment with either pramipexole or placebo using a double-blind, parallel-group design. After 12 to 15 days of treatment (dose titrated up from 0.25 mg/d of pramipexole salt to 1.0 mg/d), taste recognition performance was assessed using a standardized and validated assay (taste strip test). Additionally, visual analogue scale ratings of subjective pleasantness and disgustingness of taste samples were obtained.

RESULTS

Compared with the placebo group, participants receiving pramipexole showed significantly higher total recognition accuracy (medianpramipexole = 14.0, medianplacebo = 13.0, U = 264.5, P = .04). This was driven by a higher sensitivity for taste in the pramipexole group. Exploratory analysis of pleasantness and disgustingness ratings of appetitive (sweet) vs aversive (bitter) stimuli suggested that pramipexole treatment was associated with overall blunted hedonic responses, but this effect did not survive the inclusion of nausea (a side effect of treatment) as a covariate in the analysis.

CONCLUSIONS

Healthy volunteers who received subacute pramipexole treatment exhibited higher taste recognition performance compared with the placebo group. This finding is consistent with a proposed role of the dopaminergic system in gustatory functioning and could have important theoretical and clinical implications.

Dual Orexin Receptor Antagonists (DORAs) as an Adjunct Treatment for Smoking Cessation

Smoking is recognized as the most avoidable cause for multiplicity of chronic diseases. However, smoking cessation rates remain low, in part due to the limited target engagement of the currently approved medications for smoking cessation. Sleep is a promising focus for increasing smoking cessation rates because smokers' sleep problems are exacerbated during the first week of smoking abstinence and are associated with poor smoking cessation outcomes. Furthermore, the currently approved smoking cessation pharmacological agents varenicline and nicotine replacement treatment exacerbate sleep problems beyond what would be observed as a consequence of natural nicotine withdrawal. Addressing sleep problems with dual orexin receptor antagonists (DORAs) is positioned to remedy the shortcoming of overlooking sleep as a viable smoking cessation intervention target. Based on previous animal literature, DORA agents suvorexant and lemborexant may accomplish this by diminishing withdrawal difficulty and reducing nicotine cravings. The pharmacologic focus is the orexin system, not only because orexin peptides mediate the sleep-wake cycle, but also because DORA agents have a milder adverse event profile over previous treatments for insomnia. A novel adjunct DORA treatment to a currently approved smoking cessation pharmacotherapy holds a potential to reduce morbidity and mortality caused by smoking.

Towards a Unifying Account of Dopamine’s Role in Cost-Benefit Decision Making

Dopamine is thought to play a crucial role in cost-benefit decision making, but so far there is no consensus on the precise role of dopamine in decision making. Here, we review the literature on dopaminergic manipulations of cost-benefit decision making in humans and evaluate how well different theoretical accounts explain the existing body of evidence. Reduced D₂ stimulation tends to increase the willingness to bear delay and risk costs (i.e., wait for later rewards, take riskier options), while increased D₁ and D₂ receptor stimulation increases willingness to bear effort costs. We argue that the empirical findings can best be explained by combining the strengths of two theoretical accounts: in cost-benefit decision making, dopamine may play a dual role both in promoting the pursuit of psychologically close options (e.g., sooner and safer rewards) and in computing which costs are acceptable for a reward at stake. Moreover, we identify several limiting factors in the study designs of previous investigations that prevented a fuller understanding of dopamine's role in value-based choice. Together, the proposed theoretical framework and the methodological suggestions for future studies may bring us closer to a unifying account of dopamine in healthy and impaired cost-benefit decision making.

Dopamine increases risky choice while D2 blockade shortens decision time

Dopamine is crucially involved in decision-making and overstimulation within dopaminergic pathways can lead to impulsive behaviour, including a desire to take risks and reduced deliberation before acting. These behavioural changes are side effects of treatment with dopaminergic drugs in Parkinson disease, but their likelihood of occurrence is difficult to predict and may be influenced by the individual's baseline endogenous dopamine state, and indeed correlate with sensation-seeking personality traits. We here collected data on a standard gambling task in healthy volunteers given either placebo, 2.5 mg of the dopamine antagonist haloperidol or 100/25 mg of the dopamine precursor levodopa in a within-subject design. We found an increase in risky choices on levodopa. Choices were, however, made faster on haloperidol with no effect of levodopa on deliberation time. Shortened deliberation times on haloperidol occurred in low sensation-seekers only, suggesting a correlation between sensation-seeking personality trait and baseline dopamine levels. We hypothesise that levodopa increases risk-taking behaviour via overstimulation at both D1 and D2 receptor level, while a single low dose of haloperidol, as previously reported (Frank and O'Reilly 2006), may block D2 receptors pre- and post-synaptically and may paradoxically lead to higher striatal dopamine acting on remaining striatal D1 receptors, causing speedier decision without influencing risk tolerance. These effects could also fit with a recently proposed computational model of the basal ganglia (Moeller and Bogacz 2019; Moeller et al. 2021). Furthermore, our data suggest that the actual dopaminergic drug effect may be dependent on the individual's baseline dopamine state, which may influence our therapeutic decision as clinicians in the future.

Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults

Dopamine (DA) plays a key role in reward processing and is implicated in psychological disorders such as depression, substance use, and schizophrenia. The role of DA in reward processing is an area of highly active research. One approach to this question is drug challenge studies with drugs known to alter DA function. These studies provide good experimental control and can be performed in parallel in laboratory animals and humans. This review aimed to summarize results of studies using pharmacological manipulations of DA in healthy adults. 'Reward' is a complex process, so we separated 'phases' of reward, including anticipation, evaluation of cost and benefits of upcoming reward, execution of actions to obtain reward, pleasure in response to receiving a reward, and reward learning. Results indicated that i) DAergic drugs have different effects on different phases of reward; ii) the relationship between DA and reward functioning appears unlikely to be linear; iii) our ability to detect the effects of DAergic drugs varies depending on whether subjective, behavioral, imaging measures are used.

Dopaminergic Modulation of Human Intertemporal Choice: A Diffusion Model Analysis Using the D2-Receptor Antagonist Haloperidol

The neurotransmitter dopamine is implicated in diverse functions, including reward processing, reinforcement learning, and cognitive control. The tendency to discount future rewards over time has long been discussed in the context of potential dopaminergic modulation. Here we examined the effect of a single dose of the D2 receptor antagonist haloperidol (2 mg) on temporal discounting in healthy female and male human participants. Our approach extends previous pharmacological studies in two ways. First, we applied combined temporal discounting drift diffusion models to examine choice dynamics. Second, we examined dopaminergic modulation of reward magnitude effects on temporal discounting. Hierarchical Bayesian parameter estimation revealed that the data were best accounted for by a temporal discounting drift diffusion model with nonlinear trialwise drift rate scaling. This model showed good parameter recovery, and posterior predictive checks revealed that it accurately reproduced the relationship between decision conflict and response times in individual participants. We observed reduced temporal discounting and substantially faster nondecision times under haloperidol compared with placebo. Discounting was steeper for low versus high reward magnitudes, but this effect was largely unaffected by haloperidol. Results were corroborated by model-free analyses and modeling via more standard approaches. We previously reported elevated caudate activation under haloperidol in this sample of participants, supporting the idea that haloperidol elevated dopamine neurotransmission (e.g., by blocking inhibitory feedback via presynaptic D2 auto-receptors). The present results reveal that this is associated with an augmentation of both lower-level (nondecision time) and higher-level (temporal discounting) components of the decision process.SIGNIFICANCE STATEMENT Dopamine is implicated in reward processing, reinforcement learning, and cognitive control. Here we examined the effects of a single dose of the D2 receptor antagonist haloperidol on temporal discounting and choice dynamics during the decision process. We extend previous studies by applying computational modeling using the drift diffusion model, which revealed that haloperidol reduced the nondecision time and reduced impulsive choice compared with placebo. These findings are compatible with a haloperidol-induced increase in striatal dopamine (e.g., because of a presynaptic mechanism). Our data provide novel insights into the contributions of dopamine to value-based decision-making and highlight how comprehensive model-based analyses using sequential sampling models can inform the effects of pharmacological modulation on choice processes.

The role of dopamine pharmacotherapy and addiction-like behaviors in Parkinson's disease

Addictions involve a spectrum of behaviors that encompass features of impulsivity and compulsivity, herein referred to as impulsive-compulsive spectrum disorders (ICSDs). The etiology of ICSDs likely involves a complex interplay among neurobiological, psychological and social risk factors. Neurobiological risk factors include the status of the neuroanatomical circuits that govern ICSDs. These circuits can be altered by disease, as well as exogenous influences such as centrally-acting pharmacologics. The 'poster child' for this scenario is Parkinson's disease (PD) medically managed by pharmacological treatments. PD is a progressive neurodegenerative disease that involves a gradual loss of dopaminergic neurons largely within nigrostriatal projections. Replacement therapy includes dopamine receptor agonists that directly activate postsynaptic dopamine receptors (bypassing the requirement for functioning presynaptic terminals). Some clinically useful dopamine agonists, e.g., pramipexole and ropinirole, exhibit high affinity for the D2/D3 receptor subtypes. These agonists provide excellent relief from PD motor symptoms, but some patients exhibit debilitating ICSD. Teasing out the neuropsychiatric contribution of PD-associated pathology from the drugs used to treat PD motor symptoms is challenging. In this review, we posit that modern clinical and preclinical research converge on the conclusion that dopamine replacement therapy can mediate addictions in PD and other neurological disorders. We provide five categories of evidences that align with this position: (i) ICSD prevalence is greater with D2/D3 receptor agonist therapy vs PD alone. (ii) Capacity of dopamine replacement therapy to produce addiction-like behaviors is independent of disease for which the therapy is being provided. (iii) ICSD-like behaviors are recapitulated in laboratory rats with and without PD-like pathology. (iv) Behavioral pathology co-varies with drug exposure. (v) ICSD Features of ICSDs are consistent with agonist pharmacology and neuroanatomical substrates of addictions. Considering the underpinnings of ICSDs in PD should not only help therapeutic decision-making in neurological disorders, but also apprise ICSDs in general.

Disrupted Sleep and Circadian Rhythms in Schizophrenia and Their Interaction With Dopamine Signaling

Sleep and circadian rhythm disruption (SCRD) is a common feature of schizophrenia, and is associated with symptom severity and patient quality of life. It is commonly manifested as disturbances to the sleep/wake cycle, with sleep abnormalities occurring in up to 80% of patients, making it one of the most common symptoms of this disorder. Severe circadian misalignment has also been reported, including non-24 h periods and phase advances and delays. In parallel, there are alterations to physiological circadian parameters such as body temperature and rhythmic hormone production. At the molecular level, alterations in the rhythmic expression of core clock genes indicate a dysfunctional circadian clock. Furthermore, genetic association studies have demonstrated that mutations in several clock genes are associated with a higher risk of schizophrenia. Collectively, the evidence strongly suggests that sleep and circadian disruption is not only a symptom of schizophrenia but also plays an important causal role in this disorder. The alterations in dopamine signaling that occur in schizophrenia are likely to be central to this role. Dopamine is well-documented to be involved in the regulation of the sleep/wake cycle, in which it acts to promote wakefulness, such that elevated dopamine levels can disturb sleep. There is also evidence for the influence of dopamine on the circadian clock, such as through entrainment of the master clock in the suprachiasmatic nuclei (SCN), and dopamine signaling itself is under circadian control. Therefore dopamine is closely linked with sleep and the circadian system; it appears that they have a complex, bidirectional relationship in the pathogenesis of schizophrenia, such that disturbances to one exacerbate abnormalities in the other. This review will provide an overview of the evidence for a role of SCRD in schizophrenia, and examine the interplay of this with altered dopamine signaling. We will assess the evidence to suggest common underlying mechanisms in the regulation of sleep/circadian rhythms and the pathophysiology of schizophrenia. Improvements in sleep are associated with improvements in symptoms, along with quality of life measures such as cognitive ability and employability. Therefore the circadian system holds valuable potential as a new therapeutic target for this disorder.

The adverse effects of pramipexole on probability discounting are not reversed by acute D2 or D3 receptor antagonism

Pramipexole (PPX) is a D₂ and D₃ dopamine receptor agonist approved for clinical use, which is associated with a higher risk of impulse-control disorders. Using a rat model, we recently found that low doses of the monoamine-depleting agent reserpine (RES; 1 mg/kg/day, SC) dramatically increased the untoward effects of PPX (0.3 mg/kg/day, SC) on probability discounting, a key impulsivity function. To further understand the neurobehavioral mechanisms underlying these effects, we first tested whether the combination of PPX and RES may lead to a generalized enhancement in risk taking, as tested in the suspended wire-beam paradigm. The association of RES and PPX did not augment the proclivity of rats to cross the bridge in order to obtain a reward, suggesting that the effects of RES and PPX on probability discounting do not reflect a generalized increase in impulsivity. We then studied what receptors mediate the effects of PPX in RES-treated rats. The combination of RES and PPX increased membrane expression and binding of D₃, but not D₂ dopamine receptors, in the nucleus accumbens. However, the behavioral effects of PPX and RES were not reduced by acute treatments with the D₂/D₃ receptor antagonist raclopride (0.01-0.05 mg/kg, SC), the highly selective D₂ receptor antagonist L-741,626 (0.1-1 mg/kg, SC) or the D₃ receptor antagonists GR 103691 (0.1-0.3 mg/kg, SC) and SB 277011A (1-10 mg/kg, SC). These findings collectively suggest that the effects of PPX in probability discounting do not reflect generalized enhancements in impulsivity or acute dopamine D₂ or D₃ receptor activation.

The anterior caudate nucleus supports impulsive choices triggered by pramipexole

BACKGROUND

Pramipexole is a dopamine agonist used as a treatment in PD and restless legs syndrome to reduce motor symptoms, but it often induces impulse control disorders. In particular, patients with impulse control disorders tend to make more impulsive choices in the delay discounting task, that is, they choose small immediate rewards over larger delayed ones more often than patients without impulse control disorders and healthy subjects do. Yet the site of action of pramipexole that produces these impulsive choices remains unknown. Based on the heterogeneity of corticostriatal projections and the massive dopamine innervation of the striatum, we hypothesized that impulsive choices triggered by dopamine treatments may be supported by a specific striatal territory.

OBJECTIVES

This study aims to determine by which anteriorstriatum territory the Pramipexole trigger impulsive choices; the caudate nucleus, the ventral striatum or the putamen.

METHODS

We compared pramipexole intramuscular injections to intracerebral microinjections within the three striatal territories in healthy monkeys trained to execute the delay discounting task, a behavioral paradigm typically used to evaluate impulsive choices.

RESULTS

We found that pramipexole intramuscular injections induced impulsive choices in all monkeys. Local microinjections were performed inside the anterior caudate nucleus, ventral striatum, and anterior putamen and reproduced those impulsive choices when pramipexole was directly injected into the caudate nucleus, whereas injections into the ventral striatum or putamen had no effect on monkeys' choices.

CONCLUSIONS

These results, consistent with clinical studies, suggest that impulsive choices triggered by pramipexole are supported by the caudate nucleus, allowing us to emphasize the importance of dopamine modulation inside this striatal territory in decision processes underlying impulsive behaviors. © 2019 International Parkinson and Movement Disorder Society.

Baseline impulsivity may moderate L-DOPA effects on value-based decision-making

Research has indicated a major role of dopamine in decision-making processes, but the underlying mechanisms remain largely unknown due to inconsistency in effects of dopaminergic drugs. To clarify the impact of dopamine on impulsive choice, we administered 150 mg L-DOPA to 87 healthy adults in a randomized, placebo-controlled, double-blind, crossover study, evaluating performance in four value-based decision-making tasks. We predicted that baseline impulsivity would moderate L-DOPA effects. In support of our hypothesis, L-DOPA had no main effect on impulsive choice, but reduced risk-seeking for gains in more-impulsive subjects. Because L-DOPA effects may be influenced by body weight, we repeated our analyses on data from half of the sample (n = 44) with lower weight, anticipating a stronger effect. In addition to the effect on risk-seeking for gains, low-weight participants also exhibited baseline-dependent effects of L-DOPA on loss aversion and delay discounting. Our results are consistent with the hypothesis of an inverted U-shaped dopamine function in which both low and high extremes of dopamine signaling are associated with high-impulsive choice. Consideration of differential baseline impulsivity and body weight may resolve previous seemingly paradoxical pharmacological results and might deepen our understanding of dopaminergic mechanisms underlying impulsivity.

Dopaminergic Therapy Increases Go Timeouts in the Go/No-Go Task in Patients with Parkinson's Disease

Parkinson's disease (PD) is characterized by resting tremor, rigidity and bradykinesia. Dopaminergic medications such as L-dopa treat these motor symptoms, but can have complex effects on cognition. Impulse control is an essential cognitive function. Impulsivity is multifaceted in nature. Motor impulsivity involves the inability to withhold pre-potent, automatic, erroneous responses. In contrast, cognitive impulsivity refers to improper risk-reward assessment guiding behavior. Informed by our previous research, we anticipated that dopaminergic therapy would decrease motor impulsivity though it is well known to enhance cognitive impulsivity. We employed the Go/No-go paradigm to assess motor impulsivity in PD. Patients with PD were tested using a Go/No-go task on and off their normal dopaminergic medication. Participants completed cognitive, mood, and physiological measures. PD patients on medication had a significantly higher proportion of Go trial Timeouts (i.e., trials in which Go responses were not completed prior to a deadline of 750 ms) compared to off medication (p = 0.01). No significant ON-OFF differences were found for Go trial or No-go trial response times (RTs), or for number of No-go errors. We interpret that dopaminergic therapy induces a more conservative response set, reflected in Go trial Timeouts in PD patients. In this way, dopaminergic therapy decreased motor impulsivity in PD patients. This is in contrast to the widely recognized effects of dopaminergic therapy on cognitive impulsivity leading in some patients to impulse control disorders. Understanding the nuanced effects of dopaminergic treatment in PD on cognitive functions such as impulse control will clarify therapeutic decisions.

Pramipexole enhances disadvantageous decision-making: Lack of relation to changes in phasic dopamine release

Pramipexole (PPX) is a high-affinity D₂-like dopamine receptor agonist, used in the treatment of Parkinson's disease (PD) and restless leg syndrome. Recent evidence indicates that PPX increases the risk of problem gambling and impulse-control disorders in vulnerable patients. Although the molecular bases of these complications remain unclear, several authors have theorized that PPX may increase risk propensity by activating presynaptic dopamine receptors in the mesolimbic system, resulting in the reduction of dopamine release in the nucleus accumbens (NAcc). To test this possibility, we subjected rats to a probability-discounting task specifically designed to capture the response to disadvantageous options. PPX enhanced disadvantageous decision-making at a dose (0.3 mg/kg/day, SC) that reduced phasic dopamine release in the NAcc. To test whether these modifications in dopamine efflux were responsible for the observed neuroeconomic deficits, PPX was administered in combination with the monoamine-depleting agent reserpine (RES), at a low dose (1 mg/kg/day, SC) that did not affect baseline locomotor and operant responses. Contrary to our predictions, RES surprisingly exacerbated the effects of PPX on disadvantageous decision-making, even though it failed to augment PPX-induced decreases in phasic dopamine release. These results collectively suggest that PPX impairs the discounting of probabilistic losses and that the enhancement in risk-taking behaviors secondary to this drug may be dissociated from dynamic changes in mesolimbic dopamine release.

Pramipexole Increases Go Timeouts but Not No-go Errors in Healthy Volunteers

Parkinson's disease (PD) is characterized by motor symptoms, such as resting tremor, bradykinesia and rigidity, but also features non-motor complications. PD patients taking dopaminergic therapy, such as levodopa but especially dopamine agonists (DAs), evidence an increase in impulse control disorders (ICDs), suggesting a link between dopaminergic therapy and impulsive pursuit of pleasurable activities. However, impulsivity is a multifaceted construct. Motor impulsivity refers to the inability to overcome automatic responses or cancel pre-potent responses. Previous research has suggested that PD patients, on dopaminergic medications, have decreased motor impulsivity. Whether effects on impulsivity are main effects of dopaminergic therapies or are specific to PD is unclear. Using a Go No-go task, we investigated the effect of a single dose of the DA pramipexole on motor impulsivity in healthy participants. The Go No-go task consisted of Go trials, for which keystroke responses were made as quickly as possible, and lesser frequency No-go trials, on which motor responses were to be inhibited. We hypothesized that pramipexole would decrease motor impulsivity. This would manifest as: (a) fewer No-go errors (i.e., fewer responses on trials in which a response ought to have been inhibited); and (b) more timed-out Go trials (i.e., more trials on which the deadline elapsed before a decision to make a keystroke occurred). Healthy volunteers were treated with either 0.5 mg of pramipexole or a standard placebo (randomly determined). During the 2-h wait period, they completed demographic, cognitive, physiological and affective measures. The pramipexole group had significantly more Go timeouts (p < 0.05) compared to the placebo group though they did not differ in percent of No-go errors. In contrast to its effect on pursuit of pleasurable activities, pramipexole did not increase motor impulsivity. In fact, in line with findings in PD and addiction, dopaminergic therapy might increase motor impulse control. In these patient groups, by enhancing function of the dorsal striatum (DS) of the basal ganglia in contrast to its effect on impulsive pursuit of pleasurable activities. These findings have implications for use and effects of pramipexole in PD as well as in other conditions (e.g., restless leg, dystonia, depression, addiction-related problems).

Dopamine D2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans

Increased responding to drug-associated stimuli (cue reactivity) and an inability to tolerate delayed gratification (reward impulsivity) have been implicated in the development and maintenance of drug addiction. Whereas data from animal studies suggest that both the dopamine and opioid system are involved in these two reward-related processes, their role in humans is less clear. Moreover, dopaminergic and opioidergic drugs have not been directly compared with regard to these functions, even though a deeper understanding of the underlying mechanisms might inform the development of specific treatments for elevated cue reactivity and reward impulsivity. In a randomized, double-blind, between-subject design we administered the selective dopamine D2/D3 receptor antagonist amisulpride (400 mg, n=41), the unspecific opioid receptor antagonist naltrexone (50 mg, n=40) or placebo (n=40) to healthy humans and measured cue-induced responding with a Pavlovian-instrumental transfer task and reward impulsivity with a delay discounting task. Mood was assessed using a visual analogue scale. Compared with placebo, amisulpride significantly suppressed cue-induced responding and reward impulsivity. The effects of naltrexone were similar, although less pronounced. Both amisulpride and naltrexone decreased average mood ratings compared with placebo. Our results demonstrate that a selective blockade of dopamine D2/D3 receptors reduces cue-induced responding and reward impulsivity in healthy humans. Antagonizing μ-opioid receptors has similar effects for cue-induced responding and to a lesser extent for reward impulsivity.

Modulation of impulsivity and reward sensitivity in intertemporal choice by striatal and midbrain dopamine synthesis in healthy adults

Converging evidence links individual differences in mesolimbic and mesocortical dopamine (DA) to variation in the tendency to choose immediate rewards ("Now") over larger, delayed rewards ("Later"), or "Now bias." However, to date, no study of healthy young adults has evaluated the relationship between Now bias and DA with positron emission tomography (PET). Sixteen healthy adults (ages 24-34 yr; 50% women) completed a delay-discounting task that quantified aspects of intertemporal reward choice, including Now bias and reward magnitude sensitivity. Participants also underwent PET scanning with 6-[(18)F]fluoro-l-m-tyrosine (FMT), a radiotracer that measures DA synthesis capacity. Lower putamen FMT signal predicted elevated Now bias, a more rapidly declining discount rate with increasing delay time, and reduced willingness to accept low-interest-rate delayed rewards. In contrast, lower FMT signal in the midbrain predicted greater sensitivity to increasing magnitude of the Later reward. These data demonstrate that intertemporal reward choice in healthy humans varies with region-specific measures of DA processing, with regionally distinct associations with sensitivity to delay and to reward magnitude.

Dopamine Modulation of Intertemporal Decision-making: Evidence from Parkinson Disease

Choosing between smaller prompt rewards and larger later rewards is a common choice problem, and studies widely agree that frontostriatal circuits heavily innervated by dopamine are centrally involved. Understanding how dopamine modulates intertemporal choice has important implications for neurobiological models and for understanding the mechanisms underlying maladaptive decision-making. However, the specific role of dopamine in intertemporal decisions is not well understood. Dopamine may play a role in multiple aspects of intertemporal choices--the valuation of choice outcomes and sensitivity to reward delays. To assess the role of dopamine in intertemporal decisions, we tested Parkinson disease patients who suffer from dopamine depletion in the striatum, in either high (on medication, PDON) or low (off medication, PDOFF) dopaminergic states. Compared with both PDOFF and healthy controls, PDON made more farsighted choices and reduced their valuations less as a function of increasing time to reward. Furthermore, reduced discounting in the high dopaminergic state was robust across multiple measures, providing new evidence for dopamine's role in making decisions about the future.

Dopamine D3 Receptors Inhibit Hippocampal Gamma Oscillations by Disturbing CA3 Pyramidal Cell Firing Synchrony

Cortical gamma oscillations are associated with cognitive processes and are altered in several neuropsychiatric conditions such as schizophrenia and Alzheimer’s disease. Since dopamine D₃ receptors are possible targets in treatment of these conditions, it is of great importance to understand their role in modulation of gamma oscillations. The effect of D₃ receptors on gamma oscillations and the underlying cellular mechanisms were investigated by extracellular local field potential and simultaneous intracellular sharp micro-electrode recordings in the CA3 region of the hippocampus in vitro. D₃ receptors decreased the power and broadened the bandwidth of gamma oscillations induced by acetylcholine or kainate. Blockade of the D₃ receptors resulted in faster synchronization of the oscillations, suggesting that endogenous dopamine in the hippocampus slows down the dynamics of gamma oscillations by activation of D₃ receptors. Investigating the underlying cellular mechanisms for these effects showed that D₃ receptor activation decreased the rate of action potentials (APs) during gamma oscillations and reduced the precision of the AP phase coupling to the gamma cycle in CA3 pyramidal cells. The results may offer an explanation how selective activation of D₃ receptors may impair cognition and how, in converse, D₃ antagonists may exert pro-cognitive and antipsychotic effects.

Imaging the D3 dopamine receptor across behavioral and drug addictions: Positron emission tomography studies with [(11)C]-(+)-PHNO

Chronic drug use has been associated with dopaminergic abnormalities, detectable in humans with positron emission tomography (PET). Among these, a hallmark feature is low D2 dopamine receptor availability, which has been linked to clinical outcomes, but has not yet translated into a therapeutic strategy. The D3 dopamine receptor on the other hand has gained increasing attention, as, in contrast to D2, chronic exposure to drugs has been shown to up-regulate this receptor subtype in preclinical models of addiction-a phenomenon linked to dopamine system sensitization and drug-seeking. The present article summarizes the literature to date in humans, suggesting that the D3 receptor may indeed contribute to core features of addiction such as impulsiveness and cognitive impairment. A particularly useful tool in investigating this question is the PET imaging probe [(11)C]-(+)-PHNO, which binds to D2/3 dopamine receptors but has preferential affinity for D3. This technique has been used to demonstrate D3 up-regulation in humans, and can be applied to assess pharmacological interventions for development of D3-targeted strategies in addiction treatment.

Insulin, Central Dopamine D2 Receptors, and Monetary Reward Discounting in Obesity

Animal research finds that insulin regulates dopamine signaling and reward behavior, but similar research in humans is lacking. We investigated whether individual differences in body mass index, percent body fat, pancreatic β-cell function, and dopamine D2 receptor binding were related to reward discounting in obese and non-obese adult men and women. Obese (n = 27; body mass index>30) and non-obese (n = 20; body mass index<30) adults were assessed for percent body fat with dual-energy X-ray absorptiometry and for β-cell function using disposition index. Choice of larger, but delayed or less certain, monetary rewards relative to immediate, certain smaller monetary rewards was measured using delayed and probabilistic reward discounting tasks. Positron emission tomography using a non-displaceable D2-specific radioligand, [¹¹C](N-methyl)benperidol quantified striatal D2 receptor binding. Groups differed in body mass index, percent body fat, and disposition index, but not in striatal D2 receptor specific binding or reward discounting. Higher percent body fat in non-obese women related to preference for a smaller, certain reward over a larger, less likely one (greater probabilistic discounting). Lower β-cell function in the total sample and lower insulin sensitivity in obese related to stronger preference for an immediate and smaller monetary reward over delayed receipt of a larger one (greater delay discounting). In obese adults, higher striatal D2 receptor binding related to greater delay discounting. Interestingly, striatal D2 receptor binding was not significantly related to body mass index, percent body fat, or β-cell function in either group. Our findings indicate that individual differences in percent body fat, β-cell function, and striatal D2 receptor binding may each contribute to altered reward discounting behavior in non-obese and obese individuals. These results raise interesting questions about whether and how striatal D2 receptor binding and metabolic factors, including β-cell function, interact to affect reward discounting in humans.

Identifying the Basal Ganglia network model markers for medication-induced impulsivity in Parkinson's disease patients

Impulsivity, i.e. irresistibility in the execution of actions, may be prominent in Parkinson's disease (PD) patients who are treated with dopamine precursors or dopamine receptor agonists. In this study, we combine clinical investigations with computational modeling to explore whether impulsivity in PD patients on medication may arise as a result of abnormalities in risk, reward and punishment learning. In order to empirically assess learning outcomes involving risk, reward and punishment, four subject groups were examined: healthy controls, ON medication PD patients with impulse control disorder (PD-ON ICD) or without ICD (PD-ON non-ICD), and OFF medication PD patients (PD-OFF). A neural network model of the Basal Ganglia (BG) that has the capacity to predict the dysfunction of both the dopaminergic (DA) and the serotonergic (5HT) neuromodulator systems was developed and used to facilitate the interpretation of experimental results. In the model, the BG action selection dynamics were mimicked using a utility function based decision making framework, with DA controlling reward prediction and 5HT controlling punishment and risk predictions. The striatal model included three pools of Medium Spiny Neurons (MSNs), with D1 receptor (R) alone, D2R alone and co-expressing D1R-D2R. Empirical studies showed that reward optimality was increased in PD-ON ICD patients while punishment optimality was increased in PD-OFF patients. Empirical studies also revealed that PD-ON ICD subjects had lower reaction times (RT) compared to that of the PD-ON non-ICD patients. Computational modeling suggested that PD-OFF patients have higher punishment sensitivity, while healthy controls showed comparatively higher risk sensitivity. A significant decrease in sensitivity to punishment and risk was crucial for explaining behavioral changes observed in PD-ON ICD patients. Our results highlight the power of computational modelling for identifying neuronal circuitry implicated in learning, and its impairment in PD. The results presented here not only show that computational modelling can be used as a valuable tool for understanding and interpreting clinical data, but they also show that computational modeling has the potential to become an invaluable tool to predict the onset of behavioral changes during disease progression.

Effects of the combination of wheel running and atomoxetine on cue- and cocaine-primed reinstatement in rats selected for high or low impulsivity

BACKGROUND

Aerobic exercise and the attention-deficit/hyperactivity disorder medication, atomoxetine (ATO), are two monotherapies that have been shown to suppress reinstatement of cocaine-seeking in an animal model of relapse. The present study investigated the effects of combining wheel running and ATO versus each treatment alone on cocaine-seeking precipitated by cocaine and cocaine-paired cues in rats with differing susceptibility to drug abuse (i.e., high vs. low impulsive).

METHODS

Rats were screened for high (HiI) or low impulsivity (LoI) based on their performance on a delay-discounting task and then trained to self-administer cocaine (0.4 mg/kg/inf) for 10 days. Following 14 days of extinction, both groups were tested for reinstatement of cocaine-seeking precipitated by cocaine or cocaine-paired cues in the presence of concurrent running wheel access (W), pretreatment with ATO, or both (W+ATO).

RESULTS

HiI rats acquired cocaine self-administration more quickly than LoI rats. While both individual treatments and W+ATO significantly attenuated cue-induced cocaine seeking in HiI and LoI rats, only W+ATO was effective in reducing cocaine-induced reinstatement compared with vehicle treatment. There were dose-dependent and phenotype-specific effects of ATO with HiI rats responsive to the low but not high ATO dose. Floor effects of ATO and W on cue-induced reinstatement prevented the assessment of combined treatment effects.

CONCLUSIONS

These findings demonstrated greater attenuation of cue- versus cocaine-induced reinstatement by ATO and W alone and recapitulate impulsivity phenotype differences in both acquisition of cocaine self-administration and receptivity to treatment.

Impulsive actions and choices in laboratory animals and humans: effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

Increases and decreases in dopamine (DA) transmission have both been suggested to influence reward-related impulse-control. The present literature review suggests that, in laboratory animals, the systemic administration of DA augmenters preferentially increases susceptibility to premature responding; with continued DA transmission, reward approach behaviors are sustained. Decreases in DA transmission, in comparison, diminish the appeal of distal and difficult to obtain rewards, thereby increasing susceptibility to temporal discounting and other forms of impulsive choice. The evidence available in humans is not incompatible with this model but is less extensive.

Ovarian cycle effects on immediate reward selection bias in humans: a role for estradiol

A variety of evidence suggests that, among humans, the individual tendency to choose immediate rewards ("Now") over larger, delayed rewards ("Later"), or Now bias, varies with frontal dopamine (DA) levels. As cyclic elevations in estradiol (E+) modulate other frontal DA-dependent behaviors, we tested ovarian cycle effects on Now bias, and whether any such effects are E+ mediated. To do so, we quantified Now/Later choice behavior in naturally cycling adult females (n = 87; ages 18-40 years) during both the menstrual phase (MP; cycle day 1-2; low E+), and the follicular phase (FP; cycle day 11-12; high E+). Now bias decreased an average of 3.6% from MP to FP (p = 0.006). Measures of salivary E+ levels at each visit were available in a subsample of participants (n = 34). Participants with a verified E+ rise from MP to FP showed significantly greater decreases in Now bias at mid-cycle (n = 23) than those without a rise (n = 11; p = 0.03); Now bias decreased an average of 10.2% in the E+ rise group but increased an average of 7.9% in the no E+ rise group. The change in Now bias from MP to FP inversely correlated with the change in E+ (ρ = -0.39; p = 0.023), an effect driven by individuals with putatively lower frontal DA based on genotype at the Val(158)Met polymorphism in the COMT gene. This is the first demonstration that intertemporal choice varies across the ovarian cycle, with Now bias declining at mid-cycle, when fertility peaks. Moreover, our data suggest that the interacting effects of estradiol and frontal DA mediate this cycle effect on decision making.

The effects of methylphenidate on cerebral activations to salient stimuli in healthy adults

Detection of a salient stimulus is critical to cognitive functioning. A stimulus is salient when it appears infrequently, carries high motivational value, and/or when it dictates changes in behavior. Individuals with neurological conditions that implicate altered catecholaminergic signaling, such as those with attention deficit hyperactivity disorder, are impaired in detecting salient stimuli, a deficit that can be remediated by catecholaminergic medications. However, the effects of these catecholaminergic agents on cerebral activities during saliency processing within the context of the stop-signal task are not clear. Here, we examined the effects of a single oral dose (45 mg) of methylphenidate in 24 healthy adults performing the stop-signal task during functional MRI (fMRI). Compared to 92 demographically matched adults who did not receive any medications, the methylphenidate group showed higher activations in bilateral caudate head, primary motor cortex, and the right inferior parietal cortex during stop as compared to go trials (p < .05, corrected for family-wise error of multiple comparisons). These results show that methylphenidate enhances saliency processing by promoting specific cerebral regional activities. These findings may suggest a neural basis for catecholaminergic treatment of attention disorders.

Dissecting impulsivity and its relationships to drug addictions

Addictions are often characterized as forms of impulsive behavior. That said, it is often noted that impulsivity is a multidimensional construct, spanning several psychological domains. This review describes the relationship between varieties of impulsivity and addiction-related behaviors, the nature of the causal relationship between the two, and the underlying neurobiological mechanisms that promote impulsive behaviors. We conclude that the available data strongly support the notion that impulsivity is both a risk factor for, and a consequence of, drug and alcohol consumption. While the evidence indicating that subtypes of impulsive behavior are uniquely informative--either biologically or with respect to their relationships to addictions--is convincing, multiple lines of study link distinct subtypes of impulsivity to low dopamine D2 receptor function and perturbed serotonergic transmission, revealing shared mechanisms between the subtypes. Therefore, a common biological framework involving monoaminergic transmitters in key frontostriatal circuits may link multiple forms of impulsivity to drug self-administration and addiction-related behaviors. Further dissection of these relationships is needed before the next phase of genetic and genomic discovery will be able to reveal the biological sources of the vulnerability for addiction indexed by impulsivity.

Dopamine, urges to smoke, and the relative salience of drug versus non-drug reward

When addicted individuals are exposed to drug-related stimuli, dopamine release is thought to mediate incentive salience attribution, increasing attentional bias, craving and drug seeking. It is unclear whether dopamine acts specifically on drug cues versus other rewards, and if these effects correspond with craving and other forms of cognitive bias. Here, we administered the dopamine D2/D3 agonist pramipexole (0.5 mg) to 16 tobacco smokers in a double-blind placebo-controlled crossover design. Visual fixations on smoking and money images were recorded alongside smoking urges and fluency tasks. Pramipexole attenuated a marked bias in initial orienting towards smoking relative to money but did not alter a maintained attentional bias towards smoking. Pramipexole decreased urges to smoke retrospectively after the task but not on a state scale. Fewer smoking words were generated after pramipexole but phonological and semantic fluency were preserved. Although these treatment effects did not correlate with each other, changes in initial orienting towards smoking and money were inversely related to baseline scores. In conclusion, pramipexole can reduce the salience of an addictive drug compared with other rewards and elicit corresponding changes in smoking urges and cognitive bias. These reward-specific and baseline-dependent effects support an 'inverted-U' shaped profile of dopamine in addiction.

Effects of acute dopamine precusor depletion on immediate reward selection bias and working memory depend on catechol-O-methyltransferase genotype

Little agreement exists as to acute dopamine (DA) manipulation effects on intertemporal choice in humans. We previously found that catechol-O-methyltransferase (COMT) Val158Met genotype predicts individual differences in immediate reward selection bias among adults. Moreover, we and others have shown that the relationship between COMT genotype and immediate reward bias is inverted in adolescents. No previous pharmacology studies testing DA manipulation effects on intertemporal choice have accounted for COMT genotype, and many have included participants in the adolescent age range (18-21 years) as adults. Moreover, many studies have included female participants without strict cycle phase control, although recent evidence demonstrates that cyclic estradiol elevations interact with COMT genotype to affect DA-dependent cognition. These factors may have interacted with DA manipulations in past studies, potentially occluding detection of effects. Therefore, we predicted that, among healthy male adults (ages 22-40 years), frontal DA tone, as indexed by COMT genotype, would interact with acute changes in DA signaling to affect intertemporal choice. In a double-blind, placebo-controlled design, we decreased central DA via administration of an amino acid beverage deficient in the DA precursors, phenylalanine and tyrosine, and tested effects on immediate reward bias in a delay-discounting (DD) task and working memory (WM) in an n-back task. We found no main effect of beverage on DD or WM performance but did find significant beverage*genotype effects. These results suggest that the effect of DA manipulations on DD depends on individual differences in frontal DA tone, which may have impeded some past efforts to characterize DA's role in immediate reward bias in humans.

Dopamine modulates risk-taking as a function of baseline sensation-seeking trait

Trait sensation-seeking, defined as a need for varied, complex, and intense sensations, represents a relatively underexplored hedonic drive in human behavioral neuroscience research. It is related to increased risk for a range of behaviors including substance use, gambling, and risky sexual practice. Individual differences in self-reported sensation-seeking have been linked to brain dopamine function, particularly at D2-like receptors, but so far no causal evidence exists for a role of dopamine in sensation-seeking behavior in humans. Here, we investigated the effects of the selective D2/D3 agonist cabergoline on performance of a probabilistic risky choice task in healthy humans using a sensitive within-subject, placebo-controlled design. Cabergoline significantly influenced the way participants combined different explicit signals regarding probability and loss when choosing between response options associated with uncertain outcomes. Importantly, these effects were strongly dependent on baseline sensation-seeking score. Overall, cabergoline increased sensitivity of choice to information about probability of winning; while decreasing discrimination according to magnitude of potential losses associated with different options. The largest effects of the drug were observed in participants with lower sensation-seeking scores. These findings provide evidence that risk-taking behavior in humans can be directly manipulated by a dopaminergic drug, but that the effectiveness of such a manipulation depends on baseline differences in sensation-seeking trait. This emphasizes the importance of considering individual differences when investigating manipulation of risky decision-making, and may have relevance for the development of pharmacotherapies for disorders involving excessive risk-taking in humans, such as pathological gambling.

Effects of acute dopamine precusor depletion on immediate reward selection bias and working memory depend on catechol-O-methyltransferase genotype

Little agreement exists as to acute dopamine (DA) manipulation effects on intertemporal choice in humans. We previously found that catechol-O-methyltransferase (COMT) Val158Met genotype predicts individual differences in immediate reward selection bias among adults. Moreover, we and others have shown that the relationship between COMT genotype and immediate reward bias is inverted in adolescents. No previous pharmacology studies testing DA manipulation effects on intertemporal choice have accounted for COMT genotype, and many have included participants in the adolescent age range (18-21 years) as adults. Moreover, many studies have included female participants without strict cycle phase control, although recent evidence demonstrates that cyclic estradiol elevations interact with COMT genotype to affect DA-dependent cognition. These factors may have interacted with DA manipulations in past studies, potentially occluding detection of effects. Therefore, we predicted that, among healthy male adults (ages 22-40 years), frontal DA tone, as indexed by COMT genotype, would interact with acute changes in DA signaling to affect intertemporal choice. In a double-blind, placebo-controlled design, we decreased central DA via administration of an amino acid beverage deficient in the DA precursors, phenylalanine and tyrosine, and tested effects on immediate reward bias in a delay-discounting (DD) task and working memory (WM) in an n-back task. We found no main effect of beverage on DD or WM performance but did find significant beverage*genotype effects. These results suggest that the effect of DA manipulations on DD depends on individual differences in frontal DA tone, which may have impeded some past efforts to characterize DA's role in immediate reward bias in humans.

The potential role of dopamine D₃ receptor neurotransmission in cognition

Currently available treatments have limited pro-cognitive effects for neuropsychiatric disorders, such as schizophrenia, Parkinson's disease and Alzheimer's disease. The primary objective of this work is to review the literature on the role of dopamine D₃ receptors in cognition, and propose dopamine D₃ receptor antagonists as possible cognitive enhancers for neuropsychiatric disorders. A literature search was performed to identify animal and human studies on D₃ receptors and cognition using PubMed, MEDLINE and EMBASE. The search terms included "dopamine D₃ receptor" and "cognition". The literature search identified 164 articles. The results revealed: (1) D₃ receptors are associated with cognitive functioning in both healthy individuals and those with neuropsychiatric disorders; (2) D₃ receptor blockade appears to enhance while D₃ receptor agonism seems to impair cognitive function, including memory, attention, learning, processing speed, social recognition and executive function independent of age; and (3) D₃ receptor antagonists may exert their pro-cognitive effect by enhancing the release of acetylcholine in the prefrontal cortex, disinhibiting the activity of dopamine neurons projecting to the nucleus accumbens or prefrontal cortex, or activating CREB signaling in the hippocampus. These findings suggest that D₃ receptor blockade may enhance cognitive performance in healthy individuals and treat cognitive dysfunction in individuals with a neuropsychiatric disorder. Clinical trials are needed to confirm these effects.

Dopaminergic involvement in effort-based but not impulsive reward processing in smokers

BACKGROUND

A reduction in reward responsivity and an increase in temporal discounting of rewards are both evident in smokers during acute abstinence compared to satiation. However, it is not yet known whether these processes can be modulated pharmacologically in smokers, other than with nicotine or tobacco.

METHODS

A double-blind placebo controlled crossover design assessed the effects of 0.5 mg pramipexole, a dopamine D₂/D₃ agonist, in smokers following 2 h of abstinence. Reward responsivity was measured using an effort-based card sorting task. Temporal discounting of monetary reward was assessed using Area Under the Curve (AUC) analysis, and affective and subjective effects were indexed.

RESULTS

On placebo, smokers showed an equivalent speed of card sorting when a financial incentive was provided compared to when it was not. Conversely, more cards were sorted under rewarded compared to non-rewarded trials after pramipexole, indicating an improvement in reward responsivity. Temporal discounting of monetary reward was not affected by pramipexole. Drug treatment also decreased positive affect and increased drowsiness.

CONCLUSIONS

A single dose of pramipexole can enhance effort-based reward responsivity, but does not alter temporal discounting in smokers. These findings highlight pharmacological correlates of reward processing deficits in nicotine dependence and offer potential targets for their treatment.

Pramipexole-induced disruption of behavioral processes fundamental to intertemporal choice

Evaluating the effects of presession drug administration on intertemporal choice in nonhumans is a useful approach for identifying compounds that promote impulsive behavior in clinical populations, such as those prescribed the dopamine agonist pramipexole (PPX). Based on the results of previous studies, it is unclear whether PPX increases rats' impulsive choice or attenuates aspects of stimulus control. The present study was designed to experimentally isolate behavioral processes fundamental to intertemporal choice and challenge them pharmacologically with PPX administration. In Experiment 1, the hypothesis that PPX increases impulsive choice as a result of enhanced sensitivity to reinforcer delays was tested and disconfirmed. That is, acute PPX diminished delay sensitivity in a manner consistent with disruption of stimulus control whereas repeated PPX had no effect on delay sensitivity. Experiments 2 and 3 elaborated upon this finding by examining the effects of repeated PPX on rats' discrimination of response-reinforcer contingencies and reinforcer amounts, respectively. Accuracy of both discriminations was reduced by PPX. Collectively these results provide no support for past studies that have suggested PPX increases impulsive choice. Instead, PPX impairs stimulus control over choice behavior. The behavioral approach adopted herein could be profitably integrated with genetic and other biobehavioral models to advance our understanding of impulsive behavior associated with drug administration.

Rate dependent effects of acute nicotine on risk taking in young adults are not related to ADHD diagnosis

Beneficial effects of nicotine on cognition and behavioral control are hypothesized to relate to the high rates of cigarette smoking in Attention-Deficit/Hyperactivity Disorder (ADHD). Given that ADHD is associated with both impulsivity and elevated risk taking, we hypothesized that nicotine modulates risk taking, as it does impulsivity. 26 non-smoking young adults (15 controls with normal impulsivity and 11 ADHD with high impulsivity) received 7 mg transdermal nicotine, 20mg oral mecamylamine, and placebo on separate days, followed by the Balloon Analog Risk Task (BART). Statistical analyses found no group differences in baseline risk taking. Reexamination of the data using a median split on baseline risk taking, to create high (HRT) and low (LRT) risk taking groups, revealed significant effects of nicotinic drugs that differed by group. Nicotine reduced risk taking in HRT and mecamylamine increased risk taking in LRT. This finding supports the hypothesis that nicotinic receptor function modulates risk taking broadly, beyond those with ADHD, and is consistent with rate dependent cholinergic modulation of other cognitive functions. Further, the results demonstrate that high impulsivity is separable from high risk taking in young adults with ADHD, supporting the utility of these differential behavioral phenotypes for neurobiological studies.

Dissecting the effects of disease and treatment on impulsivity in Parkinson's disease

Converging evidence, including observations in patients with Parkinson's disease (PD), suggests that dopamine plays a role in impulsivity. This multi-faceted construct includes considerations of both time and risk; determining how these more specific processes are affected by PD and dopaminergic treatment can inform neurobiological models. We examined the effects of PD and its treatment on temporal discounting and risky decision-making in a cohort of 23 mild-moderate PD patients and 20 healthy participants. Patients completed the Balloon Analogue Risk Task and a temporal discounting paradigm both on and off their usual dopamine replacement therapy. PD patients did not differ from controls in their initial risk-taking on the Balloon Analogue Risk Task, but took progressively more risks across trials when on medication. A subset of patients and controls was tested again, 1.5-3 years later, to explore the effects of disease progression. On follow-up, baseline risk-taking diminished in patients, but the tendency to take increasing risks across trials persisted. Neither disease progression nor its treatment affected the temporal discounting rate. These findings suggest a different neural basis for temporal discounting and risk-taking, and demonstrate that risk-taking can be further decomposed into initial and trial-by-trial effects, with dopamine affecting only the latter.

Pramipexole-induced increased probabilistic discounting: comparison between a rodent model of Parkinson's disease and controls

The dopamine agonist pramipexole (PPX) can increase impulsiveness, and PPX therapy for neurological diseases (Parkinson's disease (PD) and restless leg syndrome) is associated with impulse control disorders (ICDs) in subpopulations of treated patients. A commonly reported ICD is pathological gambling of which risk taking is a prominent feature. Probability discounting is a measurable aspect of risk taking. We recently developed a probability discounting paradigm wherein intracranial self-stimulation (ICSS) serves as the positive reinforcer. Here we used this paradigm to determine the effects of PPX on discounting. We included assessments of a rodent model of PD, wherein 6-OHDA was injected into the dorsolateral striatum of both hemispheres, which produced persistent PD-like deficits in posture adjustment. Rats were trained to perform ICSS-mediated probability discounting, in which PD-like and control groups exhibited similar profiles. Rats were treated twice daily for 2 weeks with 2 mg/kg (±)PPX (ie, 1 mg/kg of the active form), a dose that improved lesion-induced motor deficits. In both groups, (±)PPX increased discounting; preference for the large reinforcer was enhanced 30-45% at the most uncertain probabilities. Tolerance did not develop with repeated treatments. Increased discounting subsided within 2 weeks of (±)PPX cessation, and re-exposure to (±)PPX reinstated heightened discounting. Such findings emulate the clinical scenario; therefore, ICSS for discounting assessments in rats exhibited high face validity. This model should prove useful in medication development where assessment of the propensity of a putative therapy to induce risk-taking behaviors is of interest.

Dopamine, serotonin and impulsivity

Impulsive people have a strong urge to act without thinking. It is sometimes regarded as a positive trait but rash impulsiveness is also widely present in clinical disorders such as attention deficit hyperactivity disorder (ADHD), drug dependence, mania, and antisocial behaviour. Contemporary research has begun to make major inroads into unravelling the brain mechanisms underlying impulsive behaviour with a prominent focus on the limbic cortico-striatal systems. With this progress has come the understanding that impulsivity is a multi-faceted behavioural trait involving neurally and psychologically diverse elements. We discuss the significance of this heterogeneity for clinical disorders expressing impulsive behaviour and the pivotal contribution made by the brain dopamine and serotonin systems in the aetiology and treatment of behavioural syndromes expressing impulsive symptoms.

The utility of rat models of impulsivity in developing pharmacotherapies for impulse control disorders

High levels of impulsive behaviours are a clinically significant symptom in a range of psychiatric disorders, such as attention deficit hyperactivity disorder, bipolar disorder, personality disorders, pathological gambling and substance abuse. Although often measured using questionnaire assessments, levels of different types of impulsivity can also be determined using behavioural tests. Rodent analogues of these paradigms have been developed, and similar neural circuitry has been implicated in their performance in both humans and rats. In the current review, the methodology underlying the measurement of different aspects of impulsive action and choice are considered from the viewpoint of drug development, with a focus on the continuous performance task (CPT), stop-signal task (SST), go/no-go and delay-discounting paradigms. Current issues impeding translation between animal and human studies are identified, and comparisons drawn between the acute effects of dopaminergic, noradrenergic and serotonergic compounds across species. Although the field could benefit from a more systematic determination of different pharmacological agents across paradigms, there are signs of strong concordance between the animal and human data. However, the type of impulsivity measured appears to play a significant role, with the SST and delay discounting providing more consistent effects for dopaminergic drugs, while the CPT and SST show better predictive validity so far for serotonergic and noradrenergic compounds. Based on the available data, it would appear that these impulsivity models could be used more widely to identify potential pharmacotherapies for impulse control disorders. Novel targets within the glutamatergic and serotonergic system are also suggested.

The dopamine augmenter L-DOPA does not affect positive mood in healthy human volunteers

Dopamine neurotransmission influences approach toward rewards and reward-related cues. The best cited interpretation of this effect proposes that dopamine mediates the pleasure that commonly accompanies reward. This hypothesis has received support in some animal models and a few studies in humans. However, direct assessments of the effect of transiently increasing dopamine neurotransmission have been largely limited to the use of psychostimulant drugs, which elevate brain levels of multiple neurotransmitters in addition to dopamine. In the present study we tested the effect of more selectively elevating dopamine neurotransmission, as produced by administration of the immediate dopamine precursor, L-DOPA (0, 100/25, 200/50 mg, Sinemet), in healthy human volunteers. Neither dose altered positive mood. The results suggest that dopamine neurotransmission does not directly influence positive mood in humans.

Similarities and differences between pathological gambling and substance use disorders: a focus on impulsivity and compulsivity

RATIONALE

Pathological gambling (PG) has recently been considered as a "behavioral" or nonsubstance addiction. A comparison of the characteristics of PG and substance use disorders (SUDs) has clinical ramifications and could help advance future research on these conditions. Specific relationships with impulsivity and compulsivity may be central to understanding PG and SUDs.

OBJECTIVES

This review was conducted to compare and contrast research findings in PG and SUDs pertaining to neurocognitive tasks, brain function, and neurochemistry, with a focus on impulsivity and compulsivity.

RESULTS

Multiple similarities were found between PG and SUDs, including poor performance on neurocognitive tasks, specifically with respect to impulsive choice and response tendencies and compulsive features (e.g., response perseveration and action with diminished relationship to goals or reward). Findings suggest dysfunction involving similar brain regions, including the ventromedial prefrontal cortex and striatum and similar neurotransmitter systems, including dopaminergic and serotonergic. Unique features exist which may in part reflect influences of acute or chronic exposures to specific substances.

CONCLUSIONS

Both similarities and differences exist between PG and SUDs. Understanding these similarities more precisely may facilitate treatment development across addictions, whereas understanding differences may provide insight into treatment development for specific disorders. Individual differences in features of impulsivity and compulsivity may represent important endophenotypic targets for prevention and treatment strategies.

Effects of pramipexole on the reinforcing effectiveness of stimuli that were previously paired with cocaine reinforcement in rats

RATIONALE

Dopamine D(2)-like agonists maintain responding when substituted for cocaine in laboratory animals. However, these effects appear to be mediated by an interaction with stimuli that were previously paired with cocaine reinforcement (CS).

OBJECTIVES

To evaluate the extent to which the pramipexole-maintained and pramipexole-induced responding are influenced by cocaine-paired stimuli.

METHODS

Rats were trained to nosepoke for cocaine under fixed ratio 1 (FR1) or progressive ratio (PR) schedules of reinforcement. In FR1-trained rats, pramipexole was substituted for cocaine with injections either paired with CSs, or delivered in their absence. The capacity of experimenter-administered pramipexole to induce FR1 and PR responding for CS presentation was evaluated. The effects of altering stimulus conditions, as well as pretreatments with D(2)- (L: -741,626) and D(3)-preferring (PG01037) antagonists on pramipexole-induced PR responding were also evaluated.

RESULTS

When substituted for cocaine, pramipexole maintained responding at high rates when injections were paired with CSs, but low rates when CSs were omitted. Similarly, experimenter-administered pramipexole induced dose-dependent increases in FR1 or PR responding, with high rates of responding observed when the CS was presented, and low rates of responding when CS presentation was omitted. D(2) and D(3) antagonists differentially affected pramipexole-induced PR responding, with L: -741,626 and PG01037 producing rightward, and downward shifts in the dose-response curve for CS-maintained responding, respectively.

CONCLUSIONS

These data indicate that pramipexole is capable of enhancing the reinforcing effectiveness of conditioned stimuli, and raise the possibility that similar mechanisms are responsible for the increased occurrence of impulse control disorders in patients being treated with pramipexole.

Effects of selective dopaminergic compounds on a delay-discounting task

Impulsivity is widely regarded as a multidimensional trait that encompasses two or more distinct patterns of behavior, and dopaminergic systems are implicated in the expression of impulsive behavior in both humans and animal subjects. Impulsive choice, or the tendency to choose rewards associated with relatively little or no delay, has been extensively studied in humans and animal subjects using delay-discounting tasks. Here, delay-discounting procedures were used to assess the effects of receptor-selective dopaminergic agonists, antagonists, and dopamine transporter ligands on choices of immediate versus delayed sucrose pellets. The effects of d-amphetamine, GBR 12909, apomorphine, SKF 81297, sumanirole, pramipexole, ABT-724, SCH 23390, L-741,626, PG01037, and L-745,870 were assessed in 24 Sprague-Dawley rats. The only drugs to affect impulsive choice selectively without altering undelayed choice were the D1-like antagonist, SCH 23390 (0.01 mg/kg), and the D4 partial agonist, ABT-724 (3.2 mg/kg), which both increased impulsive choice. The shared effects of these compounds may be explained by their localization within the prefrontal cortex on different groups of neurons. None of the selective agonists and antagonists tested reduced impulsive choice, so further research is needed to determine if direct dopaminergic agonists or antagonists may be therapeutically useful in the treatment of impulse-control disorders.

Imaging cognitive and behavioral symptoms in Parkinson's disease

Non-motor symptoms are a major and often unrecognized cause of morbidity of Parkinson's disease. In the past few years, imaging technology, such as functional MRI and PET, have provided a large bulk of information about the phenomena. Here, we provide an overview of those imaging studies that may help us understand the neuronal correlates associated with non-motor symptoms in Parkinson's disease, with a particular focus on cognitive and neuropsychiatric deficits.

Impulse control disorders in Parkinson's disease: clinical characteristics and implications

Impulse control disorders (ICDs), specifically those related to excessive gambling, eating, sex and shopping, have been observed in a subset of people with Parkinson's disease (PD). Although some initial case reports claimed that dopamine replacement therapies, particularly dopamine agonists, cause ICDs, more recent, larger and better controlled studies indicate a more complicated picture. While dopamine replacement therapy use is related to ICDs, other vulnerabilities, some related to PD and/or its treatment directly and others seemingly unrelated to PD, have also been associated with ICDs in PD. This suggests a complex etiology with multiple contributing factors. As ICDs occur in a sizable minority of PD patients and can be associated with significant distress and impairment, further investigation is needed to identify factors that can predict who may be more likely to develop ICDs. Clinical implications are discussed and topics for future research are offered.