Evaluation of the effort-related motivational effects of the novel dopamine uptake inhibitor PRX-14040

Lipopolysaccharide-induced changes in effort-related motivational function: Interactions with 2-deoxyglucose

Inflammation is linked to motivational deficits seen in depression and other disorders. Lipopolysaccharide (LPS) induces an inflammatory response and impairs motivated behavior in humans and rodents. It has been suggested that inflammation can shift metabolic needs to functions that warrant more response to the perceived threat (e.g., fighting infection), therefore altering aspects of motivation. Animal models have been developed to assess alterations in motivated behavior by giving the animal the option to work (i.e., lever press) for a highly palatable food reward vs. approaching and consuming a freely available, albeit less preferred, food. This model was used to determine if administration of 2-deoxy-D-glucose (2DG), a substance that inhibits glucose uptake and glycolysis, could reverse the motivational deficits induced by LPS in rats. A food preference/intake task was also conducted to see if LPS affected intake of the highly palatable vs. less palatable foods when both are freely available. It was hypothesized that 2-DG would reverse the motivational deficits caused by LPS and there would be no effect on food preference/intake of the highly palatable food. Results showed that 2-DG significantly reversed LPS effects at the lowest dose, while methylphenidate did not. The food intake/preference tests showed that LPS significantly decreased food intake of both foods but did not alter preference for the highly palatable food compared to vehicle. These results suggest that in addition to having effects on exertion of effort during instrumental behavior, LPS also has direct effects on primary food motivation.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Effects of the dopamine depleting agent tetrabenazine on detailed temporal parameters of effort-related choice responding

The dopamine-depleting agent tetrabenazine alters effort-based choice, suppressing food-reinforced behaviors with high response requirements, while increasing selection of low-cost options. In the present experiments, rats were tested on a concurrent fixed ratio 5/chow feeding choice task, in which high-carbohydrate Bio-serv pellets reinforced lever pressing and lab chow was concurrently available. Detailed timing of lever pressing was monitored with an event recording system, and the temporal characteristics of operant behavior seen after 1.0 mg/kg tetrabenazine or vehicle injections were analyzed. Tetrabenazine shifted choice, decreasing lever pressing but increasing chow intake. There was a small effect on the interresponse-time distribution within ratios, but marked increases in the total duration of pauses in responding. The postreinforcement-pause (PRP) distribution was bimodal, but tetrabenazine did not increase the duration of PRPs. Tetrabenazine increased time feeding and duration and number of feeding bouts, but did not affect feeding rate or total time spent lever pressing for pellets and consuming chow. Thus, TBZ appears to predominantly affect the relative allocation of lever pressing versus chow, with little alteration in consummatory motor acts involved in chow intake. Tetrabenazine is used to model motivational symptoms in psychopathology, and these effects in rats could have implications for psychiatric research.

Increased elasticity of sucrose demand during hyperdopaminergic states in rats

RATIONALE

Deficits in cost-benefit decision-making are a core feature of several psychiatric disorders, including substance addiction, eating disorders and bipolar disorder. Mesocorticolimbic dopamine signalling has been implicated in various processes related to cognition and reward, but its precise role in reward valuation and cost-benefit trade-off decisions remains incompletely understood.

OBJECTIVES

We assessed the role of mesocorticolimbic dopamine signalling in the relationship between price and consumption of sucrose, to better understand its role in cost-benefit decisions.

METHODS

Dopamine neurons in the ventral tegmental area (VTA) were chemogenetically activated in rats, and a behavioural economics approach was used to quantify the relationship between price and consumption of sucrose. Motivation for sucrose was also assessed under a progressive ratio (PR) schedule of reinforcement. To further gauge the role of dopamine in cost-benefit trade-offs for sucrose, the effects of treatment with D-amphetamine and the dopamine receptor antagonist alpha-flupentixol were assessed.

RESULTS

Chemogenetic activation of VTA dopamine neurons increased demand elasticity, while responding for sucrose under a PR schedule of reinforcement was augmented upon stimulation of VTA dopamine neurons. Treatment with amphetamine partially replicated the effects of chemogenetic dopamine neuron activation, whereas treatment with alpha-flupentixol reduced free consumption of sucrose and had mixed effects on demand elasticity.

CONCLUSIONS

Stimulation of mesocorticolimbic dopaminergic neurotransmission altered cost-benefit trade-offs in a complex manner. It reduced the essential value of palatable food, increased incentive motivation and left free consumption unaltered. Together, these findings imply that mesocorticolimbic dopamine signalling differentially influences distinct components of cost expenditure processes aimed at obtaining rewards.

Impact of Fluoxetine on Behavioral Invigoration of Appetitive and Aversively Motivated Responses: Interaction With Dopamine Depletion

Impaired behavioral activation and effort-related motivational dysfunctions like fatigue and anergia are debilitating treatment-resistant symptoms of depression. Depressed people show a bias towards the selection of low effort activities. To determine if the broadly used antidepressant fluoxetine can improve behavioral activation and reverse dopamine (DA) depletion-induced anergia, male CD1 mice were evaluated for vigorous escape behaviors in an aversive context (forced swim test, FST), and also with an exercise preference choice task [running wheel (RW)-T-maze choice task]. In the FST, fluoxetine increased active behaviors (swimming, climbing) while reducing passive ones (immobility). However, fluoxetine was not effective at reducing anergia induced by the DA-depleting agent tetrabenazine, further decreasing vigorous climbing and increasing immobility. In the T-maze, fluoxetine alone produced the same pattern of effects as tetrabenazine. Moreover, fluoxetine did not reverse tetrabenazine-induced suppression of RW time but it reduced sucrose intake duration. This pattern of effects produced by fluoxetine in DA-depleted mice was dissimilar from devaluing food reinforcement by pre-feeding or making the food bitter since in both cases sucrose intake time was reduced but animals compensated by increasing time in the RW. Thus, fluoxetine improved escape in an aversive context but decreased relative preference for active reinforcement. Moreover, fluoxetine did not reverse the anergic effects of DA depletion. These results have implications for the use of fluoxetine for treating motivational symptoms such as anergia in depressed patients.

Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning

Effort-related decision-making and reward learning are both dopamine-dependent, but preclinical research suggests they depend on different dopamine signaling dynamics. Therefore, the same dose of a dopaminergic medication could have differential effects on effort for reward vs. reward learning. However, no study has tested how effort and reward learning respond to the same dopaminergic medication within subjects. The current study aimed to test the effect of therapeutic doses of d-amphetamine on effort for reward and reward learning in the same healthy volunteers. Participants (n = 30) completed the Effort Expenditure for Reward Task (EEfRT) measure of effort-related decision-making, and the Probabilistic Reward Task (PRT) measure of reward learning, under placebo and two doses of d-amphetamine (10 mg, and 20 mg). Secondarily, we examined whether the individual characteristics of baseline working memory and willingness to exert effort for reward moderated the effects of d-amphetamine. d-Amphetamine increased willingness to exert effort, particularly at low to intermediate expected values of reward. Computational modeling analyses suggested this was due to decreased effort discounting rather than probability discounting or decision consistency. Both baseline effort and working memory emerged as moderators of this effect, such that d-amphetamine increased effort more in individuals with lower working memory and lower baseline effort, also primarily at low to intermediate expected values of reward. In contrast, d-amphetamine had no significant effect on reward learning. These results have implications for treatment of neuropsychiatric disorders, which may be characterized by multiple underlying reward dysfunctions.

Sex differences in lever pressing and running wheel tasks of effort-based choice behavior in rats: Suppression of high effort activity by the serotonin transport inhibitor fluoxetine

Selective serotonin transport (SERT) inhibitors such as fluoxetine are the most commonly prescribed treatments for depression. Although efficacious for many symptoms of depression, motivational impairments such as psychomotor retardation, anergia, fatigue and amotivation are relatively resistant to treatment with SERT inhibitors, and these drugs have been reported to exacerbate motivational deficits in some people. In order to study motivational dysfunctions in animal models, procedures have been developed to measure effort-related decision making, which offer animals a choice between high effort actions leading to highly valued reinforcers, or low effort/low reward options. In the present studies, male and female rats were tested on two different tests of effort-based choice: a fixed ratio 5 (FR5)/chow feeding choice procedure and a running wheel (RW)/chow feeding choice task. The baseline pattern of choice differed across tasks for males and females, with males pressing the lever more than females on the operant task, and females running more than males on the RW task. Administration of the SERT inhibitor and antidepressant fluoxetine suppressed the higher effort activity on each task (lever pressing and wheel running) in both males and females. The serotonin receptor mediating the suppressive effects of fluoxetine is uncertain, because serotonin antagonists with different patterns of receptor selectivity failed to reverse the effects of fluoxetine. Nevertheless, these studies uncovered important sex differences, and demonstrated that the suppressive effects of fluoxetine on high effort activities are not limited to tasks involving food reinforced behavior or appetite suppressive effects. It is possible that this line of research will contribute to an understanding of the neurochemical factors regulating selection of voluntary physical activity vs. sedentary behaviors, which could be relevant for understanding the role of physical activity in psychiatric disorders.

Energizing effects of bupropion on effortful behaviors in mice under positive and negative test conditions: modulation of DARPP-32 phosphorylation patterns

Motivational symptoms such as anergia, fatigue, and reduced exertion of effort are seen in depressed people. To model this, nucleus accumbens (Nacb) dopamine (DA) depletions are used to induce a low-effort bias in rodents tested on effort-based decision-making. We evaluated the effect of the catecholamine uptake blocker bupropion on its own, and after administration of tetrabenazine (TBZ), which blocks vesicular storage, depletes DA, and induces depressive symptoms in humans. Male CD1 mice were tested on a 3-choice-T-maze task that assessed preference between a reinforcer involving voluntary physical activity (running wheel, RW) vs. sedentary activities (sweet food pellet intake or a neutral non-social odor). Mice also were tested on the forced swim test (FST), two anxiety-related measures (dark-light box (DL), and elevated plus maze (EPM)). Expression of phosphorylated DARPP-32 (Thr34 and Thr75) was evaluated by immunohistochemistry as a marker of DA-related signal transduction. Bupropion increased selection of RW activity on the T-maze. TBZ reduced time running, but increased time-consuming sucrose, indicating an induction of a low-effort bias, but not an effect on primary sucrose motivation. In the FST, bupropion reduced immobility, increasing swimming and climbing, and TBZ produced the opposite effects. Bupropion reversed the effects of TBZ on the T-maze and the FST, and also on pDARPP32-Thr34 expression in Nacb core. None of these manipulations affected anxiety-related parameters. Thus, bupropion improved active behaviors, which were negatively motivated in the FST, and active behaviors that were positively motivated in the T-maze task, which has implications for using catecholamine uptake inhibitors for treating anergia and fatigue-like symptoms.

Behavioral and dopamine transporter binding properties of the modafinil analog (S, S)-CE-158: reversal of the motivational effects of tetrabenazine and enhancement of progressive ratio responding

RATIONALE

Atypical dopamine (DA) transport blockers such as modafinil and its analogs may be useful for treating motivational symptoms of depression and other disorders. Previous research has shown that the DA depleting agent tetrabenazine can reliably induce motivational deficits in rats, as evidenced by a shift towards a low-effort bias in effort-based choice tasks. This is consistent with human studies showing that people with major depression show a bias towards low-effort activities.

OBJECTIVES

Recent studies demonstrated that the atypical DA transport (DAT) inhibitor (S)-CE-123 reversed tetrabenazine-induced motivational deficits, increased progressive ratio (PROG) lever pressing, and increased extracellular DA in the nucleus accumbens. In the present studies, a recently synthesized modafinil analog, (S, S)-CE-158, was assessed in a series of neurochemical and behavioral studies in rats.

RESULTS

(S, S)-CE-158 demonstrated the ability to reverse the effort-related effects of tetrabenazine and increase selection of high-effort PROG lever pressing in rats tested on PROG/chow feeding choice task. (S, S)-CE-158 showed a high selectivity for inhibiting DAT compared with other monoamine transporters, and systemic administration of (S, S)-CE-158 increased extracellular DA in the nucleus accumbens during the behaviorally active time course, which is consistent with the effects of (S)-CE-123 and other DAT inhibitors that enhance high-effort responding.

CONCLUSIONS

These studies provide an initial neurochemical characterization of a novel atypical DAT inhibitor, and demonstrate that this compound is active in models of effort-related choice. This research could contribute to the development of novel compounds for the treatment of motivational dysfunctions in humans.

The novel atypical dopamine transport inhibitor CT-005404 has pro-motivational effects in neurochemical and inflammatory models of effort-based dysfunctions related to psychopathology

Depressed individuals suffer from effort-related motivational symptoms such as anergia and fatigue, which are resistant to treatment with many common antidepressants. While drugs that block dopamine transport (DAT) reportedly have positive motivational effects, DAT inhibitors such as cocaine and amphetamines produce undesirable side effects. Thus, there is a need to develop and characterize novel atypical DAT inhibitors with unique and selective binding profiles. Rodent effort-based choice tasks provide useful models of motivational dysfunctions. With these tasks, animals choose between a high-effort instrumental action leading to highly valued reinforcement vs. a low effort/low reward option. The present studies focused on the initial characterization of a novel atypical DAT inhibitor, CT-005404, which binds to DAT with high selectivity relative to serotonin and norepinephrine transport, and produces long-term elevations of extracellular DA. CT-005404 was assessed for its ability to attenuate the effort-related motivational effects of the DA depleting agent tetrabenazine and the pro-inflammatory cytokine interleukin-1β (IL-1β) using a fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg i.p.) shifted choice behavior, decreasing lever pressing and increasing chow intake. IL-1β (4.0 μg/kg i.p.) also decreased lever pressing. CT-005404 was co-administered (7.5-30.0 mg/kg p.o.) with either tetrabenazine or IL-1β, and the 15.0 and 30.0 mg/kg doses significantly reversed the effects of tetrabenazine and IL-1β. CT-005404 administered alone produced a dose-related increase in lever pressing in rats tested on a progressive ratio/chow feeding choice task. Atypical DAT inhibitors such as CT-005404 offer potential as a new avenue for drug treatment of motivational dysfunctions in humans.

The dopamine depleting agent tetrabenazine alters effort-related decision making as assessed by mouse touchscreen procedures

RATIONALE

Effort-based decision-making tasks allow animals to choose between preferred reinforcers that require high effort to obtain vs. low-effort/low reward options. Mesolimbic dopamine (DA) and related neural systems regulate effort-based choice. Tetrabenazine (TBZ) is a vesicular monoamine transport type-2 inhibitor that blocks DA storage and depletes DA. In humans, TBZ induces motivational dysfunction and depression. TBZ has been shown reliably to induce a low-effort bias in rats, but there are fewer mouse studies.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida chambers) to assess the effects of TBZ on effort-based choice in mice.

METHODS

C57BL6 mice were trained to press an elevated lit panel on the touchscreen on a fixed ratio 1 schedule reinforced by strawberry milkshake, vs. approaching and consuming a concurrently available but less preferred food pellets (Bio-serv).

RESULTS

TBZ (2.0-8.0 mg/kg IP) shifted choice, producing a dose-related decrease in panel pressing but an increase in pellet intake. In contrast, reinforcer devaluation by pre-feeding substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred the milkshake vs. the pellets, and TBZ had no effect on milkshake intake or preference, indicating that the TBZ-induced low-effort bias was not due to changes in primary food motivation or preference. TBZ significantly decreased tissue levels of nucleus accumbens DA.

CONCLUSION

The DA depleting agent TBZ induced an effort-related motivational dysfunction in mice, which may have clinical relevance for assessing novel drug targets for their potential use as therapeutic agents in patients with motivation impairments.

Comparison of acute treatment with delayed-onset versus rapid-acting antidepressants on effort-related choice behaviour

RATIONALE

Reward-related impairments are common in major depressive disorder (MDD) and may contribute to the loss of interest in pleasurable activities. A novel approach to studying reward-related decision-making are effort-based tasks; however, direct comparisons between delayed-onset and rapid-acting antidepressants (ADs) have not yet been carried out.

OBJECTIVES

To investigate the effects of conventional delayed-onset ADs versus rapid-acting ADs, ketamine and scopolamine, on effort-related choice behaviour.

METHODS

Female Lister hooded rats were trained in an operant effort for reward task (EfRT) where animals choose between working for a high value-high effort reward and consuming low value-low effort chow. Using a within-subject study design, animals were then tested following acute treatment with different monoaminergic ADs, and the rapid-acting ADs ketamine or scopolamine.

RESULTS

Consistent with previous findings, we found choice behaviour was sensitive to dopaminergic manipulations. We observed that pre-feeding altered choice behaviour and that the use of high or low value reward differentially affected behaviour. Monoamine re-uptake inhibitors and rapid-acting ADs resulted in similar, general patterns of reduced motivation without any evidence for specific effects, and we did not observe any clear differences between these classes of antidepressant.

CONCLUSIONS

Motivational changes induced by dopaminergic manipulations and pre-feeding differentially affect effort choice behaviour. However, both conventional delayed-onset ADs and ketamine and scopolamine appear to have detrimental effects on motivation in this task at the higher doses tested without any evidence of specificity for effort-related choice behaviour, in contrast to their specificity in tasks which look at more cognitive aspects of reward processing.

Chemogenetic Modulation and Single-Photon Calcium Imaging in Anterior Cingulate Cortex Reveal a Mechanism for Effort-Based Decisions

The ACC is implicated in effort exertion and choices based on effort cost, but it is still unclear how it mediates this cost-benefit evaluation. Here, male rats were trained to exert effort for a high-value reward (sucrose pellets) in a progressive ratio lever-pressing task. Trained rats were then tested in two conditions: a no-choice condition where lever-pressing for sucrose was the only available food option, and a choice condition where a low-value reward (lab chow) was freely available as an alternative to pressing for sucrose. Disruption of ACC, via either chemogenetic inhibition or excitation, reduced lever-pressing in the choice, but not in the no-choice, condition. We next looked for value coding cells in ACC during effortful behavior and reward consumption phases during choice and no-choice conditions. For this, we used in vivo miniaturized fluorescence microscopy to reliably track responses of the same cells and compare how ACC neurons respond during the same effortful behavior where there was a choice versus when there was no-choice. We found that lever-press and sucrose-evoked responses were significantly weaker during choice compared with no-choice sessions, which may have rendered them more susceptible to chemogenetic disruption. Together, findings from our interference experiments and neural recordings suggest that a mechanism by which ACC mediates effortful decisions is in the discrimination of the utility of available options. ACC regulates these choices by providing a stable population code for the relative value of different options.

SIGNIFICANCE STATEMENT The ACC is implicated in effort-based decision-making. Here, we used chemogenetics and in vivo calcium imaging to explore its mechanism. Rats were trained to lever press for a high-value reward and tested in two conditions: a no-choice condition where lever-pressing for the high-value reward was the only option, and a choice condition where a low-value reward was also available. Inhibition or excitation of ACC reduced effort toward the high-value option, but only in the choice condition. Neural responses in ACC were weaker in the choice compared with the no-choice condition. A mechanism by which ACC regulates effortful decisions is in providing a stable population code for the discrimination of the utility of available options.

Pharmacological studies of effort-related decision making using mouse touchscreen procedures: effects of dopamine antagonism do not resemble reinforcer devaluation by removal of food restriction

RATIONALE

Effort-based decision-making tasks offer animals choices between preferred reinforcers that require high effort to obtain vs. low effort/low reward options. The neural mechanisms of effort-based choice are widely studied in rats, and evidence indicates that mesolimbic dopamine (DA) and related neural systems play a key role. Fewer studies of effort-based choice have been performed in mice.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida boxes) to assess effort-based choice in mice.

METHODS

CD1 mice were assessed on a concurrent fixed ratio 1 panel pressing/choice procedure. Mice were allowed to choose between rearing to press an elevated panel on the touchscreen for a preferred food (strawberry milkshake) vs. consuming a concurrently available less preferred alternative (high carbohydrate pellets).

RESULTS

The DA D₂ antagonist haloperidol (0.05-0.15 mg/kg IP) produced a dose-related decrease in panel pressing. Intake of food pellets was not reduced by haloperidol, and in fact, there was a significant quadratic trend, indicating a tendency for pellet intake to increase at low/moderate doses. In contrast, reinforcer devaluation by removing food restriction substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred milkshake vs. pellets. Haloperidol did not affect food intake or preference.

CONCLUSION

Haloperidol reduced the tendency to work for food, but this reduction was not due to decreases in primary food motivation or preference. Mouse touchscreen procedures demonstrate effects of haloperidol that are similar but not identical to those shown in rats. These rodent studies may be relevant for understanding motivational dysfunctions in humans.

The Novel Atypical Dopamine Uptake Inhibitor (S)-CE-123 Partially Reverses the Effort-Related Effects of the Dopamine Depleting Agent Tetrabenazine and Increases Progressive Ratio Responding

Animal studies of effort-based choice behavior are being used to model effort-related motivational dysfunctions in humans. With these procedures, animals are offered a choice between high-effort instrumental actions leading to highly valued reinforcers vs. low effort/low reward options. Several previous studies have shown that dopamine (DA) uptake inhibitors, including GBR12909, lisdexamfetamine, methylphenidate, and PRX-14040, can reverse the effort-related effects of the vesicular monoamine transport blocker tetrabenazine, which inhibits DA storage. Because many drugs that block DA transport act as major stimulants that also release DA, and produce a number of undesirable side effects, there is a need to develop and characterize novel atypical DA transport inhibitors. (S)-CE-123 ((S)-5-((benzhydrylsulfinyl) methyl)thiazole) is a recently developed analog of modafinil with the biochemical characteristics of an atypical DA transport blocker. The present paper describes the enantioselective synthesis and initial chemical characterization of (S)-CE-123, as well as behavioral experiments involving effort-based choice and microdialysis studies of extracellular DA. Rats were assessed using the fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg) shifted choice behavior, decreasing lever pressing and increasing chow intake. (S)-CE-123 was coadministered at doses ranging from 6.0 to 24.0 mg/kg, and the highest dose partially but significantly reversed the effects of tetrabenazine, although this dose had no effect on fixed ratio responding when administered alone. Additional experiments showed that (S)-CE-123 significantly increased lever pressing on a progressive ratio/chow feeding choice task and that the effective dose (24.0 mg/kg) increased extracellular DA in nucleus accumbens core. In summary, (S)-CE-123 has the behavioral and neurochemical profile of a compound that can block DA transport, reverse the effort-related effects of tetrabenazine, and increase selection of high-effort progressive ratio responding. This suggests that (S)-CE-123 or a similar compound could be useful as a treatment for effort-related motivational dysfunction in humans.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

New Developments on the Adenosine Mechanisms of the Central Effects of Caffeine and Their Implications for Neuropsychiatric Disorders

Recent studies on interactions between striatal adenosine and dopamine and one of its main targets, the adenosine A_2A receptor–dopamine D₂ receptor (A2AR–D2R) heteromer, have provided a better understanding of the mechanisms involved in the psychostimulant effects of caffeine and have brought forward new data on the mechanisms of operation of classical orthosteric ligands within G protein-coupled receptor heteromers. The striatal A2AR–D2R heteromer has a tetrameric structure and forms part of a signaling complex that includes a Gs and a Gi protein and the effector adenyl cyclase (subtype AC5). Another target of caffeine, the adenosine A₁ receptor–dopamine D₁ receptor (A1R–D1R) heteromer, seems to have a very similar structure. Initially suggested to be localized in the striatum, the A1R–D1R heteromer has now been identified in the spinal motoneuron and shown to mediate the spinally generated caffeine-induced locomotion. In this study, we review the recently discovered properties of A2AR–D2R and A1R–D1R heteromers. Our studies demonstrate that these complexes are a necessary condition to sustain the canonical antagonistic interaction between a Gs-coupled receptor (A2AR or D1R) and a Gi-coupled receptor (D2R or A1R) at the adenylyl cyclase level, which constitutes a new concept in the field of G protein-coupled receptor physiology and pharmacology. A2AR antagonists targeting the striatal A2AR–D2R heteromer are already being considered as therapeutic agents in Parkinson's disease. In this study, we review the preclinical evidence that indicates that caffeine and A2AR antagonists could be used to treat the motivational symptoms of depression and attention-deficit/hyperactivity disorder, while A1R antagonists selectively targeting the spinal A1R–D1R heteromer could be used in the recovery of spinal cord injury.

Animal models of fatigue in major depressive disorder

Fatigue is common in a host of neurological and psychiatric disorders including depression and often continues unabated even after primary symptoms of disease are treated. Its high estimated prevalence combined with the lack of effective medicines has engaged the preclinical research community to search for fatigue models. The present review briefly summarizes the most common animal models that have been brought forward along with some of the associated pharmacological validation data. Like all preclinical models, these models have issues that need to be appreciated in the generation and interpretation of data for the purposes of translation to human disease; specifically, there are deficiencies in construct validity, a lack of medicines that effectively address residual fatigue symptoms, and difficulties in defining specificity with respect to drug effects on fatigue per se. Nonetheless, existing animal models of fatigue arguably serve the valuable purpose of encouraging research in this large area of unmet medical need. Data from these models are predicted to engender human experimentation and the further development of improved model systems.

Dopamine depletion shifts behavior from activity based reinforcers to more sedentary ones and adenosine receptor antagonism reverses that shift: Relation to ventral striatum DARPP32 phosphorylation patterns

The mesolimbic dopamine (DA) system plays a critical role in behavioral activation and effort-based decision-making. DA depletion produces anergia (shifts to low effort options) in animals tested on effort-based decision-making tasks. Caffeine, the most consumed stimulant in the world, acts as an adenosine A₁/A_2A receptor antagonist, and in striatal areas DA D₁ and D₂ receptors are co-localized with adenosine A₁ and A_2A receptors respectively. In the present work, we evaluated the effect of caffeine on anergia induced by the VMAT-2 inhibitor tetrabenazine (TBZ), which depletes DA. Anergia was evaluated in a three-chamber T-maze task in which animals can chose between running on a wheel (RW) vs. sedentary activities such as consuming sucrose or sniffing a neutral odor. TBZ-caffeine interactions in ventral striatum were evaluated using DARPP-32 phosphorylation patterns as an intracellular marker of DA-adenosine receptor interaction. In the T-maze, control mice spent more time running and much less consuming sucrose or sniffing. TBZ (4.0 mg/kg) reduced ventral striatal DA tissue levels as measured by HPLC, and also shifted preferences in the T-maze, reducing selection of the reinforcer that involved vigorous activity (RW), but increasing consumption of a reinforcer that required little effort (sucrose), at doses that had no effect on independent measures of appetite or locomotion in a RW. Caffeine at doses that had no effect on their own reversed the effects of TBZ on T-maze performance, and also suppressed TBZ-induced pDARPP-32(Thr34) expression as measured by western blot, suggesting a role for D₂-A_2A interactions. These results support the idea that DA depletion produces anergia, but does not affect the primary motivational effects of sucrose. Caffeine, possibly by acting on A_2A receptors in ventral striatum, reversed the DA depletion effects. It is possible that caffeine, like selective adenosine A2A antagonists, could have some therapeutic benefit for treating effort-related symptoms.

Individual differences in the energizing effects of caffeine on effort-based decision-making tests in rats

Motivated behavior is characterized by activation and high work output. Nucleus accumbens (Nacb) modulates behavioral activation and effort-based decision-making. Caffeine is widely consumed because of its energizing properties. This methylxanthine is a non-selective adenosine A₁/A_2A receptor antagonist. Adenosine receptors are highly concentrated in Nacb. Adenosine agonists injected into Nacb, shift preference towards low effort alternatives. The present studies characterized effort-related effects of caffeine in a concurrent progressive ratio (PROG)/free reinforcer choice procedure that requires high levels of work output, and generates great variability among different animals. Male Sprague-Dawley rats received an acute dose of caffeine (2.5-20.0 mg/kg, IP) and 30 min later were tested in operant boxes. One group was food-restricted and had to lever pressed for high carbohydrate pellets, another group was non-food-restricted and lever pressed for a high sucrose solution. Caffeine (2.5 and 5.0 mg/kg) increased lever pressing in food-restricted animals that were already high responders. However, in non-restricted animals, caffeine (5.0 and 10.0 mg/kg) increased work output only among low responders. In fact, caffeine (10.0 and 20.0 mg/kg) in non-restricted animals, reduced lever pressing among high responders in the PROG task, and also in a different group of animals lever pressing in an easy task (fixed ratio 7 schedule) that uniformly generates high levels of responding. Caffeine did not modify sucrose preference or consumption under free access conditions. Thus, when animals do not have a homeostatic need, caffeine can help those not very intrinsically motivated to work harder for a more palatable reward. However, caffeine can disrupt performance of animals intrinsically motivated to work hard for a better reward.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

HIV-Associated Neurocognitive Disorder

In the last two decades, several advancement studies have increased the care of HIV-infected individuals. Specifically, the development for preparation of combination antiretroviral therapy has resulted in a dramatic decline in the rate of deaths from AIDS. The term “HIV-associated neurocognitive disorder” (HAND) has been used to distinguish the spectrum of neurocognitive dysfunction associated with HIV infection. HIV can pass to the CNS during the early stages of infection and last in the CNS. CNS inflammation and infection lead to the development of HAND. The brain can serve as a sanctuary for ongoing HIV replication, even when the systemic viral suppression has been achieved. HAND can remain in patients treated with combination antiretroviral therapy, and its effect on survival, quality of life, and everyday functioning make it a significant unresolved problem. This chapter discusses details of the computational modeling studies on mechanisms and structures of human dopamine transporter (hDAT) and its interaction with HIV-1 trans activator of transcription (Tat).

Oral Ingestion and Intraventricular Injection of Curcumin Attenuates the Effort-Related Effects of the VMAT-2 Inhibitor Tetrabenazine: Implications for Motivational Symptoms of Depression

Effort-related choice tasks are used for studying depressive motivational symptoms such as anergia/fatigue. These studies investigated the ability of the dietary supplement curcumin to reverse the low-effort bias induced by the monoamine storage blocker tetrabenazine. Tetrabenazine shifted effort-related choice in rats, decreasing high-effort lever pressing but increasing chow intake. The effects of tetrabenazine were reversed by oral ingestion of curcumin (80.0-160.0 mg/kg) and infusions of curcumin into the cerebral ventricles (2.0-8.0 μg). Curcumin attenuates the effort-related effects of tetrabenazine in this model via actions on the brain, suggesting that curcumin may be useful for treating human motivational symptoms.

Assessment of a glycine uptake inhibitor in animal models of effort-related choice behavior: implications for motivational dysfunctions

RATIONALE

Motivated behavior can be characterized by a substantial exertion of effort, and organisms often make effort-related decisions based upon analyses of work-related response costs and reinforcement preference. Moreover, alterations in effort-based choice can be seen in people with major depression and schizophrenia. Effort-related decision making is studied using tasks offering choices between high effort options leading to highly valued reinforces vs low effort/low reward options. Interference with dopamine (DA) transmission by administration of the DA D2 family antagonist haloperidol biases behavior towards the lower effort option that can be obtained with minimal work, and previous research has shown that DA interacts with other transmitters, including adenosine and GABA, to regulate effort-based choice.

OBJECTIVES

The present studies focused upon the ability of the glycine transport inhibitor bitopertin to attenuate haloperidol-induced shifts in effort-related choice behavior.

METHODS

Effort-based choice in rats was assessed using the concurrent fixed ratio (FR) 5/chow feeding choice task and the T-maze barrier choice procedure.

RESULTS

Haloperidol shifted effort-based choice, biasing animals towards the low effort option in each task. Co-administration of bitopertin (1.0-10.0 mg/kg) significantly attenuated haloperidol-induced shifts in choice behavior, but the same doses of bitopertin had no effect when administered alone.

CONCLUSIONS

These results indicated that elevation of extracellular glycine via inhibition of glycine uptake was able to reverse the effects of D2 antagonism. Increases in extracellular glycine, possibly through actions on the glycine allosteric site on the NMDA receptor, may be a useful strategy for treating motivational dysfunctions in humans.

Ethanol and Caffeine Effects on Social Interaction and Recognition in Mice: Involvement of Adenosine A2A and A1 Receptors

Ethanol and caffeine are frequently consumed in combination and have opposite effects on the adenosine system: ethanol metabolism leads to an increase in adenosine levels, while caffeine is a non-selective adenosine A1/A2A receptor antagonist. These receptors are highly expressed in striatum and olfactory tubercle, brain areas involved in exploration and social interaction in rodents. Ethanol modulates social interaction processes, but the role of adenosine in social behavior is still poorly understood. The present work was undertaken to study the impact of ethanol, caffeine and their combination on social behavior, and to explore the involvement of A1 and A2A receptors on those actions. Male CD1 mice were evaluated in a social interaction three-chamber paradigm, for preference of conspecific vs. object, and also for long-term recognition memory of familiar vs. novel conspecific. Ethanol showed a biphasic effect, with low doses (0.25 g/kg) increasing social contact and higher doses (1.0-1.5 g/kg) reducing social interaction. However, no dose changed social preference; mice always spent more time sniffing the conspecific than the object, independently of the ethanol dose. Ethanol, even at doses that did not change social exploration, produced amnestic effects on social recognition the following day. Caffeine reduced social contact (15.0-60.0 mg/kg), and even blocked social preference at higher doses (30.0-60.0 mg/kg). The A1 antagonist Cyclopentyltheophylline (CPT; 3-9 mg/kg) did not modify social contact or preference on its own, and the A2A antagonist MSX-3 (1.5-6 mg/kg) increased social interaction at all doses. Ethanol at intermediate doses (0.5-1.0 g/kg) was able to reverse the reduction in social exploration induced by caffeine (15.0-30.0 mg/kg). Although there was no interaction between ethanol and CPT or MSX-3 on social exploration in the first day, MSX-3 blocked the amnestic effects of ethanol observed on the following day. Thus, ethanol impairs the formation of social memories, and A2A adenosine antagonists can prevent the amnestic effects of ethanol, so that animals can recognize familiar conspecifics. On the other hand, ethanol can counteract the social withdrawal induced by caffeine, a non-selective adenosine A1/A2A receptor antagonist. These results show the complex set of interactions between ethanol and caffeine, some of which could be the result of the opposing effects they have in modulating the adenosine system.

Computational modeling of human dopamine transporter structures, mechanism and its interaction with HIV-1 transactivator of transcription

This is a brief review of computational modeling studies on the detailed structures and mechanism of human dopamine transporter (hDAT), as well as its interaction with HIV-1 transactivator of transcription (Tat). Extensive molecular modeling, docking and dynamics simulations have resulted in reasonable structural models of hDAT in three typical conformational states, its dopamine uptake mechanism and its interaction with Tat. The obtained hDAT models in different conformational states and their complexes with dopamine and Tat have provided novel structural and mechanistic insights concerning how hDAT uptakes dopamine and how Tat affects the dopamine uptake by hDAT. The computational insights, that are consistent with available experimental data, should be valuable for future rational design of novel therapeutic strategies for treatment of HIV-associated neurocognitive disorders.