Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Effects of the dopamine depleting agent tetrabenazine on detailed temporal parameters of effort-related choice responding

The dopamine-depleting agent tetrabenazine alters effort-based choice, suppressing food-reinforced behaviors with high response requirements, while increasing selection of low-cost options. In the present experiments, rats were tested on a concurrent fixed ratio 5/chow feeding choice task, in which high-carbohydrate Bio-serv pellets reinforced lever pressing and lab chow was concurrently available. Detailed timing of lever pressing was monitored with an event recording system, and the temporal characteristics of operant behavior seen after 1.0 mg/kg tetrabenazine or vehicle injections were analyzed. Tetrabenazine shifted choice, decreasing lever pressing but increasing chow intake. There was a small effect on the interresponse-time distribution within ratios, but marked increases in the total duration of pauses in responding. The postreinforcement-pause (PRP) distribution was bimodal, but tetrabenazine did not increase the duration of PRPs. Tetrabenazine increased time feeding and duration and number of feeding bouts, but did not affect feeding rate or total time spent lever pressing for pellets and consuming chow. Thus, TBZ appears to predominantly affect the relative allocation of lever pressing versus chow, with little alteration in consummatory motor acts involved in chow intake. Tetrabenazine is used to model motivational symptoms in psychopathology, and these effects in rats could have implications for psychiatric research.

Increased elasticity of sucrose demand during hyperdopaminergic states in rats

RATIONALE

Deficits in cost-benefit decision-making are a core feature of several psychiatric disorders, including substance addiction, eating disorders and bipolar disorder. Mesocorticolimbic dopamine signalling has been implicated in various processes related to cognition and reward, but its precise role in reward valuation and cost-benefit trade-off decisions remains incompletely understood.

OBJECTIVES

We assessed the role of mesocorticolimbic dopamine signalling in the relationship between price and consumption of sucrose, to better understand its role in cost-benefit decisions.

METHODS

Dopamine neurons in the ventral tegmental area (VTA) were chemogenetically activated in rats, and a behavioural economics approach was used to quantify the relationship between price and consumption of sucrose. Motivation for sucrose was also assessed under a progressive ratio (PR) schedule of reinforcement. To further gauge the role of dopamine in cost-benefit trade-offs for sucrose, the effects of treatment with D-amphetamine and the dopamine receptor antagonist alpha-flupentixol were assessed.

RESULTS

Chemogenetic activation of VTA dopamine neurons increased demand elasticity, while responding for sucrose under a PR schedule of reinforcement was augmented upon stimulation of VTA dopamine neurons. Treatment with amphetamine partially replicated the effects of chemogenetic dopamine neuron activation, whereas treatment with alpha-flupentixol reduced free consumption of sucrose and had mixed effects on demand elasticity.

CONCLUSIONS

Stimulation of mesocorticolimbic dopaminergic neurotransmission altered cost-benefit trade-offs in a complex manner. It reduced the essential value of palatable food, increased incentive motivation and left free consumption unaltered. Together, these findings imply that mesocorticolimbic dopamine signalling differentially influences distinct components of cost expenditure processes aimed at obtaining rewards.

Sex differences in lever pressing and running wheel tasks of effort-based choice behavior in rats: Suppression of high effort activity by the serotonin transport inhibitor fluoxetine

Selective serotonin transport (SERT) inhibitors such as fluoxetine are the most commonly prescribed treatments for depression. Although efficacious for many symptoms of depression, motivational impairments such as psychomotor retardation, anergia, fatigue and amotivation are relatively resistant to treatment with SERT inhibitors, and these drugs have been reported to exacerbate motivational deficits in some people. In order to study motivational dysfunctions in animal models, procedures have been developed to measure effort-related decision making, which offer animals a choice between high effort actions leading to highly valued reinforcers, or low effort/low reward options. In the present studies, male and female rats were tested on two different tests of effort-based choice: a fixed ratio 5 (FR5)/chow feeding choice procedure and a running wheel (RW)/chow feeding choice task. The baseline pattern of choice differed across tasks for males and females, with males pressing the lever more than females on the operant task, and females running more than males on the RW task. Administration of the SERT inhibitor and antidepressant fluoxetine suppressed the higher effort activity on each task (lever pressing and wheel running) in both males and females. The serotonin receptor mediating the suppressive effects of fluoxetine is uncertain, because serotonin antagonists with different patterns of receptor selectivity failed to reverse the effects of fluoxetine. Nevertheless, these studies uncovered important sex differences, and demonstrated that the suppressive effects of fluoxetine on high effort activities are not limited to tasks involving food reinforced behavior or appetite suppressive effects. It is possible that this line of research will contribute to an understanding of the neurochemical factors regulating selection of voluntary physical activity vs. sedentary behaviors, which could be relevant for understanding the role of physical activity in psychiatric disorders.

Major Depression and Brain Asymmetry in a Decision-Making Task with Negative and Positive Feedback

Depressed patients are characterized by hypoactivity of the left and hyperactivity of the right frontal areas during the resting state. Depression is also associated with impaired decision-making, which reflects multiple cognitive, affective, and attentional processes, some of which may be lateralized. The aim of this study was to investigate brain asymmetry during a decision-making task performed in negative and positive feedback conditions in patients with Major Depressive Disorder (MDD) in comparison to healthy control participants. The electroencephalogram (EEG) was recorded from 60 MDD patients and 60 healthy participants while performing a multi-stage decision-making task. Frontal, central, and parietal alpha asymmetry were analyzed with EEGlab/ERPlab software. Evoked potential responses (ERPs) showed general lateralization suggestive of an initial right dominance developing into a more complex pattern of asymmetry across different scalp areas as information was processed. The MDD group showed impaired mood prior to performance, and decreased confidence during performance in comparison to the control group. The resting state frontal alpha asymmetry showed lateralization in the healthy group only. Task-induced alpha power and ERP P100 and P300 amplitudes were more informative biomarkers of depression during decision making. Asymmetry coefficients based on task alpha power and ERP amplitudes showed consistency in the dynamical changes during the decision-making stages. Depression was characterized by a lack of left dominance during the resting state and left hypoactivity during the task baseline and subsequent decision-making process. Findings add to understanding of the functional significance of lateralized brain processes in depression.

The dopamine depleting agent tetrabenazine alters effort-related decision making as assessed by mouse touchscreen procedures

RATIONALE

Effort-based decision-making tasks allow animals to choose between preferred reinforcers that require high effort to obtain vs. low-effort/low reward options. Mesolimbic dopamine (DA) and related neural systems regulate effort-based choice. Tetrabenazine (TBZ) is a vesicular monoamine transport type-2 inhibitor that blocks DA storage and depletes DA. In humans, TBZ induces motivational dysfunction and depression. TBZ has been shown reliably to induce a low-effort bias in rats, but there are fewer mouse studies.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida chambers) to assess the effects of TBZ on effort-based choice in mice.

METHODS

C57BL6 mice were trained to press an elevated lit panel on the touchscreen on a fixed ratio 1 schedule reinforced by strawberry milkshake, vs. approaching and consuming a concurrently available but less preferred food pellets (Bio-serv).

RESULTS

TBZ (2.0-8.0 mg/kg IP) shifted choice, producing a dose-related decrease in panel pressing but an increase in pellet intake. In contrast, reinforcer devaluation by pre-feeding substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred the milkshake vs. the pellets, and TBZ had no effect on milkshake intake or preference, indicating that the TBZ-induced low-effort bias was not due to changes in primary food motivation or preference. TBZ significantly decreased tissue levels of nucleus accumbens DA.

CONCLUSION

The DA depleting agent TBZ induced an effort-related motivational dysfunction in mice, which may have clinical relevance for assessing novel drug targets for their potential use as therapeutic agents in patients with motivation impairments.

Effort-related decision making in humanized COMT mice: Effects of Val158Met polymorphisms and possible implications for negative symptoms in humans

Catechol-o-methyltransferase (COMT) is an enzyme that metabolizes catecholamines, and is crucial for clearance of dopamine (DA) in prefrontal cortex. Val¹⁵⁸Met polymorphism, which causes a valine (Val) to methionine (Met) substitution at codon 158, is reported to be associated with human psychopathologies in some studies. The Val/Val variant of the enzyme results in higher dopamine metabolism, which results in reduced dopamine transmission. Thus, it is important to investigate the relation between Val¹⁵⁸Met polymorphisms using rodent models of psychiatric symptoms, including negative symptoms such as motivational dysfunction. In the present study, humanized COMT transgenic mice with two genotype groups (Val/Val (Val) and Met/Met (Met) homozygotes) and wild-type (WT) mice from the S129 background were tested using a touchscreen effort-based choice paradigm. Mice were trained to choose between delivery of a preferred liquid diet that reinforced panel pressing on various fixed ratio (FR) schedules (high-effort alternative), vs. intake of pellets concurrently available in the chamber (low-effort alternative). Panel pressing requirements were controlled by varying the FR levels (FR1, 2, 4, 8, 16) in ascending and descending sequences across weeks of testing. All mice were able to acquire the initial touchscreen operant training, and there was an inverse relationship between the number of reinforcers delivered by panel pressing and pellet intake across different FR levels. There was a significant group x FR level interaction in the ascending limb, with panel presses in the Val group being significantly lower than the WT group in FR1-8, and lower than Met in FR4. These findings indicate that the humanized Val allele in mice modulates FR/pellet-choice performance, as marked by lower levels of panel pressing in the Val group when the ratio requirement was moderately high. These studies may contribute to the understanding of the role of COMT polymorphisms in negative symptoms such as motivational dysfunctions in schizophrenic patients.

Pharmacological studies of effort-related decision making using mouse touchscreen procedures: effects of dopamine antagonism do not resemble reinforcer devaluation by removal of food restriction

RATIONALE

Effort-based decision-making tasks offer animals choices between preferred reinforcers that require high effort to obtain vs. low effort/low reward options. The neural mechanisms of effort-based choice are widely studied in rats, and evidence indicates that mesolimbic dopamine (DA) and related neural systems play a key role. Fewer studies of effort-based choice have been performed in mice.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida boxes) to assess effort-based choice in mice.

METHODS

CD1 mice were assessed on a concurrent fixed ratio 1 panel pressing/choice procedure. Mice were allowed to choose between rearing to press an elevated panel on the touchscreen for a preferred food (strawberry milkshake) vs. consuming a concurrently available less preferred alternative (high carbohydrate pellets).

RESULTS

The DA D₂ antagonist haloperidol (0.05-0.15 mg/kg IP) produced a dose-related decrease in panel pressing. Intake of food pellets was not reduced by haloperidol, and in fact, there was a significant quadratic trend, indicating a tendency for pellet intake to increase at low/moderate doses. In contrast, reinforcer devaluation by removing food restriction substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred milkshake vs. pellets. Haloperidol did not affect food intake or preference.

CONCLUSION

Haloperidol reduced the tendency to work for food, but this reduction was not due to decreases in primary food motivation or preference. Mouse touchscreen procedures demonstrate effects of haloperidol that are similar but not identical to those shown in rats. These rodent studies may be relevant for understanding motivational dysfunctions in humans.

The Novel Atypical Dopamine Uptake Inhibitor (S)-CE-123 Partially Reverses the Effort-Related Effects of the Dopamine Depleting Agent Tetrabenazine and Increases Progressive Ratio Responding

Animal studies of effort-based choice behavior are being used to model effort-related motivational dysfunctions in humans. With these procedures, animals are offered a choice between high-effort instrumental actions leading to highly valued reinforcers vs. low effort/low reward options. Several previous studies have shown that dopamine (DA) uptake inhibitors, including GBR12909, lisdexamfetamine, methylphenidate, and PRX-14040, can reverse the effort-related effects of the vesicular monoamine transport blocker tetrabenazine, which inhibits DA storage. Because many drugs that block DA transport act as major stimulants that also release DA, and produce a number of undesirable side effects, there is a need to develop and characterize novel atypical DA transport inhibitors. (S)-CE-123 ((S)-5-((benzhydrylsulfinyl) methyl)thiazole) is a recently developed analog of modafinil with the biochemical characteristics of an atypical DA transport blocker. The present paper describes the enantioselective synthesis and initial chemical characterization of (S)-CE-123, as well as behavioral experiments involving effort-based choice and microdialysis studies of extracellular DA. Rats were assessed using the fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg) shifted choice behavior, decreasing lever pressing and increasing chow intake. (S)-CE-123 was coadministered at doses ranging from 6.0 to 24.0 mg/kg, and the highest dose partially but significantly reversed the effects of tetrabenazine, although this dose had no effect on fixed ratio responding when administered alone. Additional experiments showed that (S)-CE-123 significantly increased lever pressing on a progressive ratio/chow feeding choice task and that the effective dose (24.0 mg/kg) increased extracellular DA in nucleus accumbens core. In summary, (S)-CE-123 has the behavioral and neurochemical profile of a compound that can block DA transport, reverse the effort-related effects of tetrabenazine, and increase selection of high-effort progressive ratio responding. This suggests that (S)-CE-123 or a similar compound could be useful as a treatment for effort-related motivational dysfunction in humans.

Quantity versus quality: Convergent findings in effort-based choice tasks

Organisms must frequently make cost-benefit decisions based on time, risk, and effort in choosing rewards to pursue. Various tasks have been developed to assess effort-based choice in rats, and experimenters have found largely similar results across tasks and brain regions. In this review, we focus primarily on the convergence of different effort-based choice tasks where quality or quantity of reward are manipulated. In the former, the rat is typically presented with the option to work for a preferred reward or select a less preferred, but freely-available reward. In such paradigms, the rewards are of different identities but are confirmed to differ qualitatively in value by a food preference task when both are freely-available. In the latter task type, rats are required to select between higher magnitude versus lower magnitudes of the same reward, but each with a similar effort requirement. We discuss the strengths/limitations of these paradigms, and describe brain regions that have been probed that result in converging or equivocal findings. Results are also reviewed with reference to a need for future work, and the broader impacts and implications of studies probing the mechanisms of effort.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Anticipated Task Difficulty Provokes Pace Conservation and Slower Running Performance

PURPOSE

Models of self-paced endurance performance suggest that accurate knowledge of the exercise end-point influences pace-related decision making. No studies have examined the effects of anticipated task difficulty during equidistant endurance activities. Accordingly, the purpose of this study was to investigate the effects of anticipated task difficulty on pacing, psychological, and physiological responses during running time trials.

METHODS

Twenty-eight trained runners completed three self-paced 3000-m time trials. The first was a baseline time trial completed on a 0% treadmill gradient. Time trials 2 and 3 were counterbalanced. Before a known incline time trial, anticipated to be more difficult, subjects were accurately informed that the gradient would increase to 7% for the final 800 m. Before an equivalent, unknown incline (UI) time trial subjects were deceptively informed that the gradient would remain at 0% throughout.

RESULTS

Expressed relative to baseline, running speed was 2.44% slower (d = -0.47) over the first 2200 m during known incline (KI) time trial than UI time trial. Effort perception, affective valence, heart rate, and blood lactate did not differ between time trials. Initial running speed during KI was related to pretrial motivation, pretrial vigor, perceived effort, and affective valence (all r ≥ 0.382). No such relationships existed during UI. More subjects also reported a conscious focus on pacing during KI.

CONCLUSIONS

An anticipated increase in task difficulty provoked pace conservation during 3000 m running time trials. The reduced pace may have resulted from greater task uncertainty and consciously aware, effort- and affect-based decisions to conserve energy and maintain hedonic state during KI. The findings add to theoretical understandings of factors that influence pacing during endurance activity. Consequently, recommendations to minimize the potentially deleterious effects of anticipated increases in task difficulty are provided.

Persistent effect of withdrawal from intravenous methamphetamine self-administration on brain activation and behavioral economic indices involving an effort cost

Exposure to drugs of abuse produces maladaptive changes in cost-benefit decision-making, including the evaluation of time and risk. Studies probing the effects of drug exposure on such evaluations have primarily used experimenter-administered drug regimens. Similarly, while much is known about the neural bases of effort, there have been relatively fewer investigations of the effects of drug experience on effort-based choices. We recently reported that experimenter-administered methamphetamine (meth) resulted in steeper discounting of effort for food rewards in rats, when assessed in protracted withdrawal. Here, we studied rats that underwent withdrawal from weeks of meth intravenous self-administration that later could freely select between a high effort, preferred option (progressive ratio lever pressing for sucrose pellets) versus a low effort, less preferred option (freely-available lab chow). We found decreased effort for the preferred reward and changes in a behavioral economic index demonstrating an increased sensitivity to effort in meth-experienced rats. Critically, the decreased effort for the preferred option was only present in the context of a competing option, not when it was the only option. We also confirmed rats preferred sucrose pellets over chow when both were freely available. These long-lasting changes were accompanied by decreased c-Fos activation in ventral striatum and basolateral amygdala, regions known to be important in effort-based choices. Taken together with our previous observations, these results suggest a robust and enduring effect of meth on value-based decision-making, and point to the underlying neural mechanisms that support the evaluation of an effort cost.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.