Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning

A randomized proof-of-mechanism trial of TNF antagonism for motivational deficits and related corticostriatal circuitry in depressed patients with high inflammation

Chronic, low-grade inflammation has been associated with motivational deficits in patients with major depression (MD). In turn, impaired motivation has been linked to poor quality of life across psychiatric disorders. We thus determined effects of the anti-inflammatory drug infliximab-a potent tumor necrosis factor (TNF) antagonist-on behavioral and neural measures of motivation in 42 medically stable, unmedicated MD patients with a C-reactive protein >3 mg/L. All patients underwent a double-blind, placebo-controlled, single-dose, randomized clinical trial with infliximab (5 mg/kg) versus placebo. Behavioral performance on an effort-based decision-making task, self-report questionnaires, and neural responses during event-related functional magnetic resonance imaging were assessed at baseline and 2 weeks following infusion. We found that relative to placebo, patients receiving infliximab were more willing to expend effort for rewards. Moreover, increase in effortful choices was associated with reduced TNF signaling as indexed by decreased soluble TNF receptor type 2 (sTNFR2). Changes in effort-based decision-making and sTNFR2 were also associated with changes in task-related activity in a network of brain areas, including dorsomedial prefrontal cortex (dmPFC), ventral striatum, and putamen, as well as the functional connectivity between these regions. Changes in sTNFR2 also mediated the relationships between drug condition and behavioral and neuroimaging measures. Finally, changes in self-reported anhedonia symptoms and effort-discounting behavior were associated with greater responses of an independently validated whole-brain predictive model (aka "neural signature") sensitive to monetary rewards. Taken together, these data support the use of anti-inflammatory treatment to improve effort-based decision-making and associated brain circuitry in depressed patients with high inflammation.

Using Computational Phenotyping to Identify Divergent Strategies for Effort Allocation Across the Psychosis Spectrum

BACKGROUND AND HYPOTHESIS

Disturbances in effort-cost decision-making have been highlighted as a potential transdiagnostic process underpinning negative symptoms in individuals with schizophrenia. However, recent studies using computational phenotyping show that individuals employ a range of strategies to allocate effort, and use of different strategies is associated with unique clinical and cognitive characteristics. Building on prior work in schizophrenia, this study evaluated whether effort allocation strategies differed in individuals with distinct psychotic disorders.

STUDY DESIGN

We applied computational modeling to effort-cost decision-making data obtained from individuals with psychotic disorders (n = 190) who performed the Effort Expenditure for Rewards Task. The sample included 91 individuals with schizophrenia/schizoaffective disorder, 90 individuals with psychotic bipolar disorder, and 52 controls.

STUDY RESULTS

Different effort allocation strategies were observed both across and within different disorders. Relative to individuals with psychotic bipolar disorder, a greater proportion of individuals with schizophrenia/schizoaffective disorder did not use reward value or probability information to guide effort allocation. Furthermore, across disorders, different effort allocation strategies were associated with specific clinical and cognitive features. Those who did not use reward value or probability information to guide effort allocation had more severe positive and negative symptoms, and poorer cognitive and community functioning. In contrast, those who only used reward value information showed a trend toward more severe positive symptoms.

CONCLUSIONS

These findings indicate that similar deficits in effort-cost decision-making may arise from different computational mechanisms across the psychosis spectrum.

A randomized proof-of-mechanism trial of TNF antagonism for motivational anhedonia and related corticostriatal circuitry in depressed patients with high inflammation

Chronic, low-grade inflammation has been associated with motivational deficits in patients with major depression (MD). In turn, impaired motivation has been linked to poor quality of life across psychiatric disorders. We thus determined effects of the anti-inflammatory drug infliximab-a potent tumor necrosis factor (TNF) antagonist-on behavioral and neural measures of motivation in 42 medically stable, unmedicated MD patients with a C-reactive protein > 3mg/L. All patients underwent a double-blind, placebo-controlled, single-dose, randomized clinical trial with infliximab (5mg/kg) versus placebo. Behavioral performance on an effort-based decision-making task, self-report questionnaires, and neural responses during event-related functional magnetic resonance imaging were assessed at baseline and 2 weeks following infusion. We found that relative to placebo, patients receiving infliximab were more willing to expend effort for rewards. Moreover, increase in effortful choices was associated with reduced TNF signaling as indexed by decreased soluble TNF receptor type 2 (sTNFR2). Changes in effort-based decision-making and sTNFR2 were also associated with changes in task-related activity in a network of brain areas, including dmPFC, ventral striatum, and putamen, as well as the functional connectivity between these regions. Changes in sTNFR2 also mediated the relationships between drug condition and behavioral and neuroimaging measures. Finally, changes in self-reported anhedonia symptoms and effort-discounting behavior were associated with greater responses of an independently validated whole-brain predictive model (aka "neural signature") sensitive to monetary rewards. Taken together, these data support the use of anti-inflammatory treatment to improve effort-based decision-making and associated brain circuitry in depressed patients with high inflammation.

Pharmacological characterisation of the effort for reward task as a measure of motivation for reward in male mice

RATIONALE

Motivational deficits are a common symptom shared across multiple psychiatric and neurodegenerative disorders. Effort-based decision-making tasks are a translatable method for assessing motivational state. Much of the preclinical validation of the task derives from acute pharmacological manipulations in rats. However, mice currently offer a greater genetic toolkit to study risk genes and phenotypic models. Despite this, there is limited characterisation of their behaviour in this type of motivation task.

OBJECTIVES

Here, we investigate the effort for reward (EfR) task as a measure of motivational state in mice using drugs previously shown to modulate effort-based decision-making in rats and humans.

METHOD

Using male C57bl/6j mice, we test the effects of drugs which modulate DA transmission. We also test the effects of CP101-606 which does not act directly via DA modulation but has been shown to exert beneficial effects on motivational state. Finally, we test the sensitivity of the task to a chronic corticosterone (CORT) treatment.

RESULTS

Amphetamine, methylphenidate, and CP101606 in mice increased high-effort responses for high-value reward, while administration of haloperidol decreased high-effort responses. Surprisingly, tetrabenazine had no effect at the doses tested. Chronic, low-dose CORT consumption did not alter task performance.

CONCLUSION

These data suggest that the EfR task is sensitive to acute dopaminergic modulation and NR2B selective antagonism in mice. However, it may lack sensitivity to non-acute phenotypic models. Further work is required to demonstrate the utility of the task in this context.

Amphetamines Improve the Motivation to Invest Effort in Attention-Deficit/Hyperactivity Disorder

Prevailing frameworks propose that a key feature of attention-deficit/hyperactivity disorder (ADHD) is lower motivation. An important component of motivation is the willingness to engage in cognitively or physically effortful behavior. However, the degree to which effort sensitivity is impaired in ADHD has rarely been tested, and the efficacy of stimulant medication in ameliorating any such impairments is unclear. Here, we tested 20 individuals with ADHD (11 males, 9 females) who were managed with amphetamine-based medication (dexamfetamine, lisdexamfetamine), and 24 controls (8 males, 16 females). Individuals with ADHD were tested over two counterbalanced sessions, ON and OFF their usual amphetamine-based medication. In each session, participants performed an effort-based decision-making task, in which they were required to choose how much cognitive or physical effort they were willing to engage in return for reward. Our results revealed three main findings. First, individuals with ADHD had lower motivation relative to controls to invest effort in both the cognitive and physical domains. Second, amphetamine increased motivation uniformly across both domains. Finally, the net effect of amphetamine treatment was to mostly restore motivation across both domains of effort relative to healthy controls. These data provide clear evidence for a heightened sensitivity to both cognitive and physical effort in ADHD, and reveal the efficacy of amphetamine-based drugs in restoring effort sensitivity to levels similar to controls. These findings confirm the existence of reduced motivational drive in ADHD, and more broadly provide direct causal evidence for a domain-general role of catecholamines in motivating effortful behavior.SIGNIFICANCE STATEMENT A core feature of attention-deficit/hyperactivity disorder (ADHD) is thought to be a heightened aversion to effort. Surprisingly, however, the degree to which effort sensitivity is impaired in ADHD has rarely been tested. More broadly, the relative efficacy of catecholamines in motivating the investment of cognitive and physical effort is unclear. We tested 20 individuals with ADHD ON and OFF amphetamines, and compared their behavior on an effort-based decision-making task to 24 controls. When tested OFF medication, the ADHD group was less cognitively and physically motivated than controls. However, amphetamines led to a comparable increase in motivation across both domains. This demonstrates the efficacy of catecholamines in facilitating domain-general effort, and highlights the broader potential of such drugs to treat disorders of motivation.

Stress to inflammation and anhedonia: Mechanistic insights from preclinical and clinical models

Anhedonia, as evidenced by impaired pleasurable response to reward, reduced reward motivation, and/or deficits in reward-related learning, is a common feature of depression. Such deficits in reward processing are also an important clinical target as a risk factor for depression onset. Unfortunately, reward-related deficits remain difficult to treat. To address this gap and inform the development of effective prevention and treatment strategies, it is critical to understand the mechanisms that drive impairments in reward function. Stress-induced inflammation is a plausible mechanism of reward deficits. The purpose of this paper is to review evidence for two components of this psychobiological pathway: 1) the effects of stress on reward function; and 2) the effects of inflammation on reward function. Within these two areas, we draw upon preclinical and clinical models, distinguish between acute and chronic effects of stress and inflammation, and address specific domains of reward dysregulation. By addressing these contextual factors, the review reveals a nuanced literature which might be targeted for additional scientific inquiry to inform the development of precise interventions.

Dopamine Transporter Deficient Rodents: Perspectives and Limitations for Neuroscience

The key element of dopamine (DA) neurotransmission is undoubtedly DA transporter (DAT), a transmembrane protein responsible for the synaptic reuptake of the mediator. Changes in DAT's function can be a key mechanism of pathological conditions associated with hyperdopaminergia. The first strain of gene-modified rodents with a lack of DAT were created more than 25 years ago. Such animals are characterized by increased levels of striatal DA, resulting in locomotor hyperactivity, increased levels of motor stereotypes, cognitive deficits, and other behavioral abnormalities. The administration of dopaminergic and pharmacological agents affecting other neurotransmitter systems can mitigate those abnormalities. The main purpose of this review is to systematize and analyze (1) known data on the consequences of changes in DAT expression in experimental animals, (2) results of pharmacological studies in these animals, and (3) to estimate the validity of animals lacking DAT as models for discovering new treatments of DA-related disorders.

Ventral Tegmental Area M5 Muscarinic Receptors Mediate Effort-Choice Responding and Nucleus Accumbens Dopamine in a Sex-Specific Manner

Optimization of effort-related choices is impaired in depressive disorders. Acetylcholine (ACh) and dopamine (DA) are linked to depressive disorders, and modulation of ACh tone in the ventral tegmental area (VTA) affects mood-related behavioral responses in rats. However, it is unknown if VTA ACh mediates effort-choice behaviors. Using a task of effort-choice, rats can choose to lever press on a fixed-ratio 5 (FR5) schedule for a more-preferred food or consume freely available, less-preferred food. VTA administration of physostigmine (1 μg and 2 μg/side), a cholinesterase inhibitor, reduced FR5 responding for the more-preferred food while leaving consumption of the less-preferred food intact. VTA infusion of the M5 muscarinic receptor negative allosteric modulator VU6000181 (3 μM, 10 μM, 30 μM/side) did not affect lever pressing or chow consumption. However, VU6000181 (30 μM/side) coadministration with physostigmine (2 μg/side) attenuated physostigmine-induced decrease in lever pressing in female and male rats and significantly elevated lever pressing above vehicle baseline levels in male rats. In in vivo voltammetry experiments, VTA infusion of combined physostigmine and VU6000181 did not significantly alter evoked phasic DA release in the nucleus accumbens core (NAc) in female rats. In male rats, combined VTA infusion of physostigmine and VU6000181 increased phasic evoked DA release in the NAc compared with vehicle, physostigmine, or VU6000181 infusion alone. These data indicate a critical role and potential sex differences of VTA M5 receptors in mediating VTA cholinergic effects on effort choice behavior and regulation of DA release. SIGNIFICANCE STATEMENT: Effort-choice impairments are observed in depressive disorders, which are often treatment resistant to currently available thymoleptics. The role of ventral tegmental area (VTA) acetylcholine muscarinic M5 receptors, in a preclinical model of effort-choice behavior, is examined. Using the selective negative allosteric modulator of the M5 receptor VU6000181, we show the role of VTA M5 receptors on effort-choice and regulation of dopamine release in the nucleus accumbens core. This study supports M5 receptors as therapeutic targets for depression.

Reduced sensitivity but intact motivation to monetary rewards and reversal learning in obesity

BACKGROUND

Obesity has been linked to altered reward processing but little is known about which components of reward processing including motivation, sensitivity and learning are impaired in obesity. We examined whether obesity compared to healthy weight controls is associated with differences in distinct subdomains of reward processing. To this end, we used two established paradigms, namely the Effort Expenditure for Rewards task (EEfRT) and the Probabilistic Reversal Learning Task (PRLT).

METHODS

30 individuals with obesity (OBS) and 30 healthy weight control subjects (HC) were included in the study. Generalized estimating equation models were used to analyze EEfRT choice behavior. PRLT data was analyzed using both conventional behavioral variables of choices and computational models.

RESULTS

Our findings from the different tasks speak in favor of a hyposensitivity to non-food rewards in obesity. OBS did not make fewer overall hard task selections compared to HC in the EEfRT suggesting generally intact non-food reward motivation. However, in highly rewarding trials (i.e.,trials with high reward magnitude and high reward probability),OBSmadefewer hard task selections compared to normal weight subjects suggesting decreased sensitivity to highly rewarding non-food reinforcers. Hyposensitivity to non-food rewards was also evident in OBS in the PRLT as evidenced by lower win-stay probability compared to HC. Our computational modelling analyses revealed decreased stochasticity but intact reward and punishment learning rates in OBS.

CONCLUSIONS

Our findings provide evidence for intact reward motivation and learning in OBS but lower reward sensitivity which is linked to stochasticity of choices in a non-food context. These findings might provide further insight into the mechanism underlying dysfunctional choices in obesity.

Abnormal functional connectivity of the nucleus accumbens subregions mediates the association between anhedonia and major depressive disorder

BACKGROUND

The nucleus accumbens (Nac) is a crucial brain region in the pathophysiology of major depressive disorder (MDD) patients with anhedonia. However, the relationship between the functional imaging characteristics of Nac subregions and anhedonia remains unclear. Thus, this study aimed to investigate the role of resting-state functional connectivity (rsFC) of the Nac subregions between MDD and anhedonia.

METHODS

We performed resting-state functional magnetic resonance imaging (fMRI) to measure the rsFC of Nac subregions in 55 MDD patients and 30 healthy controls (HCs). A two-sample t test was performed to determine the brain regions with varying rsFC among Nac subregions between groups. Then, correlation analyses were carried out to investigate the relationships between the aberrant rsFC of Nac subregions and the severity of anhedonia. Furthermore, we constructed a mediation model to explain the role of the aberrant rsFC of Nac subregions between MDD and the severity of anhedonia.

RESULTS

Compared with the HC group, decreased rsFC of Nac subregions with regions of the prefrontal cortex, insula, lingual gyrus, and visual association cortex was observed in MDD patients. In the MDD group, the rsFC of the right Nac shell-like subregions with the middle frontal gyrus (MFG)/superior frontal gyrus (SFG) was correlated with consummatory anhedonia, and the rsFC of the Nac core-like subdivisions with the inferior frontal gyrus (IFG)/insula and lingual gyrus/visual association cortex was correlated with anticipatory anhedonia. More importantly, the functional alterations in the Nac subregions mediated the association between anhedonia and depression.

CONCLUSIONS

The present findings suggest that the functional alteration of the Nac subregions mediates the association between MDD and anhedonia, which provides evidence for the hypothesis that MDD patients have neurobiological underpinnings of reward systems that differ from those of HCs.

Development of cross-species translational paradigms for psychiatric research in the Research Domain Criteria era

The past 30 years of IBNS has included research attempting to treat the cognitive and behavioral deficits observed in people with psychiatric conditions. Early work utilized drugs identified from tests thought to be cognition-relevant, however the high failure rate crossing the translational-species barrier led to focus on developing valid cross-species translational tests. The face, predictive, and neurobiological validities used to assess animal models of psychiatry can be used to validate these tests. Clinical sensitivity is another important aspect however, for if the clinical population targeted for treatment does not exhibit task deficits, then why develop treatments? This review covers some work validating cross-species translational tests and suggests future directions. Also covered is the contribution IBNS made to fostering such research and my role in IBNS, making it more available to all including fostering mentor/mentee programs plus spearheading diversity and inclusivity initiatives. All science needs support and IBNS has supported research recreating the behavioral abnormalities that define psychiatric conditions with the aim to improve the lives of people with such conditions.

Accumbal adenosine A2A receptor inactivation biases for large and costly rewards in the effort- but not delay-based decision making

The cost-benefit decision-making (CBDM) is critical to normal human activity and a diminished willingness to expend effort to obtain rewards is a prevalent/noted characteristic of neuropsychiatric disorders such as schizophrenia, Parkinson's disease. Numerous studies have identified nucleus accumbens (NAc) as an important locus for CBDM control but their neuromodulatory and behavioral mechanisms remain largely under-explored. Adenosine A_2A receptors (A_2ARs), which are highly concentrated in the striatopallidal neurons, can integrate glutamate and dopamine signals for controlling effort-related choice behaviors. While the involvement of A_2ARs in effort-based decision making is well documented, the role of other decision variables (reward discrimination) in effort-based decision making and the role of A_2AR in delay-based decision making are less clear. In this study, we have developed a well-controlled CBDM behavioral paradigm to manipulate effort/cost and reward independently or in combination, allowing a dissection of four behavioral elements: effort-based CBDM (E-CBDM), delay-based CBDM (D-CBDM), reward discrimination (RD), effort discrimination (ED), and determined the effect of genetic knockdown (KD) of NAc A_2AR on the four behavioral elements. We found that A_2AR KD in NAc increased the choice for larger, more costly reward in the E-CBDM, but not D-CBDM. Furthermore, this high-effort/high-reward bias was attributable to the increased willingness to engage in effort but not the effect of discrimination of reward magnitude. Our findings substantiate an important role of the NAc A_2AR in control of E-CBDM and support that pharmacologically targeting NAc A_2ARs would be a useful strategy for treating the aberrant effort-based decision making in neuropsychiatric disorders.

Back to the Future of Neuropsychopharmacology

Disappointments in translating preclinical findings into clinical efficacy have triggered a number of changes in neuroscience drug discovery ranging from investments diverted to other therapeutic areas to reduced reliance on efficacy claims derived from preclinical models. In this chapter, we argue that there are several existing examples that teach us on what needs to be done to improve the success rate. We advocate the reverse engineering approach that shifts the focus from preclinical efforts to "model" human disease states to pharmacodynamic activity as a common denominator in the journey to translate clinically validated phenomena to preclinical level and then back to humans. Combined with the research rigor, openness, and transparency, this reverse engineering approach is well set to bring new effective and safe medications to patients in need.

Increased Inflammation and Treatment of Depression: From Resistance to Reuse, Repurposing, and Redesign

Based on mounting clinical and translational evidence demonstrating the impact of exogenously administered inflammatory stimuli on the brain and behavior, increased endogenous inflammation has received attention as one pathophysiologic process contributing to psychiatric illnesses and particularly depression. Increased endogenous inflammation is observed in a significant proportion of depressed patients and has been associated with reduced responsiveness to standard antidepressant therapies. This chapter presents recent evidence that inflammation affects neurotransmitters and neurocircuits to contribute to specific depressive symptoms including anhedonia, motor slowing, and anxiety, which may preferentially improve after anti-cytokine therapies in patients with evidence of increased inflammation. Existing and novel pharmacological strategies that target inflammation or its downstream effects on the brain and behavior will be discussed in the context of a need for intelligent trial design in order to meaningfully translate these concepts and develop more precise therapies for depressed patients with increased inflammation.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

Pharmacological investigations of effort-based decision-making in humans: Naltrexone and nicotine

Many mental health disorders are characterized by an impaired ability, or willingness, to exert effort to obtain rewards. This impairment is modeled in effort-based decision tasks, and neuropharmacological studies implicate dopamine in this process. However, other transmitter systems such as opioidergic and cholinergic systems have received less attention. Here, in two separate studies we tested the acute effects of naltrexone and nicotine on effort-based decision-making in healthy adults. In Study 1, we compared naltrexone (50mg and 25mg) to placebo, and in Study 2, a pilot study, we compared nicotine (7mg) to placebo. In both studies, participants completed the Effort Expenditure for Rewards Task (EEfRT), which measured effort-based decision-making related to monetary rewards. Although subjects expended greater effort for larger reward magnitude and when there was a higher probability of receiving the reward, neither naltrexone nor nicotine affected willingness to exert effort for monetary rewards. Although the drugs produced significant and typical drug effects on measures of mood and behavior, they did not alter effort-based decision-making. This has implications both for the clinical use of these drugs, as well as for understanding the neuropharmacology of effort-related behavior.

Functional connectivity in reward circuitry and symptoms of anhedonia as therapeutic targets in depression with high inflammation: evidence from a dopamine challenge study

Increased inflammation in major depressive disorder (MDD) has been associated with low functional connectivity (FC) in corticostriatal reward circuits and symptoms of anhedonia, relationships which may involve the impact of inflammation on synthesis and release of dopamine. To test this hypothesis while establishing a platform to examine target engagement of potential therapies in patients with increased inflammation, medically stable unmedicated adult MDD outpatients enrolled to have a range of inflammation (as indexed by plasma C-reactive protein [CRP] levels) were studied at two visits involving acute challenge with the dopamine precursor levodopa (L-DOPA; 250 mg) and placebo (double-blind, randomized order ~1-week apart). The primary outcome of resting-state (rs)FC in a classic ventral striatum to ventromedial prefrontal cortex reward circuit was calculated using a targeted, a priori approach. Data available both pre- and post-challenge (n = 31/40) established stability of rsFC across visits and determined CRP > 2 mg/L as a cut-point for patients exhibiting positive FC responses (post minus pre) to L-DOPA versus placebo (p < 0.01). Higher post-L-DOPA FC in patients with CRP > 2 mg/L was confirmed in all patients (n = 40) where rsFC data were available post-challenge (B = 0.15, p = 0.006), and in those with task-based (tb)FC during reward anticipation (B = 0.15, p = 0.013). While effort-based motivation outside the scanner positively correlated with rsFC independent of treatment or CRP, change in anhedonia scores negatively correlated with rsFC after L-DOPA only in patients with CRP > 2 mg/L (r = -0.56, p = 0.012). FC in reward circuitry should be further validated in larger samples as a biomarker of target engagement for potential treatments including dopaminergic agents in MDD patients with increased inflammation.

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Shared and distinct reward neural mechanisms among patients with schizophrenia, major depressive disorder, and bipolar disorder: an effort-based functional imaging study

Unwillingness to exert effort for rewards has been found in patients with schizophrenia (SCZ), major depressive disorder (MDD), and bipolar disorder (BD), but the underlying shared and distinct reward neural mechanisms remain unclear. This study aimed to compare the neural correlates of such impairments across different diagnoses. The neural responses in an effort-expenditure for reward task (EEfRT) were assessed in 20 SCZ patients, 23 MDD patients, 17 BD patients, and 30 healthy controls (HC). The results found shared activation in the cingulate gyrus, the medial frontal gyrus, and the middle frontal gyrus during the EEfRT administration. Compared to HC, SCZ patients exhibited stronger variations of functional connectivity between the right caudate and the left amygdala, the left hippocampus and the left putamen, with increase in reward magnitude. In MDD patients, an enhanced activation compared to HC in the right superior temporal gyrus was found with the increase of reward magnitude. The variations of functional connectivity between the caudate and the right cingulate gyrus, the left postcentral gyrus and the left inferior parietal lobule with increase in reward magnitude were weaker than that found in HC. In BD patients, the degree of activation in the left precuneus was increased, but that in the left dorsolateral prefrontal cortex was decreased with increase in reward probability compared to HC. These findings demonstrate both shared and distinct reward neural mechanisms associated with EEfRT in patients with SCZ, MDD, and BD, implicating potential intervention targets to alleviate amotivation in these clinical disorders.

Cholinergic and dopaminergic-mediated motivated behavior in healthy states and in substance use and mood disorders

Acetylcholine is an important neuromodulator of the mesolimbic dopamine (DA) system, which itself is a mediator of motivated behavior. Motivated behavior can be described by two primary components, termed directional and activational motivation, both of which can be examined and dissociated using effort-choice tasks. The directional component refers to motivated behavior directed towards reinforcing stimuli and away from aversive stimuli. Behaviors characterized by increased vigor, persistence, and work output are considered to reflect activational components of motivation. Disruption of DA signaling has been shown to decrease activational components of motivation, while leaving directional features intact. Facilitation of DA release promotes the activational aspects of motivated behavior. In this review, we discuss cholinergic and DA regulation of motivated behaviors. We place emphasis on effort-choice processes and the ability of effort-choice tasks to examine and dissociate changes of motivated behavior in the context of substance use and mood disorders. Furthermore, we consider how altered cholinergic transmission impacts motivated behavior across disease states, and the possible role of cholinergic dysregulation in the etiology of these illnesses. Finally, we suggest that treatments targeting cholinergic activity may be useful in ameliorating motivational disruptions associated with substance use and comorbid substance use and mood disorders.

Progress and challenges in research of the mechanisms of anhedonia in major depressive disorder

There is an increasing heavy disease burden of major depressive disorder (MDD) globally. Both high diagnostic heterogeneity and complicated pathological mechanisms of MDD pose significant challenges. There is much evidence to support anhedonia as a core feature of MDD. In the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, anhedonia is further emphasised as a key item in the diagnosis of major depression with melancholic features. Anhedonia is a multifaceted symptom that includes deficits in various aspects of reward processing, such as anticipatory anhedonia, consummatory anhedonia, and decision-making anhedonia. Anhedonia is expected to become an important clinicopathological sign for predicting the treatment outcome of MDD and assisting clinical decision making. However, the precise neurobiological mechanisms of anhedonia in MDD are not clearly understood. In this paper, we reviewed (1) the current understanding of the link between anhedonia and MDD; (2) the biological basis of the pathological mechanism of anhedonia in MDD; and (3) challenges in research on the pathological mechanisms of anhedonia in MDD. A more in-depth understanding of anhedonia associated with MDD will improve the diagnosis, prediction, and treatment of patients with MDD in the future.

Inflammation as a Pathophysiologic Pathway to Anhedonia: Mechanisms and Therapeutic Implications

Anhedonia, characterized by a lack of motivation, interest, or ability to experience pleasure, is a prominent symptom of depression and other psychiatric disorders and has been associated with poor response to standard therapies. One pathophysiologic pathway receiving increased attention for its potential role in anhedonia is inflammation and its effects on the brain. Exogenous administration of inflammatory stimuli to humans and laboratory animals has reliably been found to affect neurotransmitters and neurocircuits involved in reward processing, including the ventral striatum and ventromedial prefrontal cortex, in association with reduced motivation. Moreover, a rich literature including meta-analyses describes increased inflammation in a significant proportion of patients with depression and other psychiatric illnesses involving anhedonia, as evident by elevated inflammatory cytokines, acute phase proteins, chemokines, and adhesion molecules in both the periphery and central nervous system. This endogenous inflammation may arise from numerous sources including stress, obesity or metabolic dysfunction, genetics, and lifestyle factors, many of which are also risk factors for psychiatric illness. Consistent with laboratory studies involving exogenous administration of peripheral inflammatory stimuli, neuroimaging studies have further confirmed that increased endogenous inflammation in depression is associated with decreased activation of and reduced functional connectivity within reward circuits involving ventral striatum and ventromedial prefrontal cortex in association with anhedonia. Here, we review recent evidence of relationships between inflammation and anhedonia, while highlighting translational and mechanistic work describing the impact of inflammation on synthesis, release, and reuptake of neurotransmitters like dopamine and glutamate that affects circuits to drive motivational deficits. We will then present insight into novel pharmacological strategies that target either inflammation or its downstream effects on the brain and behavior. The meaningful translation of these concepts through appropriately designed trials targeting therapies for psychiatric patients with high inflammation and transdiagnostic symptoms of anhedonia is also discussed.

Delta-9-tetrahydrocannabinol reduces willingness to exert effort in women

BACKGROUND

The use of cannabis has been clinically associated with decreased motivation to engage in normally rewarding activities. However, evidence from previous controlled studies is mixed.

METHOD

In this study, we examined the effects of acute delta-9-tetrahydrocannabinol (THC) versus placebo on a task measuring willingness to exert effort for rewards. This is a secondary analysis of a larger study examining interactions between ovarian hormones and THC. In this within-subjects study, oral THC and placebo were administered under double-blind conditions in counterbalanced order to healthy young adult (M age = 24 years) women with previous cannabis experience who were not regular users. Forty subjects completed three 4-h sessions with PL, 7.5 and 15 mg THC, while an additional 18 completed only PL and 15 mg THC sessions (design abridged due to pandemic). At each session, they completed a task consisting of making repeated choices between a hard and an easy task, which were worth varying amounts of money at varying probabilities.

RESULTS

THC dose-dependently decreased hard task choices (drug effect, b =  - 0.79, SE = 0.29, z =  - 2.67, p < 0.01), especially at moderate to high expected values of reward (drug × probability × amount interaction, b = 0.77, SE = 0.38, z = 1.99, p = 0.04). THC also slowed task performance (drug effect, b = 0.01, SE = 0.005, t(5.24) = 2.11, p = 0.04), but the effect of THC on choice was still significant after controlling for this psychomotor slowing.

CONCLUSIONS

These findings support the idea that cannabis acutely reduces motivation to earn non-drug rewards. Still to be determined are the neurochemical mechanisms underlying this effect.

The neural basis of effort valuation: A meta-analysis of functional magnetic resonance imaging studies

Choosing how much effort to expend is critical for everyday decisions. While several neuroimaging studies have examined effort-based decision-making, results have been highly heterogeneous, leaving unclear which brain regions process effort-related costs and integrate them with rewards. We conducted two meta-analyses of functional magnetic resonance imaging data to examine consistent neural correlates of effort demands (23 studies, 15 maps, 549 participants) and net value (15 studies, 11 maps, 428 participants). The pre-supplementary motor area (pre-SMA) scaled positively with pure effort demand, whereas the ventromedial prefrontal cortex (vmPFC) showed the opposite effect. Moreover, regions that have been previously implicated in value integration in other cost domains, such as the vmPFC and ventral striatum, were consistently involved in signaling net value. The opposite response patterns of the pre-SMA and vmPFC imply that they are differentially involved in the representation of effort costs and value integration. These findings provide conclusive evidence that the vmPFC is a central node for net value computation and reveal potential brain targets to treat motivation-related disorders.

Acute drug effects differentially predict desire to take dextroamphetamine again for work and recreation

RATIONALE

Misuse of dextroamphetamine occurs in work and recreational contexts. While acute drug effects broadly predict abuse liability, few studies have considered the relationship between acute effects and context.

OBJECTIVES

This study examined how individual differences in acute effects of dextroamphetamine relate to desire to take dextroamphetamine again in different contexts.

METHODS

This secondary analysis used data from healthy adults with no history of moderate-to-severe substance use disorder, who received oral doses of placebo and dextroamphetamine (10 and 20 mg) over 3 sessions under double-blind, randomized conditions. Subjects rated subjective effects and completed reward-related behavioral tasks. Subjects rated their desire to take dextroamphetamine again in hypothetical work and recreational contexts. Multilevel models examined within-subjects change scores (10 mg-placebo; 20 mg-placebo) to determine how subjective effects and behavioral outcomes predicted desire to take dextroamphetamine again for work versus recreation.

RESULTS

Subjects reported more desire to take 20 mg dextroamphetamine again for work than for recreation. At 20 mg, there was an interaction between context and liking/wanting, such that liking/wanting predicted desire to use dextroamphetamine for work only. There was also an interaction at 20 mg between context and psychomotor speed, such that psychomotor speed predicted interest in using dextroamphetamine for recreation only.

CONCLUSIONS

We found that positive subjective effects predicted desire to use dextroamphetamine again for work, while increased motor effects predicted desire to use dextroamphetamine recreationally. Hedonic effects may be perceived as advantageous when working, while increased physical energy may be preferred during recreation, suggesting that context of intended use is important when examining abuse liability.