Differential modulation of cognitive control networks by monetary reward and punishment

Motivational context determines the impact of aversive outcomes on mental effort allocation

It is well known that people will exert effort on a task if sufficiently motivated, but how they distribute these efforts across different strategies (e.g., efficiency vs. caution) remains uncertain. Past work has shown that people invest effort differently for potential positive outcomes (rewards) versus potential negative outcomes (penalties). However, this research failed to account for differences in the context in which negative outcomes motivate someone - either as punishment or reinforcement. It is therefore unclear whether effort profiles differ as a function of outcome valence, motivational context, or both. Using computational modeling and our novel Multi-Incentive Control Task, we show that the influence of aversive outcomes on one's effort profile is entirely determined by their motivational context. Participants (N:91) favored increased caution in response to larger penalties for incorrect responses, and favored increased efficiency in response to larger reinforcement for correct responses, whether positively or negatively incentivized.

Aggressive and psychopathic traits are linked to the acquisition of stable but imprecise hostile expectations

Individuals with hostile expectations (HEX) anticipate harm from seemingly neutral or ambiguous stimuli. However, it is unclear how HEX are acquired, and whether specific components of HEX learning can predict antisocial thought, conduct, and personality. In an online sample of healthy young individuals (n = 256, 69% women), we administered a virtual shooting task and applied computational modelling of behaviour to investigate HEX learning and its constellation of correlates. HEX acquisition was best explained by a hierarchical reinforcement learning mechanism. Crucially, we found that individuals with relatively higher self-reported aggressiveness and psychopathy developed stronger and less accurate hostile beliefs as well as larger prediction errors. Moreover, aggressive and psychopathic traits were associated with more temporally stable hostility representations. Our study thus shows that aggressiveness and psychopathy are linked with the acquisition of robust yet imprecise hostile beliefs through reinforcement learning.

The selective use of punishments on congruent versus incongruent trials in the Stroop task

Conflict adaptation refers to the dynamic modulation of conflict processing across successive trials and reflects improved cognitive control. Interestingly, aversive motivation can increase conflict adaptation, although it remains unclear through which process this modulation occurs because previous studies presented punishment feedback following suboptimal performance on both congruent and incongruent trials. According to integrative accounts of conflict monitoring and aversive motivation in the dorsal anterior cingulate cortex, punishment feedback following slow or erroneous performance on incongruent trials in particular should lead to improved conflict adaptation. Second, selectively increasing motivation on incongruent trials should reduce the overall congruency effect. The current study sought to test both hypotheses. Specifically, we administered the confound-minimized Stroop task to a large group of participants and manipulated the position of feedback (following either congruent or incongruent trials) and aversive motivation (tied to a monetary loss or not) across different blocks. As expected, the congruency effect was found to be smaller when punishment was coupled with incongruent versus congruent trials. However, results showed that conflict adaptation was increased when punishment feedback was selectively coupled with congruent rather than incongruent trials. Together, these results suggest that aversive motivation does not uniformly improve cognitive control but this gain appears to be context dependent.

Developmental differences in processing the valence and magnitude of incentive cues: Mid-adolescents are more sensitive to potential gains than early- or late-adolescents

Recent research has focused on the interaction between motivation and cognitive control and shown that both are important for goal-directed behavior. There also is evidence for developmental differences in the sensitivity and behavioral effectiveness of incentives, showing that mid-adolescents might be especially susceptible to rewards. Further pursuing this line of research, the present study examined developmental differences in incentive processing and whether these potential differences also would correspond to changes in cognitive control. We compared the processing of high and low potential gains and losses in early-, mid-, and late adolescents by means of event-related potentials (ERPs) and examined whether these incentives also led to specific performance differences in task-switching. We expected that potential gains compared to potential losses and high compared to low incentives would lead to more preparatory updating as reflected in the P3b and consequently to better task performance and smaller global and local switch costs as indicators of cognitive control in all age groups. Furthermore, we expected that mid-adolescents should be especially sensitive to high gains and thus show the most pronounced enhancements in task performance and global and local switch costs in trials with high gains, respectively. Our results corroborate the idea of a special sensitivity to high rewards during mid-adolescence. The analysis of ERPs showed age-related differences in the processing of incentive cues that also varied with cognitive control demands. However, the different incentives did not impact age-related differences in indices of cognitive control, but had a general effect on response speed.

Functional activation of insula and dorsal anterior cingulate for conflict control against larger monetary loss in young adults with subthreshold depression: a preliminary study

Subthreshold depression (StD) is associated with higher risk of later developing major depressive disorder (MDD). Deficits of goal-directed behaviors regarding the motional, motivational, and conflict control are found in MDD. The current study examined neural underpinning of conflict control against monetary punishment in StD compared to MDD and healthy controls (HC). Seventy-one participants (HC, n = 27; StD, n = 21; MDD, n = 23) in their mid-20's completed self-reports. Preprocessing of functional magnetic resonance imaging acquired for the Simon task against larger or smaller monetary punishment was conducted using ENIGMA HALFpipe version 1.2.1. Neural correlates of conflict control against monetary punishment that could vary with either diagnosis or PHQ-9 total score were examined using a general linear model of FSL. Simon effect was effective for reaction time and accuracy in every subgroup of diagnosis and regardless of the size of monetary punishment. Conflict control against larger monetary loss was associated with higher functional activation of left insula in StD than HC and MDD. StD showed lower functional activation of left dorsal anterior cingulate (dACC) than MDD for conflict control against larger monetary loss. For conflict control against smaller monetary loss, StD demonstrated higher functional activation of left paracentral lobule and right putamen compared to HC. Directed acyclic graphs showed directional associations from suicidal ideation, sadness, and concentration difficulty to functional activation of paracentral lobule, ventromedial prefrontal cortex (vmPFC), and thalamus for conflict control against monetary loss. Differential functional activation of insula and dACC for conflict control against larger monetary loss could be a brain phenotype of StD. Item-level depressive symptoms of suicidal ideation, sadness, and concentration difficulty could be reflected in the conflict control-related functional activation of paracentral lobule (against smaller monetary loss), vmPFC and thalamus (against larger monetary loss), respectively.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Motivated semantic control: Exploring the effects of extrinsic reward and self-reference on semantic retrieval in semantic aphasia

Recent insights show that increased motivation can benefit executive control, but this effect has not been explored in relation to semantic cognition. Patients with deficits of controlled semantic retrieval in the context of semantic aphasia (SA) after stroke may benefit from this approach since ‘semantic control’ is considered an executive process. Deficits in this domain are partially distinct from the domain‐general deficits of cognitive control. We assessed the effect of both extrinsic and intrinsic motivation in healthy controls and SA patients. Experiment 1 manipulated extrinsic reward using high or low levels of points for correct responses during a semantic association task. Experiment 2 manipulated the intrinsic value of items using self‐reference, allocating pictures of items to the participant (‘self’) or researcher (‘other’) in a shopping game before participants retrieved their semantic associations. These experiments revealed that patients, but not controls, showed better performance when given an extrinsic reward, consistent with the view that increased external motivation may help ameliorate patients’ semantic control deficits. However, while self‐reference was associated with better episodic memory, there was no effect on semantic retrieval. We conclude that semantic control deficits can be reduced when extrinsic rewards are anticipated; this enhanced motivational state is expected to support proactive control, for example, through the maintenance of task representations. It may be possible to harness this modulatory impact of reward to combat the control demands of semantic tasks in SA patients.

Dissociable influences of reward and punishment on adaptive cognitive control

To invest effort into any cognitive task, people must be sufficiently motivated. Whereas prior research has focused primarily on how the cognitive control required to complete these tasks is motivated by the potential rewards for success, it is also known that control investment can be equally motivated by the potential negative consequence for failure. Previous theoretical and experimental work has yet to examine how positive and negative incentives differentially influence the manner and intensity with which people allocate control. Here, we develop and test a normative model of control allocation under conditions of varying positive and negative performance incentives. Our model predicts, and our empirical findings confirm, that rewards for success and punishment for failure should differentially influence adjustments to the evidence accumulation rate versus response threshold, respectively. This dissociation further enabled us to infer how motivated a given person was by the consequences of success versus failure.

Effective connectivity underlying reward-based executive control

Motivational influences on cognitive control play an important role in shaping human behavior. Cognitive facilitation through motivators such as prospective reward or punishment is thought to depend on regions from the dopaminergic mesocortical network, primarily the ventral tegmental area (VTA), inferior frontal junction (IFJ), and anterior cingulate cortex (ACC). However, how interactions between these regions relate to motivated control remains elusive. In the present functional magnetic resonance imaging study, we used dynamic causal modeling (DCM) to investigate effective connectivity between left IFJ, ACC, and VTA in a task-switching paradigm comprising three distinct motivational conditions (prospective monetary reward or punishment and a control condition). We found that while prospective punishment significantly facilitated switching between tasks on a behavioral level, interactions between IFJ, ACC, and VTA were characterized by modulations through prospective reward but not punishment. Our DCM results show that IFJ and VTA modulate ACC activity in parallel rather than by interaction to serve task demands in reward-based cognitive control. Our findings further demonstrate that prospective reward and punishment differentially affect neural control mechanisms to initiate decision-making.

Decomposing the motivation to exert mental effort

Achieving most goals demands cognitive control, yet people vary widely in their success at meeting these demands. While motivation is known to be fundamental to determining these successes, what determines one's motivation to perform a given task remains poorly understood. Here, we describe recent efforts towards addressing this question using the Expected Value of Control model, which simulates the process by which people weigh the costs and benefits of exerting mental effort. By functionally decomposing this cost-benefit analysis, this model has been used to fill gaps in our understanding of the mechanisms of mental effort and to generate novel predictions about the sources of variability in real-world performance. We discuss the opportunities the model provides for formalizing hypotheses about why people vary in their motivation to perform tasks, as well as for understanding limitations in our ability to test these hypotheses based on a given measure of performance.

Revisiting positive affect and reward influences on cognitive control

Modulation of cognitive control by emotion and motivation has become a major topic in cognition research; however, characterizing the extent to which these influences may dissociate has proved challenging. Here, I examine recent advances in this literature, focusing on: (1) neuromodulator mechanisms underlying positive affect and reward motivation effects on cognitive control; (2) contingency and associative learning in interactions between affect/reward and cognitive control; (3) aspects of task design, unrelated to affect/reward, that may have acted as confounding influences on cognitive control in prior work. I suggest that positive affect and reward should not be considered singular in their effects on cognitive control, but instead varying on multiple parameters and interacting with task demands, to determine goal-directed, adaptive behavior.

Improving Debt Literacy by 2/3 Through Four Simple Infographics Requires Numeracy and Not Focusing on Negatives of Debt

Borrowing behavior may be more resistant to formal educational treatments than other financial behaviors. In order to study the process and results of infographics-based debt education, we used eye tracking technology (SMI RED 500 Hz) to monitor the oculomotor behavior of 108 participants (68 females) aged 18 to 60 who were shown 4 infographics. The study used an experimental design with repeated measures and an internal comparison group. We also used scales of debt literacy and a set of information literacy scales: numerical, graph, and linguistic. The results confirm that short-term infographics-based debt education can improve debt literacy significantly. The difference in processing the educational contents that were not known to participants before the educational session suggests that participants with better information literacy make more considerable debt literacy progress. Specifically, we found that numerical literacy is a significant mediator of debt education results, depending on the initial level of debt literacy; this relation is moderated by the focus of visual attention on negatives of debt. We found no significant relationship between debt literacy education results and those of graph and linguistic literacy.

The role of the vestibular system in value attribution to positive and negative reinforcers

Somatic inputs originating from bioregulatory processes can guide cognition and behavior. One such bodily signal, mostly overlooked so far, is represented by visuo-vestibular coupling and its alteration, which in extreme cases may result in motion sickness. We argued that the inherently perturbed interoceptive state that follows can be a powerful determinant of human motivated behavior, resulting in a blunted response to appetitive stimuli and an exaggerated response to noxious ones. We sought to assess such differential impact of visuo-vestibular mismatches on value through a task involving conflict monitoring. We therefore administered to 42 healthy participants a modified version of the Flankers task, in which distractors (arrows, pointing in either a congruent or incongruent direction) signaled the availability of monetary incentives (gains, losses, or neutral trials). While performing the task, participants received either galvanic vestibular stimulation (GVS), or sham stimulation. We have found impaired behavioral performances when value, which was attached to task-irrelevant information, was at stake. Gains and losses, interestingly, dissociated, and only the latter caused enhanced interference costs in the task, suggesting that negative incentives may be more effective in capturing human attention than positive ones. Finally, we have found some weak evidence for GVS to further increase the processing of losses, as suggested by even larger interference costs in this condition. Results were, however, overall ambiguous, and suggest that much more research is needed to better understand the link between the vestibular system and motivation.

Incentive-driven decision-making networks in de novo and drug-treated Parkinson's disease patients with impulsive-compulsive behaviors: A systematic review of neuroimaging studies

BACKGROUND

In Parkinson's disease (PD), impulsive-compulsive behaviors (ICBs) may develop as side-effect of dopaminergic medications. Abnormal incentive-driven decision-making, which is supported by the cognitive control and motivation interaction, may represent an ICBs signature. This systematic review explored whether structural and/or functional brain differences between PD patients with vs without ICBs encompass incentive-driven decision-making networks.

METHODS

Structural and functional neuroimaging studies comparing PD patients with and without ICBs, either de novo or medicated, were included.

RESULTS

Thirty articles were identified. No consistent evidence of structural alteration both in de novo and medicated PD patients were found. Differences in connectivity within the default mode, the salience and the central executive networks predate ICBs development and remain stable once ICBs are fully developed. Medicated PD patients with ICBs show increased metabolism and cerebral blood flow in orbitofrontal and cingulate cortices, ventral striatum, amygdala, insula, temporal and supramarginal gyri. Abnormal ventral striatum connectivity with anterior cingulate cortex and limbic structures was reported in PD patients with ICBs.

DISCUSSION

Functional brain signatures of ICBs in PD encompass areas involved in cognitive control and motivational encoding networks of the incentive-driven decision-making. Functional alterations predating ICBs may be related to abnormal synaptic plasticity in these networks.

Losing Money and Motivation: Effects of Loss Incentives on Motivation and Metacognition in Younger and Older Adults

Incentives are usually expected to increase motivation and cognitive control and to thereby improve performance. A small but growing number of studies have begun to investigate whether the effects of incentive on cognitive performance differ for younger vs. older adults. Most have used attention and cognitive control paradigms, trial-wise implementation of incentive condition, and gain incentives (reward), with only a very few investigating the effects of loss incentives. The present study takes a complementary approach: We tested younger and older adults in a working memory paradigm with loss incentives implemented session-wide (between subjects). We also included self-report measures to ask how loss incentive affected participants’ perceptions of the mental demand of the task, as well as their perceived effort, frustration, motivation, distraction, and metacognitive judgments of how well they had performed. This allowed us to test the disparate predictions of different theoretical views: the intuitive hypothesis that incentive should increase motivation and performance, the motivational shift proposal that older adults are especially motivated to avoid losses (Freund and Ebner, 2005), a heuristic “positivity effect” perspective that older adults ignore losses (Brassen et al., 2012; Williams et al., 2017), and a more nuanced view that suggests that when negative information is unavoidable and increases perceived costs, older adults may instead disengage from the situation (Charles, 2010; Hess, 2014). The results seemed most consistent with the more nuanced view of the positivity effect. While neither group showed incentive-related performance differences, both younger and older adults reported greater perceived demand and frustration under loss incentive, especially in the most challenging conditions. Loss incentive increased the accuracy of immediate metacognitive judgments, but reduced the accuracy of later, more global judgments of competency for older adults. Self-report measures suggested that the loss incentive manipulation was distracting to young adults and demotivating for older adults. The results suggest a need for caution in generalizing from existing studies to everyday life, and that additional studies parameterizing critical aspects of task design and incentive manipulation are needed to fully understand how incentives affect cognition and motivation in younger and older adults.

Losses Motivate Cognitive Effort More Than Gains in Effort-Based Decision Making and Performance

Human behavior is more strongly driven by the motivation to avoid losses than to pursue gains (loss aversion). However, there is little research on how losses influence the motivation to exert effort. We compared the effects of loss and gain incentives on cognitive task performance and effort-based decision making. In three experiments, participants performed a cognitively effortful task under gain and loss conditions and made choices about effort expenditure in a decision-making task. Results consistently showed significant loss aversion in effort-based decision making. Participants were willing to invest more effort in the loss compared to the gain condition (i.e., perform a longer duration task: Experiments 1 and 2; or higher task load: Experiment 3). On the other hand, losses did not lead to improved performance (sustained attention), or higher physiological effort (pupil diameter) in Experiments 1 and 2. In Experiment 3, losses did enhance working memory performance, but only at the highest load level. Taken together, these results suggest that loss aversion motivates higher effort investment in effort-based decision-making, while the effect of loss aversion during a performance may depend on the task type or effort level.

Craving and Cue Reactivity in Nicotine-Dependent Tobacco Smokers Is Associated With Different Insula Networks

BACKGROUND

The insula has a well-established role in nicotine dependence and is a node of the salience network, which integrates internal and external information to guide behavior. Recent findings reveal that internal and external processing occurs in the ventral anterior insula (vAI) and dorsal anterior insula (dAI), respectively. Whether vAI/dAI network connectivity differentially reflects internally generated craving and externally triggered smoking cue reactivity was tested.

METHODS

Thirty-six male and female nicotine-dependent individuals smoked 1 hour before functional magnetic resonance imaging. Baseline craving was measured, followed by resting-state and smoking cue reactivity scans and then another assessment of craving. Craving and cue reactivity interactions were measured by focusing on specific nodes of the salience network: the vAI/dAI and anterior cingulate cortex.

RESULTS

Resting-state vAI/dAI networks overlapped with the prototypical salience network, yet they possessed distinct patterns, linking the vAI with nodes of the internally focused default mode network and the dAI with nodes of the external, goal-related frontoparietal network. Internally generated baseline craving was associated with enhanced vAI connectivity, whereas rostral anterior cingulate cortex reactivity to external smoking cues was associated with greater dAI connectivity. We also found that cue reactivity in the rostral anterior cingulate cortex was associated with a rise in subjective cue-induced craving, whereas baseline subjective craving did not influence brain cue reactivity.

CONCLUSIONS

These data show that brain reactivity to smoking cues is associated with a subsequent increase in craving. In addition, separate insula networks have a role in an individual's vulnerability to internally related craving and externally triggered cue reactivity, which could guide the development of new, neurobiologically targeted therapies.