Dissociable corticostriatal circuits underlie goal-directed vs. cue-elicited habitual food seeking after satiation: evidence from a multimodal MRI study

Cortico-striatal white-matter connectivity underlies the ability to exert goal-directed control

The balance between goal-directed and habitual control has been proposed to determine the flexibility of instrumental behaviour, in both humans and animals. This view is supported by neuroscientific studies that have implicated dissociable neural pathways in the ability to flexibly adjust behaviour when outcome values change. A previous Diffusion Tensor Imaging study provided preliminary evidence that flexible instrumental performance depends on the strength of parallel cortico-striatal white-matter pathways previously implicated in goal-directed and habitual control. Specifically, estimated white-matter strength between caudate and ventromedial prefrontal cortex correlated positively with behavioural flexibility, and posterior putamen-premotor cortex connectivity correlated negatively, in line with the notion that these pathways compete for control. However, the sample size of the original study was limited, and so far, there have been no attempts to replicate these findings. In the present study, we aimed to conceptually replicate these findings by testing a large sample of 205 young adults to relate cortico-striatal connectivity to performance on the slips-of-action task. In short, we found only positive neural correlates of goal-directed performance, including striatal connectivity (caudate and anterior putamen) with the dorsolateral prefrontal cortex. However, we failed to provide converging evidence for the existence of a neural habit system that puts limits on the capacity for flexible, goal-directed action. We discuss the implications of our findings for dual-process theories of instrumental action.

Action control and selection in social disinhibition following severe TBI: a pavlovian-to-instrumental transfer and outcome devaluation study

INTRODUCTION

Social disinhibition is a significant sequela of severe traumatic brain injury (TBI). Some research suggests that it could reflect a deficiency in goal-directed behavior. The current study aimed to test whether these inappropriate behaviors tend to be deficient in goal-directed control, that is, triggered more by environmental stimuli than by the known consequences of their actions.

METHOD

We used a between-group design with 25 adult participants with severe TBI, and 27 control participants. Social disinhibition was measured using Frontal Systems Behavior Scale and Social Disinhibition Interview. Changes in reward-related goal-directed behavior were evaluated using a computer-based task in which we assessed the influence of cues predicting reward and of reward devaluation on choice performance.

RESULTS

We found no difference in the levels of social disinhibition between the TBI and control groups and, using mixed two-way ANCOVAs, no overall effect of the stimuli or outcome devaluation. However, after combing these groups and splitting them based on their disinhibition levels, a significant interaction between group (High vs Low disinhibition) and reward type (Valued vs Devalued) in sensitivity to outcome devaluation test (F = 5.99, p = .01, ηp2 = .13) appeared. Comparing with the baseline rate of responding, the Low disinhibition group decreased their responding to devalued and increased their responding to still-valued outcomes. In contrast, the High disinhibition group showed the opposite pattern of choice performance.

CONCLUSIONS

It appears that people with clinical levels of social disinhibition are both prone to outcome-response priming effects and insensitive to changes in the value of the consequences of their actions, that is, despite evidence they were aware of the reduction in the value of their actions's outcomes, people with high-level disinhibition kept performing those actions. This pattern has the hallmarks of a habit suggesting their disinhibition reflects a loss of executive control.

Snapping Out of Autopilot: Overriding Habits in Real Time and the Role of Ventrolateral Prefrontal Cortex

Habits allow environmental and interoceptive cues to trigger behavior in an automatized fashion, making them liable to deployment in inappropriate or outdated contexts. Over the long term, repeated failure of a once-adaptive habit to satisfy current goals produces extinction learning that suppresses the habit's execution. Less attention has been afforded to the mechanisms underlying real-time habit suppression: the capacity to stop the execution of a cued habit that is goal conflicting. Here, I first posit a model by which goal-relevant stimuli can (a) bring unfolding habits and their projected outcomes into awareness, (b) prompt evaluation of the habit outcome with respect to current goals, and (c) trigger cessation of the habit response if it is determined to be goal conflicting. Second, I propose a modified stop-signal task to test this model of goal-directed stopping of habit execution. Finally, I marshal evidence indicating that the ventrolateral prefrontal cortex, situated at the nexus of salience detection, action-plan assessment, and motor inhibition networks, is uniquely positioned to coordinate the overriding of habitual behaviors in real time. In sum, this perspective presents a testable model and candidate neurobiological substrate for our capacity to "snap out of autopilot" and override goal-conflicting habits in real time.

Mechanisms underlying performance in a cued go/no-go Pavlovian-to-instrumental transfer paradigm

Environmental cues that remind us of rewarding outcomes (drugs, food) play a significant role in addiction relapse. In the lab the Pavlovian-to-instrumental transfer (PIT) task has been used to formally examine how cues associated with reward or punishment can bias ongoing instrumental responding. Using a version of this paradigm that integrates PIT with a go/no-go task many studies have related stronger PIT effects (with non-drug rewards) to problematic alcohol use including risky alcohol users relative to non-risky drinkers, individuals with alcohol dependence versus healthy controls and individuals in recovery from alcohol use disorder who are more likely to relapse. However the theoretical importance of these findings and the implications for models of addiction was previously not clear. Understanding if this task indexes the general motivating effects of reward cues on instrumental responding (and whether this is sensitive to shifts in motivation for those outcomes) is critical for understanding these previous results within the context of addiction. Thus, in the current study we aimed to delineate the associative mechanisms that drive the stimulus effects observed in this PIT task. Specifically, we wished to examine whether the cueing effects observed in the cued-go/no-go task were selective in their effect on action, insofar as Pavlovian cues specifically invigorated (or suppressed) responding only if they were associated with congruent outcomes. We conclude that the PIT measured with this task is general in nature. Surprisingly however, the biasing effects of Pavlovian cues on instrumental responding did not appear to be sensitive to outcome devaluation.

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Sensory-Specific Satiety Dissociates General and Specific Pavlovian-Instrumental Transfer

Pavlovian conditioning enables predictive stimuli to control action performance and action selection. The present experiments used sensory-specific satiety to examine the role of outcome value in these two forms of control. Experiment 1 employed a general Pavlovian-instrumental transfer design to show that a stimulus predicting a food outcome energizes the performance of an instrumental action earning another food outcome. This energizing effect was removed when the stimulus-predicted outcome or a novel outcome was devalued by sensory-specific satiety. Experiments 2 and 3 employed a specific Pavlovian-instrumental transfer design to demonstrate that a stimulus predicting a particular food outcome promotes the selection of an instrumental action earning the same, but not a different, food outcome. Remarkably, this effect was maintained when all or just one of the stimulus-predicted outcomes were devalued by sensory-specific satiety. These results indicate that satiety alone removes the expression of general PIT. By contrast, satiety or outcome-specific devaluation does not regulate the expression of specific PIT, which is insensitive to changes in outcome value. This dissociation is consistent with the view that general and specific PIT are two separate phenomena driven by distinct psychological mechanisms.

Brain functional connectivity during and after imagery of gaming and alternative leisure activities in patients with internet gaming disorder

BACKGROUND

The effect of gaming cue exposure on brain activity in patients with internet gaming disorder (IGD) has been investigated a lot, but the effect on brain connectivity has not. This study aimed to investigate the effects of imageries of gaming and alternative leisure activities on functional connectivity during the during-task and post-task states in patients with IGD.

METHODS

Twenty-nine patients and 20 healthy controls were scanned in the 6-min states before, during, and after the imagery tasks for gaming and alternative leisure behaviors using fMRI. Seed-based functional connectivity during and after the tasks were analyzed. The seeds were the nucleus accumbens (NAcc), ventral tegmental area (VTA), caudate, putamen, anterior cingulate cortex (ACC), and posterior cingulate cortex.

RESULTS

The group-by-state interaction effects for the during-tasks were found in caudate-, putamen-, and ACC-based connectivity, whereas those for the post-tasks were shown only in NAcc-based connectivity. In particular, patients showed that caudate-right parahippocampal gyrus connectivity and putamen-right orbitofrontal cortex connectivity increased during gaming and decreased during alternative, whereas NAcc-right precuneus connectivity decreased at baseline, increased in post-gaming, and were not different in post-alternative.

CONCLUSION

Differences in during-task connectivity of the habit/motor and salience networks and post-task resting-state connectivity of the reward and limbic networks between the two imagery tasks may differ between the groups. In the treatment of IGD, when these network connections are reactive to alternative leisure activity, just as to gaming activity, they seem to be freed from gaming addiction.

Effective Connectivity during an Avoidance-Based Pavlovian-to-Instrumental Transfer Task

Pavlovian-to-instrumental transfer (PIT) refers to a phenomenon whereby a classically conditioned stimulus (CS) impacts the motivational salience of instrumental behavior. We examined behavioral response patterns and functional magnetic resonance imaging (fMRI) based effective connectivity during an avoidance-based PIT task. Eleven participants (8 females; Mage = 28.2, SD = 2.8, range = 25-32 years) completed the task. Effective connectivity between a priori brain regions engaged during the task was determined using hemodynamic response function group iterative multiple model estimation (HRF-GIMME). Participants exhibited behavior that was suggestive of specific PIT, a CS previously associated with a reinforcing outcome increased instrumental responding directed at the same outcome. We did not find evidence for general PIT; a CS did not significantly increase instrumental responding towards a different but related outcome. Using HRF-GIMME, we recovered effective connectivity maps among corticostriatal circuits engaged during the task. Group-level paths revealed directional effects from left putamen to right insula and from right putamen to right cingulate. Importantly, a direct effect of specific PIT stimuli on blood-oxygen-level-dependent (BOLD) activity in the left putamen was found. Results provide initial evidence of effective connectivity in key brain regions in an avoidance-based PIT task network. This study adds to the literature studying PIT effects in humans and employing GIMME models to understand how psychological phenomena are supported in the brain.

Astrocyte-neuron interaction in the dorsal striatum-pallidal circuits and alcohol-seeking behaviors

In the striatum, two main types of GABAergic medium spiny neurons (MSNs), denoted striatonigral (or direct-pathway MSNs, dMSNs) and striatopallidal neurons (indirect-pathway MSNs, iMSNs), form circuits with distinct pallidal nuclei, which sends "GO" or "NO-GO" signals through the thalamus. These striatopallidal circuits evaluate and execute reward-seeking and taking behaviors. Especially, the dorsal striatum can be further divided into the dorsomedial striatum (DMS, equivalent to caudate in primates and humans) and dorsolateral striatum (DLS, equivalent to putamen), which orchestrates goal-directed and habitual reward-seeking and taking behaviors, respectively. Using optogenetics, chemogenetics and in vivo calcium imaging technologies combined with electrophysiology and digitalized behavior phenotyping, recent studies have revealed cell-, circuit- and context-specific functions of these microcircuits in addictive behaviors. Also, region-specific astrocytes regulate the homeostatic activities of the dMSNs and iMSNs as well as the downstream circuits, which determine the net balance of cortico-striato-pallidal activities to the thalamic neurons. This review will summarize the recent progress of striatopallidal circuits focusing on astrocyte-neuron interaction and, reward- and alcohol-seeking behaviors. Our review will also discuss the translational and clinical implications of these microcircuit studies. This article is part of the special Issue on "Neurocircuitry Modulating Drug and Alcohol Abuse".

Competing influences on healthy food choices: Mindsetting versus contextual food cues

Food choices are influenced by one's current mindset, suggesting that supporting health (vs. a palatability) mindsets could improve daily food choices. The question rises, however, to what extent internal mindsets still guide choices when people are exposed to external food-context stimuli in an obesogenic environment. To examine these two competing effects we induced health vs. palatability mindsets, and investigated the robustness of the mindset effect by presenting food-context stimuli during a Pavlovian-to-Instrumental-Transfer (PIT) task in two separate cohorts of 102 (76 females) Dutch and 120 (60 females) German participants. For the mindset induction, participants rated food items on visual analogue scales (VAS), based on healthiness and palatability, respectively. In each cohort, half of the participants received a health, the other half a palatability mindset induction. Additionally, we explored whether 'mindset triggers' could be used to further shape behavior. Triggers were established by placing unfamiliar logos at the extreme ends of the VASs used for the mindset inductions. Independent of the mindset, food-associated stimuli influenced food choices in accordance with the previously learned association in each test phase. Health mindset induction biased food choices towards healthier, palatability mindset towards unhealthier choices in the first cohort, but not in the second. The mindset triggers had a more robust effect. These induced healthier (triggers for healthy and not-palatable) and unhealthier (triggers for unhealthy and palatable) food choices in both cohorts alike. Interestingly, these effects did not tamper with the overall effect of Pavlovian cues and were thus true in the presence and absence of food-context stimuli. Therefore, we show that, in our experimental setting, food-associated mindset triggers can be used to bias food choices towards a healthy snack even in an obesogenic environment.

Helpless against food cues: the influence of pro- and anti-sugar videos on instrumental food-seeking behaviour in a Pavlovian-to-instrumental transfer paradigm

OBJECTIVE

External food cues can trigger food seeking by means of associative Stimulus-Outcome-Response learning mechanisms. These mechanisms can contribute to cued overeating. The present study aims at investigating if (cued) food-seeking behaviour can be influenced by pro- and anti-sugar videos.

DESIGN

Participants (N = 81) completed a Pavlovian-to-instrumental transfer (PIT) task: in an instrumental training, they learned associations between button presses and resulting sugary or sugar-free snacks. In a subsequent Pavlovian training, the snacks were paired with different cues. During the following transfer test, participants performed free button presses to win snacks while the cues were present or not.

MAIN OUTCOME MEASURES

The number of button presses for the different snacks in the transfer test was analysed.

RESULTS

We observed an outcome specific PIT effect, i.e. higher response rates for cued snacks. The videos did not affect the PIT effect. However, exploratory analyses revealed that the anti-sugar video led to fewer button presses for sugary snacks (compared to the pro-sugar video).

CONCLUSION

While snack-seeking behaviour was unaffected by the video's messages in the presence of food cues, in the absence of food cues there was evidence for a reduction of sugary snack choices by the anti-sugar video.

Neural correlates of cue-induced changes in decision-making distinguish subjects with gambling disorder from healthy controls

In addiction, there are few human studies on the neural basis of cue-induced changes in value-based decision making (Pavlovian-to-instrumental transfer, PIT). It is especially unclear whether neural alterations related to PIT are due to the physiological effects of substance abuse or rather related to learning processes and/or other etiological factors related to addiction. We have thus investigated whether neural activation patterns during a PIT task help to distinguish subjects with gambling disorder (GD), a nonsubstance-based addiction, from healthy controls (HCs). Thirty GD and 30 HC subjects completed an affective decision-making task in a functional magnetic resonance imaging (fMRI) scanner. Gambling-associated and other emotional cues were shown in the background during the task. Data collection and feature modeling focused on a network of nucleus accumbens (NAcc), amygdala, and orbitofrontal cortex (OFC) (derived from PIT and substance use disorder [SUD] studies). We built and tested a linear classifier based on these multivariate neural PIT signatures. GD subjects showed stronger PIT than HC subjects. Classification based on neural PIT signatures yielded a significant area under the receiver operating curve (AUC-ROC) (0.70, p = 0.013). GD subjects showed stronger PIT-related functional connectivity between NAcc and amygdala elicited by gambling cues, as well as between amygdala and OFC elicited by negative and positive cues. HC and GD subjects were thus distinguishable by PIT-related neural signatures including amygdala-NAcc-OFC functional connectivity. Neural PIT alterations in addictive disorders might not depend on the physiological effect of a substance of abuse but on related learning processes or even innate neural traits.

How predictive learning influences choice: Evidence for a GPCR-based memory process necessary for Pavlovian-instrumental transfer

Predictive learning endows stimuli with the capacity to signal both the sensory-specific and general motivational properties of their associated rewards or outcomes. These two signals can be distinguished behaviorally by their influence on the selection and performance of instrumental actions, respectively. This review focuses on how sensory-specific predictive learning guides choice between actions that earn otherwise equally desirable outcomes. We describe evidence that outcome-specific predictive learning is encoded in the basolateral amygdala and drives the accumulation of delta-opioid receptors on the surface of cholinergic interneurons located in the nucleus accumbens shell. This accumulation constitutes a novel form of cellular memory, not for outcome-specific predictive learning per se but for the selection of, and choice between, future instrumental actions. We describe recent evidence regarding the cascade of events necessary for the formation and expression of this cellular memory and point to open questions for future research into this process. Beyond these mechanistic considerations, the discovery of this new form of memory is consistent with recent evidence suggesting that intracellular rather than synaptic changes can mediate learning-related plasticity to modify brain circuitry to prepare for future significant events.

White Matter Alterations of the Goal-Directed System in Patients With Obsessive-Compulsive Disorder and Their Unaffected First-Degree Relatives

BACKGROUND

It has been postulated that the neurobiological mechanism responsible for the onset of symptoms of obsessive-compulsive disorder (OCD), especially compulsive behavior, is related to alterations of the goal-directed and habitual learning systems. However, little is known about whether changes in these learning systems co-occur with changes in the white matter structure of patients with OCD and their unaffected first-degree relatives (UFDRs).

METHODS

Diffusion tensor imaging data were acquired from 32 patients with OCD (21 male), 32 UFDRs (16 male), and 32 healthy control subjects (16 male). White matter tracts in the goal-directed and habitual networks were reconstructed with seed-based probabilistic tractography. Partial least squares path modeling was used to measure the covariation between white matter connectivity, psychiatric symptoms, and cognitive flexibility.

RESULTS

Patients with OCD showed reduced connectivity in the fiber tracts within the goal-directed but not within the habitual network compared with healthy control subjects. Using partial least squares path modeling, patients' symptoms were negatively associated with connectivity within the goal-directed but not within the habitual network. Cognitive flexibility was correlated negatively with caudate-dorsolateral prefrontal cortex tracts in patients with OCD. UFDRs also exhibited reduced white matter connectivity in the goal-directed network.

CONCLUSIONS

These findings suggest that the balance of learning systems in OCD may be disrupted, mainly impairing white matter in the goal-directed network. Alterations of the goal-directed network could explain overt symptoms and impaired cognitive flexibility in patients with OCD. Similar alterations in the goal-directed network are present in UFDRs. The impaired goal-directed system may be an endophenotype of OCD.

Habit, choice, and addiction

Addiction was suggested to emerge from the progressive dominance of habits over goal-directed behaviors. However, it is generally assumed that habits do not persist in choice settings. Therefore, it is unclear how drug habits may persist in real-world scenarios where this factor predominates. Here, we discuss the poor translational validity of the habit construct, which impedes our ability to determine its role in addiction. New evidence of habitual behavior in a drug choice setting are then described and discussed. Interestingly, habitual preference did not promote drug choice but instead favored abstinence. Here, we propose several clues to reconcile these unexpected results with the habit theory of addiction, and we highlight the need in experimental research to face the complexity of drug addicts' decision-making environments by investigating drug habits in the context of choice and in the presence of cues. On a theoretical level, we need to consider more complex frameworks, taking into account continuous interactions between goal-directed and habitual systems, and alternative decision-making models more representative of real-world conditions.

Modulation of cue-guided choices by transcranial direct current stimulation

Environmental cues may anticipate the availability of rewards, thus acting as a guide towards a specific choice (i.e., cue-guided choices). Despite the lateral prefrontal cortex having a critical role in using past learning and flexibly selecting relevant information to guide behavior, the literature on the neural basis of human cue-guided choice mainly focused on the subcortical brain structures implicated, while the specific role of cortical areas remained unclear. The present study aimed to provide causal evidence for the involvement of the lateral prefrontal cortex in two forms of human cue-guided choice, namely outcome-specific and general. To do this, 2 mA cathodal, anodal or sham transcranial direct current stimulation was applied over the lateral prefrontal cortex (with the posterior parietal cortex serving as control region) in three separate groups performing a Pavlovian-to-Instrumental Transfer task. Results showed, for the first time, a dissociation in the cortical structures involved in human cue-guided choice. Cathodal stimulation of the lateral prefrontal cortex reduced the outcome-specific transfer. In striking contrast, there was no influence on the general transfer. These results argue in favor of the presence of at least two possible neural pathways underlying cue-guided choices.

An Adaptation of Pavlovian-to-Instrumental Transfer (PIT) Methodology to Examine the Energizing Effects of Reward-Predicting Cues on Behavior in Young Adults

There is growing recognition that much of human behavior is governed by the presence of classically conditioned cues. The Pavlovian-to-Instrumental Transfer (PIT) paradigm offers a way to measure the effects of classically conditioned stimuli on behavior. In the current study, a novel behavioral task, an adaptation of the PIT framework, was developed for use in conjunction with an fMRI classical conditioning task. Twenty-four healthy young adults completed (1) instrumental training, (2) Pavlovian conditioning, and (3) a Transfer test. During instrumental training, participants learned to apply force to a handgrip to win money from slot machines pictured on a computer screen. During Pavlovian conditioning, slot machines appeared with one of two abstract symbols (cues), one symbol was predictive of monetary reward. During the Transfer test, participants again applied force to a handgrip to win money. This time, the slot machines were presented with the Pavlovian cues, but with the outcomes hidden. The results indicated increased effort on the instrumental task, i.e. higher response frequency and greater force, in the presence of the reward-predicting cue. Our findings add to the growing number of studies demonstrating PIT effects in humans. This new paradigm is effective in measuring the effects of a conditioned stimulus on behavioral activation.

Task complexity interacts with state-space uncertainty in the arbitration between model-based and model-free learning

It has previously been shown that the relative reliability of model-based and model-free reinforcement-learning (RL) systems plays a role in the allocation of behavioral control between them. However, the role of task complexity in the arbitration between these two strategies remains largely unknown. Here, using a combination of novel task design, computational modelling, and model-based fMRI analysis, we examined the role of task complexity alongside state-space uncertainty in the arbitration process. Participants tended to increase model-based RL control in response to increasing task complexity. However, they resorted to model-free RL when both uncertainty and task complexity were high, suggesting that these two variables interact during the arbitration process. Computational fMRI revealed that task complexity interacts with neural representations of the reliability of the two systems in the inferior prefrontal cortex.

The brain dynamically arbitrates between two model-based and model-free reinforcement learning (RL). Here, the authors show that participants tended to increase model-based control in response to increasing task complexity, but resorted to model-free when both uncertainty and task complexity were high.

Inhibition of food craving is a metabolically active process in the brain in obese men

OBJECTIVE

Obesity is associated with impaired inhibitory control over food intake. We hypothesized that the neural circuitry underlying inhibition of food craving would be impaired in obesity. Here we assessed whether obese men show altered brain responses during attempted cognitive inhibition of craving when exposed to food cues.

METHODS

Sixteen obese men (32 ± 8.7 years old, BMI = 38.6 ± 7.2) were compared with 11 age-matched non-obese men (BMI 24.2 ± 2.5) using PET and FDG. Brain glucose metabolism was evaluated in a food deprived state: no food stimulation, food stimulation with no inhibition (NI), and food stimulation with attempted inhibition (AI), each on a separate day. Individualized favorite food items were presented prior to and after FDG injection for 40 min. For AI, participants were asked to attempt to inhibit their desire for the food presented. Self-reports for hunger and food desire were recorded.

RESULTS

Food stimulation compared with no stimulation increased glucose metabolism in inferior and superior frontal gyrus, default mode network and cerebellum, in both groups. For both groups, AI compared with NI-suppressed metabolism in right subgenual anterior cingulate, orbitofrontal areas, bilateral insula, and temporal gyri. There was a stimulation-by-group interaction effect in obese (but not in non-obese) men showing increased metabolism in pregenual anterior cingulate cortex (pgACC) and caudate during AI relative to NI. Changes in the food desire from NI to AI correlated negatively with changes in metabolism in pgACC/caudate in obese but not in non-obese men.

CONCLUSIONS

Obese men showed higher activation in pgACC/caudate, which are regions involved with self-regulation and emotion/reward during AI. Behavioral associations suggest that successful AI is an active process requiring more energy in obese but not in non-obese men. The additional required effort to increase cognitive control in response to food stimulation in obese compared with non-obese men may contribute to their uncontrolled eating behavior.

Affect-driven impulsivity impairs human action control and selection, as measured through Pavlovian instrumental transfer and outcome devaluation

Two experiments were designed to study the role of emotional impulsiveness in action control and selection, involving healthy young women participants. In Experiment 1, the effects of both outcome devaluation and Pavlovian-to-instrumental transfer (PIT) were assessed on instrumental responding. In Experiment 2, we further explored the effect of outcome devaluation on outcome-specific PIT. The role of emotional impulsivity, specifically negative urgency (NU), was also evaluated in both experiments using a self-reported measure (UPPS-P scale, Spanish short version). Experiment 1 showed both outcome devaluation and outcome-specific PIT effects, which were positively inter-correlated and negatively correlated with scores in NU. Experiment 2 found an effect of outcome devaluation on outcome-specific PIT, which was negatively correlated with scores on NU. These results highlight the relevance of considering individual differences in affect-driven impulsivity, specifically NU, when addressing failures in action control and selection (proneness to habit). Moreover, these findings suggest that, at least with the procedure used in these experiments, outcome-specific PIT may be based on a goal-directed process that is under the participant's control.

Neuroendocrinological mechanisms underlying impulsive and compulsive behaviors in obesity: a narrative review of fMRI studies

Impulsivity and compulsivity are multidimensional constructs that are increasingly considered determinants of obesity. Studies using functional magnetic resonance imaging (fMRI) have provided insight on how differences in brain response during tasks exploring facets of impulsivity and compulsivity relate to the ingestive behaviors that support the etiology and maintenance of obesity. In this narrative review, we provide an overview of neuroimaging studies exploring impulsivity and compulsivity factors as they relate to weight status. Special focus will be placed on studies examining the impulsivity-related dimensions of attentional bias, delayed gratification and emotion regulation. Discussions of compulsivity within the context of obesity will be restricted to fMRI studies investigating habit formation and response flexibility under shifting contingencies. Further, we will highlight neuroimaging research demonstrating how alterations in neuroendocrine functioning are linked to excessive food intake and may serve as a driver of the impulsive and compulsive behaviors observed in obesity. Research on the associations between brain response with neuroendocrine factors, such as insulin, peptide YY (PYY), leptin, ghrelin and glucagon-like peptide 1 (GLP-1), will be reviewed.

Expected Value of Control and the Motivational Control of Habitual Action

A hallmark of habitual actions is that, once they are established, they become insensitive to changes in the values of action outcomes. In this article, we review empirical research that examined effects of posttraining changes in outcome values in outcome-selective Pavlovian-to-instrumental transfer (PIT) tasks. This review suggests that cue-instigated action tendencies in these tasks are not affected by weak and/or incomplete revaluation procedures (e.g., selective satiety) and substantially disrupted by a strong and complete devaluation of reinforcers. In a second part, we discuss two alternative models of a motivational control of habitual action: a default-interventionist framework and expected value of control theory. It is argued that the default-interventionist framework cannot solve the problem of an infinite regress (i.e., what controls the controller?). In contrast, expected value of control can explain control of habitual actions with local computations and feedback loops without (implicit) references to control homunculi. It is argued that insensitivity to changes in action outcomes is not an intrinsic design feature of habits but, rather, a function of the cognitive system that controls habitual action tendencies.

Pavlovian-To-Instrumental Transfer and Alcohol Consumption in Young Male Social Drinkers: Behavioral, Neural and Polygenic Correlates

In animals and humans, behavior can be influenced by irrelevant stimuli, a phenomenon called Pavlovian-to-instrumental transfer (PIT). In subjects with substance use disorder, PIT is even enhanced with functional activation in the nucleus accumbens (NAcc) and amygdala. While we observed enhanced behavioral and neural PIT effects in alcohol-dependent subjects, we here aimed to determine whether behavioral PIT is enhanced in young men with high-risk compared to low-risk drinking and subsequently related functional activation in an a-priori region of interest encompassing the NAcc and amygdala and related to polygenic risk for alcohol consumption. A representative sample of 18-year old men (n = 1937) was contacted: 445 were screened, 209 assessed: resulting in 191 valid behavioral, 139 imaging and 157 genetic datasets. None of the subjects fulfilled criteria for alcohol dependence according to the Diagnostic and Statistical Manual of Mental Disorders-IV-TextRevision (DSM-IV-TR). We measured how instrumental responding for rewards was influenced by background Pavlovian conditioned stimuli predicting action-independent rewards and losses. Behavioral PIT was enhanced in high-compared to low-risk drinkers (b = 0.09, SE = 0.03, z = 2.7, p < 0.009). Across all subjects, we observed PIT-related neural blood oxygen level-dependent (BOLD) signal in the right amygdala (t = 3.25, p_SVC = 0.04, x = 26, y = -6, z = -12), but not in NAcc. The strength of the behavioral PIT effect was positively correlated with polygenic risk for alcohol consumption (r_s = 0.17, p = 0.032). We conclude that behavioral PIT and polygenic risk for alcohol consumption might be a biomarker for a subclinical phenotype of risky alcohol consumption, even if no drug-related stimulus is present. The association between behavioral PIT effects and the amygdala might point to habitual processes related to out PIT task. In non-dependent young social drinkers, the amygdala rather than the NAcc is activated during PIT; possible different involvement in association with disease trajectory should be investigated in future studies.

Single-response appetitive Pavlovian to instrumental transfer is suppressed by aversive counter-conditioning

Environmental stimuli, when paired with reward, can influence behaviour in maladaptive ways, for example, by encouraging overeating or addiction. Such behaviour can be sensitive to reward value manipulations, under circumscribed conditions, but whether reward-seeking is also sensitive to stimulus value manipulations remains unclear. Thus, the current experiment investigated whether reducing the hedonic value of a reward-paired stimulus would reduce reward-seeking behaviour. In total, 36 participants successfully completed a single-response Pavlovian-instrumental transfer (PIT) task with a counter-conditioning procedure. The Pavlovian phase associated three conditioned stimuli (CSs) with money at 100%, 50%, or 0% contingency. Counter-conditioning then followed for the experimental group, who saw the 100% CS paired with unpleasant pictures, while the control group saw only neutral images. Instrumental training required participants to learn a button-pressing response to win money. The transfer phase contrasted instrumental responding during baseline and CS presentation. Both experimental and control groups liked the 100% CS more than the other CSs after Pavlovian training, but counter-conditioning reduced this 100% CS liking. In transfer, the experimental group showed an abolition of appetitive PIT, while the control group showed maintenance of appetitive PIT. However, this group difference was only evident in response vigour, not response initiation. In summary, CS hedonic value influences cue-potentiated instrumental responding. More specifically, hedonic value of a reward-paired cue influences the vigour of instrumental responses, but not the decision to initiate a response. These data may have relevance to smoking cessation policies, where the introduction of health warnings may be viewed as a real-world example of counter conditioning.

Motivational sensitivity of outcome-response priming: Experimental research and theoretical models

Outcome-response (O-R) priming is at the core of various associative theories of human intentional action. This is a simple and parsimonious mechanism by which activation of outcome representations (e.g. thinking about the light coming on) leads to activation of the associated motor patterns required to achieve it (e.g. pushing the light switch). In the current manuscript, we review the evidence for such O-R associative links demonstrated by converging (yet until now, separate) strands of research. While there is a wealth of evidence that both the perceptual and motivational properties of an outcome can be encoded in the O-R association and mediate O-R priming, we critically examine the integration of these mechanisms and the conditions under which motivational factors constrain the sensory O-R priming effect. We discuss the clinical relevance of this O-R priming mechanism, whether it can satisfactorily account for human goal-directed behaviour, and the implications for theories of human action control.

Automaticity and cognitive control: Effects of cognitive load on cue-controlled reward choice

The extent to which human outcome–response (O-R) priming effects are automatic or under cognitive control is currently unclear. Two experiments tested the effect of cognitive load on O-R priming to shed further light on the debate. In Experiment 1, two instrumental responses earned beer and chocolate points in an instrumental training phase. Instrumental response choice was then tested in the presence of beer, chocolate, and neutral stimuli. On test, a Reversal instruction group was told that the stimuli signalled which response would not be rewarded. The transfer test was also conducted under either minimal (No Load) or considerable (Load) cognitive load. The Non-Reversal groups showed O-R priming effects, where the reward cues increased the instrumental responses that had previously produced those outcomes, relative to the neutral stimulus. This effect was observed even under cognitive load. The Reversal No Load group demonstrated a reversed effect, where response choice was biased towards the response that was most likely to be rewarded according to the instruction. Most importantly, response choice was at chance in the Reversal Load condition. In Experiment 2, cognitive load abolished the sensitivity to outcome devaluation that was otherwise seen when multiple outcomes and responses were cued on test. Collectively, the results demonstrate that complex O-R priming effects are sensitive to cognitive load, whereas the very simple, standard O-R priming effect is more robust.

Shifting the balance between goals and habits: Five failures in experimental habit induction

Habits are repetitive behaviors that become ingrained with practice, routine, and repetition. The more we repeat an action, the stronger our habits become. Behavioral and clinical neuroscientists have become increasingly interested in this topic because habits may contribute to aspects of maladaptive human behavior, such as compulsive behavior in psychiatry. Numerous studies have demonstrated that habits can be induced in otherwise healthy rats by simply overtraining stimulus-response behaviors. However, despite growing interest in this topic and its application to psychiatry, a similar body of work in humans is absent. Only a single study has been published in humans that shows the effect of extensive training on habit expression. Here, we report five failed attempts to demonstrate that overtraining instrumental behavior leads to the development of inflexible habits in humans, using variants of four previously published outcome devaluation paradigms. Extensive training did not lead to greater habits in two versions of an avoidance learning task, in an appetitive slips-of-action task, or in two independent attempts to replicate the original demonstration. The finding that these outcome devaluation procedures may be insensitive to duration of stimulus-response training in humans has implications for prior work in psychiatric populations. Specifically, it converges with the suggestion that the failures in outcome devaluation in compulsive individuals reflect dysfunction in goal-directed control, rather than overactive habit learning. We discuss why habits are difficult to experimentally induce in healthy humans, and the implications of this for future research in healthy and disordered populations. (PsycINFO Database Record

Cognitive Control of Eating: the Role of Memory in Appetite and Weight Gain

PURPOSE OF REVIEW

The present review organises the recent literature on the role of memory in eating behaviours and provides an overview of the current evidence relating to the associations between memory and weight gain.

RECENT FINDINGS

Research over the last few years has highlighted working memory as an important cognitive process that underpins many aspects of appetite control. Recent work on episodic memory and appetite has replicated work showing that manipulating memory for recent eating affects later consumption and extended this work to examine associations between individual differences in memory and eating behaviours. Poorer episodic memory ability is related to a reduced sensitivity to internal states of hunger and satiety and a tendency towards uncontrolled eating. There is also recent evidence to suggest that working memory and episodic memory impairments are related to weight gain and high BMI. Working memory and episodic memory are core cognitive processes that are critical for food-related decision-making, and disruption to these processes contributes to problems with appetite control and weight gain, which suggests that weight loss programmes might be improved by the addition of cognitive training.

Structural and Functional Brain Abnormalities Associated With Exposure to Different Childhood Trauma Subtypes: A Systematic Review of Neuroimaging Findings

Background: Childhood trauma subtypes sexual abuse, physical abuse, emotional maltreatment, and neglect may have differential effects on the brain that persist into adulthood. A systematic review of neuroimaging findings supporting these differential effects is as yet lacking. Objectives: The present systematic review aims to summarize the findings of controlled neuroimaging trials regarding long-term differential effects of trauma subtypes on the human brain. Methods: A systematic literature search was performed using the PubMed and PsycINFO databases from January 2017 up to and including January 2018. Additional papers were identified by a manual search in the reference lists of selected papers and of relevant review articles retrieved by the initial database search. Studies were then assessed for eligibility by the first author. Only original human studies directly comparing neuroimaging findings of exposed and unexposed individuals to well-defined emotional, physical or sexual childhood maltreatment while controlling for the effects of other subtypes were included. A visual summary of extracted data was made for neuroimaging modalities for which comparison between trauma subtypes was feasible, taking the studies' numbers and sample sizes into account. Results: The systematic literature search yielded 25 publications. Sexual abuse was associated with structural deficits in the reward circuit and genitosensory cortex and amygdalar hyperreactivity during sad autobiographic memory recall. Emotional maltreatment correlated with abnormalities in fronto-limbic socioemotional networks. In neglected individuals, white matter integrity and connectivity were disturbed in several brain networks involved in a variety of functions. Other abnormalities, such as reduced frontal cortical volume, were common to all maltreatment types. Conclusions: There is some evidence for long-term differential effects of trauma subtypes on the human brain. The observed alterations may result from both protective adaptation of and damage to the brain following exposure to threatening life events. Though promising, the current evidence is incomplete, with few brain regions and neuroimaging modalities having been investigated in all subtypes. The comparability of the available evidence is further limited by the heterogeneity of study populations regarding gender, age and comorbid psychopathology. Future neuroimaging studies should take this potentially differential role of childhood trauma subtypes into account.

Using the research domain criteria (RDoC) to conceptualize impulsivity and compulsivity in relation to addiction

Nomenclature for mental disorder was updated in 2013 with the publication of the fifth edition of the Diagnostic and Statistical Manual (DSM-5). In DSM-5, substance use disorders are framed as more dimensional. First, the distinction between abuse and dependence is replaced by substance use. Second, the addictions section now covers both substances and behavioral addictions. This contemporary move toward dimensionality and transdiagnosis in the addictions and other disorders embrace accumulating cognitive-affective neurobiological evidence that is reflected in the United States' National Institutes of Health Research Domain Criteria (NIH RDoC). The RDoC calls for the further development of transdiagnostic approaches to psychopathy and includes five domains to improve research. Additionally, the RDoC suggests that these domains can be measured in terms of specific units of analysis. In line with these suggestions, recent publications have stimulated updated neurobiological conceptualizations of two transdiagnostic concepts, namely impulsivity and compulsivity and their interactions that are applicable to addictive disorders. However, there has not yet been a review to examine the constructs of impulsivity and compulsivity in relation to addiction in light of the research-oriented RDoC. By doing so it may become clearer as to whether impulsivity and compulsivity function antagonistically, complementarily or in some other way at the behavioral, cognitive, and neural level and how this relationship underpins addiction. Thus, here we consider research into impulsivity and compulsivity in light of the transdiagnostic RDoC to help better understand these concepts and their application to evidence-based clinical intervention for addiction.

Lever Insertion as a Salient Stimulus Promoting Insensitivity to Outcome Devaluation

Flexible and efficient decision-making in complex environments can be achieved through constant interactions between the goal-directed and habitual systems. While goal-directed behavior is considered dependent upon Response-Outcome (R-O) associations, habits instead rely on Stimulus-Response (S-R) associations. However, the stimuli that support the S-R association underlying habitual responding in typical instrumental procedures are poorly defined. To resolve this issue, we designed a discrete-trials procedure, in which rats must wait for lever insertion and complete a sequence of five lever presses to obtain a reward (20% sucrose or grain-based pellets). Lever insertion thus constituted an audio-visual stimulus signaling the opportunity for reward. Using sensory-specific satiety-induced devaluation, we found that rats trained with grain-based pellets remained sensitive to outcome devaluation over the course of training with this procedure whereas rats trained with a solution of 20% sucrose rapidly developed habit, and that insensitivity to outcome devaluation in rats trained with sucrose did not result from a bias in general satiety. Importantly, although rats trained with pellets were sensitive to satiety-induced devaluation, their performance was not affected by degradation of instrumental contingency and devaluation by conditioned taste aversion (CTA), suggesting that these rats may also have developed habitual responding. To test whether the discrete-trials procedure biases subjects towards habitual responding, we compared discrete-trials to free-running instrumental responding, and found that rats trained with sucrose in a fixed-ratio 5 (FR5) procedure with continuous presentation of the lever were goal-directed. Together, these results demonstrate that discrete presentations of a stimulus predictive of reward availability promoted the formation of S-R habit in rats trained with liquid sucrose. Further research is necessary to explain inconsistencies in sensitivity to outcome devaluation when rats are trained with grain-based pellets.