Instrumental and Pavlovian Mechanisms in Alcohol Use Disorder

Transfer from goal-directed behavior to stimulus-response habits and its modulation by acute stress in individuals with risky gaming behavior

Habitual responses towards addiction-related cues play a relevant role in the development and maintenance of addictions. Such automatic responses may be more likely under stress, as stress has been shown to induce a shift from goal-directed to habitual behavior. The current study investigated these mechanisms in risky gaming behavior. Individuals with risky gaming behavior (n = 68), as established by a structured clinical interview, and a matched control group (n = 67) completed a Pavlovian-to-Instrumental Transfer (PIT) paradigm with gaming-related cues and rewards. After the Pavlovian training, participants underwent a stress (Trier Social Stress Test) or control condition before performing the instrumental training and the transfer phase of the PIT paradigm. To assess habitual behavior, the gaming-related rewards were devalued after half of the transfer phase. In both groups, gaming-related cues enhanced the choice of the gaming-related reward and this gaming PIT effect was reduced, however, not eliminated by the devaluation. Unexpectedly, stress did not significantly increase responding for the gaming-related reward in participants aware of the stimulus-outcome associations, however seemed to enhance habitual responding in unaware participants. Our findings underline the relevance of gaming-related cues in triggering habitual responses, which may undermine attempts to change a problematic gaming behavior.

Sex differences in motivational biases over instrumental actions

Motivational (i.e., appetitive or aversive) cues can bias value-based decisions by affecting either direction and intensity of instrumental actions. Despite several findings describing important interindividual differences in these biases, whether biological sex can also play a role is still up to debate. By comparing females and males in both appetitive and aversive Pavlovian-to-Instrumental Transfer paradigms we found that, while motivational cues similarly bias the direction of instrumental actions in both sexes, the intensity of such actions is increased by the cue in male participants only. The present results constitute compelling evidence that a crucial motivational bias of daily actions directed to obtaining rewards or avoiding punishments is modulated by biological sex. This evidence sheds new light on the role of sex in motivational processes that underlie decision-making, highlighting the importance of considering sex as a crucial factor in future research on this topic.

Elevated Amygdala Responses During De Novo Pavlovian Conditioning in Alcohol Use Disorder Are Associated With Pavlovian-to-Instrumental Transfer and Relapse Latency

Background

Contemporary learning theories of drug addiction ascribe a key role to Pavlovian learning mechanisms in the development, maintenance, and relapse of addiction. In fact, cue-reactivity research has demonstrated the power of alcohol-associated cues to activate the brain's reward system, which has been linked to craving and subsequent relapse. However, whether de novo Pavlovian conditioning is altered in alcohol use disorder (AUD) has rarely been investigated.

Methods

To characterize de novo Pavlovian conditioning in AUD, 62 detoxified patients with AUD and 63 matched healthy control participants completed a Pavlovian learning task as part of a Pavlovian-to-instrumental transfer paradigm during a functional magnetic resonance imaging session. Patients were followed up for 12 months to assess drinking behavior and relapse status.

Results

While patients and healthy controls did not differ in their ability to explicitly acquire the contingencies between conditioned and unconditioned stimuli, patients with AUD displayed significantly stronger amygdala responses toward Pavlovian cues, an effect primarily driven by stronger blood oxygen level-dependent differentiation during learning from reward compared with punishment. Moreover, in patients compared with controls, differential amygdala responses during conditioning were positively related to the ability of Pavlovian stimuli to influence ongoing instrumental choice behavior measured during a subsequent Pavlovian-to-instrumental transfer test. Finally, patients who relapsed within the 12-month follow-up period showed an inverse association between amygdala activity during conditioning and relapse latency.

Conclusions

We provide evidence of altered neural correlates of de novo Pavlovian conditioning in patients with AUD, especially for appetitive stimuli. Thus, heightened processing of Pavlovian cues might constitute a behaviorally relevant mechanism in alcohol addiction.

Electrophysiological signature of the interplay between habits and inhibition in response to smoking-related cues in individuals with a smoking habit: An event-related potential study

The rigid, stimulus-bound nature of drug seeking that characterizes substance use disorder (SUD) has been related to a dysregulation of motivational and early attentional reflexive and inhibitory reflective systems. However, the mechanisms by which these systems are engaged by drug-paired conditioned stimuli (CSs) when they promote the enactment of seeking habits in individuals with a SUD have not been elucidated. The present study aimed behaviourally and electrophysiologically to characterize the nature of the interaction between the reflexive and reflective systems recruited by CSs in individuals with a smoking habit. We measured the behavioural performance and associated event-related potentials (ERPs) of 20 individuals with a smoking habit and 20 controls, who never smoked regularly, in a modified Go/NoGo task during which smoking-related CSs, appetitive and neutral pictures, presented either in first or third-person visual perspective were displayed 250 ms before the Go/NoGo cue. We show that smoking-related cues selectively influence early incentive motivation-related attention bias (N2 after picture onset), motor readiness and behavioural inhibition (Go-P3, NoGo-P3 and Pc) of individuals with a smoking habit only when presented from a first-person visual perspective. These data together identify the neural signature of the aberrant engagement of the reflexive and reflective systems during the recruitment of an incentive habit by CSs presented as if they had been response-produced, that is, as conditioned reinforcers.

The Association of Non-Drug-Related Pavlovian-to-Instrumental Transfer Effect in Nucleus Accumbens With Relapse in Alcohol Dependence: A Replication

BACKGROUND

The Pavlovian-to-instrumental transfer (PIT) paradigm measures the effects of Pavlovian conditioned cues on instrumental behavior in the laboratory. A previous study conducted by our research group observed activity in the left nucleus accumbens (NAcc) elicited by a non-drug-related PIT task across patients with alcohol dependence (AD) and healthy control subjects, and the left NAcc PIT effect differentiated patients who subsequently relapsed from those who remained abstinent. In this study, we aimed to examine whether such effects were present in a larger sample collected at a later date.

METHODS

A total of 129 recently detoxified patients with AD (21 females) and 74 healthy, age- and gender-matched control subjects (12 females) performing a PIT task during functional magnetic resonance imaging were examined. After task assessments, patients were followed for 6 months. Forty-seven patients relapsed and 37 remained abstinent.

RESULTS

We found a significant behavioral non-drug-related PIT effect and PIT-related activity in the NAcc across all participants. Moreover, subsequent relapsers showed stronger behavioral and left NAcc PIT effects than abstainers. These findings are consistent with our previous findings.

CONCLUSIONS

Behavioral non-drug-related PIT and neural PIT correlates are associated with prospective relapse risk in AD. This study replicated previous findings and provides evidence for the clinical relevance of PIT mechanisms to treatment outcome in AD. The observed difference between prospective relapsers and abstainers in the NAcc PIT effect in our study is small overall. Future studies are needed to further elucidate the mechanisms and the possible modulators of neural PIT in relapse in AD.

Reward-Mediated, Model-Free Reinforcement-Learning Mechanisms in Pavlovian and Instrumental Tasks Are Related

Model-free and model-based computations are argued to distinctly update action values that guide decision-making processes. It is not known, however, if these model-free and model-based reinforcement learning mechanisms recruited in operationally based instrumental tasks parallel those engaged by pavlovian-based behavioral procedures. Recently, computational work has suggested that individual differences in the attribution of incentive salience to reward predictive cues, that is, sign- and goal-tracking behaviors, are also governed by variations in model-free and model-based value representations that guide behavior. Moreover, it is not appreciated if these systems that are characterized computationally using model-free and model-based algorithms are conserved across tasks for individual animals. In the current study, we used a within-subject design to assess sign-tracking and goal-tracking behaviors using a pavlovian conditioned approach task and then characterized behavior using an instrumental multistage decision-making (MSDM) task in male rats. We hypothesized that both pavlovian and instrumental learning processes may be driven by common reinforcement-learning mechanisms. Our data confirm that sign-tracking behavior was associated with greater reward-mediated, model-free reinforcement learning and that it was also linked to model-free reinforcement learning in the MSDM task. Computational analyses revealed that pavlovian model-free updating was correlated with model-free reinforcement learning in the MSDM task. These data provide key insights into the computational mechanisms mediating associative learning that could have important implications for normal and abnormal states.SIGNIFICANCE STATEMENT Model-free and model-based computations that guide instrumental decision-making processes may also be recruited in pavlovian-based behavioral procedures. Here, we used a within-subject design to test the hypothesis that both pavlovian and instrumental learning processes were driven by common reinforcement-learning mechanisms. Sign-tracking and goal-tracking behaviors were assessed in rats using a pavlovian conditioned approach task, and then instrumental behavior was characterized using an MSDM task. We report that sign-tracking behavior was associated with greater model-free, but not model-based, learning in the MSDM task. These data suggest that pavlovian and instrumental behaviors may be driven by conserved reinforcement-learning mechanisms.

Pavlovian-to-Instrumental Transfer across Mental Disorders: A Review

A mechanism known as Pavlovian-to-instrumental transfer (PIT) describes a phenomenon by which the values of environmental cues acquired through Pavlovian conditioning can motivate instrumental behavior. PIT may be one basic mechanism of action control that can characterize mental disorders on a dimensional level beyond current classification systems. Therefore, we review human PIT studies investigating subclinical and clinical mental syndromes. The literature prevails an inhomogeneous picture concerning PIT. While enhanced PIT effects seem to be present in non-substance-related disorders, overweight people, and most studies with AUD patients, no altered PIT effects were reported in tobacco use disorder and obesity. Regarding AUD and relapsing alcohol-dependent patients, there is mixed evidence of enhanced or no PIT effects. Additionally, there is evidence for aberrant corticostriatal activation and genetic risk, e.g., in association with high-risk alcohol consumption and relapse after alcohol detoxification. In patients with anorexia nervosa, stronger PIT effects elicited by low caloric stimuli were associated with increased disease severity. In patients with depression, enhanced aversive PIT effects and a loss of action-specificity associated with poorer treatment outcomes were reported. Schizophrenic patients showed disrupted specific but intact general PIT effects. Patients with chronic back pain showed reduced PIT effects. We provide possible reasons to understand heterogeneity in PIT effects within and across mental disorders. Further, we strengthen the importance of reliable experimental tasks and provide test-retest data of a PIT task showing moderate to good reliability. Finally, we point toward stress as a possible underlying factor that may explain stronger PIT effects in mental disorders, as there is some evidence that stress per se interacts with the impact of environmental cues on behavior by selectively increasing cue-triggered wanting. To conclude, we discuss the results of the literature review in the light of Research Domain Criteria, suggesting future studies that comprehensively assess PIT across psychopathological dimensions.

Computational analysis of probabilistic reversal learning deficits in male subjects with alcohol use disorder

BACKGROUND

Alcohol use disorder is characterized by perseverative alcohol use despite negative consequences. This hallmark feature of addiction potentially relates to impairments in behavioral flexibility, which can be measured by probabilistic reversal learning (PRL) paradigms. We here aimed to examine the cognitive mechanisms underlying impaired PRL task performance in patients with alcohol use disorder (AUDP) using computational models of reinforcement learning.

METHODS

Twenty-eight early abstinent AUDP and 27 healthy controls (HC) performed an extensive PRL paradigm. We compared conventional behavioral variables of choices (perseveration; correct responses) between groups. Moreover, we fitted Bayesian computational models to the task data to compare differences in latent cognitive variables including reward and punishment learning and choice consistency between groups.

RESULTS

AUDP and HC did not significantly differ with regard to direct perseveration rates after reversals. However, AUDP made overall less correct responses and specifically showed decreased win-stay behavior compared to HC. Interestingly, AUDP showed premature switching after no or little negative feedback but elevated proneness to stay when accumulation of negative feedback would make switching a more optimal option. Computational modeling revealed that AUDP compared to HC showed enhanced learning from punishment, a tendency to learn less from positive feedback and lower choice consistency.

CONCLUSION

Our data do not support the assumption that AUDP are characterized by increased perseveration behavior. Instead our findings provide evidence that enhanced negative reinforcement and decreased non-drug-related reward learning as well as diminished choice consistency underlie dysfunctional choice behavior in AUDP.

Discordant Effects of Cannabinoid 2 Receptor Antagonism/Inverse Agonism During Adolescence on Pavlovian and Instrumental Reward Learning in Adult Male Rats

The endocannabinoid system is responsible for regulating a spectrum of physiological activities and plays a critical role in the developing brain. During adolescence, the endocannabinoid system is particularly sensitive to external insults that may change the brain’s developmental trajectory. Cannabinoid receptor type 2 (CB2R) was initially thought to predominantly function in the peripheral nervous system, but more recent studies have implicated its role in the mesolimbic pathway, a network largely attributed to reward circuitry and reward motivated behavior, which undergoes extensive changes during adolescence. It is therefore important to understand how CB2R modulation during adolescence can impact reward-related behaviors in adulthood. In this study, adolescent male rats (postnatal days 28–41) were exposed to a low or high dose of the CB2R antagonist/inverse agonist SR144528 and Pavlovian autoshaping and instrumental conditional behavioral outcomes were measured in adulthood. SR144528-treated rats had significantly slower acquisition of the autoshaping task, seen by less lever pressing behavior over time [F_{(2, 19)} = 5.964, p = 0.010]. Conversely, there was no effect of adolescent SR144528 exposure on instrumental conditioning. These results suggest that modulation of the CB2R in adolescence differentially impacts reward-learning behaviors in adulthood.