Deficit of state-dependent risk attitude modulation in gambling disorder

Ventrolateral prefrontal cortex in macaques guides decisions in different learning contexts

Flexibly adjusting our behavioral strategies based on the environmental context is critical to maximize rewards. Ventrolateral prefrontal cortex (vlPFC) has been implicated in both learning and decision-making for probabilistic rewards, although how context influences these processes remains unclear. We collected functional neuroimaging data while rhesus macaques performed a probabilistic learning task in two contexts: one with novel and another with familiar visual stimuli. We found that activity in vlPFC encoded rewards irrespective of the context but encoded behavioral strategies that depend on reward outcome (win-stay/lose-shift) preferentially in novel contexts. Functional connectivity between vlPFC and anterior cingulate cortex varied with behavioral strategy in novel learning blocks. By contrast, connectivity between vlPFC and mediodorsal thalamus was highest when subjects repeated a prior choice. Furthermore, pharmacological D2-receptor blockade altered behavioral strategies during learning and resting-state vlPFC activity. Taken together, our results suggest that multiple vlPFC-linked circuits contribute to adaptive decision-making in different contexts.

Balancing risk-return decisions by manipulating the mesofrontal circuits in primates

Decision-making is always coupled with some level of risk, with more pathological forms of risk-taking decisions manifesting as gambling disorders. In macaque monkeys trained in a high risk-high return (HH) versus low risk-low return (LL) choice task, we found that the reversible pharmacological inactivation of ventral Brodmann area 6 (area 6V) impaired the risk dependency of decision-making. Selective optogenetic activation of the mesofrontal pathway from the ventral tegmental area (VTA) to the ventral aspect of 6V resulted in stronger preference for HH, whereas activation of the pathway from the VTA to the dorsal aspect of 6V led to LL preference. Finally, computational decoding captured the modulations of behavioral preference. Our results suggest that VTA inputs to area 6V determine the decision balance between HH and LL.

Abnormal frontostriatal connectivity and serotonin function in gambling disorder: A preliminary exploratory study

Background

The neurobiological mechanisms of gambling disorder are not yet fully characterized, limiting the development of treatments. Defects in frontostriatal connections have been shown to play a major role in substance use disorders, but data on behavioral addictions, such as gambling disorder, are scarce. The aim of this study was to 1) investigate whether gambling disorder is associated with abnormal frontostriatal connectivity and 2) characterize the key neurotransmitter systems underlying the connectivity abnormalities.

Methods

Fifteen individuals with gambling disorder and 17 matched healthy controls were studied with resting-state functional connectivity MRI and three brain positron emission tomography scans, investigating dopamine (18F-FDOPA), opioid (11C-carfentanil) and serotonin (11C-MADAM) function. Frontostriatal connectivity was investigated using striatal seed-to-voxel connectivity and compared between the groups. Neurotransmitter systems underlying the identified connectivity differences were investigated using region-of-interest and voxelwise approaches.

Results

Individuals with gambling disorder showed loss of functional connectivity between the right nucleus accumbens (NAcc) and a region in the right dorsolateral prefrontal cortex (DLPFC) (PFWE <0.05). Similarly, there was a significant Group x right NAcc interaction in right DLPFC 11C-MADAM binding (p = 0.03) but not in 18F-FDOPA uptake or 11C-carfentanil binding. This was confirmed in voxelwise analyses showing a widespread Group x right NAcc interaction in the prefrontal cortex 11C-MADAM binding (PFWE <0.05). Right NAcc 11C-MADAM binding potential correlated with attentional impulsivity in individuals with gambling disorder (r = -0.73, p = 0.005).

Discussion

Gambling disorder is associated with right hemisphere abnormal frontostriatal connectivity and serotonergic function. These findings will contribute to understanding the neurobiological mechanism and may help identify potential treatment targets for gambling disorder.

Working memory performance in disordered gambling and gaming: A systematic review

BACKGROUND

Converging evidence supports that gaming and gambling disorders are associated with executive dysfunction. The involvement of different components of executive functions (EF) in these forms of behavioural addiction is unclear.

AIM

In a systematic review, we aim to uncover the association between working memory (WM), a crucial component of EF, and disordered gaming and gambling. Note that, in the context of this review, gaming has been used synonymously with video gaming.

METHODS

Adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), we systematically searched for studies published from 2012 onwards.

RESULTS

The search yielded 6081 records after removing duplicates, from which 17 peer-reviewed journal articles were eligible for inclusion. The association between WM and problem or disordered gaming and gambling have been categorized separately to observe possible differences. Essentially, problem gaming or gambling, compared to disorder, presents lesser severity and clinical significance. The results demonstrate reduced auditory-verbal WM in individuals with gambling disorder. Decreased WM capacity was also associated with problem gambling, with a correlation between problem gambling severity and decreased WM capacity. Similarly, gaming disorder was associated with decreased WM. Specifically, gaming disorder patients had lower WM capacity than the healthy controls.

CONCLUSION

Working memory seems to be a significant predictor of gambling and gaming disorders. Therefore, holistic treatment approaches that incorporate cognitive techniques that could enhance working memory may significantly boost gambling and gaming disorders treatment success.

Attenuated Directed Exploration during Reinforcement Learning in Gambling Disorder

Gambling disorder (GD) is a behavioral addiction associated with impairments in value-based decision-making and behavioral flexibility and might be linked to changes in the dopamine system. Maximizing long-term rewards requires a flexible trade-off between the exploitation of known options and the exploration of novel options for information gain. This exploration-exploitation trade-off is thought to depend on dopamine neurotransmission. We hypothesized that human gamblers would show a reduction in directed (uncertainty-based) exploration, accompanied by changes in brain activity in a fronto-parietal exploration-related network. Twenty-three frequent, non-treatment seeking gamblers and twenty-three healthy matched controls (all male) performed a four-armed bandit task during functional magnetic resonance imaging (fMRI). Computational modeling using hierarchical Bayesian parameter estimation revealed signatures of directed exploration, random exploration, and perseveration in both groups. Gamblers showed a reduction in directed exploration, whereas random exploration and perseveration were similar between groups. Neuroimaging revealed no evidence for group differences in neural representations of basic task variables (expected value, prediction errors). Our hypothesis of reduced frontal pole (FP) recruitment in gamblers was not supported. Exploratory analyses showed that during directed exploration, gamblers showed reduced parietal cortex and substantia-nigra/ventral-tegmental-area activity. Cross-validated classification analyses revealed that connectivity in an exploration-related network was predictive of group status, suggesting that connectivity patterns might be more predictive of problem gambling than univariate effects. Findings reveal specific reductions of strategic exploration in gamblers that might be linked to altered processing in a fronto-parietal network and/or changes in dopamine neurotransmission implicated in GD.SIGNIFICANCE STATEMENT Wiehler et al. (2021) report that gamblers rely less on the strategic exploration of unknown, but potentially better rewards during reward learning. This is reflected in a related network of brain activity. Parameters of this network can be used to predict the presence of problem gambling behavior in participants.

The neural basis of gambling disorder: An activation likelihood estimation meta-analysis

Previous imaging studies suggested that impairments of prefrontal-striatal and limbic circuits are correlated to excessive gambling. However, the neural underpinnings of gambling disorder (GD) continue to be the topic of debate. The present study aimed to identify structural changes in GD and differentiate the specific brain activity patterns associated with decision-making and reward-processing. We performed a systematic review complemented by Activation likelihood estimation (ALE) meta-analyses on morphometric and functional studies on neural correlates of GD. The ALE meta-analysis on structural studies revealed that patients with GD showed significant cortical grey-matter thinning in the right ventrolateral and ventromedial prefrontal cortex compared to healthy subjects. The ALE meta-analyses on functional studies revealed that patients with GD showed a significant hyperactivation in the medial prefrontal cortex and in the right ventral striatum during decision-making and gain processing compared to healthy subjects. These findings suggest that GD is related to an alteration of brain mechanisms underlying top-down control and appraisal of gambling-related stimuli and provided indications to develop new interventions in clinical practice.

Framing effects on financial and health problems in gambling disorder

Gambling disorder (GD) patients show excessively risky decision-making in the financial domain. We aimed to clarify whether GD patients show risky decision-making in domain-general or in domain-specific. Furthermore, we also investigated the effect of the well-known cognitive bias, the framing effect on GD's decision-making under risk. Sixty-two male GD patients and 74 age-matched healthy male controls (HC) conducted a risky choice task in which they should choose solutions for difficult situations between a sure and a risky option that had the same expectations. Six situations were prepared for each financial and health domain. For each domain, three situations were presented with options using positive frames, and the other three situations were presented with options using negative frames. The results showed that GD chose more risky options in the financial domain with positive frames than HC, but chose comparably in the financial domain with negative frames, whereas GD and HC chose comparably in the health domain regardless of the frames. Thus, GD showed risky decision-making in domain-specific. In addition, the results indicate the importance of considering the influence of the framing effect for assessment of risky decision-making by GD. Domains and the influence of the framing effect should be considered when decision-making patterns of neuropsychiatric disorders are studied.

Brain Network Underlying Executive Functions in Gambling and Alcohol Use Disorders: An Activation Likelihood Estimation Meta-Analysis of fMRI Studies

BACKGROUND

Neuroimaging and neuropsychological studies have suggested that common features characterize both Gambling Disorder (GD) and Alcohol Use Disorder (AUD), but these conditions have rarely been compared.

METHODS

We provide evidence for the similarities and differences between GD and AUD in neural correlates of executive functions by performing an activation likelihood estimation meta-analysis of 34 functional magnetic resonance imaging studies involving executive function processes in individuals diagnosed with GD and AUD and healthy controls (HC).

RESULTS

GD showed greater bilateral clusters of activation compared with HC, mainly located in the head and body of the caudate, right middle frontal gyrus, right putamen, and hypothalamus. Differently, AUD showed enhanced activation compared with HC in the right lentiform nucleus, right middle frontal gyrus, and the precuneus; it also showed clusters of deactivation in the bilateral middle frontal gyrus, left middle cingulate cortex, and inferior portion of the left putamen.

CONCLUSIONS

Going beyond the limitations of a single study approach, these findings provide evidence, for the first time, that both disorders are associated with specific neural alterations in the neural network for executive functions.

Trait and State-Dependent Risk Attitude of Monkeys Measured in a Single-Option Response Task

Humans and animals show diverse preferences for risks (“trait-like” risk attitude) and shift their preference depending on the state or current needs (“state-dependent” risk attitude). For a better understanding of the neural mechanisms underlying risk-sensitive decisions, useful animal models have been required. Here we examined the risk attitude of three male monkeys in a single-option response task, in which an instrumental lever-release was required to obtain a chance of reward. In each trial, reward condition, either deterministic (100% of 1, 2, 3, and 4 drops of juice) or probabilistic (25, 50, 75, and 100% of 4-drop juice) was randomly selected and assigned by a unique visual cue, allowing the monkeys to evaluate the forthcoming reward. The subjective value of the reward was inferred from their performance. Model-based analysis incorporating known economic models revealed non-linear probability distortion in monkeys; unlike previous studies, they showed a simple convex or concave probability distortion curve. The direction of risk preference was consistent between early and late phases of the testing period, suggesting that our observation reflected the trait-like risk attitude of monkeys, at least under the current experimental setting. Regardless of the baseline risk preference, all monkeys showed an enhancement of risk preference in a session according to the satiation level (i.e., state-dependent risk attitude). Our results suggest that, without choice or cognitive demand, monkeys show naturalistic risk attitude – diverse and flexible like humans. Our novel approach may provide a useful animal model of risk-sensitive decisions, facilitating the investigation of the neural mechanisms of decision-making under risk.

Neuroimaging of reward mechanisms in Gambling disorder: an integrative review

Gambling disorder (GD) was reclassified as a behavioral addiction in the DSM-5 and shares clinical and behavioral features with substance use disorders (SUDs). Neuroimaging studies of GD hold promise in isolating core features of the addiction syndrome, avoiding confounding effects of drug neurotoxicity. At the same time, a neurobiologically-grounded theory of how behaviors like gambling can become addictive remains lacking, posing a significant hurdle for ongoing decisions in addiction nosology. This article integrates research on reward-related brain activity (functional MRI) and neurotransmitter function (PET) in GD, alongside the consideration of structural MRI data as to whether these signals more likely reflect pre-existing vulnerability or neuroadaptive change. Where possible, we point to qualitative similarities and differences with established markers for SUDs. Structural MRI studies indicate modest changes in regional gray matter volume and diffuse reductions in white matter integrity in GD, contrasting with clear structural deterioration in SUDs. Functional MRI studies consistently identify dysregulation in reward-related circuitry (primarily ventral striatum and medial prefrontal cortex), but evidence is mixed as to the direction of these effects. The need for further parsing of reward sub-processes is emphasized, including anticipation vs outcome, gains vs. losses, and disorder-relevant cues vs natural rewards. Neurotransmitter PET studies indicate amplified dopamine (DA) release in GD, in the context of minimal differences in baseline DA D2 receptor binding, highlighting a distinct profile from SUDs. Preliminary work has investigated further contributions of opioids, GABA and serotonin. Neuroimaging data increasingly highlight divergent profiles in GD vs. SUDs. The ability of gambling to perpetually activate DA (via maximal uncertainty) may contribute to neuroimaging similarities between GD and SUDs, whereas the supra-physiological DA effects of drugs may partly explain differences in the neuroimaging profile of the two syndromes. Coupled with consistent observations of correlations with gambling severity and related clinical variables within GD samples, the overall pattern of effects is interpreted as a likely combination of shared vulnerability markers across GD and SUDs, but with further experience-dependent neuroadaptive processes in GD.

Activity of Prefrontal Neurons Predict Future Choices during Gambling

Neuronal signals in the prefrontal cortex have been reported to predict upcoming decisions. Such activity patterns are often coupled to perceptual cues indicating correct choices or values of different options. How does the prefrontal cortex signal future decisions when no cues are present but when decisions are made based on internal valuations of past experiences with stochastic outcomes? We trained rats to perform a two-arm bandit-task, successfully adjusting choices between certain-small or possible-big rewards with changing long-term advantages. We discovered specialized prefrontal neurons, whose firing during the encounter of no-reward predicted the subsequent choice of animals, even for unlikely or uncertain decisions and several seconds before choice execution. Optogenetic silencing of the prelimbic cortex exclusively timed to encounters of no reward, provoked animals to excessive gambling for large rewards. Firing of prefrontal neurons during outcome evaluation signals subsequent choices during gambling and is essential for dynamically adjusting decisions based on internal valuations.

An fMRI study of decision-making under sunk costs in gambling disorder

The sunk cost effect is the tendency to continue an investment, or take an action, even though it has higher future costs than benefits, if costs of time, money, or effort were previously incurred. This type of decision bias is pervasive in real life and has been studied in various disciplines. Previous studies and clinical observations suggest that decision-making under sunk costs is altered in gambling disorder (GD). However, the neural mechanisms of decision-making under sunk costs in GD remain largely unknown, and so is their association with the clinical characteristics of this patient group. Here, by combining functional magnetic resonance imaging and the task that demonstrated a clear example of the sunk cost effect, we investigated the neural correlates during decision-making under sunk costs in GD. We found no significant differences in the strength of the sunk cost effect between the GD and healthy control (HC) groups. However, the strength of the sunk cost effect in patients with GD showed a significant negative correlation with abstinence period and a marginally significant positive correlation with the duration of illness. We also found a reduction in the neural activation in the dorsal medial prefrontal cortex during decision-making under sunk costs for the GD group compared with the HC group. Furthermore, in patients with GD, the levels of activation in this area negatively correlated with the duration of illness. These findings have important clinical implications. This study will contribute to a better understanding of the mechanisms underlying altered decision-making abilities in GD.

A Neuroeconomic Theory of Mental Time Travel

We propose a theoretical model that places attention at the center of mental time travel (MTT) ability. This theory predicts that attention promotes a memory-based process that encodes memories of unexpected events, facilitates accurate recollection of information of such events during MTT, and optimizes subsequent decision-making. This process coexists with a habitual process that governs all other events and treats them equally. Our theory demonstrates that the memory-based process is useful when the environment features novel experiences that are likely to be relevant in future decision-making, hence worth remembering accurately. By contrast, the habitual process is optimal in environments that either do not change significantly, or have a small chance of being repeated in the future. This may explain why the ability to mentally travel in time has developed differently in humans than in other species. Implications are discussed in the context of decision-making.