1
|
Hu M, Chang R, Sui X, Gao M. Attention biases the process of risky decision-making: Evidence from eye-tracking. Psych J 2024; 13:157-165. [PMID: 38155408 PMCID: PMC10990817 DOI: 10.1002/pchj.724] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 11/29/2023] [Indexed: 12/30/2023]
Abstract
Attention determines what kind of option information is processed during risky choices owing to the limitation of visual attention. This paper reviews research on the relationship between higher-complexity risky decision-making and attention as illustrated by eye-tracking to explain the process of risky decision-making by the effect of attention. We demonstrate this process from three stages: the pre-phase guidance of options on attention, the process of attention being biased, and the impact of attention on final risk preference. We conclude that exogenous information can capture attention directly to salient options, thereby altering evidence accumulation. In particular, for multi-attribute risky decision-making, attentional advantages increase the weight of specific attributes, thus biasing risk preference in different directions. We highlight the significance of understanding how people use available information to weigh risks from an information-processing perspective via process data.
Collapse
Affiliation(s)
- Mengchen Hu
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and CultivationLiaoning Normal UniversityDalianChina
| | - Ruosong Chang
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and CultivationLiaoning Normal UniversityDalianChina
| | - Xue Sui
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and CultivationLiaoning Normal UniversityDalianChina
| | - Min Gao
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and CultivationLiaoning Normal UniversityDalianChina
| |
Collapse
|
2
|
Hathaway BA, Li A, Brodie HG, Silveira MM, Tremblay M, Seo YS, Winstanley CA. Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats. Eur J Neurosci 2024; 59:1621-1637. [PMID: 38369911 DOI: 10.1111/ejn.16287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 01/18/2024] [Accepted: 02/03/2024] [Indexed: 02/20/2024]
Abstract
Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.
Collapse
Affiliation(s)
- Brett A Hathaway
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Andrew Li
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Hannah G Brodie
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Mason M Silveira
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Melanie Tremblay
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Yeon Soo Seo
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Catharine A Winstanley
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| |
Collapse
|
3
|
Chernoff CS, Hynes TJ, Schumacher JD, Ramaiah S, Avramidis DK, Mortazavi L, Floresco SB, Winstanley CA. Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions. Psychopharmacology (Berl) 2024; 241:767-783. [PMID: 38001266 DOI: 10.1007/s00213-023-06508-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 11/14/2023] [Indexed: 11/26/2023]
Abstract
RATIONALE Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding. OBJECTIVE The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance. RESULTS When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine. CONCLUSIONS These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.
Collapse
Affiliation(s)
- Chloe S Chernoff
- Graduate Program in Neuroscience, Faculty of Medicine, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada.
- Department of Psychology, Downing Site, University of Cambridge, Cambridge, UK.
| | - Tristan J Hynes
- Graduate Program in Neuroscience, Faculty of Medicine, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
- Department of Psychology, Downing Site, University of Cambridge, Cambridge, UK
| | - Jackson D Schumacher
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| | - Shrishti Ramaiah
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
- Department of Psychological and Brain Sciences, University of Massachusetts Amherst, Amherst, MA, USA
| | - Dimitrios K Avramidis
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
- Department of Psychology, University of Concordia, Montreal, QC, Canada
| | - Leili Mortazavi
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Stan B Floresco
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| | - Catharine A Winstanley
- Graduate Program in Neuroscience, Faculty of Medicine, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada.
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada.
| |
Collapse
|
4
|
Cherkasova MV, Clark L, Barton JJS, Stoessl AJ, Winstanley CA. Risk-promoting effects of reward-paired cues in human sign- and goal-trackers. Behav Brain Res 2024; 461:114865. [PMID: 38220058 DOI: 10.1016/j.bbr.2024.114865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 01/09/2024] [Accepted: 01/10/2024] [Indexed: 01/16/2024]
Abstract
Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences.
Collapse
Affiliation(s)
- Mariya V Cherkasova
- Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada; Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada.
| | - Luke Clark
- Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada; Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jason J S Barton
- Department of Medicine, Division of Neurology, University of British Columbia, Vancouver, British Columbia, Canada; Department of Ophthalmology, University of British Columbia, Vancouver, British Columbia, Canada
| | - A Jon Stoessl
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada; Department of Medicine, Division of Neurology, University of British Columbia, Vancouver, British Columbia, Canada
| | - Catharine A Winstanley
- Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada; Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada.
| |
Collapse
|
5
|
Hynes TJ, Chernoff CS, Hrelja KM, Tse MTL, Avramidis DK, Lysenko-Martin MR, Calderhead L, Kaur S, Floresco SB, Winstanley CA. Win-Paired Cues Modulate the Effect of Dopamine Neuron Sensitization on Decision Making and Cocaine Self-administration: Divergent Effects Across Sex. Biol Psychiatry 2024; 95:220-230. [PMID: 37673411 DOI: 10.1016/j.biopsych.2023.08.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/10/2023] [Accepted: 08/22/2023] [Indexed: 09/08/2023]
Abstract
BACKGROUND Both psychostimulant use and engagement with probabilistic schedules of reward sensitize the mesocorticolimbic dopamine (DA) system. Such behaviors may act synergistically to explain the high comorbidity between stimulant use and gambling disorder. The salient audiovisual stimuli of modern electronic gambling may exacerbate the situation. METHODS To probe these interactions, we sensitized ventral tegmental area DA neurons via chronic chemogenetic stimulation while rats (n = 134) learned a rat gambling task in the presence or absence of casino-like cues. The same rats then learned to self-administer cocaine. In a separate cohort (n = 25), we confirmed that our chemogenetic methods sensitized the locomotor response to cocaine and potentiated phasic excitability of ventral tegmental area DA neurons through in vivo electrophysiological recordings. RESULTS In the absence of cues, sensitization promoted risk taking in both sexes. When rewards were cued, sensitization expedited the development of a risk-preferring phenotype in males while attenuating cue-induced risk taking in females. CONCLUSIONS While these results provide further confirmation that ventral tegmental area DA neurons critically modulate risky decision making, they also reveal stark sex differences in the decisional impact that dopaminergic signals exert when winning outcomes are cued. As previously observed, risky decision making on the cued rat gambling task increased as both males and females learned to self-administer cocaine. The combination of DA sensitization and win-paired cues while gambling led to significantly greater cocaine taking, but these rats did not show any increase in risky choice as a result. Therefore, cocaine and heavily cued gambles may partially substitute for each other once the DA system has been rendered labile through sensitization, thereby compounding addiction risk across modalities.
Collapse
Affiliation(s)
- Tristan J Hynes
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada.
| | - Chloe S Chernoff
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Kelly M Hrelja
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Maric T L Tse
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Dimitrios K Avramidis
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Melanie R Lysenko-Martin
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Lucas Calderhead
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Sukhbir Kaur
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Stan B Floresco
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Catharine A Winstanley
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada.
| |
Collapse
|
6
|
Pearson D, Piao M, Le Pelley ME. Value-modulated attentional capture is augmented by win-related sensory cues. Q J Exp Psychol (Hove) 2024; 77:133-143. [PMID: 36803153 PMCID: PMC10712205 DOI: 10.1177/17470218231160368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 12/20/2022] [Accepted: 02/03/2023] [Indexed: 02/23/2023]
Abstract
Attentional prioritisation of stimuli in the environment plays an important role in overt choice. Previous research shows that prioritisation is influenced by the magnitude of paired rewards, in that stimuli signalling high-value rewards are more likely to capture attention than stimuli signalling low-value rewards; and this attentional bias has been proposed to play a role in addictive and compulsive behaviours. A separate line of research has shown that win-related sensory cues can bias overt choices. However, the role that these cues play in attentional selection is yet to be investigated. Participants in this study completed a visual search task in which they responded to a target shape in order to earn reward. The colour of a distractor signalled the magnitude of reward and type of feedback on each trial. Participants were slower to respond to the target when the distractor signalled high reward compared to when the distractor signalled low reward, suggesting that the high-reward distractors had increased attentional priority. Critically, the magnitude of this reward-related attentional bias was further increased for a high-reward distractor with post-trial feedback accompanied by win-related sensory cues. Participants also demonstrated an overt choice preference for the distractor that was associated with win-related sensory cues. These findings demonstrate that stimuli paired with win-related sensory cues are prioritised by the attention system over stimuli with equivalent physical salience and learned value. This attentional prioritisation may have downstream implications for overt choices, especially in gambling contexts where win-related sensory cues are common.
Collapse
Affiliation(s)
- Daniel Pearson
- School of Psychology, UNSW Sydney, Sydney, NSW, Australia
- School of Psychology, The University of Sydney, Sydney, NSW, Australia
| | - Meihui Piao
- School of Psychology, UNSW Sydney, Sydney, NSW, Australia
| | | |
Collapse
|
7
|
Zeng S, McLaughlin EFB, Ramesh A, Morrison SE. Propensity for risky choices despite lower cue reactivity in adolescent rats. Front Behav Neurosci 2023; 17:1297293. [PMID: 38053922 PMCID: PMC10694209 DOI: 10.3389/fnbeh.2023.1297293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 11/03/2023] [Indexed: 12/07/2023] Open
Abstract
Adolescence is a time of heightened risk-taking across species. Salient audiovisual cues associated with rewards are a common feature of gambling environments and have been connected to increased risky decision-making. We have previously shown that, in adult male rats, sign tracking - a behavioral measure of cue reactivity - predicts an individual's propensity for suboptimal risky choices in a rodent gambling task (rGT) with win-paired cues. However, adolescents perform less sign tracking than adult animals, suggesting that they are less cue-reactive than adults in some circumstances. Therefore, we investigated the performance of adolescent male rats on the rGT with win cues and examined its relationship with their sign-tracking behavior. We found that adolescents make more risky choices and fewer optimal choices on the rGT compared with adults, evidence of the validity of the rGT as a model of adolescent gambling behavior. We also confirmed that adolescents perform less sign tracking than adults, and we found that, unlike in adults, adolescents' sign tracking was unrelated to their risk-taking in the rGT. This implies that adolescent risk-taking is less likely than that of adults to be driven by reward-related cues. Finally, we found that adults trained on the rGT as adolescents retained an adolescent-like propensity toward risky choices, suggesting that early exposure to a gambling environment may have a long-lasting impact on risk-taking behavior.
Collapse
Affiliation(s)
| | | | | | - Sara E. Morrison
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA, United States
| |
Collapse
|
8
|
Mortazavi L, Hynes TJ, Chernoff CS, Ramaiah S, Brodie HG, Russell B, Hathaway BA, Kaur S, Winstanley CA. D 2/3 Agonist during Learning Potentiates Cued Risky Choice. J Neurosci 2023; 43:979-992. [PMID: 36623876 PMCID: PMC9908318 DOI: 10.1523/jneurosci.1459-22.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 11/29/2022] [Accepted: 12/19/2022] [Indexed: 01/11/2023] Open
Abstract
Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos+ neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues.SIGNIFICANCE STATEMENT D2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this.
Collapse
Affiliation(s)
- Leili Mortazavi
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Tristan J Hynes
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Chloe S Chernoff
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Shrishti Ramaiah
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Hannah G Brodie
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Brittney Russell
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Brett A Hathaway
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Sukhbir Kaur
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Catharine A Winstanley
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| |
Collapse
|
9
|
Zentall TR. An Animal Model of Human Gambling Behavior. CURRENT RESEARCH IN BEHAVIORAL SCIENCES 2023. [DOI: 10.1016/j.crbeha.2023.100101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2023] Open
|
10
|
Mason A, Madan CR, Simonsen N, Spetch ML, Ludvig EA. Biased confabulation in risky choice. Cognition 2022; 229:105245. [PMID: 35961162 DOI: 10.1016/j.cognition.2022.105245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Revised: 06/13/2022] [Accepted: 07/27/2022] [Indexed: 11/03/2022]
Abstract
When people make risky decisions based on past experience, they must rely on memory. The nature of the memory representations that support these decisions is not yet well understood. A key question concerns the extent to which people recall specific past episodes or whether they have learned a more abstract rule from their past experience. To address this question, we examined the precision of the memories used in risky decisions-from-experience. In three pre-registered experiments, we presented people with risky options, where the outcomes were drawn from continuous ranges (e.g., 100-190 or 500-590), and then assessed their memories for the outcomes experienced. In two preferential tasks, people were more risk seeking for high-value than low-value options, choosing as though they overweighted the outcomes from more extreme ranges. Moreover, in two preferential tasks and a parallel evaluation task, people were very poor at recalling the exact outcomes encountered, but rather confabulated outcomes that were consistent with the outcomes they had seen and were biased towards the more extreme ranges encountered. This common pattern suggests that the observed decision bias in the preferential task reflects a basic cognitive process to overweight extreme outcomes in memory. These results highlight the importance of the edges of the distribution in providing the encoding context for memory recall. They also suggest that episodic memory influences decision-making through gist memory and not through direct recall of specific instances.
Collapse
|
11
|
Do pupillary responses during authentic slot machine use reflect arousal or screen luminance fluctuations? A proof-of-concept study. PLoS One 2022; 17:e0272070. [PMID: 35877672 PMCID: PMC9312385 DOI: 10.1371/journal.pone.0272070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Accepted: 07/12/2022] [Indexed: 12/03/2022] Open
Abstract
Modern slot machines are among the more harmful forms of gambling. Psychophysiological measures may provide a window into mental processes that underpin these harms. Here we investigated pupil dilation derived from eye tracking as a means of capturing changes in sympathetic nervous system arousal following outcomes on a real slot machine. We hypothesized that positively reinforcing slot machine outcomes would be associated with increases in arousal, reflected in larger pupil diameter. We further examined the contribution of game luminance fluctuations on pupil diameter. In Experiment 1A, experienced slot machine gamblers (N = 53) played a commercially-available slot machine in a laboratory for 20 minutes while wearing mobile eye tracking glasses. Analyses differentiated loss outcomes, wins, losses-disguised-as-wins, and (free-spin) bonus features. Bonus features were associated with rapid increases in pupil diameter following the onset of outcome-related audiovisual feedback, relative to losses. In Experiment 1B, luminance data were extracted from captured screen videos (derived from Experiment 1A) to characterize on-screen luminance changes that could modulate pupil diameter. Bonus features and wins were associated with pronounced and complex fluctuations in screen luminance (≈50 L and ≈25L, respectively). However, the pupil dilation that was observed to bonus features in Experiment 1A coincided temporally with only negligible changes in screen luminance, providing partial evidence that the pupil dilation to bonus features may be due to arousal. In Experiment 2, 12 participants viewed pairs of stimuli (scrambled slot machine images) at luminance difference thresholds of ≈25L, ≈50L, and ≈100L. Scrambled images presented at luminance differences of ≈25L and greater were sufficient to cause pupillary responses. Overall, pupillometry may detect event-related changes in sympathetic nervous system arousal following gambling outcomes, but researchers must pay careful attention to substantial in-game luminance changes that may confound arousal-based interpretations.
Collapse
|
12
|
Abstract
For over 100 years, eye movements have been studied and used as indicators of human sensory and cognitive functions. This review evaluates how eye movements contribute to our understanding of the processes that underlie decision-making. Eye movement metrics signify the visual and task contexts in which information is accumulated and weighed. They indicate the efficiency with which we evaluate the instructions for decision tasks, the timing and duration of decision formation, the expected reward associated with a decision, the accuracy of the decision outcome, and our ability to predict and feel confident about a decision. Because of their continuous nature, eye movements provide an exciting opportunity to probe decision processes noninvasively in real time. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Miriam Spering
- Department of Ophthalmology & Visual Sciences and the Djavad Mowafaghian Center for Brain Health, University of British Columbia, Vancouver, Canada;
| |
Collapse
|
13
|
Serotonin 2C Antagonism in the Lateral Orbitofrontal Cortex Ameliorates Cue-Enhanced Risk Preference and Restores Sensitivity to Reinforcer Devaluation in Male Rats. eNeuro 2021; 8:ENEURO.0341-21.2021. [PMID: 34815296 PMCID: PMC8670605 DOI: 10.1523/eneuro.0341-21.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 10/27/2021] [Accepted: 11/16/2021] [Indexed: 11/21/2022] Open
Abstract
Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long–Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT2C antagonism may optimize choice by facilitating exploration.
Collapse
|
14
|
Hynes TJ, Hrelja KM, Hathaway BA, Hounjet CD, Chernoff CS, Ebsary SA, Betts GD, Russell B, Ma L, Kaur S, Winstanley CA. Dopamine neurons gate the intersection of cocaine use, decision making, and impulsivity. Addict Biol 2021; 26:e13022. [PMID: 33559379 DOI: 10.1111/adb.13022] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Revised: 01/20/2021] [Accepted: 01/21/2021] [Indexed: 12/13/2022]
Abstract
Gambling and substance use disorders are highly comorbid. Both clinical populations are impulsive and exhibit risky decision-making. Drug-associated cues have long been known to facilitate habitual drug-seeking, and the salient audiovisual cues embedded within modern gambling products may likewise encourage problem gambling. The dopamine neurons of the ventral tegmental area (VTA) are exquisitely sensitive to drugs of abuse, uncertain rewards, and reward-paired cues and may therefore be the common neural substrate mediating synergistic features of both disorders. To test this hypothesis, we first gained specific inhibitory control over VTA dopamine neurons by transducing a floxed inhibitory DREADD (AAV5-hSyn-DIO-hM4D(Gi)-mCherry) in rats expressing Cre recombinase in tyrosine hydroxylase neurons. We then trained rats in our cued rat gambling task (crGT), inhibiting dopamine neurons throughout task acquisition and performance, before allowing them to self-administer cocaine in the same diurnal period as crGT sessions. The trajectories of addiction differ in women and men, and the dopamine system may differ functionally across the sexes; therefore, we used male and female rats here. We found that inhibition of VTA dopamine neurons decreased cue-induced risky choice and reduced motor impulsivity in males, but surprisingly, enhanced risky decision making in females. Inhibiting VTA dopamine neurons also prevented cocaine-induced changes in decision making in both sexes, but nevertheless drove all animals to consume more cocaine. These findings show that chronic dampening of dopamine signalling can have both protective and deleterious effects on addiction-relevant behaviours, depending on biological sex and dependent variable of interest.
Collapse
Affiliation(s)
- Tristan J. Hynes
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Kelly M. Hrelja
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Brett A. Hathaway
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Celine D. Hounjet
- UBC School of Medicine University of British Columbia Vancouver BC Canada
| | - Chloe S. Chernoff
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Sophie A. Ebsary
- Department of Electrical and Computer Engineering University of British Columbia Vancouver BC Canada
| | - Graeme D. Betts
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Brittney Russell
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Lawrence Ma
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Sukhbir Kaur
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| | - Catharine A. Winstanley
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health University of British Columbia Vancouver BC Canada
| |
Collapse
|
15
|
Noradrenergic contributions to cue-driven risk-taking and impulsivity. Psychopharmacology (Berl) 2021; 238:1765-1779. [PMID: 33649970 DOI: 10.1007/s00213-021-05806-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 02/22/2021] [Indexed: 02/02/2023]
Abstract
RATIONALE The flashing lights and sounds of modern casinos are alluring and may contribute to the addictive nature of gambling. Such cues can have a profound impact on the noradrenaline (NA) system, which could therefore be a viable therapeutic target for gambling disorder (GD). While there is substantial evidence to support the involvement of NA in the impulsive symptoms of GD, its function in mediating the "pro-addictive" impact of cues is less understood. OBJECTIVE We wished to investigate the role of NA in our rodent assay of decision making and impulsivity, the cued rat gambling task (crGT). Given that sex differences are prominent in addiction disorders, and increasingly reported in the monoaminergic regulation of behaviour, we also prioritised evaluating noradrenergic drugs in both sexes. METHODS Female and male rats were trained to stability on the crGT and then given intraperitoneal injections of the noradrenaline reuptake inhibitor atomoxetine, the α2A receptor agonist guanfacine, the beta receptor antagonist propranolol, and the α2 receptor antagonist yohimbine. RESULTS Atomoxetine dose-dependently improved decision-making score. Guanfacine selectively enhanced decision making in risk-preferring males and optimal performing females. Propranolol and yohimbine did not influence decision making. Atomoxetine and guanfacine reduced premature responses, while yohimbine bi-phasically affected this index of motor impulsivity. CONCLUSIONS These results support the hypothesis that NA is an important neuromodulator of the cue-induced deficits in decision making observed in laboratory-based gambling paradigms, and suggest that NAergic drugs like atomoxetine and guanfacine may be useful in treating GD.
Collapse
|
16
|
Betts GD, Hynes TJ, Winstanley CA. Pharmacological evidence of a cholinergic contribution to elevated impulsivity and risky decision-making caused by adding win-paired cues to a rat gambling task. J Psychopharmacol 2021; 35:701-712. [PMID: 33573446 DOI: 10.1177/0269881120972421] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND Pairing rewards with sensory stimulation, in the form of auditory and visual cues, increases risky decision-making in both rats and humans. Understanding the neurobiological basis of this effect could help explain why electronic gambling machines are so addictive, and inform treatment development for compulsive gambling and gaming. Numerous studies implicate the dopamine system in mediating the motivational influence of reward-paired cues; recent data suggest the cholinergic system also plays a critical role. Previous work also indicates that cholinergic drugs alter decision-making under uncertainty. AIMS We investigated whether the addition of reward-concurrent cues to the rat gambling task (crGT) altered the effects of peripherally administered cholinergic compounds. METHODS Muscarinic and nicotinic agonists and antagonists were administered to 16 male, Long-Evans rats trained on the crGT. Measures of optimal/risky decision-making and motor impulsivity were the main dependent variables of interest. RESULTS The muscarinic receptor antagonist scopolamine improved decision-making overall, decreasing selection of one of the risky options while increasing choice of the more advantageous options. The muscarinic agonist oxotremorine increased choice latency but did not significantly affect option preference. Neither the nicotinic antagonist mecamylamine nor the agonist nicotine affected choice patterns, but mecamylamine decreased premature responding, an index of motor impulsivity. CONCLUSIONS These results contrast sharply from those obtained previously using the uncued rGT, and suggest that the deleterious effects of win-paired cues on decision-making and impulse control may result from elevated cholinergic tone.
Collapse
Affiliation(s)
- Graeme D Betts
- Department of Psychology, University of British Columbia, Vancouver, BC, Canada
| | - Tristan J Hynes
- Department of Psychology, University of British Columbia, Vancouver, BC, Canada
| | | |
Collapse
|
17
|
Bevington CW, Cheng JCK, Klyuzhin IS, Cherkasova MV, Winstanley CA, Sossi V. A Monte Carlo approach for improving transient dopamine release detection sensitivity. J Cereb Blood Flow Metab 2021; 41:116-131. [PMID: 32050828 PMCID: PMC7747166 DOI: 10.1177/0271678x20905613] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Current methods using a single PET scan to detect voxel-level transient dopamine release-using F-test (significance) and cluster size thresholding-have limited detection sensitivity for clusters of release small in size and/or having low release levels. Specifically, simulations show that voxels with release near the peripheries of such clusters are often rejected-becoming false negatives and ultimately distorting the F-distribution of rejected voxels. We suggest a Monte Carlo method that incorporates these two observations into a cost function, allowing erroneously rejected voxels to be accepted under specified criteria. In simulations, the proposed method improves detection sensitivity by up to 50% while preserving the cluster size threshold, or up to 180% when optimizing for sensitivity. A further parametric-based voxelwise thresholding is then suggested to better estimate the release dynamics in detected clusters. We apply the Monte Carlo method to a pilot scan from a human gambling study, where additional parametrically unique clusters are detected as compared to the current best methods-results consistent with our simulations.
Collapse
Affiliation(s)
- Connor Wj Bevington
- Department of Physics and Astronomy, University of British Columbia, Vancouver, Canada
| | - Ju-Chieh Kevin Cheng
- Department of Physics and Astronomy, University of British Columbia, Vancouver, Canada.,Pacific Parkinson's Research Centre, University of British Columbia, Vancouver, Canada
| | - Ivan S Klyuzhin
- Faculty of Medicine, Division of Neurology, University of British Columbia, Vancouver, Canada
| | - Mariya V Cherkasova
- Pacific Parkinson's Research Centre, University of British Columbia, Vancouver, Canada.,Faculty of Medicine, Division of Neurology, University of British Columbia, Vancouver, Canada
| | | | - Vesna Sossi
- Department of Physics and Astronomy, University of British Columbia, Vancouver, Canada
| |
Collapse
|
18
|
Klyuzhin IS, Bevington CWJ, Cheng JC(K, Sossi V. Detection of transient neurotransmitter response using personalized neural networks. ACTA ACUST UNITED AC 2020; 65:235004. [DOI: 10.1088/1361-6560/abc230] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
19
|
Limbrick-Oldfield EH, Cherkasova MV, Kennedy D, Goshko CB, Griffin D, Barton JJ, Clark L. Gambling disorder is associated with reduced sensitivity to expected value during risky choice. J Behav Addict 2020; 9:1044-1055. [PMID: 33275122 PMCID: PMC8969736 DOI: 10.1556/2006.2020.00088] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Revised: 10/20/2020] [Accepted: 10/25/2020] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND AND AIMS Individuals with gambling disorder display increased levels of risk-taking, but it is not known if it is associated with an altered subjective valuation of gains and/or losses, perception of their probabilities, or integration of these sources of information into expected value. METHODS Participants with gambling disorder (n = 48) were compared with a healthy comparison group (n = 35) on a two-choice lottery task that involved either gains-only or losses-only gambles. On each trial, two lotteries were displayed, showing the associated probability and magnitude of the possible outcome for each. On each trial, participants chose one of the two lotteries, and the outcome was revealed. RESULTS Choice behaviour was highly sensitive to the expected value of the two gambles in both the gain and loss domains. This sensitivity to expected value was attenuated in the group with gambling disorder. The group with gambling disorder used both probability and magnitude information less, and this impairment was greater for probability information. By contrast, they used prior feedback (win vs loss) to inform their next choice, despite the independence of each trial. Within the gambling disorder group, problem gambling severity and trait gambling-related cognitions independently predicted reduced sensitivity to expected value. The majority of observed effects were consistent across both gain and loss domains. DISCUSSION AND CONCLUSIONS Our results provide a thorough characterization of decision processes in gain and loss domains in gambling disorder, and place these problems in the context of theoretical constructs from behavioural economics.
Collapse
Affiliation(s)
- Eve H. Limbrick-Oldfield
- Department of Psychology, Centre for Gambling Research at UBC, University of British Columbia
,
Vancouver
,
Canada,
Corresponding author.
| | - Mariya V. Cherkasova
- Department of Psychology, Centre for Gambling Research at UBC, University of British Columbia
,
Vancouver
,
Canada,Department of Medicine, Division of Neurology, University of British Columbia
,
Vancouver
,
Canada,Department of Psychology, West Virginia University
,
Morgantown, WV
,
USA
| | - Dawn Kennedy
- Department of Psychology, Centre for Gambling Research at UBC, University of British Columbia
,
Vancouver
,
Canada
| | - Caylee-Britt Goshko
- Department of Psychology, Centre for Gambling Research at UBC, University of British Columbia
,
Vancouver
,
Canada
| | - Dale Griffin
- Marketing and Behavioural Science Division, UBC Sauder School of Business, University of British Columbia
,
Vancouver
,
Canada
| | - Jason J.S. Barton
- Department of Medicine, Division of Neurology, University of British Columbia
,
Vancouver
,
Canada,Department of Ophthalmology, University of British Columbia
,
Vancouver
,
Canada
| | - Luke Clark
- Department of Psychology, Centre for Gambling Research at UBC, University of British Columbia
,
Vancouver
,
Canada,Djavad Mowafaghian Centre for Brain Health, University of British Columbia
,
Vancouver
,
Canada
| |
Collapse
|
20
|
Spetch ML, Madan CR, Liu YS, Ludvig EA. Effects of winning cues and relative payout on choice between simulated slot machines. Addiction 2020; 115:1719-1727. [PMID: 32056323 DOI: 10.1111/add.15010] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/27/2019] [Revised: 11/18/2019] [Accepted: 02/12/2020] [Indexed: 11/28/2022]
Abstract
BACKGROUND AND AIMS Cues associated with winning may encourage gambling. We assessed the effects on risky choice of slot machine of: (1) neutral sounds paired with winning, (2) casino-related cues (such as the sound of coins dropping and pictures of dollar signs) and (3) relative payouts. DESIGN Experimental studies in which participants repeatedly chose between safer and riskier simulated slot machines. Safer slot machines paid the same amount regardless of which symbols lined up. Risky machines paid different amounts depending on which symbols lined up. Effects of initially neutral sounds paired with the best payout were assessed between-groups (experiment 1a) and within-participants (experiment 1b). In experiment 2, pairing of casino-related audiovisual cues with payout was assessed within participants, and cue timing was assessed between groups. SETTING A university research laboratory in Edmonton, Canada. PARTICIPANTS Undergraduate students (n = 630 across three experiments). MEASUREMENTS Preference for riskier over safer machines, preference between machines that differed in cues, payout recall and frequency estimates for payouts. Risky choice was calculated as the proportion of choices of the risky machine when presented with a fixed machine of the same expected value. FINDINGS In experiment 1a, risky choice was slightly increased by pairing a sound with the best payout compared with pairing the sound with a lower payout (P = 0.04, d = 0.28) but not compared with no sound [P = 0.36, d = 0.13, Bayes factors (BF)10 = 0.22]. In experiment 1b, people did not prefer a machine with a best-payout sound over one with a lower-payout sound (P = 0.67, d = 0.03, BF10 = 0.11). Relative payout affected choice: risky choices were higher for high- than low-payout decisions (P < 0.001, d = 0.53). In experiment 2, people preferred machines with casino-related cues paired with winning (P < 0.001, r2 = 0.11) and cue timing (at choice or concurrently with the win) had no effect (P = 0.95, r2 = 0.0, BF10 = 0.05). Casino-related cues also enhanced payout memory (P = 0.013 and 0.006). Cue effects were not specific to risk: people also preferred fixed-payout machines with casino-related cues (P < 0.001, r2 = 0.16). CONCLUSIONS In a gambling simulation, student participants chose more risky slot machines when payouts were relatively higher and when casino-related cues were associated with payouts. Pairing a neutral sound with the best payout did not consistently affect slot machine choice, and the effect of casino cues did not depend on their timing. Casino-related cues enhanced payout memory.
Collapse
Affiliation(s)
- Marcia L Spetch
- Department of Psychology, University of Alberta, Edmonton, AB, Canada
| | | | - Yang S Liu
- Department of Psychology, University of Alberta, Edmonton, AB, Canada.,Department of Psychiatry, University of Alberta, Edmonton, AB, Canada
| | - Elliot A Ludvig
- Department of Psychology, University of Warwick, Coventry, UK
| |
Collapse
|
21
|
From sign-tracking to attentional bias: Implications for gambling and substance use disorders. Prog Neuropsychopharmacol Biol Psychiatry 2020; 99:109861. [PMID: 31931091 DOI: 10.1016/j.pnpbp.2020.109861] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Revised: 01/07/2020] [Accepted: 01/08/2020] [Indexed: 01/11/2023]
Abstract
Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.
Collapse
|
22
|
Zack M, St George R, Clark L. Dopaminergic signaling of uncertainty and the aetiology of gambling addiction. Prog Neuropsychopharmacol Biol Psychiatry 2020; 99:109853. [PMID: 31870708 DOI: 10.1016/j.pnpbp.2019.109853] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/27/2019] [Revised: 12/03/2019] [Accepted: 12/20/2019] [Indexed: 11/15/2022]
Abstract
Although there is increasing clinical recognition of behavioral addictions, of which gambling disorder is the prototype example, there is a limited understanding of the psychological properties of (non-substance-related) behaviors that enable them to become 'addictive' in a way that is comparable to drugs of abuse. According to an influential application of reinforcement learning to substance addictions, the direct effects of drugs to release dopamine can create a perpetual escalation of incentive salience. This article focusses on reward uncertainty, which is proposed to be the core feature of gambling that creates the capacity for addiction. We describe the neuro-dynamics of the dopamine response to uncertainty that may allow a similar escalation of incentive salience, and its relevance to behavioral addictions. We review translational evidence from both preclinical animal models and human clinical research, including studies in people with gambling disorder. Further, we describe the evidence for 1) the effects of the omission of expected reward as a stressor and to promote sensitization, 2) the effect of the resolution of reward uncertainty as a source of value, 3) structural characteristics of modern Electronic Gaming Machines (EGMs) in leveraging these mechanisms, 4) analogies to the aberrant salience hypothesis of psychosis for creating and maintaining gambling-related cognitive distortions. This neurobiologically-inspired model has implications for harm profiling of other putative behavioral addictions, as well as offering avenues for enhancing neurological, pharmacological and psychological treatments for gambling disorder, and harm reduction strategies for EGM design.
Collapse
Affiliation(s)
- Martin Zack
- Centre for Addiction and Mental Health, 33 Russell St, Toronto, ON M5S 2S1, Canada; Department of Pharmacology & Toxicology, University of Toronto, 1 King's College Circle, Toronto, ON M5S 1A8, Canada.
| | - Ross St George
- Department of Psychology, University of British Columbia, Okanagan Campus, 3333 University Way, Kelowna, BC V1V 1V7, Canada.
| | - Luke Clark
- Centre for Gambling Research at UBC, Department of Psychology, University of British Columbia, 2136 West Mall, Vancouver, BC V6T 1Z4, Canada.
| |
Collapse
|
23
|
Kılıç A, Tilburg WA, Igou ER. Risk‐taking increases under boredom. JOURNAL OF BEHAVIORAL DECISION MAKING 2019. [DOI: 10.1002/bdm.2160] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Affiliation(s)
- Ayşenur Kılıç
- Psychology Department, Institute of Psychiatry, Psychology and Neuroscience (IoPPN)King's College London London United Kingdom
| | - Wijnand A.P. Tilburg
- Psychology Department, Institute of Psychiatry, Psychology and Neuroscience (IoPPN)King's College London London United Kingdom
| | - Eric R. Igou
- Department of PsychologyUniversity of Limerick Limerick Republic of Ireland
| |
Collapse
|
24
|
Abstract
In games of chance, a near miss is said to occur when feedback for a loss approximates a win. For instance, obtaining “cherry–cherry–lemon” on a slot machine could be considered a near miss. Sixty-six years ago, B.F. Skinner first proposed the idea that near-miss events might reinforce continued play in slot machines, and despite some inconsistencies in the experimental literature, belief in this “near-miss effect” has remained strong. In the present manuscript, we will review this literature and present experimental assessments of the near-miss effect on the frequency of the gambling response. Experiment 1 used a tightly controlled resistance-to-extinction procedure in pigeons to evaluate the putative reinforcing effect of near misses relative to a control “far-miss” reel pattern. Experiment 2 extended Experiment 1’s procedure to human participants. The results of both experiments failed to support the near-miss effect hypothesis. Experiment 3 used a further simplified procedure to assess the validity of the resistance-to-extinction paradigm when a probable conditional reinforcer was present on the reel stimuli. Although a clear conditional response was obtained from the reel, subsequent testing in extinction revealed no conditionally reinforcing function of this stimulus on operant response frequency.
Collapse
|
25
|
Langdon AJ, Hathaway BA, Zorowitz S, Harris CBW, Winstanley CA. Relative insensitivity to time-out punishments induced by win-paired cues in a rat gambling task. Psychopharmacology (Berl) 2019; 236:2543-2556. [PMID: 31256220 PMCID: PMC7388589 DOI: 10.1007/s00213-019-05308-x] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Accepted: 06/18/2019] [Indexed: 10/26/2022]
Abstract
RATIONALE Pairing rewarding outcomes with audiovisual cues in simulated gambling games increases risky choice in both humans and rats. However, the cognitive mechanism through which this sensory enhancement biases decision-making is unknown. OBJECTIVES To assess the computational mechanisms that promote risky choice during gambling, we applied a series of reinforcement learning models to a large dataset of choices acquired from rats as they each performed one of two variants of a rat gambling task (rGT), in which rewards on "win" trials were delivered either with or without salient audiovisual cues. METHODS We used a sampling technique based on Markov chain Monte Carlo to obtain posterior estimates of model parameters for a series of RL models of increasing complexity, in order to assess the relative contribution of learning about positive and negative outcomes to the latent valuation of each choice option on the cued and uncued rGT. RESULTS Rats which develop a preference for the risky options on the rGT substantially down-weight the equivalent cost of the time-out punishments during these tasks. For each model tested, the reduction in learning from the negative time-outs correlated with the degree of risk preference in individual rats. We found no apparent relationship between risk preference and the parameters that govern learning from the positive rewards. CONCLUSIONS The emergence of risk-preferring choice on the rGT derives from a relative insensitivity to the cost of the time-out punishments, as opposed to a relative hypersensitivity to rewards. This hyposensitivity to punishment is more likely to be induced in individual rats by the addition of salient audiovisual cues to rewards delivered on win trials.
Collapse
Affiliation(s)
- Angela J Langdon
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, 08544, USA.
| | - Brett A Hathaway
- Department of Psychology, University of British Columbia, Vancouver, Canada
| | - Samuel Zorowitz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, 08544, USA
| | - Cailean B W Harris
- Department of Psychology, University of British Columbia, Vancouver, Canada
| | - Catharine A Winstanley
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, 08544, USA.
- Department of Psychology, University of British Columbia, Vancouver, Canada.
| |
Collapse
|