1
|
Lalonde R, Strazielle C. The neuropharmacological profile of interval responding during operant tasks. NAUNYN-SCHMIEDEBERG'S ARCHIVES OF PHARMACOLOGY 2024:10.1007/s00210-024-03155-y. [PMID: 38814460 DOI: 10.1007/s00210-024-03155-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Accepted: 05/10/2024] [Indexed: 05/31/2024]
Abstract
Responses occurring during intervals of operant tasks have been subdivided as interim, facultative, and terminal, depending on the time between response onset and reward. Although interval responses, also known as adjunctive responses, have been described in pigeons, rats, mice, monkeys, and humans, most experiments have been conducted in rats. We review the neurochemical basis of interval responses and examine the hypothesis that these responses modulate operant performance. Preliminary experiments indicate the involvement of biogenic amines, acetylcholine, and GABA during interval responding associated with operant tasks. In particular, catecholaminergic deafferentation of the basal ganglia modulated interval responses as did the peripheral injection of catecholamine reuptake blockers. Under the influence of amphetamine, interval responding may either increase or decrease, so that a wide range of responses must be selected to gauge drug effects. In non-drugged pigeons and rats, the expression of interval responses facilitates operant training.
Collapse
Affiliation(s)
- Robert Lalonde
- Laboratoire "Stress, Immunité, Pathogènes" EA 7300, Université de Lorraine, Campus Santé, 9 avenue de la Forêt de Haye, Vandoeuvre-les-Nancy, 54500, France.
| | - Catherine Strazielle
- Laboratoire "Stress, Immunité, Pathogènes" EA 7300, Université de Lorraine, Campus Santé, 9 avenue de la Forêt de Haye, Vandoeuvre-les-Nancy, 54500, France
- CHRU Nancy, allée du Morvan, Vandoeuvre-les-Nancy, 54500, France
| |
Collapse
|
2
|
Hathaway BA, Li A, Brodie HG, Silveira MM, Tremblay M, Seo YS, Winstanley CA. Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats. Eur J Neurosci 2024; 59:1621-1637. [PMID: 38369911 DOI: 10.1111/ejn.16287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 01/18/2024] [Accepted: 02/03/2024] [Indexed: 02/20/2024]
Abstract
Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.
Collapse
Affiliation(s)
- Brett A Hathaway
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Andrew Li
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Hannah G Brodie
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Mason M Silveira
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Melanie Tremblay
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Yeon Soo Seo
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| | - Catharine A Winstanley
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada
| |
Collapse
|
3
|
Chernoff CS, Hynes TJ, Schumacher JD, Ramaiah S, Avramidis DK, Mortazavi L, Floresco SB, Winstanley CA. Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions. Psychopharmacology (Berl) 2024; 241:767-783. [PMID: 38001266 DOI: 10.1007/s00213-023-06508-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 11/14/2023] [Indexed: 11/26/2023]
Abstract
RATIONALE Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding. OBJECTIVE The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance. RESULTS When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine. CONCLUSIONS These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.
Collapse
Affiliation(s)
- Chloe S Chernoff
- Graduate Program in Neuroscience, Faculty of Medicine, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada.
- Department of Psychology, Downing Site, University of Cambridge, Cambridge, UK.
| | - Tristan J Hynes
- Graduate Program in Neuroscience, Faculty of Medicine, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
- Department of Psychology, Downing Site, University of Cambridge, Cambridge, UK
| | - Jackson D Schumacher
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| | - Shrishti Ramaiah
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
- Department of Psychological and Brain Sciences, University of Massachusetts Amherst, Amherst, MA, USA
| | - Dimitrios K Avramidis
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
- Department of Psychology, University of Concordia, Montreal, QC, Canada
| | - Leili Mortazavi
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Stan B Floresco
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| | - Catharine A Winstanley
- Graduate Program in Neuroscience, Faculty of Medicine, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada.
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada.
| |
Collapse
|
4
|
Hynes TJ, Chernoff CS, Hrelja KM, Tse MTL, Avramidis DK, Lysenko-Martin MR, Calderhead L, Kaur S, Floresco SB, Winstanley CA. Win-Paired Cues Modulate the Effect of Dopamine Neuron Sensitization on Decision Making and Cocaine Self-administration: Divergent Effects Across Sex. Biol Psychiatry 2024; 95:220-230. [PMID: 37673411 DOI: 10.1016/j.biopsych.2023.08.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/10/2023] [Accepted: 08/22/2023] [Indexed: 09/08/2023]
Abstract
BACKGROUND Both psychostimulant use and engagement with probabilistic schedules of reward sensitize the mesocorticolimbic dopamine (DA) system. Such behaviors may act synergistically to explain the high comorbidity between stimulant use and gambling disorder. The salient audiovisual stimuli of modern electronic gambling may exacerbate the situation. METHODS To probe these interactions, we sensitized ventral tegmental area DA neurons via chronic chemogenetic stimulation while rats (n = 134) learned a rat gambling task in the presence or absence of casino-like cues. The same rats then learned to self-administer cocaine. In a separate cohort (n = 25), we confirmed that our chemogenetic methods sensitized the locomotor response to cocaine and potentiated phasic excitability of ventral tegmental area DA neurons through in vivo electrophysiological recordings. RESULTS In the absence of cues, sensitization promoted risk taking in both sexes. When rewards were cued, sensitization expedited the development of a risk-preferring phenotype in males while attenuating cue-induced risk taking in females. CONCLUSIONS While these results provide further confirmation that ventral tegmental area DA neurons critically modulate risky decision making, they also reveal stark sex differences in the decisional impact that dopaminergic signals exert when winning outcomes are cued. As previously observed, risky decision making on the cued rat gambling task increased as both males and females learned to self-administer cocaine. The combination of DA sensitization and win-paired cues while gambling led to significantly greater cocaine taking, but these rats did not show any increase in risky choice as a result. Therefore, cocaine and heavily cued gambles may partially substitute for each other once the DA system has been rendered labile through sensitization, thereby compounding addiction risk across modalities.
Collapse
Affiliation(s)
- Tristan J Hynes
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada.
| | - Chloe S Chernoff
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Kelly M Hrelja
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Maric T L Tse
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Dimitrios K Avramidis
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Melanie R Lysenko-Martin
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Lucas Calderhead
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Sukhbir Kaur
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Stan B Floresco
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Catharine A Winstanley
- Department of Psychology, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada.
| |
Collapse
|
5
|
Lowet AS, Zheng Q, Meng M, Matias S, Drugowitsch J, Uchida N. An opponent striatal circuit for distributional reinforcement learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.02.573966. [PMID: 38260354 PMCID: PMC10802299 DOI: 10.1101/2024.01.02.573966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.
Collapse
Affiliation(s)
- Adam S Lowet
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
- Program in Neuroscience, Harvard University, Boston, MA, USA
| | - Qiao Zheng
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Melissa Meng
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
| | - Sara Matias
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
| | - Jan Drugowitsch
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Naoshige Uchida
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
| |
Collapse
|
6
|
Asarch AM, Kruse LC, Schindler AG, Phillips PEM, Clark JJ. Sexually dimorphic development of the mesolimbic dopamine system is associated with nuanced sensitivity to adolescent alcohol use. Front Behav Neurosci 2023; 17:1124979. [PMID: 36910128 PMCID: PMC9992416 DOI: 10.3389/fnbeh.2023.1124979] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 01/30/2023] [Indexed: 02/24/2023] Open
Abstract
Alcohol use remains a major public health concern and is especially prevalent during adolescence. Adolescent alcohol use has been linked to several behavioral abnormalities in later life, including increased risk taking and impulsivity. Accordingly, when modeled in animals, male rats that had moderate alcohol consumption during adolescence exhibit multiple effects in adulthood, including increased risk taking, altered incentive learning, and greater release of dopamine in the mesolimbic pathway. It has been proposed that alcohol arrests neural development, "locking in" adolescent physiological, and consequent behavioral, phenotypes. Here we examined the feasibility that the elevated dopamine levels following adolescent alcohol exposure are a "locked in" phenotype by testing mesolimbic dopamine release across adolescent development. We found that in male rats, dopamine release peaks in late adolescence, returning to lower levels in adulthood, consistent with the notion that high dopamine levels in adolescence-alcohol-exposed adults were due to arrested development. Surprisingly, dopamine release in females was stable across the tested developmental window. This result raised a quandary that arrested dopamine levels would not differ from normal development in females and, therefore, may not contribute to pathological behavior. However, the aforementioned findings related to risk-based decision-making have only been performed in male subjects. When we tested females that had undergone adolescent alcohol use, we found that neither risk attitude during probabilistic decision-making nor mesolimbic dopamine release was altered. These findings suggest that different developmental profiles of the mesolimbic dopamine system across sexes result in dimorphic susceptibility to alcohol-induced cognitive and motivational anomalies exposure.
Collapse
Affiliation(s)
- Ari M Asarch
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA, United States.,Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA, United States.,Graduate Program in Neuroscience, University of Washington, Seattle, WA, United States
| | - Lauren C Kruse
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA, United States.,Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA, United States
| | - Abigail G Schindler
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA, United States.,Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA, United States.,Graduate Program in Neuroscience, University of Washington, Seattle, WA, United States.,VA Puget Sound Health Care System, Seattle, WA, United States
| | - Paul E M Phillips
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA, United States.,Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA, United States.,Graduate Program in Neuroscience, University of Washington, Seattle, WA, United States.,Department of Pharmacology, University of Washington, Seattle, WA, United States
| | - Jeremy J Clark
- Center for Neurobiology of Addiction, Pain & Emotion, University of Washington, Seattle, WA, United States.,Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA, United States.,Graduate Program in Neuroscience, University of Washington, Seattle, WA, United States
| |
Collapse
|