Dorsal Raphe Dopamine Neurons Signal Motivational Salience Dependent on Internal State, Expectation, and Behavioral Context

Adenosine A2A Receptors Link Astrocytic α1-Adrenergic Signaling to Wake-Promoting Dopamine Neurons

BACKGROUND

Sleep and arousal disorders are common, but the underlying physiology of wakefulness is not fully understood. The locus coeruleus promotes arousal via α1-adrenergic receptor (α1AR)-driven recruitment of wake-promoting dopamine neurons in the ventral periaqueductal gray (vPAGDA neurons). α1AR expression is enriched on vPAG astrocytes, and chemogenetic activation of astrocytic Gq signaling promotes wakefulness. Astrocytes can release extracellular gliotransmitters, such as ATP and adenosine, but the mechanism underlying how vPAG astrocytic α1ARs influence sleep/wake behavior and vPAGDA neuron physiology is unknown.

METHODS

In this study, we utilized genetic manipulations with ex vivo calcium imaging in vPAGDA neurons and astrocytes, patch-clamp electrophysiology, and behavioral experiments in mice to test our hypothesis that astrocytic α1ARs mediate noradrenergic modulation of wake-promoting vPAGDA neurons via adenosine signaling.

RESULTS

Activation of α1ARs with phenylephrine increased calcium transients in vPAGDA neurons and vPAG astrocytes and increased vPAGDA neuron excitability ex vivo. Chemogenetic Gq-DREADD (designer receptor exclusively activated by designer drugs) activation of vPAG astrocytes similarly increased vPAGDA neuron calcium activity and intrinsic excitability. Conversely, short hairpin RNA knockdown of vPAG astrocytic α1ARs reduced the excitatory effect of phenylephrine on vPAGDA neurons and blunted arousal during the wake phase. Pharmacological blockade of adenosine A2A receptors precluded the α1AR-induced increase in vPAGDA calcium activity and excitability in brain slices, as well as the wake-promoting effects of vPAG α1AR activation in vivo.

CONCLUSIONS

We have identified a crucial role for vPAG astrocytic α1ARs in sustaining arousal through heightened excitability and activity of vPAGDA neurons mediated by local A2A receptors.

Dorsal raphe to basolateral amygdala corticotropin-releasing factor circuit regulates cocaine-memory reconsolidation

Environmental stimuli elicit drug craving and relapse in cocaine users by triggering the retrieval of strong cocaine-related contextual memories. Retrieval can also destabilize drug memories, requiring reconsolidation, a protein synthesis-dependent storage process, to maintain memory strength. Corticotropin-releasing factor (CRF) signaling in the basolateral amygdala (BLA) is necessary for cocaine-memory reconsolidation. We have hypothesized that a critical source of CRF in the BLA is the dorsal raphe nucleus (DR) based on its neurochemistry, anatomical connectivity, and requisite involvement in cocaine-memory reconsolidation. To test this hypothesis, male and female Sprague-Dawley rats received adeno-associated viruses to express Gi-coupled designer receptors exclusively activated by designer drugs (DREADDs) selectively in CRF neurons of the DR and injection cannulae directed at the BLA. The rats were trained to self-administer cocaine in a distinct environmental context then received extinction training in a different context. Next, they were briefly re-exposed to the cocaine-predictive context to destabilize (reactivate) cocaine memories. Intra-BLA infusions of the DREADD agonist deschloroclozapine (DCZ; 0.1 mM, 0.5 µL/hemisphere) immediately after memory reactivation attenuated cocaine-memory strength, relative to vehicle infusion. This was indicated by a selective, DCZ-induced and memory reactivation-dependent decrease in drug-seeking behavior in the cocaine-predictive context in DREADD-expressing males and females at test compared to respective controls. Notably, BLA-projecting DR CRF neurons that exhibited increased c-Fos expression during memory reconsolidation co-expressed the glutamatergic neuronal marker, vesicular glutamate transporter 3. Together, these findings suggest that the DRCRF → BLA circuit is engaged to maintain cocaine-memory strength after memory destabilization, and this phenomenon may be mediated by DR CRF and/or glutamate release in the BLA.

Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when confronting reward uncertainty. However, it has been unclear whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider these attributes to make a choice. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes, and this population tended to integrate the attributes in a manner that reflected monkeys' preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how the DRN participates in value computations, guiding theories about the role of the DRN in decision-making and psychiatric disease.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Dorsal Raphe to Basolateral Amygdala Corticotropin-Releasing Factor Circuit Regulates Cocaine-Memory Reconsolidation

Environmental stimuli elicit drug craving and relapse in cocaine users by triggering the retrieval of strong cocainerelated contextual memories. Retrieval can also destabilize drug memories, requiring reconsolidation, a protein synthesis-dependent storage process, to maintain memory strength. Corticotropin-releasing factor (CRF) signaling in the basolateral amygdala (BLA) is necessary for cocainememory reconsolidation. We have hypothesized that a critical source of CRF in the BLA is the dorsal raphe nucleus (DR) based on its neurochemistry, anatomical connectivity, and requisite involvement in cocaine-memory reconsolidation. To test this hypothesis, male and female Sprague-Dawley rats received adeno-associated viruses to express Gi-coupled designer receptors exclusively activated by designer drugs (DREADDs) selectively in CRF neurons of the DR and injection cannulae directed at the BLA. The rats were trained to self-administer cocaine in a distinct environmental context then received extinction training in a different context. They were then briefly reexposed to the cocaine-predictive context to destabilize (reactivate) cocaine memories. Intra-BLA infusions of the DREADD agonist deschloroclozapine (DCZ; 0.1 mM, 0.5 μL/hemisphere) after memory reactivation attenuated cocaine-memory strength, relative to vehicle infusion. This was indicated by a selective, DCZ-induced and memory reactivation-dependent decrease in drug-seeking behavior in the cocaine-predictive context in DREADD-expressing males and females at test compared to respective controls. Notably, BLA-projecting DR CRF neurons that exhibited increased c-Fos expression during memory reconsolidation co-expressed glutamatergic and serotonergic neuronal markers. Together, these findings suggest that the DRCRF → BLA circuit is engaged to maintain cocaine-memory strength after memory destabilization, and this phenomenon may be mediated by DR CRF, glutamate, and/or serotonin release in the BLA.

Pavlovian Fear Conditioning Is More than You Think It Is

A common neuroscience application of Pavlovian fear conditioning is to manipulate neuron-type activity, pair a cue with foot shock, then measure cue-elicited freezing in a novel context. If the manipulation reduces freezing, the neuron type is implicated in Pavlovian fear conditioning. This application reduces Pavlovian fear conditioning to a single concept. In this Viewpoint, I describe experiments supporting the view that Pavlovian fear conditioning refers to three distinct concepts: procedure, process, and behavior. An experimenter controls procedure, observes behavior, but infers process. Distinguishing these concepts is essential because: (1) a shock-paired cue can engage numerous processes and behaviors; (2) experimenter decisions about procedure influence the processes engaged and behaviors elicited; and (3) many processes are latent, imbuing the cue with properties that only manifest outside of the original conditioning setting. This means we could understand the complete neural basis of freezing, yet know little about the neural basis of fear. Neuroscientists can choose to use a variety of procedures to study a diversity of processes and behaviors. Manipulating neuron-type activity in multiple procedures can reveal specific, general, or complex neuron-type contributions to cue-elicited processes and behaviors. The results will be a broader and more detailed neural basis of fear with greater relevance to the spectrum of symptoms defining anxiety and stressor-related disorders.

Activation patterns of dopaminergic cell populations reflect different learning scenarios in a cichlid fish, Pseudotropheus zebra

Dopamine is present in all vertebrates and the functional roles of the subsystems are assumed to be similar. Whereas the effect of dopaminergic modulation is well investigated in different target systems, less is known about the factors that are causing the modulation of dopaminergic cells. Using the zebra mbuna, Pseudotropheus zebra, a cichlid fish from Lake Malawi as a model system, we investigated the activation of specific dopaminergic cell populations detected by double-labeling with TH and pS6 antibodies while the animals were solving different learning tasks. Specifically, we compared an intense avoidance learning situation, an instrumental learning task, and a non-learning isolated group and found strong activation of different dopaminergic cell populations. Preoptic-hypothalamic cell populations respond to the stress component in the avoidance task, and the forced movement/locomotion may be responsible for activation in the posterior tubercle. The instrumental learning task had little stress component, but the activation of the raphe superior in this group may be correlated with attention or arousal during the training sessions. At the same time, the weaker activation of the nucleus of the posterior commissure may be related to positive reward acting onto tectal circuits. Finally, we examined the co-activation patterns across all dopaminergic cell populations and recovered robust differences across experimental groups, largely driven by hypothalamic, posterior tubercle, and brain stem regions possibly encoding the valence and salience associated with stressful stimuli. Taken together, our results offer some insights into the different functions of the dopaminergic cell populations in the brain of a non-mammalian vertebrate in correlation with different behavioral conditions, extending our knowledge for a more comprehensive view of the mechanisms of dopaminergic modulation in vertebrates.

Immediate responses to ambient light in vivo reveal distinct subpopulations of suprachiasmatic VIP neurons

The circadian rhythm pacemaker, the suprachiasmatic nucleus (SCN), mediates light entrainment via vasoactive intestinal peptide (VIP) neurons (SCNVIP). Yet, how these neurons uniquely respond and connect to intrinsically photosensitive retinal ganglion cells (ipRGCs) expressing melanopsin (Opn4) has not been determined functionally in freely behaving animals. To address this, we first used monosynaptic tracing from SCNVIP neurons in mice and identified two SCNVIP subpopulations. Second, we recorded calcium changes in response to ambient light, at both bulk and single-cell levels, and found two unique activity patterns in response to high- and low-intensity blue light. The activity patterns of both subpopulations could be manipulated by application of an Opn4 antagonist. These results suggest that the two SCNVIP subpopulations connect to two types of Opn4-expressing ipRGCs, likely M1 and M2, but only one is responsive to red light. These findings have important implications for our basic understanding of non-image-forming circadian light processing.

Dorsal raphe neurons signal integrated value during multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.

Dopamine in the dorsal bed nucleus of stria terminalis signals Pavlovian sign-tracking and reward violations

Midbrain and striatal dopamine signals have been extremely well characterized over the past several decades, yet novel dopamine signals and functions in reward learning and motivation continue to emerge. A similar characterization of real-time sub-second dopamine signals in areas outside of the striatum has been limited. Recent advances in fluorescent sensor technology and fiber photometry permit the measurement of dopamine binding correlates, which can divulge basic functions of dopamine signaling in non-striatal dopamine terminal regions, like the dorsal bed nucleus of the stria terminalis (dBNST). Here, we record GRABDA signals in the dBNST during a Pavlovian lever autoshaping task. We observe greater Pavlovian cue-evoked dBNST GRABDA signals in sign-tracking (ST) compared to goal-tracking/intermediate (GT/INT) rats and the magnitude of cue-evoked dBNST GRABDA signals decreases immediately following reinforcer-specific satiety. When we deliver unexpected rewards or omit expected rewards, we find that dBNST dopamine signals encode bidirectional reward prediction errors in GT/INT rats, but only positive prediction errors in ST rats. Since sign- and goal-tracking approach strategies are associated with distinct drug relapse vulnerabilities, we examined the effects of experimenter-administered fentanyl on dBNST dopamine associative encoding. Systemic fentanyl injections do not disrupt cue discrimination but generally potentiate dBNST dopamine signals. These results reveal multiple dBNST dopamine correlates of learning and motivation that depend on the Pavlovian approach strategy employed.

Optogenetic Stimulation of Midbrain Dopamine Neurons Produces Striatal Serotonin Release

Targeting neurons with light-driven opsins is widely used to investigate cell-specific responses. We transfected midbrain dopamine neurons with the excitatory opsin Chrimson. Extracellular basal and stimulated neurotransmitter levels in the dorsal striatum were measured by microdialysis in awake mice. Optical activation of dopamine cell bodies evoked terminal dopamine release in the striatum. Multiplexed analysis of dialysate samples revealed that the evoked dopamine was accompanied by temporally coupled increases in striatal 3-methoxytyramine, an extracellular dopamine metabolite, and in serotonin. We investigated a mechanism for dopamine-serotonin interactions involving striatal dopamine receptors. However, the evoked serotonin associated with optical stimulation of dopamine neurons was not abolished by striatal D1- or D2-like receptor inhibition. Although the mechanisms underlying the coupling of striatal dopamine and serotonin remain unclear, these findings illustrate advantages of multiplexed measurements for uncovering functional interactions between neurotransmitter systems. Furthermore, they suggest that the output of optogenetic manipulations may extend beyond opsin-expressing neuronal populations.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.