Learning From One's Mistakes: A Dual Role for the Rostromedial Tegmental Nucleus in the Encoding and Expression of Punished Reward Seeking

Input-output specific orchestration of aversive valence in lateral habenula during stress dynamics

Stress has been considered as a major risk factor for depressive disorders, triggering depression onset via inducing persistent dysfunctions in specialized brain regions and neural circuits. Among various regions across the brain, the lateral habenula (LHb) serves as a critical hub for processing aversive information during the dynamic process of stress accumulation, thus having been implicated in the pathogenesis of depression. LHb neurons integrate aversive valence conveyed by distinct upstream inputs, many of which selectively innervate the medial part (LHbM) or lateral part (LHbL) of LHb. LHb subregions also separately assign aversive valence via dissociable projections to the downstream targets in the midbrain which provides feedback loops. Despite these strides, the spatiotemporal dynamics of LHb-centric neural circuits remain elusive during the progression of depression-like state under stress. In this review, we attempt to describe a framework in which LHb orchestrates aversive valence via the input-output specific neuronal architecture. Notably, a physiological form of Hebbian plasticity in LHb under multiple stressors has been unveiled to incubate neuronal hyperactivity in an input-specific manner, which causally encodes chronic stress experience and drives depression onset. Collectively, the recent progress and future efforts in elucidating LHb circuits shed light on early interventions and circuit-specific antidepressant therapies.

Emotion in action: When emotions meet motor circuits

The brain is a remarkably complex organ responsible for a wide range of functions, including the modulation of emotional states and movement. Neuronal circuits are believed to play a crucial role in integrating sensory, cognitive, and emotional information to ultimately guide motor behavior. Over the years, numerous studies employing diverse techniques such as electrophysiology, imaging, and optogenetics have revealed a complex network of neural circuits involved in the regulation of emotional or motor processes. Emotions can exert a substantial influence on motor performance, encompassing both everyday activities and pathological conditions. The aim of this review is to explore how emotional states can shape movements by connecting the neural circuits for emotional processing to motor neural circuits. We first provide a comprehensive overview of the impact of different emotional states on motor control in humans and rodents. In line with behavioral studies, we set out to identify emotion-related structures capable of modulating motor output, behaviorally and anatomically. Neuronal circuits involved in emotional processing are extensively connected to the motor system. These circuits can drive emotional behavior, essential for survival, but can also continuously shape ongoing movement. In summary, the investigation of the intricate relationship between emotion and movement offers valuable insights into human behavior, including opportunities to enhance performance, and holds promise for improving mental and physical health. This review integrates findings from multiple scientific approaches, including anatomical tracing, circuit-based dissection, and behavioral studies, conducted in both animal and human subjects. By incorporating these different methodologies, we aim to present a comprehensive overview of the current understanding of the emotional modulation of movement in both physiological and pathological conditions.

Pumping the brakes: rostromedial tegmental inhibition of compulsive cocaine seeking

Addiction is marked by aberrant decision-making and an inability to suppress inappropriate and often dangerous behaviors. We previously demonstrated that inactivation of the rostromedial tegmental nucleus (RMTg) in rats causes persistent food seeking despite impending aversive footshock, an effect strikingly similar to the punishment resistance observed in people with a history of protracted drug use [1]. Here, we extend these studies to demonstrate chemogenetic silencing of RMTg axonal projections to the ventral tegmental area (VTA) (RMTg→VTA pathway) causes rats to endure significantly more footshock to receive cocaine infusions. To further test whether activation of this circuit is sufficient to suppress reward seeking in the absence of an overtly aversive stimulus, we used temporally specific optogenetic stimulation of the RMTg→VTA pathway as a "punisher" in place of footshock following lever pressing for either food or cocaine reward. While optical stimulation of the RMTg→VTA pathway robustly suppressed lever pressing for food, we found that stimulation of this circuit had only modest effects on suppressing responding for cocaine infusions. Even though optical RMTg→VTA stimulation was not particularly effective at reducing ongoing cocaine use, this experience nevertheless had long-lasting consequences, as reinstatement of drug seeking in response to cocaine-associated cues was profoundly suppressed when tested nearly two weeks later. These results suggest the RMTg may serve as a useful target for producing enduring reductions in drug craving, particularly during periods of abstinence from drug use.

The rostromedial tegmental nucleus RMTg is not a critical site for ethanol-induced motor activation in rats

RATIONALE

Opioid drugs indirectly activate dopamine (DA) neurons in the ventral tegmental area (VTA) through a disinhibition mechanism mediated by mu opioid receptors (MORs) present both on the GABA projection neurons located in the medial tegmental nucleus/tail of the VTA (RMTg/tVTA) and on the VTA GABA interneurons. It is well demonstrated that ethanol, like opioid drugs, provokes VTA DA neuron disinhibition by interacting (through its secondary metabolite, salsolinol) with MORs present in VTA GABA interneurons, but it is not known whether ethanol could disinhibit VTA DA neurons through the MORs present in the RMTg/tVTA.

OBJECTIVES

The objective of the present study was to determine whether ethanol, directly microinjected into the tVTA/RMTg, is also able to induce VTA DA neurons disinhibition.

METHODS

Disinhibition of VTA DA neurons was indirectly assessed through the analysis of the motor activity of rats. Cannulae were placed into the tVTA/RMTg to perform microinjections of DAMGO (0.13 nmol), ethanol (150 or 300 nmol) or acetaldehyde (250 nmol) in animals pre-treated with either aCSF or the irreversible antagonist of MORs, beta-funaltrexamine (beta-FNA; 2.5 nmol). After injections, spontaneous activity was monitored for 30 min.

RESULTS

Neither ethanol nor acetaldehyde directly administered into the RMTg/tVTA were able to increase the locomotor activity of rats at doses that, in previous studies performed in the posterior VTA, were effective in increasing motor activities. However, microinjections of 0.13 nmol of DAMGO into the tVTA/RMTg significantly increased the locomotor activity of rats. These activating effects were reduced by local pre-treatment of rats with beta-FNA (2.5 nmol).

CONCLUSIONS

The tVTA/RMTg does not appear to be a key brain region for the disinhibiting action of ethanol on VTA DA neurons. The absence of dopamine in the tVTA/RMTg extracellular medium, the lack of local ethanol metabolism or both could explain the present results.

Pushing the Frontiers: Optogenetics for Illuminating the Neural Pathophysiology of Bipolar Disorder

Bipolar disorder (BD), a disabling mental disorder, is featured by the oscillation between episodes of depression and mania, along with disturbance in the biological rhythms. It is on an urgent demand to identify the intricate mechanisms of BD pathophysiology. Based on the continuous progression of neural science techniques, the dysfunction of circuits in the central nervous system was currently thought to be tightly associated with BD development. Yet, challenge exists since it depends on techniques that can manipulate spatiotemporal dynamics of neuron activity. Notably, the emergence of optogenetics has empowered researchers with precise timing and local manipulation, providing a possible approach for deciphering the pathological underpinnings of mental disorders. Although the application of optogenetics in BD research remains preliminary due to the scarcity of valid animal models, this technique will advance the psychiatric research at neural circuit level. In this review, we summarized the crucial aberrant brain activity and function pertaining to emotion and rhythm abnormities, thereby elucidating the underlying neural substrates of BD, and highlighted the importance of optogenetics in the pursuit of BD research.

Pharmacological evaluation of lateral habenula and rostromedial tegmental nucleus in the expression of ethanol-induced place preference

Although ethanol administration produces a range of physiological effects, the rewarding aspect associated with its consumption is a major contributory factor to its abuse liability. Recently, lateral habenula (LHb) has been shown to be engaged by both rewarding and aversive stimuli. Its major glutamatergic output, the fasciculus retroflexus, projects to the rostromedial tegmental nucleus (RMTg) and controls the activity of the ventral tegmental area (VTA) dopaminergic system to promote reward circuitry. While several attempts have been made to understand the relationship between LHb and addiction, there is still a lack of knowledge in relation to ethanol addiction. In the present study, by pharmacologically exacerbating or inhibiting the LHb or RMTg neuronal activity during a post-conditioning test, we investigated the role of LHb-RMTg fasciculus retroflexus in ethanol-induced reward behavior using the conditioned place preference (CPP) test. We found that activation of LHb glutamatergic system by intra-LHb administration of l-trans-2,4-pyrrolidine dicarboxylate (PDC) (glutamate transporter inhibitor) significantly decreased CPP score; on the contrary, lamotrigine (inhibits glutamate release) significantly increased CPP score and showed a rewarding effect in CPP. Instead, intra-RMTg administration of muscimol (GABAA receptor agonist) significantly increased CPP score, whereas bicuculline (GABAA antagonist) treatment decreased CPP score. In immunohistochemistry, we found that PDC administration significantly decreased, whereas lamotrigine treatment significantly increased tyrosine hydroxylase immunoreactivity (TH-ir) in VTA and nucleus accumbens (NAc). Furthermore, while intra-RMTg administration of muscimol increased, the bicuculline treatment significantly decreased the TH-ir in VTA and NAc. Together, our behavioral and immunohistochemical results signify the role of LHb and RMTg in the expression of ethanol-conditioned reward behavior.

Rostromedial tegmental nucleus nociceptin/orphanin FQ (N/OFQ) signaling regulates anxiety- and depression-like behaviors in alcohol withdrawn rats

Recent studies indicate that stimulation of the rostromedial tegmental nucleus (RMTg) can drive a negative affective state and that nociceptin/orphanin FQ (N/OFQ) may play a role in affective disorders and drug addiction. The N/OFQ precursor prepronociceptin encoding genes Pnoc are situated in RMTg neurons. To determine whether N/OFQ signaling contributes to the changes in both behavior phenotypes and RMTg activity of alcohol withdrawn (Post-EtOH) rats, we trained adult male Long-Evans rats, randomly assigned into the ethanol and Naïve groups to consume either 20% ethanol or water-only under an intermittent-access procedure. Using the fluorescence in situ hybridization technique combined with retrograde tracing, we show that the ventral tegmental area projecting RMTg neurons express Pnoc and nociceptin opioid peptide (NOP) receptors encoding gene Oprl1. Also, using the laser capture microdissection technique combined with RT-qPCR, we detected a substantial decrease in Pnoc but an increase in Oprl1 mRNA levels in the RMTg of Post-EtOH rats. Moreover, RMTg cFos expression is increased in Post-EtOH rats, which display anxiety- and depression-like behaviors. Intra-RMTg infusion of the endogenous NOP agonist nociceptin attenuates the aversive behaviors in Post-EtOH rats without causing any notable change in Naïve rats. Conversely, intra-RMTg infusion of the NOP selective antagonist [Nphe1]nociceptin(1-13)NH2 elicits anxiety- and depression-like behaviors in Naïve but not Post-EtOH rats. Furthermore, intra-RMTg infusion of nociceptin significantly reduces alcohol consumption. Thus, our results show that the deficiency of RMTg NOP signaling during alcohol withdrawal mediates anxiety- and depression-like behaviors. The intervention of NOP may help those individuals suffering from alcohol use disorders.

Innate cocaine-seeking vulnerability arising from loss of serotonin-mediated aversive effects of cocaine in rats

Cocaine blocks dopamine reuptake, thereby producing rewarding effects that are widely studied. However, cocaine also blocks serotonin uptake, which we show drives, in rats, individually variable aversive effects that depend on serotonin 2C receptors (5-HT2CRs) in the rostromedial tegmental nucleus (RMTg), a major GABAergic afferent to midbrain dopamine neurons. 5-HT2CRs produce depolarizing effects in RMTg neurons that are particularly strong in some rats, leading to aversive effects that reduce acquisition of and relapse to cocaine seeking. In contrast, 5-HT2CR signaling is largely lost after cocaine exposure in other rats, leading to reduced aversive effects and increased cocaine seeking. These results suggest a serotonergic biological marker of cocaine-seeking vulnerability that can be targeted to modulate drug seeking.

The rostromedial tegmental (RMTg) "brake" on dopamine and behavior: A decade of progress but also much unfinished work

Between 2005 and 2009, several research groups identified a strikingly dense inhibitory input to midbrain dopamine neurons arising from a previously uncharted region posterior to the ventral tegmental area (VTA). This region is now denoted as either the rostromedial tegmental nucleus (RMTg) or the "tail of the VTA" (tVTA), and is recognized to express distinct genetic markers, encode negative "prediction errors" (inverse to dopamine neurons), and play critical roles in behavioral inhibition and punishment learning. RMTg neurons are also influenced by many categories of abused drugs, and may drive some aversive responses to such drugs, particularly cocaine and alcohol. However, despite much progress, many important questions remain about RMTg molecular/genetic properties, diversity of projection targets, and applications to addiction, depression, and other neuropsychiatric disorders. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Prelimbic cortical projections to rostromedial tegmental nucleus play a suppressive role in cue-induced reinstatement of cocaine seeking

The prelimbic (PL) region of prefrontal cortex has been implicated in both driving and suppressing cocaine seeking in animal models of addiction. We hypothesized that these opposing roles for PL may be supported by distinct efferent projections. While PL projections to nucleus accumbens core have been shown to be involved in driving reinstatement of cocaine seeking, PL projections to the rostromedial tegmental nucleus (RMTg) may instead suppress reinstatement of cocaine seeking, due to the role of RMTg in behavioral inhibition. Here, we used a functional disconnection approach to temporarily disrupt the PL-RMTg pathway during cue- or cocaine-induced reinstatement. Male Sprague Dawley rats self-administered cocaine during daily 2-h sessions for ≥10 days and then underwent extinction training. Reinstatement of extinguished cocaine seeking was elicited by cocaine-associated cues or cocaine prime. Prior to reinstatement, rats received microinjections of the GABA agonists baclofen/muscimol (1/0.1 mM) into unilateral PL and the AMPA receptor antagonist NBQX (1 mM) into contralateral or ipsilateral RMTg. Functional disconnection of PL-RMTg via contralateral inactivation markedly increased cue-induced reinstatement, but did not increase cocaine-induced reinstatement or drive reinstatement of extinguished cocaine seeking in the absence of cues or cocaine. Enhanced cue-induced reinstatement was also observed with ipsilateral inactivation of PL and RMTg, but not with unilateral inactivation of PL or RMTg alone, indicating that both ipsilateral and contralateral projections from PL to RMTg have an inhibitory influence on behavior. These data further support a suppressive role for PL in cocaine seeking by implicating PL efferent projections to RMTg in inhibiting cue-induced reinstatement.

Synaptic Adaptations at the Rostromedial Tegmental Nucleus Underlie Individual Differences in Cocaine Avoidance Behavior

Although cocaine is powerfully rewarding, not all individuals are equally prone to abusing this drug. We postulate that these differences arise in part because some individuals exhibit stronger aversive responses to cocaine that protect them from cocaine seeking. Indeed, using conditioned place preference (CPP) and a runway operant cocaine self-administration task, we demonstrate that avoidance responses to cocaine vary greatly between individual high cocaine-avoider and low cocaine-avoider rats. These behavioral differences correlated with cocaine-induced activation of the rostromedial tegmental nucleus (RMTg), measured using both in vivo firing and c-fos, whereas slice electrophysiological recordings from ventral tegmental area (VTA)-projecting RMTg neurons showed that relative to low avoiders, high avoiders exhibited greater intrinsic excitability, greater transmission via calcium-permeable AMPA receptors (CP-AMPARs), and higher presynaptic glutamate release. In behaving animals, blocking CP-AMPARs in the RMTg with NASPM reduced cocaine avoidance. Hence, cocaine addiction vulnerability may be linked to multiple coordinated synaptic differences in VTA-projecting RMTg neurons.SIGNIFICANCE STATEMENT Although cocaine is highly addictive, not all individuals exposed to cocaine progress to chronic use for reasons that remain unclear. We find that cocaine's aversive effects, although less widely studied than its rewarding effects, show more individual variability, are predictive of subsequent propensity to seek cocaine, and are driven by variations in RMTg in response to cocaine that arise from distinct alterations in intrinsic excitability and glutamate transmission onto VTA-projecting RMTg neurons.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Monosynaptic Retrograde Tracing From Prelimbic Neuron Subpopulations Projecting to Either Nucleus Accumbens Core or Rostromedial Tegmental Nucleus

The prelimbic (PL) region of the medial prefrontal cortex (mPFC) has been implicated in both driving and suppressing motivated behaviors, including cocaine-seeking in rats. These seemingly opposing functions may be mediated by different efferent targets of PL projections, such as the nucleus accumbens (NAc) core and rostromedial tegmental nucleus (RMTg), which have contrasting roles in reward-seeking behaviors. We sought to characterize the anatomical connectivity differences between PL neurons projecting to NAc core and RMTg. We used conventional retrograde tracers to reveal distinct subpopulations of PL neurons projecting to NAc core vs. RMTg in rats, with very little overlap. To examine potential differences in input specificity for these two PL subpopulations, we then used Cre-dependent rabies virus (EnvA-RV-EGFP) as a monosynaptic retrograde tracer and targeted specific PL neurons via injections of retrograde CAV2-Cre in either NAc core or RMTg. We observed a similar catalog of cortical, thalamic, and limbic afferents for both NAc- and RMTg-projecting populations, with the primary source of afferent information arising from neighboring prefrontal neurons in ipsilateral PL and infralimbic cortex (IL). However, when the two subpopulations were directly compared, we found that RMTg-projecting PL neurons received a greater proportion of input from ipsilateral PL and IL, whereas NAc-projecting PL neurons received a greater proportion of input from most other cortical areas, mediodorsal thalamic nucleus, and several other subcortical areas. NAc-projecting PL neurons also received a greater proportion of contralateral cortical input. Our findings reveal that PL subpopulations differ not only in their efferent target but also in the input specificity from afferent structures. These differences in connectivity are likely to be critical to functional differences of PL subpopulations.

The ventral hippocampus is necessary for cue-elicited, but not outcome driven approach-avoidance conflict decisions: a novel operant choice decision-making task

Approach-avoidance conflict is induced when an organism encounters a stimulus that carries both positive and negative attributes. Accumulating evidence implicates the ventral hippocampus (VH) in the detection and resolution of approach-avoidance conflict, largely on the basis of maze-based tasks assaying innate and conditioned responses to situations of conflict. However, its role in discrete trial approach-avoidance decision-making has yet to be elucidated. In this study, we designed a novel cued operant conflict decision-making task in which rats were required to choose and respond for a low reward option or high reward option paired with varying shock intensities on a differential reinforcement of low rates of responding schedule. Post training, the VH was chemogenetically inhibited while animals performed the task with the usual outcomes delivered, and with the presentation of cues associated with the reward vs. conflict options only (extinction condition). We found that VH inhibition led to an avoidance of the conflict option and longer latency to choose this option when decision-making was being made on the basis of cues alone with no outcomes. Consistent with these findings, VH-inhibited animals spent more time in the central component of the elevated plus maze (EPM), indicating a potential deficit in decision-making under innate forms of approach-avoidance conflict. Taken together, these findings implicate the VH in cue-driven approach-avoidance decisions in the face of motivational conflict.

Nicotine Increases Spontaneous Glutamate Release in the Rostromedial Tegmental Nucleus

The rostromedial tegmental nucleus (RMTg) is a bilateral structure localized in the brainstem and comprise of mainly GABAergic neurons. One of the main functions of the RMTg is to regulate the activity of dopamine neurons of the mesoaccumbens pathway. Therefore, the RMTg has been proposed as a modulator of the reward system and adaptive behaviors associated to reward learning. The RMTg receives an important glutamatergic input from the lateral habenula. Also, it receives cholinergic inputs from the laterodorsal and pedunculopontine tegmental nuclei. Previously, it was reported that nicotine increases glutamate release, evoked by electric stimulation, in the RMTg nucleus. However, the mechanisms by which nicotine induces this effect were not explored. In the present work, we performed electrophysiological experiments in brainstem slices to study the effect of nicotine on spontaneous excitatory postsynaptic currents recorded from immunocytochemically identified RMTg neurons. Also, we used calcium imaging techniques to explore the effects of nicotine on multiple RMTg neurons simultaneously. We found that nicotine promotes the persistent release of glutamate through the activation of α7 nicotinic acetylcholine receptors present on glutamatergic afferents and by a mechanism involving calcium release from intracellular stores. Through these mechanisms, nicotine increases the excitability and synchronizes the activity of RMTg neurons. Our results suggest that the RMTg nucleus mediates the noxious effects of the nicotine, and it could be a potential therapeutic target against tobacco addiction.

ADHD-like behaviors caused by inactivation of a transcription factor controlling the balance of inhibitory and excitatory neuron development in the mouse anterior brainstem

The neural circuits regulating motivation and movement include midbrain dopaminergic neurons and associated inhibitory GABAergic and excitatory glutamatergic neurons in the anterior brainstem. Differentiation of specific subtypes of GABAergic and glutamatergic neurons in the mouse embryonic brainstem is controlled by a transcription factor Tal1. This study characterizes the behavioral and neurochemical changes caused by the absence of Tal1 function. The Tal1^cko mutant mice are hyperactive, impulsive, hypersensitive to reward, have learning deficits and a habituation defect in a novel environment. Only minor changes in their dopaminergic system were detected. Amphetamine induced striatal dopamine release and amphetamine induced place preference were normal in Tal1^cko mice. Increased dopamine signaling failed to stimulate the locomotor activity of the Tal1^cko mice, but instead alleviated their hyperactivity. Altogether, the Tal1^cko mice recapitulate many features of the attention and hyperactivity disorders, suggesting a role for Tal1 regulated developmental pathways and neural structures in the control of motivation and movement.

Periaqueductal Gray and Rostromedial Tegmental Inhibitory Afferents to VTA Have Distinct Synaptic Plasticity and Opiate Sensitivity

The ventral tegmental area (VTA) is a major target of addictive drugs and receives multiple GABAergic projections originating outside the VTA. We describe differences in synaptic plasticity and behavior when optogenetically driving two opiate-sensitive GABAergic inputs to the VTA, the rostromedial tegmental nucleus (RMTg), and the periaqueductal gray (PAG). Activation of GABAergic RMTg terminals in the VTA in vivo is aversive, and low-frequency stimulation induces long-term depression in vitro. Low-frequency stimulation of PAG afferents in vitro unexpectedly causes long-term potentiation. Opioid receptor activation profoundly depresses PAG and RMTg inhibitory synapses but prevents synaptic plasticity only at PAG synapses. Activation of the GABAergic PAG terminals in the VTA promotes immobility, and optogenetically-driven immobility is blocked by morphine. Our data reveal the PAG as a source of highly opioid-sensitive GABAergic afferents and support the idea that different GABAergic pathways to the VTA control distinct behaviors.

Three Rostromedial Tegmental Afferents Drive Triply Dissociable Aspects of Punishment Learning and Aversive Valence Encoding

Persistence of reward seeking despite punishment or other negative consequences is a defining feature of mania and addiction, and numerous brain regions have been implicated in such punishment learning, but in disparate ways that are difficult to reconcile. We now show that the ability of an aversive punisher to inhibit reward seeking depends on coordinated activity of three distinct afferents to the rostromedial tegmental nucleus (RMTg) arising from cortex, brainstem, and habenula that drive triply dissociable RMTg responses to aversive cues, outcomes, and prediction errors, respectively. These three pathways drive correspondingly dissociable aspects of punishment learning. The RMTg in turn drives negative, but not positive, valence encoding patterns in the ventral tegmental area (VTA). Hence, punishment learning involves pathways and functions that are highly distinct, yet tightly coordinated.

Inhibition of the rostromedial tegmental nucleus reverses alcohol withdrawal-induced anxiety-like behavior

Acute withdrawal from alcohol is associated with a number of unpleasant symptoms that play an important role in preventing recovery and long-term abstinence. Considerable research has focused on the role that neuropeptide systems and the amygdala play in mediating affective symptoms of acute withdrawal, but promising preclinical findings have not translated successfully into the clinic. The rostromedial tegmental nucleus (RMTg) has been implicated in both fear and anxiety. In addition, RMTg neurons exert inhibitory control over midbrain dopamine neurons, the activity of which are suppressed during acute withdrawal. Thus, we hypothesized that the RMTg may play a role in mediating symptoms of acute withdrawal. Using a chronic ethanol vapor exposure paradigm that renders rats physically dependent on ethanol, we observed significant withdrawal-induced enhancement of cFos expression in the RMTg. This was accompanied by a significant increase in somatic symptoms and a decrease in reward sensitivity as measured by intracranial self-stimulation (ICSS). Both measures followed a similar time course to RMTg cFos expression with peak symptom severity occurring 12 h following cessation of ethanol exposure. Heightened anxiety-like behavior was also observed in withdrawn rats at this same time point. RMTg inhibition had no effect on somatic signs of withdrawal or withdrawal-induced changes in reward sensitivity, but significantly attenuated withdrawal-induced anxiety-like behavior. Together, these data demonstrate that the RMTg plays a distinct role in the negative affective state associated with acute withdrawal and may therefore be critically involved in the neurobiological mechanisms that promote relapse during early stages of recovery.

Deconstructing value-based decision making via temporally selective manipulation of neural activity: Insights from rodent models

The ability to choose among options that differ in their rewards and costs (value-based decision making) has long been a topic of interest for neuroscientists, psychologists, and economists alike. This is likely because this is a cognitive process in which all animals (including humans) engage on a daily basis, be it routine (which road to take to work) or consequential (which graduate school to attend). Studies of value-based decision making (particularly at the preclinical level) often treat it as a uniform process. The results of such studies have been invaluable for our understanding of the brain substrates and neurochemical systems that contribute to decision making involving a range of different rewards and costs. Value-based decision making is not a unitary process, however, but is instead composed of distinct cognitive operations that function in concert to guide choice behavior. Within this conceptual framework, it is therefore important to consider that the known neural substrates supporting decision making may contribute to temporally distinct and dissociable components of the decision process. This review will describe this approach for investigating decision making, drawing from published studies that have used techniques that allow temporal dissection of the decision process, with an emphasis on the literature in animal models. The review will conclude with a discussion of the implications of this work for understanding pathological conditions that are characterized by impaired decision making.

Valence-encoding in the lateral habenula arises from the entopeduncular region

Lateral habenula (LHb) neurons are activated by negative motivational stimuli and play key roles in the pathophysiology of depression. Prior reports suggested that rostral entopeduncular nucleus (rEPN) neurons drive these responses in the LHb and rostromedial tegmental nucleus (RMTg), but these influences remain untested. Using rabies viral tracers, we demonstrate disynaptic projections from the rEPN to RMTg, but not VTA, via the LHb in rats. Using in vivo electrophysiology, we find that rEPN or LHb subpopulations exhibit activation/inhibition patterns after negative/positive motivational stimuli, similar to the RMTg, while temporary inactivation of a region centered on the rEPN decreases LHb basal and burst firing, and reduces valence-related signals in LHb neurons. Additionally, excitotoxic rEPN lesions partly diminish footshock-induced cFos in the LHb and RMTg. Together, our findings indicate an important role of the rEPN, and possibly immediately adjacent hypothalamus, in driving basal activities and valence processing in LHb and RMTg neurons.

Generality and opponency of rostromedial tegmental (RMTg) roles in valence processing

The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine (DA) neurons, has been hypothesized to be broadly activated by aversive stimuli. However, this encoding pattern has only been demonstrated for a limited number of stimuli, and the RMTg influence on ventral tegmental (VTA) responses to aversive stimuli is untested. Here, we found that RMTg neurons are broadly excited by aversive stimuli of different sensory modalities and inhibited by reward-related stimuli. These stimuli include visual, auditory, somatosensory and chemical aversive stimuli, as well as “opponent” motivational states induced by removal of sustained rewarding or aversive stimuli. These patterns are consistent with broad encoding of negative valence in a subset of RMTg neurons. We further found that valence-encoding RMTg neurons preferentially project to the DA-rich VTA versus other targets, and excitotoxic RMTg lesions greatly reduce aversive stimulus-induced inhibitions in VTA neurons, particularly putative DA neurons, while also impairing conditioned place aversion to multiple aversive stimuli. Together, our findings indicate a broad RMTg role in encoding aversion and driving VTA responses and behavior.

Behavioral and neural mechanisms underlying habitual and compulsive drug seeking

Addiction is characterized by compulsive drug use despite negative consequences. Here we review studies that indicate that compulsive drug use, and in particular punishment resistance in animal models of addiction, is related to impaired cortical control over habitual behavior. In humans and animals, instrumental behavior is supported by goal-directed and habitual systems that rely on distinct corticostriatal networks. Chronic exposure to addictive drugs or stress has been shown to bias instrumental response strategies toward habit learning, and impair prefrontal cortical (PFC) control over responding. Moreover, recent work has implicated prelimbic PFC hypofunction in the punishment resistance that has been observed in a subset of animals with an extended history of cocaine self-administration. This may be related to a broader role for prelimbic PFC in mediating adaptive responding and behavioral flexibility, including exerting goal-directed control over behavior. We hypothesize that impaired cortical control and reduced flexibility between habitual and goal-directed systems may be critically involved in the development of maladaptive, compulsive drug use.

Inhibitory Plasticity of Mesocorticolimbic Circuits in Addiction and Mental Illness

Behavioral adaptations occur through remodeling of brain circuits, as arising, for instance, from experience-dependent synaptic plasticity. Drugs of abuse and aversive stimuli, such as stress, act on the mesocorticolimbic system, dysregulating adaptive mechanisms and leading to a variety of aberrant behaviors associated with neuropsychiatric disorders. Until recently, research in the field has commonly focused on experience-dependent synaptic plasticity at excitatory synapses. However, there is growing evidence that synaptic plasticity within inhibitory circuits is an important contributor to maladaptive behaviors. We speculate that restoring normal inhibitory synaptic transmission is a promising therapeutic target for correcting some of the circuit abnormalities underlying neuropsychiatric disorders.

Gene expression and neurochemical characterization of the rostromedial tegmental nucleus (RMTg) in rats and mice

The rostromedial tegmental nucleus (RMTg), also known as the tail of the ventral tegmental area (tVTA), is a GABAergic structure identified in 2009 that receives strong inputs from the lateral habenula and other sources, sends dense inhibitory projections to midbrain dopamine (DA) neurons, and plays increasingly recognized roles in aversive learning, addiction, and other motivated behaviors. In general, little is known about the genetic identity of these neurons. However, recent work has identified the transcription factor FoxP1 as enhanced in the mouse RMTg (Lahti et al. in Development 143(3):516-529, 2016). Hence, in the current study, we used RNA sequencing to identify genes significantly enhanced in the rat RMTg as compared to adjacent VTA, and then examined the detailed distribution of two genes in particular, prepronociceptin (Pnoc) and FoxP1. In rats and mice, both Pnoc and FoxP1 were expressed at high levels in the RMTg and colocalized strongly with previously established RMTg markers. FoxP1 was particularly selective for RMTg neurons, as it was absent in most adjacent brain regions. We used these gene expression patterns to refine the anatomic characterization of RMTg in rats, extend this characterization to mice, and show that optogenetic manipulation of RMTg in mice bidirectionally modulates real-time place preference. Hence, RMTg neurons in both rats and mice exhibit distinct genetic profiles that correlate with their distinct connectivity and function.

The rostromedial tegmental nucleus modulates the development of stress-induced helpless behavior

A growing body of clinical and preclinical research suggests that structural and functional changes in the habenula, a component of the epithalamus, are associated with major depressive disorder. A major excitatory, efferent projection from the habenula targets the rostromedial tegmentum (RMTg), a mesopontine region that provides significant input to the ventral tegmentum and raphe nuclei. While the RMTg contributes to monoaminergic responses to aversive events, its role in stress-based animal models of depression has yet to be determined. In the present study, we test the hypothesis that the RMTg is a component of the circuitry mediating the development of a maladaptive behavior in which rats repeatedly exposed to inescapable footshock, fail to avoid or escape the same stressor when subsequently given the opportunity to do so. Excitotoxic lesions of the RMTg significantly diminished the frequency of these escape failures 24 h after exposure to inescapable footshock. Conversely, electrical stimulation of the Hb during the initial uncontrollable aversive event, a manipulation that enhances excitatory input to the RMTg, increased the number of trials in which subjects failed to escape an aversive stimulus when presented the option 24 h later. These complementary results provide evidence supporting a role for the RMTg in the expression of stress-induced helpless phenotype and are an important step in understanding the contribution made by this region to the development of depression-related maladaptive behaviors.

The tail of the ventral tegmental area in behavioral processes and in the effect of psychostimulants and drugs of abuse

The tail of the ventral tegmental area (tVTA) is a recently identified structure that exerts a major inhibitory drive onto midbrain dopamine (DA) neurons. Also referred to as the rostromedial tegmental nucleus (RMTg), the tVTA is a cluster of gamma-aminobutyric acid (GABA)ergic neurons that starts within the posterior end of the VTA, where it is restricted dorsolateral to the caudal part of the interpeduncular nucleus, and extends into the pons. First identified in the rat, the tVTA has been described in many species, including mice and monkeys, as a region exhibiting similar anatomical and behavioral properties; it receives strong excitatory inputs from the lateral habenula (LHb), conveys negative reward-related information, and inhibits midbrain DA neuron activity. As an important inhibitory afferent to midbrain DA neurons, the tVTA is also implicated in drug abuse and in the complex interplay between reward and aversion processes. The overarching goal of this review is to provide the current state of knowledge on the anatomy and connectivity of the tVTA and to discuss recent evidence implicating this structure in reward-related processes and in the effect of psychostimulants and drugs of abuse.

A neural pathway controlling motivation to exert effort

The neural mechanisms conferring reduced motivation, as observed in depressed individuals, is poorly understood. Here, we examine in rodents if reduced motivation to exert effort is controlled by transmission from the lateral habenula (LHb), a nucleus overactive in depressed-like states, to the rostromedial tegmental nucleus (RMTg), a nucleus that inhibits dopaminergic neurons. In an aversive test wherein immobility indicates loss of effort, LHb→RMTg transmission increased during transitions into immobility, driving LHb→RMTg increased immobility, and inhibiting LHb→RMTg produced the opposite effects. In an appetitive test, driving LHb→RMTg reduced the effort exerted to receive a reward, without affecting the reward's hedonic property. Notably, LHb→RMTg stimulation only affected specific aspects of these motor tasks, did not affect all motor tasks, and promoted avoidance, indicating that LHb→RMTg activity does not generally reduce movement but appears to carry a negative valence that reduces effort. These results indicate that LHb→RMTg activity controls the motivation to exert effort and may contribute to the reduced motivation in depression.

Synaptic function and plasticity in identified inhibitory inputs onto VTA dopamine neurons

Ventral tegmental area (VTA) dopaminergic neurons are key components of the reward pathway, and their activity is powerfully controlled by a diverse array of inhibitory GABAergic inputs. Two major sources of GABAergic nerve terminals within the VTA are local VTA interneurons and neurons in the rostromedial tegmental nucleus (RMTg). Here, using optogenetics, we compared synaptic properties of GABAergic synapses on VTA dopamine neurons using selective activation of afferents that originate from these two cell populations. We found little evidence of co-release of glutamate from either input, but RMTg-originating synaptic currents were reduced by strychnine, suggesting co-release of glycine and GABA. VTA-originating synapses displayed a lower initial release probability, and at higher frequency stimulation, short-term depression was more marked in VTA- but not RMTg-originating synapses. We previously reported that nitric oxide (NO)-induced potentiation of GABAergic synapses on VTA dopaminergic cells is lost after exposure to drugs of abuse or acute stress; in these experiments, multiple GABAergic afferents were simultaneously activated by electrical stimulation. Here we found that optogenetically-activated VTA-originating synapses on presumptive dopamine neurons also exhibited NO-induced potentiation, whereas RMTg-originating synapses did not. Despite providing a robust inhibitory input to the VTA, RMTg GABAergic synapses are most likely not those previously shown by our work to be persistently altered by addictive drugs and stress. Our work emphasises the idea that dopamine neuron excitability is controlled by diverse inhibitory inputs expected to exert varying degrees of inhibition and to participate differently in a range of behaviours.