Pedunculopontine tegmental nucleus neurons provide reward, sensorimotor, and alerting signals to midbrain dopamine neurons

Periaqueductal gray passes over disappointment and signals continuity of remaining reward expectancy

Disappointment is a vital factor in the learning and adjustment of strategies in reward-seeking behaviors. It helps them conserve energy in environments where rewards are scarce, while also increasing their chances of maximizing rewards by prompting them to escape to environments where richer rewards are anticipated (e.g., migration). However, another key factor in obtaining the reward is the ability to monitor the remaining possibilities of obtaining the outcome and to tolerate the disappointment in order to continue with subsequent actions. The periaqueductal gray (PAG) has been reported as one of the key brain regions in regulating negative emotions and escape behaviors in animals. The present study suggests that the PAG could also play a critical role in inhibiting escape behaviors and facilitating ongoing motivated behaviors to overcome disappointing events. We found that PAG activity is tonically suppressed by reward expectancy as animals engage in a task to acquire a reward outcome. This tonic suppression of PAG activity was sustained during a series of sequential task procedures as long as the expectancy of reward outcomes persisted. Notably, the tonic suppression of PAG activity showed a significant correlation with the persistence of animals' reward-seeking behavior while overcoming intermittent disappointing events. This finding highlights that the balance between distinct tonic signaling in the PAG, which signals remaining reward expectancy, and phasic signaling in the LHb, which signals disappointment, could play a crucial role in determining whether animals continue or discontinue reward-seeking behaviors when they encounter an unexpected negative event. This mechanism would be essential for animals to efficiently navigate complex environments with various reward volatilities and ultimately contributes to maximizing their reward acquisition.

Inhibition of midbrain cholinergic neurons impairs decision-making strategies during reversal learning

Introduction

The pedunculopontine nucleus (PPN) plays a role in coordinating complex behaviors and adapting to changing environmental conditions. The specific role of cholinergic neurons in PPN function is not well understood, but their ascending connectivity with basal ganglia and thalamus suggests involvement in adaptive functions.

Methods

We used a chemogenetic approach in ChAT::Cre rats to explore the specific contribution of PPN cholinergic neurons to behavioral flexibility, focusing on the adaptation to shifting reward contingencies in a Reversal Learning Task. Rats were first trained in a non-probabilistic reversal learning task, followed by a probabilistic phase to challenge their adaptive strategies under varying reward conditions.

Results

Motor functions were evaluated to confirm that behavioral observations were not confounded by motor deficits. We found that inhibition of PPN cholinergic neurons did not affect performance in the non-probabilistic condition but significantly altered the rats' ability to adapt to the probabilistic condition. Under chemogenetic inhibition, the rats showed a marked deficiency in utilizing previous trial outcomes for decision-making and an increased sensitivity to negative outcomes. Logistic regression and Q-learning models revealed that suppression of PPN cholinergic activity impaired the adaptation of decision-making strategies.

Discussion

Our results highlight the role of PPN cholinergic neurons in dynamically updating action-outcome expectations and adapting to new contingencies. The observed impairments in decision-making under PPN cholinergic inhibition align with cognitive deficits associated with cholinergic dysfunction in neurodegenerative disorders. These findings suggest that cholinergic neurons in the PPN are essential for maximizing rewards through the flexible updating of behavioral strategies.

Convergent representation of values from tactile and visual inputs for efficient goal-directed behavior in the primate putamen

Animals can discriminate diverse sensory values with a limited number of neurons, raising questions about how the brain utilizes neural resources to efficiently process multi-dimensional inputs for decision-making. Here, we demonstrate that this efficiency is achieved by reducing sensory dimensions and converging towards the value dimension essential for goal-directed behavior in the putamen. Humans and monkeys performed tactile and visual value discrimination tasks while their neural responses were examined. Value information, whether originating from tactile or visual stimuli, was found to be processed within the human putamen using fMRI. Notably, at the single-neuron level in the macaque putamen, half of the individual neurons encode values independently of sensory inputs, while the other half selectively encode tactile or visual value. The responses of bimodal value neurons correlate with value-guided finger insertion behavior in both tasks, whereas modality-selective value neurons show task-specific correlations. Simulation using these neurons reveals that the presence of bimodal value neurons enables value discrimination with a significantly reduced number of neurons compared to simulations without them. Our data indicate that individual neurons in the primate putamen process different values in a convergent manner, thereby facilitating the efficient use of constrained neural resources for value-guided behavior.

Differential cholinergic innervation of lemniscal versus non-lemniscal regions of the inferior colliculus

The inferior colliculus (IC), a midbrain hub for integration of auditory information, receives dense cholinergic input that could modulate nearly all aspects of hearing. A key step in understanding cholinergic modulation is to identify the source(s) and termination patterns of cholinergic input. These issues have not been addressed for the IC in mice, an increasingly important model for study of hearing. We examined cholinergic inputs to the IC in adult male and female mice. We used retrograde tracing and immunochemistry to identify three sources of cholinergic innervation of the mouse IC: the pedunculopontine tegmental nucleus (PPT), the laterodorsal tegmental nucleus (LDT) and the lateral paragigantocellular nucleus (LPGi). We then used Cre-dependent labeling of cholinergic neurons in normal-hearing ChAT-Cre mice to selectively label the cholinergic projections to the IC from each of the cholinergic sources. Labeling of cholinergic projections from the PPT and LDT revealed cholinergic axons and boutons terminating throughout the IC, with the ipsilateral projection being denser. Electron microscopic examination showed that these cholinergic axons can form traditional synaptic junctions with IC neurons. In separate experiments, selective labeling of cholinergic projections from the LPGi revealed bilateral projections to the IC. The LPGi axons exhibited relatively equal densities on ipsilateral and contralateral sides, but on both sides the terminations were largely restricted to the non-lemniscal regions of the IC (i.e., the dorsal cortex, lateral cortex and intercollicular tegmentum). We conclude first that cholinergic axons can form traditional synapses in the IC. In addition, lemniscal and non-lemniscal regions of the IC receive different patterns of cholinergic innervation. The lemniscal IC (IC central nucleus) is innervated by cholinergic neurons in the PPT and the LDT whereas the non-lemniscal "shell" areas of the IC are innervated by the PPT and LDT and by cholinergic neurons in the LPGi. DATA AVAILABILITY: Data will be made available on request.

Distinct cholinergic circuits underlie discrete effects of reward on attention

Attention and reward are functions that are critical for the control of behavior, and massive multi-region neural systems have evolved to support the discrete computations associated with each. Previous research has also identified that attention and reward interact, though our understanding of the neural mechanisms that mediate this interplay is incomplete. Here, we review the basic neuroanatomy of attention, reward, and cholinergic systems. We then examine specific contexts in which attention and reward computations interact. Building on this work, we propose two discrete neural circuits whereby acetylcholine, released from cell groups located in different parts of the brain, mediates the impact of stimulus-reward associations as well as motivation on attentional control. We conclude by examining these circuits as a potential shared loci of dysfunction across diseases states associated with deficits in attention and reward.

Mixed Representations of Sound and Action in the Auditory Midbrain

Linking sensory input and its consequences is a fundamental brain operation. During behavior, the neural activity of neocortical and limbic systems often reflects dynamic combinations of sensory and task-dependent variables, and these "mixed representations" are suggested to be important for perception, learning, and plasticity. However, the extent to which such integrative computations might occur outside of the forebrain is less clear. Here, we conduct cellular-resolution two-photon Ca2+ imaging in the superficial "shell" layers of the inferior colliculus (IC), as head-fixed mice of either sex perform a reward-based psychometric auditory task. We find that the activity of individual shell IC neurons jointly reflects auditory cues, mice's actions, and behavioral trial outcomes, such that trajectories of neural population activity diverge depending on mice's behavioral choice. Consequently, simple classifier models trained on shell IC neuron activity can predict trial-by-trial outcomes, even when training data are restricted to neural activity occurring prior to mice's instrumental actions. Thus, in behaving mice, auditory midbrain neurons transmit a population code that reflects a joint representation of sound, actions, and task-dependent variables.

The mesopontine tegmentum in reward and aversion: From cellular heterogeneity to behaviour

The mesopontine tegmentum, comprising the pedunculopontine tegmentum (PPN) and the laterodorsal tegmentum (LDT), is intricately connected to various regions of the basal ganglia, motor systems, and limbic systems. The PPN and LDT can regulate the activity of different brain regions of these target systems, and in this way are in a privileged position to modulate motivated behaviours. Despite recent findings, the PPN and LDT have been largely overlooked in discussions about the neural circuits associated with reward and aversion. This review aims to provide a timely and comprehensive resource on past and current research, highlighting the PPN and LDT's connectivity and influence on basal ganglia and limbic, and motor systems. Seminal studies, including lesion, pharmacological, and optogenetic/chemogenetic approaches, demonstrate their critical roles in modulating reward/aversive behaviours. The review emphasizes the need for further investigation into the associated cellular mechanisms, in order to clarify their role in behaviour and contribution for different neuropsychiatric disorders.

Neurobiological and psychological factors to depression

Major Depressive Disorder (MDD) is a common condition with complex psychological and biological background. While its aetiology is still unclear, chronic stress stands amongst major risk factors to MDD pathogenesis. When researching on MDD, it is necessary to be familiar with the neurobiological effects of several prominent contributors to the chronic stress factor experienced across hypothalamic-pituitary-adrenal (HPA) axis, neurotransmission, immune system reflexivity, and genetic alterations. Bi-directional flow of MDD pathogenesis suggests that psychological factors produce biological effects. Here, a summary of how the MDD expresses its mechanisms of action across an overactive HPA axis, the negative impacts of reduced neurotransmitter functions, the inflammatory responses and their gene x environment interactions. This paper builds on these conceptual factors and their input towards the MDD symptomatology with a purpose of synthesising the current findings and create an integrated view of the MDD pathogenesis. Finally, relevant treatment implications will be summarised, along with recommendations to a multimodal clinical practice.

A dopamine mechanism for reward maximization

Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.

Inhibiting cholinergic signalling in the cerebellar interpositus nucleus impairs motor behaviour

The role of neuromodulators in the cerebellum is not well understood. In particular, the behavioural significance of the cholinergic system in the cerebellum is unknown. To investigate the importance of cerebellar cholinergic signalling in behaviour, we infused acetylcholine receptor antagonists, scopolamine and mecamylamine, bilaterally into the rat cerebellum (centred on interpositus nucleus) and observed the motor effects through a battery of behavioural tests. These tests included unrewarded behaviour during open field exploration and a horizontal ladder walking task and reward-based beam walking and pellet reaching tasks. Infusion of a mix of the antagonists did not impair motor learning in the horizontal ladder walking or the reaching task but reduced spontaneous movement during open field exploration, impaired coordination during beam walking and ladder walking, led to fewer reaches in the pellet reaching task, slowed goal-directed reaching behaviour and reduced reward pellet consumption in a free access to food task. Infusion of the muscarinic antagonist scopolamine on its own resulted in deficits in motor performance and a reduction in the number of reward pellets consumed in the free access to food task. By contrast, infusion of the nicotinic antagonist mecamylamine on its own had no significant effect on any task, except beam walking traversal time, which was reduced. Together, these data suggest that acetylcholine in the cerebellar interpositus nucleus is important for the execution and coordination of voluntary movements mainly via muscarinic receptor signalling, especially in relation to reward-related behaviour.

The Basal Ganglia and Mesencephalic Locomotor Region Connectivity Matrix

Although classically considered a relay station for basal ganglia (BG) output, the anatomy, connectivity, and function of the mesencephalic locomotor region (MLR) were redefined during the last two decades. In striking opposition to what was initially thought, MLR and BG are actually reciprocally and intimately interconnected. New viral-based, optogenetic, and mapping technologies revealed that cholinergic, glutamatergic, and GABAergic neurons coexist in this structure, which, in addition to extending descending projections, send long-range ascending fibers to the BG. These MLR projections to the BG convey motor and non-motor information to specific synaptic targets throughout different nuclei. Moreover, MLR efferent fibers originate from precise neuronal subpopulations located in particular MLR subregions, defining independent anatomo-functional subcircuits involved in particular aspects of animal behavior such as fast locomotion, explorative locomotion, posture, forelimb- related movements, speed, reinforcement, among others. In this review, we revised the literature produced during the last decade linking MLR and BG. We conclude that the classic framework considering the MLR as a homogeneous output structure passively receiving input from the BG needs to be revisited. We propose instead that the multiple subcircuits embedded in this region should be taken as independent entities that convey relevant and specific ascending information to the BG and, thus, actively participate in the execution and tuning of behavior.

Inhibitory Pedunculopontine Neurons Gate Dopamine-Mediated Motor Actions of Unsigned Valence

BACKGROUND

The pedunculopontine nucleus (PPN) maintains a bidirectional connectivity with the basal ganglia that supports their shared roles in the selection and execution of motor actions. Previous studies identified a role for PPN neurons in goal-directed behavior, but the cellular substrates underlying this function have not been elucidated. We recently revealed the existence of a monosynaptic GABAergic input from the PPN that inhibits dopamine neurons of the substantia nigra. Activation of this pathway interferes with the execution of learned motor sequences when the actions are rewarded, even though the inhibition of dopamine neurons did not shift the value of the action, hence suggesting executive control over the gating of behavior.

OBJECTIVE

To test the attributes of the inhibition of dopamine neurons by the PPN in the context of goal-directed behavior regardless of whether the outcome is positively or negatively reinforced.

METHODS

We delivered optogenetic stimulation to PPN GABAergic axon terminals in the substantia nigra during a battery of behavioral tasks with positive and negative valence.

RESULTS

Inhibition of dopamine neurons by PPN optogenetic activation during an appetitive task impaired the initiation and overall execution of the behavioral sequence without affecting the consumption of reward. During an active avoidance task, the same activation impaired the ability of mice to avoid a foot shock, but their escape response was unaffected. In addition, responses to potential threats were significantly attenuated.

CONCLUSION

Our results show that PPN GABAergic neurons modulate learned, goal-directed behavior of unsigned valence without affecting overall motor behavior.

Updates on brain regions and neuronal circuits of movement disorders in Parkinson's disease

Parkinson's disease (PD) is a progressive neurodegenerative disease with a global burden that affects more often in the elderly. The basal ganglia (BG) is believed to account for movement disorders in PD. More recently, new findings in the original regions in BG involved in motor control, as well as the new circuits or new nucleuses previously not specifically considered were explored. In the present review, we provide up-to-date information related to movement disorders and modulations in PD, especially from the perspectives of brain regions and neuronal circuits. Meanwhile, there are updates in deep brain stimulation (DBS) and other factors for the motor improvement in PD. Comprehensive understandings of brain regions and neuronal circuits involved in motor control could benefit the development of novel therapeutical strategies in PD.

Mixed representations of sound and action in the auditory midbrain

Linking sensory input and its consequences is a fundamental brain operation. Accordingly, neural activity of neo-cortical and limbic systems often reflects dynamic combinations of sensory and behaviorally relevant variables, and these "mixed representations" are suggested to be important for perception, learning, and plasticity. However, the extent to which such integrative computations might occur in brain regions upstream of the forebrain is less clear. Here, we conduct cellular-resolution 2-photon Ca2+ imaging in the superficial "shell" layers of the inferior colliculus (IC), as head-fixed mice of either sex perform a reward-based psychometric auditory task. We find that the activity of individual shell IC neurons jointly reflects auditory cues and mice's actions, such that trajectories of neural population activity diverge depending on mice's behavioral choice. Consequently, simple classifier models trained on shell IC neuron activity can predict trial-by-trial outcomes, even when training data are restricted to neural activity occurring prior to mice's instrumental actions. Thus in behaving animals, auditory midbrain neurons transmit a population code that reflects a joint representation of sound and action.

Muscarinic and NMDA Receptors in the Substantia Nigra Play a Role in Reward-Related Learning

BACKGROUND

Reward-related learning, where animals form associations between rewards and stimuli (i.e., conditioned stimuli [CS]) that predict or accompany those rewards, is an essential adaptive function for survival.

METHODS

In this study, we investigated the mechanisms underlying the acquisition and performance of conditioned approach learning with a focus on the role of muscarinic acetylcholine (mACh) and NMDA glutamate receptors in the substantia nigra (SN), a brain region implicated in reward and motor processes.

RESULTS

Using RNAscope in situ hybridization assays, we found that dopamine neurons of the SN express muscarinic (mACh5), NMDA2a, NMDA2b, and NMDA2d receptor mRNA but not mACh4. NMDA, but not mACh5, receptor mRNA was also found on SN GABA neurons. In a conditioned approach paradigm, rats were exposed to 3 or 7 conditioning sessions during which light/tone (CS) presentations were paired with delivery of food pellets, followed by a test session with CS-only presentations. Intra-SN microinjections of scopolamine (a mACh receptor antagonist) or AP-5 (a NMDA receptor antagonist) were made either prior to each conditioning session (to test their effects on acquisition) or prior to the CS-only test (to test their effects on expression of the learned response). Scopolamine and AP-5 produced dose-dependent significant reductions in the acquisition, but not performance, of conditioned approach.

CONCLUSIONS

These results suggest that SN mACh and NMDA receptors are key players in the acquisition, but not the expression, of reward-related learning. Importantly, these findings redefine the role of the SN, which has traditionally been known for its involvement in motor processes, and suggest that the SN possesses attributes consistent with a function as a hub of integration of primary reward and CS signals.

Apathy in Parkinson's Disease: Defining the Park Apathy Subtype

Apathy is a neurobehavioural symptom affecting Parkinson's disease patients of all disease stages. Apathy seems to be associated with a specific underlying non-motor disease subtype and reflects dysfunction of separate neural networks with distinct neurotransmitter systems. Due to the complicated neuropsychiatric aetiology of apathy, clinical assessment of this invalidating non-motor symptom remains challenging. We aim to summarize the current findings on apathy in Parkinson's disease and highlight knowledge gaps. We will discuss the prevalence rates across the different disease stages and suggest screening tools for clinically relevant apathetic symptoms. We will approach the fundamental knowledge on the neural networks implicated in apathy in a practical manner and formulate recommendations on patient-tailored treatment. We will discuss the Park apathy phenotype in detail, shedding light on different clinical manifestations and implications for prognosis. With this review, we strive to distil the vast available theoretical knowledge into a clinical and patient-oriented perspective.

A VTA GABAergic computational model of dissociated reward prediction error computation in classical conditioning

Classical Conditioning is a fundamental learning mechanism where the Ventral Striatum is generally thought to be the source of inhibition to Ventral Tegmental Area (VTA) Dopamine neurons when a reward is expected. However, recent evidences point to a new candidate in VTA GABA encoding expectation for computing the reward prediction error in the VTA. In this system-level computational model, the VTA GABA signal is hypothesised to be a combination of magnitude and timing computed in the Peduncolopontine and Ventral Striatum respectively. This dissociation enables the model to explain recent results wherein Ventral Striatum lesions affected the temporal expectation of the reward but the magnitude of the reward was intact. This model also exhibits other features in classical conditioning namely, progressively decreasing firing for early rewards closer to the actual reward, twin peaks of VTA dopamine during training and cancellation of US dopamine after training.

Cholinergic neurons in the pedunculopontine nucleus guide reversal learning by signaling the changing reward contingency

Cognitive flexibility enables effective switching between mental processes to generate appropriate responses. Cholinergic neurons (CNs) within the pedunculopontine nucleus (PPN) are associated with many functions, but their contribution to cognitive flexibility remains poorly understood. Here we measure PPN cholinergic activities using calcium indicators during the attentional set-shifting task. We find that PPN CNs exhibit increasing activities correlated with rewards during each stage and error trials in reversal stages, indicating sensitivity to rule switching. Inhibition of PPN cholinergic activity selectively impairs reversal learning, which improves with PPN CN activation. Activation of PPN CNs projecting to the substantia nigra pars compacta, mediodorsal thalamus, and parafascicular nucleus in a time-locked manner with reward improves reversal learning. Therefore, PPN CNs may encode not only reward signals but also the information of changing reward contingency that contributes to guiding reversal learning through output projections to multiple nuclei that participate in flexibility.

A Causal Role for the Pedunculopontine Nucleus in Human Instrumental Learning

A critical mechanism for maximizing reward is instrumental learning. In standard instrumental learning models, action values are updated on the basis of reward prediction errors (RPEs), defined as the discrepancy between expectations and outcomes. A wealth of evidence across species and experimental techniques has established that RPEs are signaled by midbrain dopamine neurons. However, the way dopamine neurons receive information about reward outcomes remains poorly understood. Recent animal studies suggest that the pedunculopontine nucleus (PPN), a small brainstem structure considered as a locomotor center, is sensitive to reward and sends excitatory projection to dopaminergic nuclei. Here, we examined the hypothesis that the PPN could contribute to reward learning in humans. To this aim, we leveraged a clinical protocol that assessed the therapeutic impact of PPN deep-brain stimulation (DBS) in three patients with Parkinson disease. PPN local field potentials (LFPs), recorded while patients performed an instrumental learning task, showed a specific response to reward outcomes in a low-frequency (alpha-beta) band. Moreover, PPN DBS selectively improved learning from rewards but not from punishments, a pattern that is typically observed following dopaminergic treatment. Computational analyses indicated that the effect of PPN DBS on instrumental learning was best captured by an increase in subjective reward sensitivity. Taken together, these results support a causal role for PPN-mediated reward signals in human instrumental learning.

Modulation of Dopamine for Adaptive Learning: A Neurocomputational Model

There have been many proposals that learning rates in the brain are adaptive, in the sense that they increase or decrease depending on environmental conditions. The majority of these models are abstract and make no attempt to describe the neural circuitry that implements the proposed computations. This article describes a biologically detailed computational model that overcomes this shortcoming. Specifically, we propose a neural circuit that implements adaptive learning rates by modulating the gain on the dopamine response to reward prediction errors, and we model activity within this circuit at the level of spiking neurons. The model generates a dopamine signal that depends on the size of the tonically active dopamine neuron population and the phasic spike rate. The model was tested successfully against results from two single-neuron recording studies and a fast-scan cyclic voltammetry study. We conclude by discussing the general applicability of the model to dopamine mediated tasks that transcend the experimental phenomena it was initially designed to address.

Long-Term Value Memory in the Primate Posterior Thalamus for Fast Automatic Action

The thalamus is known to process information from various brain regions and relay it to other brain regions, serving an essential role in sensory perception and motor execution. The thalamus also receives inputs from basal ganglia nuclei (BG) involved in value-based decision making, suggesting a role in the value process. We found that neurons in a particular area of the rhesus macaque posterior thalamus encoded the historical value memory of visual objects. Many of these value-coding neurons were located in the suprageniculate nucleus (SGN). This thalamic area directly received anatomical input from the superior colliculus (SC), and the neurons showed visual responses with contralateral preferences. Notably, the value discrimination activity of these thalamic neurons increased during learning, with the learned values stably retained even more than 200 days after learning. Our data indicate that single neurons in the posterior thalamus not only processed simple visual information but also represented historical values. Furthermore, our data suggest an SC-posterior thalamus-BG-SC subcortical loop circuit that encodes the historical value, enabling a quick automatic gaze by bypassing the visual cortex.

Human decisions about when to act originate within a basal forebrain-nigral circuit

Decision-making studies often focus on brain mechanisms for selecting between goals and actions; however, another important, and often neglected, aspect of decision-making in humans concerns whether, at any given point in time, it is worth making any action at all. We showed that a considerable portion of the variance in when voluntary actions are emitted can be explained by a simple model that that takes into account key features of the current environment. By using ultrahigh-field MRI we identified a multilayered circuit in the human brain originating far beyond the medial frontal areas typically linked to human voluntary action starting in the basal forebrain and brain stem, converging in the dopaminergic midbrain, and only then projecting to striatum and cortex.

Decisions about when to act are critical for survival in humans as in animals, but how a desire is translated into the decision that an action is worth taking at any particular point in time is incompletely understood. Here we show that a simple model developed to explain when animals decide it is worth taking an action also explains a significant portion of the variance in timing observed when humans take voluntary actions. The model focuses on the current environment’s potential for reward, the timing of the individual’s own recent actions, and the outcomes of those actions. We show, by using ultrahigh-field MRI scanning, that in addition to anterior cingulate cortex within medial frontal cortex, a group of subcortical structures including striatum, substantia nigra, basal forebrain (BF), pedunculopontine nucleus (PPN), and habenula (HB) encode trial-by-trial variation in action time. Further analysis of the activity patterns found in each area together with psychophysiological interaction analysis and structural equation modeling suggested a model in which BF integrates contextual information that will influence the decision about when to act and communicates this information, in parallel with PPN and HB influences, to nigrostriatal circuits. It is then in the nigrostriatal circuit that action initiation per se begins.

Cholinergic midbrain afferents modulate striatal circuits and shape encoding of action strategies

Assimilation of novel strategies into a consolidated action repertoire is a crucial function for behavioral adaptation and cognitive flexibility. Acetylcholine in the striatum plays a pivotal role in such adaptation, and its release has been causally associated with the activity of cholinergic interneurons. Here we show that the midbrain, a previously unknown source of acetylcholine in the striatum, is a major contributor to cholinergic transmission in the striatal complex. Neurons of the pedunculopontine and laterodorsal tegmental nuclei synapse with striatal cholinergic interneurons and give rise to excitatory responses. Furthermore, they produce uniform inhibition of spiny projection neurons. Inhibition of acetylcholine release from midbrain terminals in the striatum impairs the association of contingencies and the formation of habits in an instrumental task, and mimics the effects observed following inhibition of acetylcholine release from striatal cholinergic interneurons. These results suggest the existence of two hierarchically-organized modes of cholinergic transmission in the striatum, where cholinergic interneurons are modulated by cholinergic neurons of the midbrain.

Microinjection of urotensin II into the pedunculopontine tegmentum leads to an increase in the consumption of sweet tastants

The pedunculopontine tegmentum (PPTg) plays a role in processing multiple sensory inputs and innervates brain regions associated with reward-related behaviors. The urotensin II receptor, activated by the urotensin II peptide (UII), is selectively expressed by the cholinergic neurons of the PPTg. Although the exact function of cholinergic neurons of the PPTg is unknown, they are thought to contribute to the perception of reward magnitude or salience detection. We hypothesized that the activation of PPTg cholinergic neurons would alter sensory processing across multiple modalities (ex. taste and hearing). Here we had three aims: first, determine if cholinergic activation is involved in consumption behavior of palatable solutions (sucrose). Second, if so, distinguish the impact of the caloric value by using saccharin, a zero calorie sweetener. Lastly, we tested the UII-mediated effects on perception of acoustic stimuli by measuring acoustic startle reflex (ASR). Male Sprague-Dawley rats were bilaterally cannulated into the PPTg, then placed under food restriction lasting the entire consumption experiment (water ad lib.). Treatment consisted of a microinjection of either 1 μL of aCSF or 1 μL of 10 μM UII into the PPTg, and the rats were immediately given access to either sucrose or saccharin. For the remaining five days, rats were allowed one hour access per day to the same sweet solution without any further treatments. During the saccharin experiment rats were tested in a contact lickometer which recorded each individual lick to give insight into the microstructure of the consumption behavior. ASR testing consisted of a baseline (no treatment), treatment day, and two additional days (no treatment). Immediately following the microinjection of UII, consumption of both saccharin and sucrose increased compared to controls. This significant increase persisted for days after the single administration of UII, but there was no generalized arousal or increase in water consumption between testing sessions. The effects on ASR were not significant. Activating cholinergic PPTg neurons may lead to a miscalculation of the salience of external stimuli, implicating the importance of cholinergic input in modulating a variety of behaviors. The long-lasting effects seen after UII treatment support further research into the role of sensory processing on reward related-behaviors at the level of the PPTg cholinergic neurons.

NMDA receptor modulation of the pedunculopontine tegmental nucleus underlies the motivational drive for feeding induced by midbrain dopaminergic neurons

The mesolimbic system, particularly the somatodendritic ventral tegmental area (VTA), is responsible for the positive reinforcing aspects of various homeostatic stimuli. In turn, the pedunculopontine tegmental nucleus (PPN) is anatomically and functionally connected with the VTA and substantia nigra (SN). In the present study, we investigated the role of glutamate receptors in the PPN in motivated behaviors by using a model of feeding induced by electrical stimulation of the VTA in male Wistar rats (n = 80). We found that injection of 2.5/5 µg dizocilpine (MK-801; NMDA receptor antagonist) to the PPN significantly reduced the feeding response induced by unilateral VTA-stimulation. This reaction was significantly impaired after local injection of MK-801 into the PPN in the ipsilateral rather than the contralateral hemisphere. After NMDA injection (2/3 µg) to the PPN we did not observe behavioral changes, only a trend of a lengthening/shortening of the latency to a feeding reaction at the highest dose of NMDA (3 µg). Immunohistochemical TH+/c-Fos+ analysis revealed a decrease in the number of TH+ cells in the midbrain (VTA-SN) in all experimental groups and altered activity of c-Fos+ neurons in selected brain structures depending on drug type (MK-801/NMDA) and injection site (ipsi-/contralateral hemisphere). Additionally, the pattern of TH+/c-Fos+ expression showed lateralization of feeding circuit functional connectivity. We conclude that the level of NMDA receptor arousal in the PPN regulates the activity of the midbrain dopaminergic cells, and the PPN-VTA circuit may be important in the regulation of motivational aspects of food intake.

Songbird Ventral Pallidum Sends Diverse Performance Error Signals to Dopaminergic Midbrain

Motor skills improve with practice, requiring outcomes to be evaluated against ever-changing performance benchmarks, yet it remains unclear how performance error signals are computed. Here, we show that the songbird ventral pallidum (VP) is required for song learning and sends diverse song timing and performance error signals to the ventral tegmental area (VTA). Viral tracing revealed inputs to VP from auditory and vocal motor thalamus, auditory and vocal motor cortex, and VTA. Our findings show that VP circuits, commonly associated with hedonic functions, signal performance error during motor sequence learning.

Predominant Striatal Input to the Lateral Habenula in Macaques Comes from Striosomes

Striosomes, neurochemically specialized modules in the striatum, are thought to be nodes in circuits extending, via basal ganglia pathways, from mood-related neocortical regions to dopamine-containing neurons of the substantia nigra. Yet striosomes have remained beyond the reach of electrophysiological methods to identify them, especially in non-human primates. Such work is needed for translational as well as for basic science. Here we introduce a method to identify striosomes on-line in awake, behaving macaques. We combined electrical microstimulation of the striatum with simultaneous electrophysiological recording in the lateral habenula (LHb) followed by immunohistochemistry. We demonstrate that striosomes provide the predominant striatal input to the macaque pallido-habenular circuit, which is known to function in relation to reinforcement signaling. Further, our experiments suggest that striosomes from different striatal regions may convergently influence the lateral habenula. This work now opens the way to defining the functions of striosomes in behaving primates in relation to mood, motivation, and action.

Dynamical ventral tegmental area circuit mechanisms of alcohol-dependent dopamine release

A large body of data has identified numerous molecular targets through which ethanol (EtOH) acts on brain circuits. Yet how these multiple mechanisms interact to result in dysregulated dopamine (DA) release under the influence of alcohol in vivo remains unclear. In this manuscript, we delineate potential circuit-level mechanisms responsible for EtOH-dependent dysregulation of DA release from the ventral tegmental area (VTA) into its projection areas. For this purpose, we constructed a circuit model of the VTA that integrates realistic Glutamatergic (Glu) inputs and reproduces DA release observed experimentally. We modelled the concentration-dependent effects of EtOH on its principal VTA targets. We calibrated the model to reproduce the inverted U-shape dose dependence of DA neuron activity on EtOH concentration. The model suggests a primary role of EtOH-induced boost in the I_h and AMPA currents in the DA firing-rate/bursting increase. This is counteracted by potentiated GABA transmission that decreases DA neuron activity at higher EtOH concentrations. Thus, the model connects well-established in vitro pharmacological EtOH targets with its in vivo influence on neuronal activity. Furthermore, we predict that increases in VTA activity produced by moderate EtOH doses require partial synchrony and relatively low rates of the Glu afferents. We propose that the increased frequency of transient (phasic) DA peaks evoked by EtOH results from synchronous population bursts in VTA DA neurons. Our model predicts that the impact of acute ETOH on dopamine release is critically shaped by the structure of the cortical inputs to the VTA.

What is the therapeutic mechanism of pedunculopontine nucleus stimulation in Parkinson's disease?

Pedunculopontine nucleus (PPN) deep brain stimulation (DBS) is an experimental treatment for Parkinson's disease (PD) which offers a fairly circumscribed benefit for gait freezing and perhaps balance impairment. The benefit on gait freezing is variable and typically incomplete, which may reflect that the clinical application is yet to be optimised or reflect a fundamental limitation of the therapeutic mechanism. Thus, a better understanding of the therapeutic mechanism of PPN DBS may guide the further development of this therapy. The available evidence supports that the PPN is underactive in PD due to a combination of both degeneration and excessive inhibition. Low frequency PPN DBS could enhance PPN network activity, perhaps via disinhibition. A clinical implication is that in some PD patients, the PPN may be too degenerate for PPN DBS to work. Reaction time studies report that PPN DBS mediates a very specific benefit on pre-programmed movement. This seems relevant to the pathophysiology of gait freezing, which can be argued to reflect impaired release of pre-programmed adjustments to locomotion. Thus, the benefit of PPN DBS on gait freezing could be akin to that mediated by external cues. Alpha band activity is a prominent finding in local field potential recordings from PPN electrodes in PD patients. Alpha band activity is implicated in the suppression of task irrelevant processes and thus the effective allocation of attention (processing resources). Attentional deficits are prominent in patients with PD and gait freezing and PPN alpha activity has been observed to drop out prior to gait freezing episodes and to increase with levodopa. This raises the hypothesis that PPN DBS could support or emulate PPN alpha activity and consequently enhance the allocation of attention. Although PPN DBS has not been convincingly shown to increase general alertness or attention, it remains possible that PPN DBS may enhance the allocation of processing resources within the motor system, or "motor attention". For example, this could facilitate the 'switching' of motor state between continuation of pattern generated locomotion towards the intervention of pre-programmed adjustments. However, if the downstream consequence of PPN DBS on movement is limited to a circumscribed unblocking of pre-programmed movement, then this may have a similarly circumscribed degree of benefit for gait. If this is the case, then it may be possible to identify patients who may benefit most from PPN DBS. For example, those in whom pre-programmed deficits are the major contributors to gait freezing.

Novelty-Sensitive Dopaminergic Neurons in the Human Substantia Nigra Predict Success of Declarative Memory Formation

The encoding of information into long-term declarative memory is facilitated by dopamine. This process depends on hippocampal novelty signals, but it remains unknown how midbrain dopaminergic neurons are modulated by declarative-memory-based information. We recorded individual substantia nigra (SN) neurons and cortical field potentials in human patients performing a recognition memory task. We found that 25% of SN neurons were modulated by stimulus novelty. Extracellular waveform shape and anatomical location indicated that these memory-selective neurons were putatively dopaminergic. The responses of memory-selective neurons appeared 527 ms after stimulus onset, changed after a single trial, and were indicative of recognition accuracy. SN neurons phase locked to frontal cortical theta-frequency oscillations, and the extent of this coordination predicted successful memory formation. These data reveal that dopaminergic neurons in the human SN are modulated by memory signals and demonstrate a progression of information flow in the hippocampal-basal ganglia-frontal cortex loop for memory encoding.

Direct localisation of the human pedunculopontine nucleus using MRI: a coordinate and fibre-tracking study

OBJECTIVES

To image the pedunculopontine tegmental nucleus (PPN), a deep brain stimulation (DBS) target for Parkinson disease, using MRI with validated results.

METHODS

This study used the MP2RAGE sequence with high resolution and enhanced grey-white matter contrast on a 7-T ultra-high-field MRI system to image the PPN as well as a diffusion spectrum imaging method on a 3-T MRI system to reconstruct the main fibre systems surrounding the PPN. The coordinates of the rostral and caudal PPN poles of both sides were measured in relation to the third and fourth ventricular landmarks on the 7-T image.

RESULTS

The boundary of the PPN was delineated, and showed morphology consistent with previous histological works. The main fibres around the PPN were reconstructed. The pole coordinate results combined with the fibre spatial relationships validate the imaging results.

CONCLUSIONS

A practical protocol is provided to directly localise the PPN using MRI; the position and morphology of the PPN can be obtained and validated by locating its poles relative to two ventricular landmarks and by inspecting its spatial relationship with the surrounding fibre systems. This technique can be potentially used in clinics to define the boundary of the PPN before DBS surgery for treatment of Parkinson disease in a more precise and reliable manner.

KEY POINTS

• Combined information helps localise the PPN as a DBS target for PD patients • Scan the PPN at 7 T and measure its coordinates against different ventricular landmarks • Reconstruct the main fibres around the PPN using diffusion spectrum imaging.

Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments

Neuromodulatory systems, including the noradrenergic, serotonergic, dopaminergic, and cholinergic systems, track environmental signals, such as risks, rewards, novelty, effort, and social cooperation. These systems provide a foundation for cognitive function in higher organisms; attention, emotion, goal-directed behavior, and decision-making derive from the interaction between the neuromodulatory systems and brain areas, such as the amygdala, frontal cortex, hippocampus, and sensory cortices. Given their strong influence on behavior and cognition, these systems also play a key role in disease states and are the primary target of many current treatment strategies. The fact that these systems interact with each other either directly or indirectly, however, makes it difficult to understand how a failure in one or more systems can lead to a particular symptom or pathology. In this review, we explore experimental evidence, as well as focus on computational and theoretical models of neuromodulation. Better understanding of neuromodulatory systems may lead to the development of novel treatment strategies for a number of brain disorders.

Dopamine Neurons, Input Integration, and Reward Prediction Errors: E Pluribus Unum

Dopamine neurons encode errors in reward prediction, yet understanding how they integrate information from different subcortical inputs to generate these signals has remained elusive. In this issue of Neuron, Tian et al. (2016) shed new light onto these underlying mechanisms.

Pedunculopontine glutamatergic neurons control spike patterning in substantia nigra dopaminergic neurons

Burst spiking in substantia nigra pars compacta (SNc) dopaminergic neurons is a key signaling event in the circuitry controlling goal-directed behavior. It is widely believed that this spiking mode depends upon an interaction between synaptic activation of N-methyl-D-aspartate receptors (NMDARs) and intrinsic oscillatory mechanisms. However, the role of specific neural networks in burst generation has not been defined. To begin filling this gap, SNc glutamatergic synapses arising from pedunculopotine nucleus (PPN) neurons were characterized using optical and electrophysiological approaches. These synapses were localized exclusively on the soma and proximal dendrites, placing them in a good location to influence spike generation. Indeed, optogenetic stimulation of PPN axons reliably evoked spiking in SNc dopaminergic neurons. Moreover, burst stimulation of PPN axons was faithfully followed, even in the presence of NMDAR antagonists. Thus, PPN-evoked burst spiking of SNc dopaminergic neurons in vivo may not only be extrinsically triggered, but extrinsically patterned as well.

Rethinking the Pedunculopontine Nucleus: From Cellular Organization to Function

The pedunculopontine nucleus (PPN) has long been considered an interface between the basal ganglia and motor systems, and its ability to regulate arousal states puts the PPN in a key position to modulate behavior. Despite the large amount of data obtained over recent decades, a unified theory of its function is still incomplete. By putting together classical concepts and new evidence that dissects the influence of its different neuronal subtypes on their various targets, we propose that the PPN and, in particular, cholinergic neurons have a central role in updating the behavioral state as a result of changes in environmental contingencies. Such a function is accomplished by a combined mechanism that simultaneously restrains ongoing obsolete actions while it facilitates new contextual associations.

Anatomical evidence for functional diversity in the mesencephalic locomotor region of primates

The mesencephalic locomotor region (MLR) is a highly preserved brainstem structure in vertebrates. The MLR performs a crucial role in locomotion but also controls various other functions such as sleep, attention, and even emotion. The MLR comprises the pedunculopontine (PPN) and cuneiform nuclei (CuN) but their specific roles are still unknown in primates. Here, we sought to characterise the inputs and outputs of the PPN and CuN to and from the basal ganglia, thalamus, amygdala and cortex, with a specific interest in identifying functional anatomical territories. For this purpose, we used tract-tracing techniques in monkeys and diffusion weighted imaging-based tractography in humans to understand structural connectivity. We found that MLR connections are broadly similar between monkeys and humans. The PPN projects to the sensorimotor, associative and limbic territories of the basal ganglia nuclei, the centre median-parafascicular thalamic nuclei and the central nucleus of the amygdala. The PPN receives motor cortical inputs and less abundant connections from the associative and limbic cortices. In monkeys, we found a stronger connection between the anterior PPN and motor cortex suggesting a topographical organisation of this specific projection. The CuN projected to similar cerebral structures to the PPN in both species. However, these projections were much stronger towards the limbic territories of the basal ganglia and thalamus, to the basal forebrain (extended amygdala) and the central nucleus of the amygdala, suggesting that the CuN is not primarily a motor structure. Our findings highlight the fact that the PPN integrates sensorimotor, cognitive and emotional information whereas the CuN participates in a more restricted network integrating predominantly emotional information.

Reward and Behavioral Factors Contributing to the Tonic Activity of Monkey Pedunculopontine Tegmental Nucleus Neurons during Saccade Tasks

The pedunculopontine tegmental nucleus (PPTg) in the brainstem plays a role in controlling reinforcement learning and executing conditioned behavior. We previously examined the activity of PPTg neurons in monkeys during a reward-conditioned, visually guided saccade task, and reported that a population of these neurons exhibited tonic responses throughout the task period. These tonic responses might depend on prediction of the upcoming reward, successful execution of the task, or both. Here, we sought to further distinguish these factors and to investigate how each contributes to the tonic neuronal activity of the PPTg. In our normal visually guided saccade task, the monkey initially fixated on the central fixation target (FT), then made saccades to the peripheral saccade target and received a juice reward after the saccade target disappeared. Most of the tonic activity terminated shortly after the reward delivery, when the monkey broke fixation. To distinguish between reward and behavioral epochs, we then changed the task sequence for a block of trials, such that the saccade target remained visible after the reward delivery. Under these visible conditions, the monkeys tended to continue fixating on the saccade target even after the reward delivery. Therefore, the prediction of the upcoming reward and the end of an individual trial were separated in time. Regardless of the task conditions, half of the tonically active PPTg neurons terminated their activity around the time of the reward delivery, consistent with the view that PPTg neurons might send reward prediction signals until the time of reward delivery, which is essential for computing reward prediction error in reinforcement learning. On the other hand, the other half of the tonically active PPTg neurons changed their activity dependent on the task condition. In the normal condition, the tonic responses terminated around the time of the reward delivery, while in the visible condition, the activity continued until the disappearance of the saccade target (ST) after reward delivery. Thus, for these neurons, the tonic activity might be related to maintaining attention to complete fixation behavior. These results suggest that, in addition to the reward value information, some PPTg neurons might contribute to the execution of conditioned task behavior.

The Pedunculopontine Tegmental Nucleus as a Motor and Cognitive Interface between the Cerebellum and Basal Ganglia

As an important component of ascending activating systems, brainstem cholinergic neurons in the pedunculopontine tegmental nucleus (PPTg) are involved in the regulation of motor control (locomotion, posture and gaze) and cognitive processes (attention, learning and memory). The PPTg is highly interconnected with several regions of the basal ganglia, and one of its key functions is to regulate and relay activity from the basal ganglia. Together, they have been implicated in the motor control system (such as voluntary movement initiation or inhibition), and modulate aspects of executive function (such as motivation). In addition to its intimate connection with the basal ganglia, projections from the PPTg to the cerebellum have been recently reported to synaptically activate the deep cerebellar nuclei. Classically, the cerebellum and basal ganglia were regarded as forming separated anatomical loops that play a distinct functional role in motor and cognitive behavioral control. Here, we suggest that the PPTg may also act as an interface device between the basal ganglia and cerebellum. As such, part of the therapeutic effect of PPTg deep brain stimulation (DBS) to relieve gait freezing and postural instability in advanced Parkinson’s disease (PD) patients might also involve modulation of the cerebellum. We review the anatomical position and role of the PPTg in the pathway of basal ganglia and cerebellum in relation to motor control, cognitive function and PD.

Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons

Dopamine neurons encode the difference between actual and predicted reward, or reward prediction error (RPE). Although many models have been proposed to account for this computation, it has been difficult to test these models experimentally. Here we established an awake electrophysiological recording system, combined with rabies virus and optogenetic cell-type identification, to characterize the firing patterns of monosynaptic inputs to dopamine neurons while mice performed classical conditioning tasks. We found that each variable required to compute RPE, including actual and predicted reward, was distributed in input neurons in multiple brain areas. Further, many input neurons across brain areas signaled combinations of these variables. These results demonstrate that even simple arithmetic computations such as RPE are not localized in specific brain areas but, rather, distributed across multiple nodes in a brain-wide network. Our systematic method to examine both activity and connectivity revealed unexpected redundancy for a simple computation in the brain.

Advantages of nonhuman primates as preclinical models for evaluating stem cell-based therapies for Parkinson's disease

The derivation of dopaminergic neurons from induced pluripotent stem cells brings new hope for a patient-specific, stem cell-based replacement therapy to treat Parkinson's disease (PD) and related neurodegenerative diseases; and this novel cell-based approach has already proven effective in animal models. However, there are several aspects of this procedure that have yet to be optimized to the extent required for translation to an optimal cell-based transplantation protocol in humans. These challenges include pinpointing the optimal graft location, appropriately scaling up the graft volume, and minimizing the risk of chronic immune rejection, among others. To advance this procedure to the clinic, it is imperative that a model that accurately and fully recapitulates characteristics most pertinent to a cell-based transplantation to the human brain is used to optimize key technical aspects of the procedure. Nonhuman primates mimic humans in multiple ways including similarities in genomics, neuroanatomy, neurophysiology, immunogenetics, and age-related changes in immune function. These characteristics are critical to the establishment of a relevant model in which to conduct preclinical studies to optimize the efficacy and safety of cell-based therapeutic approaches to the treatment of PD. Here we review previous studies in rodent models, and emphasize additional advantages afforded by nonhuman primate models in general, and the baboon model in particular, for preclinical optimization of cell-based therapeutic approaches to the treatment of PD and other neurodegenerative diseases. We outline current unresolved challenges to the successful application of stem cell therapies in humans and propose that the baboon model in particular affords a number of traits that render it most useful for preclinical studies designed to overcome these challenges.

Pontomesencephalic Tegmental Afferents to VTA Non-dopamine Neurons Are Necessary for Appetitive Pavlovian Learning

The ventral tegmental area (VTA) receives phenotypically distinct innervations from the pedunculopontine tegmental nucleus (PPTg). While PPTg-to-VTA inputs are thought to play a critical role in stimulus-reward learning, direct evidence linking PPTg-to-VTA phenotypically distinct inputs in the learning process remains lacking. Here, we used optogenetic approaches to investigate the functional contribution of PPTg excitatory and inhibitory inputs to the VTA in appetitive Pavlovian conditioning. We show that photoinhibition of PPTg-to-VTA cholinergic or glutamatergic inputs during cue presentation dampens the development of anticipatory approach responding to the food receptacle during the cue. Furthermore, we employed in vivo optetrode recordings to show that photoinhibition of PPTg cholinergic or glutamatergic inputs significantly decreases VTA non-dopamine (non-DA) neural activity. Consistently, photoinhibition of VTA non-DA neurons disrupts the development of cue-elicited anticipatory approach responding. Taken together, our study reveals a crucial regulatory mechanism by PPTg excitatory inputs onto VTA non-DA neurons during appetitive Pavlovian conditioning.

Segregated cholinergic transmission modulates dopamine neurons integrated in distinct functional circuits

Dopamine neurons in the ventral tegmental area (VTA) receive cholinergic innervation from brainstem structures that are associated with either movement or reward. Whereas cholinergic neurons of the pedunculopontine nucleus (PPN) carry an associative/motor signal, those of the laterodorsal tegmental nucleus (LDT) convey limbic information. We used optogenetics and in vivo juxtacellular recording and labeling to examine the influence of brainstem cholinergic innervation of distinct neuronal subpopulations in the VTA. We found that LDT cholinergic axons selectively enhanced the bursting activity of mesolimbic dopamine neurons that were excited by aversive stimulation. In contrast, PPN cholinergic axons activated and changed the discharge properties of VTA neurons that were integrated in distinct functional circuits and were inhibited by aversive stimulation. Although both structures conveyed a reinforcing signal, they had opposite roles in locomotion. Our results demonstrate that two modes of cholinergic transmission operate in the VTA and segregate the neurons involved in different reward circuits.