Independent neural coding of reward and movement by pedunculopontine tegmental nucleus neurons in freely navigating rats

The mesopontine tegmentum in reward and aversion: From cellular heterogeneity to behaviour

The mesopontine tegmentum, comprising the pedunculopontine tegmentum (PPN) and the laterodorsal tegmentum (LDT), is intricately connected to various regions of the basal ganglia, motor systems, and limbic systems. The PPN and LDT can regulate the activity of different brain regions of these target systems, and in this way are in a privileged position to modulate motivated behaviours. Despite recent findings, the PPN and LDT have been largely overlooked in discussions about the neural circuits associated with reward and aversion. This review aims to provide a timely and comprehensive resource on past and current research, highlighting the PPN and LDT's connectivity and influence on basal ganglia and limbic, and motor systems. Seminal studies, including lesion, pharmacological, and optogenetic/chemogenetic approaches, demonstrate their critical roles in modulating reward/aversive behaviours. The review emphasizes the need for further investigation into the associated cellular mechanisms, in order to clarify their role in behaviour and contribution for different neuropsychiatric disorders.

The Mesencephalic Locomotor Region: Multiple Cell Types, Multiple Behavioral Roles, and Multiple Implications for Disease

The mesencephalic locomotor region (MLR) controls locomotion in vertebrates. In humans with Parkinson disease, locomotor deficits are increasingly associated with decreased activity in the MLR. This brainstem region, commonly considered to include the cuneiform and pedunculopontine nuclei, has been explored as a target for deep brain stimulation to improve locomotor function, but the results are variable, from modest to promising. However, the MLR is a heterogeneous structure, and identification of the best cell type to target is only beginning. Here, I review the studies that uncovered the role of genetically defined MLR cell types, and I highlight the cells whose activation improves locomotor function in animal models of Parkinson disease. The promising cell types to activate comprise some glutamatergic neurons in the cuneiform and caudal pedunculopontine nuclei, as well as some cholinergic neurons of the pedunculopontine nucleus. Activation of MLR GABAergic neurons should be avoided, since they stop locomotion or evoke bouts flanked with numerous stops. MLR is also considered a potential target in spinal cord injury, supranuclear palsy, primary progressive freezing of gait, or stroke. Better targeting of the MLR cell types should be achieved through optimized deep brain stimulation protocols, pharmacotherapy, or the development of optogenetics for human use.

The Basal Ganglia and Mesencephalic Locomotor Region Connectivity Matrix

Although classically considered a relay station for basal ganglia (BG) output, the anatomy, connectivity, and function of the mesencephalic locomotor region (MLR) were redefined during the last two decades. In striking opposition to what was initially thought, MLR and BG are actually reciprocally and intimately interconnected. New viral-based, optogenetic, and mapping technologies revealed that cholinergic, glutamatergic, and GABAergic neurons coexist in this structure, which, in addition to extending descending projections, send long-range ascending fibers to the BG. These MLR projections to the BG convey motor and non-motor information to specific synaptic targets throughout different nuclei. Moreover, MLR efferent fibers originate from precise neuronal subpopulations located in particular MLR subregions, defining independent anatomo-functional subcircuits involved in particular aspects of animal behavior such as fast locomotion, explorative locomotion, posture, forelimb- related movements, speed, reinforcement, among others. In this review, we revised the literature produced during the last decade linking MLR and BG. We conclude that the classic framework considering the MLR as a homogeneous output structure passively receiving input from the BG needs to be revisited. We propose instead that the multiple subcircuits embedded in this region should be taken as independent entities that convey relevant and specific ascending information to the BG and, thus, actively participate in the execution and tuning of behavior.

Inhibitory Pedunculopontine Neurons Gate Dopamine-Mediated Motor Actions of Unsigned Valence

BACKGROUND

The pedunculopontine nucleus (PPN) maintains a bidirectional connectivity with the basal ganglia that supports their shared roles in the selection and execution of motor actions. Previous studies identified a role for PPN neurons in goal-directed behavior, but the cellular substrates underlying this function have not been elucidated. We recently revealed the existence of a monosynaptic GABAergic input from the PPN that inhibits dopamine neurons of the substantia nigra. Activation of this pathway interferes with the execution of learned motor sequences when the actions are rewarded, even though the inhibition of dopamine neurons did not shift the value of the action, hence suggesting executive control over the gating of behavior.

OBJECTIVE

To test the attributes of the inhibition of dopamine neurons by the PPN in the context of goal-directed behavior regardless of whether the outcome is positively or negatively reinforced.

METHODS

We delivered optogenetic stimulation to PPN GABAergic axon terminals in the substantia nigra during a battery of behavioral tasks with positive and negative valence.

RESULTS

Inhibition of dopamine neurons by PPN optogenetic activation during an appetitive task impaired the initiation and overall execution of the behavioral sequence without affecting the consumption of reward. During an active avoidance task, the same activation impaired the ability of mice to avoid a foot shock, but their escape response was unaffected. In addition, responses to potential threats were significantly attenuated.

CONCLUSION

Our results show that PPN GABAergic neurons modulate learned, goal-directed behavior of unsigned valence without affecting overall motor behavior.

A cholinergic circuit that relieves pain despite opioid tolerance

Chronic pain is a tremendous burden for afflicted individuals and society. Although opioids effectively relieve pain, significant adverse outcomes limit their utility and efficacy. To investigate alternate pain control mechanisms, we explored cholinergic signaling in the ventrolateral periaqueductal gray (vlPAG), a critical nexus for descending pain modulation. Biosensor assays revealed that pain states decreased acetylcholine release in vlPAG. Activation of cholinergic projections from the pedunculopontine tegmentum to vlPAG relieved pain, even in opioid-tolerant conditions, through ⍺7 nicotinic acetylcholine receptors (nAChRs). Activating ⍺7 nAChRs with agonists or stimulating endogenous acetylcholine inhibited vlPAG neuronal activity through Ca2+ and peroxisome proliferator-activated receptor α (PPAR⍺)-dependent signaling. In vivo 2-photon imaging revealed that chronic pain induces aberrant excitability of vlPAG neuronal ensembles and that ⍺7 nAChR-mediated inhibition of these cells relieves pain, even after opioid tolerance. Finally, pain relief through these cholinergic mechanisms was not associated with tolerance, reward, or withdrawal symptoms, highlighting its potential clinical relevance.

Behavioral Reaction and c-fos Expression after Opioids Injection into the Pedunculopontine Tegmental Nucleus and Electrical Stimulation of the Ventral Tegmental Area

The pedunculopontine tegmental nucleus (PPN) regulates the activity of dopaminergic cells in the ventral tegmental area (VTA). In this study, the role of opioid receptors (OR) in the PPN on motivated behaviors was investigated by using a model of feeding induced by electrical VTA-stimulation (Es-VTA) in rats (male Wistar; n = 91). We found that the OR excitation by morphine and their blocking by naloxone within the PPN caused a change in the analyzed motivational behavior and neuronal activation. The opioid injections into the PPN resulted in a marked, dose-dependent increase/decrease in latency to feeding response (FR), which corresponded with increased neuronal activity (c-Fos protein), in most of the analyzed brain structures. Morphine dosed at 1.25/1.5 µg into the PPN significantly reduced behavior induced by Es-VTA, whereas morphine dosed at 0.25/0.5 µg into the PPN did not affect this behavior. The opposite effect was observed after the naloxone injection into the PPN, where its lowest doses of 2.5/5.0 μg shortened the FR latency. However, its highest dose of 25.0 μg into the PPN nucleus did not cause FR latency changes. In conclusion, the level of OR arousal in the PPN can modulate the activity of the reward system.

Glutamatergic pedunculopontine tegmental neurons control wakefulness and locomotion via distinct axonal projections

STUDY OBJECTIVES

The pedunculopontine tegmental (PPT) nucleus is implicated in many brain functions, ranging from sleep/wake control and locomotion, to reward mechanisms and learning. The PPT contains cholinergic, GABAergic, and glutamatergic neurons with extensive ascending and descending axonal projections. Glutamatergic PPT (PPTvGlut2) neurons are thought to promote wakefulness, but the mechanisms through which this occurs are unknown. In addition, some researchers propose that PPTvGlut2 neurons promote locomotion, yet even though the PPT is a target for deep brain stimulation in Parkinson's disease, the role of the PPT in locomotion is debated. We hypothesized that PPTvGluT2 neurons drive arousal and specific waking behaviors via certain projections and modulate locomotion via others.

METHODS

We mapped the axonal projections of PPTvGlut2 neurons using conditional anterograde tracing and then photostimulated PPTvGlut2 soma or their axon terminal fields across sleep/wake states and analyzed sleep/wake behavior, muscle activity, and locomotion in transgenic mice.

RESULTS

We found that stimulation of PPTvGlut2 soma and their axon terminals rapidly triggered arousals from non-rapid eye movement sleep, especially with activation of terminals in the basal forebrain (BF) and lateral hypothalamus (LH). With photoactivation of PPTvGlut2 terminals in the BF and LH, this wakefulness was accompanied by locomotion and other active behaviors, but stimulation of PPTvGlut2 soma and terminals in the substantia nigra triggered only quiet wakefulness without locomotion.

CONCLUSIONS

These findings demonstrate the importance of the PPTvGluT2 neurons in driving various aspects of arousal and show that heterogeneous brain nuclei, such as the PPT, can promote a variety of behaviors via distinct axonal projections.

Cholinergic neurons in the pedunculopontine nucleus guide reversal learning by signaling the changing reward contingency

Cognitive flexibility enables effective switching between mental processes to generate appropriate responses. Cholinergic neurons (CNs) within the pedunculopontine nucleus (PPN) are associated with many functions, but their contribution to cognitive flexibility remains poorly understood. Here we measure PPN cholinergic activities using calcium indicators during the attentional set-shifting task. We find that PPN CNs exhibit increasing activities correlated with rewards during each stage and error trials in reversal stages, indicating sensitivity to rule switching. Inhibition of PPN cholinergic activity selectively impairs reversal learning, which improves with PPN CN activation. Activation of PPN CNs projecting to the substantia nigra pars compacta, mediodorsal thalamus, and parafascicular nucleus in a time-locked manner with reward improves reversal learning. Therefore, PPN CNs may encode not only reward signals but also the information of changing reward contingency that contributes to guiding reversal learning through output projections to multiple nuclei that participate in flexibility.

Non-motor connections of the pedunculopontine nucleus of the rat and human brain

INTRODUCTION

The connections of the pedunculopontine nucleus (PPN) with motor areas of the central nervous system (CNS) are well described in the literature, in contrast relations with non-motor areas are lacking. Thus, the aim of the present study is to define the non-motor connections of the PPN in rats using the fluoro-gold (FG) tracer and compare the presence of these connections in healthy human adults using diffusion tensor tractography (DTI).

MATERIALS AND METHODS

We injected FG into the PPN of 12 rats. The non-motor connections of the PPN with cortical, subcortical, and brainstem structures were documented. The non-motor connections of the rats were compared with the DTI obtained from 35 healthy adults.

RESULTS

The results of the tract-tracing study in the rat showed that the PPN was connected to non-motor cortical (cingulate, somatosensory, visual, auditory, medial frontal cortices), subcortical (amygdala, hypothalamus, thalamus, habenular, and bed nucleus of stria terminalis), and brainstem (medullary reticular, trigeminal spinal, external cuneate, pontine reticular, vestibular, superior and inferior colliculus, locus ceruleus, periaqueductal gray, parabrachial, dorsal raphe, pretectal, lateral lemniscus nuclei, and the contralateral PPN) structures. The DTI obtained from healthy adults showed similar PPN non-motor connections as in rats.

CONCLUSION

Understanding the connections of the PPN with non-motor cortical, subcortical, and brainstem areas of the CNS will enrich our knowledge of its contribution in various circuits and the areas that PPN activity can influence. Further, it will provide insight into the role of Parkinson's disease and related disorders and explain the non-motor complications which occur subsequent to deep brain stimulation (DBS) of the PPN.

A Causal Role for the Pedunculopontine Nucleus in Human Instrumental Learning

A critical mechanism for maximizing reward is instrumental learning. In standard instrumental learning models, action values are updated on the basis of reward prediction errors (RPEs), defined as the discrepancy between expectations and outcomes. A wealth of evidence across species and experimental techniques has established that RPEs are signaled by midbrain dopamine neurons. However, the way dopamine neurons receive information about reward outcomes remains poorly understood. Recent animal studies suggest that the pedunculopontine nucleus (PPN), a small brainstem structure considered as a locomotor center, is sensitive to reward and sends excitatory projection to dopaminergic nuclei. Here, we examined the hypothesis that the PPN could contribute to reward learning in humans. To this aim, we leveraged a clinical protocol that assessed the therapeutic impact of PPN deep-brain stimulation (DBS) in three patients with Parkinson disease. PPN local field potentials (LFPs), recorded while patients performed an instrumental learning task, showed a specific response to reward outcomes in a low-frequency (alpha-beta) band. Moreover, PPN DBS selectively improved learning from rewards but not from punishments, a pattern that is typically observed following dopaminergic treatment. Computational analyses indicated that the effect of PPN DBS on instrumental learning was best captured by an increase in subjective reward sensitivity. Taken together, these results support a causal role for PPN-mediated reward signals in human instrumental learning.

The neural circuitry supporting successful spatial navigation despite variable movement speeds

Ants who have successfully navigated the long distance between their foraging spot and their nest dozens of times will drastically overshoot their destination if the size of their legs is doubled by the addition of stilts. This observation reflects a navigational strategy called path integration, a strategy also utilized by mammals. Path integration necessitates that animals keep track of their movement speed and use it to precisely and instantly modify where they think they are and where they want to go. Here we review the neural circuitry that has evolved to integrate speed and space. We start with the rate and temporal codes for speed in the hippocampus and work backwards towards the motor and sensory systems. We highlight the need for experiments designed to differentiate the respective contributions of motor efference copy versus sensory inputs. In particular, we discuss the importance of high-resolution tracking of the latency of speed-encoding as a precise way to disentangle the sensory versus motor computations that enable successful spatial navigation at very different speeds.

A Novel Role for the Periaqueductal Gray in Consummatory Behavior

The periaqueductal gray (PAG) has a well-established role in pain processing, autonomic function and behavioral responses to fear. Anatomical work suggests the PAG may mediate food intake and reward processing as it has extensive reciprocal connections within brain circuits that mediate appetitive processes and consummatory behaviors such as prefrontal cortex, hypothalamus, amygdala, parabrachial nucleus (PBN) and ventral tegmental area (Kelley et al., 2005). Therefore, we investigated if the PAG of hungry rats has a functional role in appetitive and consummatory behaviors. To address this, PAG was pharmacologically inactivated during a spatial working memory task with muscimol (0.1-0.3 μg), a GABAA agonist via intracranial infusion. Inactivation of PAG led to reduced intake of food rewards and increased errors on this task. To focus on the specific effects PAG inactivation had on food consumption, PAG was inactivated during two separate food intake tasks in a separate group of rats. Again, PAG inactivation resulted in a significant decrease in food consumption, as well as an increased latency to consume food. We next investigated PAG neural responses to reward encounters. A different group of rats performed the same task used in Experiment 1 while the in vivo activity of PAG neurons was recorded. In a subset of PAG neurons, reward encounters elicited phasic excitation. A separate subset of PAG neurons were inhibited during reward encounters. These responses scaled with the size of the reward, with sustained excitation or inhibition in response to large rewards compared to small. Our data also show that separate groups of PAG neurons in awake behaving animals display either increased and decreased neural responses to reward encounters. Additionally, a proportion of neurons were modulated by the animals' velocity. This study is the first to show that PAG neurons process reward-related information, perhaps to mediate consummatory behaviors related to food consumption.

Stereological Estimates of Glutamatergic, GABAergic, and Cholinergic Neurons in the Pedunculopontine and Laterodorsal Tegmental Nuclei in the Rat

The pedunculopontine tegmental nucleus (PPN) and laterodorsal tegmental nucleus (LDT) are functionally associated brainstem structures implicated in behavioral state control and sensorimotor integration. The PPN is also involved in gait and posture, while the LDT plays a role in reward. Both nuclei comprise characteristic cholinergic neurons intermingled with glutamatergic and GABAergic cells whose absolute numbers in the rat have been only partly established. Here we sought to determine the complete phenotypical profile of each nucleus to investigate potential differences between them. Counts were obtained using stereological methods after the simultaneous visualization of cholinergic and either glutamatergic or GABAergic cells. The two isoforms of glutamic acid decarboxylase (GAD), GAD65 and GAD67, were separately analyzed. Dual in situ hybridization revealed coexpression of GAD65 and GAD67 mRNAs in ∼90% of GAD-positive cells in both nuclei; thus, the estimated mean numbers of (1) cholinergic, (2) glutamatergic, and (3) GABAergic cells in PPN and LDT, respectively, were (1) 3,360 and 3,650; (2) 5,910 and 5,190; and (3) 4,439 and 7,599. These data reveal significant differences between PPN and LDT in their relative phenotypical composition, which may underlie some of the functional differences observed between them. The estimation of glutamatergic cells was significantly higher in the caudal PPN, supporting the reported functional rostrocaudal segregation in this nucleus. Finally, a small subset of cholinergic neurons (8% in PPN and 5% in LDT) also expressed the glutamatergic marker Vglut2, providing anatomical evidence for a potential corelease of transmitters at specific target areas.

GABAA receptor in the Pedunculopontine tegmental (PPT) nucleus: Effects on cardiovascular system

BACKGROUND

The pedunculopontine tegmental (PPT) nucleus is a heterogeneous nucleus with several functions including cardiovascular regulation. The presence of GABA_A receptor has been shown in the PPT. Therefore, the cardiovascular effects of this receptor were examined.

METHODS

Rats were divided into: Control; Muscimol; Bicuculline (BMI); Hexamethonium (Hexa) + BMI and Atropine + BMI groups. The femoral vein and artery were cannulated for drug administration and recording of cardiovascular parameters, respectively. Muscimol (a GABA_A agonist; 1.5 and 2.5 nmol), BMI (a GABA_A antagonist; 0.1 and 0.2 nmol) were stereotaxically microinjected into the PPT. To evaluate the peripheral cardiovascular mechanisms of GABA_A receptors, Hexa (a ganglionic blocker; 10 mg/kg) and atropine (a muscarinic receptor antagonist; 1 mg/kg) were intravenously (iv) injected before BMI (0.2 nmol). The average changes of mean arterial pressure (ΔMAP), systolic blood pressure (ΔSBP) and heart rate (ΔHR) in different intervals were calculated and compared both within and between case group and control group (repeated measures ANOVA). The peak changes in each group were also calculated and compared with those of the control group (independent sample t-test).

RESULTS

Both doses of BMI significantly increased ΔMAP, ΔSBP and ΔHR compared to control, while the only higher dose of muscimol significantly decreased ΔSBP. Iv injection of Hexa significantly attenuated ΔMAP, ΔSBP and ΔHR responses induced by BMI but atropine did not affect.

CONCLUSIONS

Our results demonstrate that GABA_A receptor of the PPT has a tonic inhibitory effect on the cardiovascular system and its peripheral effect mostly is mediated by sympathetic system.

Cocaine Selectively Reorganizes Excitatory Inputs to Substantia Nigra Pars Compacta Dopamine Neurons

Substantia nigra pars compacta (SNc) dopamine neurons and their targets are involved in addiction and cue-induced relapse. However, afferents onto SNc dopamine neurons themselves appear insensitive to drugs of abuse, such as cocaine, when afferents are collectively stimulated electrically. This contrasts with ventral tegmental area (VTA) dopamine neurons, whose glutamate afferents react robustly to cocaine. We used an optogenetic strategy to isolate identified SNc inputs and determine whether cocaine sensitivity in the mouse SNc circuit is conferred at the level of three glutamate afferents: dorsal raphé nucleus (DR), pedunculopontine nucleus (PPN), and subthalamic nucleus (STN). We found that excitatory afferents to SNc dopamine neurons are sensitive to cocaine in an afferent-specific manner. A single exposure to cocaine in vivo led to PPN-innervated synapses reducing the AMPA-to-NMDA receptor-mediated current ratio. In contrast to work in the VTA, this was due to increased NMDA receptor function with no change in AMPA receptor function. STN synapses showed a decrease in calcium-permeable AMPA receptors after cocaine, but no change in the AMPA-to-NMDA ratio. Cocaine also increased the release probability at DR-innervated and STN-innervated synapses, quantified by decreases in paired-pulse ratios. However, release probability at PPN-innervated synapses remained unaffected. By examining identified inputs, our results demonstrate a functional distribution among excitatory SNc afferent nuclei in response to cocaine, and suggest a compelling architecture for differentiation and separate parsing of inputs within the nigrostriatal system.SIGNIFICANCE STATEMENT Prior studies have established that substantia nigra pars compacta (SNc) dopamine neurons are a key node in the circuitry that drives addiction and relapse, yet cocaine apparently has no effect on electrically stimulated excitatory inputs. Our study is the first to demonstrate the functional impact of a drug of abuse on synaptic mechanisms of identified afferents to the SNc. Optogenetic dissection of inputs originating from dorsal raphé, pedunculopontine, and subthalamic nuclei were tested for synaptic modifications following in vivo cocaine exposure. Our results demonstrate that cocaine differentially induces modifications to SNc synapses depending on input origin. This presents implications for understanding dopamine processing of motivated behavior; most critically, it indicates that dopamine neurons selectively modulate signal reception processed by afferent nuclei.

Integration of Descending Command Systems for the Generation of Context-Specific Locomotor Behaviors

Over the past decade there has been a renaissance in our understanding of spinal cord circuits; new technologies are beginning to provide key insights into descending circuits which project onto spinal cord central pattern generators. By integrating work from both the locomotor and animal behavioral fields, we can now examine context-specific control of locomotion, with an emphasis on descending modulation arising from various regions of the brainstem. Here we examine approach and avoidance behaviors and the circuits that lead to the production and arrest of locomotion.

Pedunculopontine glutamatergic neurons control spike patterning in substantia nigra dopaminergic neurons

Burst spiking in substantia nigra pars compacta (SNc) dopaminergic neurons is a key signaling event in the circuitry controlling goal-directed behavior. It is widely believed that this spiking mode depends upon an interaction between synaptic activation of N-methyl-D-aspartate receptors (NMDARs) and intrinsic oscillatory mechanisms. However, the role of specific neural networks in burst generation has not been defined. To begin filling this gap, SNc glutamatergic synapses arising from pedunculopotine nucleus (PPN) neurons were characterized using optical and electrophysiological approaches. These synapses were localized exclusively on the soma and proximal dendrites, placing them in a good location to influence spike generation. Indeed, optogenetic stimulation of PPN axons reliably evoked spiking in SNc dopaminergic neurons. Moreover, burst stimulation of PPN axons was faithfully followed, even in the presence of NMDAR antagonists. Thus, PPN-evoked burst spiking of SNc dopaminergic neurons in vivo may not only be extrinsically triggered, but extrinsically patterned as well.

Activation of Pedunculopontine Glutamate Neurons Is Reinforcing

Dopamine transmission from midbrain ventral tegmental area (VTA) neurons underlies behavioral processes related to motivation and drug addiction. The pedunculopontine tegmental nucleus (PPTg) is a brainstem nucleus containing glutamate-, acetylcholine-, and GABA-releasing neurons with connections to basal ganglia and limbic brain regions. Here we investigated the role of PPTg glutamate neurons in reinforcement, with an emphasis on their projections to VTA dopamine neurons. We used cell-type-specific anterograde tracing and optogenetic methods to selectively label and manipulate glutamate projections from PPTg neurons in mice. We used anatomical, electrophysiological, and behavioral assays to determine their patterns of connectivity and ascribe functional roles in reinforcement. We found that photoactivation of PPTg glutamate cell bodies could serve as a direct positive reinforcer on intracranial self-photostimulation assays. Further, PPTg glutamate neurons directly innervate VTA; photostimulation of this pathway preferentially excites VTA dopamine neurons and is sufficient to induce behavioral reinforcement. These results demonstrate that ascending PPTg glutamate projections can drive motivated behavior, and PPTg to VTA synapses may represent an important target relevant to drug addiction and other mental health disorders.

SIGNIFICANCE STATEMENT

Uncovering brain circuits underlying reward-seeking is an important step toward understanding the circuit bases of drug addiction and other psychiatric disorders. The dopaminergic system emanating from the ventral tegmental area (VTA) plays a key role in regulating reward-seeking behaviors. We used optogenetics to demonstrate that the pedunculopontine tegmental nucleus sends glutamatergic projections to VTA dopamine neurons, and that stimulation of this circuit promotes behavioral reinforcement. The findings support a critical role for pedunculopontine tegmental nucleus glutamate neurotransmission in modulating VTA dopamine neuron activity and behavioral reinforcement.

Differential Control of Dopaminergic Excitability and Locomotion by Cholinergic Inputs in Mouse Substantia Nigra

Understanding how dopaminergic (DA) neurons of the substantia nigra pars compacta (SNc) govern movements requires a detailed knowledge of how different neurotransmitter systems modulate DA neuronal excitability. We report a heterogeneity of electrophysiological properties between medial and lateral SNc neurons modulated by cholinergic neurotransmission. Lateral DA neurons received mainly excitatory (nicotinic or glutamatergic) mediated cholinergic neurotransmission. Medial DA neurons received predominantly GABAergic currents mediated by presynaptic nicotinic receptors or biphasic GABAergic and nicotinic neurotransmission conveyed by GABA and ACh corelease, which inhibited DA neurons. To examine whether cholinergic signaling in the SNc controls mouse behavior, we used optogenetics in awake behaving mice and found that activation of cholinergic terminals in the medial SNc decreased locomotion, whereas activation in the lateral SNc increased locomotion. Our findings provide novel insights on how cholinergic inputs to subregions of the SNc regulate the excitability of DA neurons differentially, resulting in different patterns of motor behavior.

Cholinergic Mesopontine Signals Govern Locomotion and Reward through Dissociable Midbrain Pathways

The mesopontine tegmentum, including the pedunculopontine and laterodorsal tegmental nuclei (PPN and LDT), provides major cholinergic inputs to midbrain and regulates locomotion and reward. To delineate the underlying projection-specific circuit mechanisms, we employed optogenetics to control mesopontine cholinergic neurons at somata and at divergent projections within distinct midbrain areas. Bidirectional manipulation of PPN cholinergic cell bodies exerted opposing effects on locomotor behavior and reinforcement learning. These motor and reward effects were separable via limiting photostimulation to PPN cholinergic terminals in the ventral substantia nigra pars compacta (vSNc) or to the ventral tegmental area (VTA), respectively. LDT cholinergic neurons also form connections with vSNc and VTA neurons; however, although photo-excitation of LDT cholinergic terminals in the VTA caused positive reinforcement, LDT-to-vSNc modulation did not alter locomotion or reward. Therefore, the selective targeting of projection-specific mesopontine cholinergic pathways may offer increased benefit in treating movement and addiction disorders.

The Cellular Diversity of the Pedunculopontine Nucleus: Relevance to Behavior in Health and Aspects of Parkinson's Disease

The pedunculopontine nucleus (PPN) is a rostral brainstem structure that has extensive connections with basal ganglia nuclei and the thalamus. Through these the PPN contributes to neural circuits that effect cortical and hippocampal activity. The PPN also has descending connections to nuclei of the pontine and medullary reticular formations, deep cerebellar nuclei, and the spinal cord. Interest in the PPN has increased dramatically since it was first suggested to be a novel target for treating patients with Parkinson's disease who are refractory to medication. However, application of frequency-specific electrical stimulation of the PPN has produced inconsistent results. A central reason for this is that the PPN is not a heterogeneous structure. In this article, we review current knowledge of the neurochemical identity and topographical distribution of neurons within the PPN of both humans and experimental animals, focusing on studies that used neuronally selective targeting strategies to ascertain how the neurochemical heterogeneity of the PPN relates to its diverse functions in relation to movement and cognitive processes. If the therapeutic potential of the PPN is to be realized, it is critical to understand the complex structure-function relationships that exist here.

Functional Connectivity of the Pedunculopontine Nucleus and Surrounding Region in Parkinson's Disease

Deep brain stimulation of the pedunculopontine nucleus and surrounding region (PPNR) is a novel treatment strategy for gait freezing in Parkinson's disease (PD). However, clinical results have been variable, in part because of the paucity of functional information that might help guide selection of the optimal surgical target. In this study, we use simultaneous magnetoencephalography and local field recordings from the PPNR in seven PD patients, to characterize functional connectivity with distant brain areas at rest. The PPNR was preferentially coupled to brainstem and cingulate regions in the alpha frequency (8-12 Hz) band and to the medial motor strip and neighboring areas in the beta (18-33 Hz) band. The distribution of coupling also depended on the vertical distance of the electrode from the pontomesencephalic line: most effects being greatest in the middle PPNR, which may correspond to the caudal pars dissipata of the pedunculopontine nucleus. These observations confirm the crucial position of the PPNR as a functional node between cortical areas such as the cingulate/ medial motor strip and other brainstem nuclei, particularly in the dorsal pons. In particular they suggest a special role for the middle PPNR as this has the greatest functional connectivity with other brain regions.

Reward and Behavioral Factors Contributing to the Tonic Activity of Monkey Pedunculopontine Tegmental Nucleus Neurons during Saccade Tasks

The pedunculopontine tegmental nucleus (PPTg) in the brainstem plays a role in controlling reinforcement learning and executing conditioned behavior. We previously examined the activity of PPTg neurons in monkeys during a reward-conditioned, visually guided saccade task, and reported that a population of these neurons exhibited tonic responses throughout the task period. These tonic responses might depend on prediction of the upcoming reward, successful execution of the task, or both. Here, we sought to further distinguish these factors and to investigate how each contributes to the tonic neuronal activity of the PPTg. In our normal visually guided saccade task, the monkey initially fixated on the central fixation target (FT), then made saccades to the peripheral saccade target and received a juice reward after the saccade target disappeared. Most of the tonic activity terminated shortly after the reward delivery, when the monkey broke fixation. To distinguish between reward and behavioral epochs, we then changed the task sequence for a block of trials, such that the saccade target remained visible after the reward delivery. Under these visible conditions, the monkeys tended to continue fixating on the saccade target even after the reward delivery. Therefore, the prediction of the upcoming reward and the end of an individual trial were separated in time. Regardless of the task conditions, half of the tonically active PPTg neurons terminated their activity around the time of the reward delivery, consistent with the view that PPTg neurons might send reward prediction signals until the time of reward delivery, which is essential for computing reward prediction error in reinforcement learning. On the other hand, the other half of the tonically active PPTg neurons changed their activity dependent on the task condition. In the normal condition, the tonic responses terminated around the time of the reward delivery, while in the visible condition, the activity continued until the disappearance of the saccade target (ST) after reward delivery. Thus, for these neurons, the tonic activity might be related to maintaining attention to complete fixation behavior. These results suggest that, in addition to the reward value information, some PPTg neurons might contribute to the execution of conditioned task behavior.

Mesencephalic representations of recent experience influence decision making

Decisions are influenced by recent experience, but the neural basis for this phenomenon is not well understood. Here, we address this question in the context of action selection. We focused on activity in the pedunculopontine tegmental nucleus (PPTg), a mesencephalic region that provides input to several nuclei in the action selection network, in well-trained mice selecting actions based on sensory cues and recent trial history. We found that, at the time of action selection, the activity of many PPTg neurons reflected the action on the previous trial and its outcome, and the strength of this activity predicted the upcoming choice. Further, inactivating the PPTg predictably decreased the influence of recent experience on action selection. These findings suggest that PPTg input to downstream motor regions, where it can be integrated with other relevant information, provides a simple mechanism for incorporating recent experience into the computations underlying action selection.

DOI:http://dx.doi.org/10.7554/eLife.16572.001

The decisions we make are influenced by recent experience, yet it is not known how this experience is represented in the brain. For decisions about when, where and how to move, researchers have hypothesized that recent experience might influence activity in a region of the brainstem – the central trunk of the brain – that is known to be involved in movement.

When deciding when, where and how to move, several areas of the brain are involved in selecting the optimal action. Recent studies suggest that groups of neurons known as locomotor brainstem nuclei may also contribute to making decisions about movements.

Thompson et al. investigated whether a brainstem locomotor area called the pedunculopontine tegmental (PPTg) nucleus in mice might contribute to decision making rather than just conveying the selected response. The mice were trained to recognize particular odors and move to either the left or right to collect a food reward. While the mice were selecting an action, the activity of neurons in the PPTg nucleus reflected the action they had chosen on a previous experience and the outcome of that choice (i.e. whether they received a reward). These representations of past experiences influenced the upcoming decision the mice were about to take.

The findings of Thompson et al. suggest that the PPTg nucleus might play a critical role in the process of selecting the optimal action. Future work will examine what kinds of information about the environment or recent experience have the biggest effect on the activity of this region.

DOI:http://dx.doi.org/10.7554/eLife.16572.002

Cell-Type-Specific Control of Brainstem Locomotor Circuits by Basal Ganglia

The basal ganglia (BG) are critical for adaptive motor control, but the circuit principles underlying their pathway-specific modulation of target regions are not well understood. Here, we dissect the mechanisms underlying BG direct and indirect pathway-mediated control of the mesencephalic locomotor region (MLR), a brainstem target of BG that is critical for locomotion. We optogenetically dissect the locomotor function of the three neurochemically distinct cell types within the MLR: glutamatergic, GABAergic, and cholinergic neurons. We find that the glutamatergic subpopulation encodes locomotor state and speed, is necessary and sufficient for locomotion, and is selectively innervated by BG. We further show activation and suppression, respectively, of MLR glutamatergic neurons by direct and indirect pathways, which is required for bidirectional control of locomotion by BG circuits. These findings provide a fundamental understanding of how BG can initiate or suppress a motor program through cell-type-specific regulation of neurons linked to specific actions.

Pedunculopontine tegmental nucleus lesions impair probabilistic reversal learning by reducing sensitivity to positive reward feedback

Recent findings indicate that pedunculopontine tegmental nucleus (PPTg) neurons encode reward-related information that is context-dependent. This information is critical for behavioral flexibility when reward outcomes change signaling a shift in response patterns should occur. The present experiment investigated whether NMDA lesions of the PPTg affects the acquisition and/or reversal learning of a spatial discrimination using probabilistic reinforcement. Male Long-Evans rats received a bilateral infusion of NMDA (30nmoles/side) or saline into the PPTg. Subsequently, rats were tested in a spatial discrimination test using a probabilistic learning procedure. One spatial location was rewarded with an 80% probability and the other spatial location rewarded with a 20% probability. After reaching acquisition criterion of 10 consecutive correct trials, the spatial location - reward contingencies were reversed in the following test session. Bilateral and unilateral PPTg-lesioned rats acquired the spatial discrimination test comparable to that as sham controls. In contrast, bilateral PPTg lesions, but not unilateral PPTg lesions, impaired reversal learning. The reversal learning deficit occurred because of increased regressions to the previously 'correct' spatial location after initially selecting the new, 'correct' choice. PPTg lesions also reduced the frequency of win-stay behavior early in the reversal learning session, but did not modify the frequency of lose-shift behavior during reversal learning. The present results suggest that the PPTg contributes to behavioral flexibility under conditions in which outcomes are uncertain, e.g. probabilistic reinforcement, by facilitating sensitivity to positive reward outcomes that allows the reliable execution of a new choice pattern.

Structural and functional considerations of the cholinergic brainstem

Cholinergic neurons of the brainstem have traditionally been associated with a role in wakefulness as part of the reticular activating system, but their function cannot be explained solely on the basis of their modulation of the brain state. Recent findings about their connectivity and functional heterogeneity suggest a wider role in behavior, where basal ganglia is at the center of their influence. This review focuses on recent findings that suggest an intrinsic functional organization of the cholinergic brainstem that is closely correlated with its connectivity with midbrain and forebrain circuits. Furthermore, recent evidence on the temporal structure of the activation of brainstem cholinergic neurons reveals fundamental aspects about the nature of cholinergic signaling. Consideration of the cholinergic brainstem complex in the context of wider brain circuits is critical to understand its contribution to normal behavior.

Reward functions of the basal ganglia

Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior.

A novel turning behavior control method for rat-robot through the stimulation of ventral posteromedial thalamic nucleus

The concept of a rat-robot was initially introduced in 2002, bringing to the field, a novel area of research using modern research into neuroscience and robotics. This paper brings to the table, a study into the method best used for navigation systems in a rat-robot. Current research is epitomized by the use of reward-based spatial navigation, combining the concept of an induced reward sensation as well as a 'virtual touch' sensation to control the movement of the rat-robot. However, such methods are plagued by limitations affecting the success rate as well as preparation procedures which may have varying effects on different rats, even under similar conditions. Hence, this paper studies the stimulation of two different portions of the brain to induce a turning motion within the rat, namely the Ventral Posteromedial (VPM) thalamic nucleus as well as the Barrel-Field (BF) cortex and demonstrates the preferential usage of VPM as the choice use of navigational control in a rat-robot.

Decoding brain state transitions in the pedunculopontine nucleus: cooperative phasic and tonic mechanisms

Cholinergic neurons of the pedunculopontine nucleus (PPN) are most active during the waking state. Their activation is deemed to cause a switch in the global brain activity from sleep to wakefulness, while their sustained discharge may contribute to upholding the waking state and enhancing arousal. Similarly, non-cholinergic PPN neurons are responsive to brain state transitions and their activation may influence some of the same targets of cholinergic neurons, suggesting that they operate in coordination. Yet, it is not clear how the discharge of distinct classes of PPN neurons organize during brain states. Here, we monitored the in vivo network activity of PPN neurons in the anesthetized rat across two distinct levels of cortical dynamics and their transitions. We identified a highly structured configuration in PPN network activity during slow-wave activity that was replaced by decorrelated activity during the activated state (AS). During the transition, neurons were predominantly excited (phasically or tonically), but some were inhibited. Identified cholinergic neurons displayed phasic and short latency responses to sensory stimulation, whereas the majority of non-cholinergic showed tonic responses and remained at high discharge rates beyond the state transition. In vitro recordings demonstrate that cholinergic neurons exhibit fast adaptation that prevents them from discharging at high rates over prolonged time periods. Our data shows that PPN neurons have distinct but complementary roles during brain state transitions, where cholinergic neurons provide a fast and transient response to sensory events that drive state transitions, whereas non-cholinergic neurons maintain an elevated firing rate during global activation.

Prefrontal Regulation of Neuronal Activity in the Ventral Tegmental Area

Growing evidence indicates that midbrain dopamine (DA) cells integrate reward expectancy-related information from the prefrontal cortex to properly compute errors in reward prediction. Here we investigated how 2 major prefrontal subregions, the orbitofrontal cortex (OFC) and the medial prefrontal cortex (mPFC), contributed to DAergic prediction errors while rats performed a delay discounting task on a T-maze. Most putative DA cells in the task showed phasic responses to salient cues that predicted delayed rewards, but not to the actual rewards. After temporary inactivation of the OFC, putative DA cells exhibited strikingly reduced phasic responses to reward-predicting cues but increased responses to rewards. In contrast, mPFC inactivation significantly elevated DA responses to both predictive cues and rewards. In addition, OFC, but not mPFC, inactivation disrupted the activity of putative non-DA cells that encoded expected reward values during waiting periods. These results suggest that the 2 prefrontal subregions differentially regulate DAergic prediction errors and the OFC conveys value signals to midbrain dopamine systems.

An integrative role for the superior colliculus in selecting targets for movements

A fundamental goal of systems neuroscience is to understand the neural mechanisms underlying decision making. The midbrain superior colliculus (SC) is known to be central to the selection of one among many potential spatial targets for movements, which represents an important form of decision making that is tractable to rigorous experimental investigation. In this review, we first discuss data from mammalian models-including primates, cats, and rodents-that inform our understanding of how neural activity in the SC underlies the selection of targets for movements. We then examine the anatomy and physiology of inputs to the SC from three key regions that are themselves implicated in motor decisions-the basal ganglia, parabrachial region, and neocortex-and discuss how they may influence SC activity related to target selection. Finally, we discuss the potential for methodological advances to further our understanding of the neural bases of target selection. Our overarching goal is to synthesize what is known about how the SC and its inputs act together to mediate the selection of targets for movements, to highlight open questions about this process, and to spur future studies addressing these questions.

Rhythmic Firing of Pedunculopontine Tegmental Nucleus Neurons in Monkeys during Eye Movement Task

The pedunculopontine tegmental nucleus (PPTN) has been thought to be involved in the control of behavioral state. Projections to the entire thalamus and reciprocal connections with the basal ganglia nuclei suggest a potential role for the PPTN in the control of various rhythmic behaviors, including waking/sleeping and locomotion. Recently, rhythmic activity in the local field potentials was recorded from the PPTN of patients with Parkinson's disease who were treated with levodopa, suggesting that rhythmic firing is a feature of the functioning PPTN and might change with the behaving conditions even within waking. However, it remains unclear whether and how single PPTN neurons exhibit rhythmic firing patterns during various behaving conditions, including executing conditioned eye movement behaviors, seeking reward, or during resting. We previously recorded from PPTN neurons in healthy monkeys during visually guided saccade tasks and reported task-related changes in firing rate, and in this paper, we reanalyzed these data and focused on their firing patterns. A population of PPTN neurons demonstrated a regular firing pattern in that the coefficient of variation of interspike intervals was lower than what would be expected of theoretical random and irregular spike trains. Furthermore, a group of PPTN neurons exhibited a clear periodic single spike firing that changed with the context of the behavioral task. Many of these neurons exhibited a periodic firing pattern during highly active conditions, either the fixation condition during the saccade task or the free-viewing condition during the intertrial interval. We speculate that these task context-related changes in rhythmic firing of PPTN neurons might regulate the monkey's attentional and vigilance state to perform the task.

Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding

It has become clear that the hippocampus plays a critical role in the identification of new contexts and for the detection of changes in familiar contexts. The hippocampus accomplishes these goals through a continual process of comparing predicted features of a context or situation to those actually experienced. A mismatch between expected and experienced context expectations is thought to lead to the generation of a context prediction error (Mizumori, 2013) that functionally alerts connected brain areas to alter subsequent decision making and response selection. Little is understood about how hippocampal context analyses impact downstream decision processes. This issue is evaluated here first by comparing the nature of the information represented in hippocampus and decision-related midbrain-striatal structures, while rats perform a hippocampal-dependent spatial memory task in which rewards of different value are found at different locations. In contrast to place-specific and egocentric neural representations, neural representations of goal information are broadly distributed in hippocampal and decision neural circuitry, but they appear in different forms for different brain structures. It is suggested that further researching on how goal information processing occurs in hippocampus and decision neural circuitry may reveal insights into the nature of the interaction between memory and decision systems. The second part of this review describes neural pathways by which hippocampal context information might arrive within the decision circuit. The third section presents a hypothesis that the nature of the interactions between hippocampal and midbrain-striatal circuitry is regulated by the prefrontal cortex.

Nicotinic alteration of decision-making

Addiction to nicotine is characterized by impulses, urges and lack of self-control towards cigarettes. A key element in the process of addiction is the development of habits oriented towards nicotine consumption that surpass flexible systems as a consequence of a gradual adaptation to chronic drug exposure. However, the long-term effects of nicotine on brain circuits also induce wide changes in decision-making processes, affecting behaviors unrelated to cigarettes. This review aims at providing an update on the implications of nicotine on general decision-making processes, with an emphasis on impulsivity and risk-taking. As impulsivity is a rather ambiguous behavioral trait, we build on economic and normative theories to better characterize these nicotine-induced alterations in decision-making. Nonetheless, experimental data are sparse and often contradictory. We will discuss how the latest findings on the neurobiological basis of choice behavior may help disentangling these issues. We focus on the role of nicotine acetylcholine receptors and their different subunits, and on the spatio-temporal dynamics (i.e. diversity of the neural circuits, short- and long-term effects) of both endogenous acetylcholine and nicotine action. Finally, we try to link these neurobiological results with neuro-computational models of attention, valuation and action, and of the role of acetylcholine in these decision processes. This article is part of the Special Issue entitled 'The Nicotinic Acetylcholine Receptor: From Molecular Biology to Cognition'.

Kappa opioid receptor activation potentiates the cocaine-induced increase in evoked dopamine release recorded in vivo in the mouse nucleus accumbens

Behavioral stressors increase addiction risk in humans and increase the rewarding valence of drugs of abuse including cocaine, nicotine and ethanol in animal models. Prior studies have established that this potentiation of drug reward was mediated by stress-induced release of the endogenous dynorphin opioids and subsequent kappa opioid receptor (KOR) activation. In this study, we used in vivo fast scan cyclic voltammetry to test the hypothesis that KOR activation before cocaine administration might potentiate the evoked release of dopamine from ventral tegmental (VTA) synaptic inputs to the nucleus accumbens (NAc) and thereby increase the rewarding valence of cocaine. The KOR agonist U50488 inhibited dopamine release evoked by either medial forebrain bundle (MFB) or pedunculopontine tegmental nucleus (PPTg) activation of VTA inputs to the shell or core of the mouse NAc. Cocaine administration increased the dopamine response recorded in either the shell or core evoked by either MFB or PPTg stimulation. Administration of U50488 15 min before cocaine blocked the conditioned place preference (CPP) to cocaine, but only significantly reduced the effect of cocaine on the dopamine response evoked by PPTg stimulation to NAc core. In contrast, administration of U50488 60 min before cocaine significantly potentiated cocaine CPP and significantly increased the effects of cocaine on the dopamine response evoked by either MFB or PPTg stimulation, recorded in either NAc shell or core. Results of this study support the concept that stress-induced activation of KOR by endogenous dynorphin opioids may enhance the rewarding valence of drugs of abuse by potentiating the evoked dopamine response.

Enhanced consumption of salient solutions following pedunculopontine tegmental lesions

Rats with lesions of the pedunculopontine tegmental nucleus (PPTg) reliably overconsume high concentration sucrose solution. This effect is thought to be indicative of response-perseveration or loss of behavioral control in conditions of high excitement. While these theories have anatomical and behavioral support, they have never been explicitly tested. Here, we used a contact lickometer to examine the microstructure of drinking behavior to gain insight into the behavioral changes during overconsumption. Rats received either excitotoxic (ibotenic acid) damage to all PPTg neuronal subpopulations or selective depletion of the cholinergic neuronal sub-population (diphtheria toxin-urotensin II (Dtx-UII) lesions). We offered rats a variety of pleasant, neutral and aversive tastants to assess the generalizability and specificity of the overconsumption effect. Ibotenic-lesioned rats consumed significantly more 20% sucrose than sham controls, and did so through licking significantly more times. However, the behavioral microstructure during overconsumption was unaffected by the lesion and showed no indications of response-perseveration. Furthermore, the overconsumption effect did not generalize to highly consumed saccharin. In contrast, while only consuming small amounts of quinine solution, ibotenic-lesioned rats had significantly more licks and bursts for this tastant. Selective depletion of cholinergic PPTg neurons had no effect on consumption of any tastant. We then assessed whether it is the salience of the solution which determines overconsumption by ibotenic-lesioned rats. While maintained on free-food, ibotenic-lesioned rats had normal consumption of sucrose and hypertonic saline. After mild food deprivation ibotenic PPTg-lesioned rats overconsumed 20% sucrose. Subsequently, after dietary-induced sodium deficiency, lesioned rats consumed significantly more saline than controls. These results establish that it is the salience of the solution which is the determining factor leading to overconsumption following excitotoxic PPTg lesion. They also find no support for response-perseveration contributing to this effect. Results are discussed in terms of altered dopamine (DA) and salience signaling.

Expression of mu opioid receptor in dorsal diencephalic conduction system: new insights for the medial habenula

The habenular complex, encompassing medial (MHb) and lateral (LHb) divisions, is a highly conserved epithalamic structure involved in the dorsal diencephalic conduction system (DDC). These brain nuclei regulate information flow between the limbic forebrain and the mid- and hindbrain, integrating cognitive with emotional and sensory processes. The MHb is also one of the strongest expression sites for mu opioid receptors (MORs), which mediate analgesic and rewarding properties of opiates. At present however, anatomical distribution and function of these receptors have been poorly studied in MHb pathways. Here we took advantage of a newly generated MOR-mcherry knock-in mouse line to characterize MOR expression sites in the DDC. MOR-mcherry fluorescent signal is weak in the LHb, but strong expression is visible in the MHb, fasciculus retroflexus (fr) and interpeduncular nucleus (IPN), indicating that MOR is mainly present in the MHb-IPN pathway. MOR-mcherry cell bodies are detected both in basolateral and apical parts of MHb, where the receptor co-localizes with cholinergic and substance P (SP) neurons, respectively, representing two main MHb neuronal populations. MOR-mcherry is expressed in most MHb-SP neurons, and is present in only a subpopulation of MHb-cholinergic neurons. Intense diffuse fluorescence detected in lateral and rostral parts of the IPN further suggests that MOR-mcherry is transported to terminals of these SP and cholinergic neurons. Finally, MOR-mcherry is present in septal regions projecting to the MHb, and in neurons of the central and intermediate IPN. Together, this study describes MOR expression in several compartments of the MHb-IPN circuitry. The remarkably high MOR density in the MHb-IPN pathway suggests that these receptors are in a unique position to mediate analgesic, autonomic and reward responses.

A role for the lateral dorsal tegmentum in memory and decision neural circuitry

A role for the hippocampus in memory is clear, although the mechanism for its contribution remains a matter of debate. Converging evidence suggests that hippocampus evaluates the extent to which context-defining features of events occur as expected. The consequence of mismatches, or prediction error, signals from hippocampus is discussed in terms of its impact on neural circuitry that evaluates the significance of prediction errors: Ventral tegmental area (VTA) dopamine cells burst fire to rewards or cues that predict rewards (Schultz, Dayan, & Montague, 1997). Although the lateral dorsal tegmentum (LDTg) importantly controls dopamine cell burst firing (Lodge & Grace, 2006) the behavioral significance of the LDTg control is not known. Therefore, we evaluated LDTg functional activity as rats performed a spatial memory task that generates task-dependent reward codes in VTA (Jo, Lee, & Mizumori, 2013; Puryear, Kim, & Mizumori, 2010) and another VTA afferent, the pedunculopontine nucleus (PPTg, Norton, Jo, Clark, Taylor, & Mizumori, 2011). Reversible inactivation of the LDTg significantly impaired choice accuracy. LDTg neurons coded primarily egocentric information in the form of movement velocity, turning behaviors, and behaviors leading up to expected reward locations. A subset of the velocity-tuned LDTg cells also showed high frequency bursts shortly before or after reward encounters, after which they showed tonic elevated firing during consumption of small, but not large, rewards. Cells that fired before reward encounters showed stronger correlations with velocity as rats moved toward, rather than away from, rewarded sites. LDTg neural activity was more strongly regulated by egocentric behaviors than that observed for PPTg or VTA cells that were recorded by Puryear et al. and Norton et al. While PPTg activity was uniquely sensitive to ongoing sensory input, all three regions encoded reward magnitude (although in different ways), reward expectation, and reward encounters. Only VTA encoded reward prediction errors. LDTg may inform VTA about learned goal-directed movement that reflects the current motivational state, and this in turn may guide VTA determination of expected subjective goal values. When combined it is clear the LDTg and PPTg provide only a portion of the information that dopamine cells need to assess the value of prediction errors, a process that is essential to future adaptive decisions and switches of cognitive (i.e. memorial) strategies and behavioral responses.

Role of nicotinic acetylcholine receptors in regulating dopamine neuron activity

Midbrain dopamine (DA) neurons play a central role in a wide range of behaviors, from attention and motivation to motor control and reinforcement. The release of DA is modulated by a number of factors, and its deregulation has been implicated in multiple psychiatric disorders, such as addiction. In particular, nicotinic acetylcholine receptors (nAChRs) are key modulators of DA cells. Nicotine, the main addictive component in tobacco, strongly interacts with these receptors in the midbrain DA systems, resulting in reinforcing effects that are at the core of tobacco addiction. nAChRs are virtually expressed on every cell of the DA system, both at pre-, post- and extra-synaptic locations. The complex issue of interpreting the role of the large portfolio of different nAChR subtypes expressed on ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) neurons, and especially their role in defining functional DAergic subpopulations, is far from being solved. In this review we will try to provide the reader with an integrative view of the nicotinic modulation of DA neurons and its influence at the cellular, systemic and behavioral levels (exploratory behavior), as well as its implication in the reinforcing effects of nicotine.

Activity in mouse pedunculopontine tegmental nucleus reflects action and outcome in a decision-making task

Recent studies across several mammalian species have revealed a distributed network of cortical and subcortical brain regions responsible for sensorimotor decision making. Many of these regions have been shown to be interconnected with the pedunculopontine tegmental nucleus (PPTg), a brain stem structure characterized by neuronal heterogeneity and thought to be involved in several cognitive and behavioral functions. However, whether this structure plays a general functional role in sensorimotor decision making is unclear. We hypothesized that, in the context of a sensorimotor task, activity in the PPTg would reflect task-related variables in a similar manner as do the cortical and subcortical regions with which it is anatomically associated. To examine this hypothesis, we recorded PPTg activity in mice performing an odor-cued spatial choice task requiring a stereotyped leftward or rightward orienting movement to obtain a reward. We studied single-neuron activity during epochs of the task related to movement preparation, execution, and outcome (i.e., whether or not the movement was rewarded). We found that a substantial proportion of neurons in the PPTg exhibited direction-selective activity during one or more of these epochs. In addition, an overlapping population of neurons reflected movement direction and reward outcome. These results suggest that the PPTg should be considered within the network of brain areas responsible for sensorimotor decision making and lay the foundation for future experiments to examine how the PPTg interacts with other regions to control sensory-guided motor output.

Effects of prefrontal cortical inactivation on neural activity in the ventral tegmental area

Dopamine (DA) cells have been suggested to signal discrepancies between expected and actual rewards in reinforcement learning. DA cells in the ventral tegmental area (VTA) receive direct projections from the medial prefrontal cortex (mPFC), a structure known to be one of the brain areas that represents expected future rewards. To investigate whether the mPFC contributes to generating reward prediction error signals of DA cells, we recorded VTA cells from rats foraging for different amounts of reward in a spatial working memory task. Our results showed that DA cells initially responded after the acquisition of rewards, but over training, they exhibited phasic responses when rats detected sensory cues originating from the rewards before obtaining them. We also observed two separate groups of non-DA cells activated in expectation of upcoming rewards or during reward consumption. Bilateral injections of muscimol, a GABAA agonist, into the mPFC significantly decreased the non-DA activity that encoded reward expectation. By contrast, the same manipulation of the mPFC elevated DA responses to reward-predicting cues. However, neither DA nor non-DA responses elicited after reward acquisition were affected by mPFC inactivation. These results suggest that the mPFC provides information about expected rewards to the VTA, and its functional loss elevates DA responses to reward-predicting cues by altering expectations about forthcoming rewards.

Reward prediction-related increases and decreases in tonic neuronal activity of the pedunculopontine tegmental nucleus

The neuromodulators serotonin, acetylcholine, and dopamine have been proposed to play important roles in the execution of movement, control of several forms of attentional behavior, and reinforcement learning. While the response pattern of midbrain dopaminergic neurons and its specific role in reinforcement learning have been revealed, the roles of the other neuromodulators remain elusive. Reportedly, neurons in the dorsal raphe nucleus, one major source of serotonin, continually track the state of expectation of future rewards by showing a correlated response to the start of a behavioral task, reward cue presentation, and reward delivery. Here, we show that neurons in the pedunculopontine tegmental nucleus (PPTN), one major source of acetylcholine, showed similar encoding of the expectation of future rewards by a systematic increase or decrease in tonic activity. We recorded and analyzed PPTN neuronal activity in monkeys during a reward conditioned visually guided saccade task. The firing patterns of many PPTN neurons were tonically increased or decreased throughout the task period. The tonic activity pattern of neurons was correlated with their encoding of the predicted reward value; neurons exhibiting an increase or decrease in tonic activity showed higher or lower activity in the large reward-predicted trials, respectively. Tonic activity and reward-related modulation ended around the time of reward delivery. Additionally, some tonic changes in activity started prior to the appearance of the initial stimulus, and were related to the anticipatory fixational behavior. A partially overlapping population of neurons showed both the initial anticipatory response and subsequent predicted reward value-dependent activity modulation by their systematic increase or decrease of tonic activity. These bi-directional reward- and anticipatory behavior-related modulation patterns are suitable for the presumed role of the PPTN in reward processing and motivational control.

Updating of action-outcome associations is prevented by inactivation of the posterior pedunculopontine tegmental nucleus

•

The pedunculopontine tegmental nucleus is essential for action–outcome learning.

•

Sensitivity to instrumental contingency degradation is blocked by PPTg inactivation.

•

Inactivation of PPTg does not change performance of previously learnt operant tasks.

•

This is the first demonstration of a role for brainstem in action–outcome learning.

•

Learning functions of basal ganglia extend into the deepest parts of the circuitry.

The pedunculopontine tegmental nucleus (PPTg) is in a pivotal position between the basal ganglia and brainstem: it is able to influence and regulate all levels of basal ganglia and corticostriatal activity as well as being a key component of brainstem reticular and motor control circuitry. Consistent with its anatomical position, the PPTg has previously been shown to process rapid, salient sensory input, is a target for Parkinson’s disease treatments and has been implicated in associative learning. We explicitly investigated the role of the posterior pPPTg (pPPTg) in action–outcome processes, where actions are performed with the goal-directed aim of obtaining an anticipated outcome. We assessed rats’ sensitivity to degradation of the contingency between actions (lever pressing) and outcomes (food reward) during either inactivation of pPPTg by microinjection of the GABA agonist muscimol or control infusions of saline. In response to the degradation of contingency between lever press and food reward, saline treated rats rapidly reduced rates of lever pressing whereas muscimol treated rats (pPPTg inactivation) maintained previous lever pressing rates. In contrast, when the contingency between lever press and food reward was unchanged saline and muscimol treated rats maintained their previous rates of lever pressing. This shows that the pPPTg is critically required for updating associations between actions and outcomes, but not in the continued performance of previously learned associations. These results are consistent with a role for the PPTg in ‘higher-order’ associative learning and are the first to demonstrate a brainstem role in action–outcome learning.

Acetylcholine as a neuromodulator: cholinergic signaling shapes nervous system function and behavior

Acetylcholine in the brain alters neuronal excitability, influences synaptic transmission, induces synaptic plasticity, and coordinates firing of groups of neurons. As a result, it changes the state of neuronal networks throughout the brain and modifies their response to internal and external inputs: the classical role of a neuromodulator. Here, we identify actions of cholinergic signaling on cellular and synaptic properties of neurons in several brain areas and discuss consequences of this signaling on behaviors related to drug abuse, attention, food intake, and affect. The diverse effects of acetylcholine depend on site of release, receptor subtypes, and target neuronal population; however, a common theme is that acetylcholine potentiates behaviors that are adaptive to environmental stimuli and decreases responses to ongoing stimuli that do not require immediate action. The ability of acetylcholine to coordinate the response of neuronal networks in many brain areas makes cholinergic modulation an essential mechanism underlying complex behaviors.

A neural correlate of predicted and actual reward-value information in monkey pedunculopontine tegmental and dorsal raphe nucleus during saccade tasks

Dopamine, acetylcholine, and serotonin, the main modulators of the central nervous system, have been proposed to play important roles in the execution of movement, control of several forms of attentional behavior, and reinforcement learning. While the response pattern of midbrain dopaminergic neurons and its specific role in reinforcement learning have been revealed, the role of the other neuromodulators remains rather elusive. Here, we review our recent studies using extracellular recording from neurons in the pedunculopontine tegmental nucleus, where many cholinergic neurons exist, and the dorsal raphe nucleus, where many serotonergic neurons exist, while monkeys performed eye movement tasks to obtain different reward values. The firing patterns of these neurons are often tonic throughout the task period, while dopaminergic neurons exhibited a phasic activity pattern to the task event. The different modulation patterns, together with the activity of dopaminergic neurons, reveal dynamic information processing between these different neuromodulator systems.