Phasic dopamine release in the medial prefrontal cortex enhances stimulus discrimination

Dysfunctional mesocorticolimbic circuitry in cluster headache

BACKGROUND

This study aimed to identify mesocorticolimbic functional abnormalities in cluster headache (CH) patients, disentangling the roles of chronification and affective symptoms.

METHODS

Using the monetary incentive delay fMRI task to directly engage these pathways, we investigated functional alterations in key regions of this network in chronic (n = 23) and episodic CH patients (n = 49) compared to a control group (n = 32). After processing the fMRI data, we extracted beta values from selected regions and for contrasts of interest and entered them into logistic regression models adjusted for potential confounders (such as depressive and anxiety symptoms and smoking habit) to test their association with the diagnoses (chronic CH and control subjects, episodic CH and control subjects).

RESULTS

Results showed that chronic CH patients exhibited reduced ventral tegmental area (VTA) activity and a tendency towards significance (p = 0.056) for an increased medial prefrontal cortex (mPFC) responsiveness during reward anticipation, alongside a significant decrease in mPFC activity during reward outcomes. Episodic patients displayed abnormal mPFC activity across both reward phases, but coupled with intact VTA responses. Importantly, these functional abnormalities were not correlated to depressive and anxiety symptoms and smoking habits.

CONCLUSIONS

These findings suggest that chronic CH patients experience an imbalance in the VTA-mPFC pathway, while episodic patients may show early signs of this emerging dysfunction. Moreover, the observed reward processing alterations seem distinct from those associated with affective disorders, possibly highlighting unique mechanisms underlying the pathophysiology of CH.

On the genesis and unique functions of zinc neuromodulation

In addition to the essential structural and catalytic functions of zinc, evolution has adopted synaptic zinc as a neuromodulator. In the brain, synaptic zinc is released primarily from glutamatergic neurons, notably in the neocortex, hippocampus, amygdala, and auditory brainstem. In these brain areas, synaptic zinc is essential for neuronal and sensory processing fine-tuning. But what niche does zinc fill in neural signaling that other neuromodulators do not? Here, we discuss the evolutionary history of zinc as a signaling agent and its eventual adoption as an essential neuromodulator in the mammalian brain. We then attempt to describe the unique roles that zinc has carved out of the vast and diverse landscape of neuromodulators.

Monoaminergic Modulation of Learning and Cognitive Function in the Prefrontal Cortex

Extensive research has shed light on the cellular and functional underpinnings of higher cognition as influenced by the prefrontal cortex. Neurotransmitters act as key regulatory molecules within the PFC to assist with synchronizing cognitive state and arousal levels. The monoamine family of neurotransmitters, including dopamine, serotonin, and norepinephrine, play multifaceted roles in the cognitive processes behind learning and memory. The present review explores the organization and signaling patterns of monoamines within the PFC, as well as elucidates the numerous roles played by monoamines in learning and higher cognitive function.

Patterns of neural activity in prelimbic cortex neurons correlate with attentional behavior in the rodent continuous performance test

Sustained attention, the ability to focus on a stimulus or task over extended periods, is crucial for higher level cognition, and is impaired in individuals diagnosed with neuropsychiatric and neurodevelopmental disorders, including attention-deficit/hyperactivity disorder, schizophrenia, and depression. Translational tasks like the rodent continuous performance test (rCPT) can be used to study the cellular mechanisms underlying sustained attention. Accumulating evidence points to a role for the prelimbic cortex (PrL) in sustained attention, as electrophysiological single unit and local field (LFPs) recordings reflect changes in neural activity in the PrL in mice performing sustained attention tasks. While the evidence correlating PrL electrical activity with sustained attention is compelling, limitations inherent to electrophysiological recording techniques, including low sampling in single unit recordings and source ambivalence for LFPs, impede the ability to fully resolve the cellular mechanisms in the PrL that contribute to sustained attention. In vivo endoscopic calcium imaging using genetically encoded calcium sensors in behaving animals can address these questions by simultaneously recording up to hundreds of neurons at single cell resolution. Here, we used in vivo endoscopic calcium imaging to record patterns of neuronal activity in PrL neurons using the genetically encoded calcium sensor GCaMP6f in mice performing the rCPT at three timepoints requiring differing levels of cognitive demand and task proficiency. A higher proportion of PrL neurons were recruited during correct responses in sessions requiring high cognitive demand and task proficiency, and mice intercalated non-responsive-disengaged periods with responsive-engaged periods that resemble attention lapses. During disengaged periods, the correlation of calcium activity between PrL neurons was higher compared to engaged periods, suggesting a neuronal network state change during attention lapses in the PrL. Overall, these findings illustrate that cognitive demand, task proficiency, and task engagement differentially recruit activity in a subset of PrL neurons during sustained attention.

Functional diversity of dopamine axons in prefrontal cortex during classical conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Improved green and red GRAB sensors for monitoring dopaminergic activity in vivo

Dopamine (DA) plays multiple roles in a wide range of physiological and pathological processes via a large network of dopaminergic projections. To dissect the spatiotemporal dynamics of DA release in both dense and sparsely innervated brain regions, we developed a series of green and red fluorescent G-protein-coupled receptor activation-based DA (GRABDA) sensors using a variety of DA receptor subtypes. These sensors have high sensitivity, selectivity and signal-to-noise ratio with subsecond response kinetics and the ability to detect a wide range of DA concentrations. We then used these sensors in mice to measure both optogenetically evoked and behaviorally relevant DA release while measuring neurochemical signaling in the nucleus accumbens, amygdala and cortex. Using these sensors, we also detected spatially resolved heterogeneous cortical DA release in mice performing various behaviors. These next-generation GRABDA sensors provide a robust set of tools for imaging dopaminergic activity under a variety of physiological and pathological conditions.

Functional Diversity of Dopamine Axons in Prefrontal Cortex During Classical Conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Prefrontal cortical dopamine deficit may cause impaired glucose metabolism in schizophrenia

The brain neurotramsmitter dopamine may play an important role in modulating systemic glucose homeostasis. In seven hundred and four drug- naïve patients with first-episode schizophrenia, we provide robust evidence of positive associations between negative symptoms of schizophrenia and high fasting blood glucose. We then show that glucose metabolism and negative symptoms are improved when intermittent theta burst stimulation (iTBS) on prefrontal cortex (PFC) is performed in patients with predominantly negative symptoms of schizophrenia. These findings led us to hypothesize that the prefrontal cortical dopamine deficit, which is known to be associated with negative symptoms, may be responsible for abnormal glucose metabolism in schizophrenia. To explore this, we optogenetically and chemogenetically inhibited the ventral tegmental area (VTA)-medial prefrontal cortex (mPFC) dopamine projection in mice and found both procedures caused glucose intolerance. Moreover, microinjection of dopamine two receptor (D2R) neuron antagonists into mPFC in mice significantly impaired glucose tolerance. Finally, a transgenic mouse model of psychosis named Disc1tr exhibited depressive-like symptoms, impaired glucose homeostasis, and compared to wild type littermates reduced D2R expression in prefrontal cortex.

Maternal selenium dietary supplementation alters sociability and reinforcement learning deficits induced by in utero exposure to maternal immune activation in mice

Maternal immune activation (MIA) during pregnancy increases the risk for the unborn foetus to develop neurodevelopmental conditions such as autism spectrum disorder and schizophrenia later in life. MIA mouse models recapitulate behavioural and biological phenotypes relevant to both conditions, and are valuable models to test novel treatment approaches. Selenium (Se) has potent anti-inflammatory properties suggesting it may be an effective prophylactic treatment against MIA. The aim of this study was to determine if Se supplementation during pregnancy can prevent adverse effects of MIA on offspring brain and behaviour in a mouse model. Selenium was administered via drinking water (1.5 ppm) to pregnant dams from gestational day (GD) 9 to birth, and MIA was induced at GD17 using polyinosinic:polycytidylic acid (poly-I:C, 20 mg/kg via intraperitoneal injection). Foetal placenta and brain cytokine levels were assessed using a Luminex assay and brain elemental nutrients assessed using inductively coupled plasma- mass spectrometry. Adult offspring were behaviourally assessed using a reinforcement learning paradigm, the three-chamber sociability test and the open field test. MIA elevated placental IL-1β and IL-17, and Se supplementation successfully prevented this elevation. MIA caused an increase in foetal brain calcium, which was prevented by Se supplement. MIA caused in offspring a female-specific reduction in sociability, which was recovered by Se, and a male-specific reduction in social memory, which was not recovered by Se. Exposure to poly-I:C or selenium, but not both, reduced performance in the reinforcement learning task. Computational modelling indicated that this was predominantly due to increased exploratory behaviour, rather than reduced rate of learning the location of the food reward. This study demonstrates that while Se may be beneficial in ameliorating sociability deficits caused by MIA, it may have negative effects in other behavioural domains. Caution in the use of Se supplementation during pregnancy is therefore warranted.

Neuronal Ensembles in the Infralimbic Cortex Dynamically Process Distinct Aspects of Hedonic Value

Hedonic processing is critical for guiding appropriate behavior, and the infralimbic cortex (IL) is a key neural substrate associated with this function in rodents and humans. We used deep brain in vivo calcium imaging and taste reactivity in freely behaving male and female Sprague Dawley rats to examine whether the infralimbic cortex is involved in encoding innate versus conditioned hedonic states. In experiment 1, we examined the IL neuronal ensemble responsiveness to intraoral innately rewarding (sucrose) versus aversive (quinine) tastants. Most IL neurons responded to either sucrose only or both sucrose and quinine, with fewer neurons selectively processing quinine. Among neurons that responded to both stimuli, some appear to encode hedonic processing. In experiment 2, we examined how IL neurons process devalued sucrose using conditioned taste aversion (CTA). We found that neurons that responded exclusively to sucrose were disengaged while additional quinine-exclusive neurons were recruited. Moreover, tastant-specific neurons that did not change their neuronal activity after CTA appeared to encode objective hedonic value. However, other neuronal ensembles responded to both tastants and appear to encode distinct aspects of hedonic processing. Specifically, some neurons responded differently to quinine and sucrose and shifted from appetitive-like to aversive-like activity after CTA, thus encoding the subjective hedonic value of the stimulus. Conversely, neurons that responded similarly to both tastants were heightened after CTA. Our findings show dynamic shifts in IL ensembles encoding devalued sucrose and support a role for parallel processing of objective and subjective hedonic value.SIGNIFICANCE STATEMENT Disrupted affective processing contributes to psychiatric disorders including depression, substance use disorder, and schizophrenia. We assessed how the infralimbic cortex, a key neural substrate involved in affect generation and affect regulation, processes innate and learned hedonic states using deep brain in vivo calcium imaging in freely behaving rats. We report that unique infralimbic cortex ensembles encode stimulus subjective and objective hedonic value. Further, our findings support similarities and differences in innate versus learned negative affective states. This study provides insight into the neural mechanisms underlying affect generation and helps to establish a foundation for the development of novel treatment strategies to reduce negative affective states that arise in many psychiatric disorders.

Improved dual-color GRAB sensors for monitoring dopaminergic activity in vivo

Dopamine (DA) plays multiple roles in a wide range of physiological and pathological processes via a vast network of dopaminergic projections. To fully dissect the spatiotemporal dynamics of DA release in both dense and sparsely innervated brain regions, we developed a series of green and red fluorescent GPCR activation-based DA (GRABDA) sensors using a variety of DA receptor subtypes. These sensors have high sensitivity, selectivity, and signal-to-noise properties with subsecond response kinetics and the ability to detect a wide range of DA concentrations. We then used these sensors in freely moving mice to measure both optogenetically evoked and behaviorally relevant DA release while measuring neurochemical signaling in the nucleus accumbens, amygdala, and cortex. Using these sensors, we also detected spatially resolved heterogeneous cortical DA release in mice performing various behaviors. These next-generation GRABDA sensors provide a robust set of tools for imaging dopaminergic activity under a variety of physiological and pathological conditions.

Somatodendritic Release of Cholecystokinin Potentiates GABAergic Synapses Onto Ventral Tegmental Area Dopamine Cells

BACKGROUND

Neuropeptides are contained in nearly every neuron in the central nervous system and can be released not only from nerve terminals but also from somatodendritic sites. Cholecystokinin (CCK), among the most abundant neuropeptides in the brain, is expressed in the majority of midbrain dopamine neurons. Despite this high expression, CCK function within the ventral tegmental area (VTA) is not well understood.

METHODS

We confirmed CCK expression in VTA dopamine neurons through immunohistochemistry and in situ hybridization and detected optogenetically induced CCK release using an enzyme-linked immunosorbent assay. To investigate whether CCK modulates VTA circuit activity, we used whole-cell patch clamp recordings in mouse brain slices. We infused CCK locally in vivo and tested food intake and locomotion in fasted mice. We also used in vivo fiber photometry to measure Ca²⁺ transients in dopamine neurons during feeding.

RESULTS

Here we report that VTA dopamine neurons release CCK from somatodendritic regions, where it triggers long-term potentiation of GABAergic (gamma-aminobutyric acidergic) synapses. The somatodendritic release occurs during trains of optogenetic stimuli or prolonged but modest depolarization and is dependent on synaptotagmin-7 and T-type Ca²⁺ channels. Depolarization-induced long-term potentiation is blocked by a CCK₂ receptor antagonist and mimicked by exogenous CCK. Local infusion of CCK in vivo inhibits food consumption and decreases distance traveled in an open field test. Furthermore, intra-VTA-infused CCK reduced dopamine cell Ca²⁺ signals during food consumption after an overnight fast and was correlated with reduced food intake.

CONCLUSIONS

Our experiments introduce somatodendritic neuropeptide release as a previously unknown feedback regulator of VTA dopamine cell excitability and dopamine-related behaviors.

Blunt dopamine transmission due to decreased GDNF in the PFC evokes cognitive impairment in Parkinson's disease

Studies have found that the absence of glial cell line-derived neurotrophic factor may be the primary risk factor for Parkinson's disease. However, there have not been any studies conducted on the potential relationship between glial cell line-derived neurotrophic factor and cognitive performance in Parkinson's disease. We first performed a retrospective case-control study at the Affiliated Hospital of Xuzhou Medical University between September 2018 and January 2020 and found that a decreased serum level of glial cell line-derived neurotrophic factor was a risk factor for cognitive disorders in patients with Parkinson's disease. We then established a mouse model of Parkinson's disease induced by 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine and analyzed the potential relationships among glial cell line-derived neurotrophic factor in the prefrontal cortex, dopamine transmission, and cognitive function. Our results showed that decreased glial cell line-derived neurotrophic factor in the prefrontal cortex weakened dopamine release and transmission by upregulating the presynaptic membrane expression of the dopamine transporter, which led to the loss and primitivization of dendritic spines of pyramidal neurons and cognitive impairment. In addition, magnetic resonance imaging data showed that the long-term lack of glial cell line-derived neurotrophic factor reduced the connectivity between the prefrontal cortex and other brain regions, and exogenous glial cell line-derived neurotrophic factor significantly improved this connectivity. These findings suggested that decreased glial cell line-derived neurotrophic factor in the prefrontal cortex leads to neuroplastic degeneration at the level of synaptic connections and circuits, which results in cognitive impairment in patients with Parkinson's disease.

Repeated methamphetamine administration produces cognitive deficits through augmentation of GABAergic synaptic transmission in the prefrontal cortex

Methamphetamine (METH) abuse is associated with the emergence of cognitive deficits and hypofrontality, a pathophysiological marker of many neuropsychiatric disorders that is produced by altered balance of local excitatory and inhibitory synaptic transmission. However, there is a dearth of information regarding the cellular and synaptic mechanisms underlying METH-induced cognitive deficits and associated hypofrontal states. Using PV-Cre transgenic rats that went through a METH sensitization regime or saline (SAL) followed by 7-10 days of home cage abstinence combined with cognitive tests, chemogenetic experiments, and whole-cell patch recordings on the prelimbic prefrontal cortex (PFC), we investigated the cellular and synaptic mechanisms underlying METH-induce hypofrontality. We report here that repeated METH administration in rats produces deficits in working memory and increases in inhibitory synaptic transmission onto pyramidal neurons in the PFC. The increased PFC inhibition is detected by an increase in spontaneous and evoked inhibitory postsynaptic synaptic currents (IPSCs), an increase in GABAergic presynaptic function, and a shift in the excitatory-inhibitory balance onto PFC deep-layer pyramidal neurons. We find that pharmacological blockade of D1 dopamine receptor function reduces the METH-induced augmentation of IPSCs, suggesting a critical role for D1 dopamine signaling in METH-induced hypofrontality. In addition, repeated METH administration increases the intrinsic excitability of parvalbumin-positive fast spiking interneurons (PV + FSIs), a key local interneuron population in PFC that contributes to the control of inhibitory tone. Using a cell type-specific chemogenetic approach, we show that increasing PV + FSIs activity in the PFC is necessary and sufficient to cause deficits in temporal order memory similar to those induced by METH. Conversely, reducing PV + FSIs activity in the PFC of METH-exposed rats rescues METH-induced temporal order memory deficits. Together, our findings reveal that repeated METH exposure increases PFC inhibitory tone through a D1 dopamine signaling-dependent potentiation of inhibitory synaptic transmission, and that reduction of PV + FSIs activity can rescue METH-induced cognitive deficits, suggesting a potential therapeutic approach to treating cognitive symptoms in patients suffering from METH use disorder.

Cognitive control in Parkinson's disease

Cognitive control is the ability to act according to plan. Problems with cognitive control are a primary symptom and a major decrement of quality of life in Parkinson's disease (PD). Individuals with PD have problems with seemingly different controlled processes (e.g., task switching, impulsivity, gait disturbance, apathetic motivation). We review how these varied processes all rely upon disease-related alteration of common neural substrates, particularly due to dopaminergic imbalance. A comprehensive understanding of the neural systems underlying cognitive control will hopefully lead to more concise and reliable explanations of distributed deficits. However, high levels of clinical heterogeneity and medication-invariant control deficiencies suggest the need for increasingly detailed elaboration of the neural systems underlying control in PD.

Off-Target Expression of Cre-Dependent Adeno-Associated Viruses in Wild-Type C57BL/6J Mice

Adeno-associated viruses (AAVs) are a commonly used tool in neuroscience to efficiently label, trace, and/or manipulate neuronal populations. Highly specific targeting can be achieved through recombinase-dependent AAVs in combination with transgenic rodent lines that express Cre-recombinase in specific cell types. Visualization of viral expression is typically achieved through fluorescent reporter proteins (e.g., GFP or mCherry) packaged within the AAV genome. Although nonamplified fluorescence is usually sufficient to observe viral expression, immunohistochemical amplification of the fluorescent reporter is routinely used to improve viral visualization. In the present study, Cre-dependent AAVs were injected into the neocortex of wild-type C57BL/6J mice. While we observed weak but consistent nonamplified off-target double inverted open reading frame (DIO) expression in C57BL/6J mice, antibody amplification of the GFP or mCherry reporter revealed notable Cre-independent viral expression. Off-target expression of DIO constructs in wild-type C57BL/6J mice occurred independent of vendor, AAV serotype, or promoter. We also evaluated whether Cre-independent expression had functional effects via designer receptors exclusively activated by designer drugs (DREADDs). The DREADD agonist C21 (compound 21) had no effect on contextual fear conditioning or c-Fos expression in DIO-hM3Dq-mCherry+ cells of C57BL/6J mice. Together, our results indicate that DIO constructs have off-target expression in wild-type subjects. Our findings are particularly important for the design of experiments featuring sensitive systems and/or quantitative measurements that could be negatively impacted by off-target expression.

Reactivating a positive feedback loop VTA-BLA-NAc circuit associated with positive experience ameliorates the attenuated reward sensitivity induced by chronic stress

Both genetic predisposition and life events, particularly life stress, are thought to increase the risk for depression. Reward sensitivity appears to be attenuated in major depressive disorder (MDD), suggesting deficits in reward processing in these patients. We identified the VTA-BLA-NAc circuit as being activated by sex reward, and the VTA neurons that respond to sex reward are mostly dopaminergic. Acute or chronic reactivation of this circuit ameliorates the reward insensitivity induced by chronic restraint stress. Our histological and electrophysiological results show that the VTA neuron subpopulation responding to restraint stress, predominantly GABAergic neurons, inhibits the responsiveness of VTA dopaminergic neurons to reward stimuli, which is probably the mechanism by which stress modulates the reward processing neural circuits and subsequently disrupts reward-related behaviours. Furthermore, we found that the VTA-BLA-NAc circuit is a positive feedback loop. Blocking the projections from the BLA to the NAc associated with sex reward increases the excitability of VTA GABAergic neurons and decreases the excitability of VTA dopaminergic neurons, while activating this pathway decreases the excitability of VTA GABAergic neurons and increases the excitability of VTA dopaminergic neurons, which may be the cellular mechanism by which the VTA-BLA-NAc circuit associated with sex reward ameliorates the attenuated reward sensitivity induced by chronic stress.

Rapid suppression and sustained activation of distinct cortical regions for a delayed sensory-triggered motor response

The neuronal mechanisms generating a delayed motor response initiated by a sensory cue remain elusive. Here, we tracked the precise sequence of cortical activity in mice transforming a brief whisker stimulus into delayed licking using wide-field calcium imaging, multiregion high-density electrophysiology, and time-resolved optogenetic manipulation. Rapid activity evoked by whisker deflection acquired two prominent features for task performance: (1) an enhanced excitation of secondary whisker motor cortex, suggesting its important role connecting whisker sensory processing to lick motor planning; and (2) a transient reduction of activity in orofacial sensorimotor cortex, which contributed to suppressing premature licking. Subsequent widespread cortical activity during the delay period largely correlated with anticipatory movements, but when these were accounted for, a focal sustained activity remained in frontal cortex, which was causally essential for licking in the response period. Our results demonstrate key cortical nodes for motor plan generation and timely execution in delayed goal-directed licking.

Dopamine Inputs from the Ventral Tegmental Area into the Medial Prefrontal Cortex Modulate Neuropathic Pain-Associated Behaviors in Mice

The medial prefrontal cortex (mPFC) is a brain region involved in the affective components of pain and undergoes plasticity during the development of chronic pain. Dopamine (DA) is a key neuromodulator in the mesocortical circuit and modulates working memory and aversion. Although DA inputs into the mPFC are known to modulate plasticity, whether and how these inputs affect pain remains incompletely understood. By using optogenetics, we find that phasic activation of DA inputs from the ventral tegmental area (VTA) into the mPFC reduce mechanical hypersensitivity during neuropathic pain states. Mice with neuropathic pain exhibit a preference for contexts paired with photostimulation of DA terminals in the mPFC. Fiber photometry-based calcium imaging reveals that DA increases the activity of mPFC neurons projecting to the ventrolateral periaqueductal gray (vlPAG). Together, our findings indicate an important role of mPFC DA signaling in pain modulation.

The mouse prefrontal cortex: Unity in diversity

The prefrontal cortex (PFC) is considered to constitute the highest stage of neural integration and to be devoted to representation and production of actions. Studies in primates have laid the foundation for theories regarding the principles of prefrontal function and provided mechanistic insights. The recent surge of studies of the PFC in mice holds promise for evolvement of present theories and development of novel concepts, particularly regarding principles shared across mammals. Here we review recent empirical work on the mouse PFC capitalizing on the experimental toolbox currently privileged to studies in this species. We conclude that this line of research has revealed cellular and structural distinctions of the PFC and neuronal activity with direct relevance to theories regarding the functions of the PFC. We foresee that data-rich mouse studies will be key to shed light on the general prefrontal architecture and mechanisms underlying cognitive aspects of organized actions.

What is dopamine doing in model-based reinforcement learning?

Experiments have implicated dopamine in model-based reinforcement learning (RL). These findings are unexpected as dopamine is thought to encode a reward prediction error (RPE), which is the key teaching signal in model-free RL. Here we examine two possible accounts for dopamine's involvement in model-based RL: the first that dopamine neurons carry a prediction error used to update a type of predictive state representation called a successor representation, the second that two well established aspects of dopaminergic activity, RPEs and surprise signals, can together explain dopamine's involvement in model-based RL.

Medial prefrontal cortical control of reward- and aversion-based behavioral output: Bottom-up modulation

How does the brain guide our actions? This is a complex issue, where the medial prefrontal cortex (mPFC) plays a crucial role. The mPFC is essential for cognitive flexibility and decision making. These functions are related to reward- and aversion-based learning, which ultimately drive behavior. Though, cortical projections and modulatory systems that may regulate those processes in the mPFC are less understood. How does the mPFC regulate approach-avoidance behavior in the case of conflicting aversive and appetitive stimuli? This is likely dependent on the bottom-up neuromodulation of the mPFC projection neurons. In this review, we integrate behavioral-, pharmacological-, and viral-based circuit manipulation data showing the involvement of mPFC dopaminergic, noradrenergic, cholinergic, and serotoninergic inputs in reward and aversion processing. Given that an incorrect balance of reward and aversion value could be a key problem in mental diseases such as substance use disorders, we discuss outstanding questions for future research on the role of mPFC modulation in reward and aversion.

Rational inattention and tonic dopamine

Slow-timescale (tonic) changes in dopamine (DA) contribute to a wide variety of processes in reinforcement learning, interval timing, and other domains. Furthermore, changes in tonic DA exert distinct effects depending on when they occur (e.g., during learning vs. performance) and what task the subject is performing (e.g., operant vs. classical conditioning). Two influential theories of tonic DA-the average reward theory and the Bayesian theory in which DA controls precision-have each been successful at explaining a subset of empirical findings. But how the same DA signal performs two seemingly distinct functions without creating crosstalk is not well understood. Here we reconcile the two theories under the unifying framework of 'rational inattention,' which (1) conceptually links average reward and precision, (2) outlines how DA manipulations affect this relationship, and in so doing, (3) captures new empirical phenomena. In brief, rational inattention asserts that agents can increase their precision in a task (and thus improve their performance) by paying a cognitive cost. Crucially, whether this cost is worth paying depends on average reward availability, reported by DA. The monotonic relationship between average reward and precision means that the DA signal contains the information necessary to retrieve the precision. When this information is needed after the task is performed, as presumed by Bayesian inference, acute manipulations of DA will bias behavior in predictable ways. We show how this framework reconciles a remarkably large collection of experimental findings. In reinforcement learning, the rational inattention framework predicts that learning from positive and negative feedback should be enhanced in high and low DA states, respectively, and that DA should tip the exploration-exploitation balance toward exploitation. In interval timing, this framework predicts that DA should increase the speed of the internal clock and decrease the extent of interference by other temporal stimuli during temporal reproduction (the central tendency effect). Finally, rational inattention makes the new predictions that these effects should be critically dependent on the controllability of rewards, that post-reward delays in intertemporal choice tasks should be underestimated, and that average reward manipulations should affect the speed of the clock-thus capturing empirical findings that are unexplained by either theory alone. Our results suggest that a common computational repertoire may underlie the seemingly heterogeneous roles of DA.

Unique effects of social defeat stress in adolescent male mice on the Netrin-1/DCC pathway, prefrontal cortex dopamine and cognition (Social stress in adolescent vs. adult male mice)

For some individuals, social stress is a risk factor for psychiatric disorders characterised by adolescent onset, prefrontal cortex (PFC) dysfunction and cognitive impairments. Social stress may be particularly harmful during adolescence when dopamine (DA) axons are still growing to the PFC, rendering them sensitive to environmental influences. The guidance cue Netrin-1 and its receptor, DCC, coordinate to control mesocorticolimbic DA axon targeting and growth during this age. Here we adapted the accelerated social defeat (AcSD) paradigm to expose male mice to social stress in either adolescence or adulthood and categorised them as "resilient" or "susceptible" based on social avoidance behaviour. We examined whether stress would alter the expression of DCC and Netrin-1 in mesolimbic dopamine regions and would have enduring consequences on PFC dopamine connectivity and cognition. While in adolescence the majority of mice are resilient but exhibit risk-taking behaviour, AcSD in adulthood leads to a majority of susceptible mice without altering anxiety-like traits. In adolescent, but not adult mice, AcSD dysregulates DCC and Netrin-1 expression in mesolimbic DA regions. These molecular changes in adolescent mice are accompanied by changes in PFC DA connectivity. Following AcSD in adulthood, cognitive function remains unaffected, but all mice exposed to AcSD in adolescence show deficits in inhibitory control when they reach adulthood. These findings indicate that exposure to AcSD in adolescence vs. adulthood has substantially different effects on brain and behaviour and that stress-induced social avoidance in adolescence does not predict vulnerability to deficits in cognitive performance.Significance statement During adolescence, dopamine circuitries undergo maturational changes which may render them particularly vulnerable to social stress. While social stress can be detrimental to adolescents and adults, it may engage different mechanisms and impact different domains, depending on age. The accelerated social defeat (AcSD) model implemented here allows exposing adolescent and adult male mice to comparable social stress levels. AcSD in adulthood leads to a majority of socially avoidant mice. However, the predominance of AcSD-exposed adolescent mice does not develop social avoidance, and these resilient mice show risk-taking behaviour. Nonetheless, in adolescence only, AcSD dysregulates Netrin-1/DCC expression in mesolimbic dopamine regions, possibly disrupting mesocortical dopamine and cognition. The unique adolescent responsiveness to stress may explain increased psychopathology risk at this age.

Valence processing in the PFC: Reconciling circuit-level and systems-level views

An essential component in animal behavior is the ability to process emotion and dissociate among positive and negative valence in response to a rewarding or aversive stimulus. The medial prefrontal cortex (mPFC)-responsible for higher order executive functions that include cognition, learning, and working memory; and is also involved in sociability-plays a major role in emotional processing and control. Although the amygdala is widely regarded as the "emotional hub," the mPFC encodes for context-specific salience and elicits top-down control over limbic circuitry. The mPFC can then conduct behavioral responses, via cortico-striatal and cortico-brainstem pathways, that correspond to emotional stimuli. Evidence shows that abnormalities within the mPFC lead to sociability deficits, working memory impairments, and drug-seeking behavior that include addiction and compulsive disorders; as well as conditions such as anhedonia. Recent studies investigate the effects of aberrant salience processing on cortical circuitry and neuronal populations associated with these behaviors. In this chapter, we discuss mPFC valence processing, neuroanatomical connections, and physiological substrates involved in mPFC-associated behavior. We review neurocomputational and theoretical models such as "mixed selectivity," that describe cognitive control, attentiveness, and motivational drives. Using this knowledge, we describe the effects of valence imbalances and its influence on mPFC neural pathways that contribute to deficits in social cognition, while understanding the effects in addiction/compulsive behaviors and anhedonia.

Independent Contributions of Discrete Dopaminergic Circuits to Cellular Plasticity, Memory Strength, and Valence in Drosophila

Dopaminergic neurons play a key role in encoding associative memories, but little is known about how these circuits modulate memory strength. Here we report that different sets of dopaminergic neurons projecting to the Drosophila mushroom body (MB) differentially regulate valence and memory strength. PPL2 neurons increase odor-evoked calcium re- sponses to a paired odor in the MB and enhance behavioral memory strength when activated during olfactory classical conditioning. When paired with odor alone, they increase MB responses to the paired odor but do not drive behavioral approach or avoidance, suggesting that they increase the salience of the odor without encoding strong valence. This contrasts with the role of dopaminergic PPL1 neurons, which drive behavioral reinforcement but do not alter odor-evoked calcium responses in the MB when stimulated. These data suggest that different sets of dopaminergic neurons modulate olfactory valence and memory strength via independent actions on a memory-encoding brain region.

Boto et al. investigated the roles of two sets of dopaminergic neurons that converge on a memory-encoding brain region in flies. While one set, PPL1, drives aversive reinforcement (valence), PPL2 neurons enhance memory strength via modulation of Ca²⁺ response plasticity in memory-encoding mushroom body neurons.

Effects of exposure to chronic uncertainty and a sensitizing regimen of amphetamine injections on locomotion, decision-making, and dopamine receptors in rats

Gambling disorder (GD) is a behavioral addiction that may be linked to alterations in dopamine (DA) systems. Gambling involves chronic exposure to uncertain reward, which can sensitize the activity of DA systems. Here we explored how combinations of Pavlovian and instrumental uncertainty impact DA sensitization and risky decision-making. Experiment 1: 40 rats underwent 66 uncertainty exposure (UE) sessions during which they responded for saccharin. Animal responding was reinforced according to a fixed or variable (FR/VR) ratio schedule that turned on a conditioned stimulus (CS; light), which predicted saccharin on 50% or 100% of trials. Animals responded under one of the four conditions: FR-CS100% (no uncertainty), VR-CS100%, FR-CS50%, and VR-CS50% (maximal uncertainty). DA sensitization was inferred from an enhanced locomotor response to d-amphetamine (d-AMPH; 0.5 mg/kg) challenge. The rat gambling task (rGT) was used to assess decision-making. Experiment 2: 24 rats received 5 weeks of sensitizing d-AMPH or saline doses, followed by locomotor activity and rGT testing. Experiment 3: Effects of UE and a sensitizing d-AMPH regimen on DA D1, D2, and D3 receptor binding were assessed in 44 rats using autoradiography. Compared to FR-CS100%, VR-CS100% and VR-CS50% rats displayed a greater locomotor response to d-AMPH, and VR-CS50% rats demonstrated riskier decision-making. Chronic d-AMPH-treated rats mirrored the effects of VR-CS50% groups on these two indices. Both VR-CS50% and d-AMPH-treated groups had increased striatal DA D2 receptor binding. These results suggest that chronic uncertainty exposure, similar to exposure to a sensitizing d-AMPH regimen, sensitized the function of DA systems and increased risky decision-making.

Dopamine transients do not act as model-free prediction errors during associative learning

Dopamine neurons are proposed to signal the reward prediction error in model-free reinforcement learning algorithms. This term represents the unpredicted or 'excess' value of the rewarding event, value that is then added to the intrinsic value of any antecedent cues, contexts or events. To support this proposal, proponents cite evidence that artificially-induced dopamine transients cause lasting changes in behavior. Yet these studies do not generally assess learning under conditions where an endogenous prediction error would occur. Here, to address this, we conducted three experiments where we optogenetically activated dopamine neurons while rats were learning associative relationships, both with and without reward. In each experiment, the antecedent cues failed to acquire value and instead entered into associations with the later events, whether valueless cues or valued rewards. These results show that in learning situations appropriate for the appearance of a prediction error, dopamine transients support associative, rather than model-free, learning.

Glutamatergic neurons in the medial prefrontal cortex mediate the formation and retrieval of cocaine-associated memories in mice

In drug addiction, environmental stimuli previously associated with cocaine use readily elicit cocaine-associated memories, which persist long after abstinence and trigger cocaine craving and consumption. Although previous studies suggest that the medial prefrontal cortex (mPFC) is involved in the expression of cocaine-addictive behaviors, it remains unclear whether excitatory and inhibitory neurons in the mPFC are causally related to the formation and retrieval of cocaine-associated memories. To address this issue, we used the designer receptors exclusively activated by designer drugs (DREADD) technology combined with a cocaine-induced conditioned place preference (CPP) paradigm. We suppressed mPFC neuronal activity in a cell-type- and timing-dependent manner. C57BL/6J wild-type mice received bilateral intra-mPFC infusion of an adeno-associated virus (AAV) expressing inhibitory DREADD (hM4Di) under the control of CaMKII promotor to selectively suppress mPFC pyramidal neurons. GAD67-Cre mice received bilateral intra-mPFC infusion of a Cre-dependent AAV expressing hM4Di to specifically silence GABAergic neurons. Chemogenetic suppression of mPFC pyramidal neurons significantly attenuated both the acquisition and expression of cocaine CPP, while suppression of mPFC GABAergic neurons affected neither the acquisition nor expression of cocaine CPP. Moreover, chemogenetic inhibition of mPFC glutamatergic neurons did not affect the acquisition and expression of lithium chloride-induced conditioned place aversion. These results suggest that the activation of glutamatergic, but not GABAergic, neurons in the mPFC mediates both the formation and retrieval of cocaine-associated memories.

Dysfunction of homeostatic control of dopamine by astrocytes in the developing prefrontal cortex leads to cognitive impairments

Astrocytes orchestrate neural development by powerfully coordinating synapse formation and function and, as such, may be critically involved in the pathogenesis of neurodevelopmental abnormalities and cognitive deficits commonly observed in psychiatric disorders. Here, we report the identification of a subset of cortical astrocytes that are competent for regulating dopamine (DA) homeostasis during postnatal development of the prefrontal cortex (PFC), allowing for optimal DA-mediated maturation of excitatory circuits. Such control of DA homeostasis occurs through the coordinated activity of astroglial vesicular monoamine transporter 2 (VMAT2) together with organic cation transporter 3 and monoamine oxidase type B, two key proteins for DA uptake and metabolism. Conditional deletion of VMAT2 in astrocytes postnatally produces loss of PFC DA homeostasis, leading to defective synaptic transmission and plasticity as well as impaired executive functions. Our findings show a novel role for PFC astrocytes in the DA modulation of cognitive performances with relevance to psychiatric disorders.

Dopamine and Cognitive Control in Prefrontal Cortex

Cognitive control, the ability to orchestrate behavior in accord with our goals, depends on the prefrontal cortex. These cognitive functions are heavily influenced by the neuromodulator dopamine. We review here recent insights exploring the influence of dopamine on neuronal response properties in prefrontal cortex (PFC) during ongoing behaviors in primates. This review suggests three major computational roles of dopamine in cognitive control: (i) gating sensory input, (ii) maintaining and manipulating working memory contents, and (iii) relaying motor commands. For each of these roles, we propose a neuronal microcircuit based on known mechanisms of action of dopamine in PFC, which are corroborated by computational network models. This conceptual approach accounts for the various roles of dopamine in prefrontal executive functioning.

Minimal Circuit Model of Reward Prediction Error Computations and Effects of Nicotinic Modulations

Dopamine (DA) neurons in the ventral tegmental area (VTA) are thought to encode reward prediction errors (RPE) by comparing actual and expected rewards. In recent years, much work has been done to identify how the brain uses and computes this signal. While several lines of evidence suggest the interplay of the DA and the inhibitory interneurons in the VTA implements the RPE computation, it still remains unclear how the DA neurons learn key quantities, for example the amplitude and the timing of primary rewards during conditioning tasks. Furthermore, endogenous acetylcholine and exogenous nicotine, also likely affect these computations by acting on both VTA DA and GABA (γ -aminobutyric acid) neurons via nicotinic-acetylcholine receptors (nAChRs). To explore the potential circuit-level mechanisms for RPE computations during classical-conditioning tasks, we developed a minimal computational model of the VTA circuitry. The model was designed to account for several reward-related properties of VTA afferents and recent findings on VTA GABA neuron dynamics during conditioning. With our minimal model, we showed that the RPE can be learned by a two-speed process computing reward timing and magnitude. By including models of nAChR-mediated currents in the VTA DA-GABA circuit, we showed that nicotine should reduce the acetylcholine action on the VTA GABA neurons by receptor desensitization and potentially boost DA responses to reward-related signals in a non-trivial manner. Together, our results delineate the mechanisms by which RPE are computed in the brain, and suggest a hypothesis on nicotine-mediated effects on reward-related perception and decision-making.

Dopamine tunes prefrontal outputs to orchestrate aversive processing

Decades of research suggest that the mesocortical dopamine system exerts powerful control over mPFC physiology and function. Indeed, dopamine signaling in the medial prefrontal cortex (mPFC) is implicated in a vast array of processes, including working memory, stimulus discrimination, stress responses, and emotional and behavioral control. Consequently, even slight perturbations within this delicate system result in profound disruptions of mPFC-mediated processes. Many neuropsychiatric disorders are associated with dysregulation of mesocortical dopamine, including schizophrenia, depression, attention deficit hyperactivity disorder, post-traumatic stress disorder, among others. Here, we review the anatomy and functions of the mesocortical dopamine system. In contrast to the canonical role of striatal dopamine in reward-related functions, recent work has revealed that mesocortical dopamine fine-tunes distinct efferent projection populations in a manner that biases subsequent behavior towards responding to stimuli associated with potentially aversive outcomes. We propose a framework wherein dopamine can serve as a signal for switching mPFC states by orchestrating how information is routed to the rest of the brain.

Dopaminergic modulation of pain signals in the medial prefrontal cortex: Challenges and perspectives

Chronic pain is a massive socieoeconomic burden and is often refractory to treatment. To devise novel therapeutic interventions, it is important to understand in detail the processing of pain signals in the brain. Recent studies have revealed shared features between the brain's reward and pain systems. Dopamine (DA) is a key neuromodulator in the mesocorticolimbic system that has been implicated not only in motivated behaviours, reinforcement learning and reward processing, but also in the pain axis. The medial prefrontal cortex (mPFC) is an important region for mediating executive functions including attention, judgement, and learning. Studies have revealed that the mPFC undergoes plasticity during the development of chronic pain. The mPFC receives dopaminergic input from the ventral tegmental area (VTA), and stimulation of these inputs has been shown to modulate the plasticity of the mPFC and anxiety and aversive behaviour. Here, we review the role of the mPFC and its dopaminergic modulation in chronic pain.

Dopamine enhances signal-to-noise ratio in cortical-brainstem encoding of aversive stimuli

Despite abundant evidence that dopamine (DA) modulates medial prefrontal cortex (mPFC) activity to mediate diverse behavioral functions^1,2, the precise circuit computations remain elusive. One potentially unifying model by which DA can underlie a diversity of functions is to modulate the signal-to-noise ratio (SNR) in subpopulations of mPFC neurons^3–6, where neural activity conveying sensory information (signal) is amplified relative to spontaneous firing (noise). Here, we demonstrate that DA increases the SNR of responses to aversive stimuli in mPFC neurons projecting to the dorsal periaqueductal gray (dPAG). Using electrochemical approaches, we reveal the precise time course of pinch-evoked DA release in the mPFC, and show that mPFC DA biases behavioral responses to aversive stimuli. Activation of mPFC-dPAG neurons is sufficient to drive place avoidance and defensive behaviors. mPFC-dPAG neurons displayed robust shock-induced excitations, as visualized by single-cell, projection-defined microendoscopic calcium imaging. Finally, photostimulation of DA terminals in the mPFC revealed an increase in SNR in mPFC-dPAG responses to aversive stimuli. Together, these data highlight how mPFC DA can route sensory information in a valence-specific manner to different downstream circuits.

Comparing phasic dopamine dynamics in the striatum, nucleus accumbens, amygdala, and medial prefrontal cortex

Midbrain dopaminergic neurons project to and modulate multiple highly interconnected modules of the basal ganglia, limbic system, and frontal cortex. Dopamine regulates behaviors associated with action selection in the striatum, reward in the nucleus accumbens (NAc), emotional processing in the amygdala, and executive functioning in the medial prefrontal cortex (mPFC). The multifunctionality of dopamine likely occurs at the individual synapses, with varied levels of phasic dopamine release acting on different receptor populations. This study aimed to characterize specific aspects of stimulation-evoked phasic dopamine transmission, beyond simple dopamine release, using in vivo fixed potential amperometry with carbon fiber recording microelectrodes positioned in either the dorsal striatum, NAc, amygdala, or mPFC of anesthetized mice. To summarize results, the present study found that the striatum and NAc had increased stimulation-evoked phasic dopamine release, faster dopamine uptake (leading to restricted dopamine diffusion), weaker autoreceptor functioning, greater supply levels of available dopamine, and increased dopaminergic responses to DAT blockade compared to the amygdala and mPFC. Overall, these findings indicate that phasic dopamine may have different modes of communication between striatal and corticolimbic regions, with the first being profuse in concentration, rapid, and synaptically confined and the second being more limited in concentration but longer lasting and spatially dispersed. An improved understanding of regional differences in dopamine transmission can lead to more efficient treatments for disorders related to dopamine dysfunction.

Neural Circuits for Goal-Directed Sensorimotor Transformations

Precisely wired neuronal circuits process sensory information in a learning- and context-dependent manner in order to govern behavior. Simple sensory decision-making tasks in rodents are now beginning to reveal the contributions of distinct cell types and brain regions participating in the conversion of sensory information into learned goal-directed motor output. Task learning is accompanied by target-specific routing of sensory information to specific downstream cortical regions, with higher-order cortical regions such as the posterior parietal cortex, medial prefrontal cortex, and hippocampus appearing to play important roles in learning- and context-dependent processing of sensory input. An important challenge for future research is to connect cell-type-specific activity in these brain regions with motor neurons responsible for action initiation.

Putative dopamine neurons in the ventral tegmental area enhance information coding in the prefrontal cortex

It has been proposed that neuronal populations in the prefrontal cortex (PFC) robustly encode task-relevant information through an interplay with the ventral tegmental area (VTA). Yet, the precise computation underlying such functional interaction remains elusive. Here, we conducted simultaneous recordings of single-unit activity in PFC and VTA of rats performing a GO/NoGO task. We found that mutual information between stimuli and neural activity increases in the PFC as soon as stimuli are presented. Notably, it is the activity of putative dopamine neurons in the VTA that contributes critically to enhance information coding in the PFC. The higher the activity of these VTA neurons, the better the conditioned stimuli are encoded in the PFC.

Impaired recruitment of dopamine neurons during working memory in mice with striatal D2 receptor overexpression

The dopamine (DA) system plays a major role in cognitive functions through its interactions with several brain regions including the prefrontal cortex (PFC). Conversely, disturbances in the DA system contribute to cognitive deficits in psychiatric diseases, yet exactly how they do so remains poorly understood. Here we show, using mice with disease-relevant alterations in DA signaling (D2R-OE mice), that deficits in working memory (WM) are associated with impairments in the WM-dependent firing patterns of DA neurons in the ventral tegmental area (VTA). The WM-dependent phase-locking of DA neurons to 4 Hz VTA-PFC oscillations is absent in D2R-OE mice and VTA-PFC synchrony deficits scale with their WM impairments. We also find reduced 4 Hz synchrony between VTA DA neurons and selective impairments in their representation of WM demand. These results identify how altered DA neuron activity—at the level of long-range network activity and task-related firing patterns—may underlie cognitive impairments.

Disrupted dopamine neuron firing is thought to contribute to cognitive dysfunction in psychiatric disorders. Here the authors show that mice overexpressing D2R in the striatum, commonly seen in schizophrenia, are also impaired in recruitment of dopamine neurons during working memory performance.

Dopaminergic dysregulation and impaired associative learning behavior in zebrafish during chronic dietary exposure to selenium

A growing body of evidence indicates that exposure to selenium (Se) can cause neurotoxicity, and this can occur because of its interference with several neurotransmitter systems in humans and animals. Dopamine is a critical modulator of a variety of brain functions and a prime target for environmental neurotoxicants. However, effects of environmentally relevant concentrations of Se on dopaminergic system and its neurobehavioral effects are still largely unknown. For this purpose, we exposed zebrafish, a model organism, to different concentrations of dietary l-selenomethionine (control, 3.5, 11.1, 27.4, and 63.4 μg Se/g dry weight) for a period of 60 days. Cognitive performance of fish was evaluated using a plus maze associative learning paradigm. Oxidative stress, as the main driver of Se neurotoxicity, was assessed by measuring the ratio of reduced to oxidized glutathione (GSH:GSSG), lipid peroxidation (LPO) levels, and mRNA expression of several antioxidant enzymes in the zebrafish brain. Dopamine levels in the brain and the expression of genes involved in dopamine synthesis, storage, reuptake, metabolism, and receptor activation were examined. Moreover, transcription of several synaptic plasticity-related immediate-early and late response genes was determined. Overall, fish fed with the two highest concentrations of dietary Se displayed impaired associative learning. Se exposure also induced oxidative stress in the zebrafish brain, as indicated by a reduction in GSH:GSSG ratio, increased LPO levels, and up-regulation of antioxidant genes in fish treated with the two highest concentrations of Se. An increase in brain dopamine levels associated with altered expression of dopaminergic cell markers was evident in different treatment groups. Moreover, Se exposure led to the down-regulation of immediate-early and late response genes in fish that exhibiting learning impairment. Taken together, the results of this study imply that the induction of oxidative stress and dysregulation of dopaminergic neurotransmission may underlie Se-induced impairment of associative learning in zebrafish.

Mice lacking cyclin-dependent kinase-like 5 manifest autistic and ADHD-like behaviors

Neurodevelopmental disorders frequently share common clinical features and appear high rate of comorbidity, such as those present in patients with attention-deficit hyperactivity disorder (ADHD) and autism spectrum disorders (ASD). While characterizing behavioral phenotypes in the mouse model of cyclin-dependent kinase-like 5 (CDKL5) disorder, a neurodevelopmental disorder caused by mutations in the X-linked gene encoding CDKL5, we found that these mice manifested behavioral phenotypes mimicking multiple key features of ASD, such as impaired social interaction and communication, as well as increased stereotypic digging behaviors. These mice also displayed hyper-locomotion, increased aggressiveness and impulsivity, plus deficits in motor and associative learning, resembling primary symptoms of ADHD. Through brain region-specific biochemical analysis, we uncovered that loss of CDKL5 disrupts dopamine synthesis and the expression of social communication-related key genes, such as forkhead-box P2 and mu-opioid receptor, in the corticostriatal circuit. Together, our findings support that CDKL5 plays a role in the comorbid features of autism and ADHD, and mice lacking CDKL5 may serve as an animal model to study the molecular and circuit mechanisms underlying autism-ADHD comorbidity.

Reward-Based Learning Drives Rapid Sensory Signals in Medial Prefrontal Cortex and Dorsal Hippocampus Necessary for Goal-Directed Behavior

The neural circuits underlying learning and execution of goal-directed behaviors remain to be determined. Here, through electrophysiological recordings, we investigated fast sensory processing across multiple cortical areas as mice learned to lick a reward spout in response to a brief deflection of a single whisker. Sensory-evoked signals were absent from medial prefrontal cortex and dorsal hippocampus in naive mice, but developed with task learning and correlated with behavioral performance in mice trained in the detection task. The sensory responses in medial prefrontal cortex and dorsal hippocampus occurred with short latencies of less than 50 ms after whisker deflection. Pharmacological and optogenetic inactivation of medial prefrontal cortex or dorsal hippocampus impaired behavioral performance. Neuronal activity in medial prefrontal cortex and dorsal hippocampus thus appears to contribute directly to task performance, perhaps providing top-down control of learned, context-dependent transformation of sensory input into goal-directed motor output.

Diminished EEG habituation to novel events effectively classifies Parkinson's patients

OBJECTIVES

We aimed to test if EEG responses to novel events reliably dissociated individuals with Parkinson's disease and controls, and if this dissociation was sensitive and specific enough to be a candidate biomarker of cognitive dysfunction in Parkinson's disease.

METHODS

Participants included N = 25 individuals with Parkinson's disease and an equal number of well-matched controls. EEG was recorded during a three-stimulus auditory oddball paradigm both ON and OFF medication.

RESULTS

While control participants showed reliable EEG habituation to novel events over time, individuals with Parkinson's did not. In the OFF condition, individual differences in habituation correlated with years since diagnosis. Pattern classifiers achieved high sensitivity and specificity in discriminating patients from controls, with a maximum accuracy of 82%. Most importantly, the confidence of the classifier was related to years since diagnosis, and this correlation increased as the time course of differential habituation increasingly distinguished the groups.

CONCLUSIONS

These findings identify systemic alteration in an obligatory neural mechanism that may contribute to higher-level cognitive dysfunction in Parkinson's disease.

SIGNIFICANCE

These findings suggest that EEG responses to novel events in this rapid, simple, and inexpensive test have tremendous promise for tracking individual trajectories of cognitive dysfunction in Parkinson's disease.

Role of dopamine projections from ventral tegmental area to nucleus accumbens and medial prefrontal cortex in reinforcement behaviors assessed using optogenetic manipulation

Dopamine (DA) neurons in the ventral tegmental area (VTA) are predicted to play important roles in reward. In pharmacological studies, the rewarding effects of methamphetamine are mediated by DA neurons localized in the VTA. The nucleus accumbens (NAc) and medial prefrontal cortices (mPFC) are the main projections from the VTA. However, the role of these projections remains unclear, particularly the mPFC projections. In the present study, DAT-Cre transgenic mice received an injection of adeno-associated viral vectors encoding channelrhodopsin2 (ChR2) or control vector into the VTA resulting in the selective expression of these opsins in DA neurons. Then, we stimulated the VTA, NAc (core and shell) or mPFC (prelimbic cortex (PL) and infralimbic cortex (IL)) via an optical fiber. The mice with ChR2 learned instrumental responses corresponding to the delivery of photostimulation into the VTA. The projections to the NAc core and shell from the VTA and stimulation of the NAc subregion both induced reinforcement. For projections to the mPFC (IL and PL), we verified that stimulation of the IL induced reinforcement dependent on DA from the VTA but not the PL. Furthermore, micro-infusion of methamphetamine into the NAc core and NAc shell also induced hyper-locomotion in a dose-dependent manner with a slight tendency of increased excitation of the IL but not PL. Taken together, excitation of the projection into the NAc core, NAc shell and IL elicited positive behavior during reward.

Tonic or Phasic Stimulation of Dopaminergic Projections to Prefrontal Cortex Causes Mice to Maintain or Deviate from Previously Learned Behavioral Strategies

Dopamine neurons in the ventral tegmental area (VTA) encode reward prediction errors and can drive reinforcement learning through their projections to striatum, but much less is known about their projections to prefrontal cortex (PFC). Here, we studied these projections and observed phasic VTA-PFC fiber photometry signals after the delivery of rewards. Next, we studied how optogenetic stimulation of these projections affects behavior using conditioned place preference and a task in which mice learn associations between cues and food rewards and then use those associations to make choices. Neither phasic nor tonic stimulation of dopaminergic VTA-PFC projections elicited place preference. Furthermore, substituting phasic VTA-PFC stimulation for food rewards was not sufficient to reinforce new cue-reward associations nor maintain previously learned ones. However, the same patterns of stimulation that failed to reinforce place preference or cue-reward associations were able to modify behavior in other ways. First, continuous tonic stimulation maintained previously learned cue-reward associations even after they ceased being valid. Second, delivering phasic stimulation either continuously or after choices not previously associated with reward induced mice to make choices that deviated from previously learned associations. In summary, despite the fact that dopaminergic VTA-PFC projections exhibit phasic increases in activity that are time locked to the delivery of rewards, phasic activation of these projections does not necessarily reinforce specific actions. Rather, dopaminergic VTA-PFC activity can control whether mice maintain or deviate from previously learned cue-reward associations.SIGNIFICANCE STATEMENT Dopaminergic inputs from ventral tegmental area (VTA) to striatum encode reward prediction errors and reinforce specific actions; however, it is currently unknown whether dopaminergic inputs to prefrontal cortex (PFC) play similar or distinct roles. Here, we used bulk Ca²⁺ imaging to show that unexpected rewards or reward-predicting cues elicit phasic increases in the activity of dopaminergic VTA-PFC fibers. However, in multiple behavioral paradigms, we failed to observe reinforcing effects after stimulation of these fibers. In these same experiments, we did find that tonic or phasic patterns of stimulation caused mice to maintain or deviate from previously learned cue-reward associations, respectively. Therefore, although they may exhibit similar patterns of activity, dopaminergic inputs to striatum and PFC can elicit divergent behavioral effects.

Supramodal Enhancement of Auditory Perceptual and Cognitive Learning by Video Game Playing

Medical rehabilitation involving behavioral training can produce highly successful outcomes, but those successes are obtained at the cost of long periods of often tedious training, reducing compliance. By contrast, arcade-style video games can be entertaining and highly motivating. We examine here the impact of video game play on contiguous perceptual training. We alternated several periods of auditory pure-tone frequency discrimination (FD) with the popular spatial visual-motor game Tetris played in silence. Tetris play alone did not produce any auditory or cognitive benefits. However, when alternated with FD training it enhanced learning of FD and auditory working memory. The learning-enhancing effects of Tetris play cannot be explained simply by the visual-spatial training involved, as the effects were gone when Tetris play was replaced with another visual-spatial task using Tetris-like stimuli but not incorporated into a game environment. The results indicate that game play enhances learning and transfer of the contiguous auditory experiences, pointing to a promising approach for increasing the efficiency and applicability of rehabilitative training.

Lateral Hypothalamic Control of the Ventral Tegmental Area: Reward Evaluation and the Driving of Motivated Behavior

The lateral hypothalamus (LH) plays an important role in many motivated behaviors, sleep-wake states, food intake, drug-seeking, energy balance, etc. It is also home to a heterogeneous population of neurons that express and co-express multiple neuropeptides including hypocretin (Hcrt), melanin-concentrating hormone (MCH), cocaine- and amphetamine-regulated transcript (CART) and neurotensin (NT). These neurons project widely throughout the brain to areas such as the locus coeruleus, the bed nucleus of the stria terminalis, the amygdala and the ventral tegmental area (VTA). Lateral hypothalamic projections to the VTA are believed to be important for driving behavior due to the involvement of dopaminergic reward circuitry. The purpose of this article is to review current knowledge regarding the lateral hypothalamic connections to the VTA and the role they play in driving these behaviors.

Dopamine transients are sufficient and necessary for acquisition of model-based associations

Associative learning is driven by prediction errors. Dopamine transients correlate with these errors, which current interpretations limit to endowing cues with a scalar quantity reflecting the value of future rewards. We tested whether dopamine might act more broadly to support learning of an associative model of the environment. Using sensory preconditioning, we show that prediction errors underlying stimulus-stimulus learning can be blocked behaviorally and reinstated by optogenetically activating dopamine neurons. We further show that suppressing the firing of these neurons across the transition prevents normal stimulus-stimulus learning. These results establish that the acquisition of model-based information about transitions between nonrewarding events is also driven by prediction errors and that, contrary to existing canon, dopamine transients are both sufficient and necessary to support this type of learning. Our findings open new possibilities for how these biological signals might support associative learning in the mammalian brain in these and other contexts.

VTA dopamine neuron plasticity - the unusual suspects

Dopamine neurons in the ventral tegmental area (VTA) are involved in a variety of physiological and pathological conditions, ranging from motivated behaviours to substance use disorders. While many studies have shown that these neurons can express plasticity at excitatory and inhibitory synapses, little is known about how inhibitory inputs and glial activity shape the output of DA neurons and therefore, merit greater discussion. In this review, we will attempt to fill in a bit more of the puzzle, with a focus on inhibitory transmission and astrocyte function. We summarize the findings within the VTA as well as observations made in other brain regions that have important implications for plasticity in general and should be considered in the context of DA neuron plasticity.