Tonic or Phasic Stimulation of Dopaminergic Projections to Prefrontal Cortex Causes Mice to Maintain or Deviate from Previously Learned Behavioral Strategies

Distinct neuronal processes in the ventromedial prefrontal cortex mediate changes in attention load and nicotine pro-cognitive effects in male rats

The prefrontal cortex (PFC) plays a key role in attention. In particular, neuronal activity in the ventromedial PFC (vmPFC) has been implicated in the preparatory attentional period that immediately precedes cue presentation. However, whether vmPFC neuronal activity during this preparatory period is also sensitive to changes in task demand and to the pro-cognitive effects of nicotine remained to be investigated. Here, we used in vivo electrophysiology to record vmPFC neuronal activity in rats during two distinct manipulations: a task manipulation that increased task demand by reducing the cue stimulus duration (from 1 to 0.5 s), and a pharmacological manipulation by administrating an acute nicotine injection (10 μg/inj, i.v.) before the session. We found that increasing task demand decreased attentional performances and vmPFC precue neuronal activity, but had no effect on gamma oscillations. In contrast, nicotine injection increased attention and gamma oscillations, but almost abolished vmPFC phasic precue responses. Together, these findings indicate the existence of two distinct neuronal processes operating at different timescales and suggests that allocation of attention could be achieved through multiple neuronal mechanisms within the vmPFC.

Androgen effects on mesoprefrontal dopamine systems in the adult male brain

Epidemiological data show that males are more often and/or more severely affected by symptoms of prefrontal cortical dysfunction in schizophrenia, Parkinson's disease and other disorders in which dopamine circuits associated with the prefrontal cortex are dysregulated. This review focuses on research showing that these dopamine circuits are powerfully regulated by androgens. It begins with a brief overview of the sex differences that distinguish prefrontal function in health and prefrontal dysfunction or decline in aging and/or neuropsychiatric disease. This review article then spotlights data from human subjects and animal models that specifically identify androgens as potent modulators of prefrontal cortical operations and of closely related, functionally critical measures of prefrontal dopamine level or tone. Candidate mechanisms by which androgens dynamically control mesoprefrontal dopamine systems and impact prefrontal states of hypo- and hyper-dopaminergia in aging and disease are then considered. This is followed by discussion of a working model that identifies a key locus for androgen modulation of mesoprefrontal dopamine systems as residing within the prefrontal cortex itself. The last sections of this review critically consider the ways in which the organization and regulation of mesoprefrontal dopamine circuits differ in the adult male and female brain, and highlights gaps where more research is needed.

Effects of positive mGlu5 modulation on D2 signaling and nicotine-conditioned place preference: Mechanisms of epigenetic inheritance in a transgenerational model of drug abuse vulnerability in psychosis

BACKGROUND

The metabotropic glutamate type 5 (mGlu5) receptor has emerged as a potential target for the treatment of psychosis that is suggested to have greater efficacy than antipsychotic medications that are currently utilized.

AIMS

This study sought to elucidate mechanisms of therapeutic action associated with the modulation of the mGlu5 receptor in a disordered system marked by dopamine dysfunction. We further explored epigenetic mechanisms contributing to heritable transmission of a psychosis-like phenotype in a novel heritable model of drug abuse vulnerability in psychosis.

METHODS

F1 generation male and female Sprague-Dawley rats that were the offspring of two neonatal quinpirole-treated (QQ) or two saline-treated (SS) animals were tested on nicotine-conditioned place preference (CPP). Regulators of G protein signaling 9 (RGS9) and β-arrestin 2 (βA2), which mediate dopamine (DA) D2 signaling, were measured in the nucleus accumbens shell, prelimbic and infralimbic cortices. Reduced Representation Bisulfite Sequencing (RRBS) was used to analyze the cytosine methylation in these brain regions.

RESULTS

Pretreatment with the mGlu5-positive allosteric modulator 3-Cyano-N-(1,3-diphenyl-1H-pyrazol-5-yl)benzamide (CDPPB) 20 min prior to conditioning trials blocked enhanced nicotine CPP and mitigated aberrant G protein-dependent and -independent signaling in QQ animals. RRBS analysis revealed region-specific changes in several pathways, including nicotine addiction, dopamine synapses, and neural connectivity.

CONCLUSIONS

These results reveal an important region-specific mechanism of action for CDPPB in a system marked by enhanced DAD2 receptor signaling. Results additionally reveal DNA methylation as an epigenetic mechanism of heritability, further validating the current model as a useful tool for the study of psychosis and comorbid nicotine use.

Prefrontal dopamine activity is critical for rapid threat avoidance learning

The medial prefrontal cortex (mPFC) is required for learning associations that determine whether animals approach or avoid potential threats in the environment. Dopaminergic (DA) projections from the ventral tegmental area (VTA) to the mPFC carry information, particularly about aversive outcomes, that may inform prefrontal computations. But the role of prefrontal DA in learning based on aversive outcomes remains poorly understood. Here, we used platform mediated avoidance (PMA) to study the role of mPFC DA in threat avoidance learning in mice. We show that activity in VTA-mPFC dopaminergic terminals is required for avoidance learning, but not for escape, conditioned fear, or to recall a previously learned avoidance strategy. mPFC DA is most dynamic in the early stages of learning, and encodes aversive outcomes, their omissions, and threat-induced behaviors. Computational models of PMA behavior and DA activity revealed that mPFC DA influences learning rates and encodes the predictive relationships between cues and adaptive behaviors. Taken together, these data indicate that mPFC DA is necessary to rapidly learn behaviors required to avoid signaled threats, but not for learning cue-threat associations.

Dopaminergic circuits controlling threat and safety learning

The ability to learn from experience that certain cues and situations are associated with threats or safety is crucial for survival and adaptive behavior. Understanding the neural substrates of threat and safety learning has high clinical significance because deficits in these forms of learning characterize anxiety disorders. Traditionally, dopamine neurons were thought to uniformly support reward learning by signaling reward prediction errors. However, the dopamine system is functionally more diverse than was initially appreciated and is also critical for processing threat and safety. In this review, I highlight recent studies demonstrating that dopamine neurons generate prediction errors for threat and safety, and describe how dopamine projections to the amygdala, medial prefrontal cortex (mPFC), and striatum regulate associative threat and safety learning.

Distinct roles of excitatory and inhibitory neurons in the medial prefrontal cortex in the expression and reconsolidation of methamphetamine-associated memory in male mice

Methamphetamine, a commonly abused drug, is known for its high relapse rate. The persistence of addictive memories associated with methamphetamine poses a significant challenge in preventing relapse. Memory retrieval and subsequent reconsolidation provide an opportunity to disrupt addictive memories. However, the key node in the brain network involved in methamphetamine-associated memory retrieval has not been clearly defined. In this study, using the conditioned place preference in male mice, whole brain c-FOS mapping and functional connectivity analysis, together with chemogenetic manipulations of neural circuits, we identified the medial prefrontal cortex (mPFC) as a critical hub that integrates inputs from the retrosplenial cortex and the ventral tegmental area to support both the expression and reconsolidation of methamphetamine-associated memory during its retrieval. Surprisingly, with further cell-type specific analysis and manipulation, we also observed that methamphetamine-associated memory retrieval activated inhibitory neurons in the mPFC to facilitate memory reconsolidation, while suppressing excitatory neurons to aid memory expression. These findings provide novel insights into the neural circuits and cellular mechanisms involved in the retrieval process of addictive memories. They suggest that targeting the balance between excitation and inhibition in the mPFC during memory retrieval could be a promising treatment strategy to prevent relapse in methamphetamine addiction.

Divergent subregional information processing in mouse prefrontal cortex during working memory

Working memory (WM) is a critical cognitive function allowing recent information to be temporarily held in mind to inform future action. This process depends on coordination between prefrontal cortex (PFC) subregions and other connected brain areas. However, few studies have examined the degree of functional specialization between these subregions throughout WM using electrophysiological recordings in freely-moving mice. Here we record single-units in three neighboring mouse medial PFC (mPFC) subregions-supplementary motor area (MOs), dorsomedial PFC (dmPFC), and ventromedial (vmPFC)-during a freely-behaving non-match-to-position WM task. The MOs is most active around task phase transitions, when it transiently represents the starting sample location. Dorsomedial PFC contains a stable population code, including persistent sample-location-specific firing during the delay period. Ventromedial PFC responds most strongly to reward-related information during choices. Our results reveal subregionally segregated WM computation in mPFC and motivate more precise consideration of the dynamic neural activity required for WM.

Dopamine in the prefrontal cortex plays multiple roles in the executive function of patients with Parkinson's disease

Parkinson's disease can affect not only motor functions but also cognitive abilities, leading to cognitive impairment. One common issue in Parkinson's disease with cognitive dysfunction is the difficulty in executive functioning. Executive functions help us plan, organize, and control our actions based on our goals. The brain area responsible for executive functions is called the prefrontal cortex. It acts as the command center for the brain, especially when it comes to regulating executive functions. The role of the prefrontal cortex in cognitive processes is influenced by a chemical messenger called dopamine. However, little is known about how dopamine affects the cognitive functions of patients with Parkinson's disease. In this article, the authors review the latest research on this topic. They start by looking at how the dopaminergic system, is altered in Parkinson's disease with executive dysfunction. Then, they explore how these changes in dopamine impact the synaptic structure, electrical activity, and connection components of the prefrontal cortex. The authors also summarize the relationship between Parkinson's disease and dopamine-related cognitive issues. This information may offer valuable insights and directions for further research and improvement in the clinical treatment of cognitive impairment in Parkinson's disease.

A chemogenetic approach for dopamine imaging with tunable sensitivity

Genetically-encoded dopamine (DA) sensors enable high-resolution imaging of DA release, but their ability to detect a wide range of extracellular DA levels, especially tonic versus phasic DA release, is limited by their intrinsic affinity. Here we show that a human-selective dopamine receptor positive allosteric modulator (PAM) can be used to boost sensor affinity on-demand. The PAM enhances DA detection sensitivity across experimental preparations (in vitro, ex vivo and in vivo) via one-photon or two-photon imaging. In vivo photometry-based detection of optogenetically-evoked DA release revealed that DETQ administration produces a stable 31 minutes window of potentiation without effects on animal behavior. The use of the PAM revealed region-specific and metabolic state-dependent differences in tonic DA levels and enhanced single-trial detection of behavior-evoked phasic DA release in cortex and striatum. Our chemogenetic strategy can potently and flexibly tune DA imaging sensitivity and reveal multi-modal (tonic/phasic) DA signaling across preparations and imaging approaches.

Encoding of self-initiated actions in axon terminals of the mesocortical pathway

Significance

The initiation of goal-directed actions is a complex process involving the medial prefrontal cortex and dopaminergic inputs through the mesocortical pathway. However, it is unclear what information the mesocortical pathway conveys and how it impacts action initiation. In this study, we unveiled the indispensable role of mesocortical axon terminals in encoding the execution of movements in self-initiated actions.

Aim

To investigate the role of mesocortical axon terminals in encoding the execution of movements in self-initiated actions.

Approach

We designed a lever-press task in which mice internally determine the timing of the press, receiving a larger reward for longer waiting periods.

Results

Our study revealed that self-initiated actions depend on dopaminergic signaling mediated by D2 receptors, whereas sensory-triggered lever-press actions do not involve D2 signaling. Microprism-mediated two-photon calcium imaging further demonstrated ramping activity in mesocortical axon terminals approximately 0.5 s before the self-initiated lever press. Remarkably, the ramping patterns remained consistent whether the mice responded to cues immediately for a smaller reward or held their response for a larger reward.

Conclusions

We conclude that mesocortical dopamine axon terminals encode the timing of self-initiated actions, shedding light on a crucial aspect of the intricate neural mechanisms governing goal-directed behavior.

Dopaminergic lesions of the anterior cingulate cortex of rats increase vulnerability to salient distractors

The anterior cingulate cortex (ACC) has been shown to be critical to many aspects of executive function including filtering irrelevant information, updating response contingencies when reinforcement contingencies change and stabilizing task sets. Nonspecific lesions to this region in rats produce a vulnerability to distractors that have gained salience through prior associations with reinforcement. These lesions also exacerbate cognitive fatigue in tests of sustained attention but do not produce global attentional impairments nor do they produce distractibility to novel distractors that do not have a prior association with reinforcement. To determine the neurochemical basis of these cognitive impairments, dopaminergically selective lesions of the ACC were made in both male and female Long-Evans, hooded rats prior to assessment in two attentional tasks. Dopaminergic lesions of the ACC increase the vulnerability of subjects to previously reinforced distractors and impede formation of an attentional set. Lesioned rats were not more susceptible to the effects of novel, irrelevant stimuli in a test of sustained attention as has been previously shown. Additionally, the effects of dopaminergic lesions were found to differ based on sex. Lesioned female, but not male, rats were more vulnerable than sham-lesioned females to the effects of prolonged testing and the removal of reinforcement during a test of sustained attention. Together, these data support the hypothesis that dopamine in the ACC is critical to filtering distractors whose salience has been gained through reinforcement.

Functional diversity of dopamine axons in prefrontal cortex during classical conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Divergent Subregional Information Processing in Mouse Prefrontal Cortex During Working Memory

Working memory (WM) is a critical cognitive function allowing recent information to be temporarily held in mind to inform future action. This process depends on coordination between key subregions in prefrontal cortex (PFC) and other connected brain areas. However, few studies have examined the degree of functional specialization between these subregions throughout the phases of WM using electrophysiological recordings in freely-moving animals, particularly mice. To this end, we recorded single-units in three neighboring medial PFC (mPFC) subregions in mouse - supplementary motor area (MOs), dorsomedial PFC (dmPFC), and ventromedial (vmPFC) - during a freely-behaving non-match-to-position WM task. We found divergent patterns of task-related activity across the phases of WM. The MOs is most active around task phase transitions and encodes the starting sample location most selectively. Dorsomedial PFC contains a more stable population code, including persistent sample-location-specific firing during a five second delay period. Finally, the vmPFC responds most strongly to reward-related information during the choice phase. Our results reveal anatomically and temporally segregated computation of WM task information in mPFC and motivate more precise consideration of the dynamic neural activity required for WM.

Potentiation of prefrontal cortex dopamine function by the novel cognitive enhancer d-govadine

Cognitive impairment is a debilitating feature of psychiatric disorders including schizophrenia, mood disorders and substance use disorders for which there is a substantial lack of effective therapies. d-Govadine (d-GOV) is a tetrahydroprotoberberine recently shown to significantly enhance working memory and behavioural flexibility in several prefrontal cortex (PFC)-dependent rodent tasks. d-GOV potentiates dopamine (DA) efflux in the mPFC and not the nucleus accumbens, a unique pharmacology that sets it apart from many dopaminergic drugs and likely contributes to its effects on cognitive function. However, specific mechanisms involved in the preferential effects of d-GOV on mPFC DA function remain to be determined. The present study employs brain dialysis in male rats to deliver d-GOV into the mPFC or ventral tegmental area (VTA), while simultaneously sampling DA and norepinephrine (NE) efflux in the mPFC. Intra-PFC delivery or systemic administration of d-GOV preferentially potentiated medial prefrontal DA vs NE efflux. This differential effect of d-GOV on the primary catecholamines known to affect mPFC function further underscores its specificity for the mPFC DA system. Importantly, the potentiating effect of d-GOV on mPFC DA was disrupted when glutamatergic transmission was blocked in either the mPFC or the VTA. We hypothesize that d-GOV acts in the mPFC to engage the mesocortical feedback loop through which prefrontal glutamatergic projections activate a population of VTA DA neurons that specifically project back to the PFC. The activation of a PFC-VTA feedback loop to elevate PFC DA efflux without affecting mesolimbic DA release represents a novel approach to developing pro-cognitive drugs.

Functional Diversity of Dopamine Axons in Prefrontal Cortex During Classical Conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Prefrontal Dopamine in Flexible Adaptation to Environmental Changes: A Game for Two Players

Deficits in cognitive flexibility have been characterized in affective, anxiety, and neurodegenerative disorders. This paper reviews data, mainly from studies on animal models, that support the existence of a cortical-striatal brain circuit modulated by dopamine (DA), playing a major role in cognitive/behavioral flexibility. Moreover, we reviewed clinical findings supporting misfunctioning of this circuit in Parkinson's disease that could be responsible for some important non-motoric symptoms. The reviewed findings point to a role of catecholaminergic transmission in the medial prefrontal cortex (mpFC) in modulating DA's availability in the nucleus accumbens (NAc), as well as a role of NAc DA in modulating the motivational value of natural and conditioned stimuli. The review section is accompanied by a preliminary experiment aimed at testing weather the extinction of a simple Pavlovian association fosters increased DA transmission in the mpFC and inhibition of DA transmission in the NAc.

Molecular logic of synaptic diversity between Drosophila tonic and phasic motoneurons

Although neuronal subtypes display unique synaptic organization and function, the underlying transcriptional differences that establish these features are poorly understood. To identify molecular pathways that contribute to synaptic diversity, single-neuron Patch-seq RNA profiling was performed on Drosophila tonic and phasic glutamatergic motoneurons. Tonic motoneurons form weaker facilitating synapses onto single muscles, while phasic motoneurons form stronger depressing synapses onto multiple muscles. Super-resolution microscopy and in vivo imaging demonstrated that synaptic active zones in phasic motoneurons are more compact and display enhanced Ca2+ influx compared with their tonic counterparts. Genetic analysis identified unique synaptic properties that mapped onto gene expression differences for several cellular pathways, including distinct signaling ligands, post-translational modifications, and intracellular Ca2+ buffers. These findings provide insights into how unique transcriptomes drive functional and morphological differences between neuronal subtypes.

Adolescent neurostimulation of dopamine circuit reverses genetic deficits in frontal cortex function

Dopamine system dysfunction is implicated in adolescent-onset neuropsychiatric disorders. Although psychosis symptoms can be alleviated by antipsychotics, cognitive symptoms remain unresponsive and novel paradigms investigating the circuit substrates underlying cognitive deficits are critically needed. The frontal cortex and its dopaminergic input from the midbrain are implicated in cognitive functions and undergo maturational changes during adolescence. Here, we used mice carrying mutations in Arc or Disc1 to model mesofrontal dopamine circuit deficiencies and test circuit-based neurostimulation strategies to restore cognitive functions. We found that in a memory-guided spatial navigation task, frontal cortical neurons were activated coordinately at the decision-making point in wild-type but not Arc-/- mice. Chemogenetic stimulation of midbrain dopamine neurons or optogenetic stimulation of frontal cortical dopamine axons in a limited adolescent period consistently reversed genetic defects in mesofrontal innervation, task-coordinated neuronal activity, and memory-guided decision-making at adulthood. Furthermore, adolescent stimulation of dopamine neurons also reversed the same cognitive deficits in Disc1+/- mice. Our findings reveal common mesofrontal circuit alterations underlying the cognitive deficits caused by two different genes and demonstrate the feasibility of adolescent neurostimulation to reverse these circuit and behavioral deficits. These results may suggest developmental windows and circuit targets for treating cognitive deficits in neurodevelopmental disorders.

The Dopaminergic System in the Ventral Tegmental Area Contributes to Morphine Analgesia and Tolerance

Morphine has a strong analgesic effect and is suitable for various types of pain, so it is widely used. But long-term usage of morphine can lead to drug tolerance, which limits its clinical application. The complex mechanisms underlying the development of morphine analgesia into tolerance involve multiple nuclei in the brain. Recent studies reveal the signaling at the cellular and molecular levels as well as neural circuits contributing to morphine analgesia and tolerance in the ventral tegmental area (VTA), which is traditionally considered a critical center of opioid reward and addiction. Existing studies show that dopamine receptors and μ-opioid receptors participate in morphine tolerance through the altered activities of dopaminergic and/or non-dopaminergic neurons in the VTA. Several neural circuits related to the VTA are also involved in the regulation of morphine analgesia and the development of drug tolerance. Reviewing specific cellular and molecular targets and related neural circuits may provide novel precautionary strategies for morphine tolerance.

Dopaminergic and prefrontal dynamics co-determine mouse decisions in a spatial gambling task

The neural mechanisms by which animals initiate goal-directed actions, choose between options, or explore opportunities remain unknown. Here, we develop a spatial gambling task in which mice, to obtain intracranial self-stimulation rewards, self-determine the initiation, direction, vigor, and pace of their actions based on their knowledge of the outcomes. Using electrophysiological recordings, pharmacology, and optogenetics, we identify a sequence of oscillations and firings in the ventral tegmental area (VTA), orbitofrontal cortex (OFC), and prefrontal cortex (PFC) that co-encodes and co-determines self-initiation and choices. This sequence appeared with learning as an uncued realignment of spontaneous dynamics. Interactions between the structures varied with the reward context, particularly the uncertainty associated with the different options. We suggest that self-generated choices arise from a distributed circuit based on an OFC-VTA core determining whether to wait for or initiate actions, while the PFC is specifically engaged by reward uncertainty in action selection and pace.

Insights into the Involvement and Therapeutic Target Potential of the Dopamine System in the Posttraumatic Stress Disorder

Posttraumatic stress disorder (PTSD) is a neuropsychiatric disease closely related to life-threatening events and psychological stress. Re-experiencing, hyperarousal, avoidance, and numbness are the hallmark symptoms of PTSD, but their underlying neurological processes have not been clearly elucidated. Therefore, the identification and development of drugs for PTSD that targets brain neuronal activities have stalled. Considering that the persistent fear memory induced by traumatic stimulation causes high alertness, high arousal, and cognitive impairment of PTSD symptoms. While the midbrain dopamine system can affect physiological processes such as aversive fear memory learning, consolidation, persistence, and extinction, by altering the functions of the dopaminergic neurons, our viewpoint is that the dopamine system plays a considerable role in the PTSD occurrence and acts as a potential therapeutic target of the disorder. This paper reviews recent findings on the structural and functional connections between ventral tegmental area neurons and the core synaptic circuits involved in PTSD, gene polymorphisms related to the dopamine system that confer susceptibility to clinical PTSD. Moreover, the progress of research on medications that target the dopamine system as PTSD therapies is also discussed. Our goal is to offer some hints for early detection and assist in identifying novel, efficient approaches for treating PTSD.

Molecular Logic of Synaptic Diversity Between Drosophila Tonic and Phasic Motoneurons

Although neuronal subtypes display unique synaptic organization and function, the underlying transcriptional differences that establish these features is poorly understood. To identify molecular pathways that contribute to synaptic diversity, single neuron PatchSeq RNA profiling was performed on Drosophila tonic and phasic glutamatergic motoneurons. Tonic motoneurons form weaker facilitating synapses onto single muscles, while phasic motoneurons form stronger depressing synapses onto multiple muscles. Super-resolution microscopy and in vivo imaging demonstrated synaptic active zones in phasic motoneurons are more compact and display enhanced Ca 2+ influx compared to their tonic counterparts. Genetic analysis identified unique synaptic properties that mapped onto gene expression differences for several cellular pathways, including distinct signaling ligands, post-translational modifications and intracellular Ca 2+ buffers. These findings provide insights into how unique transcriptomes drive functional and morphological differences between neuronal subtypes.

Long-term memory, synaptic plasticity and dopamine in rodent medial prefrontal cortex: Role in executive functions

Mnemonic functions, supporting rodent behavior in complex tasks, include both long-term and (short-term) working memory components. While working memory is thought to rely on persistent activity states in an active neural network, long-term memory and synaptic plasticity contribute to the formation of the underlying synaptic structure, determining the range of possible states. Whereas, the implication of working memory in executive functions, mediated by the prefrontal cortex (PFC) in primates and rodents, has been extensively studied, the contribution of long-term memory component to these tasks received little attention. This review summarizes available experimental data and theoretical work concerning cellular mechanisms of synaptic plasticity in the medial region of rodent PFC and the link between plasticity, memory and behavior in PFC-dependent tasks. A special attention is devoted to unique properties of dopaminergic modulation of prefrontal synaptic plasticity and its contribution to executive functions.

Dopamine D2/3-receptor availability and its association with autonomous motivation to exercise in older adults: An exploratory [11C]-raclopride study

BACKGROUND

Autonomous motivation to exercise occurs when the activity is voluntary and with a perceived inherent satisfaction from the activity itself. It has been suggested that autonomous motivation is related to striatal dopamine D2/3-receptor (D2/3R) availability within the brain. In this study, we hypothesized that D2/3R availability in three striatal regions (nucleus accumbens, caudate nucleus, and putamen) would be positively associated with self-reported autonomous motivation to exercise. We also examined this relationship with additional exploratory analyses across a set of a priori extrastriatal regions of interest (ROI).

METHODS

Our sample comprised 49 older adults (28 females) between 64 and 78 years of age. The D2/3R availability was quantified from positron emission tomography using the non-displaceable binding potential of [11C]-raclopride ligand. The exercise-related autonomous motivation was assessed with the Swedish version of the Behavioral Regulations in Exercise Questionnaire-2.

RESULTS

No significant associations were observed between self-reported autonomous motivation to exercise and D2/3R availability within the striatum (nucleus accumbens, caudate nucleus, and putamen) using semi-partial correlations controlling for ROI volume on D2/3R availability. For exploratory analyses, positive associations were observed for the superior (r = 0.289, p = 0.023) and middle frontal gyrus (r = 0.330, p = 0.011), but not for the inferior frontal gyrus, orbitofrontal cortex, anterior cingulate cortex, or anterior insular cortex.

CONCLUSION

This study could not confirm the suggested link between striatal D2/3R availability and subjective autonomous motivation to exercise among older adults. The exploratory findings, however, propose that frontal brain regions may be involved in the intrinsic regulation of exercise-related behaviors, though this has to be confirmed by future studies using a more suitable ligand and objective measures of physical activity levels.

The role of dopamine and endocannabinoid systems in prefrontal cortex development: Adolescence as a critical period

The prefrontal cortex plays a central role in the control of complex cognitive processes including action control and decision making. It also shows a specific pattern of delayed maturation related to unique behavioral changes during adolescence and allows the development of adult cognitive processes. The adolescent brain is extremely plastic and critically vulnerable to external insults. Related to this vulnerability, adolescence is also associated with the emergence of numerous neuropsychiatric disorders involving alterations of prefrontal functions. Within prefrontal microcircuits, the dopamine and the endocannabinoid systems have widespread effects on adolescent-specific ontogenetic processes. In this review, we highlight recent advances in our understanding of the maturation of the dopamine system and the endocannabinoid system in the prefrontal cortex during adolescence. We discuss how they interact with GABA and glutamate neurons to modulate prefrontal circuits and how they can be altered by different environmental events leading to long-term neurobiological and behavioral changes at adulthood. Finally, we aim to identify several future research directions to help highlight gaps in our current knowledge on the maturation of these microcircuits.

Learning of probabilistic punishment as a model of anxiety produces changes in action but not punisher encoding in the dmPFC and VTA

Previously, we developed a novel model for anxiety during motivated behavior by training rats to perform a task where actions executed to obtain a reward were probabilistically punished and observed that after learning, neuronal activity in the ventral tegmental area (VTA) and dorsomedial prefrontal cortex (dmPFC) represent the relationship between action and punishment risk (Park and Moghaddam, 2017). Here, we used male and female rats to expand on the previous work by focusing on neural changes in the dmPFC and VTA that were associated with the learning of probabilistic punishment, and anxiolytic treatment with diazepam after learning. We find that adaptive neural responses of dmPFC and VTA during the learning of anxiogenic contingencies are independent from the punisher experience and occur primarily during the peri-action and reward period. Our results also identify peri-action ramping of VTA neural calcium activity, and VTA-dmPFC correlated activity, as potential markers for the anxiolytic properties of diazepam.

Cocaine's effects on the reactivity of the medial prefrontal cortex to ventral tegmental area stimulation: optical imaging study in mice

BACKGROUND AND AIMS

The prefrontal cortex (PFC) is modulated by dopaminergic and glutamatergic neurons that project from the ventral tegmental area (VTA) and disruption of this modulation might facilitate impulsive behaviors during cocaine intoxication. Here, we assessed the effects of acute cocaine (30 mg/kg, i.p.) on the reactivity of the PFC to VTA stimulation.

METHODS

Using a genetically encoded calcium indicator (GCaMP6f), we optically imaged the neuronal Ca2+ reactance in medial PFC (mPFC) in response to 'tonic-like' (5 Hz) and 'phasic-like' (50 Hz) electrical VTA stimulation. The high temporal and spatial resolutions of our optical system allowed us to capture single Ca2+ neuronal transients from individual stimuli with 'tonic-like' stimulation and to visualize single neuronal activation evoked by 'phasic-like' VTA stimulation.

RESULTS

'Tonic-like' VTA stimulation induced a rapid increase in mean neuronal Ca2+ in mPFC followed by a plateau and recovery upon termination of stimulation. After cocaine, the mPFC sensitivity to 'tonic-like' VTA stimulation was attenuated, with a 50.4% reduction (P = 0.03) in the number of Ca2+ transients corresponding to single electrical stimuli but the recovery time was lengthened (4.30 ± 0.25 sec to 5.41 ± 0.24 sec, P = 0.03). 'Phasic-like' stimulation evoked a rapid Ca2+ fluorescence increase in mPFC with an immediate decay process, and while cocaine did not affect the peak response (7.17 ± 1.07% versus 7.13 ± 0.96%, P = 0.98) it shortened the recovery time to baseline (3.27 ± 0.11 sec versus 2.38 ± 0.23 sec, P = 0.005).

CONCLUSIONS

Acute cocaine impairs reactivity of medial prefrontal cortex (mPFC) to ventral tegmental area stimulation, decreasing its sensitivity to 'tonic-like' stimulation and lengthening the recovery time to return to baseline while shortening it for phasic stimulation. These changes in mPFC might contribute to cocaine binging during intoxication.

Defining the interconnectivity of the medial prefrontal cortex and ventral midbrain

Dysfunction in dopamine (DA) signaling contributes to neurological disorders ranging from drug addiction and schizophrenia to depression and Parkinson’s Disease. How might impairment of one neurotransmitter come to effect these seemingly disparate diseases? One potential explanation is that unique populations of DA-releasing cells project to separate brain regions that contribute to different sets of behaviors. Though dopaminergic cells themselves are spatially restricted to the midbrain and constitute a relatively small proportion of all neurons, their projections influence many brain regions. DA is particularly critical for the activity and function of medial prefrontal cortical (mPFC) ensembles. The midbrain and mPFC exhibit reciprocal connectivity – the former innervates the mPFC, and in turn, the mPFC projects back to the midbrain. Viral mapping studies have helped elucidate the connectivity within and between these regions, which likely have broad implications for DA-dependent behaviors. In this review, we discuss advancements in our understanding of the connectivity between the mPFC and midbrain DA system, focusing primarily on rodent models.

Oscillation/Coincidence-Detection Models of Reward-Related Timing in Corticostriatal Circuits

The major tenets of beat-frequency/coincidence-detection models of reward-related timing are reviewed in light of recent behavioral and neurobiological findings. This includes the emphasis on a core timing network embedded in the motor system that is comprised of a corticothalamic-basal ganglia circuit. Therein, a central hub provides timing pulses (i.e., predictive signals) to the entire brain, including a set of distributed satellite regions in the cerebellum, cortex, amygdala, and hippocampus that are selectively engaged in timing in a manner that is more dependent upon the specific sensory, behavioral, and contextual requirements of the task. Oscillation/coincidence-detection models also emphasize the importance of a tuned ‘perception’ learning and memory system whereby target durations are detected by striatal networks of medium spiny neurons (MSNs) through the coincidental activation of different neural populations, typically utilizing patterns of oscillatory input from the cortex and thalamus or derivations thereof (e.g., population coding) as a time base. The measure of success of beat-frequency/coincidence-detection accounts, such as the Striatal Beat-Frequency model of reward-related timing (SBF), is their ability to accommodate new experimental findings while maintaining their original framework, thereby making testable experimental predictions concerning diagnosis and treatment of issues related to a variety of dopamine-dependent basal ganglia disorders, including Huntington’s and Parkinson’s disease.

Historical and Modern Evidence for the Role of Reward Circuitry in Emergence

Increasing evidence supports a role for brain reward circuitry in modulating arousal along with emergence from anesthesia. Emergence remains an important frontier for investigation, since no drug exists in clinical practice to initiate rapid and smooth emergence. This review discusses clinical and preclinical evidence indicating a role for two brain regions classically considered integral components of the mesolimbic brain reward circuitry, the ventral tegmental area and the nucleus accumbens, in emergence from propofol and volatile anesthesia. Then there is a description of modern systems neuroscience approaches to neural circuit investigations that will help span the large gap between preclinical and clinical investigation with the shared aim of developing therapies to promote rapid emergence without agitation or delirium. This article proposes that neuroscientists include models of whole-brain network activity in future studies to inform the translational value of preclinical investigations and foster productive dialogues with clinician anesthesiologists.

Convergence of Clinically Relevant Manipulations on Dopamine-Regulated Prefrontal Activity Underlying Stress Coping Responses

BACKGROUND

Depression is pleiotropic and influenced by diverse genetic, environmental, and pharmacological factors. Identifying patterns of circuit activity on which many of these factors converge would be important, because studying these patterns could reveal underlying pathophysiological processes and/or novel therapies. Depression is commonly assumed to involve changes within prefrontal circuits, and dopamine D2 receptor (D2R) agonists are increasingly used as adjunctive antidepressants. Nevertheless, how D2Rs influence disease-relevant patterns of prefrontal circuit activity remains unknown.

METHODS

We used brain slice calcium imaging to measure how patterns of prefrontal activity are modulated by D2Rs, antidepressants, and manipulations that increase depression susceptibility. To validate the idea that prefrontal D2Rs might contribute to antidepressant responses, we used optogenetic and genetic manipulations to test how dopamine, D2Rs, and D2R+ neurons contribute to stress-coping behavior.

RESULTS

Patterns of positively correlated activity in prefrontal microcircuits are specifically enhanced by D2R stimulation as well as by two mechanistically distinct antidepressants, ketamine and fluoxetine. Conversely, this D2R-driven effect was disrupted in two etiologically distinct depression models, a genetic susceptibility model and mice that are susceptible to chronic social defeat. Phasic stimulation of dopaminergic afferents to the prefrontal cortex and closed-loop stimulation of D2R+ neurons increased effortful responses to tail suspension stress, whereas prefrontal D2R deletion reduced the duration of individual struggling episodes.

CONCLUSIONS

Correlated prefrontal microcircuit activity represents a point of convergence for multiple depression-related manipulations. Prefrontal D2Rs enhance this activity. Through this mechanism, prefrontal D2Rs may promote network states associated with antidepressant actions and effortful responses to stress.

State anxiety alters the neural oscillatory correlates of predictions and prediction errors during reward-based learning

Anxiety influences how the brain estimates and responds to uncertainty. The consequences of these processes on behaviour have been described in theoretical and empirical studies, yet the associated neural correlates remain unclear. Rhythm-based accounts of Bayesian predictive coding propose that predictions in generative models of perception are represented in alpha (8-12 Hz) and beta oscillations (13-30 Hz). Updates to predictions are driven by prediction errors weighted by precision (inverse variance) encoded in gamma oscillations (>30 Hz) and associated with the suppression of beta activity. We tested whether state anxiety alters the neural oscillatory activity associated with predictions and precision-weighted prediction errors (pwPE) during learning. Healthy human participants performed a probabilistic reward-based learning task in a volatile environment. In our previous work, we described learning behaviour in this task using a hierarchical Bayesian model, revealing more precise (biased) beliefs about the tendency of the reward contingency in state anxiety, consistent with reduced learning in this group. The model provided trajectories of predictions and pwPEs for the current study, allowing us to assess their parametric effects on the time-frequency representations of EEG data. Using convolution modelling for oscillatory responses, we found that, relative to a control group, state anxiety increased beta activity in frontal and sensorimotor regions during processing of pwPE, and in fronto-parietal regions during encoding of predictions. No effects of state anxiety on gamma modulation were found. Our findings expand prior evidence on the oscillatory representations of predictions and pwPEs into the reward-based learning domain. The results suggest that state anxiety modulates beta-band oscillatory correlates of pwPE and predictions in generative models, providing insights into the neural processes associated with biased belief updating and poorer learning.

Event-based control of autonomic and emotional states by the anterior cingulate cortex

Despite being an intensive area of research, the function of the anterior cingulate cortex (ACC) remains somewhat of a mystery. Human imaging studies implicate the ACC in various cognitive functions, yet surgical ACC lesions used to treat emotional disorders have minimal lasting effects on cognition. An alternative view is that ACC regulates autonomic states, consistent with its interconnectivity with autonomic control regions and that stimulation evokes changes in autonomic/emotional states. At the cellular level, ACC neurons are highly multi-modal and promiscuous, and can represent a staggering array of task events. These neurons nevertheless combine to produce highly event-specific ensemble patterns that likely alter activity in downstream regions controlling emotional and autonomic tone. Since neuromodulators regulate the strength of the ensemble activity patterns, they would regulate the impact these patterns have on downstream targets. Through these mechanisms, the ACC may determine how strongly to react to the very events its ensembles represent. Pathologies arise when specific event-related representations gain excessive control over autonomic/emotional states.

Off-Target Expression of Cre-Dependent Adeno-Associated Viruses in Wild-Type C57BL/6J Mice

Adeno-associated viruses (AAVs) are a commonly used tool in neuroscience to efficiently label, trace, and/or manipulate neuronal populations. Highly specific targeting can be achieved through recombinase-dependent AAVs in combination with transgenic rodent lines that express Cre-recombinase in specific cell types. Visualization of viral expression is typically achieved through fluorescent reporter proteins (e.g., GFP or mCherry) packaged within the AAV genome. Although nonamplified fluorescence is usually sufficient to observe viral expression, immunohistochemical amplification of the fluorescent reporter is routinely used to improve viral visualization. In the present study, Cre-dependent AAVs were injected into the neocortex of wild-type C57BL/6J mice. While we observed weak but consistent nonamplified off-target double inverted open reading frame (DIO) expression in C57BL/6J mice, antibody amplification of the GFP or mCherry reporter revealed notable Cre-independent viral expression. Off-target expression of DIO constructs in wild-type C57BL/6J mice occurred independent of vendor, AAV serotype, or promoter. We also evaluated whether Cre-independent expression had functional effects via designer receptors exclusively activated by designer drugs (DREADDs). The DREADD agonist C21 (compound 21) had no effect on contextual fear conditioning or c-Fos expression in DIO-hM3Dq-mCherry+ cells of C57BL/6J mice. Together, our results indicate that DIO constructs have off-target expression in wild-type subjects. Our findings are particularly important for the design of experiments featuring sensitive systems and/or quantitative measurements that could be negatively impacted by off-target expression.

Glucokinase neurons of the paraventricular nucleus of the thalamus sense glucose and decrease food consumption

The paraventricular nucleus of the thalamus (PVT) controls goal-oriented behavior through its connections to the nucleus accumbens (NAc). We previously characterized Glut2^aPVT neurons that are activated by hypoglycemia, and which increase sucrose seeking behavior through their glutamatergic projections to the NAc. Here, we identified glucokinase (Gck)-expressing neurons of the PVT (Gck^aPVT) and generated a mouse line expressing the Cre recombinase from the glucokinase locus (Gck ^Cre/+ mice). Ex vivo calcium imaging and whole-cell patch clamp recordings revealed that Gck^aPVT neurons that project to the NAc were mostly activated by hyperglycemia. Their chemogenetic inhibition or optogenetic stimulation, respectively, enhanced food intake or decreased sucrose-seeking behavior. Collectively, our results describe a neuronal population of Gck-expressing neurons in the PVT, which has opposite glucose sensing properties and control over feeding behavior than the previously characterized Glut2^aPVT neurons. This study allows a better understanding of the complex regulation of feeding behavior by the PVT.

Distinct Role of Dopamine in the PFC and NAc During Exposure to Cocaine-Associated Cues

BACKGROUND

Dopamine neurotransmission plays a critical role in reward in drug abuse and drug addiction. However, the role of dopamine in the recognition of drug-associated environmental stimuli, retrieval of drug-associated memory, and drug-seeking behaviors is not fully understood.

METHODS

Roles of dopamine neurotransmission in the prefrontal cortex (PFC) and nucleus accumbens (NAc) in the cocaine-conditioned place preference (CPP) paradigm were evaluated using in vivo microdialysis.

RESULTS

In mice that had acquired cocaine CPP, dopamine levels in the PFC, but not in the NAc, increased in response to cocaine-associated cues when mice were placed in the cocaine chamber of an apparatus with 2 separated chambers. The induction of the dopamine response and the development of cocaine CPP were mediated through activation of glutamate NMDA (N-methyl-D-aspartate)/AMPA (α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid) receptor signaling in the PFC during conditioning. Activation of dopamine D1 or D2 receptor signaling in the PFC was required for cocaine-induced locomotion, but not for the induction of the dopamine response or the development of cocaine CPP. Interestingly, dopamine levels in the NAc increased in response to cocaine-associated cues when mice were placed at the center of an apparatus with 2 connected chambers, which requires motivated exploration associated with cocaine reward.

CONCLUSIONS

Dopamine neurotransmission in the PFC is activated by the exposure to the cocaine-associated cues, whereas dopamine neurotransmission in the NAc is activated in a process of motivated exploration of cues associated with cocaine reward. Furthermore, the glutamate signaling cascade in the PFC is suggested to be a potential therapeutic target to prevent the progression of drug addiction.

The Aversion Function of the Limbic Dopaminergic Neurons and Their Roles in Functional Neurological Disorders

The Freudian theory of conversion suggested that the major symptoms of functional neurological disorders (FNDs) are due to internal conflicts at motivation, especially at the sex drive or libido. FND patients might behave properly at rewarding situations, but they do not know how to behave at aversive situations. Sex drive is the major source of dopamine (DA) release in the limbic area; however, the neural mechanism involved in FND is not clear. Dopaminergic (DAergic) neurons have been shown to play a key role in processing motivation-related information. Recently, DAergic neurons are found to be involved in reward-related prediction error, as well as the prediction of aversive information. Therefore, it is suggested that DA might change the rewarding reactions to aversive reactions at internal conflicts of FND. So DAergic neurons in the limbic areas might induce two major motivational functions: reward and aversion at internal conflicts. This article reviewed the recent advances on studies about DAergic neurons involved in aversive stimulus processing at internal conflicts and summarizes several neural pathways, including four limbic system brain regions, which are involved in the processing of aversion. Then the article discussed the vital function of these neural circuits in addictive behavior, depression treatment, and FNDs. In all, this review provided a prospect for future research on the aversion function of limbic system DA neurons and the therapy of FNDs.

Chronic Stress Induces Sex-Specific Functional and Morphological Alterations in Corticoaccumbal and Corticotegmental Pathways

BACKGROUND

The medial prefrontal cortex (mPFC) is part of a complex circuit controlling stress responses by sending projections to different limbic structures including the nucleus accumbens (NAc) and ventral tegmental area (VTA). However, the impact of chronic stress on NAc- and VTA-projecting mPFC neurons is still unknown, and the distinct contribution of these pathways to stress responses in males and females is unclear.

METHODS

Behavioral stress responses were induced by 21 days of chronic variable stress in male and female C57BL/6NCrl mice. An intersectional viral approach was used to label both pathways and assess the functional, morphological, and transcriptional adaptations in NAc- and VTA-projecting mPFC neurons in stressed males and females. Using chemogenetic approaches, we modified neuronal activity of NAc-projecting mPFC neurons to decipher their contribution to stress phenotypes.

RESULTS

Chronic variable stress induced depressive-like behaviors in males and females. NAc- and VTA-projecting mPFC neurons exhibited sex-specific functional, morphological, and transcriptional alterations. The functional changes were more severe in females in NAc-projecting mPFC neurons, while males exhibited more drastic reductions in dendritic complexity in VTA-projecting mPFC neurons after chronic variable stress. Finally, chemogenetic overactivation of the corticoaccumbal pathway triggered anxiety and behavioral despair in both sexes, while its inhibition rescued the phenotype only in females.

CONCLUSIONS

Our results suggest that stress responses in males and females result from pathway-specific changes in the activity of transcriptional programs controlling the morphological and synaptic properties of corticoaccumbal and corticotegmental pathways in a sex-specific fashion.

Online Learning and Memory of Neural Trajectory Replays for Prefrontal Persistent and Dynamic Representations in the Irregular Asynchronous State

In the prefrontal cortex (PFC), higher-order cognitive functions and adaptive flexible behaviors rely on continuous dynamical sequences of spiking activity that constitute neural trajectories in the state space of activity. Neural trajectories subserve diverse representations, from explicit mappings in physical spaces to generalized mappings in the task space, and up to complex abstract transformations such as working memory, decision-making and behavioral planning. Computational models have separately assessed learning and replay of neural trajectories, often using unrealistic learning rules or decoupling simulations for learning from replay. Hence, the question remains open of how neural trajectories are learned, memorized and replayed online, with permanently acting biological plasticity rules. The asynchronous irregular regime characterizing cortical dynamics in awake conditions exerts a major source of disorder that may jeopardize plasticity and replay of locally ordered activity. Here, we show that a recurrent model of local PFC circuitry endowed with realistic synaptic spike timing-dependent plasticity and scaling processes can learn, memorize and replay large-size neural trajectories online under asynchronous irregular dynamics, at regular or fast (sped-up) timescale. Presented trajectories are quickly learned (within seconds) as synaptic engrams in the network, and the model is able to chunk overlapping trajectories presented separately. These trajectory engrams last long-term (dozen hours) and trajectory replays can be triggered over an hour. In turn, we show the conditions under which trajectory engrams and replays preserve asynchronous irregular dynamics in the network. Functionally, spiking activity during trajectory replays at regular timescale accounts for both dynamical coding with temporal tuning in individual neurons, persistent activity at the population level, and large levels of variability consistent with observed cognitive-related PFC dynamics. Together, these results offer a consistent theoretical framework accounting for how neural trajectories can be learned, memorized and replayed in PFC networks circuits to subserve flexible dynamic representations and adaptive behaviors.

Dopamine Inputs from the Ventral Tegmental Area into the Medial Prefrontal Cortex Modulate Neuropathic Pain-Associated Behaviors in Mice

The medial prefrontal cortex (mPFC) is a brain region involved in the affective components of pain and undergoes plasticity during the development of chronic pain. Dopamine (DA) is a key neuromodulator in the mesocortical circuit and modulates working memory and aversion. Although DA inputs into the mPFC are known to modulate plasticity, whether and how these inputs affect pain remains incompletely understood. By using optogenetics, we find that phasic activation of DA inputs from the ventral tegmental area (VTA) into the mPFC reduce mechanical hypersensitivity during neuropathic pain states. Mice with neuropathic pain exhibit a preference for contexts paired with photostimulation of DA terminals in the mPFC. Fiber photometry-based calcium imaging reveals that DA increases the activity of mPFC neurons projecting to the ventrolateral periaqueductal gray (vlPAG). Together, our findings indicate an important role of mPFC DA signaling in pain modulation.

Prefrontal deep projection neurons enable cognitive flexibility via persistent feedback monitoring

Cognitive flexibility, the ability to alter strategy according to changing stimulus-response-reward relationships, is critical for updating learned behavior. Attentional set-shifting, a test of cognitive flexibility, depends on the activity of prefrontal cortex (PFC). It remains unclear, however, what role PFC neurons play to support set-shifting. Using optogenetics and two-photon calcium imaging, we demonstrate that medial PFC activity does not bias sensorimotor responses during set-shifting, but rather enables set-shifting by encoding trial feedback information, a role it has been known to play in other contexts. Unexpectedly, the functional properties of PFC cells did not vary with their efferent projection targets. Instead, representations of trial feedback formed a topological gradient, with cells more strongly selective for feedback information located further from the pial surface, where afferent input from the anterior cingulate cortex was denser. These findings identify a critical role for deep PFC projection neurons in enabling set-shifting through behavioral feedback monitoring.

The anterior cingulate cortex directs exploration of alternative strategies

The ability to adjust one's behavioral strategy in complex environments is at the core of cognition. Doing so efficiently requires monitoring the reliability of the ongoing strategy and, when appropriate, switching away from it to evaluate alternatives. Studies in humans and non-human primates have uncovered signals in the anterior cingulate cortex (ACC) that reflect the pressure to switch away from the ongoing strategy, whereas other ACC signals relate to the pursuit of alternatives. However, whether these signals underlie computations that actually underpin strategy switching or merely reflect tracking of related variables remains unclear. Here we provide causal evidence that the rodent ACC actively arbitrates between persisting with the ongoing behavioral strategy and temporarily switching away to re-evaluate alternatives. Furthermore, by individually perturbing distinct output pathways, we establish that the two associated computations-determining whether to switch strategy and committing to the pursuit of a specific alternative-are segregated in the ACC microcircuitry.

Dopamine signals as temporal difference errors: recent advances

In the brain, dopamine is thought to drive reward-based learning by signaling temporal difference reward prediction errors (TD errors), a 'teaching signal' used to train computers. Recent studies using optogenetic manipulations have provided multiple pieces of evidence supporting that phasic dopamine signals function as TD errors. Furthermore, novel experimental results have indicated that when the current state of the environment is uncertain, dopamine neurons compute TD errors using 'belief states' or a probability distribution over potential states. It remains unclear how belief states are computed but emerging evidence suggests involvement of the prefrontal cortex and the hippocampus. These results refine our understanding of the role of dopamine in learning and the algorithms by which dopamine functions in the brain.

Unique effects of social defeat stress in adolescent male mice on the Netrin-1/DCC pathway, prefrontal cortex dopamine and cognition (Social stress in adolescent vs. adult male mice)

For some individuals, social stress is a risk factor for psychiatric disorders characterised by adolescent onset, prefrontal cortex (PFC) dysfunction and cognitive impairments. Social stress may be particularly harmful during adolescence when dopamine (DA) axons are still growing to the PFC, rendering them sensitive to environmental influences. The guidance cue Netrin-1 and its receptor, DCC, coordinate to control mesocorticolimbic DA axon targeting and growth during this age. Here we adapted the accelerated social defeat (AcSD) paradigm to expose male mice to social stress in either adolescence or adulthood and categorised them as "resilient" or "susceptible" based on social avoidance behaviour. We examined whether stress would alter the expression of DCC and Netrin-1 in mesolimbic dopamine regions and would have enduring consequences on PFC dopamine connectivity and cognition. While in adolescence the majority of mice are resilient but exhibit risk-taking behaviour, AcSD in adulthood leads to a majority of susceptible mice without altering anxiety-like traits. In adolescent, but not adult mice, AcSD dysregulates DCC and Netrin-1 expression in mesolimbic DA regions. These molecular changes in adolescent mice are accompanied by changes in PFC DA connectivity. Following AcSD in adulthood, cognitive function remains unaffected, but all mice exposed to AcSD in adolescence show deficits in inhibitory control when they reach adulthood. These findings indicate that exposure to AcSD in adolescence vs. adulthood has substantially different effects on brain and behaviour and that stress-induced social avoidance in adolescence does not predict vulnerability to deficits in cognitive performance.Significance statement During adolescence, dopamine circuitries undergo maturational changes which may render them particularly vulnerable to social stress. While social stress can be detrimental to adolescents and adults, it may engage different mechanisms and impact different domains, depending on age. The accelerated social defeat (AcSD) model implemented here allows exposing adolescent and adult male mice to comparable social stress levels. AcSD in adulthood leads to a majority of socially avoidant mice. However, the predominance of AcSD-exposed adolescent mice does not develop social avoidance, and these resilient mice show risk-taking behaviour. Nonetheless, in adolescence only, AcSD dysregulates Netrin-1/DCC expression in mesolimbic dopamine regions, possibly disrupting mesocortical dopamine and cognition. The unique adolescent responsiveness to stress may explain increased psychopathology risk at this age.

Pathways for Contextual Memory: The Primate Hippocampal Pathway to Anterior Cingulate Cortex

The anterior cingulate cortex (ACC) is one of the few prefrontal areas that receives robust direct hippocampal terminations. This pathway may enable current context and past experience to influence goal-directed actions and emotional regulation by prefrontal cortices. We investigated the still ill-understood organization of the pathway from anterior hippocampus to ACC (A24a, A25, A32) to identify laminar termination patterns and their postsynaptic excitatory and inhibitory targets from system to synapse in rhesus monkeys. The densest hippocampal terminations targeted posterior A25, a region that is involved in affective and autonomic regulation. Hippocampal terminations innervated mostly excitatory neurons (~90%), suggesting strong excitatory effects. Among the smaller fraction of inhibitory targets, hippocampal terminations in A25 preferentially innervated calretinin neurons, a pattern that differs markedly from rodents. Further, hippocampal terminations innervated spines with D1 receptors, particularly in the deep layers of A25, where D1 receptors are enriched in comparison with the upper layers. The proximity of hippocampal terminations to D1 receptors may enable dopamine to enhance information transfer from the hippocampus to A25 and contribute to dopaminergic influence downstream on goal-directed action and emotional control by prefrontal cortices, in processes that may be disrupted by excessive dopamine release during uncontrollable stress.

The anterior cingulate cortex and event-based modulation of autonomic states

In spite of being an intensive area of research focus, the anterior cingulate cortex (ACC) remains somewhat of an enigma. Many theories have focused on its role in various aspects of cognition yet surgically precise lesions of the ACC, used to treat severe emotional disorders in human patients, typically have no lasting effects on cognition. An alternative view is that the ACC has a prominent role in regulating autonomic states. This view is consistent with anatomical data showing that a main target of the ACC are regions involved in autonomic control and with the observation that stimulation of the ACC evokes changes in autonomic states in both animals and humans. From an electrophysiological perspective, ACC neurons appear able to represent virtually any event or internal state, even though there is not always a strong link between these representations and behavior. Ensembles of neurons form robust contextual representations that strongly influence how specific events are encoded. The activity patterns associated with these contextually-based event representations presumably impact activity in downstream regions that control autonomic state. As a result, the ACC may regulate the autonomic and perhaps emotional reactions to events it is representing. This event-based control of autonomic tone by the ACC would likely arise during all types of cognitive and affective processes, without necessarily being critical for any of them.

Reinforcement learning approaches to hippocampus-dependent flexible spatial navigation

Humans and non-human animals show great flexibility in spatial navigation, including the ability to return to specific locations based on as few as one single experience. To study spatial navigation in the laboratory, watermaze tasks, in which rats have to find a hidden platform in a pool of cloudy water surrounded by spatial cues, have long been used. Analogous tasks have been developed for human participants using virtual environments. Spatial learning in the watermaze is facilitated by the hippocampus. In particular, rapid, one-trial, allocentric place learning, as measured in the delayed-matching-to-place variant of the watermaze task, which requires rodents to learn repeatedly new locations in a familiar environment, is hippocampal dependent. In this article, we review some computational principles, embedded within a reinforcement learning framework, that utilise hippocampal spatial representations for navigation in watermaze tasks. We consider which key elements underlie their efficacy, and discuss their limitations in accounting for hippocampus-dependent navigation, both in terms of behavioural performance (i.e. how well do they reproduce behavioural measures of rapid place learning) and neurobiological realism (i.e. how well do they map to neurobiological substrates involved in rapid place learning). We discuss how an actor-critic architecture, enabling simultaneous assessment of the value of the current location and of the optimal direction to follow, can reproduce one-trial place learning performance as shown on watermaze and virtual delayed-matching-to-place tasks by rats and humans, respectively, if complemented with map-like place representations. The contribution of actor-critic mechanisms to delayed-matching-to-place performance is consistent with neurobiological findings implicating the striatum and hippocampo-striatal interaction in delayed-matching-to-place performance, given that the striatum has been associated with actor-critic mechanisms. Moreover, we illustrate that hierarchical computations embedded within an actor-critic architecture may help to account for aspects of flexible spatial navigation. The hierarchical reinforcement learning approach separates trajectory control via a temporal-difference error from goal selection via a goal prediction error and may account for flexible, trial-specific, navigation to familiar goal locations, as required in some arm-maze place memory tasks, although it does not capture one-trial learning of new goal locations, as observed in open field, including watermaze and virtual, delayed-matching-to-place tasks. Future models of one-shot learning of new goal locations, as observed on delayed-matching-to-place tasks, should incorporate hippocampal plasticity mechanisms that integrate new goal information with allocentric place representation, as such mechanisms are supported by substantial empirical evidence.

Distinct roles for dopamine clearance mechanisms in regulating behavioral flexibility

Dopamine plays a crucial role in adaptive behavior, and dysfunctional dopamine is implicated in multiple psychiatric conditions characterized by inflexible or inconsistent choices. However, the precise relationship between dopamine and flexible decision making remains unclear. One reason is that, while many studies have focused on the activity of dopamine neurons, efficient dopamine signaling also relies on clearance mechanisms, notably the dopamine transporter (DAT), which predominates in striatum, and catechol-O-methyltransferase (COMT), which predominates in cortex. The exact locus, extent, and timescale of the effects of DAT and COMT are uncertain. Moreover, there is limited data on how acute disruption of either mechanism affects flexible decision making strategies mediated by cortico-striatal networks. To address these issues, we combined pharmacological modulation of DAT and COMT with electrochemistry and behavior in mice. DAT blockade, but not COMT inhibition, regulated sub-second dopamine release in the nucleus accumbens core, but surprisingly neither clearance mechanism affected evoked release in prelimbic cortex. This was not due to a lack of sensitivity, as both amphetamine and atomoxetine changed the kinetics of sub-second release. In a multi-step decision making task where mice had to respond to reversals in either reward probabilities or the choice sequence to reach the goal, DAT blockade selectively impaired, and COMT inhibition improved, performance after reward reversals, but neither manipulation affected the adaptation of choices after action-state transition reversals. Together, our data suggest that DAT and COMT shape specific aspects of behavioral flexibility by regulating different aspects of the kinetics of striatal and cortical dopamine, respectively.

Synaptic Properties and Plasticity Mechanisms of Invertebrate Tonic and Phasic Neurons

Defining neuronal cell types and their associated biophysical and synaptic diversity has become an important goal in neuroscience as a mechanism to create comprehensive brain cell atlases in the post-genomic age. Beyond broad classification such as neurotransmitter expression, interneuron vs. pyramidal, sensory or motor, the field is still in the early stages of understanding closely related cell types. In both vertebrate and invertebrate nervous systems, one well-described distinction related to firing characteristics and synaptic release properties are tonic and phasic neuronal subtypes. In vertebrates, these classes were defined based on sustained firing responses during stimulation (tonic) vs. transient responses that rapidly adapt (phasic). In crustaceans, the distinction expanded to include synaptic release properties, with tonic motoneurons displaying sustained firing and weaker synapses that undergo short-term facilitation to maintain muscle contraction and posture. In contrast, phasic motoneurons with stronger synapses showed rapid depression and were recruited for short bursts during fast locomotion. Tonic and phasic motoneurons with similarities to those in crustaceans have been characterized in Drosophila, allowing the genetic toolkit associated with this model to be used for dissecting the unique properties and plasticity mechanisms for these neuronal subtypes. This review outlines general properties of invertebrate tonic and phasic motoneurons and highlights recent advances that characterize distinct synaptic and plasticity pathways associated with two closely related glutamatergic neuronal cell types that drive invertebrate locomotion.