Activity patterns of serotonin neurons underlying cognitive flexibility

Optogenetic activation of dorsal raphe serotonin neurons induces brain-wide activation

Serotonin is a neuromodulator that affects multiple behavioral and cognitive functions. Nonetheless, how serotonin causes such a variety of effects via brain-wide projections and various receptors remains unclear. Here we measured brain-wide responses to optogenetic stimulation of serotonin neurons in the dorsal raphe nucleus (DRN) of the male mouse brain using functional MRI with an 11.7 T scanner and a cryoprobe. Transient activation of DRN serotonin neurons caused brain-wide activation, including the medial prefrontal cortex, the striatum, and the ventral tegmental area. The same stimulation under anesthesia with isoflurane decreased brain-wide activation, including the hippocampal complex. These brain-wide response patterns can be explained by DRN serotonergic projection topography and serotonin receptor expression profiles, with enhanced weights on 5-HT1 receptors. Together, these results provide insight into the DR serotonergic system, which is consistent with recent discoveries of its functions in adaptive behaviors.

Poor Decision Making and Sociability Impairment Following Central Serotonin Reduction in Inducible TPH2-Knockdown Rats

Serotonin is an essential neuromodulator for mental health and animals' socio-cognitive abilities. However, we previously found that a constitutive depletion of central serotonin did not impair rat cognitive abilities in stand-alone tests. Here, we investigated how a mild and acute decrease in brain serotonin would affect rats' cognitive abilities. Using a novel rat model of inducible serotonin depletion via the genetic knockdown of tryptophan hydroxylase 2 (TPH2), we achieved a 20% decrease in serotonin levels in the hypothalamus after three weeks of non-invasive oral doxycycline administration. Decision making, cognitive flexibility, and social recognition memory were tested in low-serotonin (Tph2-kd) and control rats. Our results showed that the Tph2-kd rats were more prone to choose disadvantageously in the long term (poor decision making) in the Rat Gambling Task and that only the low-serotonin poor decision makers were more sensitive to probabilistic discounting and had poorer social recognition memory than other low-serotonin and control individuals. Flexibility was unaffected by the acute brain serotonin reduction. Poor social recognition memory was the most central characteristic of the behavioral network of low-serotonin poor decision makers, suggesting a key role of social recognition in the expression of their profile. The acute decrease in brain serotonin appeared to specifically amplify the cognitive impairments of the subgroup of individuals also identified as poor decision makers in the population. This study highlights the great opportunity the Tph2-kd rat model offers to study inter-individual susceptibilities to develop cognitive impairment following mild variations of brain serotonin in otherwise healthy individuals. These transgenic and differential approaches together could be critical for the identification of translational markers and vulnerabilities in the development of mental disorders.

Serotonin Signaling in Hippocampus during Initial Cocaine Abstinence Drives Persistent Drug Seeking

The initiation of abstinence after chronic drug self-administration is stressful. Cocaine-seeking behavior on the first day of the absence of the expected drug (Extinction Day 1, ED1) is reduced by blocking 5-HT signaling in dorsal hippocampal cornu ammonis 1 (CA1) in both male and female rats. We hypothesized that the experience of ED1 can substantially influence later relapse behavior and that dorsal raphe (DR) serotonin (5-HT) input to CA1 may be involved. We inhibited 5-HT1A/1B receptors (WAY-100635 plus GR-127935), or DR input (chemogenetics), in CA1 on ED1 to test the role of this pathway on cocaine-seeking persistence 2 weeks later. We also inhibited 5-HT1A or 5-HT1B receptors in CA1 during conditioned place preference (CPP) for cocaine, to examine mechanisms involved in the persistent effects of ED1 manipulations. Inhibition of DR inputs, or 5-HT1A/1B signaling, in CA1 decreased drug seeking on ED1 and decreased cocaine seeking 2 weeks later revealing that 5-HT signaling in CA1 during ED1 contributes to persistent drug seeking during abstinence. In addition, 5-HT1B antagonism alone transiently decreased drug-associated memory performance when given prior to a CPP test, whereas similar antagonism of 5-HT1A alone had no such effect but blocked CPP retrieval on a test 24 h later. These CPP findings are consistent with prior work showing that DR inputs to CA1 augment recall of the drug-associated context and drug seeking via 5-HT1B receptors and prevent consolidation of the updated nondrug context via 5-HT1A receptors. Thus, treatments that modulate 5-HT-dependent memory mechanisms in CA1 during initial abstinence may facilitate later maintenance of abstinence.

Contemporary neurocognitive models of memory: A descriptive comparative analysis

The great complexity involved in the study of memory has given rise to numerous hypotheses and models associated with various phenomena at different levels of analysis. This has allowed us to delve deeper in our knowledge about memory but has also made it difficult to synthesize and integrate data from different lines of research. In this context, this work presents a descriptive comparative analysis of contemporary models that address the structure and function of multiple memory systems. The main goal is to outline a panoramic view of the key elements that constitute these models in order to visualize both the current state of research and possible future directions. The elements that stand out from different levels of analysis are distributed neural networks, hierarchical organization, predictive coding, homeostasis, and evolutionary perspective.

Dopamine and serotonin in human substantia nigra track social context and value signals during economic exchange

Dopamine and serotonin are hypothesized to guide social behaviours. In humans, however, we have not yet been able to study neuromodulator dynamics as social interaction unfolds. Here, we obtained subsecond estimates of dopamine and serotonin from human substantia nigra pars reticulata during the ultimatum game. Participants, who were patients with Parkinson's disease undergoing awake brain surgery, had to accept or reject monetary offers of varying fairness from human and computer players. They rejected more offers in the human than the computer condition, an effect of social context associated with higher overall levels of dopamine but not serotonin. Regardless of the social context, relative changes in dopamine tracked trial-by-trial changes in offer value-akin to reward prediction errors-whereas serotonin tracked the current offer value. These results show that dopamine and serotonin fluctuations in one of the basal ganglia's main output structures reflect distinct social context and value signals.

Neonatal hypoxia impairs serotonin release and cognitive functions in adult mice

Children who experienced moderate perinatal asphyxia (MPA) are at risk of developing long lasting subtle cognitive and behavioral deficits, including learning disabilities and emotional problems. The prefrontal cortex (PFC) regulates cognitive flexibility and emotional behavior. Neurons that release serotonin (5-HT) project to the PFC, and compounds modulating 5-HT activity influence emotion and cognition. Whether 5-HT dysregulations contribute to MPA-induced cognitive problems is unknown. We established a MPA mouse model, which displays recognition and spatial memory impairments and dysfunctional cognitive flexibility. We found that 5-HT expression levels, quantified by immunohistochemistry, and 5-HT release, quantified by in vivo microdialysis in awake mice, are reduced in PFC of adult MPA mice. MPA mice also show impaired body temperature regulation following injection of the 5-HT1A receptor agonist 8-OH-DPAT, suggesting the presence of deficits in 5-HT auto-receptor function on raphe neurons. Finally, chronic treatment of adult MPA mice with fluoxetine, an inhibitor of 5-HT reuptake transporter, or the 5-HT1A receptor agonist tandospirone rescues cognitive flexibility and memory impairments. All together, these data demonstrate that the development of 5-HT system function is vulnerable to moderate perinatal asphyxia. 5-HT hypofunction might in turn contribute to long-term cognitive impairment in adulthood, indicating a potential target for pharmacological therapies.

Fast adaptation to rule switching using neuronal surprise

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signal is extracted from an increase in neural activity after an imbalance of excitation and inhibition. The surprise signal modulates synaptic plasticity via a three-factor learning rule which increases plasticity at moments of surprise. The surprise signal remains small when transitions between sensory events follow a previously learned rule but increases immediately after rule switching. In a spiking network with several modules, previously learned rules are protected against overwriting, as long as the number of modules is larger than the total number of rules-making a step towards solving the stability-plasticity dilemma in neuroscience. Our model relates the subjective notion of surprise to specific predictions on the circuit level.

Synthetic surprise as the foundation of the psychedelic experience

Psychedelic agents, such as LSD and psilocybin, induce marked alterations in consciousness via activation of the 5-HT2A receptor (5-HT2ARs). We hypothesize that psychedelics enforce a state of synthetic surprise through the biased activation of the 5-HTRs system. This idea is informed by recent insights into the role of 5-HT in signaling surprise. The effects on consciousness, explained by the cognitive penetrability of perception, can be described within the predictive coding framework where surprise corresponds to prediction error, the mismatch between predictions and actual sensory input. Crucially, the precision afforded to the prediction error determines its effect on priors, enabling a dynamic interaction between top-down expectations and incoming sensory data. By integrating recent findings on predictive coding circuitry and 5-HT2ARs transcriptomic data, we propose a biological implementation with emphasis on the role of inhibitory interneurons. Implications arise for the clinical use of psychedelics, which may rely primarily on their inherent capacity to induce surprise in order to disrupt maladaptive patterns.

Comparable roles for serotonin in rats and humans for computations underlying flexible decision-making

Serotonin is critical for adapting behavior flexibly to meet changing environmental demands. Cognitive flexibility is important for successful attainment of goals, as well as for social interactions, and is frequently impaired in neuropsychiatric disorders, including obsessive-compulsive disorder. However, a unifying mechanistic framework accounting for the role of serotonin in behavioral flexibility has remained elusive. Here, we demonstrate common effects of manipulating serotonin function across two species (rats and humans) on latent processes supporting choice behavior during probabilistic reversal learning, using computational modelling. The findings support a role of serotonin in behavioral flexibility and plasticity, indicated, respectively, by increases or decreases in choice repetition ('stickiness') or reinforcement learning rates following manipulations intended to increase or decrease serotonin function. More specifically, the rate at which expected value increased following reward and decreased following punishment (reward and punishment 'learning rates') was greatest after sub-chronic administration of the selective serotonin reuptake inhibitor (SSRI) citalopram (5 mg/kg for 7 days followed by 10 mg/kg twice a day for 5 days) in rats. Conversely, humans given a single dose of an SSRI (20 mg escitalopram), which can decrease post-synaptic serotonin signalling, and rats that received the neurotoxin 5,7-dihydroxytryptamine (5,7-DHT), which destroys forebrain serotonergic neurons, exhibited decreased reward learning rates. A basic perseverative tendency ('stickiness'), or choice repetition irrespective of the outcome produced, was likewise increased in rats after the 12-day SSRI regimen and decreased after single dose SSRI in humans and 5,7-DHT in rats. These common effects of serotonergic manipulations on rats and humans-identified via computational modelling-suggest an evolutionarily conserved role for serotonin in plasticity and behavioral flexibility and have clinical relevance transdiagnostically for neuropsychiatric disorders.

A role for the serotonin 2A receptor in the expansion and functioning of human transmodal cortex

Integrating independent but converging lines of research on brain function and neurodevelopment across scales, this article proposes that serotonin 2A receptor (5-HT2AR) signalling is an evolutionary and developmental driver and potent modulator of the macroscale functional organization of the human cerebral cortex. A wealth of evidence indicates that the anatomical and functional organization of the cortex follows a unimodal-to-transmodal gradient. Situated at the apex of this processing hierarchy-where it plays a central role in the integrative processes underpinning complex, human-defining cognition-the transmodal cortex has disproportionately expanded across human development and evolution. Notably, the adult human transmodal cortex is especially rich in 5-HT2AR expression and recent evidence suggests that, during early brain development, 5-HT2AR signalling on neural progenitor cells stimulates their proliferation-a critical process for evolutionarily-relevant cortical expansion. Drawing on multimodal neuroimaging and cross-species investigations, we argue that, by contributing to the expansion of the human cortex and being prevalent at the apex of its hierarchy in the adult brain, 5-HT2AR signalling plays a major role in both human cortical expansion and functioning. Owing to its unique excitatory and downstream cellular effects, neuronal 5-HT2AR agonism promotes neuroplasticity, learning and cognitive and psychological flexibility in a context-(hyper)sensitive manner with therapeutic potential. Overall, we delineate a dual role of 5-HT2ARs in enabling both the expansion and modulation of the human transmodal cortex.

Distinct spatiotemporal brainstem pathways of outcome valence during reward- and punishment-based learning

Learning to seek rewards and avoid punishments, based on positive and negative choice outcomes, is essential for human survival. Yet, the neural underpinnings of outcome valence in the human brainstem and the extent to which they differ in reward and punishment learning contexts remain largely elusive. Here, using simultaneously acquired electroencephalography and functional magnetic resonance imaging data, we show that during reward learning the substantia nigra (SN)/ventral tegmental area (VTA) and locus coeruleus are initially activated following negative outcomes, while the VTA subsequently re-engages exhibiting greater responses for positive than negative outcomes, consistent with an early arousal/avoidance response and a later value-updating process, respectively. During punishment learning, we show that distinct raphe nucleus and SN subregions are activated only by negative outcomes with a sustained post-outcome activity across time, supporting the involvement of these brainstem subregions in avoidance behavior. Finally, we demonstrate that the coupling of these brainstem structures with other subcortical and cortical areas helps to shape participants' serial choice behavior in each context.

Serotonin neurons in mating female mice are activated by male ejaculation

Sexual stimulation triggers changes in female physiology and behavior, including sexual satiety and preparing the uterus for pregnancy. Serotonin (5-HT) is an important regulator of reproductive physiology and sexual receptivity, but the relationship between sexual stimulation and 5-HT neural activity in females is poorly understood. Here, we investigated dorsal raphe 5-HT neural activity in female mice during sexual behavior. We found that 5-HT neural activity in mating females peaked specifically upon male ejaculation and remained elevated above baseline until disengagement. Artificial intravaginal mechanical stimulation was sufficient to elicit increased 5-HT neural activity but the delivery of ejaculatory fluids was not. Distal penis expansion ("penile cupping") at ejaculation and forceful expulsion of ejaculatory fluid each provided sufficient mechanical stimulation to elicit 5-HT neuron activation. Our study identifies a female ejaculation-specific signal in a major neuromodulatory system and shows that intravaginal mechanosensory stimulation is necessary and sufficient to drive this signal.

Dorsal raphe neurons signal integrated value during multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.

Serotonin neurons in mating female mice are activated by male ejaculation

Sexual stimulation triggers changes in female physiology and behavior, including sexual satiety and preparing the uterus for pregnancy. Serotonin is an important regulator of reproductive physiology and sexual receptivity, but the relationship between sexual stimulation and serotonin neural activity in females is poorly understood. Here, we investigated dorsal raphe serotonin neural activity in females during sexual behavior. We found that serotonin neural activity in mating females peaked specifically upon male ejaculation, and remained elevated above baseline until disengagement. Artificial intravaginal mechanical stimulation was sufficient to elicit increased 5-HT neural activity but the delivery of ejaculatory fluids was not. Distal penis erectile enlargement ("penile cupping") at ejaculation and forceful expulsion of ejaculatory fluid each provided sufficient mechanical stimulation to elicit serotonin neuron activation. Our study identifies a female ejaculation-specific signal in a major neuromodulatory system and shows that intravaginal mechanosensory stimulation is necessary and sufficient to drive this signal.

Gradients of neurotransmitter receptor expression in the macaque cortex

Dynamics and functions of neural circuits depend on interactions mediated by receptors. Therefore, a comprehensive map of receptor organization across cortical regions is needed. In this study, we used in vitro receptor autoradiography to measure the density of 14 neurotransmitter receptor types in 109 areas of macaque cortex. We integrated the receptor data with anatomical, genetic and functional connectivity data into a common cortical space. We uncovered a principal gradient of receptor expression per neuron. This aligns with the cortical hierarchy from sensory cortex to higher cognitive areas. A second gradient, driven by serotonin 5-HT1A receptors, peaks in the anterior cingulate, default mode and salience networks. We found a similar pattern of 5-HT1A expression in the human brain. Thus, the macaque may be a promising translational model of serotonergic processing and disorders. The receptor gradients may enable rapid, reliable information processing in sensory cortical areas and slow, flexible integration in higher cognitive areas.

Anxiety as a disorder of uncertainty: implications for understanding maladaptive anxiety, anxious avoidance, and exposure therapy

In cognitive-behavioral conceptualizations of anxiety, exaggerated threat expectancies underlie maladaptive anxiety. This view has led to successful treatments, notably exposure therapy, but is not consistent with the empirical literature on learning and choice alterations in anxiety. Empirically, anxiety is better described as a disorder of uncertainty learning. How disruptions in uncertainty lead to impairing avoidance and are treated with exposure-based methods, however, is unclear. Here, we integrate concepts from neurocomputational learning models with clinical literature on exposure therapy to propose a new framework for understanding maladaptive uncertainty functioning in anxiety. Specifically, we propose that anxiety disorders are fundamentally disorders of uncertainty learning and that successful treatments, particularly exposure therapy, work by remediating maladaptive avoidance from dysfunctional explore/exploit decisions in uncertain, potentially aversive situations. This framework reconciles several inconsistencies in the literature and provides a path forward to better understand and treat anxiety.

Chronic corticosterone improves perseverative behavior in mice during sequential reversal learning

BACKGROUND

Stressful life events can both trigger development of psychiatric disorders and promote positive behavioral changes in response to adversities. The relationship between stress and cognitive flexibility is complex, and conflicting effects of stress manifest in both humans and laboratory animals.

OBJECTIVE

To mirror the clinical situation where stressful life events impair mental health or promote behavioral change, we examined the post-exposure effects of stress on cognitive flexibility in mice.

METHODS

We tested female C57BL/6JOlaHsd mice in the touchscreen-based sequential reversal learning test. Corticosterone (CORT) was used as a model of stress and was administered in the drinking water for two weeks before reversal learning. Control animals received drinking water without CORT. Behaviors in supplementary tests were included to exclude non-specific confounding effects of CORT and improve interpretation of the results.

RESULTS

CORT-treated mice were similar to controls on all touchscreen parameters before reversal. During the low accuracy phase of reversal learning, CORT reduced perseveration index, a measure of perseverative responding, but did not affect acquisition of the new reward contingency. This effect was not related to non-specific deficits in chamber activity. CORT increased anxiety-like behavior in the elevated zero maze test and repetitive digging in the marble burying test, reduced locomotor activity, but did not affect spontaneous alternation behavior.

CONCLUSION

CORT improved cognitive flexibility in the reversal learning test by extinguishing prepotent responses that were no longer rewarded, an effect possibly related to a stress-mediated increase in sensitivity to negative feedback that should be confirmed in a larger study.

Neurocomputational mechanisms underlying fear-biased adaptation learning in changing environments

Humans are able to adapt to the fast-changing world by estimating statistical regularities of the environment. Although fear can profoundly impact adaptive behaviors, the computational and neural mechanisms underlying this phenomenon remain elusive. Here, we conducted a behavioral experiment (n = 21) and a functional magnetic resonance imaging experiment (n = 37) with a novel cue-biased adaptation learning task, during which we simultaneously manipulated emotional valence (fearful/neutral expressions of the cue) and environmental volatility (frequent/infrequent reversals of reward probabilities). Across 2 experiments, computational modeling consistently revealed a higher learning rate for the environment with frequent versus infrequent reversals following neutral cues. In contrast, this flexible adjustment was absent in the environment with fearful cues, suggesting a suppressive role of fear in adaptation to environmental volatility. This suppressive effect was underpinned by activity of the ventral striatum, hippocampus, and dorsal anterior cingulate cortex (dACC) as well as increased functional connectivity between the dACC and temporal-parietal junction (TPJ) for fear with environmental volatility. Dynamic causal modeling identified that the driving effect was located in the TPJ and was associated with dACC activation, suggesting that the suppression of fear on adaptive behaviors occurs at the early stage of bottom-up processing. These findings provide a neuro-computational account of how fear interferes with adaptation to volatility during dynamic environments.

PhAT: A Flexible Open-Source GUI-Driven Toolkit for Photometry Analysis

Photometry approaches detect sensor-mediated changes in fluorescence as a proxy for rapid molecular changes within the brain. As a flexible technique with a relatively low cost to implement, photometry is rapidly being incorporated into neuroscience laboratories. Yet, although multiple data acquisition systems for photometry now exist, robust analytical pipelines for the resulting data remain limited. Here we present the Photometry Analysis Toolkit (PhAT)-a free open-source analysis pipeline that provides options for signal normalization, incorporation of multiple data streams to align photometry data with behavior and other events, calculation of event-related changes in fluorescence, and comparison of similarity across fluorescent traces. A graphical user interface (GUI) enables use of this software without prior coding knowledge. In addition to providing foundational analytical tools, PhAT is designed to readily incorporate community-driven development of new modules for more bespoke analyses, and enables data to be easily exported to enable subsequent statistical testing and/or code-based analyses. In addition, we provide recommendations regarding technical aspects of photometry experiments, including sensor selection and validation, reference signal considerations, and best practices for experimental design and data collection. We hope that the distribution of this software and protocols will lower the barrier to entry for new photometry users and improve the quality of collected data, increasing transparency and reproducibility in photometry analyses. © 2023 Wiley Periodicals LLC. Basic Protocol 1: Software and environment installation Alternate Protocol 1: Software and environment update Basic Protocol 2: GUI-driven fiber photometry analysis Support Protocol 1: Examining signal quality Support Protocol 2: Interacting with graphs Basic Protocol 3: Adding modules to PhAT Alternate Protocol 2: Creating functions for use in Jupyter Notebook.

Physical activity for cognitive health promotion: An overview of the underlying neurobiological mechanisms

Physical activity is one of the modifiable factors of cognitive decline and dementia with the strongest evidence. Although many influential reviews have illustrated the neurobiological mechanisms of the cognitive benefits of physical activity, none of them have linked the neurobiological mechanisms to normal exercise physiology to help the readers gain a more advanced, comprehensive understanding of the phenomenon. In this review, we address this issue and provide a synthesis of the literature by focusing on five most studied neurobiological mechanisms. We show that the body's adaptations to enhance exercise performance also benefit the brain and contribute to improved cognition. Specifically, these adaptations include, 1), the release of growth factors that are essential for the development and growth of neurons and for neurogenesis and angiogenesis, 2), the production of lactate that provides energy to the brain and is involved in the synthesis of glutamate and the maintenance of long-term potentiation, 3), the release of anti-inflammatory cytokines that reduce neuroinflammation, 4), the increase in mitochondrial biogenesis and antioxidant enzyme activity that reduce oxidative stress, and 5), the release of neurotransmitters such as dopamine and 5-HT that regulate neurogenesis and modulate cognition. We also discussed several issues relevant for prescribing physical activity, including what intensity and mode of physical activity brings the most cognitive benefits, based on their influence on the above five neurobiological mechanisms. We hope this review helps readers gain a general understanding of the state-of-the-art knowledge on the neurobiological mechanisms of the cognitive benefits of physical activity and guide them in designing new studies to further advance the field.

Medial Prefrontal Cortex Serotonin Input Regulates Cognitive Flexibility in Mice

The medial prefrontal cortex (mPFC) regulates cognitive flexibility and emotional behavior. Neurons that release serotonin project to the mPFC, and serotonergic drugs influence emotion and cognition. Yet, the specific roles of endogenous serotonin release in the mPFC on neurophysiology and behavior are unknown. We show that axonal serotonin release in the mPFC directly inhibits the major mPFC output neurons. In serotonergic neurons projecting from the dorsal raphe to the mPFC, we find endogenous activity signatures pre-reward retrieval and at reward retrieval during a cognitive flexibility task. In vivo optogenetic activation of this pathway during pre-reward retrieval selectively improved extradimensional rule shift performance while inhibition impaired it, demonstrating sufficiency and necessity for mPFC serotonin release in cognitive flexibility. Locomotor activity and anxiety-like behavior were not affected by either optogenetic manipulation. Collectively, our data reveal a powerful and specific modulatory role of endogenous serotonin release from dorsal raphe-to-mPFC projecting neurons in cognitive flexibility.

PhAT: A flexible open-source GUI-driven toolkit for photometry analysis

Photometry approaches detect sensor-mediated changes in fluorescence as a proxy for rapid molecular changes within the brain. As a flexible technique with a relatively low cost to implement, photometry is rapidly being incorporated into neuroscience laboratories. While multiple data acquisition systems for photometry now exist, robust analytical pipelines for the resulting data remain limited. Here we present the Ph otometry A nalysis T oolkit (PhAT) - a free open source analysis pipeline that provides options for signal normalization, incorporation of multiple data streams to align photometry data with behavior and other events, calculation of event-related changes in fluorescence, and comparison of similarity across fluorescent traces. A graphical user interface (GUI) enables use of this software without prior coding knowledge. In addition to providing foundational analytical tools, PhAT is designed to readily incorporate community-driven development of new modules for more bespoke analyses, and data can be easily exported to enable subsequent statistical testing and/or code-based analyses. In addition, we provide recommendations regarding technical aspects of photometry experiments including sensor selection and validation, reference signal considerations, and best practices for experimental design and data collection. We hope that the distribution of this software and protocol will lower the barrier to entry for new photometry users and improve the quality of collected data, increasing transparency and reproducibility in photometry analyses. Basic Protocol 1: Software Environment InstallationBasic Protocol 2: GUI-driven Fiber Photometry AnalysisBasic Protocol 3: Adding Modules.

Serotonin in the orbitofrontal cortex enhances cognitive flexibility

Cognitive flexibility is a brain's ability to switch between different rules or action plans depending on the context. However, cellular level understanding of cognitive flexibility have been largely unexplored. We probed a specific serotonergic pathway from dorsal raphe nuclei (DRN) to the orbitofrontal cortex (OFC) while animals are performing reversal learning task. We found that serotonin release from DRN to the OFC promotes reversal learning. A long-range connection between these two brain regions was confirmed anatomically and functionally. We further show that spatiotemporally precise serotonergic action directly enhances the excitability of OFC neurons and offers enhanced spike probability of OFC network. Serotonergic action facilitated the induction of synaptic plasticity by enhancing Ca2+ influx at dendritic spines in the OFC. Thus, our findings suggest that a key signature of flexibility is the formation of choice specific ensembles via serotonin-dependent synaptic plasticity.

Effect of psilocybin on decision-making and motivation in the healthy rat

Psilocybin and its active metabolite psilocin are hallucinogenic serotonergic agonists with high affinity for several serotonin receptors. In addition to underlying the hallucinogenic effects of these compounds, serotonin receptor activation also has important effects on decision-making and goal-directed behaviors. The impact of psilocybin and psilocin on these cognitive systems, however, remains unclear. This study investigated the effects of psilocybin treatment on decision-making and motivation in healthy male and female rats. We compared probability and delay discounting performance of psilocybin treated (1 mg/kg) to vehicle rats (n = 10/sex/group), and further assessed motivation in each group using a progressive ratio task. We also confirmed drug action by assessing head twitch responses after psilocybin treatment (1 mg/kg). Results from this study demonstrated that exposure to 1 mg/kg psilocybin did not affect decision-making in the probability and delay discounting tasks and did not reduce response rates in the progressive ratio task. However, psilocybin treatment did cause the expected increase in head twitch responses in both male and female rats, demonstrating that the drug was delivered at a pharmacologically relevant dosage. Combined, these results suggest that psilocybin may not impair or improve decision-making and motivation. Considering recent interest in psilocybin as a potential fast-acting therapeutic for a variety of mental health disorders, our findings also suggest the therapeutic effects of this drug may not be mediated by changes to the brain systems underlying reward and decision-making. Finally, these results may have important implications regarding the relative safety of this compound, suggesting that widespread cognitive impairments may not be seen in subjects, even after chronic treatment.

The Role of α-Synuclein in the Regulation of Serotonin System: Physiological and Pathological Features

In patients affected by Parkinson's disease (PD), up to 50% of them experience cognitive changes, and psychiatric disturbances, such as anxiety and depression, often precede the onset of motor symptoms and have a negative impact on their quality of life. Pathologically, PD is characterized by the loss of dopamine (DA) neurons in the substantia nigra pars compacta (SNc) and the presence of intracellular inclusions, called Lewy bodies and Lewy neurites, composed mostly of α-synuclein (α-Syn). Much of PD research has focused on the role of α-Syn aggregates in the degeneration of SNc DA neurons due to the impact of striatal DA deficits on classical motor phenotypes. However, abundant Lewy pathology is also found in other brain regions including the midbrain raphe nuclei, which may contribute to non-motor symptoms. Indeed, dysfunction of the serotonergic (5-HT) system, which regulates mood and emotional pathways, occurs during the premotor phase of PD. However, little is known about the functional consequences of α-Syn inclusions in this neuronal population other than DA neurons. Here, we provide an overview of the current knowledge of α-Syn and its role in regulating the 5-HT function in health and disease. Understanding the relative contributions to α-Syn-linked alterations in the 5-HT system may provide a basis for identifying PD patients at risk for developing depression and could lead to a more targeted therapeutic approach.

Degeneracy and stability in neural circuits of dopamine and serotonin neuromodulators: A theoretical consideration

Degenerate neural circuits perform the same function despite being structurally different. However, it is unclear whether neural circuits with interacting neuromodulator sources can themselves degenerate while maintaining the same neuromodulatory function. Here, we address this by computationally modeling the neural circuits of neuromodulators serotonin and dopamine, local glutamatergic and GABAergic interneurons, and their possible interactions, under reward/punishment-based conditioning tasks. The neural modeling is constrained by relevant experimental studies of the VTA or DRN system using, e.g., electrophysiology, optogenetics, and voltammetry. We first show that a single parsimonious, sparsely connected neural circuit model can recapitulate several separate experimental findings that indicated diverse, heterogeneous, distributed, and mixed DRNVTA neuronal signaling in reward and punishment tasks. The inability of this model to recapitulate all observed neuronal signaling suggests potentially multiple circuits acting in parallel. Then using computational simulations and dynamical systems analysis, we demonstrate that several different stable circuit architectures can produce the same observed network activity profile, hence demonstrating degeneracy. Due to the extensive D2-mediated connections in the investigated circuits, we simulate the D2 receptor agonist by increasing the connection strengths emanating from the VTA DA neurons. We found that the simulated D2 agonist can distinguish among sub-groups of the degenerate neural circuits based on substantial deviations in specific neural populations' activities in reward and punishment conditions. This forms a testable model prediction using pharmacological means. Overall, this theoretical work suggests the plausibility of degeneracy within neuromodulator circuitry and has important implications for the stable and robust maintenance of neuromodulatory functions.

Differential Serotonergic Modulation of Synaptic Inputs to the Olfactory Cortex

Serotonin (5-hydroxytriptamine, 5-HT) is an important monoaminergic neuromodulator involved in a variety of physiological and pathological functions. It has been implicated in the regulation of sensory functions at various stages of multiple modalities, but its mechanisms and functions in the olfactory system have remained elusive. Combining electrophysiology, optogenetics and pharmacology, here we show that afferent (feed-forward) pathway-evoked synaptic responses are boosted, whereas feedback responses are suppressed by presynaptic 5-HT_1B receptors in the anterior piriform cortex (aPC) in vitro. Blocking 5-HT_1B receptors also reduces the suppressive effects of serotonergic photostimulation of baseline firing in vivo. We suggest that by regulating the relative weights of synaptic inputs to aPC, 5-HT finely tunes sensory inputs in the olfactory cortex.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

By means of an expansive innervation, the serotonin (5-HT) neurons of the dorsal raphe nucleus (DRN) are positioned to enact coordinated modulation of circuits distributed across the entire brain in order to adaptively regulate behavior. Yet the network computations that emerge from the excitability and connectivity features of the DRN are still poorly understood. To gain insight into these computations, we began by carrying out a detailed electrophysiological characterization of genetically identified mouse 5-HT and somatostatin (SOM) neurons. We next developed a single-neuron modeling framework that combines the realism of Hodgkin-Huxley models with the simplicity and predictive power of generalized integrate-and-fire models. We found that feedforward inhibition of 5-HT neurons by heterogeneous SOM neurons implemented divisive inhibition, while endocannabinoid-mediated modulation of excitatory drive to the DRN increased the gain of 5-HT output. Our most striking finding was that the output of the DRN encodes a mixture of the intensity and temporal derivative of its input, and that the temporal derivative component dominates this mixture precisely when the input is increasing rapidly. This network computation primarily emerged from prominent adaptation mechanisms found in 5-HT neurons, including a previously undescribed dynamic threshold. By applying a bottom-up neural network modeling approach, our results suggest that the DRN is particularly apt to encode input changes over short timescales, reflecting one of the salient emerging computations that dominate its output to regulate behavior.

Constitutive depletion of brain serotonin differentially affects rats' social and cognitive abilities

Central serotonin appears a promising transdiagnostic marker of psychiatric disorders and a modulator of some of their key behavioral symptoms. In adult male Tph2 ^-/- rats, constitutively lacking central serotonin, we tested individual's cognitive, social and non-social abilities and characterized group's social organization under classical and ethological testing conditions. Using unsupervised machine learning, we identified the functions most dependent on serotonin. Although serotonin depletion did not affect cognitive performances in classical testing, in the home-cage it induced compulsive aggression and sexual behavior, hyperactive and hypervigilant stereotyped behavior, reduced self-care and exacerbated corticosterone levels. This profile recalled symptoms of impulse control and anxiety disorders. Serotonin appeared essential for behavioral adaptation to dynamic social environments. Our animal model challenges the essential role of serotonin in decision-making, flexibility, impulsivity, and risk-taking. These findings highlight the importance of studying everyday life functions within the dynamic social living environment to model complexity in animal models.

Next generation genetically encoded fluorescent sensors for serotonin

We developed a family of genetically encoded serotonin (5-HT) sensors (sDarken) on the basis of the native 5-HT1A receptor and circularly permuted GFP. sDarken 5-HT sensors are bright in the unbound state and diminish their fluorescence upon binding of 5-HT. Sensor variants with different affinities for serotonin were engineered to increase the versatility in imaging of serotonin dynamics. Experiments in vitro and in vivo showed the feasibility of imaging serotonin dynamics with high temporal and spatial resolution. As demonstrated here, the designed sensors show excellent membrane expression, have high specificity and a superior signal-to-noise ratio, detect the endogenous release of serotonin and are suitable for two-photon in vivo imaging.

Atypical action updating in a dynamic environment associated with adolescent obsessive-compulsive disorder

BACKGROUND

Computational research had determined that adults with obsessive-compulsive disorder (OCD) display heightened action updating in response to noise in the environment and neglect metacognitive information (such as confidence) when making decisions. These features are proposed to underlie patients' compulsions despite the knowledge they are irrational. Nonetheless, it is unclear whether this extends to adolescents with OCD as research in this population is lacking. Thus, this study aimed to investigate the interplay between action and confidence in adolescents with OCD.

METHODS

Twenty-seven adolescents with OCD and 46 controls completed a predictive-inference task, designed to probe how subjects' actions and confidence ratings fluctuate in response to unexpected outcomes. We investigated how subjects update actions in response to prediction errors (indexing mismatches between expectations and outcomes) and used parameters from a Bayesian model to predict how confidence and action evolve over time. Confidence-action association strength was assessed using a regression model. We also investigated the effects of serotonergic medication.

RESULTS

Adolescents with OCD showed significantly increased learning rates, particularly following small prediction errors. Results were driven primarily by unmedicated patients. Confidence ratings appeared equivalent between groups, although model-based analysis revealed that patients' confidence was less affected by prediction errors compared to controls. Patients and controls did not differ in the extent to which they updated actions and confidence in tandem.

CONCLUSIONS

Adolescents with OCD showed enhanced action adjustments, especially in the face of small prediction errors, consistent with previous research establishing 'just-right' compulsions, enhanced error-related negativity, and greater decision uncertainty in paediatric-OCD. These tendencies were ameliorated in patients receiving serotonergic medication, emphasising the importance of early intervention in preventing disorder-related cognitive deficits. Confidence ratings were equivalent between young patients and controls, mirroring findings in adult OCD research.

Regulation of social hierarchy learning by serotonin transporter availability

Learning one's status in a group is a fundamental process in building social hierarchies. Although animal studies suggest that serotonin (5-HT) signaling modulates learning social hierarchies, direct evidence in humans is lacking. Here we determined the relationship between serotonin transporter (SERT) availability and brain systems engaged in learning social ranks combining computational approaches with simultaneous PET-fMRI acquisition in healthy males. We also investigated the link between SERT availability and brain activity in a non-social control condition involving learning the payoffs of slot machines. Learning social ranks was modulated by the dorsal raphe nucleus (DRN) 5-HT function. BOLD ventral striatal response, tracking the rank of opponents, decreased with DRN SERT levels. Moreover, this link was specific to the social learning task. These findings demonstrate that 5-HT plays an influence on the computations required to learn social ranks.

Effect of lysergic acid diethylamide (LSD) on reinforcement learning in humans

BACKGROUND

The non-selective serotonin 2A (5-HT2A) receptor agonist lysergic acid diethylamide (LSD) holds promise as a treatment for some psychiatric disorders. Psychedelic drugs such as LSD have been suggested to have therapeutic actions through their effects on learning. The behavioural effects of LSD in humans, however, remain incompletely understood. Here we examined how LSD affects probabilistic reversal learning (PRL) in healthy humans.

METHODS

Healthy volunteers received intravenous LSD (75 μg in 10 mL saline) or placebo (10 mL saline) in a within-subjects design and completed a PRL task. Participants had to learn through trial and error which of three stimuli was rewarded most of the time, and these contingencies switched in a reversal phase. Computational models of reinforcement learning (RL) were fitted to the behavioural data to assess how LSD affected the updating ('learning rates') and deployment of value representations ('reinforcement sensitivity') during choice, as well as 'stimulus stickiness' (choice repetition irrespective of reinforcement history).

RESULTS

Raw data measures assessing sensitivity to immediate feedback ('win-stay' and 'lose-shift' probabilities) were unaffected, whereas LSD increased the impact of the strength of initial learning on perseveration. Computational modelling revealed that the most pronounced effect of LSD was the enhancement of the reward learning rate. The punishment learning rate was also elevated. Stimulus stickiness was decreased by LSD, reflecting heightened exploration. Reinforcement sensitivity differed by phase.

CONCLUSIONS

Increased RL rates suggest LSD induced a state of heightened plasticity. These results indicate a potential mechanism through which revision of maladaptive associations could occur in the clinical application of LSD.

Brain serotonergic fibers suggest anomalous diffusion-based dropout in artificial neural networks

Random dropout has become a standard regularization technique in artificial neural networks (ANNs), but it is currently unknown whether an analogous mechanism exists in biological neural networks (BioNNs). If it does, its structure is likely to be optimized by hundreds of millions of years of evolution, which may suggest novel dropout strategies in large-scale ANNs. We propose that the brain serotonergic fibers (axons) meet some of the expected criteria because of their ubiquitous presence, stochastic structure, and ability to grow throughout the individual's lifespan. Since the trajectories of serotonergic fibers can be modeled as paths of anomalous diffusion processes, in this proof-of-concept study we investigated a dropout algorithm based on the superdiffusive fractional Brownian motion (FBM). The results demonstrate that serotonergic fibers can potentially implement a dropout-like mechanism in brain tissue, supporting neuroplasticity. They also suggest that mathematical theories of the structure and dynamics of serotonergic fibers can contribute to the design of dropout algorithms in ANNs.

Neural Mechanisms and Psychology of Psychedelic Ego Dissolution

Neuroimaging studies of psychedelics have advanced our understanding of hierarchical brain organization and the mechanisms underlying their subjective and therapeutic effects. The primary mechanism of action of classic psychedelics is binding to serotonergic 5-HT2A receptors. Agonist activity at these receptors leads to neuromodulatory changes in synaptic efficacy that can have a profound effect on hierarchical message-passing in the brain. Here, we review the cognitive and neuroimaging evidence for the effects of psychedelics: in particular, their influence on selfhood and subject-object boundaries-known as ego dissolution-surmised to underwrite their subjective and therapeutic effects. Agonism of 5-HT2A receptors, located at the apex of the cortical hierarchy, may have a particularly powerful effect on sentience and consciousness. These effects can endure well after the pharmacological half-life, suggesting that psychedelics may have effects on neural plasticity that may play a role in their therapeutic efficacy. Psychologically, this may be accompanied by a disarming of ego resistance that increases the repertoire of perceptual hypotheses and affords alternate pathways for thought and behavior, including those that undergird selfhood. We consider the interaction between serotonergic neuromodulation and sentience through the lens of hierarchical predictive coding, which speaks to the value of psychedelics in understanding how we make sense of the world and specific predictions about effective connectivity in cortical hierarchies that can be tested using functional neuroimaging. SIGNIFICANCE STATEMENT: Classic psychedelics bind to serotonergic 5-HT2A receptors. Their agonist activity at these receptors leads to neuromodulatory changes in synaptic efficacy, resulting in a profound effect on information processing in the brain. Here, we synthesize an abundance of brain imaging research with pharmacological and psychological interpretations informed by the framework of predictive coding. Moreover, predictive coding is suggested to offer more sophisticated interpretations of neuroimaging findings by bridging the role between the 5-HT2A receptors and large-scale brain networks.

Learning of probabilistic punishment as a model of anxiety produces changes in action but not punisher encoding in the dmPFC and VTA

Previously, we developed a novel model for anxiety during motivated behavior by training rats to perform a task where actions executed to obtain a reward were probabilistically punished and observed that after learning, neuronal activity in the ventral tegmental area (VTA) and dorsomedial prefrontal cortex (dmPFC) represent the relationship between action and punishment risk (Park and Moghaddam, 2017). Here, we used male and female rats to expand on the previous work by focusing on neural changes in the dmPFC and VTA that were associated with the learning of probabilistic punishment, and anxiolytic treatment with diazepam after learning. We find that adaptive neural responses of dmPFC and VTA during the learning of anxiogenic contingencies are independent from the punisher experience and occur primarily during the peri-action and reward period. Our results also identify peri-action ramping of VTA neural calcium activity, and VTA-dmPFC correlated activity, as potential markers for the anxiolytic properties of diazepam.

Understanding the effects of serotonin in the brain through its role in the gastrointestinal tract

The neuromodulatory arousal system imbues the nervous system with the flexibility and robustness required to facilitate adaptive behaviour. While there are well-understood mechanisms linking dopamine, noradrenaline and acetylcholine to distinct behavioural states, similar conclusions have not been as readily available for serotonin. Fascinatingly, despite clear links between serotonergic function and cognitive capacities as diverse as reward processing, exploration, and the psychedelic experience, over 95% of the serotonin in the body is released in the gastrointestinal tract, where it controls digestive muscle contractions (peristalsis). Here, we argue that framing neural serotonin as a rostral extension of the gastrointestinal serotonergic system dissolves much of the mystery associated with the central serotonergic system. Specifically, we outline that central serotonin activity mimics the effects of a digestion/satiety circuit mediated by hypothalamic control over descending serotonergic nuclei in the brainstem. We review commonalities and differences between these two circuits, with a focus on the heterogeneous expression of different classes of serotonin receptors in the brain. Much in the way that serotonin-induced peristalsis facilitates the work of digestion, serotonergic influences over cognition can be reframed as performing the work of cognition. Extending this analogy, we argue that the central serotonergic system allows the brain to arbitrate between different cognitive modes as a function of serotonergic tone: low activity facilitates cognitive automaticity, whereas higher activity helps to identify flexible solutions to problems, particularly if and when the initial responses fail. This perspective sheds light on otherwise disparate capacities mediated by serotonin, and also helps to understand why there are such pervasive links between serotonergic pathology and the symptoms of psychiatric disorders.

Action suppression reveals opponent parallel control via striatal circuits

The direct and indirect pathways of the basal ganglia are classically thought to promote and suppress action, respectively¹. However, the observed co-activation of striatal direct and indirect medium spiny neurons² (dMSNs and iMSNs, respectively) has challenged this view. Here we study these circuits in mice performing an interval categorization task that requires a series of self-initiated and cued actions and, critically, a sustained period of dynamic action suppression. Although movement produced the co-activation of iMSNs and dMSNs in the sensorimotor, dorsolateral striatum (DLS), fibre photometry and photo-identified electrophysiological recordings revealed signatures of functional opponency between the two pathways during action suppression. Notably, optogenetic inhibition showed that DLS circuits were largely engaged to suppress-and not promote-action. Specifically, iMSNs on a given hemisphere were dynamically engaged to suppress tempting contralateral action. To understand how such regionally specific circuit function arose, we constructed a computational reinforcement learning model that reproduced key features of behaviour, neural activity and optogenetic inhibition. The model predicted that parallel striatal circuits outside the DLS learned the action-promoting functions, generating the temptation to act. Consistent with this, optogenetic inhibition experiments revealed that dMSNs in the associative, dorsomedial striatum, in contrast to those in the DLS, promote contralateral actions. These data highlight how opponent interactions between multiple circuit- and region-specific basal ganglia processes can lead to behavioural control, and establish a critical role for the sensorimotor indirect pathway in the proactive suppression of tempting actions.

Plasticity in mental health: A network theory

Plasticity is the ability to modify brain and behavior, ultimately promoting an amplification of the impact of the context on the individual's mental health. Thus, plasticity is not beneficial per se but its value depends on contextual factors, such as the quality of the living environment. High plasticity is beneficial in a favorable environment, but can be detrimental in adverse conditions, while the opposite applies to low plasticity. Resilience and vulnerability are not univocally associated to high or low plasticity. Consequently, individuals should undergo different preventive and therapeutic strategies according to their plasticity levels and living conditions. Here, an operationalization of plasticity relying on network theory is proposed: the strength of the connection among the network elements defining the individual, such as its symptoms, is a measure of plasticity. This theoretical framework represents a promising tool to investigate research questions related to changes in neural structure and activity and in behavior, and to improve therapeutic strategies for psychiatric disorders, such as major depression.

Norepinephrine potentiates and serotonin depresses visual cortical responses by transforming eligibility traces

Reinforcement allows organisms to learn which stimuli predict subsequent biological relevance. Hebbian mechanisms of synaptic plasticity are insufficient to account for reinforced learning because neuromodulators signaling biological relevance are delayed with respect to the neural activity associated with the stimulus. A theoretical solution is the concept of eligibility traces (eTraces), silent synaptic processes elicited by activity which upon arrival of a neuromodulator are converted into a lasting change in synaptic strength. Previously we demonstrated in visual cortical slices the Hebbian induction of eTraces and their conversion into LTP and LTD by the retroactive action of norepinephrine and serotonin Here we show in vivo in mouse V1 that the induction of eTraces and their conversion to LTP/D by norepinephrine and serotonin respectively potentiates and depresses visual responses. We also show that the integrity of this process is crucial for ocular dominance plasticity, a canonical model of experience-dependent plasticity.

Spatiotemporal dynamics of noradrenaline during learned behaviour

Noradrenaline released from the locus coeruleus (LC) is a ubiquitous neuromodulator^1-4 that has been linked to multiple functions including arousal^5-8, action and sensory gain^9-11, and learning^12-16. Whether and how activation of noradrenaline-expressing neurons in the LC (LC-NA) facilitates different components of specific behaviours is unknown. Here we show that LC-NA activity displays distinct spatiotemporal dynamics to enable two functions during learned behaviour: facilitating task execution and encoding reinforcement to improve performance accuracy. To examine these functions, we used a behavioural task in mice with graded auditory stimulus detection and task performance. Optogenetic inactivation of the LC demonstrated that LC-NA activity was causal for both task execution and optimization. Targeted recordings of LC-NA neurons using photo-tagging, two-photon micro-endoscopy and two-photon output monitoring showed that transient LC-NA activation preceded behavioural execution and followed reinforcement. These two components of phasic activity were heterogeneously represented in LC-NA cortical outputs, such that the behavioural response signal was higher in the motor cortex and facilitated task execution, whereas the negative reinforcement signal was widely distributed among cortical regions and improved response sensitivity on the subsequent trial. Modular targeting of LC outputs thus enables diverse functions, whereby some noradrenaline signals are segregated among targets, whereas others are broadly distributed.

Social Relationship as a Factor for the Development of Stress Incubation in Adult Mice

While stress reactions can emerge long after the triggering event, it remains elusive how they emerge after a protracted, seemingly stress-free period during which stress incubates. Here, we study the behavioral development in mice isolated after observing an aggressive encounter inflicted upon their pair-housed partners. We developed a spatially resolved fine-scale behavioral analysis and applied it to standard behavioral tests. It reveals that the seemingly sudden behavioral changes developed gradually. These behavioral changes were not observed if the aggressive encounter happened to a stranger mouse, suggesting that social bonding is a prerequisite for stress incubation in this paradigm. This finding was corroborated by hemisphere-specific morphological changes in cortex regions centering at the anterior cingulate cortex, a cognitive and emotional center. Our non-invasive analytical methods to capture informative behavioral details may have applications beyond laboratory animals.

Dopamine and serotonin interplay for valence-based spatial learning

Dopamine (DA) and serotonin (5-HT) are important neuromodulators of synaptic plasticity that have been linked to learning from positive or negative outcomes or valence-based learning. In the hippocampus, both affect long-term plasticity but play different roles in encoding uncertainty or predicted reward. DA has been related to positive valence, from reward consumption or avoidance behavior, and 5-HT to aversive encoding. We propose DA produces overall LTP while 5-HT elicits LTD. Here, we compare two reward-modulated spike timing-dependent plasticity (R-STDP) rules to describe the action of these neuromodulators. We examined their role in cognitive performance and flexibility for computational models of the Morris water maze task and reversal learning. Our results show that the interplay of DA and 5-HT improves learning performance and can explain experimental evidence. This study reinforces the importance of neuromodulation in determining the direction of plasticity.

Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making

Nervous systems evolved to effectively navigate the dynamics of the environment to achieve their goals. One framework used to study this fundamental problem arose in the study of learning and decision-making. In this framework, the demands of effective behavior require slow dynamics-on the scale of seconds to minutes-of networks of neurons. Here, we review the phenomena and mechanisms involved. Using vignettes from a few species and areas of the nervous system, we view neuromodulators as key substrates for temporal scaling of neuronal dynamics. Expected final online publication date for the Annual Review of Neuroscience, Volume 45 is July 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

A neurobiological perspective on social influence: Serotonin and social adaptation

Humans are inherently social beings. Being suggestible to each other's expectations enables pro-social skills that are crucial for social learning and adaptation. Despite its high relevance for psychiatry, the neurobiological mechanisms underlying social adaptation are still not well understood. This review therefore provides a conceptual framework covering various distinct mechanisms underlying social adaptation and explores the neuropharmacology - in particular the role of the serotonin (5-HT) system - modulating these mechanisms. This article therefore reviews empirical results on social influence processing and reconciles them with recent findings from psychedelic research on social processing to elucidate neurobiological and neuropharmacological underpinnings of social adaptation. Various computational, neurobiological, and neurochemical processes are involved in distinct mechanisms underlying social adaptation such as the multisensory process of social information integration that is crucial for the forming of self-representation and representations of social norms. This is again associated with self- and other-perception during social interactions as well as value-based decision making that guides our behaviour in daily interactions. We highlight the critical role of 5-HT in these processes and suggest that 5-HT can facilitate social learning and may represent an important target for treating psychiatric disorders characterized by impairments in social functioning. This framework also has important implications for psychedelic-assisted therapy as well as for the development of novel treatment approaches and future research directions.

Serotonin neurons modulate learning rate through uncertainty

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates ("meta-learning"). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Neuromodulation of prefrontal cortex cognitive function in primates: the powerful roles of monoamines and acetylcholine

The primate prefrontal cortex (PFC) subserves our highest order cognitive operations, and yet is tremendously dependent on a precise neurochemical environment for proper functioning. Depletion of noradrenaline and dopamine, or of acetylcholine from the dorsolateral PFC (dlPFC), is as devastating as removing the cortex itself, and serotonergic influences are also critical to proper functioning of the orbital and medial PFC. Most neuromodulators have a narrow inverted U dose response, which coordinates arousal state with cognitive state, and contributes to cognitive deficits with fatigue or uncontrollable stress. Studies in monkeys have revealed the molecular signaling mechanisms that govern the generation and modulation of mental representations by the dlPFC, allowing dynamic regulation of network strength, a process that requires tight regulation to prevent toxic actions, e.g., as occurs with advanced age. Brain imaging studies in humans have observed drug and genotype influences on a range of cognitive tasks and on PFC circuit functional connectivity, e.g., showing that catecholamines stabilize representations in a baseline-dependent manner. Research in monkeys has already led to new treatments for cognitive disorders in humans, encouraging future research in this important field.

5-HT2C receptor perturbation has bidirectional influence over instrumental vigour and restraint

The serotonin (5-HT) system, particularly the 5-HT2C receptor, has consistently been implicated in behavioural control. However, while some studies have focused on the role 5-HT2C receptors play in regulating motivation to work for reward, others have highlighted its importance in response restraint. To date, it is unclear how 5-HT transmission at this receptor regulates the balance of response invigoration and restraint in anticipation of future reward. In addition, it remains to be established how 5-HT2C receptors gate the influence of internal versus cue-driven processes over reward-guided actions. To elucidate these issues, we investigated the effects of administering the 5-HT2C receptor antagonist SB242084, both systemically and directly into the nucleus accumbens core (NAcC), in rats performing a Go/No-Go task for small or large rewards. The results were compared to the administration of d-amphetamine into the NAcC, which has previously been shown to promote behavioural activation. Systemic perturbation of 5-HT2C receptors-but crucially not intra-NAcC infusions-consistently boosted rats' performance and instrumental vigour on Go trials when they were required to act. Concomitantly, systemic administration also reduced their ability to withhold responding for rewards on No-Go trials, particularly late in the holding period. Notably, these effects were often apparent only when the reward on offer was small. By contrast, inducing a hyperdopaminergic state in the NAcC with d-amphetamine strongly impaired response restraint on No-Go trials both early and late in the holding period, as well as speeding action initiation. Together, these findings suggest that 5-HT2C receptor transmission, outside the NAcC, shapes the vigour of ongoing goal-directed action as well as the likelihood of responding as a function of expected reward.

Dorsal Raphe 5-HT Neurons Utilize, But Do Not Generate, Negative Aversive Prediction Errors

The dorsal raphe nucleus (DRN) contains the largest population of serotonin (5-HT) neurons in the central nervous system. 5-HT, synthesized via tryptophan hydroxylase 2 (Tph2), is a widely functioning neuromodulator implicated in fear learning. Here, we sought to investigate whether DRN 5-HT is necessary to reduce fear via negative prediction error (–PE). Using male and female TPH2-cre rats, DRN^tph2+ cells were selectively deleted via cre-caspase (rAAV5-Flex-taCasp3-TEVp) in experiment 1. Rats then underwent fear discrimination during which three cues were associated with unique foot shock probabilities: safety p = 0.00, uncertainty p = 0.375, and danger p = 1.00. Rats then received selective extinction to the uncertainty cue, a behavioral manipulation designed to probe –PE. Deleting DRN^tph2+ cells had no impact on initial discrimination but slowed selective extinction. In experiment 2, we used a within-subjects optogenetic inhibition design to causally implicate DRN^tph2+ cells in prediction error signaling. Male and female TPH2-cre rats received intra-DRN infusions of cre-dependent halorhodopsin (rAAV5-Ef1a-DIO-eNpHR3.0-eYFP) or cre-YFP. DRN^tph2+ cells were inhibited specifically during the time of prediction error or a control period. Illumination during either positive prediction error (+PE) or control periods had no impact on fear to the uncertainty cue. Inhibition of DRN^tph2+ cells at the time of –PE did not impact immediate fear, but facilitated selective extinction in postillumination sessions. Together, these results demonstrate a role for DRN^tph2+ cells in using, but not generating, –PE to weaken cue-shock associations.