Activation of Dorsal Raphe Serotonergic Neurons Promotes Waiting but Is Not Reinforcing

Nonlinear recurrent inhibition through facilitating serotonin release in the raphe

Serotonin (5-HT) neurons in the dorsal raphe nucleus (DRN) receive a constellation of long-range inputs, yet guiding principles of local circuit organization and underlying computations in this nucleus are largely unknown. Using inputs from the lateral habenula to interrogate the processing features of the mouse DRN, we uncovered 5-HT1A receptor-mediated recurrent connections between 5-HT neurons, refuting classical theories of autoinhibition. Cellular electrophysiology and imaging of a genetically encoded 5-HT sensor revealed that these recurrent inhibitory connections spanned the raphe, were slow, stochastic, strongly facilitating and gated spike output. These features collectively conveyed highly nonlinear dynamics to this network, generating excitation-driven inhibition and winner-take-all computations. In vivo optogenetic activation of lateral habenula inputs to DRN, at frequencies where these computations are predicted to ignite, transiently disrupted expression of a reward-conditioned response in an auditory conditioning task. Together, these data identify a core computation supported by an unsuspected slow serotonergic recurrent inhibitory network.

Role of serotonin neurons in the dorsal raphe nucleus in heroin self-administration and punishment

One hallmark of substance use disorder is continued drug use despite negative consequences. When drug-taking behavior is punished with aversive stimuli, i.e. footshock, rats can also be categorized into punishment-resistant or compulsive vs. punishment-sensitive or non-compulsive phenotypes. The serotonin (5-hydroxytryptamine, 5-HT) system modulates responses to both reward and punishment. The goal of the current study was to examine punishment phenotypes in heroin self-administration and to determine the role of dorsal raphe nucleus (DRN) 5-HT neurons in both basal and punished heroin self-administration. First, rats were exposed to punished heroin self-administration and neuronal excitability of DRN 5-HT neurons was compared between punishment-resistant and punishment-sensitive phenotypes using ex vivo electrophysiology. Second, DRN 5-HT neuronal activity was manipulated in vivo during basal and punished heroin self-administration using chemogenetic tools in a Tph2-iCre rat line. While rats separated into punishment-resistant and punishment-sensitive phenotypes for punished heroin self-administration, DRN 5-HT neuronal excitability did not differ between the phenotypes. While chemogenetic inhibition of DRN 5-HT neurons was without effect, chemogenetic activation of DRN 5-HT neurons increased both basal and punished heroin self-administration selectively in punishment-resistant animals. Additionally, the responsiveness to chemogenetic activation of DRN 5-HT neurons in basal self-administration and motivation for heroin in progressive ratio each predicted resistance to punishment. Therefore, our data support the role for the DRN 5-HT system in compulsive heroin self-administration.

Phase synchrony between prefrontal noradrenergic and cholinergic signals indexes inhibitory control

Inhibitory control is a critical executive function that allows animals to suppress their impulsive behavior in order to achieve certain goals or avoid punishment. We investigated norepinephrine (NE) and acetylcholine (ACh) dynamics and population neuronal activity in the prefrontal cortex (PFC) during inhibitory control. Using fluorescent sensors to measure extracellular levels of NE and ACh, we simultaneously recorded prefrontal NE and ACh dynamics in mice performing inhibitory control tasks. The prefrontal NE and ACh signals exhibited strong coherence at 0.4-0.8 Hz. Although inhibition of locus coeruleus (LC) neurons projecting to the PFC impaired inhibitory control, inhibiting LC neurons projecting to the basal forebrain (BF) caused a more profound impairment, despite an approximately 30% overlap between LC neurons projecting to the PFC and BF, as revealed by our tracing studies. The inhibition of LC neurons projecting to the BF did not diminish the difference in prefrontal NE/ACh signals between successful and failed trials; instead, it abolished the difference in NE-ACh phase synchrony between successful and failed trials, indicating that NE-ACh phase synchrony is a task-relevant neuromodulatory feature. Chemogenetic inhibition of cholinergic neurons that project to the LC region did not impair inhibitory control, nor did it abolish the difference in NE-ACh phase synchrony between successful or failed trials, further confirming the relevance of NE-ACh phase synchrony to inhibitory control. To understand the possible effect of NE-ACh synchrony on prefrontal population activity, we employed Neuropixels to record from the PFC during inhibitory control. The inhibition of LC neurons projecting to the BF not only reduced the number of prefrontal neurons encoding inhibitory control, but also disrupted population firing patterns representing inhibitory control, as revealed by a demixed principal component (dPCA) analysis. Taken together, these findings suggest that the LC modulates inhibitory control through its collective effect with cholinergic systems on population activity in the prefrontal cortex. Our results further indicate that NE-ACh phase synchrony is a critical neuromodulatory feature with important implications for cognitive control.

Computational and Neural Evidence for Altered Fast and Slow Learning from Losses in Problem Gambling

Learning occurs across multiple timescales, with fast learning crucial for adapting to sudden environmental changes, and slow learning beneficial for extracting robust knowledge from multiple events. Here, we asked if miscalibrated fast vs slow learning can lead to maladaptive decision-making in individuals with problem gambling. We recruited participants with problem gambling (PG; N = 20; 9 female and 11 male) and a recreational gambling control group without any symptoms associated with PG (N = 20; 10 female and 10 male) from the community in Los Angeles, CA. Participants performed a decision-making task involving reward-learning and loss-avoidance while being scanned with fMRI. Using computational model fitting, we found that individuals in the PG group showed evidence for an excessive dependence on slow timescales and a reduced reliance on fast timescales during learning. fMRI data implicated the putamen, an area associated with habit, and medial prefrontal cortex (PFC) in slow loss-value encoding, with significantly more robust encoding in medial PFC in the PG group compared to controls. The PG group also exhibited stronger loss prediction error encoding in the insular cortex. These findings suggest that individuals with PG have an impaired ability to adjust their predictions following losses, manifested by a stronger influence of slow value learning. This impairment could contribute to the behavioral inflexibility of problem gamblers, particularly the persistence in gambling behavior typically observed in those individuals after incurring loss outcomes.

Effects of chronic stress on cognitive function - From neurobiology to intervention

Exposure to chronic stress contributes considerably to the development of cognitive impairments in psychiatric disorders such as depression, generalized anxiety disorder (GAD), obsessive-compulsive disorder (OCD), post-traumatic stress disorder (PTSD), and addictive behavior. Unfortunately, unlike mood-related symptoms, cognitive impairments are not effectively treated by available therapies, a situation in part resulting from a still incomplete knowledge of the neurobiological substrates that underly cognitive domains and the difficulty in generating interventions that are both efficacious and safe. In this review, we will present an overview of the cognitive domains affected by stress with a specific focus on cognitive flexibility, behavioral inhibition, and working memory. We will then consider the effects of stress on neuronal correlates of cognitive function and the factors which may modulate the interaction of stress and cognition. Finally, we will discuss intervention strategies for treatment of stress-related disorders and gaps in knowledge with emerging new treatments under development. Understanding how cognitive impairment occurs during exposure to chronic stress is crucial to make progress towards the development of new and effective therapeutic approaches.

The differential effect of optogenetic serotonergic manipulation on sustained motor actions and waiting for future rewards in mice

Serotonin is an essential neuromodulator that affects behavioral and cognitive functions. Previous studies have shown that activation of serotonergic neurons in the dorsal raphe nucleus (DRN) promotes patience to wait for future rewards. However, it is still unclear whether serotonergic neurons also regulate persistence to act for future rewards. Here we used optogenetic activation and inhibition of DRN serotonergic neurons to examine their effects on sustained motor actions for future rewards. We trained mice to perform waiting and repeated lever-pressing tasks with variable reward delays and tested effects of optogenetic activation and inhibition of DRN serotonergic neurons on task performance. Interestingly, in the lever-pressing task, mice tolerated longer delays as they repeatedly pressed a lever than in the waiting task, suggesting that lever-pressing actions may not simply be costly, but may also be subjectively rewarding. Optogenetic activation of DRN serotonergic neurons prolonged waiting duration in the waiting task, consistent with previous studies. However, its effect on lever presses was nuanced, and was detected only by focusing on the period before premature reward check and by subtracting the trends within and across sessions using generalized linear model. While optogenetic inhibition decreased waiting, it did not affect lever pressing time or numbers. These results revealed that the necessity of motor actions may increase motivation for delayed rewards and that DRN serotonergic neurons more significantly promote waiting rather than persistent motor actions for future rewards.

Competitive integration of time and reward explains value-sensitive foraging decisions and frontal cortex ramping dynamics

Patch foraging presents a ubiquitous decision-making process in which animals decide when to abandon a resource patch of diminishing value to pursue an alternative. We developed a virtual foraging task in which mouse behavior varied systematically with patch value. Mouse behavior could be explained by a model integrating time and rewards antagonistically, scaled by a latent patience state. The model accounted for deviations from predictions of optimal foraging theory. Neural recordings throughout frontal areas revealed encoding of decision variables from the integrator model, most robustly in frontal cortex. Regression modeling followed by unsupervised clustering identified a subset of ramping neurons. These neurons' firing rates ramped up gradually (up to tens of seconds), were inhibited by rewards, and were better described as a continuous ramp than a discrete stepping process. Together, these results identify integration via frontal cortex ramping dynamics as a candidate mechanism for solving patch foraging problems.

Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when confronting reward uncertainty. However, it has been unclear whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider these attributes to make a choice. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes, and this population tended to integrate the attributes in a manner that reflected monkeys' preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how the DRN participates in value computations, guiding theories about the role of the DRN in decision-making and psychiatric disease.

Optogenetic activation of dorsal raphe serotonin neurons induces brain-wide activation

Serotonin is a neuromodulator that affects multiple behavioral and cognitive functions. Nonetheless, how serotonin causes such a variety of effects via brain-wide projections and various receptors remains unclear. Here we measured brain-wide responses to optogenetic stimulation of serotonin neurons in the dorsal raphe nucleus (DRN) of the male mouse brain using functional MRI with an 11.7 T scanner and a cryoprobe. Transient activation of DRN serotonin neurons caused brain-wide activation, including the medial prefrontal cortex, the striatum, and the ventral tegmental area. The same stimulation under anesthesia with isoflurane decreased brain-wide activation, including the hippocampal complex. These brain-wide response patterns can be explained by DRN serotonergic projection topography and serotonin receptor expression profiles, with enhanced weights on 5-HT1 receptors. Together, these results provide insight into the DR serotonergic system, which is consistent with recent discoveries of its functions in adaptive behaviors.

Methylphenidate, but not citalopram, decreases impulsive choice in rats performing a temporal discounting task

Introduction

Drugs targeting monoamine systems remain the most common treatment for disorders with impulse control impairments. There is a body of literature suggesting that drugs affecting serotonin reuptake and dopamine reuptake can modulate distinct aspects of impulsivity - though such tests are often performed using distinct behavioral tasks prohibiting easy comparisons.

Methods

Here, we directly compare pharmacologic agents that affect dopamine (methylphenidate) vs serotonin (citalopram) manipulations on choice impulsivity in a temporal discounting task where rats could choose between a small, immediate reward or a large reward delayed at either 2 or 10s. In control conditions, rats preferred the large reward at a small (2s) delay and discounted the large reward at a long (10s) delay.

Results

Methylphenidate, a dopamine transport inhibitor that blocks reuptake of dopamine, dose-dependently increased large reward preference in the long delay (10s) block. Citalopram, a selective serotonin reuptake inhibitor, had no effect on temporal discounting behavior. Impulsive behavior on the temporal discounting task was at least partially mediated by the nucleus accumbens shell. Bilateral lesions to the nucleus accumbens shell reduced choice impulsivity during the long delay (10s) block. Following lesions, methylphenidate did not impact impulsivity.

Discussion

Our results suggest that striatal dopaminergic systems modulate choice impulsivity via actions within the nucleus accumbens shell, whereas serotonin systems may regulate different aspects of behavioral inhibition/impulsivity.

Aggression modulator: Understanding the multifaceted role of the dorsal raphe nucleus

Aggressive behavior is instinctively driven behavior that helps animals to survive and reproduce and is closely related to multiple behavioral and physiological processes. The dorsal raphe nucleus (DRN) is an evolutionarily conserved midbrain structure that regulates aggressive behavior by integrating diverse brain inputs. The DRN consists predominantly of serotonergic (5-HT:5-hydroxytryptamine) neurons and decreased 5-HT activity was classically thought to increase aggression. However, recent studies challenge this 5-HT deficiency model, revealing a more complex role for the DRN 5-HT system in aggression. Furthermore, emerging evidence has shown that non-5-HT populations in the DRN and specific neural circuits contribute to the escalation of aggressive behavior. This review argues that the DRN serves as a multifaceted modulator of aggression, acting not only via 5-HT but also via other neurotransmitters and neural pathways, as well as different subsets of 5-HT neurons. In addition, we discuss the contribution of DRN neurons in the behavioral and physiological aspects implicated in aggressive behavior, such as arousal, reward, and impulsivity, to further our understanding of DRN-mediated aggression modulation.

Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice

The ability to persist toward a desired objective is a fundamental aspect of behavioral control whose impairment is implicated in several behavioral disorders. One of the prominent features of behavioral persistence is that its maturation occurs relatively late in development. This is presumed to echo the developmental time course of a corresponding circuit within late-maturing parts of the brain, such as the prefrontal cortex, but the specific identity of the responsible circuits is unknown. Here, we used a genetic approach to describe the maturation of the projection from layer 5 neurons of the neocortex to the dorsal raphe nucleus in mice. Using optogenetic-assisted circuit mapping, we show that this projection undergoes a dramatic increase in synaptic potency between postnatal weeks 3 and 8, corresponding to the transition from juvenile to adult. We then show that this period corresponds to an increase in the behavioral persistence that mice exhibit in a foraging task. Finally, we used a genetic targeting strategy that primarily affected neurons in the medial prefrontal cortex, to selectively ablate this pathway in adulthood and show that mice revert to a behavioral phenotype similar to juveniles. These results suggest that frontal cortical to dorsal raphe input is a critical anatomical and functional substrate of the development and manifestation of behavioral persistence.

Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Active reinforcement learning enables dynamic prediction and control, where one should not only maximize rewards but also minimize costs such as of inference, decisions, actions, and time. For an embodied agent such as a human, decisions are also shaped by physical aspects of actions. Beyond the effects of reward outcomes on learning processes, to what extent can modeling of behavior in a reinforcement-learning task be complicated by other sources of variance in sequential action choices? What of the effects of action bias (for actions per se) and action hysteresis determined by the history of actions chosen previously? The present study addressed these questions with incremental assembly of models for the sequential choice data from a task with hierarchical structure for additional complexity in learning. With systematic comparison and falsification of computational models, human choices were tested for signatures of parallel modules representing not only an enhanced form of generalized reinforcement learning but also action bias and hysteresis. We found evidence for substantial differences in bias and hysteresis across participants-even comparable in magnitude to the individual differences in learning. Individuals who did not learn well revealed the greatest biases, but those who did learn accurately were also significantly biased. The direction of hysteresis varied among individuals as repetition or, more commonly, alternation biases persisting from multiple previous actions. Considering that these actions were button presses with trivial motor demands, the idiosyncratic forces biasing sequences of action choices were robust enough to suggest ubiquity across individuals and across tasks requiring various actions. In light of how bias and hysteresis function as a heuristic for efficient control that adapts to uncertainty or low motivation by minimizing the cost of effort, these phenomena broaden the consilient theory of a mixture of experts to encompass a mixture of expert and nonexpert controllers of behavior.

Apathy and Motivation: Biological Basis and Drug Treatment

Apathy is a disabling syndrome associated with poor functional outcomes that is common across a broad range of neurological and psychiatric conditions. Currently, there are no established therapies specifically for the condition, and safe and effective treatments are urgently needed. Advances in the understanding of motivation and goal-directed behavior in humans and animals have shed light on the cognitive and neurobiological mechanisms contributing to apathy, providing an important foundation for the development of new treatments. Here, we review the cognitive components, neural circuitry, and pharmacology of apathy and motivation, highlighting converging evidence of shared transdiagnostic mechanisms. Though no pharmacological treatments have yet been licensed, we summarize trials of existing and novel compounds to date, identifying several promising candidates for clinical use and avenues of future drug development.

Dynamic Foraging Behavior Performance Is Not Affected by Scn2a Haploinsufficiency

Dysfunction in the gene SCN2A, which encodes the voltage-gated sodium channel Nav1.2, is strongly associated with neurodevelopmental disorders including autism spectrum disorder and intellectual disability (ASD/ID). This dysfunction typically manifests in these disorders as a haploinsufficiency, where loss of one copy of a gene cannot be compensated for by the other allele. Scn2a haploinsufficiency affects a range of cells and circuits across the brain, including associative neocortical circuits that are important for cognitive flexibility and decision-making behaviors. Here, we tested whether Scn2a haploinsufficiency has any effect on a dynamic foraging task that engages such circuits. Scn2a +/- mice and wild-type (WT) littermates were trained on a choice behavior where the probability of reward between two options varied dynamically across trials and where the location of the high reward underwent uncued reversals. Despite impairments in Scn2a-related neuronal excitability, we found that both male and female Scn2a +/- mice performed these tasks as well as wild-type littermates, with no behavioral difference across genotypes in learning or performance parameters. Varying the number of trials between reversals or probabilities of receiving reward did not result in an observable behavioral difference, either. These data suggest that, despite heterozygous loss of Scn2a, mice can perform relatively complex foraging tasks that make use of higher-order neuronal circuits.

Serotonin neurons in mating female mice are activated by male ejaculation

Sexual stimulation triggers changes in female physiology and behavior, including sexual satiety and preparing the uterus for pregnancy. Serotonin (5-HT) is an important regulator of reproductive physiology and sexual receptivity, but the relationship between sexual stimulation and 5-HT neural activity in females is poorly understood. Here, we investigated dorsal raphe 5-HT neural activity in female mice during sexual behavior. We found that 5-HT neural activity in mating females peaked specifically upon male ejaculation and remained elevated above baseline until disengagement. Artificial intravaginal mechanical stimulation was sufficient to elicit increased 5-HT neural activity but the delivery of ejaculatory fluids was not. Distal penis expansion ("penile cupping") at ejaculation and forceful expulsion of ejaculatory fluid each provided sufficient mechanical stimulation to elicit 5-HT neuron activation. Our study identifies a female ejaculation-specific signal in a major neuromodulatory system and shows that intravaginal mechanosensory stimulation is necessary and sufficient to drive this signal.

Hypothalamic neuronal outputs transmit sensorimotor signals at the onset of locomotor initiation

The lateral hypothalamus (LH) plays a critical role in sensory integration to organize behavior responses. However, how projection-defined LH neuronal outputs dynamically transmit sensorimotor signals to major downstream targets to organize behavior is unknown. Here, using multi-fiber photometry, we show that three major LH neuronal outputs projecting to the dorsal raphe nucleus (DRN), ventral tegmental area (VTA), and lateral habenula (LHb) exhibit significant coherent activity in mice engaging sensory-evoked or self-initiated motor responses. Increased activity at LH axon terminals precedes movement initiation during active coping responses and the activity of serotonin neurons and dopamine neurons. The optogenetic activation of LH axon terminals in either of the DRN, VTA, or LHb was sufficient to increase motor initiation but had different effects on passive avoidance and sucrose consumption. Our findings support the complementary role of three projection-defined LH neuronal outputs in the transmission of sensorimotor signals to major downstream regions at movement onset.

Dorsal raphe neurons signal integrated value during multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.

Serotonin neurons in mating female mice are activated by male ejaculation

Sexual stimulation triggers changes in female physiology and behavior, including sexual satiety and preparing the uterus for pregnancy. Serotonin is an important regulator of reproductive physiology and sexual receptivity, but the relationship between sexual stimulation and serotonin neural activity in females is poorly understood. Here, we investigated dorsal raphe serotonin neural activity in females during sexual behavior. We found that serotonin neural activity in mating females peaked specifically upon male ejaculation, and remained elevated above baseline until disengagement. Artificial intravaginal mechanical stimulation was sufficient to elicit increased 5-HT neural activity but the delivery of ejaculatory fluids was not. Distal penis erectile enlargement ("penile cupping") at ejaculation and forceful expulsion of ejaculatory fluid each provided sufficient mechanical stimulation to elicit serotonin neuron activation. Our study identifies a female ejaculation-specific signal in a major neuromodulatory system and shows that intravaginal mechanosensory stimulation is necessary and sufficient to drive this signal.

Boosting Serotonin Increases Information Gathering by Reducing Subjective Cognitive Costs

Serotonin is implicated in the valuation of aversive costs, such as delay or physical effort. However, its role in governing sensitivity to cognitive effort, for example, deliberation costs during information gathering, is unclear. We show that treatment with a serotonergic antidepressant in healthy human individuals of either sex enhances a willingness to gather information when trying to maximize reward. Using computational modeling, we show this arises from a diminished sensitivity to subjective deliberation costs during the sampling process. This result is consistent with the notion that serotonin alleviates sensitivity to aversive costs in a domain-general fashion, with implications for its potential contribution to a positive impact on motivational deficits in psychiatric disorders.SIGNIFICANCE STATEMENT Gathering information about the world is essential for successfully navigating it. However, sampling information is costly, and we need to balance between gathering too little and too much information. The neurocomputational mechanisms underlying this arbitration between a putative gain, such as reward, and the associated costs, such as allocation of cognitive resources, remain unclear. In this study, we show that week-long daily treatment with a serotonergic antidepressant enhances a willingness to gather information when trying to maximize reward. Computational modeling indicates this arises from a reduced perception of aversive costs, rendering information gathering less cognitively effortful. This finding points to a candidate mechanism by which serotonergic treatment might help alleviate motivational deficits in a range of mental illnesses.

Local 5-HT signaling bi-directionally regulates the coincidence time window for associative learning

The coincidence between conditioned stimulus (CS) and unconditioned stimulus (US) is essential for associative learning; however, the mechanism regulating the duration of this temporal window remains unclear. Here, we found that serotonin (5-HT) bi-directionally regulates the coincidence time window of olfactory learning in Drosophila and affects synaptic plasticity of Kenyon cells (KCs) in the mushroom body (MB). Utilizing GPCR-activation-based (GRAB) neurotransmitter sensors, we found that KC-released acetylcholine (ACh) activates a serotonergic dorsal paired medial (DPM) neuron, which in turn provides inhibitory feedback to KCs. Physiological stimuli induce spatially heterogeneous 5-HT signals, which proportionally gate the intrinsic coincidence time windows of different MB compartments. Artificially reducing or increasing the DPM neuron-released 5-HT shortens or prolongs the coincidence window, respectively. In a sequential trace conditioning paradigm, this serotonergic neuromodulation helps to bridge the CS-US temporal gap. Altogether, we report a model circuitry for perceiving the temporal coincidence and determining the causal relationship between environmental events.

Physical activity for cognitive health promotion: An overview of the underlying neurobiological mechanisms

Physical activity is one of the modifiable factors of cognitive decline and dementia with the strongest evidence. Although many influential reviews have illustrated the neurobiological mechanisms of the cognitive benefits of physical activity, none of them have linked the neurobiological mechanisms to normal exercise physiology to help the readers gain a more advanced, comprehensive understanding of the phenomenon. In this review, we address this issue and provide a synthesis of the literature by focusing on five most studied neurobiological mechanisms. We show that the body's adaptations to enhance exercise performance also benefit the brain and contribute to improved cognition. Specifically, these adaptations include, 1), the release of growth factors that are essential for the development and growth of neurons and for neurogenesis and angiogenesis, 2), the production of lactate that provides energy to the brain and is involved in the synthesis of glutamate and the maintenance of long-term potentiation, 3), the release of anti-inflammatory cytokines that reduce neuroinflammation, 4), the increase in mitochondrial biogenesis and antioxidant enzyme activity that reduce oxidative stress, and 5), the release of neurotransmitters such as dopamine and 5-HT that regulate neurogenesis and modulate cognition. We also discussed several issues relevant for prescribing physical activity, including what intensity and mode of physical activity brings the most cognitive benefits, based on their influence on the above five neurobiological mechanisms. We hope this review helps readers gain a general understanding of the state-of-the-art knowledge on the neurobiological mechanisms of the cognitive benefits of physical activity and guide them in designing new studies to further advance the field.

Serotonergic modulation of local network processing in V1 mirrors previously reported signatures of local network modulation by spatial attention

Sensory processing is influenced by neuromodulators such as serotonin, thought to relay behavioural state. Recent work has shown that the modulatory effect of serotonin itself differs with the animal's behavioural state. In primates, including humans, the serotonin system is anatomically important in the primary visual cortex (V1). We previously reported that in awake fixating macaques, serotonin reduces the spiking activity by decreasing response gain in V1. But the effect of serotonin on the local network is unknown. Here, we simultaneously recorded single-unit activity and local field potentials (LFPs) while iontophoretically applying serotonin in V1 of alert monkeys fixating on a video screen for juice rewards. The reduction in spiking response we observed previously is the opposite of the known increase of spiking activity with spatial attention. Conversely, in the local network (LFP), the application of serotonin resulted in changes mirroring the local network effects of previous reports in macaques directing spatial attention to the receptive field. It reduced the LFP power and the spike-field coherence, and the LFP became less predictive of spiking activity, consistent with reduced functional connectivity. We speculate that together, these effects may reflect the sensory side of a serotonergic contribution to quiet vigilance: The lower gain reduces the salience of stimuli to suppress an orienting reflex to novel stimuli, whereas at the network level, visual processing is in a state comparable to that of spatial attention.

Medial Prefrontal Cortex Serotonin Input Regulates Cognitive Flexibility in Mice

The medial prefrontal cortex (mPFC) regulates cognitive flexibility and emotional behavior. Neurons that release serotonin project to the mPFC, and serotonergic drugs influence emotion and cognition. Yet, the specific roles of endogenous serotonin release in the mPFC on neurophysiology and behavior are unknown. We show that axonal serotonin release in the mPFC directly inhibits the major mPFC output neurons. In serotonergic neurons projecting from the dorsal raphe to the mPFC, we find endogenous activity signatures pre-reward retrieval and at reward retrieval during a cognitive flexibility task. In vivo optogenetic activation of this pathway during pre-reward retrieval selectively improved extradimensional rule shift performance while inhibition impaired it, demonstrating sufficiency and necessity for mPFC serotonin release in cognitive flexibility. Locomotor activity and anxiety-like behavior were not affected by either optogenetic manipulation. Collectively, our data reveal a powerful and specific modulatory role of endogenous serotonin release from dorsal raphe-to-mPFC projecting neurons in cognitive flexibility.

A behavioral timing intervention upregulates striatal serotonergic markers and reduces impulsive action in adult male mice

Many studies support the hypothesis that time-based interventions reduce impulsive behavior in rodents. However, few studies have directly assessed 1) how such interventions affect impulsive action rather than impulsive choice, 2) if intervention effects differ by sex, and 3) how time-based interventions affect neurochemistry in regions mediating decision-making and reward. Thus, we assessed how a fixed-interval (FI) intervention initiated during late adolescence and extending into adulthood affected dopaminergic and serotonergic analytes in the frontal cortex and striatum and subsequent impulsive action in adult male and female mice. Beginning on postnatal day (PND) 45, mice were either trained on a progressive series of FI schedules (FI 20, 40, & 60 s) or remained in the home cage. Following the intervention, increases in striatal serotonergic analytes were found in FI-exposed males and females (n = 8/sex/group) with few changes found in the frontal cortex. Impulsive action was assessed in the remaining mice (n = 10/sex/group) using a fixed-ratio waiting-for-reward (FR-wait) task in which completion of an FR-25 component initiated a "free" pellet component in which pellets were delivered at increasing intervals according to a fixed delay increment that varied across sessions. Responses reset the additive delay and initiated a new FR-25 component. FI-exposed males, but not females, showed fewer delay resets and no-wait resets relative to control mice. Importantly, FI-exposure did not affect discrimination reversal performance in either sex. These data suggest that time-based interventions may reduce impulsive action in addition to impulsive choice perhaps with increased male sensitivity. Additionally, time-based interventions appear to operate through striatal serotonergic augmentation.

Constitutive depletion of brain serotonin differentially affects rats' social and cognitive abilities

Central serotonin appears a promising transdiagnostic marker of psychiatric disorders and a modulator of some of their key behavioral symptoms. In adult male Tph2 -/- rats, constitutively lacking central serotonin, we tested individual's cognitive, social and non-social abilities and characterized group's social organization under classical and ethological testing conditions. Using unsupervised machine learning, we identified the functions most dependent on serotonin. Although serotonin depletion did not affect cognitive performances in classical testing, in the home-cage it induced compulsive aggression and sexual behavior, hyperactive and hypervigilant stereotyped behavior, reduced self-care and exacerbated corticosterone levels. This profile recalled symptoms of impulse control and anxiety disorders. Serotonin appeared essential for behavioral adaptation to dynamic social environments. Our animal model challenges the essential role of serotonin in decision-making, flexibility, impulsivity, and risk-taking. These findings highlight the importance of studying everyday life functions within the dynamic social living environment to model complexity in animal models.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

By means of an expansive innervation, the serotonin (5-HT) neurons of the dorsal raphe nucleus (DRN) are positioned to enact coordinated modulation of circuits distributed across the entire brain in order to adaptively regulate behavior. Yet the network computations that emerge from the excitability and connectivity features of the DRN are still poorly understood. To gain insight into these computations, we began by carrying out a detailed electrophysiological characterization of genetically identified mouse 5-HT and somatostatin (SOM) neurons. We next developed a single-neuron modeling framework that combines the realism of Hodgkin-Huxley models with the simplicity and predictive power of generalized integrate-and-fire models. We found that feedforward inhibition of 5-HT neurons by heterogeneous SOM neurons implemented divisive inhibition, while endocannabinoid-mediated modulation of excitatory drive to the DRN increased the gain of 5-HT output. Our most striking finding was that the output of the DRN encodes a mixture of the intensity and temporal derivative of its input, and that the temporal derivative component dominates this mixture precisely when the input is increasing rapidly. This network computation primarily emerged from prominent adaptation mechanisms found in 5-HT neurons, including a previously undescribed dynamic threshold. By applying a bottom-up neural network modeling approach, our results suggest that the DRN is particularly apt to encode input changes over short timescales, reflecting one of the salient emerging computations that dominate its output to regulate behavior.

Undermatching Is a Consequence of Policy Compression

The matching law describes the tendency of agents to match the ratio of choices allocated to the ratio of rewards received when choosing among multiple options (Herrnstein, 1961). Perfect matching, however, is infrequently observed. Instead, agents tend to undermatch or bias choices toward the poorer option. Overmatching, or the tendency to bias choices toward the richer option, is rarely observed. Despite the ubiquity of undermatching, it has received an inadequate normative justification. Here, we assume agents not only seek to maximize reward, but also seek to minimize cognitive cost, which we formalize as policy complexity (the mutual information between actions and states of the environment). Policy complexity measures the extent to which the policy of an agent is state dependent. Our theory states that capacity-constrained agents (i.e., agents that must compress their policies to reduce complexity) can only undermatch or perfectly match, but not overmatch, consistent with the empirical evidence. Moreover, using mouse behavioral data (male), we validate a novel prediction about which task conditions exaggerate undermatching. Finally, in patients with Parkinson's disease (male and female), we argue that a reduction in undermatching with higher dopamine levels is consistent with an increased policy complexity.SIGNIFICANCE STATEMENT The matching law describes the tendency of agents to match the ratio of choices allocated to different options to the ratio of reward received. For example, if option a yields twice as much reward as option b, matching states that agents will choose option a twice as much. However, agents typically undermatch: they choose the poorer option more frequently than expected. Here, we assume that agents seek to simultaneously maximize reward and minimize the complexity of their action policies. We show that this theory explains when and why undermatching occurs. Neurally, we show that policy complexity, and by extension undermatching, is controlled by tonic dopamine, consistent with other evidence that dopamine plays an important role in cognitive resource allocation.

Serotonin regulation of behavior via large-scale neuromodulation of serotonin receptor networks

Although we understand how serotonin receptors function at the single-cell level, what role different serotonin receptors play in regulating brain-wide activity and, in turn, human behavior, remains unknown. Here, we developed transcriptomic-neuroimaging mapping to characterize brain-wide functional signatures associated with specific serotonin receptors: serotonin receptor networks (SRNs). Probing SRNs with optogenetics-functional magnetic resonance imaging (MRI) and pharmacology in mice, we show that activation of dorsal raphe serotonin neurons differentially modulates the amplitude and functional connectivity of different SRNs, showing that receptors' spatial distributions can confer specificity not only at the local, but also at the brain-wide, network level. In humans, using resting-state functional MRI, SRNs replicate established divisions of serotonin effects on impulsivity and negative biases. These results provide compelling evidence that heterogeneous brain-wide distributions of different serotonin receptor types may underpin behaviorally distinct modes of serotonin regulation. This suggests that serotonin neurons may regulate multiple aspects of human behavior via modulation of large-scale receptor networks.

Overview on brain function enhancement of Internet addicts through exercise intervention: Based on reward-execution-decision cycle

Internet addiction (IA) has become an impulse control disorder included in the category of psychiatric disorders. The IA trend significantly increased after the outbreak of the new crown epidemic. IA damages some brain functions in humans. Emerging evidence suggests that exercise exerts beneficial effects on the brain function and cognitive level damaged by IA. This work reviews the neurobiological mechanisms of IA and describes the brain function impairment by IA from three systems: reward, execution, and decision-making. Furthermore, we sort out the research related to exercise intervention on IA and its effect on improving brain function. The internal and external factors that produce IA must be considered when summarizing movement interventions from a behavioral perspective. We can design exercise prescriptions based on exercise interests and achieve the goal of quitting IA. This work explores the possible mechanisms of exercise to improve IA through systematic analysis. Furthermore, this work provides research directions for the future targeted design of exercise prescriptions.

Understanding the effects of serotonin in the brain through its role in the gastrointestinal tract

The neuromodulatory arousal system imbues the nervous system with the flexibility and robustness required to facilitate adaptive behaviour. While there are well-understood mechanisms linking dopamine, noradrenaline and acetylcholine to distinct behavioural states, similar conclusions have not been as readily available for serotonin. Fascinatingly, despite clear links between serotonergic function and cognitive capacities as diverse as reward processing, exploration, and the psychedelic experience, over 95% of the serotonin in the body is released in the gastrointestinal tract, where it controls digestive muscle contractions (peristalsis). Here, we argue that framing neural serotonin as a rostral extension of the gastrointestinal serotonergic system dissolves much of the mystery associated with the central serotonergic system. Specifically, we outline that central serotonin activity mimics the effects of a digestion/satiety circuit mediated by hypothalamic control over descending serotonergic nuclei in the brainstem. We review commonalities and differences between these two circuits, with a focus on the heterogeneous expression of different classes of serotonin receptors in the brain. Much in the way that serotonin-induced peristalsis facilitates the work of digestion, serotonergic influences over cognition can be reframed as performing the work of cognition. Extending this analogy, we argue that the central serotonergic system allows the brain to arbitrate between different cognitive modes as a function of serotonergic tone: low activity facilitates cognitive automaticity, whereas higher activity helps to identify flexible solutions to problems, particularly if and when the initial responses fail. This perspective sheds light on otherwise disparate capacities mediated by serotonin, and also helps to understand why there are such pervasive links between serotonergic pathology and the symptoms of psychiatric disorders.

Neural mechanisms underlying the temporal organization of naturalistic animal behavior

Naturalistic animal behavior exhibits a strikingly complex organization in the temporal domain, with variability arising from at least three sources: hierarchical, contextual, and stochastic. What neural mechanisms and computational principles underlie such intricate temporal features? In this review, we provide a critical assessment of the existing behavioral and neurophysiological evidence for these sources of temporal variability in naturalistic behavior. Recent research converges on an emergent mechanistic theory of temporal variability based on attractor neural networks and metastable dynamics, arising via coordinated interactions between mesoscopic neural circuits. We highlight the crucial role played by structural heterogeneities as well as noise from mesoscopic feedback loops in regulating flexible behavior. We assess the shortcomings and missing links in the current theoretical and experimental literature and propose new directions of investigation to fill these gaps.

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the "brake" on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory "drive." For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the "drive" and "brake" circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

Friend of the Devil: Negative Social Influences Driving Substance Use Disorders

Substance use disorders in humans have significant social influences, both positive and negative. While prosocial behaviors promote group cooperation and are naturally rewarding, distressing social encounters, such as aggression exhibited by a conspecific, are aversive and can enhance the sensitivity to rewarding substances, promote the acquisition of drug-taking, and reinstate drug-seeking. On the other hand, withdrawal and prolonged abstinence from drugs of abuse can promote social avoidance and suppress social motivation, accentuating drug cravings and facilitating relapse. Understanding how complex social states and experiences modulate drug-seeking behaviors as well as the underlying circuit dynamics, such as those interacting with mesolimbic reward systems, will greatly facilitate progress on understanding triggers of drug use, drug relapse and the chronicity of substance use disorders. Here we discuss some of the common circuit mechanisms underlying social and addictive behaviors that may underlie their antagonistic functions. We also highlight key neurochemicals involved in social influences over addiction that are frequently identified in comorbid psychiatric conditions. Finally, we integrate these data with recent findings on (±)3,4-methylenedioxymethamphetamine (MDMA) that suggest functional segregation and convergence of social and reward circuits that may be relevant to substance use disorder treatment through the competitive nature of these two types of reward. More studies focused on the relationship between social behavior and addictive behavior we hope will spur the development of treatment strategies aimed at breaking vicious addiction cycles.

Complementary roles of serotonergic and cholinergic systems in decisions about when to act

Decision-making not only involves deciding about which action to choose but when and whether to initiate an action in the first place. Macaque monkeys tracked number of dots on a screen and could choose when to make a response. The longer the animals waited before responding, the more dots appeared on the screen and the higher the probability of reward. Monkeys waited longer before making a response when a trial’s value was less than the environment’s average value. Recordings of brain activity with fMRI revealed that activity in dorsal raphe nucleus (DRN)—a key source of serotonin (5-HT)—tracked average value of the environment. By contrast, activity in the basal forebrain (BF)—an important source of acetylcholine (ACh)—was related to decision time to act as a function of immediate and recent past context. Interactions between DRN and BF and the anterior cingulate cortex (ACC), another region with action initiation-related activity, occurred as a function of the decision time to act. Next, we performed two psychopharmacological studies. Manipulating systemic 5-HT by citalopram prolonged the time macaques waited to respond for a given opportunity. This effect was more evident during blocks with long inter-trial intervals (ITIs) where good opportunities were sparse. Manipulating systemic acetylcholine (ACh) by rivastigmine reduced the time macaques waited to respond given the immediate and recent past context, a pattern opposite to the effect observed with 5-HT. These findings suggest complementary roles for serotonin/DRN and acetylcholine/BF in decisions about when to initiate an action.

•

Both immediate context and wider environment influence decisions about when to act

•

DRN and 5-HT mediate the influence of wider environment

•

BF and ACh mediate the influence of immediate context

Serotonin neurons modulate learning rate through uncertainty

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates ("meta-learning"). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.

Differential Serotonergic Modulation of Principal Neurons and Interneurons in the Anterior Piriform Cortex

Originating from the brainstem raphe nuclei, serotonin is an important neuromodulator involved in a variety of physiological and pathological functions. Specific optogenetic stimulation of serotonergic neurons results in the divisive suppression of spontaneous, but not sensory evoked activity in the majority of neurons in the primary olfactory cortex and an increase in firing in a minority of neurons. To reveal the mechanisms involved in this dual serotonergic control of cortical activity we used a combination of in vitro electrophysiological recordings from identified neurons in the primary olfactory cortex, optogenetics and pharmacology and found that serotonin suppressed the activity of principal neurons, but excited local interneurons. The results have important implications in sensory information processing and other functions of the olfactory cortex and related brain areas.

5-HT2C receptor perturbation has bidirectional influence over instrumental vigour and restraint

The serotonin (5-HT) system, particularly the 5-HT2C receptor, has consistently been implicated in behavioural control. However, while some studies have focused on the role 5-HT2C receptors play in regulating motivation to work for reward, others have highlighted its importance in response restraint. To date, it is unclear how 5-HT transmission at this receptor regulates the balance of response invigoration and restraint in anticipation of future reward. In addition, it remains to be established how 5-HT2C receptors gate the influence of internal versus cue-driven processes over reward-guided actions. To elucidate these issues, we investigated the effects of administering the 5-HT2C receptor antagonist SB242084, both systemically and directly into the nucleus accumbens core (NAcC), in rats performing a Go/No-Go task for small or large rewards. The results were compared to the administration of d-amphetamine into the NAcC, which has previously been shown to promote behavioural activation. Systemic perturbation of 5-HT2C receptors-but crucially not intra-NAcC infusions-consistently boosted rats' performance and instrumental vigour on Go trials when they were required to act. Concomitantly, systemic administration also reduced their ability to withhold responding for rewards on No-Go trials, particularly late in the holding period. Notably, these effects were often apparent only when the reward on offer was small. By contrast, inducing a hyperdopaminergic state in the NAcC with d-amphetamine strongly impaired response restraint on No-Go trials both early and late in the holding period, as well as speeding action initiation. Together, these findings suggest that 5-HT2C receptor transmission, outside the NAcC, shapes the vigour of ongoing goal-directed action as well as the likelihood of responding as a function of expected reward.

Entropy-based metrics for predicting choice behavior based on local response to reward

For decades, behavioral scientists have used the matching law to quantify how animals distribute their choices between multiple options in response to reinforcement they receive. More recently, many reinforcement learning (RL) models have been developed to explain choice by integrating reward feedback over time. Despite reasonable success of RL models in capturing choice on a trial-by-trial basis, these models cannot capture variability in matching behavior. To address this, we developed metrics based on information theory and applied them to choice data from dynamic learning tasks in mice and monkeys. We found that a single entropy-based metric can explain 50% and 41% of variance in matching in mice and monkeys, respectively. We then used limitations of existing RL models in capturing entropy-based metrics to construct more accurate models of choice. Together, our entropy-based metrics provide a model-free tool to predict adaptive choice behavior and reveal underlying neural mechanisms.

The dorsal raphe nucleus in the control of energy balance

Energy balance is orchestrated by an extended network of highly interconnected nuclei across the central nervous system. While much is known about the hypothalamic circuits regulating energy homeostasis, the 'extra-hypothalamic' circuits involved are relatively poorly understood. In this review, we focus on the brainstem's dorsal raphe nucleus (DRN), integrating decades of research linking this structure to the physiologic and behavioral responses that maintain proper energy stores. DRN neurons sense and respond to interoceptive and exteroceptive cues related to energy imbalance and in turn induce appropriate alterations in energy intake and expenditure. The DRN is also molecularly differentiable, with different populations playing distinct and often opposing roles in controlling energy balance. These populations are integrated into the extended circuit known to regulate energy balance. Overall, this review summarizes the key evidence demonstrating an important role for the DRN in regulating energy balance.

Dynamics of history-dependent perceptual judgment

Identical physical inputs do not always evoke identical percepts. To investigate the role of stimulus history in tactile perception, we designed a task in which rats had to judge each vibrissal vibration, in a long series, as strong or weak depending on its mean speed. After a low-speed stimulus (trial n - 1), rats were more likely to report the next stimulus (trial n) as strong, and after a high-speed stimulus, they were more likely to report the next stimulus as weak, a repulsive effect that did not depend on choice or reward on trial n - 1. This effect could be tracked over several preceding trials (i.e., n - 2 and earlier) and was characterized by an exponential decay function, reflecting a trial-by-trial incorporation of sensory history. Surprisingly, the influence of trial n - 1 strengthened as the time interval between n - 1 and n grew. Human subjects receiving fingertip vibrations showed these same key findings. We are able to account for the repulsive stimulus history effect, and its detailed time scale, through a single-parameter model, wherein each new stimulus gradually updates the subject's decision criterion. This model points to mechanisms underlying how the past affects the ongoing subjective experience.

Gray areas: Neuropeptide circuits linking the Edinger-Westphal and Dorsal Raphe nuclei in addiction

The circuitry of addiction comprises several neural networks including the midbrain - an expansive region critically involved in the control of motivated behaviors. Midbrain nuclei like the Edinger-Westphal (EW) and dorsal raphe (DR) contain unique populations of neurons that synthesize many understudied neuroactive molecules and are encircled by the periaqueductal gray (PAG). Despite the proximity of these special neuron classes to the ventral midbrain complex and surrounding PAG, functions of the EW and DR remain substantially underinvestigated by comparison. Spanning approximately -3.0 to -5.2 mm posterior from bregma in the mouse, these various cell groups form a continuum of neurons that we refer to collectively as the subaqueductal paramedian zone. Defining how these pathways modulate affective behavioral states presents a difficult, yet conquerable challenge for today's technological advances in neuroscience. In this review, we cover the known contributions of different neuronal subtypes of the subaqueductal paramedian zone. We catalogue these cell types based on their spatial, molecular, connectivity, and functional properties and integrate this information with the existing data on the EW and DR in addiction. We next discuss evidence that links the EW and DR anatomically and functionally, highlighting the potential contributions of an EW-DR circuit to addiction-related behaviors. Overall, we aim to derive an integrated framework that emphasizes the contributions of EW and DR nuclei to addictive states and describes how these cell groups function in individuals suffering from substance use disorders. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Cortical Serotonergic and Catecholaminergic Denervation in MPTP-Treated Parkinsonian Monkeys

Decreased cortical serotonergic and catecholaminergic innervation of the frontal cortex has been reported at early stages of Parkinson's disease (PD). However, the limited availability of animal models that exhibit these pathological features has hampered our understanding of the functional significance of these changes during the course of the disease. In the present study, we assessed longitudinal changes in cortical serotonin and catecholamine innervation in motor-symptomatic and asymptomatic monkeys chronically treated with low doses of 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP). Densitometry and unbiased stereological techniques were used to quantify changes in serotonin and tyrosine hydroxylase (TH) immunoreactivity in frontal cortices of 3 control monkeys and 3 groups of MPTP-treated monkeys (motor-asymptomatic [N = 2], mild parkinsonian [N = 3], and moderate parkinsonian [N = 3]). Our findings revealed a significant decrease (P < 0.001) in serotonin innervation of motor (Areas 4 and 6), dorsolateral prefrontal (Areas 9 and 46), and limbic (Areas 24 and 25) cortical areas in motor-asymptomatic MPTP-treated monkeys. Both groups of symptomatic MPTP-treated animals displayed further serotonin denervation in these cortical regions (P < 0.0001). A significant loss of serotonin-positive dorsal raphe neurons was found in the moderate parkinsonian group. On the other hand, the intensity of cortical TH immunostaining was not significantly affected in motor asymptomatic MPTP-treated monkeys, but underwent a significant reduction in the moderate symptomatic group (P < 0.05). Our results indicate that chronic intoxication with MPTP induces early pathology in the corticopetal serotonergic system, which may contribute to early non-motor symptoms in PD.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.

Perinatal interference with the serotonergic system affects VTA function in the adult via glutamate co-transmission

Serotonin and dopamine are associated with multiple psychiatric disorders. How they interact during development to affect subsequent behavior remains unknown. Knockout of the serotonin transporter or postnatal blockade with selective serotonin reuptake inhibitors (SSRIs) leads to novelty-induced exploration deficits in adulthood, potentially involving the dopamine system. Here, we show in the mouse that raphe nucleus serotonin neurons activate ventral tegmental area dopamine neurons via glutamate co-transmission and that this co-transmission is reduced in animals exposed postnatally to SSRIs. Blocking serotonin neuron glutamate co-transmission mimics this SSRI-induced hypolocomotion, while optogenetic activation of dopamine neurons reverses this hypolocomotor phenotype. Our data demonstrate that serotonin neurons modulate dopamine neuron activity via glutamate co-transmission and that this pathway is developmentally malleable, with high serotonin levels during early life reducing co-transmission, revealing the basis for the reduced novelty-induced exploration in adulthood due to postnatal SSRI exposure.

Knockout of the Serotonin Transporter in the Rat Mildly Modulates Decisional Anhedonia

Serotonin transporter gene variance has long been considered an essential factor contributing to depression. However, meta-analyses yielded inconsistent findings recently, asking for further understanding of the link between the gene and depression-related symptoms. One key feature of depression is anhedonia. While data exist on the effect of serotonin transporter gene knockout (5-HTT^-/-) in rodents on consummatory and anticipatory anhedonia, with mixed outcomes, the effect on decisional anhedonia has not been investigated thus far. Here, we tested whether 5-HTT^-/- contributes to decisional anhedonia. To this end, we established a novel touchscreen-based go/go task of visual decision-making. During the learning of stimulus discrimination, 5-HTT^+/+ rats performed more optimal decision-making compared to 5-HTT^-/- rats at the beginning, but this difference did not persist throughout the learning period. During stimulus generalization, the generalization curves were similar between both genotypes and did not alter as the learning progress. Interestingly, the response time in 5-HTT^+/+ rats increased as the session increased in general, while 5-HTT^-/- rats tended to decrease. The response time difference might indicate that 5-HTT^-/- rats altered willingness to exert cognitive effort to the categorization of generalization stimuli. These results suggest that the effect of 5-HTT ablation on decisional anhedonia is mild and interacts with learning, explaining the discrepant findings on the link between 5-HTT gene and depression.

Diminished Cortical Excitation and Elevated Inhibition During Perceptual Impairments in a Mouse Model of Autism

Sensory impairments are a core feature of autism spectrum disorder (ASD). These impairments affect visual perception and have been hypothesized to arise from imbalances in cortical excitatory and inhibitory activity. There is conflicting evidence for this hypothesis from several recent studies of transgenic mouse models of ASD; crucially, none have measured activity from identified excitatory and inhibitory neurons during simultaneous impairments of sensory perception. Here, we directly recorded putative excitatory and inhibitory population spiking in primary visual cortex (V1) while simultaneously measuring visual perceptual behavior in CNTNAP2-/- knockout (KO) mice. We observed quantitative impairments in the speed, accuracy, and contrast sensitivity of visual perception in KO mice. During these perceptual impairments, stimuli evoked more firing of inhibitory neurons and less firing of excitatory neurons, with reduced neural sensitivity to contrast. In addition, pervasive 3-10 Hz oscillations in superficial cortical layers 2/3 (L2/3) of KO mice degraded predictions of behavioral performance from neural activity. Our findings show that perceptual deficits relevant to ASD may be associated with elevated cortical inhibitory activity along with diminished and aberrant excitatory population activity in L2/3, a major source of feedforward projections to higher cortical regions.

Reciprocal Lateral Hypothalamic and Raphe GABAergic Projections Promote Wakefulness

The lateral hypothalamus (LH), together with multiple neuromodulatory systems of the brain, such as the dorsal raphe nucleus (DR), is implicated in arousal, yet interactions between these systems are just beginning to be explored. Using a combination of viral tracing, circuit mapping, electrophysiological recordings from identified neurons, and combinatorial optogenetics in mice, we show that GABAergic neurons in the LH selectively inhibit GABAergic neurons in the DR, resulting in increased firing of a substantial fraction of its neurons that ultimately promotes arousal. These DRGABA neurons are wake active and project to multiple brain areas involved in the control of arousal, including the LH, where their specific activation potently influences local network activity leading to arousal from sleep. Our results show how mutual inhibitory projections between the LH and the DR promote wakefulness and suggest a complex arousal control by intimate interactions between long-range connections and local circuit dynamics.SIGNIFICANCE STATEMENT: Multiple brain systems including the lateral hypothalamus and raphe serotonergic system are involved in the regulation of the sleep/wake cycle, yet the interaction between these systems have remained elusive. Here we show that mutual disinhibition mediated by long range inhibitory projections between these brain areas can promote wakefulness. The main importance of this work relies in revealing the interaction between a brain area involved in autonomic regulation and another in controlling higher brain functions including reward, patience, mood and sensory coding.

Sniff-synchronized, gradient-guided olfactory search by freely moving mice

For many organisms, searching for relevant targets such as food or mates entails active, strategic sampling of the environment. Finding odorous targets may be the most ancient search problem that motile organisms evolved to solve. While chemosensory navigation has been well characterized in microorganisms and invertebrates, spatial olfaction in vertebrates is poorly understood. We have established an olfactory search assay in which freely moving mice navigate noisy concentration gradients of airborne odor. Mice solve this task using concentration gradient cues and do not require stereo olfaction for performance. During task performance, respiration and nose movement are synchronized with tens of milliseconds precision. This synchrony is present during trials and largely absent during inter-trial intervals, suggesting that sniff-synchronized nose movement is a strategic behavioral state rather than simply a constant accompaniment to fast breathing. To reveal the spatiotemporal structure of these active sensing movements, we used machine learning methods to parse motion trajectories into elementary movement motifs. Motifs fall into two clusters, which correspond to investigation and approach states. Investigation motifs lock precisely to sniffing, such that the individual motifs preferentially occur at specific phases of the sniff cycle. The allocentric structure of investigation and approach indicates an advantage to sampling both sides of the sharpest part of the odor gradient, consistent with a serial-sniff strategy for gradient sensing. This work clarifies sensorimotor strategies for mouse olfactory search and guides ongoing work into the underlying neural mechanisms.