Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans

Direct serotonin release in humans shapes aversive learning and inhibition

The role of serotonin in human behaviour is informed by approaches which allow in vivo modification of synaptic serotonin. However, characterising the effects of increased serotonin signalling in human models of behaviour is challenging given the limitations of available experimental probes, notably selective serotonin reuptake inhibitors. Here we use a now-accessible approach to directly increase synaptic serotonin in humans (a selective serotonin releasing agent) and examine its influence on domains of behaviour historically considered core functions of serotonin. Computational techniques, including reinforcement learning and drift diffusion modelling, explain participant behaviour at baseline and after week-long intervention. Reinforcement learning models reveal that increasing synaptic serotonin reduces sensitivity for outcomes in aversive contexts. Furthermore, increasing synaptic serotonin enhances behavioural inhibition, and shifts bias towards impulse control during exposure to aversive emotional probes. These effects are seen in the context of overall improvements in memory for neutral verbal information. Our findings highlight the direct effects of increasing synaptic serotonin on human behaviour, underlining its role in guiding decision-making within aversive and more neutral contexts, and offering implications for longstanding theories of central serotonin function.

High stakes slow responding, but do not help overcome Pavlovian biases in humans

"Pavlovian" or "motivational" biases are the phenomenon that the valence of prospective outcomes modulates action invigoration: the prospect of reward invigorates actions, while the prospect of punishment suppresses actions. Effects of the valence of prospective outcomes are well established, but it remains unclear how the magnitude of outcomes ("stake magnitude") modulates these biases. In this preregistered study (N = 55), we manipulated stake magnitude (high vs. low) in an orthogonalized Motivational Go/NoGo Task. We tested whether higher stakes (a) strengthen biases or (b) elicit cognitive control recruitment, enhancing the suppression of biases in motivationally incongruent conditions. Confirmatory tests showed that high stakes slowed down responding, especially in motivationally incongruent conditions. However, high stakes did not affect whether a response was made or not, and did not change the magnitude of Pavlovian biases. Reinforcement-learning drift-diffusion models (RL-DDMs) fit to the data suggested that response slowing was best captured by stakes prolonging the non-decision time. There was no effect of the stakes on the response threshold (as in typical speed-accuracy trade-offs). In sum, these results suggest that high stakes slow down responses without affecting the expression of Pavlovian biases in behavior. We speculate that this slowing under high stakes might reflect heightened cognitive control, which is however ineffectively used, or reflect positive conditioned suppression, i.e., the interference between goal-directed and consummatory behaviors, a phenomenon previously observed in rodents that might also exist in humans. Pavlovian biases and slowing under high stakes may arise in parallel to each other.

The selective serotonin reuptake inhibitor sertraline alters learning from aversive reinforcements in patients with depression: evidence from a randomized controlled trial

BACKGROUND

Selective serotonin reuptake inhibitors (SSRIs) are first-line pharmacological treatments for depression and anxiety. However, little is known about how pharmacological action is related to cognitive and affective processes. Here, we examine whether specific reinforcement learning processes mediate the treatment effects of SSRIs.

METHODS

The PANDA trial was a multicentre, double-blind, randomized clinical trial in UK primary care comparing the SSRI sertraline with placebo for depression and anxiety. Participants (N = 655) performed an affective Go/NoGo task three times during the trial and computational models were used to infer reinforcement learning processes.

RESULTS

There was poor task performance: only 54% of the task runs were informative, with more informative task runs in the placebo than in the active group. There was no evidence for the preregistered hypothesis that Pavlovian inhibition was affected by sertraline. Exploratory analyses revealed that in the sertraline group, early increases in Pavlovian inhibition were associated with improvements in depression after 12 weeks. Furthermore, sertraline increased how fast participants learned from losses and faster learning from losses was associated with more severe generalized anxiety symptoms.

CONCLUSIONS

The study findings indicate a relationship between aversive reinforcement learning mechanisms and aspects of depression, anxiety, and SSRI treatment, but these relationships did not align with the initial hypotheses. Poor task performance limits the interpretability and likely generalizability of the findings, and highlights the critical importance of developing acceptable and reliable tasks for use in clinical studies.

FUNDING

This article presents research supported by NIHR Program Grants for Applied Research (RP-PG-0610-10048), the NIHR BRC, and UCL, with additional support from IMPRS COMP2PSYCH (JM, QH) and a Wellcome Trust grant (QH).

Distinct spatiotemporal brainstem pathways of outcome valence during reward- and punishment-based learning

Learning to seek rewards and avoid punishments, based on positive and negative choice outcomes, is essential for human survival. Yet, the neural underpinnings of outcome valence in the human brainstem and the extent to which they differ in reward and punishment learning contexts remain largely elusive. Here, using simultaneously acquired electroencephalography and functional magnetic resonance imaging data, we show that during reward learning the substantia nigra (SN)/ventral tegmental area (VTA) and locus coeruleus are initially activated following negative outcomes, while the VTA subsequently re-engages exhibiting greater responses for positive than negative outcomes, consistent with an early arousal/avoidance response and a later value-updating process, respectively. During punishment learning, we show that distinct raphe nucleus and SN subregions are activated only by negative outcomes with a sustained post-outcome activity across time, supporting the involvement of these brainstem subregions in avoidance behavior. Finally, we demonstrate that the coupling of these brainstem structures with other subcortical and cortical areas helps to shape participants' serial choice behavior in each context.

Facial expressions of pain: the role of the serotonergic system

RATIONALE

Although interest in the neurobiology of facial communication of pain has increased over the last decades, little is known about which neurotransmitter systems might be involved in regulating facial expressions of pain.

OBJECTIVES

We aim to investigate whether the serotonergic system (5-HT), which has been implicated in various aspects of pain processing as well as in behavioral response inhibition, might play a role in facial expressions of pain. Using acute tryptophan depletion (ATD) to manipulate 5-HT function, we examined its effects on facial and subjective pain responses.

METHODS

In a double-blind, placebo-controlled within-subject design, 27 participants received either an ATD or a control drink in two separate sessions. Approximately 5-h post-oral consumption, we assessed pain thresholds (heat, pressure) as well as facial and subjective responses to phasic heat pain. Moreover, situational pain catastrophizing and mood were assessed as affective state indicators.

RESULTS

ATD neither influenced pain thresholds nor self-report ratings, nor catastrophizing or mood. Only facial responses were significantly affected by ATD. ATD led to a decrease in pain-indicative as well as in pain-non-indicative facial responses to painful heat, compared to the control condition.

CONCLUSIONS

Decrease in brain 5-HT synthesis via ATD significantly reduced facial responses to phasic heat pain; possibly due to (i) diminished disposition to display social behavior or due to (ii) decreased facilitation of excitatory inputs to the facial motor neuron.

Functional Magnetic Resonance Imaging Signatures of Pavlovian and Instrumental Valuation Systems during a Modified Orthogonalized Go/No-go Task

Motivational (i.e., Pavlovian) values interfere with instrumental responding and can lead to suboptimal decision-making. In humans, task-based neuroimaging studies have only recently started illuminating the functional neuroanatomy of Pavlovian biasing of instrumental control. To provide a mechanistic understanding of the neural dynamics underlying the Pavlovian and instrumental valuation systems, analysis of neuroimaging data has been informed by computational modeling of conditioned behavior. Nonetheless, because of collinearities in Pavlovian and instrumental predictions, previous research failed to tease out hemodynamic activity that is parametrically and dynamically modulated by coexistent Pavlovian and instrumental value expectations. Moreover, neural correlates of Pavlovian to instrumental transfer effects have so far only been identified in extinction (i.e., in the absence of learning). In this study, we devised a modified version of the orthogonalized go/no-go paradigm, which introduced Pavlovian-only catch trials to better disambiguate trial-by-trial Pavlovian and instrumental predictions in both sexes. We found that hemodynamic activity in the ventromedial pFC covaried uniquely with the model-derived Pavlovian value expectations. Notably, modulation of neural activity encoding for instrumental predictions in the supplementary motor cortex was linked to successful action selection in conflict conditions. Furthermore, hemodynamic activity in regions pertaining to the limbic system and medial pFC was correlated with synergistic Pavlovian and instrumental predictions and improved conditioned behavior during congruent trials. Altogether, our results provide new insights into the functional neuroanatomy of decision-making and corroborate the validity of our variant of the orthogonalized go/no-go task as a behavioral assay of the Pavlovian and instrumental valuation systems.

Differential effects of reward and punishment on reinforcement-based motor learning and generalization

Reward and punishment have long been recognized as potent modulators of human behavior. Although reinforcement learning is a significant motor learning process, the exact mechanisms underlying how the brain learns movements through reward and punishment are not yet fully understood. Beyond the memory of specific examples, investigating the ability to generalize to new situations offers a better understanding of motor learning. This study hypothesizes that reward and punishment engage qualitatively different motivational systems with different neurochemical and neuroanatomical substrates, which would have differential effects on reinforcement-based motor learning and generalization. To test this hypothesis, two groups of participants learn a motor task in one direction and then relearn the same task in a new direction, receiving only performance-based reward or punishment score feedback. Our findings support our hypothesis, showing that reward led to slower learning but promoted generalization. On the other hand, punishment led to faster learning but impaired generalization. These behavioral differences may be due to different tendencies of movement variability in each group. The punishment group tended to explore more actively than the reward group during the initial learning phase, possibly due to loss aversion. In contrast, the reward group tended to explore more actively than the initial learning phase during the generalization test phase, seemingly recalling the strategy that led to the reward. These results suggest that reward and punishment may engage different neural mechanisms during reinforcement-based motor learning and generalization, with important implications for practical applications such as sports training and motor rehabilitation.NEW & NOTEWORTHY Although reinforcement learning is a significant motor learning process, the mechanisms underlying how the brain learns movements through reward and punishment are not fully understood. We modified a well-established motor adaptation task and used savings (faster relearning) to measure generalization. We found reward led to slower learning but promoted generalization, whereas punishment led to faster learning but impaired generalization, suggesting that reward and punishment may engage different neural mechanisms during reinforcement-based motor learning and generalization.

Effect of lysergic acid diethylamide (LSD) on reinforcement learning in humans

BACKGROUND

The non-selective serotonin 2A (5-HT2A) receptor agonist lysergic acid diethylamide (LSD) holds promise as a treatment for some psychiatric disorders. Psychedelic drugs such as LSD have been suggested to have therapeutic actions through their effects on learning. The behavioural effects of LSD in humans, however, remain incompletely understood. Here we examined how LSD affects probabilistic reversal learning (PRL) in healthy humans.

METHODS

Healthy volunteers received intravenous LSD (75 μg in 10 mL saline) or placebo (10 mL saline) in a within-subjects design and completed a PRL task. Participants had to learn through trial and error which of three stimuli was rewarded most of the time, and these contingencies switched in a reversal phase. Computational models of reinforcement learning (RL) were fitted to the behavioural data to assess how LSD affected the updating ('learning rates') and deployment of value representations ('reinforcement sensitivity') during choice, as well as 'stimulus stickiness' (choice repetition irrespective of reinforcement history).

RESULTS

Raw data measures assessing sensitivity to immediate feedback ('win-stay' and 'lose-shift' probabilities) were unaffected, whereas LSD increased the impact of the strength of initial learning on perseveration. Computational modelling revealed that the most pronounced effect of LSD was the enhancement of the reward learning rate. The punishment learning rate was also elevated. Stimulus stickiness was decreased by LSD, reflecting heightened exploration. Reinforcement sensitivity differed by phase.

CONCLUSIONS

Increased RL rates suggest LSD induced a state of heightened plasticity. These results indicate a potential mechanism through which revision of maladaptive associations could occur in the clinical application of LSD.

Reframing dopamine: A controlled controller at the limbic-motor interface

Pavlovian influences notoriously interfere with operant behaviour. Evidence suggests this interference sometimes coincides with the release of the neuromodulator dopamine in the nucleus accumbens. Suppressing such interference is one of the targets of cognitive control. Here, using the examples of active avoidance and omission behaviour, we examine the possibility that direct manipulation of the dopamine signal is an instrument of control itself. In particular, when instrumental and Pavlovian influences come into conflict, dopamine levels might be affected by the controlled deployment of a reframing mechanism that recasts the prospect of possible punishment as an opportunity to approach safety, and the prospect of future reward in terms of a possible loss of that reward. We operationalize this reframing mechanism and fit the resulting model to rodent behaviour from two paradigmatic experiments in which accumbens dopamine release was also measured. We show that in addition to matching animals' behaviour, the model predicts dopamine transients that capture some key features of observed dopamine release at the time of discriminative cues, supporting the idea that modulation of this neuromodulator is amongst the repertoire of cognitive control strategies.

Boosting Serotonin Increases Information Gathering by Reducing Subjective Cognitive Costs

Serotonin is implicated in the valuation of aversive costs, such as delay or physical effort. However, its role in governing sensitivity to cognitive effort, for example, deliberation costs during information gathering, is unclear. We show that treatment with a serotonergic antidepressant in healthy human individuals of either sex enhances a willingness to gather information when trying to maximize reward. Using computational modeling, we show this arises from a diminished sensitivity to subjective deliberation costs during the sampling process. This result is consistent with the notion that serotonin alleviates sensitivity to aversive costs in a domain-general fashion, with implications for its potential contribution to a positive impact on motivational deficits in psychiatric disorders.SIGNIFICANCE STATEMENT Gathering information about the world is essential for successfully navigating it. However, sampling information is costly, and we need to balance between gathering too little and too much information. The neurocomputational mechanisms underlying this arbitration between a putative gain, such as reward, and the associated costs, such as allocation of cognitive resources, remain unclear. In this study, we show that week-long daily treatment with a serotonergic antidepressant enhances a willingness to gather information when trying to maximize reward. Computational modeling indicates this arises from a reduced perception of aversive costs, rendering information gathering less cognitively effortful. This finding points to a candidate mechanism by which serotonergic treatment might help alleviate motivational deficits in a range of mental illnesses.

Causal role of the dorsolateral prefrontal cortex in modulating the balance between Pavlovian and instrumental systems in the punishment domain

Previous literature suggests that a balance between Pavlovian and instrumental decision-making systems is critical for optimal decision-making. Pavlovian bias (i.e., approach toward reward-predictive stimuli and avoid punishment-predictive stimuli) often contrasts with the instrumental response. Although recent neuroimaging studies have identified brain regions that may be related to Pavlovian bias, including the dorsolateral prefrontal cortex (dlPFC), it is unclear whether a causal relationship exists. Therefore, we investigated whether upregulation of the dlPFC using transcranial current direct stimulation (tDCS) would reduce Pavlovian bias. In this double-blind study, participants were assigned to the anodal or the sham group; they received stimulation over the right dlPFC for 3 successive days. On the last day, participants performed a reinforcement learning task known as the orthogonalized go/no-go task; this was used to assess each participant's degree of Pavlovian bias in reward and punishment domains. We used computational modeling and hierarchical Bayesian analysis to estimate model parameters reflecting latent cognitive processes, including Pavlovian bias, go bias, and choice randomness. Several computational models were compared; the model with separate Pavlovian bias parameters for reward and punishment domains demonstrated the best model fit. When using a behavioral index of Pavlovian bias, the anodal group showed significantly lower Pavlovian bias in the punishment domain, but not in the reward domain, compared with the sham group. In addition, computational modeling showed that Pavlovian bias parameter in the punishment domain was lower in the anodal group than in the sham group, which is consistent with the behavioral findings. The anodal group also showed a lower go bias and choice randomness, compared with the sham group. These findings suggest that anodal tDCS may lead to behavioral suppression or change in Pavlovian bias in the punishment domain, which will help to improve comprehension of the causal neural mechanism.

The effects of acute tryptophan depletion on instrumental reward learning in anorexia nervosa - an fMRI study

BACKGROUND

The serotonin (5-HT) hypothesis of anorexia nervosa (AN) posits that individuals predisposed toward or recovered from AN (recAN) have a central nervous hyperserotonergic state and therefore restrict food intake as a means to reduce 5-HT availability (via diminished tryptophan-derived precursor supply) and alleviate associated negative mood states. Importantly, the 5-HT system has also been generally implicated in reward processing, which has also been shown to be altered in AN.

METHODS

In this double-blind crossover study, 22 individuals recAN and 25 healthy control participants (HC) underwent functional magnetic resonance imaging (fMRI) while performing an established instrumental reward learning paradigm during acute tryptophan depletion (ATD; a dietary intervention that lowers central nervous 5-HT availability) as well as a sham depletion.

RESULTS

On a behavioral level, the main effects of reward and ATD were evident, but no group differences were found. fMRI analyses revealed a group × ATD × reward level interaction in the ventral anterior insula during reward anticipation as well as in the medial orbitofrontal cortex during reward consumption.

DISCUSSION

The precise pattern of results is suggestive of a 'normalization' of reward-related neural responses during ATD in recAN compared to HC. Our results lend further evidence to the 5-HT hypothesis of AN. Decreasing central nervous 5-HT synthesis and availability during ATD and possibly also by dieting may be a means to normalize 5-HT availability and associated brain processes.

Innate cocaine-seeking vulnerability arising from loss of serotonin-mediated aversive effects of cocaine in rats

Cocaine blocks dopamine reuptake, thereby producing rewarding effects that are widely studied. However, cocaine also blocks serotonin uptake, which we show drives, in rats, individually variable aversive effects that depend on serotonin 2C receptors (5-HT2CRs) in the rostromedial tegmental nucleus (RMTg), a major GABAergic afferent to midbrain dopamine neurons. 5-HT2CRs produce depolarizing effects in RMTg neurons that are particularly strong in some rats, leading to aversive effects that reduce acquisition of and relapse to cocaine seeking. In contrast, 5-HT2CR signaling is largely lost after cocaine exposure in other rats, leading to reduced aversive effects and increased cocaine seeking. These results suggest a serotonergic biological marker of cocaine-seeking vulnerability that can be targeted to modulate drug seeking.

The role of serotonin in modulating common waxbill behaviour

Abstract

Serotonin or 5-hydroxytryptamine (5-HT) is a monoaminergic neurotransmitter that is known to influence behaviour in various animal species. Its actions, however, are complex and not well-understood yet. Here, we tested whether and how two 5-HT receptor agonists and a 5-HT receptor antagonist influence behaviour in common waxbills (Estrilda astrild), focusing on aggression, movement and feeding. We applied acute administration of either 8-OH-DPAT (a 5-HT1A receptor agonist), fluoxetine (a selective serotonin reuptake inhibitor; SSRI) or WAY 100,635 (a 5-HT1A receptor antagonist), and then quantified behaviour in the context of competition for food. Waxbills treated with the SSRI fluoxetine showed an overall decrease of aggressive behaviour, activity and feeding, while we found no significant effects of treatment with the other serotonergic enhancer (8-OH-DPAT) or with the antagonist WAY 100,635. Since both 8-OH-DPAT and WAY 100,635 act mainly on 5-HT1A receptor pathways, while fluoxetine more generally affects 5-HT pathways, our results suggest that receptors other than 5-HT1A are important for serotonergic modulation of waxbill behaviour.

Significance statement

The serotonergic system is of interest for current behavioural research due to its influence on a range of behaviours, including aggression, affiliative behaviour, feeding and locomotion in various species. There are, however, numerous discrepancies regarding the behavioural effects of serotonin across studies. We used acute pharmacological manipulations of the serotonergic system in common waxbills, using two serotonin enhancers (8-OH-DPAT and fluoxetine) and a serotonin blocker (WAY 100,635). Behavioural effects of these pharmacological manipulations on aggressiveness, movement and feeding, during tests of competition over food, indicated an anxiogenic-like effect of fluoxetine, but not of 8-OH-DPAT and WAY 100,635. This suggests a distinct role for different serotonergic pathways on waxbill behaviour.

Serotonin and Dopamine Blood Levels in ADHD-Like Dogs

As with humans, dogs can suffer from attention deficit hyperactivity disorder-like (ADHD-like) behaviors naturally and exhibit high levels of hyperactivity/impulsivity and attention deficit problems, making the domestic dog a potential animal model for ADHD. ADHD has a very complex pathophysiology in which many neurotransmitters are involved, such as serotonin and dopamine. The aim of the study was to evaluate serum serotonin and dopamine levels in dogs with ADHD-like symptomatology. Fifty-eight dogs were studied, of which, thirty-six were classified as ADHD-like after physical and behavioral assessments. Additionally, the dogs’ owners performed a series of scientifically validated questionnaires which included C-BARQ, the Dog Impulsivity Assessment Scale, and the Dog-ADHD rating scale. Serum from every animal was collected after the behavioral assessments and analyzed with commercial ELISA tests for serotonin and dopamine determination. Kruskal–Wallis tests and Lasso regressions were applied to assess the relationships between both neurotransmitters and the ADHD-like behaviors (as assessed by clinical evaluation and through the different questionnaires). The dogs clinically classified as ADHD-like showed lower serotonin and dopamine concentrations. Further, serotonin and dopamine levels were also linked to aggression, hyperactivity, and impulsivity. Decreased serotonin concentrations were also related to fear, attachment, and touch sensitivity. Finally, it must be noted that our data suggested a strong relationship between serotonin and dopamine and ADHD-like behaviors.

The effects of induced positive and negative affect on Pavlovian-instrumental interactions

Across species, animals have an intrinsic drive to approach appetitive stimuli and to withdraw from aversive stimuli. In affective science, influential theories of emotion link positive affect with strengthened behavioural approach and negative affect with avoidance. Based on these theories, we predicted that individuals' positive and negative affect levels should particularly influence their behaviour when innate Pavlovian approach/avoidance tendencies conflict with learned instrumental behaviours. Here, across two experiments - exploratory Experiment 1 (N = 91) and a preregistered confirmatory Experiment 2 (N = 335) - we assessed how induced positive and negative affect influenced Pavlovian-instrumental interactions in a reward/punishment Go/No-Go task. Contrary to our hypotheses, we found no evidence for a main effect of positive/negative affect on either approach/avoidance behaviour or Pavlovian-instrumental interactions. However, we did find evidence that the effects of induced affect on behaviour were moderated by individual differences in self-reported behavioural inhibition and gender. Exploratory computational modelling analyses explained these demographic moderating effects as arising from positive correlations between demographic factors and individual differences in the strength of Pavlovian-instrumental interactions. These findings serve to sharpen our understanding of the effects of positive and negative affect on instrumental behaviour.

Neural circuits provide insights into reward and aversion

Maladaptive changes in the neural circuits associated with reward and aversion result in some common symptoms, such as drug addiction, anxiety, and depression. Historically, the study of these circuits has been hampered by technical limitations. In recent years, however, much progress has been made in understanding the neural mechanisms of reward and aversion owing to the development of technologies such as cell type-specific electrophysiology, neuronal tracing, and behavioral manipulation based on optogenetics. The aim of this paper is to summarize the latest findings on the mechanisms of the neural circuits associated with reward and aversion in a review of previous studies with a focus on the ventral tegmental area (VTA), nucleus accumbens (NAc), and basal forebrain (BF). These findings may inform efforts to prevent and treat mental illnesses associated with dysfunctions of the brain's reward and aversion system.

Cognitive [Computational] Neuroscience Test Reliability and Clinical Applications for Serious Mental Illness (CNTRaCS) Consortium: Progress and Future Directions

The development of treatments for impaired cognition in schizophrenia has been characterized as the most important challenge facing psychiatry at the beginning of the twenty-first century. The Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) project was designed to build on the potential benefits of using tasks and tools from cognitive neuroscience to better understanding and treat cognitive impairments in psychosis. These benefits include: (1) the use of fine-grained tasks that measure discrete cognitive processes; (2) the ability to design tasks that distinguish between specific cognitive domain deficits and poor performance due to generalized deficits resulting from sedation, low motivation, poor test taking skills, etc.; and (3) the ability to link cognitive deficits to specific neural systems, using animal models, neuropsychology, and functional imaging. CNTRICS convened a series of meetings to identify paradigms from cognitive neuroscience that maximize these benefits and identified the steps need for translation into use in clinical populations. The Cognitive Neuroscience Test Reliability and Clinical Applications for Schizophrenia (CNTRaCS) Consortium was developed to help carry out these steps. CNTRaCS consists of investigators at five different sites across the country with diverse expertise relevant to a wide range of the cognitive systems identified as critical as part of CNTRICs. This work reports on the progress and current directions in the evaluation and optimization carried out by CNTRaCS of the tasks identified as part of the original CNTRICs process, as well as subsequent extensions into the Positive Valence systems domain of Research Domain Criteria (RDoC). We also describe the current focus of CNTRaCS, which involves taking a computational psychiatry approach to measuring cognitive and motivational function across the spectrum of psychosis. Specifically, the current iteration of CNTRaCS is using computational modeling to isolate parameters reflecting potentially more specific cognitive and visual processes that may provide greater interpretability in understanding shared and distinct impairments across psychiatric disorders.

Aversive Pavlovian inhibition in adult attention-deficit/hyperactivity disorder and its restoration by mindfulness-based cognitive therapy

Background

Control over the tendency to make or withhold responses guided by contextual Pavlovian information plays a key role in understanding impulsivity and hyperactivity. Here we set out to assess (1) the understudied relation between contextual Pavlovian inhibitory control and hyperactivity/impulsivity in adults with ADHD and (2) whether this inhibition can be enhanced by mindfulness based cognitive therapy (MBCT).

Methods

Within the framework of a randomized controlled trial 50 Adult ADHD patients were assessed before and after 8 weeks of treatment as usual (TAU) with (n = 24) or without (n = 26) MBCT. We employed a well-established behavioral Pavlovian-to-instrumental transfer task that quantifies Pavlovian inhibitory control over instrumental behavior.

Results

Task results revealed (1) less aversive Pavlovian inhibition in ADHD patients with clinically relevant hyperactivity/impulsivity than in those without; and (2) enhanced Pavlovian inhibition across all ADHD patients after TAU+MBCT compared with TAU.

Conclusion

These findings offer new insights in the neurocognitive mechanisms of hyperactivity/impulsivity in ADHD and its treatment: We reveal a role for Pavlovian inhibitory mechanisms in understanding hyperactive/impulsive behaviors in ADHD and point toward MBCT as an intervention that might influence these mechanisms.

What Can Reinforcement Learning Models of Dopamine and Serotonin Tell Us about the Action of Antidepressants?

Although evidence suggests that antidepressants are effective at treating depression, the mechanisms behind antidepressant action remain unclear, especially at the cognitive/computational level. In recent years, reinforcement learning (RL) models have increasingly been used to characterise the roles of neurotransmitters and to probe the computations that might be altered in psychiatric disorders like depression. Hence, RL models might present an opportunity for us to better understand the computational mechanisms underlying antidepressant effects. Moreover, RL models may also help us shed light on how these computations may be implemented in the brain (e.g., in midbrain, striatal, and prefrontal regions) and how these neural mechanisms may be altered in depression and remediated by antidepressant treatments. In this paper, we evaluate the ability of RL models to help us understand the processes underlying antidepressant action. To do this, we review the preclinical literature on the roles of dopamine and serotonin in RL, draw links between these findings and clinical work investigating computations altered in depression, and appraise the evidence linking modification of RL processes to antidepressant function. Overall, while there is no shortage of promising ideas about the computational mechanisms underlying antidepressant effects, there is insufficient evidence directly implicating these mechanisms in the response of depressed patients to antidepressant treatment. Consequently, future studies should investigate these mechanisms in samples of depressed patients and assess whether modifications in RL processes mediate the clinical effect of antidepressant treatments.

Freezing revisited: coordinated autonomic and central optimization of threat coping

Animals have sophisticated mechanisms for coping with danger. Freezing is a unique state that, upon threat detection, allows evidence to be gathered, response possibilities to be previsioned and preparations to be made for worst-case fight or flight. We propose that - rather than reflecting a passive fear state - the particular somatic and cognitive characteristics of freezing help to conceal overt responses, while optimizing sensory processing and action preparation. Critical for these functions are the neurotransmitters noradrenaline and acetylcholine, which modulate neural information processing and also control the sympathetic and parasympathetic branches of the autonomic nervous system. However, the interactions between autonomic systems and the brain during freezing, and the way in which they jointly coordinate responses, remain incompletely explored. We review the joint actions of these systems and offer a novel computational framework to describe their temporally harmonized integration. This reconceptualization of freezing has implications for its role in decision-making under threat and for psychopathology.

A meta-analytic study of the effects of early maternal separation on cognitive flexibility in rodent offspring

Adverse early life experiences, such as maternal separation, are associated with an increased risk for several mental health problems. Symptoms induced by maternal separation that mirror clinically relevant aspects of mental problems, such as cognitive inflexibility, open the possibility of testing putative therapeutics prior to clinical development. Although several animal (e.g., rodent) studies have evaluated the effects of early maternal separation on cognitive flexibility, no consistent conclusions have been drawn. To clarify this issue, in this study, a meta-analysis method was used to systematically explore the relationship between early maternal separation and cognitive flexibility in rodent offspring. Results indicate that early maternal separation could significantly impair cognitive flexibility in rodent offspring. Moderator analyses further showed that the relationship between early maternal separation and cognitive flexibility was not consistent in any case, but was moderated by variations in the experimental procedures, such as the deprivation levels, task characteristics, and rodent strains. These clarify the inconsistent effects of maternal separation on cognitive flexibility in rodents and help us better understand the association between early life adversity and cognitive development.

•

Meta-analysis method was used to discuss the inconsistent effects of maternal separation on cognitive flexibility in rodent.

•

Maternal separation was found to necessarily impair the cognitive flexibility in rodent.

•

Variations in the experimental procedures moderated the relationship between maternal separation and cognitive flexibility.

•

Further studies on environment-cognition associations in rodents should take experimental procedural factors into account.

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the "brake" on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory "drive." For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the "drive" and "brake" circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Neuromodulation of prefrontal cortex cognitive function in primates: the powerful roles of monoamines and acetylcholine

The primate prefrontal cortex (PFC) subserves our highest order cognitive operations, and yet is tremendously dependent on a precise neurochemical environment for proper functioning. Depletion of noradrenaline and dopamine, or of acetylcholine from the dorsolateral PFC (dlPFC), is as devastating as removing the cortex itself, and serotonergic influences are also critical to proper functioning of the orbital and medial PFC. Most neuromodulators have a narrow inverted U dose response, which coordinates arousal state with cognitive state, and contributes to cognitive deficits with fatigue or uncontrollable stress. Studies in monkeys have revealed the molecular signaling mechanisms that govern the generation and modulation of mental representations by the dlPFC, allowing dynamic regulation of network strength, a process that requires tight regulation to prevent toxic actions, e.g., as occurs with advanced age. Brain imaging studies in humans have observed drug and genotype influences on a range of cognitive tasks and on PFC circuit functional connectivity, e.g., showing that catecholamines stabilize representations in a baseline-dependent manner. Research in monkeys has already led to new treatments for cognitive disorders in humans, encouraging future research in this important field.

The Aversion Function of the Limbic Dopaminergic Neurons and Their Roles in Functional Neurological Disorders

The Freudian theory of conversion suggested that the major symptoms of functional neurological disorders (FNDs) are due to internal conflicts at motivation, especially at the sex drive or libido. FND patients might behave properly at rewarding situations, but they do not know how to behave at aversive situations. Sex drive is the major source of dopamine (DA) release in the limbic area; however, the neural mechanism involved in FND is not clear. Dopaminergic (DAergic) neurons have been shown to play a key role in processing motivation-related information. Recently, DAergic neurons are found to be involved in reward-related prediction error, as well as the prediction of aversive information. Therefore, it is suggested that DA might change the rewarding reactions to aversive reactions at internal conflicts of FND. So DAergic neurons in the limbic areas might induce two major motivational functions: reward and aversion at internal conflicts. This article reviewed the recent advances on studies about DAergic neurons involved in aversive stimulus processing at internal conflicts and summarizes several neural pathways, including four limbic system brain regions, which are involved in the processing of aversion. Then the article discussed the vital function of these neural circuits in addictive behavior, depression treatment, and FNDs. In all, this review provided a prospect for future research on the aversion function of limbic system DA neurons and the therapy of FNDs.

A single dose of escitalopram blunts the neural response in the thalamus and caudate during monetary loss

BACKGROUND

Selective serotonin reuptake inhibitors (SSRIs) show acute effects on the neural processes associated with negative affective bias in healthy people and people with depression. However, whether and how SSRIs also affect reward and punishment processing on a similarly rapid time scale remains unclear.

METHODS

We investigated the effects of an acute and clinically relevant dose (20 mg) of the SSRI escitalopram on brain response during reward and punishment processing in 19 healthy participants. In a doubleblind, placebo-controlled study using functional MRI, participants performed a well-established monetary reward task at 3 time points: at baseline; after receiving placebo or escitalopram; and after receiving placebo or escitalopram following an 8-week washout period.

RESULTS

Acute escitalopram administration reduced blood-oxygen-level-dependent (BOLD) response during punishment feedback in the right thalamus (family-wise error corrected [FWE] p = 0.013 at peak level) and the right caudate head (pFWE = 0.011 at peak level) compared to placebo. We did not detect any significant BOLD changes during reward feedback.

LIMITATIONS

We included only healthy participants, so interpretation of findings are limited to the healthy human brain and require future testing in patient populations. The paradigm we used was based on monetary stimuli, and results may not be generalizable to other forms of reward.

CONCLUSION

Our findings extend theories of rapid SSRI action on the neural processing of rewarding and aversive stimuli and suggest a specific and acute effect of escitalopram in the punishment neurocircuitry.

The role of tryptophan metabolic pathway in children with attention deficit hyperactivity disorder with and without comorbid oppositional defiant disorder and conduct disorder

Accumulating data presented that tryptophan metabolic pathway (TMP) may play a role in attention-deficit/hyperactivity disorder (ADHD). However, no study have investigated potential role of TMP in disruptive behavior disorders coexisting with ADHD. This study compared serum levels of tryptophan, kynurenine, kynurenic acid, 3-hydroxykynurenine and 3-hydroxyantranilic acid in medication-free children with ADHD combined presentation (ADHD-C), with ADHD-C and oppositional defiant disorder (ODD), and with ADHD-C and conduct disorder (CD) versus healthy controls. The study also compared several ratios that are previously suggested to reflect the activities of the KP enzymes (kynurenine/tryptophan, kynurenic acid/kynurenine, 3-hydroxykynurenine/kynurenine) or neuroprotective activity (kynurenic acid/3-hydroxykynurenine) among groups. A total of 122 patients were enrolled: 46 children with ADHD-C alone, 43 children with ADHD-C+ODD, 33 children with ADHD-C+CD and 50 healthy controls. Targeted biochemical molecules were assessed by liquid chromatography-mass spectrometry/mass spectrometry. Compared to control group, serum kynurenine levels were significantly higher in the ADHD-C group, serum 3-hydroxykynurenine levels were significantly lower in the ADHD-C and ADHD-C+ODD groups, the serum kynurenic acid/kynurenine ratio was significantly higher in the ADHD-C, ADHD-C+ODD and ADHD-C+CD groups, and the serum 3-hydroxykynurenine/kynurenine ratio was significantly lower in the ADHD-C group. These findings suggest that TMP may play a role in the pathophysiology of ADHD-C.

Acute tryptophan depletion in healthy subjects increases preferences for negative reciprocity

Reciprocity motivates to reward those who are kind (= positive reciprocity) and to punish those who are unkind (= negative reciprocity). The neurotransmitter serotonin (5-HT) modulates human behavior in numerous social situations, such as retaliation in response to perceived unfairness. In a placebo-controlled study, we used acute tryptophan depletion (ATD) to investigate the influence of available serotonin on choice behavior and reciprocity in the Hawk-Dove game. This game illustrates a conflict situation and incorporates two potential strategies: the cooperative Dove strategy and the uncooperative, more aggressive Hawk strategy. After strategic choices, we elicited the subjects' expectations (= beliefs) regarding the opponent's choices and controlled for risk preferences and current mood. We defined strategy choices as negative reciprocity when the participants opted for Hawk in response to an expected Hawk. We hypothesized that the ATD-induced reduction of 5-HT availability would increase participants' preferences for negative reciprocity. Generalized estimating equations reveal no significant main effect of ATD on assessed belief, mood, or risk attitude. But assessment of ATD's marginal effects over beliefs suggests that ATD significantly increases the tendency for negative reciprocity, whereas positive reciprocity (Dove in response to an expected Dove) is unaffected. We could therefore demonstrate that 5-HT availability mediates (negative) reciprocal behavior in social decision-making.

A comparison of 'pruning' during multi-step planning in depressed and healthy individuals

BACKGROUND

Real-life decisions are often complex because they involve making sequential choices that constrain future options. We have previously shown that to render such multi-step decisions manageable, people 'prune' (i.e. selectively disregard) branches of decision trees that contain negative outcomes. We have theorized that sub-optimal pruning contributes to depression by promoting an oversampling of branches that result in unsavoury outcomes, which results in a negatively-biased valuation of the world. However, no study has tested this theory in depressed individuals.

METHODS

Thirty unmedicated depressed and 31 healthy participants were administered a sequential reinforcement-based decision-making task to determine pruning behaviours, and completed measures of depression and anxiety. Computational, Bayesian and frequentist analyses examined group differences in task performance and relationships between pruning and depressive symptoms.

RESULTS

Consistent with prior findings, participants robustly pruned branches of decision trees that began with large losses, regardless of the potential utility of those branches. However, there was no group difference in pruning behaviours. Further, there was no relationship between pruning and levels of depression/anxiety.

CONCLUSIONS

We found no evidence that sub-optimal pruning is evident in depression. Future research could determine whether maladaptive pruning behaviours are observable in specific sub-groups of depressed patients (e.g. in treatment-resistant individuals), or whether misuse of other heuristics may contribute to depression.

Eating to dare - Nutrition impacts human risky decision and related brain function

Macronutrient composition modulates plasma amino acids that are precursors of neurotransmitters and can impact brain function and decisions. Neurotransmitter serotonin has been shown to regulate not only food intake, but also economic decisions. We investigated whether an acute nutrition-manipulation inducing plasma tryptophan fluctuation affects brain function, thereby affecting risky decisions. Breakfasts differing in carbohydrate/protein ratios were offered to test changes in risky decision-making while metabolic and neural dynamics were tracked. We identified that a high-carbohydrate/protein breakfast increased plasma tryptophan/LNAA (large neutral amino acids) ratio which mapped to individual risk propensity changes. The nutrition-manipulation and tryptophan/LNAA fluctuation effects on risk propensity changes were further modulated by individual differences in body fat mass. Using fMRI, we further identified activation in the parietal lobule during risk-processing, of which activities 1) were sensitive to the tryptophan/LNAA fluctuation, 2) were modulated by individual's body fat mass, and 3) predicted the risk propensity changes in decision-making. Our results provide evidence for a personalized nutrition-driven modulation on human risky decision and its metabolic and neural mechanisms.

Emotion Induced Monoamine Neuromodulator Release Affects Functional Neurological Disorders

Functional neurologic disorders (FNDs), also called conversion disorder (previously called hysteria), can show almost all the symptoms of other neurological diseases, including both physical (for example, seizure, weakness, fatigue) and psychological (for instance, depression, anxiety) symptoms. In spite of our general knowledge about emotional processes and developmental defects in the formation of these somatic symptoms, there is still no systemic and comprehensive research on the effects of emotional developmental variables in FND. Recently, both experimental and theoretical emotion studies have been greatly increased, such as prediction error, conceptual act model, basic emotional theory, and monoamine neuromodulator based three primary emotions. In addition, a large amount of evidence has confirmed the role of psychosocial adversity (such as stressful life events, interpersonal difficulties) as an important risk factor for FND. Here, we review recent advances about emotional stress on FND, and pay special attention to the effects of monoamine neuromodulators, such as how norepinephrine and serotonin affect behaviors. Then, we discuss the significance of these changes for FND, which may contribute to clarifying the pathogenesis of FND, and thus provide potential therapeutic drug targets or psychological intervention methods in the future.

Neural signatures of arbitration between Pavlovian and instrumental action selection

Pavlovian associations drive approach towards reward-predictive cues, and avoidance of punishment-predictive cues. These associations “misbehave” when they conflict with correct instrumental behavior. This raises the question of how Pavlovian and instrumental influences on behavior are arbitrated. We test a computational theory according to which Pavlovian influence will be stronger when inferred controllability of outcomes is low. Using a model-based analysis of a Go/NoGo task with human subjects, we show that theta-band oscillatory power in frontal cortex tracks inferred controllability, and that these inferences predict Pavlovian action biases. Functional MRI data revealed an inferior frontal gyrus correlate of action probability and a ventromedial prefrontal correlate of outcome valence, both of which were modulated by inferred controllability.

Using a combination of computational modeling, neuroimaging (both EEG and fMRI), and behavioral analysis, we present evidence for a dual-process architecture in which Pavlovian and instrumental action values are adaptively combined through a Bayesian arbitration mechanism. Building on prior research, we find neural signatures of this arbitration mechanism in frontal cortex. In particular, we show that trial-by-trial changes in Pavlovian influences on action can be predicted by our computational model, and are reflected in midfrontal theta power, as well as inferior frontal and ventromedial prefrontal cortex fMRI responses.

Influence of ovarian hormones on value-based decision-making systems: Contribution to sexual dimorphisms in mental disorders

Women and men exhibit differences in behavior when making value-based decisions. Various hypotheses have been proposed to explain these findings, stressing differences in functional lateralization of the brain, functional activation, neurotransmitter involvement and more recently, sex hormones. While a significant interaction of neurotransmitter systems and sex hormones has been shown for both sexes, decision-making in women might be particularly affected by variations of ovarian hormones. In this review we have gathered information from animal and human studies on how ovarian hormones affect decision-making processes in females by interacting with neurotransmitter systems at functionally relevant brain locations and thus modify the computation of decision aspects. We also review previous findings on impaired decision-making in animals and clinical populations with substance use disorder and depression, emphasizing how little we know about the role of ovarian hormones in aberrant decision-making.

Serotonin depletion impairs both Pavlovian and instrumental reversal learning in healthy humans

Serotonin is involved in updating responses to changing environmental circumstances. Optimising behaviour to maximise reward and minimise punishment may require shifting strategies upon encountering new situations. Likewise, autonomic responses to threats are critical for survival yet must be modified as danger shifts from one source to another. Whilst numerous psychiatric disorders are characterised by behavioural and autonomic inflexibility, few studies have examined the contribution of serotonin in humans. We modelled both processes, respectively, in two independent experiments (N = 97). Experiment 1 assessed instrumental (stimulus-response-outcome) reversal learning whereby individuals learned through trial and error which action was most optimal for obtaining reward or avoiding punishment initially, and the contingencies subsequently reversed serially. Experiment 2 examined Pavlovian (stimulus-outcome) reversal learning assessed by the skin conductance response: one innately threatening stimulus predicted receipt of an uncomfortable electric shock and another did not; these contingencies swapped in a reversal phase. Upon depleting the serotonin precursor tryptophan-in a double-blind randomised placebo-controlled design-healthy volunteers showed impairments in updating both actions and autonomic responses to reflect changing contingencies. Reversal deficits in each domain, furthermore, were correlated with the extent of tryptophan depletion. Initial Pavlovian conditioning, moreover, which involved innately threatening stimuli, was potentiated by depletion. These results translate findings in experimental animals to humans and have implications for the neurochemical basis of cognitive inflexibility.

Effects of dopamine on reinforcement learning in Parkinson's disease depend on motor phenotype

Parkinson's disease is clinically defined by bradykinesia, along with rigidity and tremor. However, the severity of these motor signs is greatly variable between individuals, particularly the presence or absence of tremor. This variability in tremor relates to variation in cognitive/motivational impairment, as well as the spatial distribution of neurodegeneration in the midbrain and dopamine depletion in the striatum. Here we ask whether interindividual heterogeneity in tremor symptoms could account for the puzzlingly large variability in the effects of dopaminergic medication on reinforcement learning, a fundamental cognitive function known to rely on dopamine. Given that tremor-dominant and non-tremor Parkinson's disease patients have different dopaminergic phenotypes, we hypothesized that effects of dopaminergic medication on reinforcement learning differ between tremor-dominant and non-tremor patients. Forty-three tremor-dominant and 20 non-tremor patients with Parkinson's disease were recruited to be tested both OFF and ON dopaminergic medication (200/50 mg levodopa-benserazide), while 22 age-matched control subjects were recruited to be tested twice OFF medication. Participants performed a reinforcement learning task designed to dissociate effects on learning rate from effects on motivational choice (i.e. the tendency to 'Go/NoGo' in the face of reward/threat of punishment). In non-tremor patients, dopaminergic medication improved reward-based choice, replicating previous studies. In contrast, in tremor-dominant patients, dopaminergic medication improved learning from punishment. Formal modelling showed divergent computational effects of dopaminergic medication as a function of Parkinson's disease motor phenotype, with a modulation of motivational choice bias and learning rate in non-tremor and tremor patients, respectively. This finding establishes a novel cognitive/motivational difference between tremor and non-tremor Parkinson's disease patients, and highlights the importance of considering motor phenotype in future work.

The Role of Tryptophan and Tyrosine in Executive Function and Reward Processing

The serotonergic precursor tryptophan and the dopaminergic precursor tyrosine have been shown to be important modulators of mood, behaviour and cognition. Specifically, research on the function of tryptophan has characterised this molecule as particularly relevant in the context of pathological disorders such as depression. Moreover, a large body of evidence has now been accumulated to suggest that tryptophan may also be involved in executive function and reward processing. Despite some clear differentiation with tryptophan, the data reviewed in this paper illustrates that tyrosine shares similar functions with tryptophan in the regulation of executive function and reward, and that these processes in turn, rather than acting in isolation, causally influence each other.

Adolescents exhibit reduced Pavlovian biases on instrumental learning

Multiple learning systems allow individuals to flexibly respond to opportunities and challenges present in the environment. An evolutionarily conserved "Pavlovian" learning mechanism couples valence and action, promoting a tendency to approach cues associated with reward and to inhibit action in the face of anticipated punishment. Although this default response system may be adaptive, these hard-wired reactions can hinder the ability to learn flexible "instrumental" actions in pursuit of a goal. Such constraints on behavioral flexibility have been studied extensively in adults. However, the extent to which these valence-specific response tendencies bias instrumental learning across development remains poorly characterized. Here, we show that while Pavlovian response biases constrain flexible action learning in children and adults, these biases are attenuated in adolescents. This adolescent-specific reduction in Pavlovian bias may promote unbiased exploration of approach and avoidance responses, facilitating the discovery of rewarding behavior in the many novel contexts that adolescents encounter.

Psychological mechanisms and functions of 5-HT and SSRIs in potential therapeutic change: Lessons from the serotonergic modulation of action selection, learning, affect, and social cognition

Uncertainty regarding which psychological mechanisms are fundamental in mediating SSRI treatment outcomes and wide-ranging variability in their efficacy has raised more questions than it has solved. Since subjective mood states are an abstract scientific construct, only available through self-report in humans, and likely involving input from multiple top-down and bottom-up signals, it has been difficult to model at what level SSRIs interact with this process. Converging translational evidence indicates a role for serotonin in modulating context-dependent parameters of action selection, affect, and social cognition; and concurrently supporting learning mechanisms, which promote adaptability and behavioural flexibility. We examine the theoretical basis, ecological validity, and interaction of these constructs and how they may or may not exert a clinical benefit. Specifically, we bridge crucial gaps between disparate lines of research, particularly findings from animal models and human clinical trials, which often seem to present irreconcilable differences. In determining how SSRIs exert their effects, our approach examines the endogenous functions of 5-HT neurons, how 5-HT manipulations affect behaviour in different contexts, and how their therapeutic effects may be exerted in humans - which may illuminate issues of translational models, hierarchical mechanisms, idiographic variables, and social cognition.

Proactive engagement of cognitive control modulates implicit approach-avoidance bias

Implicit social-affective biases-reflected in a propensity to approach positive and avoid negative stimuli-have been documented in humans with paradigms, such as the Approach-Avoidance Task (AAT). However, the degree to which preemptively engaging cognitive control can help to down-regulate those behavioral tendencies remains poorly understood. While undergoing functional magnetic resonance imaging (fMRI), 24 healthy participants completed a cued version of the AAT, in which they responded to pictures of happy or angry faces by pulling a joystick toward themselves (approach) or pushing the joystick away (avoidance) based on the color of the stimulus frame. On some trials, they were cued to reverse the frame color/joystick action instructions. Before stimulus onset, a reverse cue was associated with deactivation of a visuo-spatial and motor planning network and subsequent slowing down in response to stimuli. During the stimulus phase, a reverse cue was associated with a) activation of cognitive control areas, including the right inferior frontal gyrus (IFG) and right inferior parietal lobule (IPL); and b) reduced right precentral gyrus activation when having to push (avoid) a happy face. Overall, these results suggest that proactively engaging cognitive control can help fine-tune behavioral and neural adjustment to emotionally incongruent behavioral conditions.

Disgust selectively dampens value-independent risk-taking for potential gains

Despite intricate interactions between emotion and decision making, the underlying cognitive mechanisms that govern their relationship remain elusive. Recent theoretical and empirical advances suggest that preferences in risky decision making can arise from the computation of subjective utility (value-dependent) or direct approach-avoidance action tendencies (value-independent). Here, 48 participants performed two gambling tasks (accept/reject and choice selection tasks) under the emotion manipulation (neutral versus disgust) to investigate how decision context and emotion may influence risk preference via the value-dependent and -independent pathways. The results showed that the decision context affected the degree to which both value-dependent and -independent systems were engaged. Crucially, however, the disgust emotion had a selective effect on participants' choices in the accept/reject task. Furthermore, computational analyses revealed that this specific effect resulted from a reduced propensity to gamble for potential gains by engaging only the value-independent system. These results indicate dissociative effects of decision context and emotion and suggest a specific route by which disgust influences choice preference in risky decision making.

Biomarkers for moral cognition: Current status and future prospects for neurotransmitters and neuropeptides

The translational neuroscience of moral cognitions draws together developments throughout the fields of neuroscience pertaining to moral cognitions in order to better the human condition. That condition, seen through this lens, is one in which much of the violence and suffering we endure and inflict upon one another is based on moral cognitions-attitudes, beliefs, judgments-that are thought to result from correct or incorrect perceptions of moral properties. The biology tells a different story; namely, that moral cognitions, like other cognitions and mental states, are predicted and determined by biological mechanisms modulated by genotype, neurotransmitter availability and receptor density, neurophysiology, and individual differences among these as well as biology-environment interactions including nutrition, experience, and microbiome. A wealth of research has demonstrated that moral reasoning and judgments are easily alterable with the application of pharmaceuticals including SSRIs, and simpler treatments and conditions like the amount of time since one's last meal. Public health experts have pushed for analysis of violence and development of interventions treating violence as a public health pandemic. We see this research as a response to that call. Work in this field demonstrates that we are unaware of both the sources and nature of the cognitions on which we base much of our violent behaviors, societally and individually. Animal studies bolster the human subjects research, demonstrating the evolutionary roots of the causal mechanisms beneath our social structures and group formations.

Interfering with a memory without erasing its trace

Previous research has shown that performance of a novice skill can be easily interfered with by subsequent training of another skill. We address the open questions whether extensively trained skills show the same vulnerability to interference as novice skills and which memory mechanism regulates interference between expert skills. We developed a recurrent neural network model of V1 able to learn from feedback experienced over the course of a long-term orientation discrimination experiment. After first exposing the model to one discrimination task for 3480 consecutive trials, we assessed how its performance was affected by subsequent training in a second, similar task. Training the second task strongly interfered with the first (highly trained) discrimination skill. The magnitude of interference depended on the relative amounts of training devoted to the different tasks. We used these and other model outcomes as predictions for a perceptual learning experiment in which human participants underwent the same training protocol as our model. Specifically, over the course of three months participants underwent baseline training in one orientation discrimination task for 15 sessions before being trained for 15 sessions on a similar task and finally undergoing another 15 sessions of training on the first task (to assess interference). Across all conditions, the pattern of interference observed empirically closely matched model predictions. According to our model, behavioral interference can be explained by antagonistic changes in neuronal tuning induced by the two tasks. Remarkably, this did not stem from erasing connections due to earlier learning but rather from a reweighting of lateral inhibition.

Monoaminergic modulation of decision-making under risk of punishment in a rat model

The ability to decide advantageously among options that vary in both their risks and rewards is critical for survival and well-being. Previous work shows that some forms of risky decision-making are robustly modulated by monoamine signaling, but it is less clear how monoamine signaling modulates decision-making under risk of explicit punishment. The goal of these experiments was to determine how this form of decision-making is modulated by dopamine, serotonin, and norepinephrine signaling, using a task in which rats choose between a small, 'safe' food reward and a large food reward associated with variable risks of punishment. Preference for the large, risky reward (risk-taking) was reduced by administration of a D2/3 dopamine receptor agonist (bromocriptine) and a selective D2 agonist (sumanirole). The selective D3 agonist PD128907 appeared to attenuate reward discrimination abilities but did not affect risk-taking per se. In contrast, drugs targeting serotonergic and noradrenergic signaling had few if any effects on choice behavior. These data suggest that in contrast to other forms of risky decision-making, decision-making under risk of punishment is selectively modulated by dopamine signaling, predominantly through D2 receptors.

Neuroinflammation as a risk factor for attention deficit hyperactivity disorder

Attention Deficit Hyperactivity Disorder (ADHD) is a persistent, and impairing pediatric-onset neurodevelopmental condition. Its high prevalence, and recurrent controversy over its widespread identification and treatment, drive strong interest in its etiology and mechanisms. Emerging evidence for a role for neuroinflammation in ADHD pathophysiology is of great interest. This evidence includes 1) the above-chance comorbidity of ADHD with inflammatory and autoimmune disorders, 2) initial studies indicating an association with ADHD and increased serum cytokines, 3) preliminary evidence from genetic studies demonstrating associations between polymorphisms in genes associated with inflammatory pathways and ADHD, 4) emerging evidence that early life exposure to environmental factors may increase risk for ADHD via an inflammatory mechanism, and 5) mechanistic evidence from animal models of maternal immune activation documenting behavioral and neural outcomes consistent with ADHD. Prenatal exposure to inflammation is associated with changes in offspring brain development including reductions in cortical gray matter volume and the volume of certain cortical areas -parallel to observations associated with ADHD. Alterations in neurotransmitter systems, including the dopaminergic, serotonergic and glutamatergic systems, are observed in ADHD populations. Animal models provide strong evidence that development and function of these neurotransmitters systems are sensitive to exposure to in utero inflammation. In summary, accumulating evidence from human studies and animal models, while still incomplete, support a potential role for neuroinflammation in the pathophysiology of ADHD. Confirmation of this association and the underlying mechanisms have become valuable targets for research. If confirmed, such a picture may be important in opening new intervention routes.

Parameters as Trait Indicators: Exploring a Complementary Neurocomputational Approach to Conceptualizing and Measuring Trait Differences in Emotional Intelligence

Current assessments of trait emotional intelligence (EI) rely on self-report inventories. While this approach has seen considerable success, a complementary approach allowing objective assessment of EI-relevant traits would provide some potential advantages. Among others, one potential advantage is that it would aid in emerging efforts to assess the brain basis of trait EI, where self-reported competency levels do not always match real-world behavior. In this paper, we review recent experimental paradigms in computational cognitive neuroscience (CCN), which allow behavioral estimates of individual differences in range of parameter values within computational models of neurocognitive processes. Based on this review, we illustrate how several of these parameters appear to correspond well to EI-relevant traits (i.e., differences in mood stability, stress vulnerability, self-control, and flexibility, among others). In contrast, although estimated objectively, these parameters do not correspond well to the optimal performance abilities assessed within competing “ability models” of EI. We suggest that adapting this approach from CCN—by treating parameter value estimates as objective trait EI measures—could (1) provide novel research directions, (2) aid in characterizing the neural basis of trait EI, and (3) offer a promising complementary assessment method.