Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders

Inhibition of the basolateral amygdala to prelimbic cortex pathway enhances risk-taking during risky decision-making shock task in rats

Many animal studies have explored decision-making under risk and punishment, particularly regarding potential rewards, but less focus has been placed on contexts involving net losses. Understanding decision-making under net loss conditions can shed light on the neural mechanisms involved. The basolateral amygdala to prelimbic cortex (BLA→PL) pathway is crucial for risky decision-making. In this study, we investigated how rats make decisions under no-reward but shock conditions, specifically examining the role of the BLA→PL pathway. In the risky decision-making shock task (RDST), rats chose between a "small/certain" lever, which consistently delivered one pellet, and a "large/risky" lever, offering variable rewards with a 50 % probability of reward and a 50 % probability of 1-s foot-shock. The results showed that the shock condition decreased the preference for the large/risky lever, despite increasing rewards. Importantly, inhibiting the BLA→PL pathway significantly increased the selection of the "large/risky" lever compared to the control. Although rats in the clozapine N-oxide (CNO) group did not exhibit significant differences in response latency between levers, they exhibited heightened sensitivity to rewards and losses, suggesting that the BLA→PL pathway affects the encoding of the relationship between aversive stimuli and reward-seeking. Overall, these results provide valuable insights into the neural mechanisms of risk-taking, particularly regarding how inhibition in the BLA→PL pathway can influence reward processing and decision-making under no-reward but shock conditions, with implications for understanding risk-related psychiatric disorders.

Effects of chronic stress on cognitive function - From neurobiology to intervention

Exposure to chronic stress contributes considerably to the development of cognitive impairments in psychiatric disorders such as depression, generalized anxiety disorder (GAD), obsessive-compulsive disorder (OCD), post-traumatic stress disorder (PTSD), and addictive behavior. Unfortunately, unlike mood-related symptoms, cognitive impairments are not effectively treated by available therapies, a situation in part resulting from a still incomplete knowledge of the neurobiological substrates that underly cognitive domains and the difficulty in generating interventions that are both efficacious and safe. In this review, we will present an overview of the cognitive domains affected by stress with a specific focus on cognitive flexibility, behavioral inhibition, and working memory. We will then consider the effects of stress on neuronal correlates of cognitive function and the factors which may modulate the interaction of stress and cognition. Finally, we will discuss intervention strategies for treatment of stress-related disorders and gaps in knowledge with emerging new treatments under development. Understanding how cognitive impairment occurs during exposure to chronic stress is crucial to make progress towards the development of new and effective therapeutic approaches.

Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when confronting reward uncertainty. However, it has been unclear whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider these attributes to make a choice. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes, and this population tended to integrate the attributes in a manner that reflected monkeys' preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how the DRN participates in value computations, guiding theories about the role of the DRN in decision-making and psychiatric disease.

Methylphenidate, but not citalopram, decreases impulsive choice in rats performing a temporal discounting task

Introduction

Drugs targeting monoamine systems remain the most common treatment for disorders with impulse control impairments. There is a body of literature suggesting that drugs affecting serotonin reuptake and dopamine reuptake can modulate distinct aspects of impulsivity - though such tests are often performed using distinct behavioral tasks prohibiting easy comparisons.

Methods

Here, we directly compare pharmacologic agents that affect dopamine (methylphenidate) vs serotonin (citalopram) manipulations on choice impulsivity in a temporal discounting task where rats could choose between a small, immediate reward or a large reward delayed at either 2 or 10s. In control conditions, rats preferred the large reward at a small (2s) delay and discounted the large reward at a long (10s) delay.

Results

Methylphenidate, a dopamine transport inhibitor that blocks reuptake of dopamine, dose-dependently increased large reward preference in the long delay (10s) block. Citalopram, a selective serotonin reuptake inhibitor, had no effect on temporal discounting behavior. Impulsive behavior on the temporal discounting task was at least partially mediated by the nucleus accumbens shell. Bilateral lesions to the nucleus accumbens shell reduced choice impulsivity during the long delay (10s) block. Following lesions, methylphenidate did not impact impulsivity.

Discussion

Our results suggest that striatal dopaminergic systems modulate choice impulsivity via actions within the nucleus accumbens shell, whereas serotonin systems may regulate different aspects of behavioral inhibition/impulsivity.

Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice

The ability to persist toward a desired objective is a fundamental aspect of behavioral control whose impairment is implicated in several behavioral disorders. One of the prominent features of behavioral persistence is that its maturation occurs relatively late in development. This is presumed to echo the developmental time course of a corresponding circuit within late-maturing parts of the brain, such as the prefrontal cortex, but the specific identity of the responsible circuits is unknown. Here, we used a genetic approach to describe the maturation of the projection from layer 5 neurons of the neocortex to the dorsal raphe nucleus in mice. Using optogenetic-assisted circuit mapping, we show that this projection undergoes a dramatic increase in synaptic potency between postnatal weeks 3 and 8, corresponding to the transition from juvenile to adult. We then show that this period corresponds to an increase in the behavioral persistence that mice exhibit in a foraging task. Finally, we used a genetic targeting strategy that primarily affected neurons in the medial prefrontal cortex, to selectively ablate this pathway in adulthood and show that mice revert to a behavioral phenotype similar to juveniles. These results suggest that frontal cortical to dorsal raphe input is a critical anatomical and functional substrate of the development and manifestation of behavioral persistence.

Not all discounts are created equal: Regional activity and brain networks in temporal and effort discounting

Reward outcomes associated with costs like time delay and effort investment are generally discounted in decision-making. Standard economic models predict rewards associated with different types of costs are devalued in a similar manner. However, our review of rodent lesion studies indicated partial dissociations between brain regions supporting temporal- and effort-based decision-making. Another debate is whether options involving low and high costs are processed in different brain substrates (dual-system) or in the same regions (single-system). This research addressed these issues using coordinate-based, connectivity-based, and activation network-based meta-analyses to identify overlapping and separable neural systems supporting temporal (39 studies) and effort (20 studies) discounting. Coordinate-based activation likelihood estimation and resting-state connectivity analyses showed immediate-small reward and delayed-large reward choices engaged distinct regions with unique connectivity profiles, but their activation network mapping was found to engage the default mode network. For effort discounting, salience and sensorimotor networks supported low-effort choices, while the frontoparietal network supported high-effort choices. There was little overlap between the temporal and effort networks. Our findings underscore the importance of differentiating different types of costs in decision-making and understanding discounting at both regional and network levels.

Dorsal raphe neurons signal integrated value during multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Evolutionary and neuroendocrine foundations of human aggression

Humans present a behavioural paradox: they are peaceful in many circumstances, but they are also violent and kill conspecifics at high rates. We describe a social evolutionary theory to resolve this paradox. The theory interprets human aggression as a combination of low propensities for reactive aggression and coercive behaviour and high propensities for some forms of proactive aggression (especially coalitionary proactive aggression). These tendencies are associated with the evolution of groupishness, self-domestication, and social norms. This human aggression profile is expected to demand substantial plasticity in the evolved biological mechanisms responsible for aggression. We discuss the contributions of various social signalling molecules (testosterone, cortisol, oxytocin, vasopressin, serotonin, and dopamine) as the neuroendocrine foundation conferring such plasticity.

Effect of psilocybin on decision-making and motivation in the healthy rat

Psilocybin and its active metabolite psilocin are hallucinogenic serotonergic agonists with high affinity for several serotonin receptors. In addition to underlying the hallucinogenic effects of these compounds, serotonin receptor activation also has important effects on decision-making and goal-directed behaviors. The impact of psilocybin and psilocin on these cognitive systems, however, remains unclear. This study investigated the effects of psilocybin treatment on decision-making and motivation in healthy male and female rats. We compared probability and delay discounting performance of psilocybin treated (1 mg/kg) to vehicle rats (n = 10/sex/group), and further assessed motivation in each group using a progressive ratio task. We also confirmed drug action by assessing head twitch responses after psilocybin treatment (1 mg/kg). Results from this study demonstrated that exposure to 1 mg/kg psilocybin did not affect decision-making in the probability and delay discounting tasks and did not reduce response rates in the progressive ratio task. However, psilocybin treatment did cause the expected increase in head twitch responses in both male and female rats, demonstrating that the drug was delivered at a pharmacologically relevant dosage. Combined, these results suggest that psilocybin may not impair or improve decision-making and motivation. Considering recent interest in psilocybin as a potential fast-acting therapeutic for a variety of mental health disorders, our findings also suggest the therapeutic effects of this drug may not be mediated by changes to the brain systems underlying reward and decision-making. Finally, these results may have important implications regarding the relative safety of this compound, suggesting that widespread cognitive impairments may not be seen in subjects, even after chronic treatment.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Accumbal adenosine A2A receptor inactivation biases for large and costly rewards in the effort- but not delay-based decision making

The cost-benefit decision-making (CBDM) is critical to normal human activity and a diminished willingness to expend effort to obtain rewards is a prevalent/noted characteristic of neuropsychiatric disorders such as schizophrenia, Parkinson's disease. Numerous studies have identified nucleus accumbens (NAc) as an important locus for CBDM control but their neuromodulatory and behavioral mechanisms remain largely under-explored. Adenosine A_2A receptors (A_2ARs), which are highly concentrated in the striatopallidal neurons, can integrate glutamate and dopamine signals for controlling effort-related choice behaviors. While the involvement of A_2ARs in effort-based decision making is well documented, the role of other decision variables (reward discrimination) in effort-based decision making and the role of A_2AR in delay-based decision making are less clear. In this study, we have developed a well-controlled CBDM behavioral paradigm to manipulate effort/cost and reward independently or in combination, allowing a dissection of four behavioral elements: effort-based CBDM (E-CBDM), delay-based CBDM (D-CBDM), reward discrimination (RD), effort discrimination (ED), and determined the effect of genetic knockdown (KD) of NAc A_2AR on the four behavioral elements. We found that A_2AR KD in NAc increased the choice for larger, more costly reward in the E-CBDM, but not D-CBDM. Furthermore, this high-effort/high-reward bias was attributable to the increased willingness to engage in effort but not the effect of discrimination of reward magnitude. Our findings substantiate an important role of the NAc A_2AR in control of E-CBDM and support that pharmacologically targeting NAc A_2ARs would be a useful strategy for treating the aberrant effort-based decision making in neuropsychiatric disorders.

Digital Addiction and Sleep

In 2020, the World Health Organization formally recognized addiction to digital technology (connected devices) as a worldwide problem, where excessive online activity and internet use lead to inability to manage time, energy, and attention during daytime and produce disturbed sleep patterns or insomnia during nighttime. Recent studies have shown that the problem has increased in magnitude worldwide during the COVID-19 pandemic. The extent to which dysfunctional sleep is a consequence of altered motivation, memory function, mood, diet, and other lifestyle variables or results from excess of blue-light exposure when looking at digital device screens for long hours at day and night is one of many still unresolved questions. This article offers a narrative overview of some of the most recent literature on this topic. The analysis provided offers a conceptual basis for understanding digital addiction as one of the major reasons why people, and adolescents in particular, sleep less and less well in the digital age. It discusses definitions as well as mechanistic model accounts in context. Digital addiction is identified as functionally equivalent to all addictions, characterized by the compulsive, habitual, and uncontrolled use of digital devices and an excessively repeated engagement in a particular online behavior. Once the urge to be online has become uncontrollable, it is always accompanied by severe sleep loss, emotional distress, depression, and memory dysfunction. In extreme cases, it may lead to suicide. The syndrome has been linked to the known chronic effects of all drugs, producing disturbances in cellular and molecular mechanisms of the GABAergic and glutamatergic neurotransmitter systems. Dopamine and serotonin synaptic plasticity, essential for impulse control, memory, and sleep function, are measurably altered. The full spectrum of behavioral symptoms in digital addicts include eating disorders and withdrawal from outdoor and social life. Evidence pointing towards dysfunctional melatonin and vitamin D metabolism in digital addicts should be taken into account for carving out perspectives for treatment. The conclusions offer a holistic account for digital addiction, where sleep deficit is one of the key factors.

Anxiety predicts impulsive-compulsive behaviours in Parkinson's disease: Clinical relevance and theoretical implications

Patients with Parkinson's disease (PD) often present symptoms of anxiety, depression and apathy. These negative affect manifestations have been recently associated with the presence of impulsive compulsive behaviours (ICBs). However, their relation with the use of dopamine replacement therapy (DRT), a renewed risk factor for ICBs, is still not fully understood. Elucidating the role of these different ICBs predictors in PD could inform both prevention/intervention recommendations as well as theoretical models. In the present study, we have analysed data collected in 417 PD patients, 50 patients with Parkinsonian symptoms but with scan without evidence of dopaminergic deficit (SWEDD), and 185 healthy controls (HC). We examined each patient's clinical profile over a two-year time window, investigating the role of both negative affect and DRT on ICBs. Results confirmed the presence of higher levels of anxiety in both the clinical groups, and of higher level of ICBs in SWEDD patients, respect to both PD and HC. Mixed model analyses revealed a statistically significant association between anxiety and ICBs in the SWEDD patients who did not take any DRT. Findings suggest the independence between anxiety and DRT in ICBs development, and provide new evidence for the motivational opponency theoretical framework.

A mutant allele of glycoprotein M6-B (Gpm6b) facilitates behavioral flexibility but increases delay discounting

The neuronal membrane glycoprotein M6B (Gpm6b) gene encodes a membrane glycoprotein that belongs to the proteolipid protein family, and is enriched in neurons, oligodendrocytes, and subset of astrocytes in the central nervous system. GPM6B is thought to play a role in neuronal differentiation, myelination, and inactivation of the serotonin transporter via internalization. Recent human genome-wide association studies (GWAS) have implicated membrane glycoproteins (both GPM6B and GPM6A) in the regulation of traits relevant to psychiatric disorders, including neuroticism, depressed affect, and delay discounting. Mouse studies have implicated Gpm6b in sensorimotor gating and regulation of serotonergic signaling. We used CRISPR to create a mutant Glycoprotein M6B (Gpm6b) allele on a C57BL/6J mouse background. Because Gpm6b is located on the X chromosome, we focused on male Gpm6b mutant mice and their wild-type littermates (WT) in two behavioral tests that measured aspects of impulsive or flexible decision-making. We found that Gpm6b deletion caused deficits in a delay discounting task. In contrast, reward sensitivity was enhanced thereby facilitating behavioral flexibility and improving performance in the probabilistic reversal learning task. Taken together these data further delineate the role of Gpm6b in decision making behaviors that are relevant to multiple psychiatric disorders.

A dynamical systems view of neuroethology: Uncovering stateful computation in natural behaviors

State-dependent computation is key to cognition in both biological and artificial systems. Alan Turing recognized the power of stateful computation when he created the Turing machine with theoretically infinite computational capacity in 1936. Independently, by 1950, ethologists such as Tinbergen and Lorenz also began to implicitly embed rudimentary forms of state-dependent computation to create qualitative models of internal drives and naturally occurring animal behaviors. Here, we reformulate core ethological concepts in explicitly dynamical systems terms for stateful computation. We examine, based on a wealth of recent neural data collected during complex innate behaviors across species, the neural dynamics that determine the temporal structure of internal states. We will also discuss the degree to which the brain can be hierarchically partitioned into nested dynamical systems and the need for a multi-dimensional state-space model of the neuromodulatory system that underlies motivational and affective states.

Dorsal Raphe Nucleus Serotoninergic Neurons Mediate Morphine Rewarding Effect and Conditioned Place Preference

Morphine rewarding properties are the main reasons for drug-craving in behaviors occurring during morphine addiction. It has been suggested that morphine addiction relies on signals to the mesolimbic dopamine system, although the mechanisms outside the dopaminergic system are still unclear. Notably, the role of the dorsal raphe nucleus (DRN) serotoninergic (5-hydroxytryptamine, 5-HT) system remains unexplored. Using in vivo electrophysiological and optogenetic approaches, we found that morphine treatment increased DRN 5-TH neurons firing rate and optogenetic activation of DRN 5-HT neurons induced a rewarding effect, indicating that morphine reward is related to DRN 5-HT neurons. Accordingly, optogenetic inhibition of DRN 5-HT neurons following morphine injection reversed conditioned place preference (CPP) during chronic morphine treatment. These findings aid our understanding of the new functions of the DRN 5-HT neurons for morphine rewarding effect and provide a potential approach for the treatment of morphine addiction.

The Effects of Drug Treatments for ADHD in Measures of Cognitive Performance

Based on core symptoms of inattention and deficient impulse control, and the identification of effective pharmacotherapies such as amphetamine (AMP; Adderall^®), methylphenidate (MPH; Ritalin^®), and atomoxetine (ATX; Strattera^®), ADHD is a clinical condition which provides opportunity for translational research. Neuropsychological tests such as the 5-Choice and Continuous Performance Tasks, which measure aspects of attention and impulse control in animals and humans, provide scope for both forward (animal to human) and reverse (human to animal) translation. Rodent studies support pro-attentive effects of AMP and MPH and effectiveness in controlling some forms of impulsive behavior. In contrast, any pro-attentive effects of ATX appear to be less consistent, the most reliable effects of ATX are recorded in tests of impulsivity. These differences may account for AMP and MPH being recognized as first-line treatments for ADHD with a higher efficacy relative to ATX. DSM-5 classifies three "presentations" of ADHD: predominantly inattentive type (ADHD-I), predominantly hyperactive/impulsive type (ADHD-HI), or combined (ADHD-C). Presently, it is unclear whether AMP, MPH, or ATX has differential levels of efficacy across these presentation types. Nonetheless, these studies encourage confidence for the forward translation of NCEs in efforts to identify newer pharmacotherapies for ADHD.

Between Temperament and Psychopathology: Examples from Neuropharmacological Challenge Tests in Healthy Humans

BACKGROUND

This paper tries to demonstrate that the questionnaire-based continuum between temperament traits and psychopathology can also be shown on the biochemical level. A common feature is the incapacity to adapt to external demands, as demonstrated by examples of disturbed hormone cycles as well as neurotransmitter (TM) responses related to affective and impulse control disorders.

METHODS

Pharmacological challenge tests performed in placebo-controlled balanced crossover experiments with consecutive challenges by serotonin (5-HT), noradrenaline (NA), and dopamine (DA) agonistic drugs were applied to healthy subjects, and individual responsivities of each TM system assessed by respective cortisol and prolactin responses were related to questionnaire-based facets of depressiveness and impulsivity, respectively.

RESULTS

The depression-related traits "Fatigue" and "Physical Anhedonia" were characterized by low and late responses to DA stimulation as opposed to "Social Anhedonia," which rather mirrored the pattern of schizophrenia. Reward-related and premature responding-related impulsivity represented by high scores on "Disinhibition" and "Motor Impulsivity," respectively, as well as the questionnaire-based components of attention deficit hyperactivity disorder, "Cognitive" and "Motor Impulsivity," could be discriminated by their patterns of DA/NA responses. 5-HT responses suggested that instead of the expected low availability of 5-HT claimed to be associated with impulse control disorders, low NA responses indicated lack of inhibition in impulsivity and high NA responses in depression-related "Anhedonia" indicated suppression of approach motivation.

CONCLUSIONS

In spite of the flaws of pharmacological challenge tests, they may be suitable for demonstrating similarities in TM affinities between psychopathological disturbances and respective temperament traits and for separating sub-entities of larger disease spectra.

Imbalance between dopamine and serotonin caused by neonatal habenula lesion

Alterations in dopamine (DA) and serotonin (5-HT) transmission have been implicated in the pathophysiology of attention deficit/hyperactivity disorder (ADHD). We have previously reported that juvenile rats with neonatal habenula lesion (NHL) exhibit an assortment of behavioral alterations resembling ADHD symptoms. In this study, we investigated the impacts of NHL on DA and 5-HT transmission in mesocorticolimbic regions of rats. Male Sprague-Dawley rats with microinjection of ibotenic acid into the habenula at postnatal day (PND) 7 were subjected for a battery of locomotion test, object exploration test and delay discounting test in the juvenile period (PND28-35), followed by DA and 5-HT brain tissue concentration measurements using high-performance liquid chromatography (HPLC). NHL rats exhibited hyperlocomotion, impulsivity, and attention deficits. NHL induced alterations of tissue DA and 5-HT concentrations only in some mesocorticolimbic regions. However, positive correlations, indicating the balance, between DA and 5-HT observed in control (CTR) rats, were more extensively disrupted across mesocorticolimbic regions in NHL rats. Pharmacological manipulations that modulated both DA and 5-HT systems simultaneously with Astragalus membranaceus (AM) and its active compound formononetin (FOR) normalized the NHL-induced DA and 5-HT imbalance in several brain areas, which consequently improved the behavioral alterations. These results suggest that behavioral alterations caused by NHL may be associated with mesocorticolimbic DA/5-HT imbalance. Drug treatments targeting multiple monoamine systems may be useful to improve the NHL-induced changes.

Rational inattention and tonic dopamine

Slow-timescale (tonic) changes in dopamine (DA) contribute to a wide variety of processes in reinforcement learning, interval timing, and other domains. Furthermore, changes in tonic DA exert distinct effects depending on when they occur (e.g., during learning vs. performance) and what task the subject is performing (e.g., operant vs. classical conditioning). Two influential theories of tonic DA-the average reward theory and the Bayesian theory in which DA controls precision-have each been successful at explaining a subset of empirical findings. But how the same DA signal performs two seemingly distinct functions without creating crosstalk is not well understood. Here we reconcile the two theories under the unifying framework of 'rational inattention,' which (1) conceptually links average reward and precision, (2) outlines how DA manipulations affect this relationship, and in so doing, (3) captures new empirical phenomena. In brief, rational inattention asserts that agents can increase their precision in a task (and thus improve their performance) by paying a cognitive cost. Crucially, whether this cost is worth paying depends on average reward availability, reported by DA. The monotonic relationship between average reward and precision means that the DA signal contains the information necessary to retrieve the precision. When this information is needed after the task is performed, as presumed by Bayesian inference, acute manipulations of DA will bias behavior in predictable ways. We show how this framework reconciles a remarkably large collection of experimental findings. In reinforcement learning, the rational inattention framework predicts that learning from positive and negative feedback should be enhanced in high and low DA states, respectively, and that DA should tip the exploration-exploitation balance toward exploitation. In interval timing, this framework predicts that DA should increase the speed of the internal clock and decrease the extent of interference by other temporal stimuli during temporal reproduction (the central tendency effect). Finally, rational inattention makes the new predictions that these effects should be critically dependent on the controllability of rewards, that post-reward delays in intertemporal choice tasks should be underestimated, and that average reward manipulations should affect the speed of the clock-thus capturing empirical findings that are unexplained by either theory alone. Our results suggest that a common computational repertoire may underlie the seemingly heterogeneous roles of DA.

Effects of a high-fat diet on impulsive choice in rats

INTRODUCTION

Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice.

METHODS

Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward.

RESULTS

There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward.

CONCLUSIONS

These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.

Effects of benztropine analogs on delay discounting in rats

RATIONALE

Methylphenidate and d-amphetamine, medications used for treatment of attention deficit hyperactivity disorder (ADHD), are used recreationally and self-administered by laboratory animals. Benztropine (BZT) analogs, like those medications, increase synaptic dopamine levels but are less effective in maintaining self-administration, suggesting clinical utility with less abuse liability.

OBJECTIVES

The current study was designed to evaluate potential therapeutic effects of BZT analogs related to ADHD.

METHODS

Rats responded under a delay-discounting procedure in which responses on one lever produced immediate delivery of a single food pellet and alternative responses produced four food pellets either immediately or with various temporal delays, with those delays arranged in ascending or random orders in different groups of rats. Selection of the smaller more immediate reinforcer has been suggested as an aspect of "impulsivity," a trait with suggested involvement in ADHD. Other rats were studied under fixed-interval (FI) 300-s schedules to assess drug effects on behavior under temporal control.

RESULTS

d-Amphetamine, methylphenidate, and the BZT analog AHN 1-055, but not AHN 2-005 or JHW 007, increased selection of the large, delayed reinforcer with either arrangement of delays. All drugs changed the temporal distribution of responses within the FI from one with responses concentrated at the end to a more uniform distribution. Changes in the temporal distribution of FI responding occurred with drugs that did not affect discounting suggesting that discounting does not arise directly from the same temporal control processes controlling FI responding.

CONCLUSIONS

AHN 1-055 may be of clinical utility in the treatment of ADHD.

Serotonergic projections to the orbitofrontal and medial prefrontal cortices differentially modulate waiting for future rewards

Optogenetic activation of serotonergic neurons in the dorsal raphe nucleus (DRN) enhances patience when waiting for future rewards, and this effect is maximized by both high probability and high timing uncertainty of reward. Here, we explored which serotonin projection areas contribute to these effects using optogenetic axon terminal stimulation. We found that serotonin stimulation in the orbitofrontal cortex (OFC) is nearly as effective as that in the DRN for promoting waiting, while in the nucleus accumbens, it does not promote waiting. We also found that serotonin stimulation in the medial prefrontal cortex (mPFC) promotes waiting only when the timing of future rewards is uncertain. Our Bayesian decision model of waiting assumed that the OFC and mPFC calculate the posterior probability of reward delivery separately. These results suggest that serotonin in the mPFC affects evaluation of time committed, while serotonin in the OFC is responsible for overall valuation of delayed rewards.

Kindling of the basolateral or central nucleus of the amygdala increases suboptimal choice in a rat gambling task and increases motor impulsivity in risk-preferring animals

Impairments in decision making under uncertainty, as measured by the Iowa Gambling Task (IGT), are observed in persons suffering from temporal lobe epilepsy (TLE), in which seizures originate in the amygdala and hippocampal formations. Gambling disorder is also more prevalent in this population. Individuals with amygdala damage show similar deficits in decision-making, as do rats with lesions restricted to the basolateral amygdala (BLA) performing an analogous rat gambling task (rGT), yet whether hyperstimulation of the BLA impacts risky decision-making has yet to be demonstrated. We therefore investigated whether kindling of the BLA affected rGT performance. In this task, sugar pellet profits are maximised through consistent selection of options associated with smaller per-trial gains but shorter punishing time-outs. Just as in the IGT, subjects must avoid the risky options, as penalties are disproportionately high despite the higher reward available. Most rats adopt the optimal strategy, but some instead make high numbers of risky, disadvantageous choices. Once stable choice preferences had been established on-task, sixteen male Long Evans rats were implanted unilaterally with a bipolar electrode targeting the BLA and stimulated twice daily until three stage five seizures had been elicited. The electrodes revealed to be nearly evenly places in the BLA and the Central Nucleus of the Amygdala (CeA). Kindling transiently increased choice of the option paired with the smallest reward but also the lowest level of punishment- a risk-averse, but suboptimal, choice. Risk-preferring rats also made more premature responses, a marker of motor impulsivity, and were faster to make a choice, whereas these variables were unaffected in optimal decision-makers. These data suggest epileptiform activity originating within the amygdala can impair choice and promote impulsivity, at least in some individuals.

Involvement of noradrenergic and serotonergic systems in risk-based decisions between options of equivalent expected value in rats

Risk perception is an important factor that may mediate risk-based decision-making processes regulated by noradrenergic (NA) and serotonergic (5-HT) systems. Most risk-based decision-making models involve complex factors, such as risk perception or reward value, such that the final decision is the result of the interactions among these factors. However, the contribution of risk perception per se in risk decisions has remained unclear. Therefore, in the present study, we made some modifications to the classical probabilistic discounting task (PDT) to focus on the impact of risk perception and noradrenergic/serotonergic systems on decision-making behavior. Meanwhile, we conducted an elevated plus-maze (EPM) test to detect the correlation between anxiety and choice behavior. In the current study, rats had to choose between a "certain" lever that delivered a certain number of pellets and a "risky" lever that delivered eight pellets in a probabilistic manner (descending: 50%, 25%, 12.5% or ascending 12.5%, 25%, 50% of the time). The long-term rewarding values of the two levers were always identical in each block within each session. According to their baseline performances in choosing the risky lever, rats were divided into the risk-prefer group and risk-averse group. The results showed that there was a significant correlation between open arm time in EPM and risky choice for both descending order and ascending order, indicating that highly anxious rats more often preferred the safe option under risk. Pharmacological stimulation of α2-adrenergic receptors via dexmedetomidine (0.01 mg/kg) decreased the preference of probabilistic rewards in the risk-prefer group, while blocking α2 receptors by atipamezole (0.3 mg/kg) also reduced risky choices. The NA reuptake inhibitor, atomoxetine, increased the preference for risky choices in the risk-prefer group, the effect of which was attained via multiple superimposed doses. Administration of the 5-HT_2A receptor agonist, DOI (0.1 mg/kg), increased risk-taking behavior in the risk-prefer group. Taken together, these results suggest that NA may be more inclined to process negative information such as loss or uncertainty in the regulation of risk-related decision making, whereas 5-HT may function primarily to increase risk-taking behavior. Our findings may help to further elucidate how noradrenergic and serotonergic systems differentially affect individuals with different risk preferences in terms of regulating risk perception in risk-related decision making.

Zebrafish models of impulsivity and impulse control disorders

Impulse control disorders (ICDs) are characterized by generalized difficulty controlling emotions and behaviors. ICDs are a broad group of the central nervous system (CNS) disorders including conduct disorder, intermittent explosive, oppositional-defiant disorder, antisocial personality disorder, kleptomania, pyromania and other illnesses. Although they all share a common feature (aberrant impulsivity), their pathobiology is complex and poorly understood. There are also currently no ICD-specific therapies to treat these illnesses. Animal models are a valuable tool for studying ICD pathobiology and potential therapies. The zebrafish (Danio rerio) has become a useful model organism to study CNS disorders due to high genetic and physiological homology to mammals, and sensitivity to various pharmacological and genetic manipulations. Here, we summarize experimental models of impulsivity and ICD in zebrafish and highlight their growing translational significance. We also emphasize the need for further development of zebrafish ICD models to improve our understanding of their pathogenesis and to search for novel therapeutic treatments.

5-HT1A and α2 adrenergic receptor levels are associated with high anxiety-like patterns and impulsivity in selectively bred Long Evans rats

Impulsivity and anxiety are psychological traits involved in many aspects of the drug addiction cycle. However, few preclinical models exist for examining both impulsive and anxiety patterns. In the current study, we investigated whether 6^th generation rats selectively bred for high anxiety (HAn)-like behavior would display amphetamine (AMPH) hyperactivity. In the same generational line, we also determined if HAn animals would display impulsivity in an operant task. Filial 5 male Long Evans rats phenotyped as HAn and low anxiety (LAn) were tested on the elevated plus maze (EPM) and in locomotor chambers following a low dose of AMPH (0.5 mg/kg, IP). Next, a separate group of F5 animals was exposed to a differential reinforcement of low rate of responding (DRL: 30 s) operant schedule to assess impulsivity. Postmortem, 5-HT1A and α2 adrenergic receptor protein levels were measured in the medial prefrontal cortex (mPFC), nucleus accumbens (NAc) core and shell, and α2 adrenergic counts were assessed in the locus coeruleus (LC), and the paraventricular nucleus (PVN) of the hypothalamus. F5 outbred HAn rats had decreased percent open arm time and entries on the EPM and elevated AMPH-induced locomotion. In the DRL, HAn rats displayed an impulsive profile, they attained fewer total rewards, had more inter-response times, and showed greater burst ratios. We found that HAn rats had a higher number of 5-HT1A receptor immunostained cells in the mPFC but were not different than LAn in NAc core or shell. By contrast, levels of the α2 adrenergic receptor protein were no different in the mPFC while HAn rats had greater levels in the LC and lower levels in the PVN. Overall, these data further validate our outbred trait anxiety rats: HAn males show anxiety-like behavior, AMPH hypersensitivity, greater impulsivity, and varying levels of limbic and midbrain 5-HT1A and α2 adrenergic receptor proteins.

Serotonin in Animal Cognition and Behavior

Serotonin (5-hydroxytryptamine, 5-HT) is acknowledged as a major neuromodulator of nervous systems in both invertebrates and vertebrates. It has been proposed for several decades that it impacts animal cognition and behavior. In spite of a completely distinct organization of the 5-HT systems across the animal kingdom, several lines of evidence suggest that the influences of 5-HT on behavior and cognition are evolutionary conserved. In this review, we have selected some behaviors classically evoked when addressing the roles of 5-HT on nervous system functions. In particular, we focus on the motor activity, arousal, sleep and circadian rhythm, feeding, social interactions and aggressiveness, anxiety, mood, learning and memory, or impulsive/compulsive dimension and behavioral flexibility. The roles of 5-HT, illustrated in both invertebrates and vertebrates, show that it is more able to potentiate or mitigate the neuronal responses necessary for the fine-tuning of most behaviors, rather than to trigger or halt a specific behavior. 5-HT is, therefore, the prototypical neuromodulator fundamentally involved in the adaptation of all organisms across the animal kingdom.

The Neuropharmacology of Impulsive Behaviour, an Update

Neuropharmacological interventions in preclinical translational models of impulsivity have tremendously contributed to a better understanding of the neurochemistry and neural basis of impulsive behaviour. In this regard, much progress has been made over the last years, also due to the introduction of novel techniques in behavioural neuroscience such as optogenetics and chemogenetics. In this chapter, we will provide an update of how the behavioural pharmacology field has progressed and built upon existing data since an earlier review we wrote in 2008. To this aim, we will first give a brief background on preclinical translational models of impulsivity. Next, recent interesting evidence of monoaminergic modulation of impulsivity will be highlighted with a focus on the neurotransmitters dopamine and noradrenaline. Finally, we will close the chapter by discussing some novel directions and drug leads in the neuropharmacological modulation of impulsivity.

The Psychopharmacology of Obsessive-Compulsive Disorder: A Preclinical Roadmap

This review evaluates current knowledge about obsessive-compulsive disorder (OCD), with the goal of providing a roadmap for future directions in research on the psychopharmacology of the disorder. It first addresses issues in the description and diagnosis of OCD, including the structure, measurement, and appropriate description of the disorder and issues of differential diagnosis. Current pharmacotherapies for OCD are then reviewed, including monotherapy with serotonin reuptake inhibitors and augmentation with antipsychotic medication and with psychologic treatment. Neuromodulatory therapies for OCD are also described, including psychosurgery, deep brain stimulation, and noninvasive brain stimulation. Psychotherapies for OCD are then reviewed, focusing on behavior therapy, including exposure and response prevention and cognitive therapy, and the efficacy of these interventions is discussed, touching on issues such as the timing of sessions, the adjunctive role of pharmacotherapy, and the underlying mechanisms. Next, current research on the neurobiology of OCD is examined, including work probing the role of various neurotransmitters and other endogenous processes and etiology as clues to the neurobiological fault that may underlie OCD. A new perspective on preclinical research is advanced, using the Research Domain Criteria to propose an adaptationist viewpoint that regards OCD as the dysfunction of a normal motivational system. A systems-design approach introduces the security motivation system (SMS) theory of OCD as a framework for research. Finally, a new perspective on psychopharmacological research for OCD is advanced, exploring three approaches: boosting infrastructure facilities of the brain, facilitating psychotherapeutic relearning, and targeting specific pathways of the SMS network to fix deficient SMS shut-down processes. SIGNIFICANCE STATEMENT: A significant proportion of patients with obsessive-compulsive disorder (OCD) do not achieve remission with current treatments, indicating the need for innovations in psychopharmacology for the disorder. OCD may be conceptualized as the dysfunction of a normal, special motivation system that evolved to manage the prospect of potential danger. This perspective, together with a wide-ranging review of the literature, suggests novel directions for psychopharmacological research, including boosting support systems of the brain, facilitating relearning that occurs in psychotherapy, and targeting specific pathways in the brain that provide deficient stopping processes in OCD.

Risky decision-making predicts dopamine release dynamics in nucleus accumbens shell

The risky decision-making task (RDT) measures risk-taking in a rat model by assessing preference between a small, safe reward and a large reward with increasing risk of punishment (mild foot shock). It is well-established that dopaminergic drugs modulate risk-taking; however, little is known about how differences in baseline phasic dopamine signaling drive individual differences in risk preference. Here, we used in vivo fixed potential amperometry in male Long-Evans rats to test if phasic nucleus accumbens shell (NACs) dopamine dynamics are associated with risk-taking. We observed a positive correlation between medial forebrain bundle-evoked dopamine release in the NACs and risky decision-making, suggesting that risk-taking is associated with elevated dopamine sensitivity. Moreover, "risk-taking" subjects were found to demonstrate greater phasic dopamine release than "risk-averse" subjects. Risky decision-making also predicted enhanced sensitivity to the dopamine reuptake inhibitor nomifensine, and elevated autoreceptor function. Importantly, this hyperdopaminergic phenotype was selective for risky decision-making, as delay discounting performance was not predictive of phasic dopamine release or dopamine supply. These data identify phasic NACs dopamine release as a possible therapeutic target for alleviating the excessive risk-taking observed across multiple forms of psychopathology.

The effect of 5-HT1A receptor antagonist on reward-based decision-making

When choosing the best action from several alternatives, we compare each value that depends on the balance between benefit and cost. Previous studies have shown that animals and humans with low brain serotonin (5-HT) level tend to choose smaller immediate reward. We used a decision-making schedule task to investigate whether 5-HT1A receptor is responsible for the decisions related to reward. In this task, the monkeys chose either of two different alternatives that were comprised of 1-4 drops of liquid reward (benefit) and 1-4 repeats of a color discrimination trial (workload cost), then executed the chosen schedule. By the administration of 5-HT1A antagonist, WAY100635, the choice tendency did not change, however, the sensitivity to the amount of reward in the schedule part was diminished. The 5-HT1A could have a role in maintaining reward value to keep track with the promised reward rather than modulating workload discounting of reward value.

Effects of d-amphetamine and MK-801 on impulsive choice: Modulation by schedule of reinforcement and delay length

Procedural modifications can modulate drug effects in delay discounting, such as signaling the delay to reinforcement and altering the order in which delays are presented. Although the schedule of reinforcement can alter the rate at which animals discount a reinforcer, research has not determined if animals trained on different schedules of reinforcement are differentially affected by pharmacological manipulations. Similarly, research has not determined if using different delays to reinforcement can modulate drug effects in delay discounting. Male Sprague Dawley rats (n = 36) were split into four groups and were trained in a delay-discounting procedure. The schedule of reinforcement (fixed ratio [FR] 1 vs. FR 10) and delays to reinforcement (0, 5, 10, 20, and 50 s vs. 0, 10, 30, 60, 100 s) were manipulated for each group. Following behavioral training, rats were treated with d-amphetamine (0, 0.25, 0.5, and 1.0 mg/kg) and MK-801 (0, 0.03, and 0.06 mg/kg). Results showed that amphetamine decreased impulsive choice when a FR 1 schedule was used, but only when the short delay sequence was used. Conversely, amphetamine decreased impulsive choice when a FR 10 schedule was used, but only when rats were trained on the long delay sequence. MK-801 decreased impulsive choice in rats trained on a FR 1 schedule, regardless of delay sequence, but did not alter choice in rats trained on a FR 10 schedule. These results show that schedule of reinforcement and delay length can modulate drug effects in delay discounting.

The use of laser capture microdissection to identify specific pathways and mechanisms involved in impulsive choice in rats

BACKGROUND

Microinjections, lesions, viral-mediated gene transfer, or designer receptors exclusively activated by designer drugs (DREADDs) can identify brain signaling pathways and their pharmacology in research animals. Genetically modified animals are used for more precise assessment of neural circuits. However, only a few of the gene-based pathway modifications are available for use in outbred rat strains.

NEW METHOD

Behaviorally characterized Sprague-Dawley rats undergo tract tracing through microinjection of fluorospheres, followed by laser capture microdissection (LCM) and qPCR for detecting mRNA of pathway-associated gene products. Correlations between mRNA expression and behavior identify specific involvement of pharmacologically relevant molecules within cells of interest. Here, we examined this methodology in an impulsive choice paradigm and targeted projections from the orbital and medial prefrontal cortex.

RESULTS

In this proof of concept study, we demonstrate relationships between measures of impulsive choice with distinct neurotransmitter receptor expression in cell populations from four different signaling pathways.

COMPARISONS WITH EXISTING METHODS

Combining behavior, tract tracing, LCM, and gene expression profiling provides more cellular selectivity than localized lesions and DREADDs, and greater pharmacological specificity than microinjections and viral-mediated gene transfer due to targeting identified neurons. Furthermore, the assessment of inter-individual pathways provides insight into the complex nature of underlying mechanisms involved in typical and atypical behavior.

CONCLUSIONS

The novel combination of behavior, tract tracing, LCM, and single gene or potential whole genome transcriptome analysis allows for a more targeted understanding of the interconnection of neural circuitry with behavior, and holds promise to identify more specific drug targets that are relevant to behavioral phenotypes.

Prelimbic Cortical Neurons Track Preferred Reward Value and Reflect Impulsive Choice during Delay Discounting Behavior

In delay discounting, individuals discount the value of a reward based on the delay to its receipt. The prelimbic cortex (PrL) is heavily interconnected with several brain regions implicated in delay discounting, but the specific contributions of the PrL to delay discounting are unknown. Here, we used multineuron electrophysiological recording methods in Long-Evans male (n = 10) and female (n = 9) rats to characterize the firing dynamics of PrL neurons during discrete cue and lever press events in a delay discounting task. Rats' initial preference for the large reward decreased as delays for that outcome increased across blocks, reflecting classic discounting behavior. Electrophysiological recordings revealed that subgroups of neurons exhibited phasic responses to cue presentations and lever presses. These phasic neurons were found to respond to either large/delay, small/immediate, or both trial types and the percentage of these neurons shifted across blocks as the expected value of the reward changed. Critically, this shift was only seen during trials in which animals could choose their preferred option (free choice trials) and not during trials where animals could choose only one option (forced choice trials). Further, this shift was dependent on rats' inherent impulsivity because high impulsive rats demonstrated a greater percentage of small/immediate-responsive neurons as the task progressed. Collectively, these findings suggest a unique role for the PrL in encoding reward value during delay discounting that is influenced by individual differences in impulsivity.SIGNIFICANCE STATEMENT In delay discounting, individuals discount the value of a reward based on the delay to its receipt. Here, we used electrophysiology to investigate the role of the prelimbic cortex (PrL) in this process. We found that subsets of neurons shifted activity as a function of the changing expected delay and reward magnitude, but this shift was only evident during trials in which animals could choose their preferred option. Further, this dynamic neural activity depended on rats' inherent impulsivity, with impulsive rats exhibiting a stronger neural shift toward the immediate reward as the task progressed. These findings suggest a role for the PrL in encoding reward value during delay discounting that is influenced by goal-directed context and individual differences in impulsivity.

Intrauterine growth restriction increases impulsive behavior and is associated with altered dopamine transmission in both medial prefrontal and orbitofrontal cortex in female rats

Recent studies have implicated a role for impulsivity in the altered eating behaviors and the increased risk for obesity consistently associated with intrauterine growth restriction (IUGR). Changes in dopamine transmission within prefrontal areas are believed to contribute to these adverse outcomes. Here we investigated the impulsive behavior toward a delayed reward and evaluated dopamine levels and its receptors in the medial prefrontal (mPFC) and orbitofrontal (OFC) cortex of female adult rats exposed to IUGR. From day 10 of pregnancy and until birth, Sprague-Dawley dams received either an ad libitum (Adlib) or a 50% food-restricted (FR) diet. At birth, all pups were adopted by Adlib mothers, generating the groups Adlib/Adlib (control) and FR/Adlib (intrauterine growth-restricted). Adult impulsive behavior was evaluated using a Tolerance to Delay of Reward Task. In vivo dopamine responses to sweet food intake were measured by voltammetry, and D1, D2 and DAT levels were accessed by Western Blot. Animals from FR group showed a pronounced aversion to delayed rewards. DA response to sweet food was found to be blunted in the mPFC of FR animals, whereas in the OFC, the DA levels appear to be unaffected by reward consumption. Moreover, FR animals presented reduced D1 receptors in the OFC and a later increase in the mPFC D2 levels. These findings suggest that IUGR female rats are more impulsive and that the associated mechanism involves changes in the dopamine signaling in both the mPFC and OFC.

Dorsal raphe serotonin neurons inhibit operant responding for reward via inputs to the ventral tegmental area but not the nucleus accumbens: evidence from studies combining optogenetic stimulation and serotonin reuptake inhibition

The monoamine neurotransmitter serotonin (5-hydroxytryptamine; 5-HT) exerts an inhibitory influence over motivation, but the circuits mediating this are unknown. Here, we used an optogenetic approach to isolate the contribution of dorsal raphe nucleus (DRN) 5-HT neurons and 5-HT innervation of the mesolimbic dopamine (DA) system to motivated behavior in mice. We found that optogenetic stimulation of DRN 5-HT neurons enhanced downstream 5-HT release, but this was not sufficient to inhibit operant responding for saccharin, a measure of motivated behavior. However, combining optogenetic stimulation of DRN 5-HT neurons with a low dose of the selective serotonin reuptake inhibitor (SSRI) citalopram synergistically reduced operant responding. We then examined whether these effects could be recapitulated if optogenetic stimulation specifically targeted 5-HT terminals in the ventral tegmental area (VTA) or nucleus accumbens (NAc) of the mesolimbic DA system. Optogenetic stimulation of 5-HT input to the VTA combined with citalopram treatment produced a synergistic decrease in responding for saccharin, resembling the changes produced by targeting 5-HT neurons in the DRN. However, this effect was not observed when optogenetic stimulation targeted 5-HT terminals in the NAc. Taken together, these results suggest that DRN 5-HT neurons exert an inhibitory influence over operant responding for reward through a direct interaction with the mesolimbic DA system at the level of the VTA. These studies support an oppositional interaction between 5-HT and DA systems in controlling motivation and goal-directed behavior, and have important implications for the development and refinement of treatment strategies for psychiatric disorders such as depression and addiction.

Association Between 5-HTTLPR Polymorphism and the Risk of Autism: A Meta-Analysis Based on Case-Control Studies

Background: Recently, many case-control studies have reported the association between 5-HTTLPR polymorphism and autism risk. However, the results are inconclusive and conflicting. To investigate the genetic association of 5-HTTLPR polymorphism and autism risk, we conducted a comprehensive meta-analysis based on previous case-control studies. Methods: Literature search was performed through PubMed, Embase, Web of Knowledge and CNKI databases until June 27, 2018. The strength of the association was assessed by relative risk (RR) and its corresponding 95% confidence interval (CI). Fixed or random effect model was selected based on the results of heterogeneity test. Further, subgroup analyses were conducted to explore the association of 5-HTTLPR polymorphism and autism risk in different population. Results: Eleven studies with 930 cases and 1234 controls were identified. Although there was a significant association between 5-HTTLPR polymorphism and autism risk under the dominant model after removing the studies causing heterogeneity, the significance did not exist after Bonferroni's correction. Subgroup analyses also showed similar results after Bonferroni's correction. In addition, there was no obvious publication bias in our meta-analysis. Conclusions: Our present meta-analysis does not support a direct effect of 5-HTTLPR polymorphism on autism risk according to present results. Further analyses of the effect of genetic networks and more well designed studies with larger sample size are required.

Risky decision-making is associated with impulsive action and sensitivity to first-time nicotine exposure

Excessive risk-taking is common in multiple psychiatric conditions, including substance use disorders. The risky decision-making task (RDT) models addiction-relevant risk-taking in rats by measuring preference for a small food reward vs. a large food reward associated with systematically increasing risk of shock. Here, we examined the relationship between risk-taking in the RDT and multiple addiction-relevant phenotypes. Risk-taking was associated with elevated impulsive action, but not impulsive choice or habit formation. Furthermore, risk-taking predicted locomotor sensitivity to first-time nicotine exposure and resilience to nicotine-evoked anxiety. These data demonstrate that risk preference in the RDT predicts other traits associated with substance use disorder, and may have utility for identification of neurobiological and genetic biomarkers that engender addiction vulnerability.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

5-HT3 antagonists decrease discounting rate without affecting sensitivity to reward magnitude in the delay discounting task in mice

RATIONALE

Impulsive choice has often been evaluated in rodents according to the proportion of choices for the delayed large magnitude reinforcer (%large choice) in a delay-discounting task (DDT). However, because %large choice is influenced by both sensitivity to reinforcer magnitude and sensitivity to delayed reinforcement (i.e., discounting rate), distinctively evaluating such discounting parameters represents a critical issue demanding methods to determine each parameter in rats. The serotonin (5-HT) system is well known to be involved in impulsive choice; nevertheless, only a few studies have distinguished discounting parameters and investigated how 5-HT modulators affect discounting rate.

OBJECTIVE

Here, we performed a discounting parameter analysis in mice and examined the effects of various 5-HT modulators on discounting rate.

METHODS

We set up DDTs with different delay schedules to determine which schedule could address delay-discounting rates in mice. We examined the effect of the following drugs on impulsive choice: a 5-HT reuptake inhibitor (paroxetine), a 5-HT_1A receptor agonist (8-OH-DPAT), and two 5-HT₃ receptor antagonists (granisetron and ondansetron).

RESULTS

Mice showed typical delay discounting at the shorter delay schedules (up to 4 s delay). The %large choice under shorter, but not longer, schedules followed an exponential function and allowed us to derive discounting rates. We selected a DDT with a 4-s delay schedule for further experiments. Granisetron and ondansetron, but not paroxetine or 8-OH-DPAT, decreased discounting rates without affecting sensitivity to reinforcer magnitude.

CONCLUSION

We found that a method to calculate discounting rates in rats is also applicable to mouse models. We also provided evidence that 5-HT₃ antagonism controls impulsive choice in mice.

A behavioral mechanistic investigation of the role of 5-HT1A receptors in the mediation of rat maternal behavior

Previous work suggests that 5-HT_1A receptors play a special role in rodent maternal aggression, but not in other aspects of maternal care (e.g. pup retrieval and nest building). The present study re-assessed the basic effects of 5-HT_1A activation or blockade on various maternal responses in postpartum female rats. We also examined the possible behavioral mechanisms underlying the maternal effects of 5-HT_1A. Sprague-Dawley mother rats were injected with a 5-HT_1A agonist 8-OH-DPAT (0.1, 0.5 or 1.0 mg/kg, sc), a 5-HT_1A antagonist WAY-101405 (0.1, 0.5 or 1.0 mg/kg, sc) or 0.9% saline solution on postpartum days 3, 5, and 7. Maternal behavior was tested 30 min before, 30 min, 120 min, and 240 min after the injection. Acute and repeated 8-OH-DPAT treatment significantly disrupted pup retrieval, pup licking, nursing, and nest building in a dose-dependent fashion, whereas WAY-101405 had no effect at the tested doses. The 5-HT_1A receptor specificity of 8-OH-DPAT's action was confirmed as its maternal disruption effect was reversed by pretreatment of WAY-100635 (a highly selective 5-HT_1A receptor antagonist). Subsequent pup preference test found that 8-OH-DPAT did not decrease the pup preference over a novel object, thus no inhibition on maternal motivation or maternal affect. The pup separation test and pup retrieval on an elevated plus maze test also failed to find any motivational and motor impairment effect with 8-OH-DPAT. However, 8-OH-DPAT at the maternal disruptive dose did disrupt the prepulse inhibition (a measure of attentional function) of acoustic startle response and enhanced the basal startle response. These findings suggest that stimulation of 5-HT_1A receptors by 8-OH-DPAT impairs maternal care by partially interfering with the attentional processing or basal anxiety. More work is needed to further delineate the psychological and neuronal mechanisms underlying the maternal disruptive effect of 5-HT_1A receptor activation.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.