Dopaminergic and serotonergic modulation of anterior insular and orbitofrontal cortex function in risky decision making

A critical review of risk-sensitive foraging

Foraging is risk sensitive if choices depend on the variability of returns from the options as well as their mean return. Risk-sensitive foraging is important in behavioural ecology, psychology and neurophysiology. It has been explained both in terms of mechanisms and in terms of evolutionary advantage. We provide a critical review, evaluating both mechanistic and evolutionary accounts. Some derivations of risk sensitivity from mechanistic models based on psychophysics are not convincing because they depend on an inappropriate use of Jensen's inequality. Attempts have been made to link risk sensitivity to the ecology of a species, but again these are not convincing. The field of risk-sensitive foraging has provided a focus for theoretical and empirical work and has yielded important insights, but we lack a simple and empirically defendable general account of it in either mechanistic or evolutionary terms. However, empirical analysis of choice sequences under theoretically motivated experimental designs and environmental settings appears a promising avenue for mapping the scope and relative merits of existing theories. Simply put, the devil is in the sequence.

Synergistic photoactivation of VTA-catecholaminergic and BLA-glutamatergic projections induces long-term potentiation in the insular cortex

The presentation of novel stimuli induces a reliable dopamine release in the insular cortex (IC) from the ventral tegmental area (VTA). The novel stimuli could be associated with motivational and emotional signals induced by cortical glutamate release from the basolateral amygdala (BLA). Dopamine and glutamate are essential for acquiring and maintaining behavioral tasks, including visual and taste recognition memories. In this study, we hypothesize that the simultaneous activation of dopaminergic and glutamatergic projections to the neocortex can underlie synaptic plasticity. High-frequency stimulation of the BLA-IC circuit has demonstrated a reliable long-term potentiation (LTP), a widely acknowledged synaptic plasticity that underlies memory consolidation. Therefore, the concurrent optogenetic stimulation of the insula's glutamatergic and dopaminergic terminal fibers would induce reliable LTP. Our results confirmed that combined photostimulation of the VTA and BLA projections to the IC induces a slow-onset LTP. We also found that optogenetically-induced LTP in the IC relies on both glutamatergic NMDA receptors and dopaminergic D1/D5 receptors, suggesting that the combined effects of these neurotransmitters can trigger synaptic plasticity in the neocortex. Overall, our findings provide compelling evidence supporting the essential role of both dopaminergic and glutamatergic projections in modulating synaptic plasticity within the IC. Furthermore, our results suggest that the synergistic actions of these projections have a pivotal influence on the formation of motivational memories.

5-HT1A receptor in the central amygdala and 5-HT2A receptor in the basolateral amygdala are involved in social hierarchy in male mice

Most social animals self-organize into dominance hierarchies that strongly influence their behavior and health. The serotonin (5-HT) system is believed to play an important role in the formation of social hierarchy. 5-HT receptors are abundantly expressed in the amygdala, which is considered as the central node for the perception and learning of social hierarchy. In this study, we assessed the functions of various 5-HT receptor subtypes related to social rank determination in different subregions of the amygdala using the confrontation tube test in mice. We revealed that most adult C57BL/6 J male mice exhibited a linear social rank after a few days of cohousing. The tube test ranks were slightly related to anxiety-like behavioral performance. After the tube test, the amygdala and 5-HT neurons in the dorsal raphe nucleus were activated in lower-rank individuals. Quantitative real-time polymerase chain reaction analysis revealed that despite the high expression of 5-HT1A receptor mRNA in the central amygdala (CeA), 5-HT2A receptor mRNA expression was downregulated in the basolateral amygdala (BLA) in higher-rank individuals. The dominant-subordinate relationship between mouse pairs could be switched via pharmacological modulation of these receptors in CeA and BLA, suggesting that these expression changes are essential for establishing social ranks. Our findings provide novel insights into the divergent functions of 5-HT receptors in the amygdala related to social hierarchy, which is closely related to our health and welfare.

Still a "hidden island"? The rodent insular cortex in drug seeking, reward, and risk

The insular cortex (IC) is implicated in risky decision making and drug-seeking behaviors, in a manner dissociable from natural reward seeking. However, evidence from rodent studies of motivated behaviors suggests that the role of the IC is not always consistent across procedures. Moreover, there is evidence of dissociation of function between posterior (pIC) and anterior (aIC) subregions in these behaviors. Under which circumstances, and by which mechanisms, these IC subregions are recruited to regulate motivated behaviors remains unclear. Here, we discuss evidence of rodent pIC and aIC function across drug-related behaviors, natural reward seeking, and decision making under risk and highlight procedural differences that may account for seemingly conflicting findings. Although gaps in the literature persist, we hypothesize that IC activity is broadly important for selection of appropriate behaviors based on learned action-outcome contingencies and that associated risk is sufficient, but not necessary, to recruit the aIC in reward seeking without involving the pIC.

Constitutive depletion of brain serotonin differentially affects rats' social and cognitive abilities

Central serotonin appears a promising transdiagnostic marker of psychiatric disorders and a modulator of some of their key behavioral symptoms. In adult male Tph2 ^-/- rats, constitutively lacking central serotonin, we tested individual's cognitive, social and non-social abilities and characterized group's social organization under classical and ethological testing conditions. Using unsupervised machine learning, we identified the functions most dependent on serotonin. Although serotonin depletion did not affect cognitive performances in classical testing, in the home-cage it induced compulsive aggression and sexual behavior, hyperactive and hypervigilant stereotyped behavior, reduced self-care and exacerbated corticosterone levels. This profile recalled symptoms of impulse control and anxiety disorders. Serotonin appeared essential for behavioral adaptation to dynamic social environments. Our animal model challenges the essential role of serotonin in decision-making, flexibility, impulsivity, and risk-taking. These findings highlight the importance of studying everyday life functions within the dynamic social living environment to model complexity in animal models.

To learn or to gain: neural signatures of exploration in human decision-making

Individuals not only take actions to obtain immediate rewards but also to gain more information to guide future choices. An ideal exploration-exploitation balance is crucial for maximizing reward over the long run. However, the neural signatures of exploration in humans remain unclear. Using quantitative meta-analyses of functional magnetic resonance imaging experiments on exploratory behaviors, we sought to identify the concordant activity pertaining to exploration over a range of experiments. The results revealed that exploration activates concordant brain activity associated with risk (e.g., dorsal medial prefrontal cortex and anterior insula), cognitive control (e.g., dorsolateral prefrontal cortex and inferior frontal gyrus), and motor processing (e.g., premotor cortex). These stereotaxic maps of exploration may indicate that exploration is highly linked to risk processing, but is also specifically associated with regions involved in executive control processes. Although this explanation should be treated as exploratory, these findings support theories positing an important role for the prefrontal-insular-motor cortical network in exploration.

Neural Responses to Fluoxetine in Youths with Disruptive Behavior and Trauma Exposure: A Pilot Study

Objective: A preliminary investigation of the impact of a serotonergic agent (fluoxetine) on symptom profile and neural response in youths with disruptive behavior disorders (DBDs) and a history of trauma exposure. Methods: There were three participant groups: (i) Youths with DBDs and trauma exposure who received fluoxetine treatment for 8 weeks (n = 11); (ii) A matched group of youths with DBDs and trauma exposure who received routine regular follow-up in an outpatient clinic (n = 10); and (iii) Typically developing youths (n = 18). All participants conducted an expression processing functional magnetic resonance imaging task twice, 8 weeks apart: (pretreatment and post-treatment for youths with DBDs). Results: Youths with DBDs and trauma exposure who received fluoxetine treatment compared to the other two groups showed: (i) significant improvement in externalizing, oppositional defiant disorder, irritability, anxiety-depression, and trauma-related symptoms; (ii) as a function of fearful expression intensity, significantly decreased amygdala response and increased recruitment of regions implicated in top-down attention control (insula cortex, inferior parietal lobule, and postcentral gyrus) and emotional regulation (ventromedial prefrontal cortex [vmPFC]); and (iii) correlation between DBD/irritability symptom improvement and increased activation of top-down attention control areas (inferior parietal lobule, insula cortex, and postcentral gyrus) and an emotion regulation area (vmPFC). Conclusions: This study provides preliminary evidence that a serotonergic agent (fluoxetine) can reduce disruptive behavior and mood symptoms in youths with DBDs and trauma exposure and that this may be mediated by enhanced activation of top-down attention control and emotion regulation areas (inferior parietal lobule, insula cortex, and vmPFC).

Opposing effects of dopamine on agonistic behaviour in crayfish

The effects of dopamine on the agonistic behaviour of crayfish were analysed. When dopamine concentrations of 1 μmol l-1 were injected into large crayfish, individuals were beaten by smaller opponents, despite their physical advantage. Injection of 10 μmol l-1 dopamine into small animals increased their rate of winning against larger opponents. Injection of a D1 receptor antagonist prohibited the onset of a 'loser' effect in subordinate animals, suggesting that the inhibitory effect of dopamine on larger animals is mediated by D1 receptors. Similarly, injection of a D2 receptor antagonist prohibited the onset of a 'winner' effect in dominant animals, suggesting that the facilitating effect of dopamine on small animals is mediated by D2 receptors. Since the inhibitory effect of 1 μmol l-1 dopamine was similar to that seen with 1 μmol l-1 octopamine and the facilitating effect of 10 μmol l-1 dopamine was similar to that of 1 μmol l-1 serotonin, functional interactions among dopamine, octopamine and serotonin were analyzed by co-injection of amines with their receptor antagonists in various combinations. The inhibitory effect of 1 μmol l-1 dopamine disappeared when administered with D1 receptor antagonist, but remained when combined with octopamine receptor antagonist. Octopamine effects disappeared when administered with either D1 receptor antagonist or octopamine receptor antagonist, suggesting that the dopamine system is downstream of octopamine. The facilitating effect of 10 μmol l-1 dopamine disappeared when combined with serotonin 5HT1 receptor antagonist or D2 receptor antagonist. Serotonin effects also disappeared when combined with D2 receptor antagonist, suggesting that dopamine and serotonin activate each other through parallel pathways.

Dorsal raphe nucleus to anterior cingulate cortex 5-HTergic neural circuit modulates consolation and sociability

Consolation is a common response to the distress of others in humans and some social animals, but the neural mechanisms underlying this behavior are not well characterized. By using socially monogamous mandarin voles, we found that optogenetic or chemogenetic inhibition of 5-HTergic neurons in the dorsal raphe nucleus (DR) or optogenetic inhibition of serotonin (5-HT) terminals in the anterior cingulate cortex (ACC) significantly decreased allogrooming time in the consolation test and reduced sociability in the three-chamber test. The release of 5-HT within the ACC and the activity of DR neurons were significantly increased during allogrooming, sniffing, and social approaching. Finally, we found that the activation of 5-HT1A receptors in the ACC was sufficient to reverse consolation and sociability deficits induced by the chemogenetic inhibition of 5-HTergic neurons in the DR. Our study provided the first direct evidence that DR-ACC 5-HTergic neural circuit is implicated in consolation-like behaviors and sociability.

Is there a Neurobiological Rationale for the Utility of the Iowa Gambling Task in Parkinson's Disease?

Up to 23% of newly diagnosed, non-demented, Parkinson’s disease (PD) patients experience deficits in executive functioning (EF). In fact, EF deficits may occur up to 39-months prior to the onset of motor decline. Optimal EF requires working memory, attention, cognitive flexibility, and response inhibition underlying appropriate decision-making. The capacity for making strategic decisions requires inhibiting imprudent decisions and are associated with noradrenergic and dopaminergic signaling in prefrontal and orbitofrontal cortex. Catecholaminergic dysfunction and the loss of noradrenergic and dopaminergic cell bodies early in PD progression in the aforementioned cortical areas likely contribute to EF deficits resulting in non-strategic decision-making. Thus, detecting these deficits early in the disease process could help identify a significant portion of individuals with PD pathology (14–60%) before frank motor impairment. A task to evaluate EF in the domain of non-strategic decision-making might be useful to indicate the moderate loss of catecholamines that occurs early in PD pathology prior to motor decline and cognitive impairment. In this review, we focus on the potential utility of the Iowa Gambling Task (IGT) for this purpose, given significant overlap between in loss of dopaminergic and noradrenergic cells bodies in early PD and the deficits in catecholamine function associated with decreased EF. As such, given the loss of catecholamines already well-underway after PD diagnosis, we evaluate the potential utility of the IGT to identify the risk of therapeutic non-compliance and a potential companion approach to detect PD in premotor stages.

Eating to dare - Nutrition impacts human risky decision and related brain function

Macronutrient composition modulates plasma amino acids that are precursors of neurotransmitters and can impact brain function and decisions. Neurotransmitter serotonin has been shown to regulate not only food intake, but also economic decisions. We investigated whether an acute nutrition-manipulation inducing plasma tryptophan fluctuation affects brain function, thereby affecting risky decisions. Breakfasts differing in carbohydrate/protein ratios were offered to test changes in risky decision-making while metabolic and neural dynamics were tracked. We identified that a high-carbohydrate/protein breakfast increased plasma tryptophan/LNAA (large neutral amino acids) ratio which mapped to individual risk propensity changes. The nutrition-manipulation and tryptophan/LNAA fluctuation effects on risk propensity changes were further modulated by individual differences in body fat mass. Using fMRI, we further identified activation in the parietal lobule during risk-processing, of which activities 1) were sensitive to the tryptophan/LNAA fluctuation, 2) were modulated by individual's body fat mass, and 3) predicted the risk propensity changes in decision-making. Our results provide evidence for a personalized nutrition-driven modulation on human risky decision and its metabolic and neural mechanisms.

Pair housing, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effect of probability presentation order on amphetamine-induced changes in risky choice

Probability discounting is often measured with independent schedules. Independent schedules have several limitations, such as confounding preference for one alternative with frequency of reward presentation and generating ceiling/floor effects at certain probabilities. To address this potential caveat, a controlled reinforcer frequency schedule can be used, in which the manipulandum that leads to reinforcement is pseudo-randomly determined before each trial. This schedule ensures subjects receive equal presentations of the small and large magnitude reinforcers across each block of trials. A total of 24 pair-housed and 11 individually housed female Sprague Dawley rats were tested in a controlled reinforcer frequency procedure. For half of the rats, the odds against (OA) receiving the large magnitude reinforcer increased across the session (ascending schedule); the OA decreased across the session for half of the rats (descending schedule). Following training, rats received treatments of amphetamine (AMPH; 0, 0.25, 0.5, 1.0 mg/kg; s.c.). For pair-housed rats, AMPH (0.5 mg/kg) increased risky choice, regardless of probability presentation order, whereas a higher dose of AMPH (1.0 mg/kg) decreased discriminability of reinforcer magnitude for rats trained on the descending schedule only. For individually housed rats, probability presentation order modulated the effects of AMPH on probability discounting, as AMPH (0.25 and 0.5 mg/kg) increased risky choice in rats trained on the ascending schedule but not on the descending schedule. These results show that pair-housing animals, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effects of probability presentation order on drug effects on risky choice.

The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

Exploring the relationship between umbilical blood cord donation and the impact of social distance on altruism and trust

Allogeneic umbilical cord blood (UCB) donation is a pro-social behaviour directed to strangers that has a certain cost for the donor. Although the promotion of such behaviour is an important goal for many countries' health systems, little is known about the reasons that would lead to it. With this study, we explored how the impact of social closeness on altruism and trust could be related to UCB donation in a sample of new-mothers (N = 167). Participants played hypothetical Dictator and Trust games with socially close (e.g., parents) or distant (e.g., strangers) others. They donated more money to parents and siblings compared to cousins, friends and strangers and they trusted more parents, siblings and friends than cousins and strangers. Interestingly, the lower the impact of social closeness on altruism (i.e., generosity towards socially distant others), the higher the intention and the actual probability of UCB donation. A mediation analysis has shown that the relationship between social closeness on altruism and UCB donation was mediated by objective intention to donate (i.e., having followed all the procedures needed). These findings show that other-oriented motivations towards distant others might have important practical implications in identifying the targets of interventions for the promotion of UCB donation.

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Monoaminergic modulation of decision-making under risk of punishment in a rat model

The ability to decide advantageously among options that vary in both their risks and rewards is critical for survival and well-being. Previous work shows that some forms of risky decision-making are robustly modulated by monoamine signaling, but it is less clear how monoamine signaling modulates decision-making under risk of explicit punishment. The goal of these experiments was to determine how this form of decision-making is modulated by dopamine, serotonin, and norepinephrine signaling, using a task in which rats choose between a small, 'safe' food reward and a large food reward associated with variable risks of punishment. Preference for the large, risky reward (risk-taking) was reduced by administration of a D2/3 dopamine receptor agonist (bromocriptine) and a selective D2 agonist (sumanirole). The selective D3 agonist PD128907 appeared to attenuate reward discrimination abilities but did not affect risk-taking per se. In contrast, drugs targeting serotonergic and noradrenergic signaling had few if any effects on choice behavior. These data suggest that in contrast to other forms of risky decision-making, decision-making under risk of punishment is selectively modulated by dopamine signaling, predominantly through D2 receptors.

[Physiological centers of decision-making: manipulation of neural activity in insular cortex by AAV]

Decision-making is a key activity process that influences many aspects of daily living and both mental and physical health. In general, healthy participants reveal rational choice, but patients with neuropsychiatric disorders reveal irrational and risky choice in decision-making. Addiction is one of typical diseases revealed risky decision-making, addicts select risky action and options that confer short-term rewards at the cost of long-term disadvantages. Thus, irrational and risky decision-making is recognized as a core problem in patients with neuropsychiatric disorders, and a better understanding of the mechanisms underlying altered decision-making would provide insights into potential therapeutic approaches for these diseases. However, the neural pathway and substrates underlying these deficits are particularly unknown. Recently, we found that insular cortex is one of key regions for risky decision-making in an animal model of methamphetamine addiction, by using the designer receptor exclusively activated by designer drug (DREADD) technology, and that GABAergic dysfunction in insular cortex is involved in evaluating the subjective value of reward and reward prediction error. These brain dysfunctions would be related to risk taking behavior in addiction. In this review, we introduced the possible neural pathway related to risky decision-making and behavioral changes in choice strategy using adeno associated virus (AAV).

Neurocognitive assessment in obsessive compulsive disorder patients: Adherence to behavioral decision models

In economics, models of decision-making under risk are widely investigated. Since many empirical studies have shown patterns in choice behavior that classical models fail to predict, several descriptive theories have been developed. Due to an evident phenotypic heterogeneity, obsessive compulsive disorder (OCD) patients have shown a general deficit in decision making when compared to healthy control subjects (HCs). However, the direction for impairment in decision-making in OCD patients is still unclear. Hence, bridging decision-making models widely used in the economic literature with mental health research may improve the understanding of preference relations in severe patients, and may enhance intervention designs. We investigate the behavior of OCD patients with respect to HCs by means of decision making economic models within a typical neuropsychological setting, such as the Cambridge Gambling Task. In this task subjects have to decide the amount of their initial wealth to invest in each risky decision. To account for heterogenous preferences, we have analyzed the micro-level data for a more informative analysis of the choices made by the subjects. We consider two influential models in economics: the expected value (EV), which assumes risk neutrality, and a multiple reference points model, an alternative formulation of Disappointment theory. We find evidence that (medicated) OCD patients are more consistent with EV than HCs. The former appear to be more risk neutral, namely, less sensitive to risk than HCs. They also seem to base their decisions on disappointment avoidance less than HCs.

Review: brain neurobiology of gambling disorder based on rodent models

Different literature reviews of gambling disorder (GD) neurobiology have been focused on human studies, others have focused on rodents, and others combined human and rodent studies. The main question of this review was: which are the main neurotransmitters systems and brain structures relevant for GD based on recent rodent studies? This work aims to review the experimental findings regarding the rodent´s neurobiology of GD. A search in the Pub Med database was set (October 2012-October 2017) and 162 references were obtained. After screening, 121 references were excluded, and only 41 references remained from the initial output. More, other 25 references were added to complement (introduction section, neuroanatomical descriptions) the principal part of the work. At the end, a total of 66 references remained for the review. The main conclusions are: 1) according to studies that used noninvasive methods for drug administration, some of the neurotransmitters and receptors involved in behaviors related to GD are: muscarinic, N-methyl-D-aspartate (NMDA), cannabinoid receptor 1 (CB₁), cannabinoid receptor 2 (CB₂), dopamine 2 receptor (D₂), dopamine 3 receptor (D₃), and dopamine 4 receptor (D₄); 2) moreover, there are other neurotransmitters and receptors involved in GD based on studies that use invasive methods of drug administration (eg, brain microinjection); example of these are: serotonin 1A receptor (5-HT_1A), noradrenaline receptors, gamma-aminobutyric acid receptor A (GABA_A), and gamma-aminobutyric acid receptor B (GABA_B); 3) different brain structures are relevant to behaviors linked to GD, like: amygdala (including basolateral amygdala (BLA)), anterior cingulate cortex (ACC), hippocampus, infralimbic area, insular cortex (anterior and rostral agranular), nucleus accumbens (NAc), olfactory tubercle (island of Calleja), orbitofrontal cortex (OFC), medial prefrontal cortex (mPFC), prefrontal cortex (PFC) - subcortical network, striatum (ventral) and the subthalamic nucleus (STN); and 4) the search for GD treatments should consider this diversity of receptor/neurotransmitter systems and brain areas.

Dopamine Receptor-Specific Contributions to the Computation of Value

Dopamine is thought to play a crucial role in value-based decision making. However, the specific contributions of different dopamine receptor subtypes to the computation of subjective value remain unknown. Here we demonstrate how the balance between D1 and D2 dopamine receptor subtypes shapes subjective value computation during risky decision making. We administered the D2 receptor antagonist amisulpride or placebo before participants made choices between risky options. Compared with placebo, D2 receptor blockade resulted in more frequent choice of higher risk and higher expected value options. Using a novel model fitting procedure, we concurrently estimated the three parameters that define individual risk attitude according to an influential theoretical account of risky decision making (prospect theory). This analysis revealed that the observed reduction in risk aversion under amisulpride was driven by increased sensitivity to reward magnitude and decreased distortion of outcome probability, resulting in more linear value coding. Our data suggest that different components that govern individual risk attitude are under dopaminergic control, such that D2 receptor blockade facilitates risk taking and expected value processing.

Sex Differences in Risk Preference and c-Fos Expression in Paraventricular Thalamic Nucleus of Rats During Gambling Task

Different biological requirements between males and females may cause sex differences in decision preference when choosing between taking a risk to get a higher gain or taking a lower but sure gain. Several studies have tested this assumption in rats, however the conclusion remains controversial because the previous real-world like gambling tasks contained a learning component to track a global payoff of probabilistic outcome in addition to risk preference. Therefore, we modified a simple gambling task allowing us to exclude such learning effect, and investigated the sex difference in risk preference of rats and its neural basis. The task required water deprived rats to choose between a risky option which provided four drops of water or no reward at a 50% random chance vs. a sure option which provided predictable amount x (x = 1, 2, 3, 4). The amount and the risk were explicitly instructed so that different choice conditions could be tested trial by trial without re-learning of reward contingency. Although both sexes correctly chose the sure option with the same level of accuracy when the sure option provided the best offer (x = 4), they exhibited different choice performances when two options had the same expected value (x = 2). Males and females both preferred to take risky choices than sure choices (risk seeking), but males were more risk seeking than females. Outcome-history analysis of their choice pattern revealed that females reduced their risk preference after losing risky choices, whereas males did not. Rather, as losses continued, reaction time for subsequent risky choices got shorter in males. Given that significant sex difference features mainly emerged after negative experiences, male and female rats may evaluate an unsuccessful outcome of their decision in different manners. Furthermore, c-Fos expression in the paraventricular nucleus of the thalamus (PV) was higher in the gambling task than for the control task in males while c-fos levels did not differ in females. The present study provides a clear evidence of sex differences in risk preference in rats and suggests that the PV is a candidate region contributing to sex differences in risky decision making.

Modeling risky decision-making in nonhuman animals: shared core features

Understanding the neural mechanisms of risky decision-making is critical to developing appropriate treatments for psychiatric disorders, problem gambling, and addiction to drugs of abuse. Probing neurobiological mechanisms requires the use of nonhuman animal models (particularly rhesus macaques, rats, and mice). However, there is considerable variation across species in risk preferences. Nevertheless, there are shared core features of risky decision-making present across species. As demonstrated with a wide variety of behavioral paradigms, modulators of risk preference observed in humans are readily replicated in model species. Thus, risky decision-making represents an important implementation of reward-guided decision-making that is feasibly modeled across species.

Neural and neurochemical basis of reinforcement-guided decision making

Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.