Inter-individual decision-making differences in the effects of cingulate, orbitofrontal, and prelimbic cortex lesions in a rat gambling task

Insular and prelimbic cortices control behavioral accuracy and precision in a temporal decision-making task in rats

The anterior insular cortex (AIC) comprises a region of sensory integration. It appears to detect salient events in order to guide goal-directed behavior, code tracking errors, and estimate the passage of time. Temporal processing in the AIC may be instantiated by the integration of representations of interoception. Projections between the AIC and the medial prefrontal cortex (mPFC) - found both in rats and humans - also suggest a possible role for these structures in the integration of autonomic responses during ongoing behavior. Few studies, however, have investigated the role of AIC and mPFC in decision-making and time estimation tasks. Moreover, their findings are not consistent, so the relationship between temporal decision-making and those areas remains unclear. The present study employed bilateral inactivations to explore the role of AIC and prelimbic cortex (PL) in rats during a temporal decision-making task. In this task, two levers are available simultaneously (but only one is active), one predicting reinforcement after a short, and the other after a long-fixed interval. Optimal performance requires a switch from the short to the long lever after the short-fixed interval elapsed and no reinforcement was delivered. Switch behavior from the short to the long lever was dependent on AIC and PL. During AIC inactivation, switch latencies became more variable, while during PL inactivation switch latencies became both more variable and less accurate. These findings point to a dissociation between AIC and PL in temporal decision-making, suggesting that the AIC is important for temporal precision, and PL is important for both temporal accuracy and precision.

Poor Decision Making and Sociability Impairment Following Central Serotonin Reduction in Inducible TPH2-Knockdown Rats

Serotonin is an essential neuromodulator for mental health and animals' socio-cognitive abilities. However, we previously found that a constitutive depletion of central serotonin did not impair rat cognitive abilities in stand-alone tests. Here, we investigated how a mild and acute decrease in brain serotonin would affect rats' cognitive abilities. Using a novel rat model of inducible serotonin depletion via the genetic knockdown of tryptophan hydroxylase 2 (TPH2), we achieved a 20% decrease in serotonin levels in the hypothalamus after three weeks of non-invasive oral doxycycline administration. Decision making, cognitive flexibility, and social recognition memory were tested in low-serotonin (Tph2-kd) and control rats. Our results showed that the Tph2-kd rats were more prone to choose disadvantageously in the long term (poor decision making) in the Rat Gambling Task and that only the low-serotonin poor decision makers were more sensitive to probabilistic discounting and had poorer social recognition memory than other low-serotonin and control individuals. Flexibility was unaffected by the acute brain serotonin reduction. Poor social recognition memory was the most central characteristic of the behavioral network of low-serotonin poor decision makers, suggesting a key role of social recognition in the expression of their profile. The acute decrease in brain serotonin appeared to specifically amplify the cognitive impairments of the subgroup of individuals also identified as poor decision makers in the population. This study highlights the great opportunity the Tph2-kd rat model offers to study inter-individual susceptibilities to develop cognitive impairment following mild variations of brain serotonin in otherwise healthy individuals. These transgenic and differential approaches together could be critical for the identification of translational markers and vulnerabilities in the development of mental disorders.

Novel rat model of gaming disorder: assessment of social reward and sex differences in behavior and c-Fos brain activity

RATIONALE

In 2018, the International Classification of Diseases (ICD-11) classified Gaming Disorder (GD) as a mental disorder. GD mainly occurs among adolescents, who, after developing addiction, show psychopathological traits, such as social anxiety, depression, social isolation, and attention deficit. However, the different studies conducted in humans so far show several limitations, such as the lack of demographic heterogeneity and equal representation of age, differences in the type of game and in the follow-up period. Furthermore, at present, no animal models specific to GD are available.

OBJECTIVES

To address the lack of an experimental model for GD, in the present work, we proposed a new GD rat model to investigate some peculiar tracts of the disorder.

METHODS

Two-month-old Wistar Kyoto rats, both males and females, were subject to a five-week training with a new innovative touch-screen platform. After five weeks of training, rats were assessed for: (a) their attachment to the play under several conditions, (b) their hyperactivity during gaming, and (c) the maintenance of these conditions after a period of game pause and reward interruption. After sacrifice, using immunohistochemistry techniques, the immunoreactivity of c-Fos (a marker of neuronal activity) was analyzed to study different neural areas.

RESULTS

After the training, the rats subjected to GD protocol developed GD-related traits (e.g., hyperactivity, loss control), and the behavioral phenotype was maintained consistently over time. These aspects were completely absent in the control groups. Lastly, the analysis of c-Fos immunoreactivity in prelimbic cortex (PrL), orbitofrontal cortex (OFC), nucleus Accumbens, amygdala and bed nucleus of stria terminalis (BNST) highlighted significant alterations in the GD groups compared to controls, suggesting modifications in neural activity related to the development of the GD phenotype.

CONCLUSIONS

The proposal of a new GD rat model could represent an innovative tool to investigate, in both sexes, the behavioral and neurobiological features of this disorder, the possible role of external factors in the predisposition and susceptibility and the development of new pharmacological therapies.

Differential processing of decision information in subregions of rodent medial prefrontal cortex

Decision-making involves multiple cognitive processes requiring different aspects of information about the situation at hand. The rodent medial prefrontal cortex (mPFC) has been hypothesized to be central to these abilities. Functional studies have sought to link specific processes to specific anatomical subregions, but past studies of mPFC have yielded controversial results, leaving the precise nature of mPFC function unclear. To settle this debate, we recorded from the full dorso-ventral extent of mPFC in each of 8 rats, as they performed a complex economic decision task. These data revealed four distinct functional domains within mPFC that closely mirrored anatomically identified subregions, including novel evidence to divide prelimbic cortex into dorsal and ventral components. We found that dorsal aspects of mPFC (ACC, dPL) were more involved in processing information about active decisions, while ventral aspects (vPL, IL) were more engaged in motivational factors.

Exploring decision-making strategies in the Iowa gambling task and rat gambling task

Decision-making requires that individuals perceive the probabilities and risks associated with different options. Experimental human and animal laboratory testing provide complimentary insights on the psychobiological underpinnings of decision-making. The Iowa gambling task (IGT) is a widely used instrument that assesses decision-making under uncertainty and risk. In the task participants are faced with a choice conflict between cards with varying monetary reinforcer/loss contingencies. The rat gambling task (rGT) is a pre-clinical version using palatable reinforcers as wins and timeouts mimicking losses. However, interspecies studies elaborating on human and rat behavior in these tasks are lacking. This study explores decision-making strategies among young adults (N = 270) performing a computerized version of the IGT, and adult outbred male Lister Hooded rats (N = 72) performing the rGT. Both group and individual data were explored by normative scoring approaches and subgroup formations based on individual choices were investigated. Overall results showed that most humans and rats learned to favor the advantageous choices, but to a widely different extent. Human performance was characterized by both exploration and learning as the task progressed, while rats showed relatively consistent pronounced preferences for the advantageous choices throughout the task. Nevertheless, humans and rats showed similar variability in individual choice preferences during end performance. Procedural differences impacting on the performance in both tasks and their potential to study different aspects of decision-making are discussed. This is a first attempt to increase the understanding of similarities and differences regarding decision-making processes in the IGT and rGT from an explorative perspective.

The orbitofrontal cortex represents advantageous choice in the Iowa gambling task

A good‐based model, the central neurobiological model of economic decision‐making, proposes that the orbitofrontal cortex (OFC) represents binary choice outcome, that is, the chosen good. A good is defined by a group of determinants characterizing the conditions in which the commodity is offered, including commodity type, cost, risk, time delay, and ambiguity. Previous studies have found that the OFC represents the binary choice outcome in decision‐making tasks involving commodity type, cost, risk, and delay. Real‐life decisions are often complex and involve uncertainty, rewards, and penalties; however, whether the OFC represents binary choice outcomes in a complex decision‐making situation, for example, Iowa gambling task (IGT), remains unclear. Here, we propose that the OFC represents binary choice outcome, that is, advantageous choice versus disadvantageous choice, in the IGT. We propose two hypotheses: first, the activity pattern in the human OFC represents an advantageous choice; and second, choice induces an OFC‐related functional network. Using functional magnetic resonance imaging and advanced machine‐learning tools, we found that the OFC represented an advantageous choice in the IGT. The OFC representation of advantageous choice was related to decision‐making performance. Choice modulated the functional connectivity between the OFC and the superior medial gyrus. In conclusion, the OFC represents an advantageous choice during the IGT. In the framework of a good‐based model, the results extend the role of the OFC to complex decision‐making situation when making a binary choice.

Inter-Individual Differences in Cognitive Tasks: Focusing on the Shaping of Decision-Making Strategies

In this paper, we review recent (published and novel) data showing inter-individual variation in decision-making strategies established by mice in a gambling task (MGT for Mouse Gambling Task). It may look intriguing, at first, that congenic animals develop divergent behaviors. However, using large groups of mice, we show that individualities emerge in the MGT, with about 30% of healthy mice displaying risk-averse choices while about 20-25% of mice make risk-prone choices. These strategies are accompanied by different brain network mobilization and individual levels of regional -prefrontal and striatal- monoamines. We further illustrate three ecological ways that influence drastically cognitive strategies in healthy adult mice: sleep deprivation, sucrose or artificial sweetener exposure, and regular exposure to stimulating environments. Questioning how to unmask individual strategies, what are their neural/neurochemical bases and whether we can shape or reshape them with different environmental manipulations is of great value, first to understand how the brain may build flexible decisions, and second to study behavioral plasticity, in healthy adult, as well as in developing brains. The latter may open new avenues for the identification of vulnerability traits to adverse events, before the emergence of mental pathologies.

Functional connectivity in reward-related networks is associated with individual differences in gambling strategies in male Lister hooded rats

Individuals with gambling disorder display deficits in decision-making in the Iowa Gambling Task. The rat Gambling Task (rGT) is a rodent analogue that can be used to investigate the neurobiological mechanisms underlying gambling behaviour. The aim of this explorative study was to examine individual strategies in the rGT and investigate possible behavioural and neural correlates associated with gambling strategies. Thirty-two adult male Lister hooded rats underwent behavioural testing in the multivariate concentric square field™ (MCSF) and the novel cage tests, were trained on and performed the rGT and subsequently underwent resting-state functional magnetic resonance imaging (R-fMRI). In the rGT, stable gambling strategies were found with subgroups of rats that preferred the suboptimal safest choice as well as the disadvantageous choice, that is, the riskiest gambling strategy. R-fMRI results revealed associations between gambling strategies and brain regions central for reward networks. Moreover, rats with risky gambling strategies differed from those with strategic and intermediate strategies in brain functional connectivity. No differences in behavioural profiles, as assessed with the MCSF and novel cage tests, were observed between the gambling strategy groups. In conclusion, stable individual differences in gambling strategies were found. Intrinsic functional connectivity using R-fMRI provides novel evidence to support the notion that individual differences in gambling strategies are associated with functional connectivity in brain regions important for reward networks.

Individual strategies in the rat gambling task are related to voluntary alcohol intake, but not sexual behavior, and can be modulated by naltrexone

INTRODUCTION

Gambling disorder (GD) is the first non-substance or behavioral addiction to be included in substance-related and addictive disorders in DSM-5. Since GD is a younger phenomenon relative to alcohol and substance use disorders, little is known about potential unique features in GD and to what extent characteristics are shared with alcohol and substance use disorders. The rat gambling task (rGT) is used to study decision-making in rats. This study aimed to identify individual differences in rGT strategies and explore the stability of these strategies over time. Moreover, motor impulsivity, sexual behavior, and voluntary alcohol intake were examined in rats with different rGT strategies. Finally, the response to naltrexone on performance in rats with different rGT strategies was investigated.

METHODS

Male Lister hooded rats (n = 40) underwent repeated testing in the rGT, repeated copulatory behavioral tests, and 7 weeks of voluntary alcohol intake through a modified intermittent two-bottle free-choice paradigm. Finally, rats were treated with naltrexone prior to testing in the rGT.

RESULTS

The results revealed individual choice strategies in the rGT that were stable over time, even after multiple interruptions and other behavioral testing. The rats with a risky choice strategy displayed higher motor impulsivity and voluntary alcohol intake than the other groups. No difference in sexual behavior was found between the different rGT groups. Finally, in all rats irrespectively of rGT strategy, treatment with naltrexone decreased the number of completed trials and premature responses, and increased omissions, which indicates an overall lowered motivation.

DISCUSSION

In conclusion, rats with risky rGT strategies had higher voluntary alcohol intake but not elevated sexual behavior, indicating shared underlying mechanisms between rGT strategies and alcohol intake but not natural rewards in terms of sexual behavior. Finally, naltrexone treatment resulted in an overall lowered motivation in the rGT.

Executive function in obesity and anorexia nervosa: Opposite ends of a spectrum of disordered feeding behaviour?

Higher-order executive functions such as decision-making, cognitive flexibility and behavioural control are critical to adaptive success in all aspects of life, including the maintenance of a healthy body weight by regulating food intake. Performance on tasks designed to assess these aspects of cognition is impaired in individuals with obesity and anorexia nervosa (AN); conditions at either end of a spectrum of body weight disturbance. While the conceptualisation of obesity and AN as mirror images of each other makes some sense from a metabolic point of view, whether or not these conditions also reflect opposing states of executive function is less clear. Here, we review evidence from neurocognitive and neuroimaging studies to compare the direction and extent of executive dysfunction in subjects with obesity and AN and how these are underpinned by changes in structure and function of subregions of the prefrontal cortex (PFC). Both conditions of extreme body weight disturbance are associated with impaired decision-making and cognitive inflexibility, however, impulsive behaviour presents in opposing directions; obesity being associated with reduced behavioural control and AN being associated with elevated control over behaviour with respect to food and feeding. Accordingly, the subregions of the PFC that guide inhibitory control and valuation of action outcomes (dorsolateral prefrontal cortex and orbitofrontal cortex) show opposite patterns of activation in subjects with obesity compared to those with AN, whereas the subregions implicated in cognitive and behavioural flexibility (ventromedial prefrontal cortex and anterior cingulate cortex) show alterations in the same direction in both conditions but with differential extent of dysfunction. We synthesise these findings in the context of the utility of animal models of obesity and AN to interrogate the detail of the neurobiological contributions to cognition in patient populations and the utility of such detail to inform future treatment strategies that specifically target executive dysfunction.

Dissociable roles for the ventral and dorsal medial prefrontal cortex in cue-guided risk/reward decision making

Converging evidence from studies with animals and humans have implicated separate regions of the medial prefrontal cortex (mPFC) corresponding to the anterior cingulate cortex (ACC), in mediating different aspects of reward-related decisions involving uncertainty or risk. However, the dissociable contributions of subregions of the ACC remain unclear, as discrepancies exist between human neuroimaging findings and preclinical rodent studies. To clarify how ventral vs. dorsal regions of the mPFC contribute to risk/reward decision making, the present study assessed the effects of inactivation of different subregions on performance of a "Blackjack task" that measured cue-guided decision making and shares similarities with paradigms used with humans. Male, Long-Evans rats were well-trained to choose between a Small/Certain reward vs a Large/Risky reward delivered with variable probabilities (i.e., good vs. poor-odds, 50% vs. 12.5%). The odds of obtaining the larger reward was signaled by auditory cues at the start of each trial. Inactivation of the ventral, infralimbic region of the mPFC increased risky choice selectively when the odds of winning were poor. By contrast, inactivation of the prelimbic and anterior cingulate regions of the dorsal mPFC led to suboptimal reductions in risky choice on good-odds trials. The effects of prelimbic vs anterior cingulate inactivations were associated with context-dependent alterations in reward vs negative feedback, respectively. These results further clarify the distinct yet complementary manners in which separate ACC regions promote optimal risk/reward decision making and complement neuroimaging findings that activity in human ventral vs dorsal ACC promotes risk aversion or risky choices.

Modelling decision-making under uncertainty: A direct comparison study between human and mouse gambling data

Decision-making is a conserved evolutionary process enabling us to choose one option among several alternatives, and relies on reward and cognitive control systems. The Iowa Gambling Task allows the assessment of human decision-making under uncertainty by presenting four card decks with various cost-benefit probabilities. Participants seek to maximise their monetary gain by developing long-term optimal-choice strategies. Animal versions have been adapted with nutritional rewards, but interspecies data comparisons are scarce. Our study directly compares the non-pathological decision-making performance between humans and wild-type C57BL/6 mice. Human participants completed an electronic Iowa Gambling Task version, while mice a maze-based adaptation with four arms baited in a probabilistic way. Our data shows closely matching performance between both species with similar patterns of choice behaviours. However, mice showed a faster learning rate than humans. Moreover, both populations were clustered into good, intermediate and poor decision-making categories with similar proportions. Remarkably, mice characterised as good decision-makers behaved the same as humans of the same category, but slight differences among species are evident for the other two subpopulations. Overall, our direct comparative study confirms the good face validity of the rodent gambling task. Extended behavioural characterisation and pathological animal models should help strengthen its construct validity and disentangle the determinants in animals and humans decision-making.

Inter-individual and inter-strain differences in cognitive and social abilities of Dark Agouti and Wistar Han rats

Healthy animals displaying extreme behaviours that resemble human psychiatric symptoms are relevant models to study the natural psychobiological processes of maladapted behaviours. Using a Rat Gambling Task, healthy individuals spontaneously making poor decisions (PDMs) were found to co-express a combination of other cognitive and reward-based characteristics similar to symptoms observed in human patients with impulse-control disorders. The main goals of this study were to 1) confirm the existence of PDMs and their unique behavioural phenotypes in Dark Agouti (DA) and Wistar Han (WH) rats, 2) to extend the behavioural profile of the PDMs to probability-based decision-making and social behaviours and 3) to extract key discriminative traits between DA and WH strains, relevant for biomedical research. We have compared cognitive abilities, natural behaviours and physiological responses in DA and WH rats at the strain and at the individual level. Here we found that the naturally occurring PDM's profile was consistent between both rat lines. Then, although the PDM individuals did not take more risks in probability discounting task, they seemed to be of higher social ranks. Finally and despite their similarities in performance, WH and DA lines differed in degree of reward sensitivity, impulsivity, locomotor activity and open space-occupation. The reproducibility and conservation of the complex phenotypes of PDMs and GDMs (good decision makers) in these two genetically different strains support their translational potential. Both strains, present large phenotypic variation in behaviours pertinent for the study of the underlying mechanisms of poor decision making and associated disorders.

Neurons in rat orbitofrontal cortex and medial prefrontal cortex exhibit distinct responses in reward and strategy-update in a risk-based decision-making task

The orbitofrontal cortex (OFC) and the medial prefrontal cortex (mPFC) are known to participate in risk-based decision-making. However, whether neuronal activities of these two brain regions play similar or differential roles during different stages of risk-based decision-making process remains unknown. Here we conducted multi-channel in vivo recordings in the OFC and mPFC simultaneously when rats were performing a gambling task. Rats were trained to update strategy as the task was shifted in two stages. Behavioral testing suggests that rats exhibited different risk preferences and response latencies to food rewards during stage-1 and stage-2. Indeed, the firing patterns and numbers of non-specific neurons and nosepoking-predicting neurons were similar in OFC and mPFC. However, there were no reward-expecting neurons and significantly more reward-excitatory neurons (fired as rats received rewards) in the mPFC. Further analyses suggested that nosepoking-predicting neurons may encode the overall value of reward and strategy, whereas reward-expecting neurons show more intensive firing to a big food reward in the OFC. Nosepoking-predicting neurons in mPFC showed no correlation with decision-making strategy updating, whereas the response of reward-excitatory neurons in mPFC, which were barely observed in OFC, were inhibited during nosepoking, but were enhanced in the post-nosepoking period. These findings indicate that neurons in the OFC and mPFC exhibit distinct responses in decision-making process during reward consumption and strategy updating. Specifically, OFC encodes the overall value of a choice and is thus important for learning and strategy updating, whereas mPFC plays a key role in monitoring and execution of a strategy.

Discretion for behavioral selection affects development of habit formation after extended training in rats

As training progresses, animals show a transition from goal-dependent behavior to goal-independent behavior (habitual responses). Habit formation is influenced by several factors, including the amount of training and action-outcome contingency. However, it remains unknown whether and how discretion for behavioral selection influences habit formation. To this end, we trained male rats in two types of two-alternative forced-choice task: visual association and nonvisual association tasks. In the first type of task, rats learned the association between reward and a visual cue, the position of which was randomly changed per trial so that rats had to make a judgmental decision about which choice delivered the reward in each trial (discreet judgment group); in the second type of task, the rats learned that a reward was delivered after either choice following task initiation (uncontrolled judgment group). To test the sensitivity to contingency manipulation, the extinction tests were conducted in short- and long-term trained groups, with the result that the overtrained rats in the uncontrolled judgment group, but not the other three groups, showed less sensitivity. To further investigate the reward sensitivity in the long-term trained groups from another perspective, we continuously and periodically altered the reward size for each trial. The rats of the discreet judgment group changed intertrial intervals depending on reward size, while this tendency was weaker in the uncontrolled judgment group. These results suggest that discreet judgment maintained goal-directed rat behavior, whereas uncontrolled judgment led to the development of habit-like behavior.

Contributions of medial prefrontal cortex to decision making involving risk of punishment

The prefrontal cortex (PFC) plays an important role in several forms of cost-benefit decision making. Its contributions to decision making under risk of explicit punishment, however, are not well understood. A rat model was used to investigate the role of the medial PFC (mPFC) and its monoaminergic innervation in a Risky Decision-making Task (RDT), in which rats chose between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of mild footshock punishment. Inactivation of mPFC increased choice of the large, risky reward when the punishment probability increased across the session ("ascending RDT"), but decreased choice of the large, risky reward when the punishment probability decreased across the session ("descending RDT"). In contrast, enhancement of monoamine availability via intra-mPFC amphetamine reduced choice of the large, risky reward only in the descending RDT. Systemic administration of amphetamine reduced choice of the large, risky reward in both the ascending and descending RDT; however, this reduction was not attenuated by concurrent mPFC inactivation, indicating that mPFC is not a critical locus of amphetamine's effects on risk taking. These findings suggest that mPFC plays an important role in adapting choice behavior in response to shifting risk contingencies, but not necessarily in risk-taking behavior per se.

Principles of Economic Rationality in Mice

Humans and non-human animals frequently violate principles of economic rationality, such as transitivity, independence of irrelevant alternatives, and regularity. The conditions that lead to these violations are not completely understood. Here we report a study on mice tested in automated home-cage setups using rewards of drinking water. Rewards differed in one of two dimensions, volume or probability. Our results suggest that mouse choice conforms to the principles of economic rationality for options that differ along a single reward dimension. A psychometric analysis of mouse choices further revealed that mice responded more strongly to differences in probability than to differences in volume, despite equivalence in return rates. This study also demonstrates the synergistic effect between the principles of economic rationality and psychophysics in making quantitative predictions about choices of healthy laboratory mice. This opens up new possibilities for the analyses of multi-dimensional choice and the use of mice with cognitive impairments that may violate economic rationality.

Inter-individual differences in decision-making, flexible and goal-directed behaviors: novel insights within the prefronto-striatal networks

Inflexible behavior is a hallmark of several decision-making-related disorders such as ADHD and addiction. As in humans, a subset of healthy rats makes poor decisions and prefers immediate larger rewards despite suffering large losses in a rat gambling task (RGT). They also display a combination of traits reminiscent of addiction, notably inflexible behavior and perseverative responses. The goal of the present work was twofold: (1) to elucidate if behavioral inflexibility of poor decision-makers could be related to a lower quality of goal-directed behavior (action-outcome associations); (2) to uncover the neural basis of inter-individual differences in goal-directed behavior. We specifically assessed inter-individual differences in decision-making in the RGT, flexibility in the RGT-reversed version and goal-directed behavior in a contingency degradation test, i.e., response adaptation when dissociating reward delivery from the animal's action. The contributions of the medial prefrontal cortex and the dorsal striatum to action-outcome associations were assessed using Zif268 immunodetection. Inflexible behavior was related to a lower sensitivity to contingency degradation in all poor decision-makers and only in a few good decision-makers. This poorer sensitivity was associated with a lower immunoreactivity in prelimbic and infralimbic cortices and a higher one in the dorsomedial and dorsolateral striatum. These findings suggest that an imbalanced prefronto-striatal activity could underlie inaccurate goal representation in changing environments and may promote maladaptive habit formation among poor decision-makers. These data strengthen our previous work identifying biomarkers of vulnerability to develop psychiatric disorders and demonstrate the relevance of inter-individual differences to model maladaptive behaviors.

Chronic ciguatoxin poisoning causes emotional and cognitive dysfunctions in rats

Ciguatoxins are marine biotoxins that induce the human poisoning syndrome known as ciguatera fish poisoning (CFP). In humans, different kinds of neurological symptoms have been reported after CFP, including anxiety, depression and memory loss. Repetitive exposures to sub-threshold levels of ciguatera toxins may cause irreversible sub-clinical damage, and eventually cause more severe illness. Our previous study has shown that an acute single dose of Pacific ciguatoxin-1 (P-CTX-1) induced synaptic facilitation and blockage of the induction of electrical stimulation-induced long-term potentiation in the medial thalamus-anterior cingulate cortex pathway. Reactive astrogliosis was detected in acute ciguatera poisoning. Despite the reports of complex and prolonged neurological symptoms in patients, few studies have been conducted in animal models to investigate the emotional and cognitive deficits after chronic exposure to ciguatoxin. In the present study, using a rat model with repeated exposures to low dosage of P-CTX-1, we observed development of anxiety-like behavior by open field test and elevated plus maze test, and learning and memory deficits by the Morris water maze; further, decision-making impairment was determined in the chronic P-CTX-1-treated rats by the rats gambling task. We conclude that chronic ciguatera poisoning leads to anxiety, and to impairment of spatial reference memory and decision-making behavior.

Brexpiprazole reduces hyperactivity, impulsivity, and risk-preference behavior in mice with dopamine transporter knockdown-a model of mania

RATIONALE

Bipolar disorder (BD) is a unique mood disorder defined by periods of depression and mania. The defining diagnosis of BD is the presence of mania/hypomania, with symptoms including hyperactivity and risk-taking. Since current treatments do not ameliorate cognitive deficits such as risky decision-making, and impulsivity that can negatively affect a patient's quality of life, better treatments are needed.

OBJECTIVES

Here, we tested whether acute treatment with brexpiprazole, a serotonin-dopamine activity modulator with partial agonist activity at D_2/3 and 5-HT_1A receptors, would attenuate the BD mania-relevant behaviors of the dopamine transporter (DAT) knockdown mouse model of mania.

METHODS

The effects of brexpiprazole on DAT knockdown and wild-type littermate mice were examined in the behavioral pattern monitor (BPM) and Iowa gambling task (IGT) to quantify activity/exploration and impulsivity/risk-taking behavior respectively.

RESULTS

DAT knockdown mice exhibited hyper-exploratory behavior in the BPM and made fewer safe choices in the IGT. Brexpiprazole attenuated the mania-like hyper-exploratory phenotype and increased safe choices in risk-preferring DAT knockdown mice. Brexpiprazole also reduced safe choices in safe-preferring mice irrespective of genotype. Finally, brexpiprazole reduced premature (impulsive-like) responses in both groups of mice.

CONCLUSIONS

Consistent with earlier reports, DAT knockdown mice exhibited hyper-exploratory, risk-preferring, and impulsive-like profiles consistent with patients with BD mania in these tasks. These behaviors were attenuated after brexpiprazole treatment. These data therefore indicate that brexpiprazole could be a novel treatment for BD mania and/or risk-taking/impulsivity disorders, since it remediates some relevant behavioral abnormalities in this mouse model.

Vagus Nerve Stimulation Alters Phase Synchrony of the Anterior Cingulate Cortex and Facilitates Decision Making in Rats

Vagus nerve stimulation (VNS) can enhance memory and cognitive functions in both rats and humans. Studies have shown that VNS influenced decision-making in epileptic patients. However, the sites of action involved in the cognitive-enhancement are poorly understood. By employing a conscious rat model equipped with vagus nerve cuff electrode, we assess the role of chronic VNS on decision-making in rat gambling task (RGT). Simultaneous multichannel-recordings offer an ideal setup to test the hypothesis that VNS may induce alterations of in both spike-field-coherence and synchronization of theta oscillations across brain areas in the anterior cingulate cortex (ACC) and basolateral amygdala (BLA). Daily VNS, administered immediately following training sessions of RGT, caused an increase in 'good decision-maker' rats. Neural spikes in the ACC became synchronized with the ongoing theta oscillations of local field potential (LFP) in BLA following VNS. Moreover, cross-correlation analysis revealed synchronization between the ACC and BLA. Our results provide specific evidence that VNS facilitates decision-making and unveils several important roles for VNS in regulating LFP and spike phases, as well as enhancing spike-phase coherence between key brain areas involved in cognitive performance. These data may serve to provide fundamental notions regarding neurophysiological biomarkers for therapeutic VNS in cognitive impairment.

Impairment of decision making and disruption of synchrony between basolateral amygdala and anterior cingulate cortex in the maternally separated rat

There is considerable evidence to suggest early life experiences, such as maternal separation (MS), play a role in the prevalence of emotional dysregulation and cognitive impairment. At the same time, optimal decision making requires functional integrity between the amygdala and anterior cingulate cortex (ACC), and any dysfunction of this system is believed to induce decision-making deficits. However, the impact of MS on decision-making behavior and the underlying neurophysiological mechanisms have not been thoroughly studied. As such, we consider the impact of MS on the emotional and cognitive functions of rats by employing the open-field test, elevated plus-maze test, and rat gambling task (RGT). Using multi-channel recordings from freely behaving rats, we assessed the effects of MS on the large scale synchrony between the basolateral amygdala (BLA) and the ACC; while also characterizing the relationship between neural spiking activity and the ongoing oscillations in theta frequency band across the BLA and ACC. The results indicated that the MS rats demonstrated anxiety-like behavior. While the RGT showed a decrease in the percentage of good decision-makers, and an increase in the percentage of poor decision-makers. Electrophysiological data revealed an increase in the total power in the theta band of the LFP in the BLA and a decrease in theta power in the ACC in MS rats. MS was also found to disrupt the spike-field coherence of the ACC single unit spiking activity to the ongoing theta oscillations in the BLA and interrupt the synchrony in the BLA-ACC pathway. We provide specific evidence that MS leads to decision-making deficits that are accompanied by alteration of the theta band LFP in the BLA-ACC circuitries and disruption of the neural network integrity. These observations may help revise fundamental notions regarding neurophysiological biomarkers to treat cognitive impairment induced by early life stress.

Individual behavioral and neurochemical markers of unadapted decision-making processes in healthy inbred mice

One of the hallmarks of decision-making processes is the inter-individual variability between healthy subjects. These behavioral patterns could constitute risk factors for the development of psychiatric disorders. Therefore, finding predictive markers of safe or risky decision-making is an important challenge for psychiatry research. We set up a mouse gambling task (MGT)-adapted from the human Iowa gambling task with uncertain contingencies between response and outcome that furthermore enables the emergence of inter-individual differences. Mice (n = 54) were further individually characterized for locomotive, emotional and cognitive behavior. Individual basal rates of monoamines and brain activation after the MGT were assessed in brain regions related to reward, emotion or cognition. In a large healthy mice population, 44 % showed a balanced strategy with limited risk-taking and flexible choices, 29 % showed a safe but rigid strategy, while 27 % adopted risky behavior. Risky mice took also more risks in other apparatus behavioral devices and were less sensitive to reward. No difference existed between groups regarding anxiety, working memory, locomotion and impulsivity. Safe/rigid mice exhibited a hypoactivation of prefrontal subareas, a high level of serotonin in the orbitofrontal cortex combined with a low level of dopamine in the putamen that predicted the emergence of rigid behavior. By contrast, high levels of dopamine, serotonin and noradrenalin in the hippocampus predicted the emergence of more exploratory and risky behaviors. The coping of C57bl/6J mice in MGT enables the determination of extreme patterns of choices either safe/rigid or risky/flexible, related to specific neurochemical and behavioral markers.

Inactivation of the prelimbic or infralimbic cortex impairs decision-making in the rat gambling task

RATIONALE

Studies employing the Iowa Gambling Task (IGT) demonstrated that areas of the frontal cortex, including the ventromedial prefrontal cortex, orbitofrontal cortex (OFC), dorsolateral prefrontal cortex, and anterior cingulate cortex (ACC), are involved in the decision-making process. However, the precise role of these regions in maintaining optimal choice is not clear.

OBJECTIVES

We used the rat gambling task (rGT), a rodent analogue of the IGT, to determine whether inactivation of or altered dopamine signalling within discrete cortical sub-regions disrupts decision-making.

METHODS

Following training on the rGT, animals were implanted with guide cannulae aimed at the prelimbic (PrL) or infralimbic (IL) cortices, the OFC, or the ACC. Prior to testing, rats received an infusion of saline or a combination of baclofen and muscimol (0.125 μg of each/side) to inactivate the region and an infusion of a dopamine D2 receptor antagonist (0, 0.1, 0.3, and 1.0 μg/side).

RESULTS

Rats tended to increase their choice of a disadvantageous option and decrease their choice of the optimal option following inactivation of either the IL or PrL cortex. In contrast, OFC or ACC inactivation did not affect decision-making. Infusion of a dopamine D2 receptor antagonist into any sub-region did not alter choice preference.

CONCLUSIONS

Online activity of the IL or PrL cortex is important for maintaining an optimal decision-making strategy, but optimal performance on the rGT does not require frontal cortex dopamine D2 receptor activation. Additionally, these results demonstrate that the roles of different cortical regions in cost-benefit decision-making may be dissociated using the rGT.

Translational Rodent Paradigms to Investigate Neuromechanisms Underlying Behaviors Relevant to Amotivation and Altered Reward Processing in Schizophrenia

Amotivation and reward-processing deficits have long been described in patients with schizophrenia and considered large contributors to patients' inability to integrate well in society. No effective treatments exist for these symptoms, partly because the neuromechanisms mediating such symptoms are poorly understood. Here, we propose a translational neuroscientific approach that can be used to assess reward/motivational deficits related to the negative symptoms of schizophrenia using behavioral paradigms that can also be conducted in experimental animals. By designing and using objective laboratory behavioral tools that are parallel in their parameters in rodents and humans, the neuromechanisms underlying behaviors with relevance to these symptoms of schizophrenia can be investigated. We describe tasks that measure the motivation of rodents to expend physical and cognitive effort to gain rewards, as well as probabilistic learning tasks that assess both reward learning and feedback-based decision making. The latter tasks are relevant because of demonstrated links of performance deficits correlating with negative symptoms in patients with schizophrenia. These tasks utilize operant techniques in order to investigate neural circuits targeting a specific domain across species. These tasks therefore enable the development of insights into altered mechanisms leading to negative symptom-relevant behaviors in patients with schizophrenia. Such findings will then enable the development of targeted treatments for these altered neuromechanisms and behaviors seen in schizophrenia.

Decision-making deficits associated with disrupted synchronization between basolateral amygdala and anterior cingulate cortex in rats after tooth loss

Human studies have shown that multiple teeth loss was significantly associated with cognitive impairment, dementia and Alzheimer's disease. However, the causal relationship between tooth loss and cognitive deficits has not been clarified. Rodents demonstrate human-like cognitive faculties. In this study by performing rat gambling task (RGT), we reported that prolonged tooth loss condition by extracting all left molars in the rats led to an increase in the proportion of poor decision-makers, and decrease in the proportion of good decision-makers compared with controls. No influence was detected on the general activity and motivation after tooth loss. Recent experiments have shown that decision-making performances in the RGT rely on the functional integrity of the amygdala and anterior cingulate cortex (ACC). The theta band brain oscillation has been acknowledged for extensive cognitive functions. Here, we performed multiple-electrode array recordings of local field potential (LFP) in anesthetized rats. The results exhibited an increase in accumulative power of the theta frequency of LFP in the basolateral amygdala (BLA) and decrease of theta power in the ACC in tooth loss rats. Furthermore, cross-correlation analysis displayed that tooth loss suppressed the synchronization of theta frequency of LFP between the BLA and ACC, indicating reduced neuronal communications between these two regions. In conclusion, we demonstrate for the first time that tooth loss leads to higher-order cognitive deficits accompanied by the alteration of theta frequency of LFP in brain circuitries and disruption of neural network integrity.

Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models

Over the past 20 years there has been a growing interest in the neural underpinnings of cost/benefit decision-making. Recent studies with animal models have made considerable advances in our understanding of how different prefrontal, striatal, limbic and monoaminergic circuits interact to promote efficient risk/reward decision-making, and how dysfunction in these circuits underlies aberrant decision-making observed in numerous psychiatric disorders. This review will highlight recent findings from studies exploring these questions using a variety of behavioral assays, as well as molecular, pharmacological, neurophysiological, and translational approaches. We begin with a discussion of how neural systems related to decision subcomponents may interact to generate more complex decisions involving risk and uncertainty. This is followed by an overview of interactions between prefrontal-amygdala-dopamine and habenular circuits in regulating choice between certain and uncertain rewards and how different modes of dopamine transmission may contribute to these processes. These data will be compared with results from other studies investigating the contribution of some of these systems to guiding decision-making related to rewards vs. punishment. Lastly, we provide a brief summary of impairments in risk-related decision-making associated with psychiatric disorders, highlighting recent translational studies in laboratory animals.

Impairment of cognitive function by chemotherapy: association with the disruption of phase-locking and synchronization in anterior cingulate cortex

Background

Patients following prolonged cancer chemotherapy are at high risk of emotional and cognitive deficits. Research indicates that the brain neuronal temporal coding and synaptic long-term potentiation (LTP) are critical in memory and perception. We studied the effects of cisplatin on induction of LTP in the basolateral amygdala (BLA)-anterior cingulate cortex (ACC) pathway, characterized the coordination of spike timing with local theta oscillation, and identified synchrony in the BLA-ACC network integrity.

Results

In the study presented, the impacts of cisplatin on emotional and cognitive functions were investigated by elevated plus-maze test, Morris water maze test, and rat Iowa gambling task (RGT). Electrophysiological recordings were conducted to study long-term potentiation. Simultaneous recordings from multi-electrodes were performed to characterize the neural spike firing and ongoing theta oscillation of local field potential (LFP), and to clarify the synchronization of large scale of theta oscillation in the BLA-ACC pathway. Cisplatin-treated rats demonstrated anxiety- like behavior, exhibited impaired spatial reference memory. RGT showed decrease of the percentage of good decision-makers, and increase in the percentage of maladaptive behavior (delay-good decision-makers plus poor decision-makers). Cisplatin suppressed the LTP, and disrupted the phase-locking of ACC single neural firings to the ongoing theta oscillation; further, cisplatin interrupted the synchrony in the BLA-ACC pathway.

Conclusions

We provide the first direct evidence that the cisplatin interrupts theta-frequency phase-locking of ACC neurons. The block of LTP and disruption of synchronized theta oscillations in the BLA-ACC pathway are associated with emotional and cognitive deficits in rats, following cancer chemotherapy.

Trait Anxiety Has Effect on Decision Making under Ambiguity but Not Decision Making under Risk

Previous studies have reported that trait anxiety (TA) affects decision making. However, results remain largely inconsistent across studies. The aim of the current study was to further address the interaction between TA and decision making. 304 subjects without depression from a sample consisting of 642 participants were grouped into high TA (HTA), medium TA (MTA) and low TA (LTA) groups based on their TA scores from State Trait Anxiety Inventory. All subjects were assessed with the Iowa Gambling Task (IGT) that measures decision making under ambiguity and the Game of Dice Task (GDT) that measures decision making under risk. While the HTA and LTA groups performed worse on the IGT compared to the MTA group, performances on the GDT between the three groups did not differ. Furthermore, the LTA and HTA groups showed different individual deck level preferences in the IGT: the former showed a preference for deck B indicating that these subjects focused more on the magnitude of rewards, and the latter showed a preference for deck A indicating significant decision making impairment. Our findings suggest that trait anxiety has effect on decision making under ambiguity but not decision making under risk and different levels of trait anxiety related differently to individual deck level preferences in the IGT.

Effects of disrupting medial prefrontal cortex GABA transmission on decision-making in a rodent gambling task

RATIONALE

Decision-making is a complex cognitive process that is mediated, in part, by subregions of the medial prefrontal cortex (PFC). Decision-making is impaired in a number of psychiatric conditions including schizophrenia. Notably, people with schizophrenia exhibit reductions in GABA function in the same PFC areas that are implicated in decision-making. For example, expression of the GABA-synthesizing enzyme GAD67 is reduced in the dorsolateral PFC of people with schizophrenia.

OBJECTIVES

The goal of this experiment was to determine whether disrupting cortical GABA transmission impairs decision-making using a rodent gambling task (rGT).

METHODS

Rats were trained on the rGT until they reached stable performance and then were implanted with guide cannulae aimed at the medial PFC. Following recovery, the effects of intra-PFC infusions of the GABAA receptor antagonist bicuculline methiodide (BMI) or the GABA synthesis inhibitor L-allylglycine (LAG) on performance on the rGT were assessed.

RESULTS

Intracortical infusions of BMI (25 ng/μl/side), but not LAG (10 μg/μl/side), altered decision-making. Following BMI infusions, rats made fewer advantageous choices. Follow-up experiments suggested that the change in decision-making was due to a change in the sensitivity to the punishments, rather than a change in the sensitivity to reward magnitudes, associated with each outcome. LAG infusions increased premature responding, a measure of response inhibition, but did not affect decision-making.

CONCLUSIONS

Blocking GABAA receptors, but not inhibiting cortical GABA synthesis, within the medial PFC affects decision-making in the rGT. These data provide proof-of-concept evidence that disruptions in GABA transmission can contribute to the decision-making deficits in schizophrenia.

Developing treatments for cognitive deficits in schizophrenia: the challenge of translation

Schizophrenia is a life-long debilitating mental disorder affecting tens of millions of people worldwide. The serendipitous discovery of antipsychotics focused pharmaceutical research on developing a better antipsychotic. Our understanding of the disorder has advanced however, with the knowledge that cognitive enhancers are required for patients in order to improve their everyday lives. While antipsychotics treat psychosis, they do not enhance cognition and hence are not antischizophrenics. Developing pro-cognitive therapeutics has been extremely difficult, however, especially when no approved treatment exists. In lieu of stumbling on an efficacious treatment, developing targeted compounds can be facilitated by understanding the neural mechanisms underlying altered cognitive functioning in patients. Equally importantly, these cognitive domains will need to be measured similarly in animals and humans so that novel targets can be tested prior to conducting expensive clinical trials. To date, the limited similarity of testing across species has resulted in a translational bottleneck. In this review, we emphasize that schizophrenia is a disorder characterized by abnormal cognitive behavior. Quantifying these abnormalities using tasks having cross-species validity would enable the quantification of comparable processes in rodents. This approach would increase the likelihood that the neural substrates underlying relevant behaviors will be conserved across species. Hence, we detail cross-species tasks which can be used to test the effects of manipulations relevant to schizophrenia and putative therapeutics. Such tasks offer the hope of providing a bridge between non-clinical and clinical testing that will eventually lead to treatments developed specifically for patients with deficient cognition.

Translational Models of Gambling-Related Decision-Making

Gambling is a harmless, recreational pastime that is ubiquitous across cultures. However, for some, gambling becomes a maladaptive and compulsive, and this syndrome is conceptualized as a behavioural addiction. Laboratory models that capture the key cognitive processes involved in gambling behaviour, and that can be translated across species, have the potential to make an important contribution to both decision neuroscience and the study of addictive disorders. The Iowa gambling task has been widely used to assess human decision-making under uncertainty, and this paradigm can be successfully modelled in rodents. Similar neurobiological processes underpin choice behaviour in humans and rats, and thus, a preference for the disadvantageous "high-risk, high-reward" options may reflect meaningful vulnerability for mental health problems. However, the choice behaviour operationalized by these tasks does not necessarily approximate the vulnerability to gambling disorder (GD) per se. We consider a number of psychological challenges that apply to modelling gambling in a translational way, and evaluate the success of the existing models. Heterogeneity in the structure of gambling games, as well as in the motivations of individuals with GD, is highlighted. The potential issues with extrapolating too directly from established animal models of drug dependency are discussed, as are the inherent difficulties in validating animal models of GD in the absence of any approved treatments for GD. Further advances in modelling the cognitive biases endemic in human decision-making, which appear to be exacerbated in GD, may be a promising line of research.

Behavioral flexibility in rats and mice: contributions of distinct frontocortical regions

Research examining the contribution of genetics to behavior is increasingly focused on higher order behavioral and cognitive processes including the ability to modify behaviors when environmental demands change. The frontal cortices of mammals, including rodents, subserve a diverse set of behavioral and cognitive functions including motor planning, social behavior, evaluation of expected outcomes and working memory, which may be particularly sensitive to genetic factors and interactions with experience (e.g. stress). Behavioral flexibility is a core attribute of these functions. This review orients readers to the current landscape of the literature on the frontocortical bases of behavioral flexibility in rodent laboratory experiments. Studies are divided into three broad categories: reversal learning, inhibitory learning and set-shifting. Functional dissociations within the broader scope of behavioral flexibility are reviewed, followed by discussion of the associations between specific components of frontal cortex and specific aspects of relevant behavioral processes. Finally, the authors identify open questions that need to be addressed to better establish the constituents of frontal cortex underlying behavioral flexibility.

Reduced dopamine transporter functioning induces high-reward risk-preference consistent with bipolar disorder

Individuals with bipolar disorder (BD) exhibit deleterious decision making, negatively impacting their lives. Such aberrant decision making can be quantified using the Iowa Gambling Task (IGT), which requires choosing between advantageous and disadvantageous options based on different reward/punishment schedules. The mechanisms underlying this behavioral deficit are unknown, but may include the reduced dopamine transporter (DAT) functioning reported in BD patients. Using both human and mouse IGTs, we tested whether reduced DAT functioning would recreate patterns of deficient decision making of BD patients. We assessed the IGT performance of 16 BD subjects (7 female) and 17 healthy control (HC) subjects (12 female). We recorded standard IGT performance measures and novel post-reward and post-punishment decision-making strategies. We characterized a novel single-session mouse IGT using C57BL/6J mice (n = 44). The BD and HC IGT performances were compared with the effects of chronic (genetic knockdown (KD; n = 31) and wild-type (n = 28) mice) and acute (C57BL/6J mice (n = 89) treated with the DAT inhibitor GBR12909) reductions of DAT functioning in mice performing this novel IGT. BD patients exhibited impaired decision making compared with HC subjects. Both the good-performing DAT KD and GBR12909-treated mice exhibited poor decision making in the mouse IGT. The deficit of each population was driven by high-reward sensitivity. The single-session mouse IGT measures dynamic risk-based decision making similar to humans. Chronic and acute reductions of DAT functioning in mice impaired decision-making consistent with poor IGT performance of BD patients. Hyperdopaminergia caused by reduced DAT may impact poor decision making in BD patients, which should be confirmed in future studies.

Prefronto-subcortical imbalance characterizes poor decision-making: neurochemical and neural functional evidences in rats

A major challenge of decision-making research in recent years has been to develop models of poor decision-making to identify its neural bases. Toward this goal, we developed a Rat Gambling Task that discerns good and poor decision-makers in a complex and conflicting situation such as the human Iowa Gambling Task. Nothing is known about the role of the monoaminergic modulatory systems in shaping these phenotypes. Moreover, functional and temporal contributions of brain areas during poor compared to good decision-making remains elusive. Good and poor decision-makers were identified in the Rat Gambling Task. We investigated neurobiological correlates of decision-making capacities in (1) dopamine and serotonin turnovers using post-mortem tissue measurements, (2) the neural circuits differentially recruited during decision-making within the prefronto-subcortical network using cellular Fos immunodetection. Imbalance in monoamine metabolism was revealed in poor decision-makers, i.e. a higher infralimbic vs. lower amygdala serotonergic metabolism. Moreover, good decision-making recruited a wide prefronto-subcortical network but once good choices had been made, a disengagement of key prefrontal areas (insular and infralimbic cortices notably) and the amygdala was observed. By contrast, poor decision-making was associated with a strikingly low recruitment of the prefronto-subcortical network, together with sustained amygdala activity. Our results identify two complementary neurobiological substrates characterizing poor decision-makers: imbalanced monoaminergic systems at rest, congruent with their previously identified complex behavioral phenotype, and an aberrant low recruitment of key brain areas for executive functions and affective valence during the process of decision-making. These biomarkers could sustain vulnerability to developing poor decision-making related disorders.

Corticosterone and decision-making in male Wistar rats: the effect of corticosterone application in the infralimbic and orbitofrontal cortex

Corticosteroid hormones, released after stress, are known to influence neuronal activity and produce a wide range of effects upon the brain. They affect cognitive tasks including decision-making. Recently it was shown that systemic injections of corticosterone (CORT) disrupt reward-based decision-making in rats when tested in a rat model of the Iowa Gambling Task (rIGT), i.e., rats do not learn across trial blocks to avoid the long-term disadvantageous option. This effect was associated with a change in neuronal activity in prefrontal brain areas, i.e., the infralimbic (IL), lateral orbitofrontal (lOFC) and insular cortex, as assessed by changes in c-Fos expression. Here, we studied whether injections of CORT directly into the IL and lOFC lead to similar changes in decision-making. As in our earlier study, CORT was injected during the final 3 days of the behavioral paradigm, 25 min prior to behavioral testing. Infusions of vehicle into the IL led to a decreased number of visits to the disadvantageous arm across trial blocks, while infusion with CORT did not. Infusions into the lOFC did not lead to differences in the number of visits to the disadvantageous arm between vehicle treated and CORT treated rats. However, compared to vehicle treated rats of the IL group, performance of vehicle treated rats of the lOFC group was impaired, possibly due to cannulation/infusion-related damage of the lOFC affecting decision-making. Overall, these results show that infusions with CORT into the IL are sufficient to disrupt decision-making performance, pointing to a critical role of the IL in corticosteroid effects on reward-based decision-making. The data do not directly support that the same holds true for infusions into the lOFC.

A rodent version of the Iowa Gambling Task: 7 years of progress

In the Iowa Gambling Task (IGT) subjects need to find a way to earn money in a context of variable wins and losses, conflicting short-term and long-term pay-off, and uncertainty of outcomes. In 2006, we published the first rodent version of the IGT (r-IGT; Behavior Research Methods 38, 470–478). Here, we discuss emerging ideas on the involvement of different prefrontal-striatal networks in task-progression in the r-IGT, as revealed by our studies thus far. The emotional system, encompassing, among others, the orbitofrontal cortex, infralimbic cortex and nucleus accumbens (shell and core area), may be involved in assessing and anticipating the value of different options in the early stages of the task, i.e., as animals explore and learn task contingencies. The cognitive control system, encompassing, among others, the prelimbic cortex and dorsomedial striatum, may be involved in instrumental goal-directed behavior in later stages of the task, i.e., as behavior toward long-term options is strengthened (reinforced) and behavior toward long-term poor options is weakened (punished). In addition, we suggest two directions for future research: (1) the role of the internal state of the subject in decision-making, and (2) studying differences in task-related costs. Overall, our studies have contributed to understanding the interaction between the emotional system and cognitive control system as crucial to navigating human and non-human animals alike through a world of variable wins and losses, conflicting short-term and long-term pay-offs, and uncertainty of outcomes.

Ventral medial prefrontal cortex inactivation impairs impulse control but does not affect delay-discounting in rats

Maladaptive levels of impulsivity are found in several neuropsychiatric disorders, such as ADHD, addiction, aggression and schizophrenia. Intolerance to delay-of-gratification, or delay-discounting, and deficits in impulse control are dissociable forms of impulsivity top-down controlled by the prefrontal cortex, with the ventral medial prefrontal cortex (vmPFC) suggested to be critically involved. The present study used transient inactivation of the rats' vmPFC via bilateral microinfusion of the GABAA receptor agonist muscimol (0.05, 0.5 μg/0.3 μl) to analyse its relevance for impulse control in a 5-choice serial reaction time task (5-CSRTT) and delay-discounting in a Skinner box. Intra-vmPFC injection of low-dose muscimol impaired impulse control indicated by enhanced premature responding in the 5-CSRTT, while flattening the delay-dependent shift in the preference of the large reward in the delay-discounting task. Likewise, high-dose muscimol did not affect delay-discounting, though raising the rate of omissions. On the contrary, 5-CSRTT performance was characterised by deficits in impulse and attentional control. These data support the behavioural distinction of delay-discounting and impulse control on the level of the vmPFC in rats. Reversible inactivation with muscimol revealed an obvious implication of the vmPFC in the modulation of impulse control in the 5-CSRTT. By contrast, delay-discounting processes seem to be regulated by other neuronal pathways, with the vmPFC playing, if at all, a minor role.

Elucidating poor decision-making in a rat gambling task

Although poor decision-making is a hallmark of psychiatric conditions such as attention deficit/hyperactivity disorder, pathological gambling or substance abuse, a fraction of healthy individuals exhibit similar poor decision-making performances in everyday life and specific laboratory tasks such as the Iowa Gambling Task. These particular individuals may provide information on risk factors or common endophenotypes of these mental disorders. In a rodent version of the Iowa gambling task--the Rat Gambling Task (RGT), we identified a population of poor decision makers, and assessed how these rats scored for several behavioral traits relevant to executive disorders: risk taking, reward seeking, behavioral inflexibility, and several aspects of impulsivity. First, we found that poor decision-making could not be well predicted by single behavioral and cognitive characteristics when considered separately. By contrast, a combination of independent traits in the same individual, namely risk taking, reward seeking, behavioral inflexibility, as well as motor impulsivity, was highly predictive of poor decision-making. Second, using a reinforcement-learning model of the RGT, we confirmed that only the combination of extreme scores on these traits could induce maladaptive decision-making. Third, the model suggested that a combination of these behavioral traits results in an inaccurate representation of rewards and penalties and inefficient learning of the environment. Poor decision-making appears as a consequence of the over-valuation of high-reward-high-risk options in the task. Such a specific psychological profile could greatly impair clinically healthy individuals in decision-making tasks and may predispose to mental disorders with similar symptoms.

Intersection of effort and risk: ethological and neurobiological perspectives

The physical effort required to seek out and extract a resource is an important consideration for a foraging animal. A second consideration is the variability or risk associated with resource delivery. An intriguing observation from ethological studies is that animals shift their preference from stable to variable food sources under conditions of increased physical effort or falling energetic reserves. Although theoretical models for this effect exist, no exploration into its biological basis has been pursued. Recent advances in understanding the neural basis of effort- and risk-guided decision making suggest that opportunities exist for determining how effort influences risk preference. In this review, we describe the intersection between the neural systems involved in effort- and risk-guided decision making and outline two mechanisms by which effort-induced changes in dopamine release may increase the preference for variable rewards.

Mechanisms of reward circuit dysfunction in psychiatric illness: prefrontal-striatal interactions

The brain's "reward circuit" has been widely implicated in the pathophysiology of mental illness. Although there has been significant progress in identifying the functional characteristics of individual nodes within the circuit and linking dysfunction of these brain areas to various forms of psychopathology, there remains a substantial gap in understanding how the nodes of the circuit interact with one another, and how the growing neurobiological knowledge may be applied to improve psychiatric patient care. In this article, we summarize what is currently known about the functions and interactions of two key nodes of this circuit-the ventral striatum and the ventromedial prefrontal/orbital frontal cortex-in relation to mental illness.

Medial prefrontal cortex lesions impair decision-making on a rodent gambling task: reversal by D1 receptor antagonist administration

Decision-making is a complex cognitive process that is impaired in a number of psychiatric disorders. In the laboratory, decision-making is frequently assessed using "gambling" tasks that are designed to simulate real-life decisions in terms of uncertainty, reward and punishment. Here, we investigate whether lesions of the medial prefrontal cortex (PFC) cause impairments in decision-making using a rodent gambling task (rGT). In this task, rats have to decide between 1 of 4 possible options: 2 options are considered "advantageous" and lead to greater net rewards (food pellets) than the other 2 "disadvantageous" options. Once rats attained stable levels of performance on the rGT they underwent sham or excitoxic lesions of the medial PFC and were allowed to recover for 1 week. Following recovery, rats were retrained for 5 days and then the effects of a dopamine D1-like receptor antagonist (SCH23390) or a D2-like receptor antagonist (haloperidol) on performance were assessed. Lesioned rats exhibited impaired decision-making: they made fewer advantageous choices and chose the most optimal choice less frequently than did sham-operated rats. Administration of SCH23390 (0.03 mg/kg), but not haloperidol (0.015-0.03 mg/kg) attenuated the lesion-induced decision-making deficit. These results indicate that the medial PFC is important for decision-making and that excessive signaling at D1 receptors may contribute to decision-making impairments.

Time-dependent effects of corticosterone on reward-based decision-making in a rodent model of the Iowa Gambling Task

Corticosteroid hormones, released after stress, are known to change neuronal activity in two time-domains: within minutes via non-genomic pathways and with a delay of >1 h through pathways involving transcriptional regulation. Recent evidence in rodents and humans indicates that these two modes of corticosteroid action differently affect cognitive tasks. Here, we investigated whether reward-based decision-making, in a rat model of the Iowa Gambling Task (rIGT), is also differently altered by rapid versus delayed actions of corticosterone. We targeted the rapid and delayed time domain by injecting corticosterone (CORT, 1 mg/kg, s.c.) at 30 min (rapid) or 180 min (delayed) respectively prior to behavioural testing, during the final 3 days of the behavioural paradigm. In saline treated rats, the number of visits to the disadvantageous arm decreased over trial blocks, whilst this was attenuated when CORT was administered 30 min before testing. This attenuation was associated with a significantly increased c-Fos expression in the lateral orbitofrontal cortex and insular cortex, and a trend for an increase in the infralimbic cortex. The rapid corticosteroid effect contrasted with treatment 180 min before testing, where the number of visits to the disadvantageous arm as well as c-Fos labelling was not affected. These findings indicate that rapid corticosteroid actions impair reward-based decision-making.

Differential effects of dopamine transporter inhibitors in the rodent Iowa gambling task: relevance to mania

RATIONALE

The Iowa Gambling Task (IGT) can be used to quantify impulsive and risky choice behaviors in psychiatric patients, e.g., bipolar disorder (BD) sufferers. Although developing treatments for these behaviors is important, few predictive animal models exist. Inhibition of the dopamine transporter (DAT) can model profiles of altered motor activity and exploration seen in patients with BD. The effect of DAT inhibition on impulsive choices related to BD has received limited study however. We used a rodent IGT to elucidate the effects of similarly acting drugs on risky choice behavior.

OBJECTIVES

We hypothesized that (1) C57BL/6 mice could adopt the "safe" choice options in the IGT and (2) DAT inhibition would alter risk preference.

METHODS

Mice were trained in the IGT to a stable risk-preference and then administered the norepinephrine/DAT inhibitor amphetamine, or the more selective DAT inhibitors modafinil or GBR12909.

RESULTS

Mice developed a preference for the "safe" option, which was potentiated by amphetamine administration. GBR12909 or modafinil administration increased motor impulsivity, motivation significantly, and risk preference subtly.

CONCLUSIONS

The rodent IGT can measure different impulse-related behaviors and differentiate similarly acting BD-related drugs. The contrasting effects of amphetamine and modafinil in mice are similar to effects in rats and humans in corresponding IGT tasks, supporting the translational validity of the task. GBR12909 and modafinil elicited similar behaviors in the IGT, likely through a shared mechanism. Future studies using a within-session IGT are warranted to confirm the suitability of DAT inhibitors to model risk-preference in BD.

A critical review of sex differences in decision-making tasks: focus on the Iowa Gambling Task

It has been observed that men and women show performance differences in the Iowa Gambling Task (IGT), a task of decision-making in which subjects through exploration learn to differentiate long-term advantageous from long-term disadvantageous decks of cards: men choose more cards from the long-term advantageous decks than women within the standard number of 100 trials. Here, we aim at discussing psychological mechanisms and neurobiological substrates underlying sex differences in IGT-like decision-making. Our review suggests that women focus on both win-loss frequencies and long-term pay-off of decks, while men focus on long-term pay-off. Furthermore, women may be more sensitive to occasional losses in the long-term advantageous decks than men. As a consequence hereof, women need 40-60 trials in addition before they reach the same level of performance as men. These performance differences are related to differences in activity in the orbitofrontal cortex and dorsolateral prefrontal cortex as well as in serotonergic activity and left-right hemispheric activity. Sex differences in orbitofrontal cortex activity may be due to organisational effects of gonadal hormones early in life. The behavioural and neurobiological differences in the IGT between men and women are an expression of more general sex differences in the regulation of emotions. We discuss these findings in the context of sex differences in information processing related to evolutionary processes. Furthermore we discuss the relationship between these findings and real world decision-making.

Individual variations in maternal care early in life correlate with later life decision-making and c-fos expression in prefrontal subregions of rats

Early life adversity affects hypothalamus-pituitary-adrenal axis activity, alters cognitive functioning and in humans is thought to increase the vulnerability to psychopathology--e.g. depression, anxiety and schizophrenia--later in life. Here we investigated whether subtle natural variations among individual rat pups in the amount of maternal care received, i.e. differences in the amount of licking and grooming (LG), correlate with anxiety and prefrontal cortex-dependent behavior in young adulthood. Therefore, we examined the correlation between LG received during the first postnatal week and later behavior in the elevated plus maze and in decision-making processes using a rodent version of the Iowa Gambling Task (rIGT). In our cohort of male and female animals a high degree of LG correlated with less anxiety in the elevated plus maze and more advantageous choices during the last 10 trials of the rIGT. In tissue collected 2 hrs after completion of the task, the correlation between LG and c-fos expression (a marker of neuronal activity) was established in structures important for IGT performance. Negative correlations existed between rIGT performance and c-fos expression in the lateral orbitofrontal cortex, prelimbic cortex, infralimbic cortex and insular cortex. The insular cortex correlations between c-fos expression and decision-making performance depended on LG background; this was also true for the lateral orbitofrontal cortex in female rats. Dendritic complexity of insular or infralimbic pyramidal neurons did not or weakly correlate with LG background. We conclude that natural variations in maternal care received by pups may significantly contribute to later-life decision-making and activity of underlying brain structures.

Rodent versions of the iowa gambling task: opportunities and challenges for the understanding of decision-making

Impaired decision-making is a core problem in several psychiatric disorders including attention-deficit/hyperactivity disorder, schizophrenia, obsessive–compulsive disorder, mania, drug addiction, eating disorders, and substance abuse as well as in chronic pain. To ensure progress in the understanding of the neuropathophysiology of these disorders, animal models with good construct and predictive validity are indispensable. Many human studies aimed at measuring decision-making capacities use the Iowa gambling task (IGT), a task designed to model everyday life choices through a conflict between immediate gratification and long-term outcomes. Recently, new rodent models based on the same principle have been developed to investigate the neurobiological mechanisms underlying IGT-like decision-making on behavioral, neural, and pharmacological levels. The comparative strengths, as well as the similarities and differences between these paradigms are discussed. The contribution of these models to elucidate the neurobehavioral factors that lead to poor decision-making and to the development of better treatments for psychiatric illness is considered, along with important future directions and potential limitations.