The anterior insula bidirectionally modulates cost-benefit decision-making on a rodent gambling task

Poor Decision Making and Sociability Impairment Following Central Serotonin Reduction in Inducible TPH2-Knockdown Rats

Serotonin is an essential neuromodulator for mental health and animals' socio-cognitive abilities. However, we previously found that a constitutive depletion of central serotonin did not impair rat cognitive abilities in stand-alone tests. Here, we investigated how a mild and acute decrease in brain serotonin would affect rats' cognitive abilities. Using a novel rat model of inducible serotonin depletion via the genetic knockdown of tryptophan hydroxylase 2 (TPH2), we achieved a 20% decrease in serotonin levels in the hypothalamus after three weeks of non-invasive oral doxycycline administration. Decision making, cognitive flexibility, and social recognition memory were tested in low-serotonin (Tph2-kd) and control rats. Our results showed that the Tph2-kd rats were more prone to choose disadvantageously in the long term (poor decision making) in the Rat Gambling Task and that only the low-serotonin poor decision makers were more sensitive to probabilistic discounting and had poorer social recognition memory than other low-serotonin and control individuals. Flexibility was unaffected by the acute brain serotonin reduction. Poor social recognition memory was the most central characteristic of the behavioral network of low-serotonin poor decision makers, suggesting a key role of social recognition in the expression of their profile. The acute decrease in brain serotonin appeared to specifically amplify the cognitive impairments of the subgroup of individuals also identified as poor decision makers in the population. This study highlights the great opportunity the Tph2-kd rat model offers to study inter-individual susceptibilities to develop cognitive impairment following mild variations of brain serotonin in otherwise healthy individuals. These transgenic and differential approaches together could be critical for the identification of translational markers and vulnerabilities in the development of mental disorders.

Still a "hidden island"? The rodent insular cortex in drug seeking, reward, and risk

The insular cortex (IC) is implicated in risky decision making and drug-seeking behaviors, in a manner dissociable from natural reward seeking. However, evidence from rodent studies of motivated behaviors suggests that the role of the IC is not always consistent across procedures. Moreover, there is evidence of dissociation of function between posterior (pIC) and anterior (aIC) subregions in these behaviors. Under which circumstances, and by which mechanisms, these IC subregions are recruited to regulate motivated behaviors remains unclear. Here, we discuss evidence of rodent pIC and aIC function across drug-related behaviors, natural reward seeking, and decision making under risk and highlight procedural differences that may account for seemingly conflicting findings. Although gaps in the literature persist, we hypothesize that IC activity is broadly important for selection of appropriate behaviors based on learned action-outcome contingencies and that associated risk is sufficient, but not necessary, to recruit the aIC in reward seeking without involving the pIC.

Using lickometry to infer differential contributions of salience network regions during compulsion-like alcohol drinking

Alcohol use disorder extracts substantial personal, social and clinical costs, and continued intake despite negative consequences (compulsion-like consumption) can contribute strongly. Here we discuss lickometry, a simple method where lick times are determined across a session, while analysis across many aspects of licking can offer important insights into underlying psychological and action strategies, including their brain mechanisms. We first describe studies implicating anterior insula (AIC) and dorsal medial prefrontal cortex (dMPF) in compulsion-like responding for alcohol, then review work suggesting that AIC/ventral frontal cortex versus dMPF regulate different aspects of behavior (oral control and overall response strategy, versus moment-to-moment action organization). We then detail our lickometer work comparing alcohol-only drinking (AOD) and compulsion-like drinking under moderate- or higher-challenge (ModChD or HiChD, using quinine-alcohol). Many studies have suggested utilization of one of two main strategies, with higher motivation indicated by more bouts, and greater palatability suggested by longer, faster bouts. Instead, ModChD shows decreased variability in many lick measures, which is unexpected but consistent with the suggested importance of automaticity for addiction. Also surprising is that HiChD retains several behavior changes seen with ModChD, reduced tongue variability and earlier bout start, even though intake is otherwise disrupted. Since AIC-related measures are retained under both moderate- and higher-challenge, we propose a novel hypothesis that AIC sustains overall commitment regardless of challenge level, while disordered licking during HiChD mirrors the effects of dMPF inhibition. Thus, while AIC provides overall drive despite challenge, the ability to act is ultimately determined within the dMPF.

A Novel Insular/Orbital-Prelimbic Circuit That Prevents Persistent Avoidance in a Rodent Model of Compulsive Behavior

BACKGROUND

A common symptom of obsessive-compulsive disorder is the persistent avoidance of cues incorrectly associated with negative outcomes. This maladaptation becomes increasingly evident as subjects fail to respond to extinction-based treatments such as exposure-with-response prevention therapy. While previous studies have highlighted the role of the insular-orbital cortex in fine-tuning avoidance-based decisions, little is known about the projections from this area that might modulate compulsive-like avoidance.

METHODS

Here, we used anatomical tract-tracing, single-unit recording, and optogenetics to characterize the projections from the insular-orbital cortex. To model exposure-with-response prevention and persistent avoidance in rats, we used the platform-mediated avoidance task followed by extinction-with-response prevention training.

RESULTS

Using tract-tracing and unit recording, we found that projections from the agranular insular/lateral orbital (AI/LO) cortex to the prefrontal cortex predominantly target the rostral portion of the prelimbic (rPL) cortex and excite rPL neurons. Photoinhibiting this projection induced persistent avoidance after extinction-with-response prevention training, an effect that was still present 1 week later. Consistent with this, photoexcitation of this projection prevented persistent avoidance in overtrained rats. This projection to rPL appears to be key for AI/LO's effects, considering that there was no effect of photoinhibiting AI/LO projections to the ventral striatum or basolateral amygdala.

CONCLUSIONS

Our findings suggest that projections from the AI/LO to the rPL decreases the likelihood of avoidance behavior following extinction. In humans, this connectivity may share some homology of projections from lateral prefrontal cortices (i.e., ventrolateral prefrontal cortex, orbitofrontal cortex, and insula) to other prefrontal areas and the anterior cingulate cortex, suggesting that reduced activity in these pathways may contribute to obsessive-compulsive disorder.

Atypical interoception as a common risk factor for psychopathology: A review

The inadequacy of a categorial approach to mental health diagnosis is now well-recognised, with many authors, diagnostic manuals and funding bodies advocating a dimensional, trans-diagnostic approach to mental health research. Variance in interoception, the ability to perceive one's internal bodily state, is reported across diagnostic boundaries, and is associated with atypical functioning across symptom categories. Drawing on behavioural and neuroscientific evidence, we outline current research on the contribution of interoception to numerous cognitive and affective abilities (in both typical and clinical populations), and describe the interoceptive atypicalities seen in a range of psychiatric conditions. We discuss the role that interoception may play in the development and maintenance of psychopathology, as well as the ways in which interoception may differ across clinical presentations. A number of important areas for further research on the role of interoception in psychopathology are highlighted.

Better living through understanding the insula: Why subregions can make all the difference

Insula function is considered critical for many motivated behaviors, with proposed functions ranging from attention, behavioral control, emotional regulation, goal-directed and aversion-resistant responding. Further, the insula is implicated in many neuropsychiatric conditions including substance abuse. More recently, multiple insula subregions have been distinguished based on anatomy, connectivity, and functional contributions. Generally, posterior insula is thought to encode more somatosensory inputs, which integrate with limbic/emotional information in middle insula, that in turn integrate with cognitive processes in anterior insula. Together, these regions provide rapid interoceptive information about the current or predicted situation, facilitating autonomic recruitment and quick, flexible action. Here, we seek to create a robust foundation from which to understand potential subregion differences, and provide direction for future studies. We address subregion differences across humans and rodents, so that the latter's mechanistic interventions can best mesh with clinical relevance of human conditions. We first consider the insula's suggested roles in humans, then compare subregional studies, and finally describe rodent work. One primary goal is to encourage precision in describing insula subregions, since imprecision (e.g. including both posterior and anterior studies when describing insula work) does a disservice to a larger understanding of insula contributions. Additionally, we note that specific task details can greatly impact recruitment of various subregions, requiring care and nuance in design and interpretation of studies. Nonetheless, the central ethological importance of the insula makes continued research to uncover mechanistic, mood, and behavioral contributions of paramount importance and interest. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Chronic Distress in Male Mice Impairs Motivation Compromising Both Effort and Reward Processing With Altered Anterior Insular Cortex and Basolateral Amygdala Neural Activation

In humans and mammals, effort-based decision-making for monetary or food rewards paradigms contributes to the study of adaptive goal-directed behaviours acquired through reinforcement learning. Chronic distress modelled by repeated exposure to glucocorticoids in rodents induces suboptimal decision-making under uncertainty by impinging on instrumental acquisition and prompting negative valence behaviours. In order to further disentangle the motivational tenets of adaptive decision-making, this study addressed the consequences of enduring distress on relevant effort and reward-processing dimensions. Experimentally, appetitive and consummatory components of motivation were evaluated in adult C57BL/6JRj male mice experiencing chronic distress induced by oral corticosterone (CORT), using multiple complementary discrete behavioural tests. Behavioural data (from novelty suppressed feeding, operant effort-based choice, free feeding, and sucrose preference tasks) collectively show that behavioural initiation, effort allocation, and hedonic appreciation and valuation are altered in mice exposed to several weeks of oral CORT treatment. Additionally, data analysis from FosB immunohistochemical processing of postmortem brain samples highlights CORT-dependent dampening of neural activation in the anterior insular cortex (aIC) and basolateral amygdala (BLA), key telencephalic brain regions involved in appetitive and consummatory motivational processing. Combined, these results suggest that chronic distress-induced irregular aIC and BLA neural activations with reduced effort production and attenuated reward value processing during reinforcement-based instrumental learning could result in maladaptive decision-making under uncertainty. The current study further illustrates how effort and reward processing contribute to adjust the motivational threshold triggering goal-directed behaviours in versatile environments.

Prolonged Consumption of Sweetened Beverages Lastingly Deteriorates Cognitive Functions and Reward Processing in Mice

We investigated the detrimental effects of chronic consumption of sweet or sweetened beverages in mice. We report that consumption of beverages containing small amounts of sucrose during several weeks impaired reward systems. This is evidenced by robust changes in the activation pattern of prefrontal brain regions associated with abnormal risk-taking and delayed establishment of decision-making strategy. Supporting these findings, we find that chronic consumption of low doses of artificial sweeteners such as saccharin disrupts brain regions' activity engaged in decision-making and reward processes. Consequently, this leads to the rapid development of inflexible decisions, particularly in a subset of vulnerable individuals. Our data also reveal that regular consumption, even at low doses, of sweet or sweeteners dramatically alters brain neurochemistry, i.e., dopamine content and turnover, and high cognitive functions, while sparing metabolic regulations. Our findings suggest that it would be relevant to focus on long-term consequences on the brain of sweet or sweetened beverages in humans, especially as they may go metabolically unnoticed.

Chronic exposure to glucocorticoids induces suboptimal decision-making in mice

Anxio-depressive symptoms as well as severe cognitive dysfunction including aberrant decision-making (DM) are documented in neuropsychiatric patients with hypercortisolaemia. Yet, the influence of the hypothalamo-pituitary-adrenal (HPA) axis on DM processes remains poorly understood. As a tractable mean to approach this human condition, adult male C57BL/6JRj mice were chronically treated with corticosterone (CORT) prior to behavioural, physiological and neurobiological evaluation. The behavioural data indicate that chronic CORT delays the acquisition of contingencies required to orient responding towards optimal DM performance in a mouse Gambling Task (mGT). Specifically, CORT-treated animals show a longer exploration and a delayed onset of the optimal DM performance. Remarkably, the proportion of individuals performing suboptimally in the mGT is increased in the CORT condition. This variability seems to be better accounted for by variations in sensitivity to negative rather than to positive outcome. Besides, CORT-treated animals perform worse than control animals in a spatial working memory (WM) paradigm and in a motor learning task. Finally, Western blotting neurobiological analyses show that chronic CORT downregulates glucocorticoid receptor expression in the medial Prefrontal Cortex (mPFC). Besides, corticotropin-releasing factor signalling in the mPFC of CORT individuals negatively correlates with their DM performance. Collectively, this study describes how chronic exposure to glucocorticoids induces suboptimal DM under uncertainty in a mGT, hampers WM and motor learning processes, thus affecting specific emotional, motor, cognitive and neurobiological endophenotypic dimensions relevant for precision medicine in biological psychiatry.

Stimulation in the Rat Anterior Insula and Anterior Cingulate During an Effortful Weightlifting Task

When performing tasks, animals must continually assess how much effort is being expended, and gage this against ever-changing physiological states. As effort costs mount, persisting in the task may be unwise. The anterior cingulate cortex (ACC) and the anterior insular cortex are implicated in this process of cost-benefit decision-making, yet their precise contributions toward driving effortful persistence are not well understood. Here we investigated whether electrical stimulation of the ACC or insular cortex would alter effortful persistence in a novel weightlifting task (WLT). In the WLT an animal is challenged to pull a rope 30 cm to trigger food reward dispensing. To make the action increasingly effortful, 45 g of weight is progressively added to the rope after every 10 successful pulls. The animal can quit the task at any point - with the rope weight at the time of quitting taken as the "break weight." Ten male Sprague-Dawley rats were implanted with stimulating electrodes in either the ACC [cingulate cortex area 1 (Cg1) in rodent] or anterior insula and then assessed in the WLT during stimulation. Low-frequency (10 Hz), high-frequency (130 Hz), and sham stimulations were performed. We predicted that low-frequency stimulation (LFS) of Cg1 in particular would increase persistence in the WLT. Contrary to our predictions, LFS of Cg1 resulted in shorter session duration, lower break weights, and fewer attempts on the break weight. High-frequency stimulation of Cg1 led to an increase in time spent off-task. LFS of the anterior insula was associated with a marginal increase in attempts on the break weight. Taken together our data suggest that stimulation of the rodent Cg1 during an effortful task alters certain aspects of effortful behavior, while insula stimulation has little effect.

Prolonged avoidance training exacerbates OCD-like behaviors in a rodent model

Obsessive-compulsive disorder (OCD) is characterized by compulsive behaviors that often resemble avoidance of perceived danger. OCD can be treated with exposure-with-response prevention (ERP) therapy in which patients are exposed to triggers but are encouraged to refrain from compulsions, to extinguish compulsive responses. The compulsions of OCD are strengthened by many repeated exposures to triggers, but little is known about the effects of extended repetition of avoidance behaviors on extinction. Here we assessed the extent to which overtraining of active avoidance affects subsequent extinction-with-response prevention (Ext-RP) as a rodent model of ERP, in which rats are extinguished to triggers, while the avoidance option is prevented. Male rats conditioned for 8d or 20d produced similar avoidance behavior to a tone paired with a shock, however, the 20d group showed a severe impairment of extinction during Ext-RP, as well as heightened anxiety. Furthermore, the majority of overtrained (20d) rats (75%) exhibited persistent avoidance following Ext-RP. In the 8d group, only a minority of rats (37%) exhibited persistent avoidance, and this was associated with elevated activity (c-Fos) in the prelimbic cortex and nucleus accumbens. In the 20d group, the minority of non-persistent rats (25%) showed elevated activity in the insular-orbital cortex and paraventricular thalamus. Lastly, extending the duration of Ext-RP prevented the deleterious effects of overtraining on extinction and avoidance. These rodent findings suggest that repeated expression of compulsion-like behaviors biases individuals toward persistent avoidance and alters avoidance circuits, thereby reducing the effectiveness of current extinction-based therapies.

Impaired decision making following escalation of cocaine self-administration predicts vulnerability to relapse in rats

Impairments in cost‐benefit decision making represent a cardinal feature of drug addiction. However, whether these alterations predate drug exposure, thereby contributing to facilitating loss of control over drug intake, or alternatively arise as a result of drug use and subsequently confer vulnerability to relapse has yet to be determined. Male Sprague‐Dawley rats were trained to self‐administer (SA) cocaine during 19 daily long‐access (12‐h) sessions; conditions reliably shown to promote escalation. One week after cocaine SA, rats underwent an extinction/relapse test immediately followed by conditioned stimuli–, stress‐, and drug‐primed reinstatement challenges. The influence of escalated cocaine intake on decision making was measured over time by four test sessions of a rodent analogue of the Iowa Gambling Task (rGT), once prior to cocaine exposure and then 1 day, 1 week, and 1 month after the last SA session. Substantial individual variability was observed in the influence of escalated cocaine SA on decision‐making performance. A subset of rats displayed pronounced deficits, while others showed unaffected or even improved performance on the rat Gambling Task (rGT) 24 hours after the last SA session. When challenged with a relapse test after 1 week of forced abstinence, animals that showed impaired decision making following SA displayed an increased propensity to respond for cocaine under extinction. These data suggest that decision‐making deficits in individuals with drug addiction are not antecedent to—but arise as a consequence of—drug exposure. Moreover, these data indicate that susceptibility to the deleterious effects of drugs on decision making confers vulnerability toward relapse.

Common neurobiological and psychological underpinnings of gambling and substance-use disorders

Both psychological and neurobiological studies in gambling disorder have increased in the past 10-15 years. This review examines the current state of the literature, with a focus on recent magnetic resonance imaging (MRI) studies in gambling disorder. The review compares and contrasts findings across gambling and substance-use disorders. Additionally, features with arguably particular relevance to gambling disorder (e.g., "near-miss" processing) are described, as well as their relationship to choice behaviors. More broadly, the review informs on how these studies advance our understanding of brain-behavior relationships relating to decision-making and key features of addictive disorders.

Modelling decision-making under uncertainty: A direct comparison study between human and mouse gambling data

Decision-making is a conserved evolutionary process enabling us to choose one option among several alternatives, and relies on reward and cognitive control systems. The Iowa Gambling Task allows the assessment of human decision-making under uncertainty by presenting four card decks with various cost-benefit probabilities. Participants seek to maximise their monetary gain by developing long-term optimal-choice strategies. Animal versions have been adapted with nutritional rewards, but interspecies data comparisons are scarce. Our study directly compares the non-pathological decision-making performance between humans and wild-type C57BL/6 mice. Human participants completed an electronic Iowa Gambling Task version, while mice a maze-based adaptation with four arms baited in a probabilistic way. Our data shows closely matching performance between both species with similar patterns of choice behaviours. However, mice showed a faster learning rate than humans. Moreover, both populations were clustered into good, intermediate and poor decision-making categories with similar proportions. Remarkably, mice characterised as good decision-makers behaved the same as humans of the same category, but slight differences among species are evident for the other two subpopulations. Overall, our direct comparative study confirms the good face validity of the rodent gambling task. Extended behavioural characterisation and pathological animal models should help strengthen its construct validity and disentangle the determinants in animals and humans decision-making.

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Compulsive Alcohol Seeking Results from a Failure to Disengage Dorsolateral Striatal Control over Behavior

The acquisition of drug, including alcohol, use is associated with activation of the mesolimbic dopamine system. However, over the course of drug exposure the control over drug seeking progressively devolves to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms. The causal importance of this functional recruitment of aDLS in the switch from controlled to compulsive drug use in vulnerable individuals remains to be established. Here we tested the hypothesis that individual differences in the susceptibility to aDLS dopamine-dependent control over alcohol seeking predicts and underlies the development of compulsive alcohol seeking. Male alcohol-preferring rats, the alcohol-preferring phenotype of which was confirmed in an intermittent two-bottle choice procedure, were implanted bilaterally with cannulae above the aDLS and trained instrumentally on a seeking-taking chained schedule of alcohol reinforcement until some individuals developed compulsive seeking behavior. The susceptibility to aDLS dopamine control over behavior was investigated before and after the development of compulsivity by measuring the extent to which bilateral aDLS infusions of the dopamine receptor antagonist α-flupenthixol (0, 5, 10, and 15 μg/side) decreased alcohol seeking at different stages of training, as follows: (1) after acquisition of instrumental taking responses for alcohol; (2) after alcohol-seeking behavior was well established; and (3) after the development of punishment-resistant alcohol seeking. Only alcohol-seeking, not alcohol-taking, responses became dependent on aDLS dopamine. Further, marked individual differences in the susceptibility of alcohol seeking to aDLS dopamine receptor blockade actually predicted the vulnerability to develop compulsive alcohol seeking, but only in subjects dependent on aDLS dopamine-dependent control.SIGNIFICANCE STATEMENT Over the course of addictive drug exposure, there is a transition in the control over drug seeking from ventral to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms, but it is unclear whether this is causally involved in the development of compulsive drug seeking. We tested the hypothesis that individual differences in the reliance of alcohol seeking on aDLS dopamine predicts and underlies the emergence of compulsive alcohol seeking. We identified individual differences in the reliance of well established alcohol seeking, but not taking behavior, on aDLS mechanisms and also showed that this predicted the subsequent development of compulsive alcohol-seeking behavior. Thus, those individuals in whom alcohol seeking depended on aDLS mechanisms were vulnerable subsequently to display compulsivity.

Behavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders

Punishment involves learning about the relationship between behavior and its adverse consequences. Punishment is fundamental to reinforcement learning, decision-making and choice, and is disrupted in psychiatric disorders such as addiction, depression, and psychopathy. However, little is known about the brain mechanisms of punishment and much of what is known is derived from study of superficially similar, but fundamentally distinct, forms of aversive learning such as fear conditioning and avoidance learning. Here we outline the unique conditions that support punishment, the contents of its learning, and its behavioral consequences. We consider evidence implicating GABA and monoamine neurotransmitter systems, as well as corticostriatal, amygdala, and dopamine circuits in punishment. We show how maladaptive punishment processes are implicated in addictions, impulse control disorders, psychopathy, anxiety, and depression and argue that a better understanding of the cellular, circuit, and cognitive mechanisms of punishment will make important contributions to next generation therapeutic approaches.