Dopaminergic modulation of impulsive decision making in the rat insular cortex

Insular and prelimbic cortices control behavioral accuracy and precision in a temporal decision-making task in rats

The anterior insular cortex (AIC) comprises a region of sensory integration. It appears to detect salient events in order to guide goal-directed behavior, code tracking errors, and estimate the passage of time. Temporal processing in the AIC may be instantiated by the integration of representations of interoception. Projections between the AIC and the medial prefrontal cortex (mPFC) - found both in rats and humans - also suggest a possible role for these structures in the integration of autonomic responses during ongoing behavior. Few studies, however, have investigated the role of AIC and mPFC in decision-making and time estimation tasks. Moreover, their findings are not consistent, so the relationship between temporal decision-making and those areas remains unclear. The present study employed bilateral inactivations to explore the role of AIC and prelimbic cortex (PL) in rats during a temporal decision-making task. In this task, two levers are available simultaneously (but only one is active), one predicting reinforcement after a short, and the other after a long-fixed interval. Optimal performance requires a switch from the short to the long lever after the short-fixed interval elapsed and no reinforcement was delivered. Switch behavior from the short to the long lever was dependent on AIC and PL. During AIC inactivation, switch latencies became more variable, while during PL inactivation switch latencies became both more variable and less accurate. These findings point to a dissociation between AIC and PL in temporal decision-making, suggesting that the AIC is important for temporal precision, and PL is important for both temporal accuracy and precision.

Partner-seeking and limbic dopamine system are enhanced following social loss in male prairie voles (Microtus ochrogaster)

Death of a loved one is recognized as one of life's greatest stresses, and 10%-20% of bereaved individuals will experience a complicated or prolonged grieving period that is characterized by intense yearning for the deceased. The monogamous prairie vole (Microtus ochrogaster) is a rodent species that forms pair bonds between breeding partners and has been used to study the neurobiology of social behaviors and isolation. Male prairie voles do not display distress after isolation from a familiar, same-sex conspecific; however, separation from a bonded female partner increases emotional, stress-related, and proximity-seeking behaviors. Here, we tested the investigatory response of male voles to partner odor during a period of social loss. We found that males who lost their partner spent significantly more time investigating partner odor but not non-partner social odor or food odor. Bachelor males and males in intact pairings did not respond uniquely to any odor. Furthermore, we examined dopamine (DA) receptor mRNA expression in the anterior insula cortex (aIC), nucleus accumbens (NAc), and anterior cingulate (ACC), regions with higher activation in grieving humans. While we found some effects of relationship type on DRD1 and DRD2 expression in some of these regions, loss of a high-quality opposite-sex relationship had a significant effect on DA receptor expression, with pair-bonded/loss males having higher expression in the aIC and ACC compared with pair-bonded/intact and nonbonded/loss males. Together, these data suggest that both relationship type and relationship quality affect reunion-seeking behavior and motivational neurocircuits following social loss of a bonded partner.

Still a "hidden island"? The rodent insular cortex in drug seeking, reward, and risk

The insular cortex (IC) is implicated in risky decision making and drug-seeking behaviors, in a manner dissociable from natural reward seeking. However, evidence from rodent studies of motivated behaviors suggests that the role of the IC is not always consistent across procedures. Moreover, there is evidence of dissociation of function between posterior (pIC) and anterior (aIC) subregions in these behaviors. Under which circumstances, and by which mechanisms, these IC subregions are recruited to regulate motivated behaviors remains unclear. Here, we discuss evidence of rodent pIC and aIC function across drug-related behaviors, natural reward seeking, and decision making under risk and highlight procedural differences that may account for seemingly conflicting findings. Although gaps in the literature persist, we hypothesize that IC activity is broadly important for selection of appropriate behaviors based on learned action-outcome contingencies and that associated risk is sufficient, but not necessary, to recruit the aIC in reward seeking without involving the pIC.

Adaptation of the 5-choice serial reaction time task to measure engagement and motivation for alcohol in mice

Alcohol use disorder (AUD) is related to excessive binge alcohol consumption, and there is considerable interest in associated factors that promote intake. AUD has many behavioral facets that enhance inflexibility toward alcohol consumption, including impulsivity, motivation, and attention. Thus, it is important to understand how these factors might promote responding for alcohol and can change after protracted alcohol intake. Previous studies have explored such behavioral factors using responding for sugar in the 5-Choice Serial Reaction Time Task (5-CSRTT), which allows careful separation of impulsivity, attention, and motivation. Importantly, our studies uniquely focus on using alcohol as the reward throughout training and testing sessions, which is critical for beginning to answer central questions relating to behavioral engagement for alcohol. Alcohol preference and consumption in male C57BL/6 mice were determined from the first 9 sessions of 2-h alcohol drinking which were interspersed among 5-CSRTT training. Interestingly, alcohol preference but not consumption level significantly predicted 5-CSRTT responding for alcohol. In contrast, responding for strawberry milk was not related to alcohol preference. Moreover, high-preference (HP) mice made more correct alcohol-directed responses than low-preference (LP) during the first half of each session and had more longer reward latencies in the second half, with no differences when performing for strawberry milk, suggesting that HP motivation for alcohol may reflect “front-loading.” Mice were then exposed to an Intermittent Access to alcohol paradigm and retested in 5-CSRTT. While both HP and LP mice increased 5-CSRTT responding for alcohol, but not strawberry milk, LP performance rose to HP levels, with a greater change in correct and premature responding in LP versus HP. Overall, this study provides three significant findings: (1) alcohol was a suitable reward in the 5-CSRTT, allowing dissection of impulsivity, attention, and motivation in relation to alcohol drinking, (2) alcohol preference was a more sensitive indicator of mouse 5-CSRTT performance than consumption, and (3) intermittent alcohol drinking promoted behavioral engagement with alcohol, especially for individuals with less initial engagement.

Better living through understanding the insula: Why subregions can make all the difference

Insula function is considered critical for many motivated behaviors, with proposed functions ranging from attention, behavioral control, emotional regulation, goal-directed and aversion-resistant responding. Further, the insula is implicated in many neuropsychiatric conditions including substance abuse. More recently, multiple insula subregions have been distinguished based on anatomy, connectivity, and functional contributions. Generally, posterior insula is thought to encode more somatosensory inputs, which integrate with limbic/emotional information in middle insula, that in turn integrate with cognitive processes in anterior insula. Together, these regions provide rapid interoceptive information about the current or predicted situation, facilitating autonomic recruitment and quick, flexible action. Here, we seek to create a robust foundation from which to understand potential subregion differences, and provide direction for future studies. We address subregion differences across humans and rodents, so that the latter's mechanistic interventions can best mesh with clinical relevance of human conditions. We first consider the insula's suggested roles in humans, then compare subregional studies, and finally describe rodent work. One primary goal is to encourage precision in describing insula subregions, since imprecision (e.g. including both posterior and anterior studies when describing insula work) does a disservice to a larger understanding of insula contributions. Additionally, we note that specific task details can greatly impact recruitment of various subregions, requiring care and nuance in design and interpretation of studies. Nonetheless, the central ethological importance of the insula makes continued research to uncover mechanistic, mood, and behavioral contributions of paramount importance and interest. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Heroin delay discounting and impulsivity: Modulation by DRD1 genetic variation

BACKGROUND

Dopamine D1 receptors (encoded by DRD1) are implicated in drug addiction and high-risk behaviors. Delay discounting (DD) procedures measure decisional balance between choosing smaller/sooner rewards vs larger/later rewards. Individuals with higher DD (rapid discounting) are prone to maladaptive behaviors that provide immediate reinforcement (eg, substance use). DRD1 variants have been linked with increased DD (in healthy volunteers) and opioid abuse. This study determined whether four dopaminergic functional variants modulated heroin DD and impulsivity.

METHODS

Substance use, DD, and genotype data (DRD1 rs686 and rs5326, DRD3 rs6280, COMT rs4680) were obtained from 106 current heroin users. Subjects completed an array of DD choices during two imagined conditions: heroin satiation and withdrawal. Rewards were expressed as $10 heroin bag units, with maximum delayed amount of 30 bags. Delays progressively increased from 3 to 96 hours.

RESULTS

DRD1 rs686 (A/A, n = 25; G/A, n = 56; G/G, n = 25) was linearly related to the difference in heroin DD (area under the curve; AUC) between the heroin satiation and withdrawal conditions; specifically, G/G homozygotes had a significantly smaller (satiation minus withdrawal) AUC difference score had higher drug-use impulsivity questionnaire scores, relative to A/A homozygotes, with G/A intermediate. DRD3 and COMT variants were not associated with these DD and impulsivity outcomes.

CONCLUSION

DRD1 rs686 modulated the difference in heroin DD score between pharmacological states and was associated with drug-use impulsivity. These data support a role of DRD1 in opioid DD and impulsive behaviors.

Effects of d-amphetamine and MK-801 on impulsive choice: Modulation by schedule of reinforcement and delay length

Procedural modifications can modulate drug effects in delay discounting, such as signaling the delay to reinforcement and altering the order in which delays are presented. Although the schedule of reinforcement can alter the rate at which animals discount a reinforcer, research has not determined if animals trained on different schedules of reinforcement are differentially affected by pharmacological manipulations. Similarly, research has not determined if using different delays to reinforcement can modulate drug effects in delay discounting. Male Sprague Dawley rats (n = 36) were split into four groups and were trained in a delay-discounting procedure. The schedule of reinforcement (fixed ratio [FR] 1 vs. FR 10) and delays to reinforcement (0, 5, 10, 20, and 50 s vs. 0, 10, 30, 60, 100 s) were manipulated for each group. Following behavioral training, rats were treated with d-amphetamine (0, 0.25, 0.5, and 1.0 mg/kg) and MK-801 (0, 0.03, and 0.06 mg/kg). Results showed that amphetamine decreased impulsive choice when a FR 1 schedule was used, but only when the short delay sequence was used. Conversely, amphetamine decreased impulsive choice when a FR 10 schedule was used, but only when rats were trained on the long delay sequence. MK-801 decreased impulsive choice in rats trained on a FR 1 schedule, regardless of delay sequence, but did not alter choice in rats trained on a FR 10 schedule. These results show that schedule of reinforcement and delay length can modulate drug effects in delay discounting.

An insular view of the social decision-making network

Social animals must detect, evaluate and respond to the emotional states of other individuals in their group. A constellation of gestures, vocalizations, and chemosignals enable animals to convey affect and arousal to others in nuanced, multisensory ways. Observers integrate social information with environmental and internal factors to select behavioral responses to others via a process call social decision-making. The Social Decision Making Network (SDMN) is a system of brain structures and neurochemicals that are conserved across species (mammals, reptiles, amphibians, birds) that are the proximal mediators of most social behaviors. However, how sensory information reaches the SDMN to shape behavioral responses during a social encounter is not well known. Here we review the empirical data that demonstrate the necessity of sensory systems in detecting social stimuli, as well as the anatomical connectivity of sensory systems with each node of the SDMN. We conclude that the insular cortex is positioned to link integrated social sensory cues to this network to produce flexible and appropriate behavioral responses to socioemotional cues.

Prelimbic Cortical Neurons Track Preferred Reward Value and Reflect Impulsive Choice during Delay Discounting Behavior

In delay discounting, individuals discount the value of a reward based on the delay to its receipt. The prelimbic cortex (PrL) is heavily interconnected with several brain regions implicated in delay discounting, but the specific contributions of the PrL to delay discounting are unknown. Here, we used multineuron electrophysiological recording methods in Long-Evans male (n = 10) and female (n = 9) rats to characterize the firing dynamics of PrL neurons during discrete cue and lever press events in a delay discounting task. Rats' initial preference for the large reward decreased as delays for that outcome increased across blocks, reflecting classic discounting behavior. Electrophysiological recordings revealed that subgroups of neurons exhibited phasic responses to cue presentations and lever presses. These phasic neurons were found to respond to either large/delay, small/immediate, or both trial types and the percentage of these neurons shifted across blocks as the expected value of the reward changed. Critically, this shift was only seen during trials in which animals could choose their preferred option (free choice trials) and not during trials where animals could choose only one option (forced choice trials). Further, this shift was dependent on rats' inherent impulsivity because high impulsive rats demonstrated a greater percentage of small/immediate-responsive neurons as the task progressed. Collectively, these findings suggest a unique role for the PrL in encoding reward value during delay discounting that is influenced by individual differences in impulsivity.SIGNIFICANCE STATEMENT In delay discounting, individuals discount the value of a reward based on the delay to its receipt. Here, we used electrophysiology to investigate the role of the prelimbic cortex (PrL) in this process. We found that subsets of neurons shifted activity as a function of the changing expected delay and reward magnitude, but this shift was only evident during trials in which animals could choose their preferred option. Further, this dynamic neural activity depended on rats' inherent impulsivity, with impulsive rats exhibiting a stronger neural shift toward the immediate reward as the task progressed. These findings suggest a role for the PrL in encoding reward value during delay discounting that is influenced by goal-directed context and individual differences in impulsivity.

Risky decision-making is associated with impulsive action and sensitivity to first-time nicotine exposure

Excessive risk-taking is common in multiple psychiatric conditions, including substance use disorders. The risky decision-making task (RDT) models addiction-relevant risk-taking in rats by measuring preference for a small food reward vs. a large food reward associated with systematically increasing risk of shock. Here, we examined the relationship between risk-taking in the RDT and multiple addiction-relevant phenotypes. Risk-taking was associated with elevated impulsive action, but not impulsive choice or habit formation. Furthermore, risk-taking predicted locomotor sensitivity to first-time nicotine exposure and resilience to nicotine-evoked anxiety. These data demonstrate that risk preference in the RDT predicts other traits associated with substance use disorder, and may have utility for identification of neurobiological and genetic biomarkers that engender addiction vulnerability.

Distinct Roles of Dopamine Receptors in the Lateral Thalamus in a Rat Model of Decisional Impulsivity

The thalamus and central dopamine signaling have been shown to play important roles in high-level cognitive processes including impulsivity. However, little is known about the role of dopamine receptors in the thalamus in decisional impulsivity. In the present study, rats were tested using a delay discounting task and divided into three groups: high impulsivity (HI), medium impulsivity (MI), and low impulsivity (LI). Subsequent in vivo voxel-based magnetic resonance imaging revealed that the HI rats displayed a markedly reduced density of gray matter in the lateral thalamus compared with the LI rats. In the MI rats, the dopamine D1 receptor antagonist SCH23390 or the D2 receptor antagonist eticlopride was microinjected into the lateral thalamus. SCH23390 significantly decreased their choice of a large, delayed reward and increased their omission of lever presses. In contrast, eticlopride increased the choice of a large, delayed reward but had no effect on the omissions. Together, our results indicate that the lateral thalamus is involved in decisional impulsivity, and dopamine D1 and D2 receptors in the lateral thalamus have distinct effects on decisional impulsive behaviors in rats. These results provide a new insight into the dopamine signaling in the lateral thalamus in decisional impulsivity.

Impulsive Rats Exhibit Blunted Dopamine Release Dynamics during a Delay Discounting Task Independent of Cocaine History

The inability to wait for a large, delayed reward when faced with a small, immediate one, known as delay discounting, has been implicated in a number of disorders including substance abuse. Individual differences in impulsivity on the delay discounting task are reflected in differences in neural function, including in the nucleus accumbens (NAc) core. We examined the role of a history of cocaine self-administration, as well as individual differences in impulsivity, on rapid dopamine (DA) release dynamics in the NAc core. Rats with a history of cocaine or water/saline self-administration were tested on delay discounting while being simultaneously assayed for rapid DA release using electrochemical methods. In controls, we found that cue DA release was modulated by reward delay and magnitude, consistent with prior reports. A history of cocaine had no effect on either delay discounting or DA release dynamics. Nonetheless, independent of drug history, individual differences in impulsivity were related to DA release in the NAc core. First, high impulsive animals exhibited dampened cue DA release during the delay discounting task. Second, reward delay and magnitude in high impulsive animals failed to robustly modulate changes in cue DA release. Importantly, these two DAergic mechanisms were uncorrelated with each other and, together, accounted for a high degree of variance in impulsive behavior. Collectively, these findings demonstrate two distinct mechanisms by which rapid DA signaling may influence impulsivity, and illustrate the importance of NAc core DA release dynamics in impulsive behavior.

From impulses to maladaptive actions: the insula is a neurobiological gate for the development of compulsive behavior

Impulsivity is an endophenotype of vulnerability for compulsive behaviors. However, the neural mechanisms whereby impulsivity facilitates the development of compulsive disorders, such as addiction or obsessive compulsive disorder, remain unknown. We first investigated, in rats, anatomical and functional correlates of impulsivity in the anterior insular (AI) cortex by measuring both the thickness of, and cellular plasticity markers in, the AI with magnetic resonance imaging and in situ hybridization of the immediate early gene zif268, respectively. We then investigated the influence of bilateral AI cortex lesions on the high impulsivity trait, as measured in the five-choice serial reaction time task (5-CSRTT), and the associated propensity to develop compulsivity as measured by high drinking levels in a schedule-induced polydipsia procedure (SIP). We demonstrate that the AI cortex causally contributes to individual vulnerability to impulsive-compulsive behavior in rats. Motor impulsivity, as measured by premature responses in the 5-CSRTT, was shown to correlate with the thinness of the anterior region of the insular cortex, in which highly impulsive (HI) rats expressed lower zif268 mRNA levels. Lesions of AI reduced impulsive behavior in HI rats, which were also highly susceptible to develop compulsive behavior as measured in a SIP procedure. AI lesions also attenuated both the development and the expression of SIP. This study thus identifies the AI as a novel neural substrate of maladaptive impulse control mechanisms that may facilitate the development of compulsive disorders.

A comparison of presynaptic and postsynaptic dopaminergic agonists on inhibitory control performance in rats perinatally exposed to PCBs

Polychlorinated Biphenyls (PCBs) are very stable environmental contaminants whose exposure induces a number of health and cognitive concerns. Currently, it is well known that PCB exposure leads to poor performance on inhibitory control tasks. It is also well known that dopamine (DA) depletion within medial prefrontal cortex (mPFC) leads to poor performance on inhibitory control tasks. However, what is not well established is whether or not the inhibitory control problems found following PCB exposure are mediated by DA depletion in mPFC. This study was an investigation into the link between perinatal exposure to PCBs, the effect of this exposure on DA neurotransmission in the mPFC, and inhibitory-control problems during adulthood using a rodent model. The current study served to determine if microinjections of different DA agonists (the presynaptic DA transporter inhibitor and vesicular monoamine transporter agonist bupropion, the postsynaptic DA receptor 2 (DAD2) agonist quinpirole, and the postsynaptic DA receptor 1 (DAD1) agonist SKF81297) directly into the mPFC would differentially improve performance on an inhibitory control task in rats perinatally exposed to an environmentally relevant PCB mixture. Findings suggest several significant sex-based differences on differential reinforcement of low rates (DRL) 15 performance as well as some evidence of differential effectiveness of the DA agonists based on PCB exposure group.

Differential Involvement of the Agranular vs Granular Insular Cortex in the Acquisition and Performance of Choice Behavior in a Rodent Gambling Task

Substance-related and addictive disorders, in particular gambling disorder, are known to be associated with risky decision-making behavior. Several neuroimaging studies have identified the involvement of the insular cortex in decision-making under risk. However, the extent of this involvement remains unclear and the specific contributions of two distinct insular subregions, the rostral agranular (RAIC) and the caudal granular (CGIC), have yet to be examined. Animals were trained to perform a rat gambling task (rGT), in which subjects chose between four options that differed in the magnitude and probability of rewards and penalties. In order to address the roles of the RAIC and CGIC in established choice behavior, pharmacological inactivations of these two subregions via local infusions of GABA receptor agonists were performed following 30 rGT training sessions. The contribution made by the RAIC or CGIC to the acquisition of choice behavior was also determined by lesioning these areas before behavioral training. Inactivation of the RAIC, but not of the CGIC, shifted rats' preference toward options with greater reward frequency and lower punishment. Before rGT acquisition, lesions of the RAIC, but not the CGIC, likewise resulted in a higher preference for options with greater reward frequency and lower punishment, and this persisted throughout the 30 training sessions. Our results provide confirmation of the involvement of the RAIC in rGT choice behavior and suggest that the RAIC may mediate detrimental risky decision-making behavior, such as that associated with addiction and gambling disorder.

A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation

Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet, to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward-thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE) perspective. This approach holds that testosterone increases reward processing and motivation, which increase the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology.