Risk of punishment influences discrete and coordinated encoding of reward-guided actions by prefrontal cortex and VTA neurons

Dopamine in the prefrontal cortex plays multiple roles in the executive function of patients with Parkinson's disease

Parkinson's disease can affect not only motor functions but also cognitive abilities, leading to cognitive impairment. One common issue in Parkinson's disease with cognitive dysfunction is the difficulty in executive functioning. Executive functions help us plan, organize, and control our actions based on our goals. The brain area responsible for executive functions is called the prefrontal cortex. It acts as the command center for the brain, especially when it comes to regulating executive functions. The role of the prefrontal cortex in cognitive processes is influenced by a chemical messenger called dopamine. However, little is known about how dopamine affects the cognitive functions of patients with Parkinson's disease. In this article, the authors review the latest research on this topic. They start by looking at how the dopaminergic system, is altered in Parkinson's disease with executive dysfunction. Then, they explore how these changes in dopamine impact the synaptic structure, electrical activity, and connection components of the prefrontal cortex. The authors also summarize the relationship between Parkinson's disease and dopamine-related cognitive issues. This information may offer valuable insights and directions for further research and improvement in the clinical treatment of cognitive impairment in Parkinson's disease.

VTA Excitatory Neurons Control Reward-driven Behavior by Modulating Infralimbic Cortical Firing

The functional dichotomy of anatomical regions of the medial prefrontal cortex (mPFC) has been tested with greater certainty in punishment-driven tasks, and less so in reward-oriented paradigms. In the infralimbic cortex (IL), known for behavioral suppression (STOP), tasks linked with reward or punishment are encoded through firing rate decrease or increase, respectively. Although the ventral tegmental area (VTA) is the brain region governing reward/aversion learning, the link between its excitatory neuron population and IL encoding of reward-linked behavioral expression is unclear. Here, we present evidence that IL ensembles use a population-based mechanism involving broad inhibition of principal cells at intervals when reward is presented or expected. The IL encoding mechanism was consistent across multiple sessions with randomized rewarded target sites. Most IL neurons exhibit FR (Firing Rate) suppression during reward acquisition intervals (T1), and subsequent exploration of previously rewarded targets when the reward is omitted (T2). Furthermore, FR suppression in putative IL ensembles persisted for intervals that followed reward-linked target events. Pairing VTA glutamate inhibition with reward acquisition events reduced the weight of reward-target association expressed as a lower affinity for previously rewarded targets. For these intervals, fewer IL neurons per mouse trial showed FR decrease and were accompanied by an increase in the percentage of units with no change in FR. Together, we conclude that VTA glutamate neurons are likely involved in establishing IL inhibition states that encode reward acquisition, and subsequent reward-target association.

Delay of punishment highlights differential vulnerability to developing addiction-like behavior toward sweet food

Resistance to punishment is commonly used to measure the difficulty in refraining from rewarding activities when negative consequences ensue, which is a hallmark of addictive behavior. We recently developed a progressive shock strength (PSS) procedure in which individual rats can titrate the amount of punishment that they are willing to tolerate to obtain food rewards. Here, we investigated the effects of a range of delays (0-12 s) on resistance to punishment measured by PSS break points. As expected from delay discounting principles, we found that delayed shock was less effective as a punisher, as revealed by higher PSS breakpoints. However, this discounting effect was not equally distributed in the population of rats, and the introduction of a delay highlighted the existence of two populations: rats that were sensitive to immediate punishment were also sensitive to delayed shock, whereas rats that were resistant to immediate punishment showed strong temporal discounting of delayed punishment. Importantly, shock-sensitive rats suppressed responding even in subsequent non-punishment sessions, and they differed from shock-resistant rats in anxiety-like behavior, but not in sensitivity to pain. These results show that manipulation of temporal contingencies of punishment in the PSS procedure provides a valuable tool to identify individuals with a double vulnerability to addiction: low sensitivity to aversion and excessive discounting of negative future consequences. Conversely, the shock-sensitive population may provide a model of humans who are vulnerable to opportunity loss due to excessive anxiety.

Orbitofrontal and Prelimbic Cortices Serve Complementary Roles in Adapting Reward Seeking to Learned Anxiety

BACKGROUND

Anxiety is a common symptom of several mental health disorders and adversely affects motivated behaviors. Anxiety can emerge from associating risk of future harm while engaged in goal-guided actions. Using a recently developed behavioral paradigm to model this aspect of anxiety, we investigated the role of 2 cortical subregions, the prelimbic medial frontal cortex (PL) and lateral orbitofrontal cortex (lOFC), which have been implicated in anxiety and outcome expectation, in flexible representation of actions associated with harm risk.

METHODS

A seek-take reward-guided instrumental task design was used to train animals (N = 8) to associate the seek action with a variable risk of punishment. After learning, animals underwent extinction training for this association. Fiber photometry was used to measure and compare neuronal activity in the PL and lOFC during learning and extinction.

RESULTS

Animals increased action suppression in response to punishment contingencies. This increase dissipated after extinction training. These behavioral changes were associated with region-specific changes in neuronal activity. PL neuronal activity preferentially adapted to the threat of punishment, whereas lOFC activity adapted to safe aspects of the task. Moreover, correlated activity between these regions was suppressed during actions associated with harm risk, suggesting that these regions may guide behavior independently under anxiety.

CONCLUSIONS

These findings suggest that the PL and lOFC serve distinct but complementary roles in the representation of learned anxiety. This dissociation may provide a mechanism to explain how overlapping cortical systems are implicated in reward-guided action execution during anxiety.

The PFC-LH-VTA pathway contributes to social deficits in IRSp53-mutant mice

Dopamine (DA) neurons in the ventral tegmental area (VTA) promote social brain functions by releasing DA onto nucleus accumbens neurons, but it remains unclear how VTA neurons communicate with cortical neurons. Here, we report that the medial prefrontal cortex (mPFC)-lateral hypothalamus (LH)-VTA pathway contributes to social deficits in mice with IRSp53 deletion restricted to cortical excitatory neurons (Emx1-Cre;Irsp53fl/fl mice). LH-projecting mutant mPFC neurons display abnormally increased excitability involving decreased potassium channel gene expression, leading to excessive excitatory synaptic input to LH-GABA neurons. A circuit-specific IRSp53 deletion in LH-projecting mPFC neurons also increases neuronal excitability and induces social deficits. LH-GABA neurons with excessive mPFC excitatory synaptic input show a compensatory decrease in excitability, weakening the inhibitory LHGABA-VTAGABA pathway and subsequently over-activating VTA-GABA neurons and over-inhibiting VTA-DA neurons. Accordingly, optogenetic activation of the LHGABA-VTAGABA pathway improves social deficits in Emx1-Cre;Irsp53fl/fl mice. Therefore, the mPFC-LHGABA-VTAGABA-VTADA pathway contributes to the social deficits in Emx1-Cre;Irsp53fl/fl mice.

Rhythmic oscillations in the midbrain dopaminergic nuclei in mice

Introduction

Dopamine release in the forebrain by midbrain ventral tegmental nucleus (VTA) and substantia nigra pars compacta (SNc) neurons is implicated in reward processing, goal-directed learning, and decision-making. Rhythmic oscillations of neural excitability underlie coordination of network processing, and have been reported in these dopaminergic nuclei at several frequency bands. This paper provides a comparative characterization of several frequencies of oscillations of local field potential and single unit activity, highlighting some behavioral correlates.

Methods

We recorded from optogenetically identified dopaminergic sites in four mice training in operant olfactory and visual discrimination tasks.

Results

Rayleigh and Pairwise Phase Consistency (PPC) analyses revealed some VTA/SNc neurons phase-locked to each frequency range, with fast spiking interneurons (FSIs) prevalent at 1-2.5 Hz (slow) and 4 Hz bands, and dopaminergic neurons predominant in the theta band. More FSIs than dopaminergic neurons were phase-locked in the slow and 4 Hz bands during many task events. The highest incidence of phase-locking in neurons was in the slow and 4 Hz bands, and occurred during the delay between the operant choice and trial outcome (reward or punishment) signals.

Discussion

These data provide a basis for further examination of rhythmic coordination of activity of dopaminergic nuclei with other brain structures, and its impact for adaptive behavior.

Dopaminergic and prefrontal dynamics co-determine mouse decisions in a spatial gambling task

The neural mechanisms by which animals initiate goal-directed actions, choose between options, or explore opportunities remain unknown. Here, we develop a spatial gambling task in which mice, to obtain intracranial self-stimulation rewards, self-determine the initiation, direction, vigor, and pace of their actions based on their knowledge of the outcomes. Using electrophysiological recordings, pharmacology, and optogenetics, we identify a sequence of oscillations and firings in the ventral tegmental area (VTA), orbitofrontal cortex (OFC), and prefrontal cortex (PFC) that co-encodes and co-determines self-initiation and choices. This sequence appeared with learning as an uncued realignment of spontaneous dynamics. Interactions between the structures varied with the reward context, particularly the uncertainty associated with the different options. We suggest that self-generated choices arise from a distributed circuit based on an OFC-VTA core determining whether to wait for or initiate actions, while the PFC is specifically engaged by reward uncertainty in action selection and pace.

Prefrontal cortex neurons in adult rats exposed to early life stress fail to appropriately signal the consequences of motivated actions

Early life stress (ELS) can set the stage for susceptibility to cognitive and emotional dysfunction in adulthood by disrupting typical neural development. The prefrontal cortex (PFC) continues to mature during early life, making this region particularly vulnerable to disruption for animals who experience ELS. Despite this, the effects of ELS experience on in vivo PFC function in awake and behaving adult animals are currently poorly understood. To assess this, we employed an instrumental conflict task to assess how hungry adult rats, either ELS (wet bedding) or unstressed Controls, were able to flexibly alter their motivation for food reward seeking (lever presses) in situations that were either threatening or safe. During this task, in vivo electrophysiological recordings (both single unit and local field potentials [LFPs]) were made in the rats' ventral-medial PFC (vmPFC). We found that ELS rats were less motivated to lever press for rewards than Controls in the threat situations during repeated extinction sessions. In recordings taken during this suppression task, Control vmPFC neurons displayed reliable differences between motivated actions, such as between rewarded and unrewarded presses, but ELS neurons failed to differentiate these action-outcome differences. We also found differences in task-related LFP activity between groups; in particular, prior ELS experience appears to induce abnormal changes in low-frequency oscillations during shock-associated threat stimuli prior to presses, as well as diminished higher-frequency oscillations following rewarded presses. Collectively, we demonstrate that ELS experience produces persistent impairment in motivational regulation that is associated with significant changes in in vivo PFC signals. Specifically, ELS-experienced adults fail to appropriately update motivated action strategies under threat conditions, and likewise fail to appropriately monitor and update action/outcome relationships in motivated behavior. These ELS-related changes may therefore lay the foundation for heightened susceptibility to mental-health disorders in adults such as substance abuse and post-traumatic stress disorder.

Learning of probabilistic punishment as a model of anxiety produces changes in action but not punisher encoding in the dmPFC and VTA

Previously, we developed a novel model for anxiety during motivated behavior by training rats to perform a task where actions executed to obtain a reward were probabilistically punished and observed that after learning, neuronal activity in the ventral tegmental area (VTA) and dorsomedial prefrontal cortex (dmPFC) represent the relationship between action and punishment risk (Park and Moghaddam, 2017). Here, we used male and female rats to expand on the previous work by focusing on neural changes in the dmPFC and VTA that were associated with the learning of probabilistic punishment, and anxiolytic treatment with diazepam after learning. We find that adaptive neural responses of dmPFC and VTA during the learning of anxiogenic contingencies are independent from the punisher experience and occur primarily during the peri-action and reward period. Our results also identify peri-action ramping of VTA neural calcium activity, and VTA-dmPFC correlated activity, as potential markers for the anxiolytic properties of diazepam.

Lateral Orbitofrontal Cortex and Basolateral Amygdala Regulate Sensitivity to Delayed Punishment during Decision-making

In real-world decision-making scenarios, negative consequences do not always occur immediately after a choice. This delay between action and outcome drives the underestimation, or "delay discounting", of punishment. While the neural substrates underlying sensitivity to immediate punishment have been well-studied, there has been minimal investigation of delayed consequences. Here, we assessed the role of lateral orbitofrontal cortex (LOFC) and basolateral amygdala (BLA), two regions implicated in cost/benefit decision-making, in sensitivity to delayed vs immediate punishment. The delayed punishment decision-making task (DPDT) was used to measure delay discounting of punishment in rodents. During DPDT, rats choose between a small, single pellet reward and a large, three pellet reward accompanied by a mild foot shock. As the task progresses, the shock is preceded by a delay that systematically increases or decreases throughout the session. We observed that rats avoid choices associated with immediate punishment, then shift preference toward these options when punishment is delayed. LOFC inactivation did not influence choice of rewards with immediate punishment, but decreased choice of delayed punishment. We also observed that BLA inactivation reduced choice of delayed punishment for ascending but not descending delays. Inactivation of either brain region produced comparable effects on decision-making in males and females, but there were sex differences observed in omissions and latency to make a choice. In summary, both LOFC and BLA contribute to the delay discounting of punishment and may serve as promising therapeutic targets to improve sensitivity to delayed punishment during decision-making.Significance StatementNegative consequences occurring after a delay are often underestimated, which can lead to maladaptive decision-making. While sensitivity to immediate punishment during reward-seeking has been well-studied, the neural substrates underlying sensitivity to delayed punishment remain unclear. Here, we used the Delayed Punishment Decision-making Task to determine that lateral orbitofrontal cortex and basolateral amygdala both regulate the discounting of delayed punishment, suggesting that these regions may be potential targets to improve decision-making in psychopathology.

Neural correlates and determinants of approach-avoidance conflict in the prelimbic prefrontal cortex

The recollection of environmental cues associated with threat or reward allows animals to select the most appropriate behavioral responses. Neurons in the prelimbic (PL) cortex respond to both threat- and reward-associated cues. However, it remains unknown whether PL regulates threat-avoidance vs. reward-approaching responses when an animals’ decision depends on previously associated memories. Using a conflict model in which male Long–Evans rats retrieve memories of shock- and food-paired cues, we observed two distinct phenotypes during conflict: (1) rats that continued to press a lever for food (Pressers) and (2) rats that exhibited a complete suppression in food seeking (Non-pressers). Single-unit recordings revealed that increased risk-taking behavior in Pressers is associated with persistent food-cue responses in PL, and reduced spontaneous activity in PL glutamatergic (PL^GLUT) neurons during conflict. Activating PL^GLUT neurons in Pressers attenuated food-seeking responses in a neutral context, whereas inhibiting PL^GLUT neurons in Non-pressers reduced defensive responses and increased food approaching during conflict. Our results establish a causal role for PL^GLUT neurons in mediating individual variability in memory-based risky decision-making by regulating threat-avoidance vs. reward-approach behaviors.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Medial prefrontal cortex encoding of stress and anxiety

The prefrontal cortex (PFC) is involved in adaptive control of behavior and optimizing action selection. When an organism is experiencing an aversive event, such as a sustained state of anxiety or an overt experience of fear or stress, the mechanisms that govern PFC regulation of action selection may be critical for survival. A large body of literature has shown that acute aversive states influence the activity of PFC neurons and the release of neurotransmitters in this region. These states also result in long-term neurobiological changes in the PFC and expression of PFC-dependent motivated behaviors. The mechanism for how these changes lead to modifying action selection is only recently beginning to emerge. Here, we review animal and human studies into the neural mechanisms which may mediate the adaptive changes in the PFC that emerge during negative affective states. We then highlight recent advances in approaches for understanding how anxiety influences action selection and related cortical processes. We conclude by proposing that PFC neurons selectively influence action encoding during conditions where actions toward obtaining a reward or avoiding harm are executed under a fog of fear and anxiety.

Integration of value and action in medial prefrontal neural systems

The rodent medial prefrontal cortex (mPFC) plays a key role in regulating cognition, emotion, and behavior. mPFC neurons are activated in diverse experimental paradigms, raising the questions of whether there are specific task elements or dimensions encoded by mPFC neurons, and whether these encoded parameters are selective to neurons in particular mPFC subregions or networks. Here, we consider the role of mPFC neurons in processing appetitive and aversive cues, outcomes, and related behaviors. mPFC neurons are strongly activated in tasks probing value and outcome-associated actions, but these responses vary across experimental paradigms. Can we identify specific categories of responses (e.g., positive or negative value), or do mPFC neurons exhibit response properties that are too heterogeneous/complex to cluster into distinct conceptual groups? Based on a review of relevant studies, we consider what has been done and what needs to be further explored in order to address these questions.

Sex differences in reward- and punishment-guided actions

Differences in the prevalence and presentation of psychiatric illnesses in men and women suggest that neurobiological sex differences confer vulnerability or resilience in these disorders. Rodent behavioral models are critical for understanding the mechanisms of these differences. Reward processing and punishment avoidance are fundamental dimensions of the symptoms of psychiatric disorders. Here we explored sex differences along these dimensions using multiple and distinct behavioral paradigms. We found no sex difference in reward-guided associative learning but a faster punishment-avoidance learning in females. After learning, females were more sensitive than males to probabilistic punishment but less sensitive when punishment could be avoided with certainty. No sex differences were found in reward-guided cognitive flexibility. Thus, sex differences in goal-directed behaviors emerged selectively when there was an aversive context. These differences were critically sensitive to whether the punishment was certain or unpredictable. Our findings with these new paradigms provide conceptual and practical tools for investigating brain mechanisms that account for sex differences in susceptibility to anxiety and impulsivity. They may also provide insight for understanding the evolution of sex-specific optimal behavioral strategies in dynamic environments.

The role of the locus coeruleus in the generation of pathological anxiety

This review aims to synthesise a large pre-clinical and clinical literature related to a hypothesised role of the locus coeruleus norepinephrine system in responses to acute and chronic threat, as well as the emergence of pathological anxiety. The locus coeruleus has widespread norepinephrine projections throughout the central nervous system, which act to globally modulate arousal states and adaptive behavior, crucially positioned to play a significant role in modulating both ascending visceral and descending cortical neurocognitive information. In response to threat or a stressor, the locus coeruleus–norepinephrine system globally modulates arousal, alerting and orienting functions and can have a powerful effect on the regulation of multiple memory systems. Chronic stress leads to amplification of locus coeruleus reactivity to subsequent stressors, which is coupled with the emergence of pathological anxiety-like behaviors in rodents. While direct in vivo evidence for locus coeruleus dysfunction in humans with pathological anxiety remains limited, recent advances in high-resolution 7-T magnetic resonance imaging and computational modeling approaches are starting to provide new insights into locus coeruleus characteristics.

Prefrontal Cortex Representation of Learning of Punishment Probability During Reward-Motivated Actions

Actions executed toward obtaining a reward are frequently associated with the probability of harm occurring during action execution. Learning this probability allows for appropriate computation of future harm to guide action selection. Impaired learning of this probability may be critical for the pathogenesis of anxiety or reckless and impulsive behavior. Here we designed a task for punishment probability learning during reward-guided actions to begin to understand the neuronal basis of this form of learning, and the biological or environmental variables that influence action selection after learning. Male and female Long-Evans rats were trained in a seek-take behavioral paradigm where the seek action was associated with varying probability of punishment. The take action remained safe and was followed by reward delivery. Learning was evident as subjects selectively adapted seek action behavior as a function of punishment probability. Recording of neural activity in the mPFC during learning revealed changes in phasic mPFC neuronal activity during risky-seek actions but not during the safe take actions or reward delivery, revealing that this region is involved in learning of probabilistic punishment. After learning, the variables that influenced behavior included reinforcer and punisher value, pretreatment with the anxiolytic diazepam, and biological sex. In particular, females were more sensitive to probabilistic punishment than males. These data demonstrate that flexible encoding of risky actions by mPFC is involved in probabilistic punishment learning and provide a novel behavioral approach for studying the pathogenesis of anxiety and impulsivity with inclusion of sex as a biological variable.SIGNIFICANCE STATEMENT Actions we choose to execute toward obtaining a reward are often associated with the probability of harm occurring. Impaired learning of this probability may be critical for the pathogenesis of anxiety or reckless behavior and impulsivity. We developed a behavioral model to assess this mode of learning. This procedure allowed us to determine biological and environmental factors that influence the resistance of reward seeking to probabilistic punishment and to identify the mPFC as a region that flexibly adapts its response to risky actions as contingencies are learned.

Unanticipated Stressful and Rewarding Experiences Engage the Same Prefrontal Cortex and Ventral Tegmental Area Neuronal Populations

Brain networks that mediate motivated behavior in the context of aversive and rewarding experiences involve the prefrontal cortex (PFC) and ventral tegmental area (VTA). Neurons in both regions are activated by stress and reward, and by learned cues that predict aversive or appetitive outcomes. Recent studies have proposed that separate neuronal populations and circuits in these regions encode learned aversive versus appetitive contexts. But how about the actual experience? Do the same or different PFC and VTA neurons encode unanticipated aversive and appetitive experiences? To address this, we recorded unit activity and local field potentials (LFPs) in the dorsomedial PFC (dmPFC) and VTA of male rats as they were exposed, in the same recording session, to reward (sucrose) or stress (tail pinch) spaced 1 h apart. As expected, experience-specific neuronal responses were observed. Approximately 15–25% of single units in each region responded by excitation or inhibition to either stress or reward, and only stress increased LFP theta oscillation power in both regions and coherence between regions. But the largest number of responses (29% dmPFC and 30% VTA units) involved dual-valence neurons that responded to both stress and reward exposure. Moreover, the temporal profile of neuronal population activity in dmPFC and VTA as assessed by principal component analysis (PCA) were similar during both types of experiences. These results reveal that aversive and rewarding experiences engage overlapping neuronal populations in the dmPFC and the VTA. These populations may provide a locus of vulnerability for stress-related disorders, which are often associated with anhedonia.

Dopamine Modulation of Prefrontal Cortex Activity Is Manifold and Operates at Multiple Temporal and Spatial Scales

Although the function of dopamine in subcortical structures is largely limited to reward and movement, dopamine neurotransmission in the prefrontal cortex (PFC) is critical to a multitude of temporally and functionally diverse processes, such as attention, working memory, behavioral flexibility, action planning, and sustained motivational and affective states. How does dopamine influence computation of these temporally complex functions? We find causative links between sustained and burst patterns of phasic dopamine neuron activation and modulation of medial PFC neuronal activity at multiple spatiotemporal scales. These include a multidirectional and weak impact on individual neuron rate activity but a robust influence on coordinated ensemble activity, gamma oscillations, and gamma-theta coupling that persisted for minutes. In addition, PFC network responses to burst pattern of dopamine firing were selectively strengthened in behaviorally active states. This multiplex mode of modulation by dopamine input may enable PFC to compute and generate spatiotemporally diverse and specialized outputs.

IRSp53 Deletion in Glutamatergic and GABAergic Neurons and in Male and Female Mice Leads to Distinct Electrophysiological and Behavioral Phenotypes

IRSp53 (also known as BAIAP2) is an abundant excitatory postsynaptic scaffolding protein implicated in autism spectrum disorders (ASD), schizophrenia, and attention-deficit/hyperactivity disorder (ADHD). IRSp53 is expressed in different cell types across different brain regions, although it remains unclear how IRSp53 deletion in different cell types affects brain functions and behaviors in mice. Here, we deleted IRSp53 in excitatory and inhibitory neurons in mice and compared resulting phenotypes in males and females. IRSp53 deletion in excitatory neurons driven by Emx1 leads to strong social deficits and hyperactivity without affecting anxiety-like behavior, whereas IRSp53 deletion in inhibitory neurons driven by Viaat has minimal impacts on these behaviors in male mice. In female mice, excitatory neuronal IRSp53 deletion induces hyperactivity but moderate social deficits. Excitatory neuronal IRSp53 deletion in male mice induces an increased ratio of evoked excitatory and inhibitory synaptic transmission (E/I ratio) in layer V pyramidal neurons in the prelimbic region of the medial prefrontal cortex (mPFC), whereas the same mutation does not alter the E/I ratio in female neurons. These results suggest that IRSp53 deletion in excitatory and inhibitory neurons and in male and female mice has distinct impacts on behaviors and synaptic transmission.

Dopaminergic contributions to behavioral control under threat of punishment in rats

RATIONALE

Excessive intake of rewards, such as food and drugs, often has explicit negative consequences, including the development of obesity and addiction, respectively. Thus, choosing not to pursue reward is the result of a cost/benefit decision, proper execution of which requires inhibition of behavior. An extensive body of preclinical and clinical evidence implicates dopamine in certain forms of inhibition of behavior, but it is not fully known how it contributes to behavioral inhibition under threat of explicit punishment.

OBJECTIVES

To assess the involvement of midbrain dopamine neurons and their corticostriatal output regions, the ventral striatum and prefrontal cortex, in control over behavior under threat of explicit (foot shock) punishment in rats.

METHODS

We used a recently developed behavioral inhibition task, which assesses the ability of rats to exert behavioral restraint at the mere sight of food reward, under threat of foot shock punishment. Using in vivo fiber photometry, chemogenetics, c-Fos immunohistochemistry, and behavioral pharmacology, we investigated how dopamine neurons in the ventral tegmental area, as well as its output areas, the ventral striatum and prefrontal cortex, contribute to behavior in this task.

RESULTS

Using this multidisciplinary approach, we found little evidence for a direct involvement of ascending midbrain dopamine neurons in inhibitory control over behavior under threat of punishment. For example, photometry recordings suggested that VTA DA neurons do not directly govern control over behavior in the task, as no differences were observed in neuronal population activity during successful versus unsuccessful behavioral control. In addition, chemogenetic and pharmacological manipulations of the mesocorticolimbic DA system had little or no effect on the animals' ability to exert inhibitory control over behavior. Rather, the dopamine system appeared to have a role in the motivational components of reward pursuit.

CONCLUSIONS

Together, our data provide insight into the mesocorticolimbic mechanisms behind motivated behaviors by showing a modulatory role of dopamine in the expression of cost/benefit decisions. In contrast to our expectations, dopamine did not appear to directly mediate the type of behavioral control that is tested in our task.

Neurobiological links between stress and anxiety

Stress and anxiety have intertwined behavioral and neural underpinnings. These commonalities are critical for understanding each state, as well as their mutual interactions. Grasping the mechanisms underlying this bidirectional relationship will have major clinical implications for managing a wide range of psychopathologies. After briefly defining key concepts for the study of stress and anxiety in pre-clinical models, we present circuit, as well as cellular and molecular mechanisms involved in either or both stress and anxiety. First, we review studies on divergent circuits of the basolateral amygdala (BLA) underlying emotional valence processing and anxiety-like behaviors, and how norepinephrine inputs from the locus coeruleus (LC) to the BLA are responsible for acute-stress induced anxiety. We then describe recent studies revealing a new role for mitochondrial function within the nucleus accumbens (NAc), defining individual trait anxiety in rodents, and participating in the link between stress and anxiety. Next, we report findings on the impact of anxiety on reward encoding through alteration of circuit dynamic synchronicity. Finally, we present work unravelling a new role for hypothalamic corticotropin-releasing hormone (CRH) neurons in controlling anxiety-like and stress-induce behaviors. Altogether, the research reviewed here reveals circuits sharing subcortical nodes and underlying the processing of both stress and anxiety. Understanding the neural overlap between these two psychobiological states, might provide alternative strategies to manage disorders such as post-traumatic stress disorder (PTSD).

Resting state oscillations suggest a motor component of Parkinson's Impulse Control Disorders

OBJECTIVES

Impulse control disorders (ICDs) in Parkinson's disease (PD) have been associated with cognitive impulsivity and dopaminergic dysfunction and treatment. The present study tests the neglected hypothesis that the neurofunctional networks involved in motor impulsivity might also be dysfunctional in PD-ICDs.

METHODS

We performed blind spectral analyses of resting state electroencephalographic (EEG) data in PD patients with and without ICDs to probe the functional integrity of all cortical networks. Analyses were performed directly at the source level after blind source separation. Discrete differences between groups were tested by comparing patients with and without ICDs. Gradual dysfunctions were assessed by means of correlations between power changes and clinical scores reflecting ICD severity (QUIP score).

RESULTS

Spectral signatures of ICDs were found in the medial prefrontal cortex, the dorsal anterior cingulate and the supplementary motor area, in the beta and gamma bands. Beta power changes in the supplementary motor area were found to predict ICDs severity.

CONCLUSION

ICDs are associated with abnormal activity within frequency bands and cortical circuits supporting the control of motor response inhibition.

SIGNIFICANCE

These results bring to the forefront the need to consider, in addition to the classical interpretation based on aberrant mesocorticolimbic reward processing, the issue of motor impulsivity in PD-ICDs and its potential implications for PD therapy.

A Free-Operant Reward-Tracking Paradigm to Study Neural Mechanisms and Neurochemical Modulation of Adaptive Behavior in Rats

The ability to respond flexibly to changing environmental circumstances is a hallmark of goal-directed behavior, and compromised flexibility is associated with a wide range of psychiatric conditions in humans, such as addiction and stress-related disorders. To identify neural circuits and transmitter systems implicated in the provision of cognitive flexibility, suitable animal paradigms are needed. Ideally, such models should be easy to implement, allow for rapid task acquisition, provide multiple behavioral readouts, and permit combination with physiological and pharmacological testing and manipulation. Here, we describe a paradigm meeting these requirements and employ it to investigate the neural substrates and neurochemical modulation of adaptive behavior. Water-restricted rats learned to emit operant responses for positive reinforcement (water reward) within minutes in a free-operant conditioning environment. Without further training, animals were able to track changes in the reward schedule. Given prior evidence that the medial prefrontal cortex (mPFC) and the dopaminergic system are required for flexible behavior, we aimed to assess both in more detail. Silencing of mPFC compromised flexible behavior when avoidance of punishment was required. Systemic injections of the D2-receptor agonist quinpirole and the D2-receptor antagonist eticlopride had complex, differential impacts on reward seeking and adaptive behavior.

Anxiety and Brain Networks of Attentional Control

Advances in the study of brain networks can be applied to our understanding of anxiety disorders (eg, generalized anxiety, obsessive-compulsive, and posttraumatic stress disorders) to enable us to create targeted treatments. These disorders have in common an inability to control thoughts, emotions, and behaviors related to a perceived threat. Here we review animal and human imaging studies that have revealed separate brain networks related to various negative emotions. Research has supported the idea that brain networks of attention serve to control emotion networks as well as the thoughts and behaviors related to them. We discuss how attention networks can modulate both positive and negative affect. Disorders arise from both abnormal activation of negative affect and a lack of attentional control. Training attention has been one way to foster improved attentional control. We review attention training studies as well as efforts to generally improve attention networks through stimulation in self-regulation.

Local Field Potentials Reflect Dopaminergic and Non-Dopaminergic Activities within the Primate Midbrain

Midbrain dopamine neurons are thought to play a crucial role in motivating behaviors toward desired goals. While the activity of dopamine single-units is known to adhere closely to the reward prediction error (RPE) signal hypothesized by learning theory, much less is known about the dynamic coordination of population-level neuronal activities in the midbrain. Local field potentials (LFPs) are thought to reflect the changes in membrane potential synchronized across a population of neurons nearby a recording electrode. These changes involve complex combinations of local spiking activity with synaptic processing that are difficult to interpret. Here we sampled LFPs from the substantia nigra pars compacta (SNc) of behaving monkeys to determine if local population-level synchrony encodes specific aspects of a reward/effort instrumental task and whether dopamine single-units participate in that signal. We found that reward-correlated information is encoded in a low-frequency signal (<32-Hz; delta and beta bands) that is synchronized across a neural population that includes dopamine neurons. Conversely, high-frequency power (>33-Hz; gamma band) was anticorrelated with predicted reward value and dopamine single-units were never phase-locked to those frequencies. This high-frequency signal may reflect inhibitory processes that were not otherwise observable. LFP encoding of movement-related parameters was negligible. Together, LFPs provide novel insights into the multidimensional processing of reward information subserved by dopaminergic and other components of the midbrain.

Firing of Putative Dopamine Neurons in Ventral Tegmental Area Is Modulated by Probability of Success during Performance of a Stop-Change Task

Response inhibition, the ability to refrain from unwanted actions, is an essential component of complex behavior and is often impaired across numerous neuropsychiatric disorders such as addiction, attention-deficit hyperactivity disorder (ADHD), schizophrenia, and obsessive-compulsive disorder. Accordingly, much research has been devoted to characterizing brain regions responsible for the regulation of response inhibition. The stop-signal task, a task in which animals are required to inhibit a prepotent response in the presence of a STOP cue, is one of the most well-studied tasks of response inhibition. While pharmacological evidence suggests that dopamine (DA) contributes to the regulation of response inhibition, what is exactly encoded by DA neurons during performance of response inhibition tasks is unknown. To address this issue, we recorded from single units in the ventral tegmental area (VTA), while rats performed a stop-change task. We found that putative DA neurons fired less and higher to cues and reward on STOP trials relative to GO trials, respectively, and that firing was reduced during errors. These results suggest that DA neurons in VTA encode the uncertainty associated with the probability of obtaining reward on difficult trials instead of the saliency associated with STOP cues or the need to resolve conflict between competing responses during response inhibition.