Medial Orbitofrontal Cortex Regulates Instrumental Conditioned Punishment, but not Pavlovian Conditioned Fear

Pavlovian Fear Conditioning Is More than You Think It Is

A common neuroscience application of Pavlovian fear conditioning is to manipulate neuron-type activity, pair a cue with foot shock, then measure cue-elicited freezing in a novel context. If the manipulation reduces freezing, the neuron type is implicated in Pavlovian fear conditioning. This application reduces Pavlovian fear conditioning to a single concept. In this Viewpoint, I describe experiments supporting the view that Pavlovian fear conditioning refers to three distinct concepts: procedure, process, and behavior. An experimenter controls procedure, observes behavior, but infers process. Distinguishing these concepts is essential because: (1) a shock-paired cue can engage numerous processes and behaviors; (2) experimenter decisions about procedure influence the processes engaged and behaviors elicited; and (3) many processes are latent, imbuing the cue with properties that only manifest outside of the original conditioning setting. This means we could understand the complete neural basis of freezing, yet know little about the neural basis of fear. Neuroscientists can choose to use a variety of procedures to study a diversity of processes and behaviors. Manipulating neuron-type activity in multiple procedures can reveal specific, general, or complex neuron-type contributions to cue-elicited processes and behaviors. The results will be a broader and more detailed neural basis of fear with greater relevance to the spectrum of symptoms defining anxiety and stressor-related disorders.

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

Early life stress is associated with the default mode and fronto-limbic network connectivity among young adults

Exposure to early life stress (ELS) is associated with a variety of detrimental psychological and neurodevelopmental effects. Importantly, ELS has been associated with regional alterations and aberrant connectivity in the structure and functioning of brain regions involved in emotion processing and self-regulation, creating vulnerability to mental health problems. However, longitudinal research regarding the impact of ELS on functional connectivity between brain regions in the default mode network (DMN) and fronto-limbic network (FLN), both implicated in emotion-related processes, is relatively scarce. Neuroimaging research on ELS has mostly focused on single nodes or bi-nodal connectivity instead of functional networks. We examined how ELS is associated with connectivity patterns within the DMN and FLN during rest in early adulthood. The participants (n = 86; 47 females) in the current functional magnetic resonance imaging (fMRI) study were young adults (18–21 years old) whose families had participated in a longitudinal study since pregnancy. ELS was assessed both prospectively (parental reports of family relationship problems and mental health problems during pregnancy and infancy) and retrospectively (self-reported adverse childhood experiences). Inter-subject representational similarity analysis (IS-RSA) and multivariate distance matrix regression (MDMR) were used to analyze the association between ELS and the chosen networks. The IS-RSA results suggested that prospective ELS was associated with complex alterations within the DMN, and that retrospective ELS was associated with alterations in the FLN. MDMR results, in turn, suggested that that retrospective ELS was associated with DMN connectivity. Mean connectivity of the DMN was also associated with retrospective ELS. Analyses further showed that ELS-related alterations in the FLN were associated with increased connectivity between the prefrontal and limbic regions, and between different prefrontal regions. These results suggest that exposure to ELS in infancy might have long-lasting influences on functional brain connectivity that persist until early adulthood. Our results also speak for the importance of differentiating prospective and retrospective assessment methods to understand the specific neurodevelopmental effects of ELS.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Aberrant orbitofrontal cortical activation interferes with encoding of Pavlovian fear conditioning

Obsessive-compulsive disorder (OCD) patients were usually found with the hyper-activation of the orbitofrontal cortex (OFC) and a deficit in fear extinction learning. The OFC can be subdivided into the lateral OFC (lOFC) and the medial OFC (mOFC). Previous studies have suggested that both subregions are involved in the modulation of negative emotions. However, how aberrant activation of the OFC interacts with the encoding of Pavlovian fear remains unknown. In this study, the lOFC or the mOFC was pharmacologically activated or inactivated before the fear conditioning on Day 1, followed by a context test on Day 2 and a tone test on Day 3 in male Long-Evans rats. We found that for the animals that underwent fear conditioning under aberrant activation of either the lOFC or the mOFC, they showed normal within-session fear expression. However, the acquisition/consolidation of contextual fear was impaired under mOFC activation, while the acquisition/consolidation of cued fear was impaired under either the lOFC or the mOFC activation, in that these animals showed lower freezing compared to controls during the retrieval test. On the other hand, for the animals that underwent fear conditioning under inactivation of either the lOFC or the mOFC, they showed normal within-session fear expression, as well as intact encoding of both the contextual and cued fear. Together, our results suggested that the OFC was not actively engaged in the acquisition of Pavlovian fear conditioning, but aberrant activation of the OFC impaired fear learning.

Meta-analysis of human prediction error for incentives, perception, cognition, and action

Prediction errors (PEs) are a keystone for computational neuroscience. Their association with midbrain neural firing has been confirmed across species and has inspired the construction of artificial intelligence that can outperform humans. However, there is still much to learn. Here, we leverage the wealth of human PE data acquired in the functional neuroimaging setting in service of a deeper understanding, using an MKDA (multi-level kernel-based density) meta-analysis. Studies were identified with Google Scholar, and we included studies with healthy adult participants that reported activation coordinates corresponding to PEs published between 1999-2018. Across 264 PE studies that have focused on reward, punishment, action, cognition, and perception, consistent with domain-general theoretical models of prediction error we found midbrain PE signals during cognitive and reward learning tasks, and an insula PE signal for perceptual, social, cognitive, and reward prediction errors. There was evidence for domain-specific error signals--in the visual hierarchy during visual perception, and the dorsomedial prefrontal cortex during social inference. We assessed bias following prior neuroimaging meta-analyses and used family-wise error correction for multiple comparisons. This organization of computation by region will be invaluable in building and testing mechanistic models of cognitive function and dysfunction in machines, humans, and other animals. Limitations include small sample sizes and ROI masking in some included studies, which we addressed by weighting each study by sample size, and directly comparing whole brain vs. ROI-based results.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.