L-DOPA modulates activity in the vmPFC, nucleus accumbens, and VTA during threat extinction learning in humans

Preclinical behavioral and pharmacological treatments for enhancing fear extinction in adolescence

Adolescence is a window of vulnerability for the development of anxiety disorders but also a window of opportunity for treatments to minimize the long-term impact of such disorders. Current first-line treatments, primarily exposure-based cognitive-behavioral therapy (CBT), have limited long-term efficacy in adolescents. The urgent need for more effective interventions is underscored by the frequent reports of extinction impairments in adolescents as well as the rising anxiety rates in youth, particularly post-COVID-19. Preclinical research on the extinction of learned fear in adolescents may contribute to developing better treatment approaches to anxiety in this age group. Unfortunately, this is still a largely under-explored area. However, both pharmacological and behavioral augmentation strategies can be used to enhance extinction learning and consolidation. Here we describe work exploring such adjuncts, focusing on pre-clinical work with rodents. Much of the research to date shows striking developmental differences in response to various pharmacological treatments, with only a few shown to be effective in adolescents. Further, recent experience of stress reduces the efficacy of these treatments in adolescence. This review highlights the necessity for tailored strategies, especially when it comes to pharmacological adjuncts, that address developmental differences in drug responses as well as the impact of stressful experiences on treatment efficacy.

Long-term exposure therapy outcome in phobia and the link with behavioral and neural indices of extinction learning

Extinction learning is regarded as a core mechanism underlying exposure therapy. Under this assumption, studies have looked at the predictive value of the extinction learning paradigm for exposure therapy outcomes. However, predicting factors of long-term exposure therapy success have not been established. Participants with a specific phobia (SP) for spiders were included in a double-blind randomized controlled trial. Participants were randomly assigned to receive exposure therapy (n = 25, 24 females) or an active control intervention, progressive muscle relaxation (PMR; n = 18, 15 females). Symptom levels were measured with the Fear of Spiders questionnaire (FSQ) at baseline (T0), after the intervention (T1), and at six- (T2) and twelve (T3) months follow-up. At baseline, participants completed a three-day fMRI fear conditioning, extinction learning, and extinction recall paradigm. Indices of extinction were defined as self-reported threat expectancy and fear, and neural activation during stimulus presentations and threat omission in the ventromedial prefrontal cortex and nucleus accumbens, based on prior data. Mixed model analysis revealed that the exposure therapy group had an overall stronger decrease in phobic symptoms over time than the PMR group (β = 10.95, p < .001). However, none of the indices of extinction learning were predictive for FSQ scores after exposure therapy at the longest follow-up measurement (T3). In sum, the current results show the long-term effectiveness of a single session of exposure therapy for reducing a specific fear of spiders but no baseline characteristics were identified that predicted individual differences in exposure therapy success after one year.

Omissions of threat trigger subjective relief and prediction error-like signaling in the human reward and salience systems

The unexpected absence of danger constitutes a pleasurable event that is critical for the learning of safety. Accumulating evidence points to similarities between the processing of absent threat and the well-established reward prediction error (PE). However, clear-cut evidence for this analogy in humans is scarce. In line with recent animal data, we showed that the unexpected omission of (painful) electrical stimulation triggers activations within key regions of the reward and salience pathways and that these activations correlate with the pleasantness of the reported relief. Furthermore, by parametrically violating participants' probability and intensity related expectations of the upcoming stimulation, we showed for the first time in humans that omission-related activations in the VTA/SN were stronger following omissions of more probable and intense stimulations, like a positive reward PE signal. Together, our findings provide additional support for an overlap in the neural processing of absent danger and rewards in humans.

Current State of the Neuroscience of Fear Extinction and Its Relevance to Anxiety Disorders

The elucidation of the functional neuroanatomy of human fear, or threat, extinction has started in the 2000s by a series of enthusiastically greeted functional magnetic resonance imaging (fMRI) studies that were able to translate findings from rodent research about an involvement of the ventromedial prefrontal cortex (vmPFC) and the hippocampus in fear extinction into human models. Enthusiasm has been painfully dampened by a meta-analysis of human fMRI studies by Fullana and colleagues in 2018 who showed that activation in these areas is inconsistent, sending shock waves through the extinction research community. The present review guides readers from the field (as well as non-specialist readers desiring safe knowledge about human extinction mechanisms) during a series of exposures with corrective information. New information about extinction-related brain activation not considered by Fullana et al. will also be presented. After completion of this exposure-based fear reduction program, readers will trust that the reward learning system, the cerebellum, the vmPFC, the hippocampus, and a wider brain network are involved in human fear extinction, along with the neurotransmitters dopamine and noradrenaline. Specific elements of our exposure program include exploitation of the temporal dynamics of extinction, of the spatial heterogeneity of extinction-related brain activation, of functional connectivity methods, and of large sample sizes. Implications of insights from studies in healthy humans for the understanding and treatment of anxiety-related disorders are discussed.

Event Segmentation Promotes the Reorganization of Emotional Memory

Event boundaries help structure the content of episodic memories by segmenting continuous experiences into discrete events. Event boundaries may also serve to preserve meaningful information within an event, thereby actively separating important memories from interfering representations imposed by past and future events. Here, we tested the hypothesis that event boundaries organize emotional memory based on changing dynamics as events unfold. We developed a novel threat-reversal learning task whereby participants encoded trial-unique exemplars from two semantic categories across three phases: preconditioning, fear acquisition, and reversal. Shock contingencies were established for one category during acquisition (CS+) and then switched to the other during reversal (CS-). Importantly, reversal was either separated by a perceptible event boundary (Experiment 1) or occurred immediately after acquisition, with no perceptible context shift (Experiment 2). In a surprise recognition memory test the next day, memory performance tracked the learning contingencies from encoding in Experiment 1, such that participants selectively recognized more threat-associated CS+ exemplars from before (retroactive) and during acquisition, but this pattern reversed toward CS- exemplars encoded during reversal. By contrast, participants with continuous encoding-without a boundary between conditioning and reversal-exhibited undifferentiated memory for exemplars from both categories encoded before acquisition and after reversal. Further analyses highlight nuanced effects of event boundaries on reversing conditioned fear, updating mnemonic generalization, and emotional biasing of temporal source memory. These findings suggest that event boundaries provide anchor points to organize memory for distinctly meaningful information, thereby adaptively structuring memory based on the content of our experiences.

Dopaminergic circuits controlling threat and safety learning

The ability to learn from experience that certain cues and situations are associated with threats or safety is crucial for survival and adaptive behavior. Understanding the neural substrates of threat and safety learning has high clinical significance because deficits in these forms of learning characterize anxiety disorders. Traditionally, dopamine neurons were thought to uniformly support reward learning by signaling reward prediction errors. However, the dopamine system is functionally more diverse than was initially appreciated and is also critical for processing threat and safety. In this review, I highlight recent studies demonstrating that dopamine neurons generate prediction errors for threat and safety, and describe how dopamine projections to the amygdala, medial prefrontal cortex (mPFC), and striatum regulate associative threat and safety learning.

Nicotine reduces discrimination between threat and safety in the hippocampus, nucleus accumbens and amygdala

Nicotine intake is linked to the maintenance and development of anxiety disorders and impairs adaptive discrimination of threat and safety in rodents and humans. Yet, it is unclear if nicotine exerts a causal pharmacological effect on the affective and neural mechanisms that underlie aversive learning. We conducted a pre-registered, pseudo-randomly and double-blinded pharmacological fMRI study to investigate the effect of acute nicotine on Fear Acquisition and Extinction in non-smokers (n = 88). Our results show that nicotine administration led to decreased discrimination between threat and safety in subjective fear. Nicotine furthermore decreased differential (threat vs. safety) activation in the hippocampus, which was functionally coupled with Nucleus Accumbens and amygdala, compared to placebo controls. Additionally, nicotine led to enhanced physiological arousal to learned threats and overactivation of the ventral tegmental area. This study provides mechanistic evidence that single doses of nicotine impair neural substrates of adaptive aversive learning in line with the risk for the development of pathological anxiety.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Fear extinction rescuing effects of dopamine and L-DOPA in the ventromedial prefrontal cortex

The ventromedial prefrontal cortex (vmPFC; rodent infralimbic cortex (IL)), is posited to be an important locus of fear extinction-facilitating effects of the dopamine (DA) bio-precursor, L-DOPA, but this hypothesis remains to be formally tested. Here, in a model of impaired fear extinction (the 129S1/SvImJ inbred mouse strain; S1), we monitored extracellular DA dynamics via in vivo microdialysis in IL during fear extinction and following L-DOPA administration. Systemic L-DOPA caused sustained elevation of extracellular DA levels in IL and increased neuronal activation in a subpopulation of IL neurons. Systemic L-DOPA enabled extinction learning and promoted extinction retention at one but not ten days after training. Conversely, direct microinfusion of DA into IL produced long-term fear extinction (an effect that was insensitive to ɑ-/ß-adrenoreceptor antagonism). However, intra-IL delivery of a D1-like or D2 receptor agonist did not facilitate extinction. Using ex vivo multi-electrode array IL neuronal recordings, along with ex vivo quantification of immediate early genes and DA receptor signalling markers in mPFC, we found evidence of reduced DA-evoked mPFC network responses in S1 as compared with extinction-competent C57BL/6J mice that were partially driven by D1 receptor activation. Together, our data demonstrate that locally increasing DA in IL is sufficient to produce lasting rescue of impaired extinction. The finding that systemic L-DOPA increased IL DA levels, but had only transient effects on extinction, suggests L-DOPA failed to reach a threshold level of IL DA or produced opposing behavioural effects in other brain regions. Collectively, our findings provide further insight into the neural basis of the extinction-promoting effects of DA and L-DOPA in a clinically relevant animal model, with possible implications for therapeutically targeting the DA system in anxiety and trauma-related disorders.

Prefrontal Dopamine in Flexible Adaptation to Environmental Changes: A Game for Two Players

Deficits in cognitive flexibility have been characterized in affective, anxiety, and neurodegenerative disorders. This paper reviews data, mainly from studies on animal models, that support the existence of a cortical-striatal brain circuit modulated by dopamine (DA), playing a major role in cognitive/behavioral flexibility. Moreover, we reviewed clinical findings supporting misfunctioning of this circuit in Parkinson's disease that could be responsible for some important non-motoric symptoms. The reviewed findings point to a role of catecholaminergic transmission in the medial prefrontal cortex (mpFC) in modulating DA's availability in the nucleus accumbens (NAc), as well as a role of NAc DA in modulating the motivational value of natural and conditioned stimuli. The review section is accompanied by a preliminary experiment aimed at testing weather the extinction of a simple Pavlovian association fosters increased DA transmission in the mpFC and inhibition of DA transmission in the NAc.

Closed-loop brain stimulation augments fear extinction in male rats

Dysregulated fear reactions can result from maladaptive processing of trauma-related memories. In post-traumatic stress disorder (PTSD) and other psychiatric disorders, dysfunctional extinction learning prevents discretization of trauma-related memory engrams and generalizes fear responses. Although PTSD may be viewed as a memory-based disorder, no approved treatments target pathological fear memory processing. Hippocampal sharp wave-ripples (SWRs) and concurrent neocortical oscillations are scaffolds to consolidate contextual memory, but their role during fear processing remains poorly understood. Here, we show that closed-loop, SWR triggered neuromodulation of the medial forebrain bundle (MFB) can enhance fear extinction consolidation in male rats. The modified fear memories became resistant to induced recall (i.e., 'renewal' and 'reinstatement') and did not reemerge spontaneously. These effects were mediated by D2 receptor signaling-induced synaptic remodeling in the basolateral amygdala. Our results demonstrate that SWR-triggered closed-loop stimulation of the MFB reward system enhances extinction of fearful memories and reducing fear expression across different contexts and preventing excessive and persistent fear responses. These findings highlight the potential of neuromodulation to augment extinction learning and provide a new avenue to develop treatments for anxiety disorders.

Neural correlates of immediate versus delayed extinction when simultaneously varying the time of the test in humans

Anxiety disorders are effectively treated with exposure therapy based on the extinction of Pavlovian fear conditioning. Animal research indicates that both the timing of extinction and test are important factors to reduce the return of fear. However, empirical evidence in humans is incomplete and inconsistent. In this neuroimaging study, we, therefore, tested 103 young, healthy participants in a 2-factorial between-subjects design with the factors extinction group (immediate, delayed) and test group (+1 day and +7 days). Immediate extinction led to greater retention of fear memory at the beginning of extinction training indicated by increased skin conductance responses. A return of fear was observed in both extinction groups, with a trend toward a greater return of fear in immediate extinction. The return of fear was generally higher in groups with an early test. Neuroimaging results show successful cross-group fear acquisition and retention, as well as activation of the left nucleus accumbens during extinction training. Importantly, the delayed extinction group showed a larger bilateral nucleus accumbens activation during test. This nucleus accumbens finding is discussed in terms of salience, contingency, relief, and prediction error processing. It may imply that the delayed extinction group benefits more from the test as a new learning opportunity.

Alleviating anxiety and taming trauma: Novel pharmacotherapeutics for anxiety disorders and posttraumatic stress disorder

Psychiatric disorders associated with psychological trauma, stress and anxiety are a highly prevalent and increasing cause of morbidity worldwide. Current therapeutic approaches, including medication, are effective in alleviating symptoms of anxiety disorders and posttraumatic stress disorder (PTSD), at least in some individuals, but have unwanted side-effects and do not resolve underlying pathophysiology. After a period of stagnation, there is renewed enthusiasm from public, academic and commercial parties in designing and developing drug treatments for these disorders. Here, we aim to provide a snapshot of the current state of this field that is written for neuropharmacologists, but also practicing clinicians and the interested lay-reader. After introducing currently available drug treatments, we summarize recent/ongoing clinical assessment of novel medicines for anxiety and PTSD, grouped according to primary neurochemical targets and their potential to produce acute and/or enduring therapeutic effects. The evaluation of putative treatments targeting monoamine (including psychedelics), GABA, glutamate, cannabinoid, cholinergic and neuropeptide systems, amongst others, are discussed. We emphasize the importance of designing and clinically assessing new medications based on a firm understanding of the underlying neurobiology stemming from the rapid advances being made in neuroscience. This includes harnessing neuroplasticity to bring about lasting beneficial changes in the brain rather than - as many current medications do - produce a transient attenuation of symptoms, as exemplified by combining psychotropic/cognitive enhancing drugs with psychotherapeutic approaches. We conclude by noting some of the other emerging trends in this promising new phase of drug development.

Acquisition of threat responses are associated with elevated plasma concentration of endocannabinoids in male humans

Endocannabinoids (eCBs) are involved in buffering threat and stress responses. Elevation of circulating eCBs in humans was reported to strengthen inhibition (i.e., extinction) of threat responses and to reduce effects of stressors. However, it remains unclear whether the acquisition of threat responses involves a physiological change in circulating eCBs. Here, we demonstrate in male human volunteers that the plasma concentration of the eCB N-arachidonoylethanolamine (AEA) and its metabolite arachidonic acid (AA) are increased during acquisition of threat responses. Furthermore, elevated responses to a learned threat cue (e.g., rating of fear) were associated with individual increases in plasma concentration of the eCB 2-arachidonoylglycerol (2-AG). In complementing these observations, we found individual increases in AEA associated with elevated neural responses during threat learning in the amygdala. Our results thereby suggest that physiological increases in circulating eCB levels are part of a response mechanism to learned threats.

The neurobiology of Pavlovian safety learning: Towards an acquisition-expression framework

Safety learning creates associations between conditional stimuli and the absence of threat. Studies of human fear conditioning have accumulated evidence for the neural signatures of safety over various paradigms, aligning on several common brain systems. While these systems are often interpreted as underlying safety learning in a generic sense, they may instead reflect the expression of learned safety, pertaining to processes of fear inhibition, positive affect, and memory. Animal models strongly suggest these can be separable from neural circuits implicated in the conditioning process itself (or safety acquisition). While acquisition-expression distinctions are ubiquitous in behavioural science, this lens has not been applied to safety learning, which remains a novel area in the field. In this mini-review, we overview findings from prevalent safety paradigms in humans, and synthesise these with insights from animal models to propose that the neurobiology of safety learning be conceptualised along an acquisition-expression model, with the aim of stimulating richer brain-based characterisations of this important process.

Asymmetric representation of aversive prediction errors in Pavlovian threat conditioning

Survival in biological environments requires learning associations between predictive sensory cues and threatening outcomes. Such aversive learning may be implemented through reinforcement learning algorithms that are driven by the signed difference between expected and encountered outcomes, termed prediction errors (PEs). While PE-based learning is well established for reward learning, the role of putative PE signals in aversive learning is less clear. Here, we used functional magnetic resonance imaging in humans (21 healthy men and women) to investigate the neural representation of PEs during maintenance of learned aversive associations. Four visual cues, each with a different probability (0, 33, 66, 100%) of being followed by an aversive outcome (electric shock), were repeatedly presented to participants. We found that neural activity at omission (US-) but not occurrence of the aversive outcome (US+) encoded PEs in the medial prefrontal cortex. More expected omission of aversive outcome was associated with lower neural activity. No neural signals fulfilled axiomatic criteria, which specify necessary and sufficient components of PE signals, for signed PE representation in a whole-brain search or in a-priori regions of interest. Our results might suggest that, different from reward learning, aversive learning does not involve signed PE signals that are represented within the same brain region for all conditions.

Cortico-Striatal Activity Characterizes Human Safety Learning via Pavlovian Conditioned Inhibition

Safety learning generates associative links between neutral stimuli and the absence of threat, promoting the inhibition of fear and security-seeking behaviors. Precisely how safety learning is mediated at the level of underlying brain systems, particularly in humans, remains unclear. Here, we integrated a novel Pavlovian conditioned inhibition task with ultra-high field (7 Tesla) fMRI to examine the neural basis of safety learning in 49 healthy participants. In our task, participants were conditioned to two safety signals: a conditioned inhibitor that predicted threat omission when paired with a known threat signal (A+/AX-), and a standard safety signal that generally predicted threat omission (BC-). Both safety signals evoked equivalent autonomic and subjective learning responses but diverged strongly in terms of underlying brain activation (PFDR whole-brain corrected). The conditioned inhibitor was characterized by more prominent activation of the dorsal striatum, anterior insular, and dorsolateral PFC compared with the standard safety signal, whereas the latter evoked greater activation of the ventromedial PFC, posterior cingulate, and hippocampus, among other regions. Further analyses of the conditioned inhibitor indicated that its initial learning was characterized by consistent engagement of dorsal striatal, midbrain, thalamic, premotor, and prefrontal subregions. These findings suggest that safety learning via conditioned inhibition involves a distributed cortico-striatal circuitry, separable from broader cortical regions involved with processing standard safety signals (e.g., CS-). This cortico-striatal system could represent a novel neural substrate of safety learning, underlying the initial generation of "stimulus-safety" associations, distinct from wider cortical correlates of safety processing, which facilitate the behavioral outcomes of learning.SIGNIFICANCE STATEMENT Identifying safety is critical for maintaining adaptive levels of anxiety, but the neural mechanisms of human safety learning remain unclear. Using 7 Tesla fMRI, we compared learning-related brain activity for a conditioned inhibitor, which actively predicted threat omission, and a standard safety signal (CS-), which was passively unpaired with threat. The inhibitor engaged an extended circuitry primarily featuring the dorsal striatum, along with thalamic, midbrain, and premotor/PFC regions. The CS- exclusively involved cortical safety-related regions observed in basic safety conditioning, such as the vmPFC. These findings extend current models to include learning-specific mechanisms for encoding stimulus-safety associations, which might be distinguished from expression-related cortical mechanisms. These insights may suggest novel avenues for targeting dysfunctional safety learning in psychopathology.

Anhedonia in Anxiety Disorders

Humans, like other animals, are fundamentally motivated to pursue rewarding outcomes and avoid aversive ones. Anxiety disorders are conceptualized, defined, and treated based on heightened sensitivity to perceived aversive outcomes, including imminent threats as well as those that are uncertain yet could occur in the future. Avoidance is the central strategy used to mitigate anticipated aversive outcomes - often at the cost of sacrificing potential rewards and hindering people from obtaining desired outcomes. It is for these reasons that people are often motivated to seek treatment. In this chapter, we consider whether and how anhedonia - the loss of interest in pursuing and/or reduced responsiveness to rewarding outcomes - may serve as a barrier to recovering from clinically impairing anxiety. Increasingly recognized as a prominent symptom in many individuals with elevated anxiety, anhedonia is not explicitly considered within prevailing theoretical models or treatment approaches of anxiety. Our goal, therefore, is to review what is known about anhedonia within the anxiety disorders and then integrate this knowledge into a functional perspective to consider how anhedonia could maintain anxiety and limit treatment response. Our overarching thesis is that anhedonia disrupts the key processes that are central to supporting anxiety recovery. We end this chapter by considering how explicitly targeting anhedonia in treatment can optimize outcomes for anxiety disorders.