How instructions shape aversive learning: higher order knowledge, reversal learning, and the role of the amygdala

Contingency Reversal in Conditioned Fear Learning: The Moderated Mediation Model of Intolerance of Uncertainty and Instruction

Objective

The study aimed to examine the roles of anxiety and intolerance of uncertainty (IU) in conditioned fear learning under an uncertain context induced by the contingency reversal of the association between the conditioned stimulus and the unconditioned stimulus (CS-US).

Methods

The study sample comprised 53 participants, randomly divided into two groups: a non-instruction group and an instruction group. The experimental procedure encompassed five stages: pre-acquisition, acquisition, generalization, reversal acquisition, and reversal generalization. Our study primarily focused on analyzing a moderated mediation model.

Results

In the instructed group, we observed that the reversed fear generalization response was directly influenced by the pre-reversal fear generalization response, while also being indirectly mediated by the IU factor. However, in the non-instructed group, we did not find a significant mediating effect of IU. Moreover, we noted that the mediation of IU was contingent on the instructional information. It is noteworthy that anxiety did not exhibit a discernible role in conditioned fear within the uncertainty condition in our study.

Conclusion

The findings provide novel insights into fear-related phenomena, emphasizing the intricate interplay between individual traits and fear generalization under conditions of uncertainty. They contribute to understanding the mechanisms of emotional and cognitive interactions in uncertain conditions.

Human ventromedial prefrontal cortex lesions enhance the effect of expectations on pain perception

Pain is strongly modulated by expectations and beliefs. Across species, subregions of ventromedial prefrontal cortex (VMPFC) are implicated in a variety of functions germane to pain, predictions, and learning. Human fMRI studies show that VMPFC activity tracks expectations about pain and mediates expectancy effects on pain-related activity in other brain regions. Prior lesion studies suggest that VMPFC may instead play a more general role in generating affective responses to painful stimuli. To test whether VMPFC is required to generate affective responses to pain or is more specifically involved in expectancy-based pain modulation, we studied responses to heat stimuli in five adults with bilateral surgical lesions of VMPFC and twenty healthy adults without brain damage. All participants underwent a quantitative sensory testing procedure followed by a pain expectancy task in which cues predicting either low or high pain were followed by intermittent medium intensity heat stimuli. Compared to adults without brain damage, individuals with VMPFC lesions reported larger differences in expected pain based on predictive cues and failed to update expectations following the covert introduction of unexpected medium temperature stimuli. Consistent with observed expectancy differences, subjective pain unpleasantness ratings in the VMPFC lesion group were more strongly modulated by cue during thermal stimulation. We found no group differences in overall pain sensitivity, nor in relationships between pain and autonomic arousal, suggesting that VMPFC damage specifically enhances the effect of expectations on pain processing, likely driven by impaired integration of new sensory feedback to update expectations about pain. These results provide essential new data regarding the specific functional contribution of VMPFC to pain modulation.

Effects of Experiencing CS-US Pairings on Instructed Fear Reversal

Fear learning allows us to identify and anticipate aversive events and adapt our behavior accordingly. This is often thought to rely on associative learning mechanisms where an initially neutral conditioned stimulus (CS) is repeatedly paired with an aversive unconditioned stimulus (US), eventually leading to the CS also being perceived as aversive and threatening. Importantly, however, humans also show verbal fear learning. Namely, they have the ability to change their responses to stimuli rapidly through verbal instructions about CS-US pairings. Past research on the link between experience-based and verbal fear learning indicated that verbal instructions about a reversal of CS-US pairings can fully override the effects of previously experienced CS-US pairings, as measured through fear ratings, skin conductance, and fear-potentiated startle. However, it remains an open question whether such instructions can also annul learned CS representations in the brain. Here, we used a fear reversal paradigm (female and male participants) in conjunction with representational similarity analysis of fMRI data to test whether verbal instructions fully override the effects of experienced CS-US pairings in fear-related brain regions or not. Previous research suggests that only the right amygdala should show lingering representations of previously experienced threat ("pavlovian trace"). Unexpectedly, we found evidence for the residual effect of prior CS-US experience to be much more widespread than anticipated, in the amygdala but also cortical regions like the dorsal anterior cingulate or dorsolateral prefrontal cortex. This finding shines a new light on the interaction of different fear learning mechanisms, at times with unexpected consequences.SIGNIFICANCE STATEMENT Humans are able to learn about aversive stimuli both from experience (i.e., repeated pairings of conditioned stimulus (CS) and unconditioned stimulus (US; pavlovian conditioning), and from verbal instructions about stimulus pairings. Understanding how experience-based and verbal learning processes interact is key for understanding the cognitive and neural underpinnings of fear learning. We tested whether prior aversive experiences (CS-US pairings) affected subsequent verbal learning, searching for lingering threat signals after verbal instructions reversed a CS from being threatening to being safe. While past research suggested such threat signals can only be found in the amygdala, we found evidence to be much more widespread, including the medial and lateral PFC. This highlights how experience-based and verbal learning processes interact to support adaptive behavior.

Temporal dynamics of the semantic versus affective representations of valence during reversal learning

Valence, the representation of a stimulus in terms of good or bad, plays a central role in models of affect, value-based learning theories, and value-based decision-making models. Previous work used Unconditioned Stimulus (US) to support a theoretical division between two different types of valence representations for a stimulus: the semantic representation of valence, i.e., stored accumulated knowledge about the value of the stimulus, and the affective representation of valence, i.e., the valence of the affective response to this stimulus. The current work extended past research by using a neutral Conditioned Stimulus (CS) in the context of reversal learning, a type of associative learning. The impact of expected uncertainty (the variability of rewards) and unexpected uncertainty (reversal) on the evolving temporal dynamics of the two types of valence representations of the CS was tested in two experiments. Results show that in an environment presenting the two types of uncertainty, the adaptation process (learning rate) of the choices and of the semantic valence representation is slower than the adaptation of the affective valence representation. In contrast, in environments with only unexpected uncertainty (i.e., fixed rewards), there is no difference in the temporal dynamics of the two types of valence representations. Implications for models of affect, value-based learning theories, and value-based decision-making models are discussed.

A partner's smile is not per se a safety signal: Psychophysiological response patterns to instructed threat and safety

Recent studies on fear conditioning and pain perception suggest that pictures of loved ones (e.g., a romantic partner) may serve as a prepared safety cue that is less likely to signal aversive events. Challenging this view, we examined whether pictures of smiling or angry loved ones are better safety or threat cues. To this end, 47 healthy participants were verbally instructed that specific facial expressions (e.g., happy faces) cue threat of electric shocks and others cue safety (e.g., angry faces). When facial images served as threat cues, they elicited distinct psychophysiological defensive responses (e.g., increased threat ratings, startle reflex, and skin conductance responses) compared to viewing safety cues. Interestingly, instructed threat effects occurred regardless of the person who cued shock threat (partner vs. unknown) and their facial expression (happy vs. angry). Taken together, these results demonstrate the flexible nature of facial information (i.e., facial expression and facial identity) to be easily learned as signals for threat or safety, even when showing loved ones.

Irrelevant Threats Linger and Affect Behavior in High Anxiety

Threat-related information attracts attention and disrupts ongoing behavior, and particularly so for more anxious individuals. Yet, it is unknown how and to what extent threat-related information leave lingering influences on behavior (e.g., by impeding ongoing learning processes). Here, human male and female participants (N = 47) performed probabilistic reinforcement learning tasks where irrelevant distracting faces (neutral, happy, or fearful) were presented together with relevant monetary feedback. Behavioral modeling was combined with fMRI data (N = 27) to explore the neurocomputational bases of learning relevant and irrelevant information. In two separate studies, individuals with high trait anxiety showed increased avoidance of objects previously paired with the combination of neutral monetary feedback and fearful faces (but not neutral or happy faces). Behavioral modeling revealed that high anxiety increased the integration of fearful faces during feedback learning, and fMRI results (regarded as provisional, because of a relatively small sample size) further showed that variance in the prediction error signal, uniquely accounted for by fearful faces, correlated more strongly with activity in the right DLPFC for more anxious individuals. Behavioral and neuronal dissociations indicated that the threat-related distractors did not simply disrupt learning processes. By showing that irrelevant threats exert long-lasting influences on behavior, our results extend previous research that separately showed that anxiety increases learning from aversive feedbacks and distractibility by threat-related information. Our behavioral results, combined with the proposed neurocomputational mechanism, may help explain how increased exposure to irrelevant affective information contributes to the acquisition of maladaptive behaviors in more anxious individuals.SIGNIFICANCE STATEMENT In modern-day society, people are increasingly exposed to various types of irrelevant information (e.g., intruding social media announcements). Yet, the neurocomputational mechanisms influenced by irrelevant information during learning, and their interactions with increasingly distracted personality types are largely unknown. Using a reinforcement learning task, where relevant feedback is presented together with irrelevant distractors (emotional faces), we reveal an interaction between irrelevant threat-related information (fearful faces) and interindividual anxiety levels. fMRI shows provisional evidence for an interaction between anxiety levels and the coupling between activity in the DLPFC and learning signals specifically elicited by fearful faces. Our study reveals how irrelevant threat-related information may become entrenched in the anxious psyche and contribute to long-lasting abnormal behaviors.

Associations between anxiety, centromedial amygdala volume, and complex verbal fluency in middle-aged to older adults

Symptoms of anxiety are related to decreases in cognitive performance in middle-aged to older adults (i.e., ages 50 and older; MOA). Verbal fluency (VF), assessed with the Delis-Kaplan Executive Function System (D-KEFS) Category Switching (VF-CS) task, captures elements of executive function such as semantic memory, response initiation and inhibition, and cognitive flexibility. The present study examined the link between anxiety symptoms and VF-CS to better understand how this association affects such executive functions in MOA. We hypothesized that higher subclinical Beck Anxiety Inventory (BAI) scores would be associated with lower VF-CS. To further investigate the underlying neurobiological basis of an expected inverse relationship, total amygdala volume, centromedial amygdala (CMA) volume, and basolateral amygdala (BLA) volume were examined as they related to VF-CS scores on the D-KEFS. Based on extant research on connectivity and functioning between the CMA and BLA, we hypothesized that larger BLA volumes would be associated with lower anxiety scores and exhibit positive relationships with VF-CS. A sample of 63 MOA were recruited from the Providence, Rhode Island area as a part of a parent study on cardiovascular diseases. Participants completed self-report measures about physical and emotional health, a neuropsychological assessment, and a magnetic resonance imaging scan (MRI). Multiple hierarchical regressions were performed to examine relationships between variables of interest. Contrary to hypotheses, no significant relationship emerged between VF-CS and BAI scores, and BLA volume was not associated with either BAI scores or VF-CS. However, a significant positive relationship was observed between CMA volume and VF-CS. The significant relationship found between CMA and VF-CS may reflect the upward slope of the quadratic relationship between arousal and cognitive performance on the Yerkes-Dodson curve. These findings newly implicate CMA volume specifically as a possible neuromarker linking emotional arousal and cognitive performance in MOA.

Instructions and experiential learning have similar impacts on pain and pain-related brain responses but produce dissociations in value-based reversal learning

Recent data suggest that interactions between systems involved in higher order knowledge and associative learning drive responses during value-based learning. However, it is unknown how these systems impact subjective responses, such as pain. We tested how instructions and reversal learning influence pain and pain-evoked brain activation. Healthy volunteers (n=40) were either instructed about contingencies between cues and aversive outcomes or learned through experience in a paradigm where contingencies reversed three times. We measured predictive cue effects on pain and heat-evoked brain responses using functional magnetic resonance imaging. Predictive cues dynamically modulated pain perception as contingencies changed, regardless of whether participants received contingency instructions. Heat-evoked responses in the insula, anterior cingulate, and other regions updated as contingencies changed, and responses in the prefrontal cortex mediated dynamic cue effects on pain, whereas responses in the brainstem’s rostroventral medulla (RVM) were shaped by initial contingencies throughout the task. Quantitative modeling revealed that expected value was shaped purely by instructions in the Instructed Group, whereas expected value updated dynamically in the Uninstructed Group as a function of error-based learning. These differences were accompanied by dissociations in the neural correlates of value-based learning in the rostral anterior cingulate, thalamus, and posterior insula, among other regions. These results show how predictions dynamically impact subjective pain. Moreover, imaging data delineate three types of networks involved in pain generation and value-based learning: those that respond to initial contingencies, those that update dynamically during feedback-driven learning as contingencies change, and those that are sensitive to instruction. Together, these findings provide multiple points of entry for therapies designs to impact pain.

Aversive anticipations modulate electrocortical correlates of decision-making and reward reversal learning, but not behavioral performance

Predicting the consequences of one’s own decisions is crucial for organizing future behavior. However, when reward contingencies vary frequently, flexible adaptation of decisions is likely to depend on the situation. We examined the effects of an instructed threat context on choice behavior (i.e., reversal learning) and its electrocortical correlates. In a probabilistic decision-making task, 30 participants had to choose between two options that were either contingent on monetary gains or losses. Reward contingencies were reversed after reaching a probabilistic threshold. Decision-making and reversal learning were examined with two contextual background colors, which were instructed as signals for threat-of-shock or safety. Self-report data confirmed the threat context as more unpleasant, arousing, and threatening relative to safety condition. However, against our expectations, behavioral performance was comparable during the threat and safety conditions (i.e., errors-to-criterion, number of reversal, error rates, and choice times). Regarding electrocortical activity, feedback processing changed throughout the visual processing stream. The feedback-related negativity (FRN) reflected expectancy-driven processing (unexpected vs. congruent losses and gains), and the threat-selective P3 component revealed non-specific discrimination of gains vs. losses. Finally, the late positive potentials (LPP) showed strongly valence-specific processing (unexpected and congruent losses vs. gains). Thus, regardless of contextual threat, early and late cortical activity reflects an attentional shift from expectation- to outcome-based feedback processing. Findings are discussed in terms of reward, threat, and reversal-learning mechanisms with implications for emotion regulation and anxiety disorders.

Validación cognitiva de un protocolo instruccional de reexperimentación emocional en adultos víctimas de violencia política en Colombia

La reexperimentación emocional (re) permite dar sentido a hechos traumáticos o estresantes mediante un proceso dirigido por instrucciones verbales o escritas, y por ello puede generar beneficios en el bienestar psicológico y la salud física autoinformada. El objetivo del presente estudio fue evaluar la comprensión de tres tipos de instrucciones experimentales (re tradicional, re con claves de aceptación y compromiso, y re psicosocial) y una instrucción para el grupo control (re trivial), mediante técnicas de validación cognitiva (pruebas centradas en el significado y verbalización de pensamiento) en personas expuestas a hechos de violencia política en Colombia. Para ello, se desarrolló un estudio de tipo cualitativo con corte instrumental, en el que se entrevistó a 42 colombianos víctimas de violencia política, en su mayoría mujeres, elegidos con un muestro por conveniencia. Las entrevistas fueron transcritas y codificadas mediante un análisis categorial mixto que tomó como referente procedimientos del Movimiento de Aspectos Cognitivos de la Metodología de Encuestas. Como resultado, los participantes comprendieron de manera diferencial las instrucciones dadas en cada protocolo, enfocándose en aspectos como el contexto sociopolítico en el caso del protocolo psicosocial, y en respuestas asociadas a la aceptación en el protocolo con claves de aceptación y compromiso. Se identificaron dificultades en la comprensión de algunas secciones de los protocolos, las cuales fueron ajustadas. Finalmente, se enfatiza la importancia de implementar técnicas de validación cognitiva para verificar la comprensión de instrucciones, protocolos o instrumentos, dado que el desempeño de los participantes y la calidad de las medidas de las intervenciones pueden verse afectados por la comprensión e interpretación de las instrucciones propuestas.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Rating expectations can slow aversive reversal learning

The process of learning allows organisms to develop predictions about outcomes in the environment, and learning is sensitive to both simple associations and higher order knowledge. However, it is unknown whether consciously attending to expectations shapes the learning process itself. Here, we directly tested whether rating expectations shapes arousal during classical conditioning. Participants performed an aversive learning paradigm wherein one image (CS+) was paired with shock on 50% of trials, while a second image (CS-) was never paired with shock. Halfway through the task, contingencies reversed. One group of participants rated the probability of upcoming shock on each trial, while the other group made no online ratings. We measured skin conductance response (SCR) evoked in response to the CS and used traditional analyses as well as quantitative models of reinforcement learning to test whether rating expectations influenced arousal and aversive reversal learning. Participants who provided online expectancy ratings displayed slower learning based on a hybrid model of adaptive learning and reduced reversal of SCR relative to those who did not rate expectations. Mediation analysis revealed that the effect of associative learning on SCR could be fully explained through its effects on subjective expectancy within the group who provided ratings. This suggests that the act of rating expectations reduces the speed of learning, likely through changes in attention, and that expectations directly influence arousal. Our findings indicate that higher order expectancy judgments can alter associative learning.

A social affective neuroscience lens on placebo analgesia

Pain is a fundamental experience that promotes survival. In humans, pain stands at the intersection of multiple health crises: chronic pain, the opioid epidemic, and health disparities. The study of placebo analgesia highlights how social, cognitive, and affective processes can directly shape pain, and identifies potential paths for mitigating these crises. This review examines recent progress in the study of placebo analgesia through affective science. It focuses on how placebo effects are shaped by expectations, affect, and the social context surrounding treatment, and discusses neurobiological mechanisms of placebo, highlighting unanswered questions and implications for health. Collaborations between clinicians and social and affective scientists can address outstanding questions and leverage placebo to reduce pain and improve human health.

How social learning amplifies moral outrage expression in online social networks

Moral outrage shapes fundamental aspects of social life and is now widespread in online social networks. Here, we show how social learning processes amplify online moral outrage expressions over time. In two preregistered observational studies on Twitter (7331 users and 12.7 million total tweets) and two preregistered behavioral experiments (N = 240), we find that positive social feedback for outrage expressions increases the likelihood of future outrage expressions, consistent with principles of reinforcement learning. In addition, users conform their outrage expressions to the expressive norms of their social networks, suggesting norm learning also guides online outrage expressions. Norm learning overshadows reinforcement learning when normative information is readily observable: in ideologically extreme networks, where outrage expression is more common, users are less sensitive to social feedback when deciding whether to express outrage. Our findings highlight how platform design interacts with human learning mechanisms to affect moral discourse in digital public spaces.

The role of intolerance of uncertainty in classical threat conditioning: Recent developments and directions for future research

Intolerance of uncertainty (IU), the tendency to find uncertainty aversive, is an important transdiagnostic dimension in mental health disorders. Over the last decade, there has been a surge of research on the role of IU in classical threat conditioning procedures, which serve as analogues to the development, treatment, and relapse of anxiety, obsessive-compulsive, and trauma- and stressor-related disorders. This review provides an overview of the existing literature on IU in classical threat conditioning procedures. The review integrates findings based on the shared or discrete parameters of uncertainty embedded within classical threat conditioning procedures. Under periods of unexpected uncertainty, where threat and safety contingencies change, high IU, over other self-reported measures of anxiety, is specifically associated with poorer threat extinction learning and retention, as well as overgeneralisation. Under periods of estimation and expected uncertainty, where the parameters of uncertainty are being learned or have been learned, such as threat acquisition training and avoidance learning, the findings are mixed for IU. These findings provide evidence that individual differences in IU play a significant role in maintaining learned fear and anxiety, particularly under volatile environments. Recommendations for future research are outlined, with discussion focusing on how parameters of uncertainty can be better defined to capture how IU is involved in the maintenance of learned fear and anxiety. Such work will be crucial for understanding the role of IU in neurobiological models of uncertainty-based maintenance of fear and anxiety and inform translational work aiming to improve the diagnosis and treatment of relevant psychopathology.

Verbal threat learning does not spare loved ones

Significant others provide individuals with a sense of safety and security. However, the mechanisms that underlie attachment-induced safety are hardly understood. Recent research has shown beneficial effects when viewing pictures of the romantic partner, leading to reduced pain experience and defensive responding. Building upon this, we examined the inhibitory capacity of loved face pictures on fear learning in an instructed threat paradigm. Pictures of loved familiar or unknown individuals served as signals for either threat of electric shocks or safety, while a broad set of psychophysiological measures was recorded. We assumed that a long-term learning history of beneficial relations interferes with social threat learning. Nevertheless, results yielded a typical pattern of physiological defense activation towards threat cues, regardless of whether threat was signaled by an unknown or a loved face. These findings call into question the notion that pictures of loved individuals are shielded against becoming threat cues, with implications for attachment and trauma research.

Evidence for a minimal role of stimulus awareness in reversal of threat learning

In an ever-changing environment, survival depends on learning which stimuli represent threat, and also on updating such associations when circumstances shift. It has been claimed that humans can acquire physiological responses to threat-associated stimuli even when they are unaware of them, but the role of awareness in updating threat contingencies remains unknown. This complex process-generating novel responses while suppressing learned ones-relies on distinct neural mechanisms from initial learning, and has only been shown with awareness. Can it occur unconsciously? Here, we present evidence that threat reversal may not require awareness. Participants underwent classical threat conditioning to visual stimuli that were suppressed from awareness. One of two images was paired with an electric shock; halfway through the experiment, contingencies were reversed and the shock was paired with the other image. Despite variations in suppression across participants, we found that physiological responses reflected changes in stimulus-threat pairings independently of stimulus awareness. These findings suggest that unconscious affective processing may be sufficiently flexible to adapt to changing circumstances.

Behavioral and Physiological Evidence Challenges the Automatic Acquisition of Evaluations

Dual-learning theories of evaluations posit that evaluations can be automatically (i.e., efficiently, unconsciously, uncontrollably, and involuntarily) acquired. They also often assume the existence of evaluative-learning processes that are impervious to verbal information. In this article, we explain that recent research challenges both assertions for three categories of measures: explicit evaluative measures, implicit evaluative measures, and physiological measures of fear. In doing so, we also question the widespread assumption that implicit (i.e., typically behavioral and physiological) compared with explicit (i.e., self-reported) evaluative measures are indicative of the way evaluations are acquired. In the second part of the article, we discuss the practical implications of these recent findings.

Making translation work: Harmonizing cross-species methodology in the behavioural neuroscience of Pavlovian fear conditioning

Translational neuroscience bridges insights from specific mechanisms in rodents to complex functions in humans and is key to advance our general understanding of central nervous function. A prime example of translational research is the study of cross-species mechanisms that underlie responding to learned threats, by employing Pavlovian fear conditioning protocols in rodents and humans. Hitherto, evidence for (and critique of) these cross-species comparisons in fear conditioning research was based on theoretical viewpoints. Here, we provide a perspective to substantiate these theoretical concepts with empirical considerations of cross-species methodology. This meta-research perspective is expected to foster cross-species comparability and reproducibility to ultimately facilitate successful transfer of results from basic science into clinical applications.