Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala

The Neuroscience of Active Learning and Direct Instruction

Throughout the educational system, students experiencing active learning pedagogy perform better and fail less than those taught through direct instruction. Can this be ascribed to differences in learning from a neuroscientific perspective? This review examines mechanistic, neuroscientific evidence that might explain differences in cognitive engagement contributing to learning outcomes between these instructional approaches. In classrooms, direct instruction comprehensively describes academic content, while active learning provides structured opportunities for learners to explore, apply, and manipulate content. Synaptic plasticity and its modulation by arousal or novelty are central to all learning and both approaches. As a form of social learning, direct instruction relies upon working memory. The reinforcement learning circuit, associated agency, curiosity, and peer-to-peer social interactions combine to enhance motivation, improve retention, and build higher-order-thinking skills in active learning environments. When working memory becomes overwhelmed, additionally engaging the reinforcement learning circuit improves retention, providing an explanation for the benefits of active learning. This analysis provides a mechanistic examination of how emerging neuroscience principles might inform pedagogical choices at all educational levels.

A systems identification approach using Bayes factors to deconstruct the brain bases of emotion regulation

Cognitive reappraisal is fundamental to cognitive therapies and everyday emotion regulation. Analyses using Bayes factors and an axiomatic systems identification approach identified four reappraisal-related components encompassing distributed neural activity patterns across two independent functional magnetic resonance imaging (fMRI) studies (n = 182 and n = 176): (1) an anterior prefrontal system selectively involved in cognitive reappraisal; (2) a fronto-parietal-insular system engaged by both reappraisal and emotion generation, demonstrating a general role in appraisal; (3) a largely subcortical system activated during negative emotion generation but unaffected by reappraisal, including amygdala, hypothalamus and periaqueductal gray; and (4) a posterior cortical system of negative emotion-related regions downregulated by reappraisal. These systems covaried with individual differences in reappraisal success and were differentially related to neurotransmitter binding maps, implicating cannabinoid and serotonin systems in reappraisal. These findings challenge 'limbic'-centric models of reappraisal and provide new systems-level targets for assessing and enhancing emotion regulation.

Disentangling the contribution of individual and social learning processes in human advice-taking behavior

The study of social learning examines how individuals learn from others by means of observation, imitation, or compliance with advice. However, it still remains largely unknown whether social learning processes have a distinct contribution to behavior, independent from non-social trial-and-error learning that often occurs simultaneously. 153 participants completed a reinforcement learning task, where they were asked to make choices to gain rewards. Advice from an artificial teacher was presented in 60% of the trials, allowing us to compare choice behavior with and without advice. Results showed a strong and reliable tendency to follow advice (test-retest reliability ~0.73). Computational modeling suggested a unique contribution of three distinct learning strategies: (a) individual learning (i.e., learning the value of actions, independent of advice), (b) informed advice-taking (i.e., learning the value of following advice), and (c) non-informed advice-taking (i.e., a constant bias to follow advice regardless of outcome history). Comparing artificial and empirical data provided specific behavioral regression signatures to both informed and non-informed advice taking processes. We discuss the theoretical implications of integrating internal and external information during the learning process.

Multiple timescales of temporal context in risky choice: Behavioral identification and relationships to physiological arousal

Context-dependence is fundamental to risky monetary decision-making. A growing body of evidence suggests that temporal context, or recent events, alters risk-taking at a minimum of three timescales: immediate (e.g. trial-by-trial), neighborhood (e.g. a group of consecutive trials), and global (e.g. task-level). To examine context effects, we created a novel monetary choice set with intentional temporal structure in which option values shifted between multiple levels of value magnitude ("contexts") several times over the course of the task. This structure allowed us to examine whether effects of each timescale were simultaneously present in risky choice behavior and the potential mechanistic role of arousal, an established correlate of risk-taking, in context-dependency. We found that risk-taking was sensitive to immediate, neighborhood, and global timescales: risk-taking decreased following large (vs. small) outcome amounts, increased following large positive (but not negative) shifts in context, and increased when cumulative earnings exceeded expectations. We quantified arousal with skin conductance responses, which were related to the global timescale, increasing with cumulative earnings, suggesting that physiological arousal captures a task-level assessment of performance. Our results both replicate and extend prior research by demonstrating that risky decision-making is consistently dynamic at multiple timescales and that the role of arousal in risk-taking extends to some, but not all timescales of context-dependence.

Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases

Actions are biased by the outcomes they can produce: Humans are more likely to show action under reward prospect, but hold back under punishment prospect. Such motivational biases derive not only from biased response selection, but also from biased learning: humans tend to attribute rewards to their own actions, but are reluctant to attribute punishments to having held back. The neural origin of these biases is unclear. Specifically, it remains open whether motivational biases arise primarily from the architecture of subcortical regions or also reflect cortical influences, the latter being typically associated with increased behavioral flexibility and control beyond stereotyped behaviors. Simultaneous EEG-fMRI allowed us to track which regions encoded biased prediction errors in which order. Biased prediction errors occurred in cortical regions (dorsal anterior and posterior cingulate cortices) before subcortical regions (striatum). These results highlight that biased learning is not a mere feature of the basal ganglia, but arises through prefrontal cortical contributions, revealing motivational biases to be a potentially flexible, sophisticated mechanism.

Resolving the Delusion Paradox

BACKGROUND AND HYPOTHESIS

The neurocomputational framework of predictive processing (PP) provides a promising approach to explaining delusions, a key symptom of psychotic disorders. According to PP, the brain makes inferences about the world by weighing prior beliefs against the available sensory data. Mismatches between prior beliefs and sensory data result in prediction errors that may update the brain's model of the world. Psychosis has been associated with reduced weighting of priors relative to the sensory data. However, delusional beliefs are highly resistant to change, suggesting increased rather than decreased weighting of priors. We propose that this "delusion paradox" can be resolved within a hierarchical PP model: Reduced weighting of prior beliefs at low hierarchical levels may be compensated by an increased influence of higher-order beliefs represented at high hierarchical levels, including delusional beliefs. This may sculpt perceptual processing into conformity with delusions and foster their resistance to contradictory evidence.

STUDY DESIGN

We review several lines of experimental evidence on low- and high-level processes, and their neurocognitive underpinnings in delusion-related phenotypes and link them to predicted processing.

STUDY RESULTS

The reviewed evidence supports the notion of decreased weighting of low-level priors and increased weighting of high-level priors, in both delusional and delusion-prone individuals. Moreover, we highlight the role of prefrontal cortex as a neural basis for the increased weighting of high-level prior beliefs and discuss possible clinical implications of the proposed hierarchical predictive-processing model.

CONCLUSIONS

Our review suggests the delusion paradox can be resolved within a hierarchical PP model.

Human ventromedial prefrontal cortex lesions enhance the effect of expectations on pain perception

Pain is strongly modulated by expectations and beliefs. Across species, subregions of ventromedial prefrontal cortex (VMPFC) are implicated in a variety of functions germane to pain, predictions, and learning. Human fMRI studies show that VMPFC activity tracks expectations about pain and mediates expectancy effects on pain-related activity in other brain regions. Prior lesion studies suggest that VMPFC may instead play a more general role in generating affective responses to painful stimuli. To test whether VMPFC is required to generate affective responses to pain or is more specifically involved in expectancy-based pain modulation, we studied responses to heat stimuli in five adults with bilateral surgical lesions of VMPFC and twenty healthy adults without brain damage. All participants underwent a quantitative sensory testing procedure followed by a pain expectancy task in which cues predicting either low or high pain were followed by intermittent medium intensity heat stimuli. Compared to adults without brain damage, individuals with VMPFC lesions reported larger differences in expected pain based on predictive cues and failed to update expectations following the covert introduction of unexpected medium temperature stimuli. Consistent with observed expectancy differences, subjective pain unpleasantness ratings in the VMPFC lesion group were more strongly modulated by cue during thermal stimulation. We found no group differences in overall pain sensitivity, nor in relationships between pain and autonomic arousal, suggesting that VMPFC damage specifically enhances the effect of expectations on pain processing, likely driven by impaired integration of new sensory feedback to update expectations about pain. These results provide essential new data regarding the specific functional contribution of VMPFC to pain modulation.

Neural underpinnings of preferential pain learning and the modulatory role of fear

Due to its unique biological relevance, pain-related learning might differ from learning from other aversive experiences. This functional magnetic resonance imaging study compared neural mechanisms underlying the acquisition and extinction of different threats in healthy humans. We investigated whether cue-pain associations are acquired faster and extinguished slower than cue associations with an equally unpleasant tone. Additionally, we studied the modulatory role of stimulus-related fear. Therefore, we used a differential conditioning paradigm, in which somatic heat pain stimuli and unpleasantness-matched auditory stimuli served as US. Our results show stronger acquisition learning for pain- than tone-predicting cues, which was augmented in participants with relatively higher levels of fear of pain. These behavioral findings were paralleled by activation of brain regions implicated in threat processing (insula, amygdala) and personal significance (ventromedial prefrontal cortex). By contrast, extinction learning seemed to be less dependent on the threat value of the US, both on the behavioral and neural levels. Amygdala activity, however, scaled with pain-related fear during extinction learning. Our findings on faster and stronger (i.e. "preferential") pain learning and the role of fear of pain are consistent with the biological relevance of pain and may be relevant to the development or maintenance of chronic pain.

Effects of Experiencing CS-US Pairings on Instructed Fear Reversal

Fear learning allows us to identify and anticipate aversive events and adapt our behavior accordingly. This is often thought to rely on associative learning mechanisms where an initially neutral conditioned stimulus (CS) is repeatedly paired with an aversive unconditioned stimulus (US), eventually leading to the CS also being perceived as aversive and threatening. Importantly, however, humans also show verbal fear learning. Namely, they have the ability to change their responses to stimuli rapidly through verbal instructions about CS-US pairings. Past research on the link between experience-based and verbal fear learning indicated that verbal instructions about a reversal of CS-US pairings can fully override the effects of previously experienced CS-US pairings, as measured through fear ratings, skin conductance, and fear-potentiated startle. However, it remains an open question whether such instructions can also annul learned CS representations in the brain. Here, we used a fear reversal paradigm (female and male participants) in conjunction with representational similarity analysis of fMRI data to test whether verbal instructions fully override the effects of experienced CS-US pairings in fear-related brain regions or not. Previous research suggests that only the right amygdala should show lingering representations of previously experienced threat ("pavlovian trace"). Unexpectedly, we found evidence for the residual effect of prior CS-US experience to be much more widespread than anticipated, in the amygdala but also cortical regions like the dorsal anterior cingulate or dorsolateral prefrontal cortex. This finding shines a new light on the interaction of different fear learning mechanisms, at times with unexpected consequences.SIGNIFICANCE STATEMENT Humans are able to learn about aversive stimuli both from experience (i.e., repeated pairings of conditioned stimulus (CS) and unconditioned stimulus (US; pavlovian conditioning), and from verbal instructions about stimulus pairings. Understanding how experience-based and verbal learning processes interact is key for understanding the cognitive and neural underpinnings of fear learning. We tested whether prior aversive experiences (CS-US pairings) affected subsequent verbal learning, searching for lingering threat signals after verbal instructions reversed a CS from being threatening to being safe. While past research suggested such threat signals can only be found in the amygdala, we found evidence to be much more widespread, including the medial and lateral PFC. This highlights how experience-based and verbal learning processes interact to support adaptive behavior.

Statistical information about reward timing is insufficient for promoting optimal persistence decisions

When deciding how long to keep waiting for delayed rewards that will arrive at an uncertain time, different distributions of possible reward times dictate different optimal strategies for maximizing reward. When reward timing distributions are heavy-tailed (e.g., waiting on hold) there is a point at which waiting is no longer advantageous because the opportunity cost of waiting is too high. Alternatively, when reward timing distributions have more predictable timing (e.g., uniform), it is advantageous to wait as long as necessary for the reward. Although people learn to approximate optimal strategies, little is known about how this learning occurs. One possibility is that people learn a general cognitive representation of the probability distribution that governs reward timing and then infer a strategy from that model of the environment. Another possibility is that they learn an action policy in a way that depends more narrowly on direct task experience, such that general knowledge of the reward timing distribution is insufficient for expressing the optimal strategy. Here, in a series of studies in which participants decided how long to persist for delayed rewards before quitting, we provided participants with information about the reward timing distribution in several ways. Whether the information was provided through counterfactual feedback (Study 1), previous exposure (Studies 2a and 2b), or description (Studies 3a and 3b), it did not obviate the need for direct, feedback-driven learning in a decision context. Therefore, learning when to quit waiting for delayed rewards might depend on task-specific experience, not solely on probabilistic reasoning.

Inferring danger with minimal aversive experience

Learning about threats is crucial for survival and fundamentally rests upon Pavlovian conditioning. However, Pavlovian threat learning is largely limited to detecting known (or similar) threats and involves first-hand exposure to danger, which inevitably poses a risk of harm. We discuss how individuals leverage a rich repertoire of mnemonic processes that operate largely in safety and significantly expand our ability to recognize danger beyond Pavlovian threat associations. These processes result in complementary memories - acquired individually or through social interactions - that represent potential threats and the relational structure of our environment. The interplay between these memories allows danger to be inferred rather than directly learned, thereby flexibly protecting us from potential harm in novel situations despite minimal prior aversive experience.

Instructions and experiential learning have similar impacts on pain and pain-related brain responses but produce dissociations in value-based reversal learning

Recent data suggest that interactions between systems involved in higher order knowledge and associative learning drive responses during value-based learning. However, it is unknown how these systems impact subjective responses, such as pain. We tested how instructions and reversal learning influence pain and pain-evoked brain activation. Healthy volunteers (n=40) were either instructed about contingencies between cues and aversive outcomes or learned through experience in a paradigm where contingencies reversed three times. We measured predictive cue effects on pain and heat-evoked brain responses using functional magnetic resonance imaging. Predictive cues dynamically modulated pain perception as contingencies changed, regardless of whether participants received contingency instructions. Heat-evoked responses in the insula, anterior cingulate, and other regions updated as contingencies changed, and responses in the prefrontal cortex mediated dynamic cue effects on pain, whereas responses in the brainstem’s rostroventral medulla (RVM) were shaped by initial contingencies throughout the task. Quantitative modeling revealed that expected value was shaped purely by instructions in the Instructed Group, whereas expected value updated dynamically in the Uninstructed Group as a function of error-based learning. These differences were accompanied by dissociations in the neural correlates of value-based learning in the rostral anterior cingulate, thalamus, and posterior insula, among other regions. These results show how predictions dynamically impact subjective pain. Moreover, imaging data delineate three types of networks involved in pain generation and value-based learning: those that respond to initial contingencies, those that update dynamically during feedback-driven learning as contingencies change, and those that are sensitive to instruction. Together, these findings provide multiple points of entry for therapies designs to impact pain.

Explicit knowledge of task structure is a primary determinant of human model-based action

Explicit information obtained through instruction profoundly shapes human choice behaviour. However, this has been studied in computationally simple tasks, and it is unknown how model-based and model-free systems, respectively generating goal-directed and habitual actions, are affected by the absence or presence of instructions. We assessed behaviour in a variant of a computationally more complex decision-making task, before and after providing information about task structure, both in healthy volunteers and in individuals suffering from obsessive-compulsive or other disorders. Initial behaviour was model-free, with rewards directly reinforcing preceding actions. Model-based control, employing predictions of states resulting from each action, emerged with experience in a minority of participants, and less in those with obsessive-compulsive disorder. Providing task structure information strongly increased model-based control, similarly across all groups. Thus, in humans, explicit task structural knowledge is a primary determinant of model-based reinforcement learning and is most readily acquired from instruction rather than experience.

Enhanced Instructed Fear Learning in Delusion-Proneness

Psychosis is associated with distorted perceptions and deficient bottom-up learning such as classical fear conditioning. This has been interpreted as reflecting imprecise priors in low-level predictive coding systems. Paradoxically, overly strong beliefs, such as overvalued beliefs and delusions, are also present in psychosis-associated states. In line with this, research has suggested that patients with psychosis and associated phenotypes rely more on high-order priors to interpret perceptual input. In this behavioural and fMRI study we studied two types of fear learning, i.e., instructed fear learning mediated by verbal suggestions about fear contingencies and classical fear conditioning mediated by low level associative learning, in delusion proneness—a trait in healthy individuals linked to psychotic disorders. Subjects were shown four faces out of which two were coupled with an aversive stimulation (CS+) while two were not (CS-) in a fear conditioning procedure. Before the conditioning, subjects were informed about the contingencies for two of the faces of each type, while no information was given for the two other faces. We could thereby study the effect of both classical fear conditioning and instructed fear learning. Our main outcome variable was evaluative rating of the faces. Simultaneously, fMRI-measurements were performed to study underlying mechanisms. We postulated that instructed fear learning, measured with evaluative ratings, is stronger in psychosis-related phenotypes, in contrast to classical fear conditioning that has repeatedly been shown to be weaker in these groups. In line with our hypothesis, we observed significantly larger instructed fear learning on a behavioural level in delusion-prone individuals (n = 20) compared to non-delusion-prone subjects (n = 23; n = 20 in fMRI study). Instructed fear learning was associated with a bilateral activation of lateral orbitofrontal cortex that did not differ significantly between groups. However, delusion-prone subjects showed a stronger functional connectivity between right lateral orbitofrontal cortex and regions processing fear and pain. Our results suggest that psychosis-related states are associated with a strong instructed fear learning in addition to previously reported weak classical fear conditioning. Given the similarity between nocebo paradigms and instructed fear learning, our results also have an impact on understanding why nocebo effects differ between individuals.

Computational modeling of threat learning reveals links with anxiety and neuroanatomy in humans

Influential theories implicate variations in the mechanisms supporting threat learning in the severity of anxiety symptoms. We use computational models of associative learning in conjunction with structural imaging to explicate links among the mechanisms underlying threat learning, their neuroanatomical substrates, and anxiety severity in humans. We recorded skin-conductance data during a threat-learning task from individuals with and without anxiety disorders (N=251; 8-50 years; 116 females). Reinforcement-learning model variants quantified processes hypothesized to relate to anxiety: threat conditioning, threat generalization, safety learning, and threat extinction. We identified the best-fitting models for these processes and tested associations among latent learning parameters, whole-brain anatomy, and anxiety severity. Results indicate that greater anxiety severity related specifically to slower safety learning and slower extinction of response to safe stimuli. Nucleus accumbens gray-matter volume moderated learning-anxiety associations. Using a modeling approach, we identify computational mechanisms linking threat learning and anxiety severity and their neuroanatomical substrates.

A double-blind study assessing the impact of orbitofrontal theta burst stimulation on goal-directed behavior

Patients with disorders of compulsivity show impairments in goal-directed behavior, which have been linked to orbitofrontal cortex (OFC) dysfunction. We recently showed that continuous theta burst stimulation (cTBS), which reduces OFC activity, had a beneficial effect on compulsive behaviors both immediately and at 1 week follow-up compared with inhibitory TBS (iTBS). In this same sample, we investigated whether two behavioral measures of goal-directed control (devaluation success on a habit override task; model-based planning on the two-step task) were also affected by acute modulation of OFC activity. Overall, model-based planning and devaluation success were significantly related to each other and (for devaluation success) to symptoms in our transdiagnostic clinical sample. These measures were moderately to highly stable across time. In individuals with low levels of model-based planning, active cTBS improved devaluation success. Analogous to previously reported clinical effects, this effect was specific to cTBS and not iTBS. Overall, results suggested that measures of goal directed behavior are reliable but less affected by cTBS than clinical self-report. Future research should continue to examine longitudinal changes in behavioral measures to determine their temporal relationship with symptom improvement after treatment. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

When experience is not enough: learning-based cognitive pain modulation with or without instructions

ABSTRACT

The effects of expectations on pain perception are often studied using large differences in pain probabilities between experimental conditions, although they may be far more subtle in clinical contexts and, therefore, more difficult to detect. The current study aimed to investigate at which point subtle differences in pain probabilities can be detected and lead to differentiable expectations and perceptions. Furthermore, we investigated whether instructions can aid learning from experience and enhance subsequent pain modulatory effects. During a predictive learning task, participants were presented with 5 different cues, followed by either a high and low noxious stimulus. They learned about the different cue-stimulus contingencies either solely through experience (LEARN, N = 40) or a combination of experience and explicit information about the cue-stimulus contingencies (INSTRUCT, N = 40). We found that without explicit information, picking up the different pain probabilities was challenging, while explicit instruction significantly improved their detection. As revealed by drift diffusion modeling, learning from experience was insufficient for the development of a bias towards low pain even when it was highly likely. By contrast, when explicit information was provided, perception became more nuanced with the direction and extent of bias, capturing the subtle differences in pain probabilities. These findings highlight that the use of instructions to foster the detection of subtle pain improvements during pain treatment to enhance their cognitive pain modulatory effects warrant further investigation.

The computational challenge of social learning

The complex reward structure of the social world and the uncertainty endemic to social contexts poses a challenge for modeling. For example, during social interactions, the actions of one person influence the internal states of another. These social dependencies make it difficult to formalize social learning problems in a mathematically tractable way. While it is tempting to dispense with these complexities, they are a defining feature of social life. Because the structure of social interactions challenges the simplifying assumptions often made in models, they make an ideal testbed for computational models of cognition. By adopting a framework that embeds existing social knowledge into the model, we can go beyond explaining behaviors in laboratory tasks to explaining those observed in the wild.

Rating expectations can slow aversive reversal learning

The process of learning allows organisms to develop predictions about outcomes in the environment, and learning is sensitive to both simple associations and higher order knowledge. However, it is unknown whether consciously attending to expectations shapes the learning process itself. Here, we directly tested whether rating expectations shapes arousal during classical conditioning. Participants performed an aversive learning paradigm wherein one image (CS+) was paired with shock on 50% of trials, while a second image (CS-) was never paired with shock. Halfway through the task, contingencies reversed. One group of participants rated the probability of upcoming shock on each trial, while the other group made no online ratings. We measured skin conductance response (SCR) evoked in response to the CS and used traditional analyses as well as quantitative models of reinforcement learning to test whether rating expectations influenced arousal and aversive reversal learning. Participants who provided online expectancy ratings displayed slower learning based on a hybrid model of adaptive learning and reduced reversal of SCR relative to those who did not rate expectations. Mediation analysis revealed that the effect of associative learning on SCR could be fully explained through its effects on subjective expectancy within the group who provided ratings. This suggests that the act of rating expectations reduces the speed of learning, likely through changes in attention, and that expectations directly influence arousal. Our findings indicate that higher order expectancy judgments can alter associative learning.

A social affective neuroscience lens on placebo analgesia

Pain is a fundamental experience that promotes survival. In humans, pain stands at the intersection of multiple health crises: chronic pain, the opioid epidemic, and health disparities. The study of placebo analgesia highlights how social, cognitive, and affective processes can directly shape pain, and identifies potential paths for mitigating these crises. This review examines recent progress in the study of placebo analgesia through affective science. It focuses on how placebo effects are shaped by expectations, affect, and the social context surrounding treatment, and discusses neurobiological mechanisms of placebo, highlighting unanswered questions and implications for health. Collaborations between clinicians and social and affective scientists can address outstanding questions and leverage placebo to reduce pain and improve human health.

Psychedelic drug use and schizotypy in young adults

Despite recently resurrected scientific interest in classical psychedelics, few studies have focused on potential harms associated with abuse of these substances. In particular, the link between psychedelic use and psychotic symptoms has been debated while no conclusive evidence has been presented. Here, we studied an adult population (n = 1032) with a special focus on young (18–35 years) and healthy individuals (n = 701) to evaluate the association of psychedelic drug use with schizotypy and evidence integration impairment typically observed in psychosis-spectrum disorders. Experimental behavioural testing was performed in a subsample of the subjects (n = 39). We observed higher schizotypy scores in psychedelic users in the total sample. However, the effect size was notably small and only marginally significant when considering young and healthy subjects (Cohen’s d = 0.13). Controlling for concomitant drug use, none of our analyses found significant associations between psychedelic use and schizotypal traits. Results from experimental testing showed that total exposure to psychedelics (frequency and temporal proximity of use) was associated with better evidence integration (Cohen’s d = 0.13) and a higher sensitivity of fear responses (Cohen’s d = 1.05) to the effects instructed knowledge in a reversal aversive learning task modelled computationally with skin conductance response and pupillometry. This effect was present even when controlling for demographics and concomitant drug use. On a group level, however, only difference in sensitivity of fear responses to instructed knowledge reached statistical significance. Taken together, our findings suggest that psychedelic drug use is only weakly associated with psychosis-like symptoms, which, in turn, is to a large extent explained by psychiatric comorbidities and use of other psychoactive substances. Our results also suggest that psychedelics may have an effect on flexibility of evidence integration and aversive learning processes, that may be linked to recently suggested therapeutic effects of psychedelic drugs in non-psychotic psychiatric populations.

Verbal threat learning does not spare loved ones

Significant others provide individuals with a sense of safety and security. However, the mechanisms that underlie attachment-induced safety are hardly understood. Recent research has shown beneficial effects when viewing pictures of the romantic partner, leading to reduced pain experience and defensive responding. Building upon this, we examined the inhibitory capacity of loved face pictures on fear learning in an instructed threat paradigm. Pictures of loved familiar or unknown individuals served as signals for either threat of electric shocks or safety, while a broad set of psychophysiological measures was recorded. We assumed that a long-term learning history of beneficial relations interferes with social threat learning. Nevertheless, results yielded a typical pattern of physiological defense activation towards threat cues, regardless of whether threat was signaled by an unknown or a loved face. These findings call into question the notion that pictures of loved individuals are shielded against becoming threat cues, with implications for attachment and trauma research.

Evidence for a minimal role of stimulus awareness in reversal of threat learning

In an ever-changing environment, survival depends on learning which stimuli represent threat, and also on updating such associations when circumstances shift. It has been claimed that humans can acquire physiological responses to threat-associated stimuli even when they are unaware of them, but the role of awareness in updating threat contingencies remains unknown. This complex process-generating novel responses while suppressing learned ones-relies on distinct neural mechanisms from initial learning, and has only been shown with awareness. Can it occur unconsciously? Here, we present evidence that threat reversal may not require awareness. Participants underwent classical threat conditioning to visual stimuli that were suppressed from awareness. One of two images was paired with an electric shock; halfway through the experiment, contingencies were reversed and the shock was paired with the other image. Despite variations in suppression across participants, we found that physiological responses reflected changes in stimulus-threat pairings independently of stimulus awareness. These findings suggest that unconscious affective processing may be sufficiently flexible to adapt to changing circumstances.

The Protective Effects of Perceived Control During Repeated Exposure to Aversive Stimuli

The ability to perceive and exercise control is a major contributor to our mental and physical wellbeing. When faced with uncontrollable aversive stimuli, organisms develop heightened anxiety and become unwilling to exert effort to avoid the stimuli. In contrast, when faced with controllable aversive stimuli, organisms demonstrate behavioral vigor via avoidance attempts toward trying to seek and exercise control over the environment. As such, controllability confers protective effects against reduced avoidance motivation trigged by aversive environments. These observations beg the question of whether controllability can be potent enough to reverse passivity following repeated exposure to uncontrollable aversive stimuli and how this protective effect is encoded neurally. Human participants performed a Control in Aversive Domain (CAD) task where they were first subjected to a series of repeated uncontrollable aversive stimuli (i.e., aversive tones) across several contexts that were followed by a series of controllable aversive stimuli in a novel context. Faced with persistent uncontrollability, participants significantly reduced their avoidance attempts over time and biased toward giving up. However, the subsequent presence of controllability rescued participants' avoidance behavior. Strikingly, participants who responded more strongly to the protective effects of control also had greater ventromedial prefrontal cortical (vmPFC) activation-a region previously observed to be associated with encoding the subjective value of control. Taken together, these findings highlighted the protective effect conferred by perceived control against passivity and offered insights into the potential role of the vmPFC in controllable environments, with implications for understanding the beneficial influence of perceived control on adaptive behavior.

Neural Computations of Threat

A host of learning, memory, and decision-making processes form the individual's response to threat and may be disrupted in anxiety and post-trauma psychopathology. Here we review the neural computations of threat, from the first encounter with a dangerous situation, through learning, storing, and updating cues that predict it, to making decisions about the optimal course of action. The overview highlights the interconnected nature of these processes and their reliance on shared neural and computational mechanisms. We propose an integrative approach to the study of threat-related processes, in which specific computations are studied across the various stages of threat experience rather than in isolation. This approach can generate new insights about the evolution, diagnosis, and treatment of threat-related psychopathology.

Hierarchical models of pain: Inference, information-seeking, and adaptive control

Computational models of pain consider how the brain processes nociceptive information and allow mapping neural circuits and networks to cognition and behaviour. To date, they have generally have assumed two largely independent processes: perceptual inference, typically modelled as an approximate Bayesian process, and action control, typically modelled as a reinforcement learning process. However, inference and control are intertwined in complex ways, challenging the clarity of this distinction. Here, we consider how they may comprise a parallel hierarchical architecture that combines inference, information-seeking, and adaptive value-based control. This sheds light on the complex neural architecture of the pain system, and takes us closer to understanding from where pain 'arises' in the brain.

Comparing neural correlates of conditioned inhibition between children with and without anxiety disorders - A preliminary study

Cognitive-behavioral therapy (CBT), a first-line treatment for pediatric anxiety disorders, is based on principles of threat learning and extinction. However, CBT does not work sufficiently for up to 40% of clinically anxious youth. The neural and behavioral correlates of conditioned inhibition might provide promising targets for attempts to improve CBT response. During conditioned inhibition, threat and safety cues appear together, forming a safety compound. Here, we test whether this safety compound elicits a reduced fear response compared to pairing the threat cue with a novel cue (novel compound). The current pilot study compares behavioral, physiological, and neural correlates of conditioned inhibition between children with (n = 17, M_age = 13.09, SD_age = 3.05) and without (n = 18, M_age = 14.49, SD_age = 2.38) anxiety disorders. Behavioral and physiological measures did not differ between children with and without anxiety disorders during fear acquisition. During testing, children with anxiety disorders showed overall higher skin conductance response and expected to hear the aversive sound following the novel compound more often than children without anxiety disorders. Children with anxiety disorders showed more activity in the right ventromedial prefrontal cortex (vmPFC) to the safety versus novel compound. Children without anxiety disorders showed the opposite pattern - more right vmPFC activity to the novel versus safety compound (F(1,31) = 5.40, p = 0.03). No group differences manifested within the amygdala, dorsal anterior cingulate cortex, or hippocampus. These pilot findings suggest a feasible approach for examining conditioned inhibition in pediatric anxiety disorders. If replicated in larger samples, findings may implicate perturbed conditioned inhibition in pediatric anxiety disorders and provide targets for CBT.

Social safety learning: Shared safety abolishes the recovery of learned threat

Humans, like other social animals, learn about threats and safety in the environment through social cues. Yet, the processes that contribute to the efficacy of social safety learning during threat transmission remain unknown. Here, we developed a novel dyadic model of associative threat and extinction learning. In three separate social groups, we manipulated whether safety information during extinction was acquired via direct exposure to the conditioned stimulus (CS) in the presence of another individual (Direct exposure), via observation of other's safety behavior (Vicarious exposure), or via the combination of both (Shared exposure).These groups were contrasted against a fourth group receiving direct CS exposure alone (Asocial exposure). Based on skin conductance responses, we observed that all social groups outperformed asocial learning in inhibiting the recovery of threat, but only Shared exposure abolished threat recovery. These results suggest that social safety learning is optimized by a combination of direct exposure and vicariously transmitted safety signals. This work might help develop exposure therapies used to treat symptoms of threat and anxiety-related disorders to counteract maladaptive fears in humans.

Knowing Ourselves Together: The Cultural Origins of Metacognition

Metacognition - the ability to represent, monitor and control ongoing cognitive processes - helps us perform many tasks, both when acting alone and when working with others. While metacognition is adaptive, and found in other animals, we should not assume that all human forms of metacognition are gene-based adaptations. Instead, some forms may have a social origin, including the discrimination, interpretation, and broadcasting of metacognitive representations. There is evidence that each of these abilities depends on cultural learning and therefore that cultural selection might shape human metacognition. The cultural origins hypothesis is a plausible and testable alternative that directs us towards a substantial new programme of research.

The neural and computational systems of social learning

Learning the value of stimuli and actions from others - social learning - adaptively contributes to individual survival and plays a key role in cultural evolution. We review research across species targeting the neural and computational systems of social learning in both the aversive and appetitive domains. Social learning generally follows the same principles as self-experienced value-based learning, including computations of prediction errors and is implemented in brain circuits activated across task domains together with regions processing social information. We integrate neural and computational perspectives of social learning with an understanding of behaviour of varying complexity, from basic threat avoidance to complex social learning strategies and cultural phenomena.

The neural processes of acquiring placebo effects through observation

Learning through social observation is critical for humans. The present study investigates the neural processes underlying the acquisition of placebo effects through observational learning. We created a new functional magnetic resonance imaging (fMRI) paradigm where participants (n ​= ​38, healthy, both sexes) observed a demonstrator experiencing pain relief by a placebo treatment cream and experiencing pain without a treatment (control cream), and subsequently performed the same procedure themselves. Participants demonstrated placebo hypoalgesia while they performed the procedure themselves, confirming that observational learning can lead to placebo effects. During the observational learning phase, fMRI analysis showed a modulation of the amygdalae, periaqueductal grey, temporoparietal junctions (TPJ), and dorsolateral prefrontal cortex (DLPFC). Connectivity between the DLPFC and TPJ during the observational learning task was modulated by the placebo treatment and predicted subsequent placebo effects. Mediation analysis further confirmed that the DLPFC-TPJ connectivity formally mediated the effect of the observed treatment condition on subsequent placebo effects. Additionally, pre-recorded resting state connectivity between the DLPFC and TPJ also predicted observationally-learned placebo effects. Our findings provide an understanding of the neural processes during the acquisition of placebo effects through observation and indicate a critical role for DLPFC-TPJ integration processes during observational learning of therapeutic outcomes.

Fear expression is suppressed by tyrosine administration

Animal studies have demonstrated that catecholamines regulate several aspects of fear conditioning. In humans, however, pharmacological manipulations of the catecholaminergic system have been scarce, and their primary focus has been to interfering with catecholaminergic activity after fear acquisition or expression had taken place, using L-Dopa, primarily, as catecholaminergic precursor. Here, we sought to determine if putative increases in presynaptic dopamine and norepinephrine by tyrosine administered before conditioning could affect fear expression. Electrodermal activity (EDA) of 46 healthy participants (24 placebo, 22 tyrosine) was measured in an instructed fear task. Results showed that tyrosine abolished fear expression compared to placebo. Importantly, tyrosine did not affect EDA responses to the aversive stimulus (UCS) or alter participants’ mood. Therefore, the effect of tyrosine on fear expression cannot be attributed to these factors. Taken together, these findings provide evidence that the catecholaminergic system influences fear expression in humans.

Pain: A Precision Signal for Reinforcement Learning and Control

Since noxious stimulation usually leads to the perception of pain, pain has traditionally been considered sensory nociception. But its variability and sensitivity to a broad array of cognitive and motivational factors have meant it is commonly viewed as inherently imprecise and intangibly subjective. However, the core function of pain is motivational-to direct both short- and long-term behavior away from harm. Here, we illustrate that a reinforcement learning model of pain offers a mechanistic understanding of how the brain supports this, illustrating the underlying computational architecture of the pain system. Importantly, it explains why pain is tuned by multiple factors and necessarily supported by a distributed network of brain regions, recasting pain as a precise and objectifiable control signal.

Reversing Threat to Safety: Incongruence of Facial Emotions and Instructed Threat Modulates Conscious Perception but Not Physiological Responding

Facial expressions inform about other peoples’ emotion and motivation and thus are central for social communication. However, the meaning of facial expressions may change depending on what we have learned about the related consequences. For instance, a smile might easily become threatening when displayed by a person who is known to be dangerous. The present study examined the malleability of emotional facial valence by means of social learning. To this end, facial expressions served as cues for verbally instructed threat-of-shock or safety (e.g., “happy faces cue shocks”). Moreover, reversal instructions tested the flexibility of threat/safety associations (e.g., “now happy faces cue safety”). Throughout the experiment, happy, neutral, and angry facial expressions were presented and auditory startle probes elicited defensive reflex activity. Results show that self-reported ratings and physiological reactions to threat/safety cues dissociate. Regarding threat and valence ratings, happy facial expressions tended to be more resistant becoming a threat cue, and angry faces remain threatening even when instructed as safety cue. For physiological response systems, however, we observed threat-potentiated startle reflex and enhanced skin conductance responses for threat compared to safety cues regardless of whether threat was cued by happy or angry faces. Thus, the incongruity of visual and verbal threat/safety information modulates conscious perception, but not the activation of physiological response systems. These results show that verbal instructions can readily overwrite the intrinsic meaning of facial emotions, with clear benefits for social communication as learning and anticipation of threat and safety readjusted to accurately track environmental changes.

Making translation work: Harmonizing cross-species methodology in the behavioural neuroscience of Pavlovian fear conditioning

Translational neuroscience bridges insights from specific mechanisms in rodents to complex functions in humans and is key to advance our general understanding of central nervous function. A prime example of translational research is the study of cross-species mechanisms that underlie responding to learned threats, by employing Pavlovian fear conditioning protocols in rodents and humans. Hitherto, evidence for (and critique of) these cross-species comparisons in fear conditioning research was based on theoretical viewpoints. Here, we provide a perspective to substantiate these theoretical concepts with empirical considerations of cross-species methodology. This meta-research perspective is expected to foster cross-species comparability and reproducibility to ultimately facilitate successful transfer of results from basic science into clinical applications.

Different brain networks mediate the effects of social and conditioned expectations on pain

Information about others' experiences can strongly influence our own feelings and decisions. But how does such social information affect the neural generation of affective experience, and are the brain mechanisms involved distinct from those that mediate other types of expectation effects? Here, we used fMRI to dissociate the brain mediators of social influence and associative learning effects on pain. Participants viewed symbolic depictions of other participants' pain ratings (social information) and classically conditioned pain-predictive cues before experiencing painful heat. Social information and conditioned stimuli each had significant effects on pain ratings, and both effects were mediated by self-reported expectations. Yet, these effects were mediated by largely separable brain activity patterns, involving different large-scale functional networks. These results show that learned versus socially instructed expectations modulate pain via partially different mechanisms-a distinction that should be accounted for by theories of predictive coding and related top-down influences.

The cerebellum is involved in processing of predictions and prediction errors in a fear conditioning paradigm

Prediction errors are thought to drive associative fear learning. Surprisingly little is known about the possible contribution of the cerebellum. To address this question, healthy participants underwent a differential fear conditioning paradigm during 7T magnetic resonance imaging. An event-related design allowed us to separate cerebellar fMRI signals related to the visual conditioned stimulus (CS) from signals related to the subsequent unconditioned stimulus (US; an aversive electric shock). We found significant activation of cerebellar lobules Crus I and VI bilaterally related to the CS+ compared to the CS-. Most importantly, significant activation of lobules Crus I and VI was also present during the unexpected omission of the US in unreinforced CS+ acquisition trials. This activation disappeared during extinction when US omission became expected. These findings provide evidence that the cerebellum has to be added to the neural network processing predictions and prediction errors in the emotional domain.

A novel method to trigger the reconsolidation of fear memory

The procedure of memory reconsolidation provides an opportunity to improve some mental disorders caused by maladaptive memories, such as Posttraumatic Stress Disorder. Prediction error was considered a necessary condition for triggering memory reconsolidation. However, it is difficult to create a satisfying prediction error to successfully open memory reconsolidation in a clinical context. The purpose of this study was to explore a more practicable method to trigger memory reconsolidation. We used a successive 4-day fear-potentiated startle paradigm to compare the effect of uncertainty with prediction error during retrieval on preventing the return of fear. Bayes factor, combined with p value and effect size, was used as the main indicator of statistical inference. The results indicated that spontaneous recovery and reinstatement of fear were not observed in the uncertainty group, whereas return of fear was observed for the prediction error group. However, the direct comparison between the two groups did not yield statistically significant results, potentially reflecting a lack of statistical power. Nonetheless, these results suggest that uncertainty retrieval could be a better means to trigger memory reconsolidation than prediction error, making uncertainty a worthwhile factor to consider in future research on memory reconsolidation.

A connectional hub in the rostral anterior cingulate cortex links areas of emotion and cognitive control

We investigated afferent inputs from all areas in the frontal cortex (FC) to different subregions in the rostral anterior cingulate cortex (rACC). Using retrograde tracing in macaque monkeys, we quantified projection strength by counting retrogradely labeled cells in each FC area. The projection from different FC regions varied across injection sites in strength, following different spatial patterns. Importantly, a site at the rostral end of the cingulate sulcus stood out as having strong inputs from many areas in diverse FC regions. Moreover, it was at the integrative conjunction of three projection trends across sites. This site marks a connectional hub inside the rACC that integrates FC inputs across functional modalities. Tractography with monkey diffusion magnetic resonance imaging (dMRI) located a similar hub region comparable to the tracing result. Applying the same tractography method to human dMRI data, we demonstrated that a similar hub can be located in the human rACC.

Pain or nociception? Subjective experience mediates the effects of acute noxious heat on autonomic responses - corrected and republished

Nociception reliably elicits an autonomic nervous system (ANS) response. Because pain and ANS circuitry interact on multiple spinal, subcortical, and cortical levels, it remains unclear whether autonomic responses are simply a reflexive product of noxious stimulation regardless of how stimulation is consciously perceived or whether the experience of pain mediates ANS responses to noxious stimulation. To test these alternative predictions, we examined the relative contribution of noxious stimulation and individual pain experience to ANS responses in healthy volunteers who underwent 1 or 2 pain assessment tasks. Participants received 8 seconds of thermal stimulation of varied temperatures and judged pain intensity on every trial. Skin conductance responses and pupil dilation responses to stimulation served as measures of the heat-evoked autonomic response. We used multilevel modelling to examine trial-by-trial relationships between heat, pain, and ANS response. Although both pain and noxious heat stimulation predicted skin conductance response and pupil dilation response in separate analyses, the individual pain experience statistically mediated effects of noxious heat on both outcomes. Furthermore, moderated mediation revealed that evidence for this process was stronger when stimulation was perceived as painful compared with when stimulation was perceived as nonpainful, although this difference emerged late, in the 4-second period after thermal stimulation. These findings suggest that pain appraisal regulates the heat-evoked autonomic response to noxious stimulation, documenting the flexibility of the autonomic pain response to adjust to perceived or actual changes in environmental affordances above and beyond nociceptive input.

Pain or nociception? Subjective experience mediates the effects of acute noxious heat on autonomic responses

Nociception reliably elicits an autonomic nervous system (ANS) response. Because pain and ANS circuitry interact on multiple spinal, subcortical, and cortical levels, it remains unclear whether autonomic responses are simply a reflexive product of noxious stimulation regardless of how stimulation is consciously perceived or whether the experience of pain mediates ANS responses to noxious stimulation. To test these alternative predictions, we examined the relative contribution of noxious stimulation and individual pain experience to ANS responses in healthy volunteers who underwent 1 or 2 pain assessment tasks. Participants received 8 seconds of thermal stimulation of varied temperatures and judged pain intensity on every trial. Skin conductance responses and pupil dilation responses to stimulation served as measures of the heat-evoked autonomic response. We used multilevel modelling to examine trial-by-trial relationships between heat, pain, and ANS response. Although both pain and noxious heat stimulation predicted skin conductance response and pupil dilation response in separate analyses, the individual pain experience statistically mediated effects of noxious heat on both outcomes. Furthermore, moderated mediation revealed that evidence for this process was stronger when stimulation was perceived as painful compared with when stimulation was perceived as nonpainful. These findings suggest that pain appraisal regulates the heat-evoked autonomic response to noxious stimulation, documenting the flexibility of the autonomic pain response to adjust to perceived or actual changes in environmental affordances above and beyond nociceptive input.

Social threat learning transfers to decision making in humans

In today’s world, indirect exposure to threatening situations is more common than ever, as illustrated by footage of terror and disaster in social media. How do such social threat learning experiences shape our decisions? We found that learning about threats from both observation and verbal information strongly influenced decision making. As with learning from our own experience, this influence could be either adaptive or maladaptive depending on whether the social information provided accurate expectations about the environment. Our findings can help explain both adaptive and pathological behaviors resulting from the indirect exposure to threatening events.

In today’s world, mass-media and online social networks present us with unprecedented exposure to second-hand, vicarious experiences and thereby the chance of forming associations between previously innocuous events (e.g., being in a subway station) and aversive outcomes (e.g., footage or verbal reports from a violent terrorist attack) without direct experience. Such social threat, or fear, learning can have dramatic consequences, as manifested in acute stress symptoms and maladaptive fears. However, most research has so far focused on socially acquired threat responses that are expressed as increased arousal rather than active behavior. In three experiments (n = 120), we examined the effect of indirect experiences on behaviors by establishing a link between social threat learning and instrumental decision making. We contrasted learning from direct experience (i.e., Pavlovian conditioning) (experiment 1) against two common forms of social threat learning—social observation (experiment 2) and verbal instruction (experiment 3)—and how this learning transferred to subsequent instrumental decision making using behavioral experiments and computational modeling. We found that both types of social threat learning transfer to decision making in a strong and surprisingly inflexible manner. Notably, computational modeling indicated that the transfer of observational and instructed threat learning involved different computational mechanisms. Our results demonstrate the strong influence of others’ expressions of fear on one’s own decisions and have important implications for understanding both healthy and pathological human behaviors resulting from the indirect exposure to threatening events.

Neural computations of threat in the aftermath of combat trauma

By combining computational, morphological, and functional analyses, this study relates latent markers of associative threat learning to overt post-traumatic stress disorder (PTSD) symptoms in combat veterans. Using reversal learning, we found that symptomatic veterans showed greater physiological adjustment to cues that did not predict what they had expected, indicating greater sensitivity to prediction errors for negative outcomes. This exaggerated weighting of prediction errors shapes the dynamic learning rate (associability) and value of threat predictive cues. The degree to which the striatum tracked the associability partially mediated the positive correlation between prediction-error weights and PTSD symptoms, suggesting that both increased prediction-error weights and decreased striatal tracking of associability independently contribute to PTSD symptoms. Furthermore, decreased neural tracking of value in the amygdala, in addition to smaller amygdala volume, independently corresponded to higher PTSD symptom severity. These results provide evidence for distinct neurocomputational contributions to PTSD symptoms.

Behavioural and neural evidence for self-reinforcing expectancy effects on pain

Beliefs and expectations often persist despite evidence to the contrary. Here we examine two potential mechanisms underlying such 'self-reinforcing' expectancy effects in the pain domain: modulation of perception and biased learning. In two experiments, cues previously associated with symbolic representations of high or low temperatures preceded painful heat. We examined trial-to-trial dynamics in participants' expected pain, reported pain and brain activity. Subjective and neural pain responses assimilated towards cue-based expectations, and pain responses in turn predicted subsequent expectations, creating a positive dynamic feedback loop. Furthermore, we found evidence for a confirmation bias in learning: higher- and lower-than-expected pain triggered greater expectation updating for high- and low-pain cues, respectively. Individual differences in this bias were reflected in the updating of pain-anticipatory brain activity. Computational modelling provided converging evidence that expectations influence both perception and learning. Together, perceptual assimilation and biased learning promote self-reinforcing expectations, helping to explain why beliefs can be resistant to change.

Distinct Activity Patterns of the Human Bed Nucleus of the Stria Terminalis and Amygdala during Fear Learning

The amygdala and, more recently, also the bed nucleus of the stria terminalis, have been widely implicated in fear and anxiety. Much of our current knowledge is derived from animal studies and suggests an intricate convergence and divergence in functions related to defensive responding. In a recent paper, Klumpers and colleagues set out to examine these functions in a human fear learning procedure using functional magnetic resonance imaging. Their main findings were a role for the bed nucleus of the stria terminalis in threat anticipation, and for the amygdala in threat confrontation. Here, we provide a critical summary of this interesting study and point out some important issues that were not addressed by its authors. In particular, we first take a closer look at the striking differences between both samples that were combined for the study, and, secondly, we provide an in-depth discussion of their findings in relation to existing neurobehavioral models.