1
|
Atlas LY, Sandman CF, Phelps EA. Rating expectations can slow aversive reversal learning. Psychophysiology 2021; 59:e13979. [PMID: 34837385 PMCID: PMC8810599 DOI: 10.1111/psyp.13979] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 10/24/2021] [Accepted: 11/03/2021] [Indexed: 12/01/2022]
Abstract
The process of learning allows organisms to develop predictions about outcomes in the environment, and learning is sensitive to both simple associations and higher order knowledge. However, it is unknown whether consciously attending to expectations shapes the learning process itself. Here, we directly tested whether rating expectations shapes arousal during classical conditioning. Participants performed an aversive learning paradigm wherein one image (CS+) was paired with shock on 50% of trials, while a second image (CS-) was never paired with shock. Halfway through the task, contingencies reversed. One group of participants rated the probability of upcoming shock on each trial, while the other group made no online ratings. We measured skin conductance response (SCR) evoked in response to the CS and used traditional analyses as well as quantitative models of reinforcement learning to test whether rating expectations influenced arousal and aversive reversal learning. Participants who provided online expectancy ratings displayed slower learning based on a hybrid model of adaptive learning and reduced reversal of SCR relative to those who did not rate expectations. Mediation analysis revealed that the effect of associative learning on SCR could be fully explained through its effects on subjective expectancy within the group who provided ratings. This suggests that the act of rating expectations reduces the speed of learning, likely through changes in attention, and that expectations directly influence arousal. Our findings indicate that higher order expectancy judgments can alter associative learning.
Collapse
Affiliation(s)
- Lauren Y Atlas
- National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, Maryland, USA.,National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland, USA.,National Institutes on Drug Abuse, National Institutes of Health, Baltimore, Maryland, USA
| | - Christina F Sandman
- Department of Psychology, University of California, Los Angeles, California, USA
| | - Elizabeth A Phelps
- Department of Psychology, Harvard University, Cambridge, Massachusetts, USA
| |
Collapse
|
2
|
Behavioral and Physiological Evidence Challenges the Automatic Acquisition of Evaluations. CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE 2020. [DOI: 10.1177/0963721420964111] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Dual-learning theories of evaluations posit that evaluations can be automatically (i.e., efficiently, unconsciously, uncontrollably, and involuntarily) acquired. They also often assume the existence of evaluative-learning processes that are impervious to verbal information. In this article, we explain that recent research challenges both assertions for three categories of measures: explicit evaluative measures, implicit evaluative measures, and physiological measures of fear. In doing so, we also question the widespread assumption that implicit (i.e., typically behavioral and physiological) compared with explicit (i.e., self-reported) evaluative measures are indicative of the way evaluations are acquired. In the second part of the article, we discuss the practical implications of these recent findings.
Collapse
|
3
|
Measuring learning in human classical threat conditioning: Translational, cognitive and methodological considerations. Neurosci Biobehav Rev 2020; 114:96-112. [DOI: 10.1016/j.neubiorev.2020.04.019] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Revised: 04/15/2020] [Accepted: 04/18/2020] [Indexed: 02/06/2023]
|
4
|
Jepma M, Koban L, van Doorn J, Jones M, Wager TD. Behavioural and neural evidence for self-reinforcing expectancy effects on pain. Nat Hum Behav 2018; 2:838-855. [PMID: 31558818 PMCID: PMC6768437 DOI: 10.1038/s41562-018-0455-8] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2017] [Accepted: 09/19/2018] [Indexed: 01/30/2023]
Abstract
Beliefs and expectations often persist despite evidence to the contrary. Here we examine two potential mechanisms underlying such 'self-reinforcing' expectancy effects in the pain domain: modulation of perception and biased learning. In two experiments, cues previously associated with symbolic representations of high or low temperatures preceded painful heat. We examined trial-to-trial dynamics in participants' expected pain, reported pain and brain activity. Subjective and neural pain responses assimilated towards cue-based expectations, and pain responses in turn predicted subsequent expectations, creating a positive dynamic feedback loop. Furthermore, we found evidence for a confirmation bias in learning: higher- and lower-than-expected pain triggered greater expectation updating for high- and low-pain cues, respectively. Individual differences in this bias were reflected in the updating of pain-anticipatory brain activity. Computational modelling provided converging evidence that expectations influence both perception and learning. Together, perceptual assimilation and biased learning promote self-reinforcing expectations, helping to explain why beliefs can be resistant to change.
Collapse
Affiliation(s)
- Marieke Jepma
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands.
- Department of Psychology and Neuroscience and Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA.
| | - Leonie Koban
- Department of Psychology and Neuroscience and Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA
| | - Johnny van Doorn
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
| | - Matt Jones
- Department of Psychology and Neuroscience and Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA
| | - Tor D Wager
- Department of Psychology and Neuroscience and Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA
| |
Collapse
|
5
|
Kroes MCW, Schiller D, LeDoux JE, Phelps EA. Translational Approaches Targeting Reconsolidation. Curr Top Behav Neurosci 2016; 28:197-230. [PMID: 27240676 PMCID: PMC5646834 DOI: 10.1007/7854_2015_5008] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Maladaptive learned responses and memories contribute to psychiatric disorders that constitute a significant socio-economic burden. Primary treatment methods teach patients to inhibit maladaptive responses, but do not get rid of the memory itself, which explains why many patients experience a return of symptoms even after initially successful treatment. This highlights the need to discover more persistent and robust techniques to diminish maladaptive learned behaviours. One potentially promising approach is to alter the original memory, as opposed to inhibiting it, by targeting memory reconsolidation. Recent research shows that reactivating an old memory results in a period of memory flexibility and requires restorage, or reconsolidation, for the memory to persist. This reconsolidation period allows a window for modification of a specific old memory. Renewal of memory flexibility following reactivation holds great clinical potential as it enables targeting reconsolidation and changing of specific learned responses and memories that contribute to maladaptive mental states and behaviours. Here, we will review translational research on non-human animals, healthy human subjects, and clinical populations aimed at altering memories by targeting reconsolidation using biological treatments (electrical stimulation, noradrenergic antagonists) or behavioural interference (reactivation-extinction paradigm). Both approaches have been used successfully to modify aversive and appetitive memories, yet effectiveness in treating clinical populations has been limited. We will discuss that memory flexibility depends on the type of memory tested and the brain regions that underlie specific types of memory. Further, when and how we can most effectively reactivate a memory and induce flexibility is largely unclear. Finally, the development of drugs that can target reconsolidation and are safe for use in humans would optimize cross-species translations. Increasing the understanding of the mechanism and limitations of memory flexibility upon reactivation should help optimize efficacy of treatments for psychiatric patients.
Collapse
Affiliation(s)
- Marijn C W Kroes
- Department of Psychology, Centre for Neural Science, New York University, New York, NY, 10003, USA
| | - Daniela Schiller
- Department of Psychiatry and Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mt. Sinai, New York, NY, 10029, USA.
| | - Joseph E LeDoux
- Department of Psychology, Centre for Neural Science, New York University, New York, NY, 10003, USA
- Nathan Kline Institute, Orangeburg, NY, 10962, USA
| | - Elizabeth A Phelps
- Department of Psychology, Centre for Neural Science, New York University, New York, NY, 10003, USA
- Nathan Kline Institute, Orangeburg, NY, 10962, USA
| |
Collapse
|
6
|
Sperl MFJ, Panitz C, Hermann C, Mueller EM. A pragmatic comparison of noise burst and electric shock unconditioned stimuli for fear conditioning research with many trials. Psychophysiology 2016; 53:1352-65. [PMID: 27286734 DOI: 10.1111/psyp.12677] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2015] [Accepted: 04/28/2016] [Indexed: 01/01/2023]
Abstract
Several methods that are promising for studying the neurophysiology of fear conditioning (e.g., EEG, MEG) require a high number of trials to achieve an adequate signal-to-noise ratio. While electric shock and white noise burst are among the most commonly used unconditioned stimuli (US) in conventional fear conditioning studies with few trials, it is unknown whether these stimuli are equally well suited for paradigms with many trials. Here, N = 32 participants underwent a 260-trial differential fear conditioning and extinction paradigm with a 240-trial recall test 24 h later and neutral faces as conditioned stimuli. In a between-subjects design, either white noise bursts (n = 16) or electric shocks (n = 16) served as US, and intensities were determined using the most common procedure for each US (i.e., a fixed 95 dB noise burst and a work-up procedure for electric shocks, respectively). In addition to differing US types, groups also differed in closely linked US-associated characteristics (e.g., calibration methods, stimulus intensities, timing). Subjective ratings (arousal/valence), skin conductance, and evoked heart period changes (i.e., fear bradycardia) indicated more reliable, extinction-resistant, and stable conditioning in the white noise burst versus electric shock group. In fear conditioning experiments where many trials are presented, white noise burst should serve as US.
Collapse
Affiliation(s)
- Matthias F J Sperl
- Faculty of Psychology, Personality Psychology and Assessment, University of Marburg, Marburg, Germany.,Faculty of Psychology and Sports Science, Clinical Psychology and Psychotherapy, University of Giessen, Giessen, Germany
| | - Christian Panitz
- Faculty of Psychology, Personality Psychology and Assessment, University of Marburg, Marburg, Germany.,Faculty of Psychology and Sports Science, Clinical Psychology and Psychotherapy, University of Giessen, Giessen, Germany
| | - Christiane Hermann
- Faculty of Psychology and Sports Science, Clinical Psychology and Psychotherapy, University of Giessen, Giessen, Germany
| | - Erik M Mueller
- Faculty of Psychology, Personality Psychology and Assessment, University of Marburg, Marburg, Germany.,Faculty of Psychology and Sports Science, Clinical Psychology and Psychotherapy, University of Giessen, Giessen, Germany
| |
Collapse
|
7
|
Atlas LY, Doll BB, Li J, Daw ND, Phelps EA. Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala. eLife 2016; 5. [PMID: 27171199 PMCID: PMC4907691 DOI: 10.7554/elife.15192] [Citation(s) in RCA: 62] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2016] [Accepted: 05/08/2016] [Indexed: 11/16/2022] Open
Abstract
Socially-conveyed rules and instructions strongly shape expectations and emotions. Yet most neuroscientific studies of learning consider reinforcement history alone, irrespective of knowledge acquired through other means. We examined fear conditioning and reversal in humans to test whether instructed knowledge modulates the neural mechanisms of feedback-driven learning. One group was informed about contingencies and reversals. A second group learned only from reinforcement. We combined quantitative models with functional magnetic resonance imaging and found that instructions induced dissociations in the neural systems of aversive learning. Responses in striatum and orbitofrontal cortex updated with instructions and correlated with prefrontal responses to instructions. Amygdala responses were influenced by reinforcement similarly in both groups and did not update with instructions. Results extend work on instructed reward learning and reveal novel dissociations that have not been observed with punishments or rewards. Findings support theories of specialized threat-detection and may have implications for fear maintenance in anxiety. DOI:http://dx.doi.org/10.7554/eLife.15192.001 Around the start of the twentieth century, Pavlov discovered that dogs salivate upon hearing a bell that has previously signaled that food is available. This phenomenon, in which a neutral stimulus (the bell) becomes associated with a particular outcome (such as food), is known as classical conditioning. The network of brain regions that supports this process – which includes the striatum, the amygdala and the prefrontal cortex – seems to work in a similar way across most animal species, including humans. However, humans don’t learn only through experience or trial-and-error. We do not need to burn our hands to learn not to touch a hot stove: a verbal warning from others is usually sufficient. Experiments have shown that giving people verbal instructions on how to obtain rewards alters the activity of the striatum and prefrontal cortex. That is, the instructions interact with the circuit that also supports learning through experience. But is this the case for learning how to avoid punishments? That process depends largely on the amygdala, and it is possible that systems designed to detect threats may be less sensitive to verbal warnings. To address this question, Atlas et al. taught people to associate one image with a mild electric shock, and another with the absence of a shock. After a number of trials, the relationships were reversed so that the previously neutral picture now predicted a shock and vice versa. Telling the participants about the reversal in advance triggered changes in the activity of the striatum and part of the prefrontal cortex. By contrast, such warnings had no effect on the amygdala. Instead, the activity of the amygdala changed only after the volunteers had experienced for themselves the new relationship between the pictures and the shocks. A key next step is to find out whether this distinction between the two types of learning signals (those that can be updated by instructions and those that cannot) is specific to humans. While the current study relied upon language, there are other methods that could be used to explore this issue in animals. Furthermore, knowing that the human brain has a specialized threat detection system that is less sensitive to instructions could help us to understand and treat anxiety disorders. Atlas et al. hope to test this possibility directly in the future. DOI:http://dx.doi.org/10.7554/eLife.15192.002
Collapse
Affiliation(s)
- Lauren Y Atlas
- National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, United States.,National Institute on Drug Abuse, National Institutes of Health, Bayview, United States
| | - Bradley B Doll
- Center for Neural Sciences, New York University, New York, United States.,Department of Psychology, Columbia University, New York, United States
| | - Jian Li
- Department of Psychology, Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China.,PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China
| | - Nathaniel D Daw
- Department of Psychology, Princeton Neuroscience Institute, Princeton University, Princeton, United States
| | - Elizabeth A Phelps
- Center for Neural Sciences, New York University, New York, United States.,Department of Psychology, New York University, New York, United States.,Nathan Kline Institute, Orangeburg, United States
| |
Collapse
|
8
|
Potentiation of the startle reflex is in line with contingency reversal instructions rather than the conditioning history. Biol Psychol 2016; 113:91-9. [DOI: 10.1016/j.biopsycho.2015.11.014] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2015] [Revised: 11/25/2015] [Accepted: 11/26/2015] [Indexed: 11/20/2022]
|
9
|
Klumpers F, Morgan B, Terburg D, Stein DJ, van Honk J. Impaired acquisition of classically conditioned fear-potentiated startle reflexes in humans with focal bilateral basolateral amygdala damage. Soc Cogn Affect Neurosci 2014; 10:1161-8. [PMID: 25552573 DOI: 10.1093/scan/nsu164] [Citation(s) in RCA: 53] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2014] [Accepted: 12/24/2014] [Indexed: 01/03/2023] Open
Abstract
Based on studies in rodents, the basolateral amygdala (BLA) is considered a key site for experience-dependent neural plasticity underlying the acquisition of conditioned fear responses. In humans, very few studies exist of subjects with selective amygdala lesions and those studies have only implicated the amygdala more broadly leaving the role of amygdala sub-regions underexplored. We tested a rare sample of subjects (N = 4) with unprecedented focal bilateral BLA lesions due to a genetic condition called Urbach-Wiethe disease. In a classical delay fear conditioning experiment, these subjects showed impaired acquisition of conditioned fear relative to a group of matched control subjects (N = 10) as measured by fear-potentiation of the defensive eye-blink startle reflex. After the experiment, the BLA-damaged cases showed normal declarative memory of the conditioned association. Our findings provide new evidence that the human BLA is essential to drive fast classically conditioned defensive reflexes.
Collapse
Affiliation(s)
- Floris Klumpers
- Department of Experimental Psychology, Utrecht University, 3584 CS Utrecht, The Netherlands, Department of Cognitive Neuroscience, Donders Institute for Brain, Cognition and Behavior, Radboud University Nijmegen Medical Centre, 6500 HB Nijmegen, The Netherlands,
| | - Barak Morgan
- Department of Human Biology, MRC Medical Imaging Research Unit, University of Cape Town, 7700 Cape Town, South Africa
| | - David Terburg
- Department of Experimental Psychology, Utrecht University, 3584 CS Utrecht, The Netherlands, Department of Psychiatry and Mental Health, University of Cape Town, 7925 Cape Town, South Africa, and
| | - Dan J Stein
- Department of Psychiatry and Mental Health, University of Cape Town, 7925 Cape Town, South Africa, and
| | - Jack van Honk
- Department of Experimental Psychology, Utrecht University, 3584 CS Utrecht, The Netherlands, Department of Psychiatry and Mental Health, University of Cape Town, 7925 Cape Town, South Africa, and Institute of Infectious Diseases and Molecular Medicine, University of Cape Town, South Africa
| |
Collapse
|
10
|
Steinfurth ECK, Kanen JW, Raio CM, Clem RL, Huganir RL, Phelps EA. Young and old Pavlovian fear memories can be modified with extinction training during reconsolidation in humans. Learn Mem 2014; 21:338-41. [PMID: 24934333 PMCID: PMC4061428 DOI: 10.1101/lm.033589.113] [Citation(s) in RCA: 59] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Extinction training during reconsolidation has been shown to persistently diminish conditioned fear responses across species. We investigated in humans if older fear memories can benefit similarly. Using a Pavlovian fear conditioning paradigm we compared standard extinction and extinction after memory reactivation 1 d or 7 d following acquisition. Participants who underwent extinction during reconsolidation showed no evidence of fear recovery, whereas fear responses returned in participants who underwent standard extinction. We observed this effect in young and old fear memories. Extending the beneficial use of reconsolidation to older fear memories in humans is promising for therapeutic applications.
Collapse
Affiliation(s)
- Elisa C K Steinfurth
- Department of Psychology, New York University, New York, New York 10003, USA Department of Biological and Clinical Psychology, University of Greifswald, Greifswald 17487, Germany
| | - Jonathan W Kanen
- Department of Psychology, New York University, New York, New York 10003, USA
| | - Candace M Raio
- Department of Psychology, New York University, New York, New York 10003, USA
| | - Roger L Clem
- Departments of Neuroscience and Psychiatry, Friedman Brain Institute, Icahn School of Medicine at Mt. Sinai, New York, New York 10029, USA
| | - Richard L Huganir
- Department of Neuroscience, Howard Hughes Medical Institute, Johns Hopkins University School of Medicine, Baltimore, Maryland 21205, USA
| | - Elizabeth A Phelps
- Department of Psychology, New York University, New York, New York 10003, USA Center for Neural Science, New York University, New York, New York 10003, USA Nathan Kline Institute for Psychiatric Research, Orangeburg, New York 10962, USA
| |
Collapse
|
11
|
Boddez Y, Baeyens F, Luyten L, Vansteenwegen D, Hermans D, Beckers T. Rating data are underrated: validity of US expectancy in human fear conditioning. J Behav Ther Exp Psychiatry 2013. [PMID: 23207968 DOI: 10.1016/j.jbtep.2012.08.003] [Citation(s) in RCA: 127] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
BACKGROUND AND OBJECTIVES Human fear conditioning is widely regarded as one of the prime paradigms for the study of fear and anxiety disorders. We provide an evaluation of a commonly used subjective measure in the human fear conditioning paradigm, namely the US-expectancy measurement. METHODS We assess the validity of US-expectancy with respect to conditions of pathological fear and anxiety using four established criteria for scrutiny of a laboratory test or model (i.e., face validity, diagnostic validity, predictive validity, construct validity). RESULTS Arguably, there is sufficient evidence for the face validity, diagnostic validity, predictive validity and construct validity of the US-expectancy measure. LIMITATIONS Presumed limitations of the US-expectancy measure, including its susceptibility to experimental demand and memory bias, are discussed. CONCLUSIONS The US-expectancy measure is a valuable measurement method that can be effectively used in research that aims to enhance our understanding of fear and anxiety disorders.
Collapse
|
12
|
Abstract
Substantial advances in our understanding of the neural bases of emotional processing have been made over the past decades. Overall, studies in humans and other animals highlight the key role of the amygdala in the detection and evaluation of stimuli with affective value. Nonetheless, contradictory findings have been reported, especially in terms of the exact role of this structure in the processing of different emotions, giving rise to different neural models of emotion. For instance, although the amygdala has traditionally been considered as exclusively involved in fear (and possibly anger), more recent work suggests that it may be important for processing other types of emotions, and even nonemotional information. A review of the main findings in this field is presented here, together with some of the hypotheses that have been put forward to interpret this literature and explain its inconsistencies.
Collapse
Affiliation(s)
- Jorge L. Armony
- Department of Psychiatry, McGill University, Canada; Douglas Mental Health University Institute, Canada; International Laboratory for Brain, Music, and Sound Research (BRAMS), Canada
| |
Collapse
|