1
|
Peters A, Witte J, Helming H, Moeck R, Straube T, Schindler S. How positive and negative feedback following real interactions changes subsequent sender ratings. Sci Rep 2025; 15:7470. [PMID: 40032962 PMCID: PMC11876303 DOI: 10.1038/s41598-025-91750-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2024] [Accepted: 02/24/2025] [Indexed: 03/05/2025] Open
Abstract
Social evaluative feedback informs us about how others perceive us, constantly updates our expectations of what to receive, and simultaneously changes our view of the sender. However, little is known about the neuronal and behavioral responses when receiving incongruent positive or negative social evaluative feedback. This study (N = 40) investigated how receiving feedback from peers after a real-life interaction modulates behavioral responses and Event-Related Potentials (ERPs). Specifically, ERP modulations by feedback being incongruent with the self-view and incongruent with the feedback expectation were examined along the whole processing stream. Feedback was manipulated such that one peer provided overly positive feedback and the other overly negative feedback, with random computer feedback as a control condition. Behaviorally, participants updated their feedback expectations according to the feedback received from the 'negative' and 'positive' peers and rapidly changed ratings of the sender towards their positive or negative behavior. Concerning ERPs, separate effects of feedback incongruence based on the feedback expectation or self-view were found during the mid-latency processing stages. Subsequently, both types of incongruence increased late ERP amplitudes, which were also increased when participants substantially changed the ratings of the peer senders. This is the first study that combined neuronal and behavioral measures of evaluative feedback processing, emphasizing that incongruent feedback elicits mid-latency modulations and subsequent updating processes associated with increased late amplitudes. In addition, we find rapid behavioral changes in the ratings for the senders based on their feedback behavior.
Collapse
Affiliation(s)
- Antje Peters
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Von-Esmarch Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany
| | - Jendrik Witte
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Von-Esmarch Straße 52, 48149, Münster, Germany
| | - Hanne Helming
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Von-Esmarch Straße 52, 48149, Münster, Germany
| | - Robert Moeck
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Von-Esmarch Straße 52, 48149, Münster, Germany
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Von-Esmarch Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany
| | - Sebastian Schindler
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Von-Esmarch Straße 52, 48149, Münster, Germany.
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany.
| |
Collapse
|
2
|
de Echegaray J, Keil A, Müller MM. Neural dynamics of attentional resource allocation in early visual cortex: emotional scenes produce competitive interactions. Cereb Cortex 2024; 34:bhae428. [PMID: 39656648 DOI: 10.1093/cercor/bhae428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 09/09/2024] [Accepted: 10/16/2024] [Indexed: 12/17/2024] Open
Abstract
Salient emotional visual cues receive prioritized processing in human visual cortex. To what extent emotional facilitation relies on preattentional stimulus processing preceding semantic analysis remains controversial. Making use of steady-state visual evoke potentials frequency-tagged to meaningful complex emotional scenes and their scrambled versions, presented in a 4-Hz rapid serial visual presentation fashion, the current study tested temporal dynamics of semantic and emotional cue processing. The neural dynamics of bottom-up capture of attention driven by concrete images were analyzed under a passive-viewing-like scenario and in a competitive context, where a concurrent foreground task realized with a random dot kinematogram flickering at 15 Hz enabled the concurrent monitoring of top-down selective attention. Aligned with the semantic primacy hypothesis, the steady-state visual evoke potentials' results provide evidence of an initial rapid capture of attention driven by objecthood, followed by heightened deployment of attentional resources to emotional scenes that remained stable for the entire stimulation period. We replicated previous findings in which emotional distractors first prompt visuocortical facilitation, followed by suppression of a concurrent foreground task. Modeling this time-delayed competition process fit the data better than a time-invariant trade-off between concurrent cues as assumed by most models of selective attention.
Collapse
Affiliation(s)
- Javier de Echegaray
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Neumarkt 9-19, Leipzig 04109, Germany
| | - Andreas Keil
- Department of Psychology, University of Florida, Gainesville, FL 32611, United States
| | - Matthias M Müller
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Neumarkt 9-19, Leipzig 04109, Germany
| |
Collapse
|
3
|
Huang X, Gao L, Xiao J, Li L, Shan X, Chen H, Chai X, Duan X. Family Environment Modulates Linkage of Transdiagnostic Psychiatric Phenotypes and Dissociable Brain Features in the Developing Brain. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2024; 9:928-938. [PMID: 38537777 DOI: 10.1016/j.bpsc.2024.03.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Revised: 02/26/2024] [Accepted: 03/16/2024] [Indexed: 06/04/2024]
Abstract
BACKGROUND Family environment has long been known for shaping brain function and psychiatric phenotypes, especially during childhood and adolescence. Accumulating neuroimaging evidence suggests that across different psychiatric disorders, common phenotypes may share common neural bases, indicating latent brain-behavior relationships beyond diagnostic categories. However, the influence of family environment on the brain-behavior relationship from a transdiagnostic perspective remains unknown. METHODS We included a community-based sample of 699 participants (ages 5-22 years) and applied partial least squares regression analysis to determine latent brain-behavior relationships from whole-brain functional connectivity and comprehensive phenotypic measures. Comparisons were made between diagnostic and nondiagnostic groups to help interpret the latent brain-behavior relationships. A moderation model was introduced to examine the potential moderating role of family factors in the estimated brain-behavior associations. RESULTS Four significant latent brain-behavior pairs were identified that reflected the relationship of dissociable brain network and general behavioral problems, cognitive and language skills, externalizing problems, and social dysfunction, respectively. The group comparisons exhibited interpretable variations across different diagnostic groups. A warm family environment was found to moderate the brain-behavior relationship of core symptoms in internalizing disorders. However, in neurodevelopmental disorders, family factors were not found to moderate the brain-behavior relationship of core symptoms, but they were found to affect the brain-behavior relationship in other domains. CONCLUSIONS Our findings leveraged a transdiagnostic analysis to investigate the moderating effects of family factors on brain-behavior associations, emphasizing the different roles that family factors play during this developmental period across distinct diagnostic groups.
Collapse
Affiliation(s)
- Xinyue Huang
- Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Leying Gao
- Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec, Canada
| | - Jinming Xiao
- Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Lei Li
- Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Xiaolong Shan
- Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Huafu Chen
- Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Xiaoqian Chai
- Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec, Canada.
| | - Xujun Duan
- Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| |
Collapse
|
4
|
Peters A, Helming H, Bruchmann M, Wiegandt A, Straube T, Schindler S. How and when social evaluative feedback is processed in the brain: A systematic review on ERP studies. Cortex 2024; 173:187-207. [PMID: 38422855 DOI: 10.1016/j.cortex.2024.02.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 02/15/2024] [Accepted: 02/16/2024] [Indexed: 03/02/2024]
Abstract
Social evaluative feedback informs the receiver of the other's views, which may contain judgments of personality-related traits and/or the level of likability. Such kinds of social evaluative feedback are of particular importance to humans. Event-related potentials (ERPs) can directly measure where in the processing stream feedback valence, expectancy, or contextual relevance modulate information processing. This review provides an overview and systematization of studies and early, mid-latency, and late ERP effects. Early effects were inconsistently reported for all factors. Feedback valence effects are more consistently reported for specific mid-latency ERPs (Reward Positivity, RewP, and Early Posterior Negativity, EPN) and late positivities (P3 and Late Positive Potential, LPP). Unexpected feedback consistently increased the Feedback Related Negativity (FRN) and, less consistently, decreased P3 amplitudes. Contextual relevance of the sender (e.g., human vs computer sender) or self-relatedness increased mid-latency to late ERPs. Interactions between valence and other factors were less often found, arising during mid-latency stages, where most consistent interactions showed larger EPN and P3 amplitude differences for valent feedback in a more relevant context. The ERP findings highlight that social evaluative feedback is consistently differentiated during mid-latency processing stages. The review discusses the relevance of findings, possible shortcomings of different experimental designs, and open questions. Furthermore, we suggest concrete venues for future research.
Collapse
Affiliation(s)
- Antje Peters
- Institute for Medical Psychology and Systems Neuroscience, University of Münster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Germany
| | - Hanne Helming
- Institute for Medical Psychology and Systems Neuroscience, University of Münster, Germany
| | - Maximilian Bruchmann
- Institute for Medical Psychology and Systems Neuroscience, University of Münster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Germany
| | - Anja Wiegandt
- Institute for Medical Psychology and Systems Neuroscience, University of Münster, Germany
| | - Thomas Straube
- Institute for Medical Psychology and Systems Neuroscience, University of Münster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Germany
| | - Sebastian Schindler
- Institute for Medical Psychology and Systems Neuroscience, University of Münster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Germany.
| |
Collapse
|
5
|
Edmiston EK, Chase HW, Jones N, Nhan TJ, Phillips ML, Fournier JC. Differential role of fusiform gyrus coupling in depressive and anxiety symptoms during emotion perception. Soc Cogn Affect Neurosci 2024; 19:nsae009. [PMID: 38334745 PMCID: PMC10908550 DOI: 10.1093/scan/nsae009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 12/06/2023] [Accepted: 02/01/2024] [Indexed: 02/10/2024] Open
Abstract
Anxiety and depression co-occur; the neural substrates of shared and unique components of these symptoms are not understood. Given emotional alterations in internalizing disorders, we hypothesized that function of regions associated with emotion processing/regulation, including the anterior cingulate cortex (ACC), amygdala and fusiform gyrus (FG), would differentiate these symptoms. Forty-three adults with depression completed an emotional functional magnetic resonance imaging task and the Hamilton Depression and Anxiety Scales. We transformed these scales to examine two orthogonal components, one representing internalizing symptom severity and the other the type of internalizing symptoms (anxiety vs depression). We extracted blood oxygen level dependent signal from FG subregions, ACC, and amygdala and performed generalized psychophysiological interaction analyses to assess relationships between symptoms and brain function. Type of internalizing symptoms was associated with FG3-FG1 coupling (F = 8.14, P = 0.007). More coupling was associated with a higher concentration of depression, demonstrating that intra-fusiform coupling is differentially associated with internalizing symptom type (anxiety vs depression). We found an interaction between task condition and internalizing symptoms and dorsal (F = 4.51, P = 0.014) and rostral ACC activity (F = 4.27, P = 0.012). Post hoc comparisons revealed that less activity was associated with greater symptom severity during emotional regulation. Functional coupling differences during emotional processing are associated with depressive relative to anxiety symptoms and internalizing symptom severity. These findings could inform future treatments for depression.
Collapse
Affiliation(s)
- Elliot Kale Edmiston
- Department of Psychiatry, University of Massachusetts Chan Medical School, Worcester, MA 01605, United States
| | - Henry W Chase
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, United States
| | - Neil Jones
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, United States
| | - Tiffany J Nhan
- Department of Psychiatry, University of Massachusetts Chan Medical School, Worcester, MA 01605, United States
| | - Mary L Phillips
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, United States
| | - Jay C Fournier
- Department of Psychiatry and Behavioral Health, The Ohio State University College of Medicine, Columbus, OH 43210, United States
| |
Collapse
|
6
|
Zhao L, Wu Z, Dai H, Liu Z, Hu X, Zhang T, Zhu D, Liu T. A generic framework for embedding human brain function with temporally correlated autoencoder. Med Image Anal 2023; 89:102892. [PMID: 37482031 DOI: 10.1016/j.media.2023.102892] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Revised: 03/19/2023] [Accepted: 07/06/2023] [Indexed: 07/25/2023]
Abstract
Learning an effective and compact representation of human brain function from high-dimensional fMRI data is crucial for studying the brain's functional organization. Traditional representation methods such as independent component analysis (ICA) and sparse dictionary learning (SDL) mainly rely on matrix decomposition which represents the brain function as spatial brain networks and the corresponding temporal patterns. The correspondence of those brain networks across individuals are built by viewing them as one-hot vectors and then performing the matching. However, those one-hot vectors do not encode the regularity and/or variability of different brains very well, and thus are limited in effectively representing the functional brain activities across individuals and among different time points. To address this problem, in this paper, we formulate the human brain functional representation as an embedding problem, and propose a novel embedding framework based on the Transformer model to encode the brain function in a compact, stereotyped and comparable latent space where the brain activities are represented as dense embedding vectors. We evaluate the proposed embedding framework on the publicly available Human Connectome Project (HCP) task fMRI dataset. The experiments on brain state prediction task indicate the effectiveness and generalizability of the learned embedding. We also explore the interpretability of the learned embedding from both spatial and temporal perspective. In general, our approach provides novel insights on representing the regularity and variability of human brain function in a general, comparable, and stereotyped latent space.
Collapse
Affiliation(s)
- Lin Zhao
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Zihao Wu
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Haixing Dai
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Zhengliang Liu
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Xintao Hu
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Tuo Zhang
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington 76019, USA.
| | - Tianming Liu
- School of Computing, The University of Georgia, Athens 30602, USA.
| |
Collapse
|
7
|
Arias Sarah P, Hall L, Saitovitch A, Aucouturier JJ, Zilbovicius M, Johansson P. Pupil dilation reflects the dynamic integration of audiovisual emotional speech. Sci Rep 2023; 13:5507. [PMID: 37016041 PMCID: PMC10073148 DOI: 10.1038/s41598-023-32133-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 03/22/2023] [Indexed: 04/06/2023] Open
Abstract
Emotional speech perception is a multisensory process. When speaking with an individual we concurrently integrate the information from their voice and face to decode e.g., their feelings, moods, and emotions. However, the physiological reactions-such as the reflexive dilation of the pupil-associated to these processes remain mostly unknown. That is the aim of the current article, to investigate whether pupillary reactions can index the processes underlying the audiovisual integration of emotional signals. To investigate this question, we used an algorithm able to increase or decrease the smiles seen in a person's face or heard in their voice, while preserving the temporal synchrony between visual and auditory channels. Using this algorithm, we created congruent and incongruent audiovisual smiles, and investigated participants' gaze and pupillary reactions to manipulated stimuli. We found that pupil reactions can reflect emotional information mismatch in audiovisual speech. In our data, when participants were explicitly asked to extract emotional information from stimuli, the first fixation within emotionally mismatching areas (i.e., the mouth) triggered pupil dilation. These results reveal that pupil dilation can reflect the dynamic integration of audiovisual emotional speech and provide insights on how these reactions are triggered during stimulus perception.
Collapse
Affiliation(s)
- Pablo Arias Sarah
- Lund University Cognitive Science, Lund University, Lund, Sweden.
- STMS Lab, UMR 9912 (IRCAM/CNRS/SU), Paris, France.
- School of Neuroscience and Psychology, Glasgow University, Glasgow, UK.
| | - Lars Hall
- STMS Lab, UMR 9912 (IRCAM/CNRS/SU), Paris, France
| | - Ana Saitovitch
- U1000 Brain Imaging in Psychiatry, INSERM-CEA, Pediatric Radiology Service, Necker Enfants Malades Hospital, Paris V René Descartes University, Paris, France
| | - Jean-Julien Aucouturier
- Department of Robotics and Automation FEMTO-ST Institute (CNRS/Université de Bourgogne Franche Comté), Besançon, France
| | - Monica Zilbovicius
- U1000 Brain Imaging in Psychiatry, INSERM-CEA, Pediatric Radiology Service, Necker Enfants Malades Hospital, Paris V René Descartes University, Paris, France
| | | |
Collapse
|
8
|
Vormbrock R, Bruchmann M, Menne L, Straube T, Schindler S. Testing stimulus exposure time as the critical factor of increased EPN and LPP amplitudes for fearful faces during perceptual distraction tasks. Cortex 2023; 160:9-23. [PMID: 36680924 DOI: 10.1016/j.cortex.2022.12.011] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 12/18/2022] [Accepted: 12/20/2022] [Indexed: 12/31/2022]
Abstract
Fearful facial expressions are prioritized across different information processing stages, as evident in early, intermediate, and late components of event-related brain potentials (ERPs). Recent studies showed that, in contrast to early N170 modulations, mid-latency (Early Posterior Negativity, EPN) and late (Late Positive Potential, LPP) emotional modulations depend on the attended perceptual feature. Nevertheless, several studies reported significant differences between emotional and neutral faces for the EPN or LPP components during distraction tasks. One cause for these conflicting findings might be that when faces are presented sufficiently long, participants attend to task-irrelevant features of the faces. In this registered report, we tested whether the presentation duration of faces is the critical factor for differences between reported emotional modulations during perceptual distraction tasks. To this end, 48 participants were required to discriminate the orientation of lines overlaid onto fearful or neutral faces, while face presentation varied (100 msec, 300 msec, 1,000 msec, 2,000 msec). While participants did not need to pay attention to the faces, we observed main effects of emotion for the EPN and LPP, but no interaction between emotion and presentation duration. Of note, unregistered exploratory tests per presentation duration showed no significant EPN and LPP emotion differences during short durations (100 and 300 msec) but significant differences with longer durations. While the presentation duration seems not to be a critical factor for EPN and LPP emotion effects, future studies are needed to investigate the role of threshold effects and the applied analytic designs to explain conflicting findings in the literature.
Collapse
Affiliation(s)
- Ria Vormbrock
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Germany
| | - Maximilian Bruchmann
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Germany
| | - Lucas Menne
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Germany
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Germany
| | - Sebastian Schindler
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Germany.
| |
Collapse
|
9
|
Bo K, Cui L, Yin S, Hu Z, Hong X, Kim S, Keil A, Ding M. Decoding the temporal dynamics of affective scene processing. Neuroimage 2022; 261:119532. [PMID: 35931307 DOI: 10.1016/j.neuroimage.2022.119532] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 07/01/2022] [Accepted: 08/01/2022] [Indexed: 10/31/2022] Open
Abstract
Natural images containing affective scenes are used extensively to investigate the neural mechanisms of visual emotion processing. Functional fMRI studies have shown that these images activate a large-scale distributed brain network that encompasses areas in visual, temporal, and frontal cortices. The underlying spatial and temporal dynamics, however, remain to be better characterized. We recorded simultaneous EEG-fMRI data while participants passively viewed affective images from the International Affective Picture System (IAPS). Applying multivariate pattern analysis to decode EEG data, and representational similarity analysis to fuse EEG data with simultaneously recorded fMRI data, we found that: (1) ∼80 ms after picture onset, perceptual processing of complex visual scenes began in early visual cortex, proceeding to ventral visual cortex at ∼100 ms, (2) between ∼200 and ∼300 ms (pleasant pictures: ∼200 ms; unpleasant pictures: ∼260 ms), affect-specific neural representations began to form, supported mainly by areas in occipital and temporal cortices, and (3) affect-specific neural representations were stable, lasting up to ∼2 s, and exhibited temporally generalizable activity patterns. These results suggest that affective scene representations in the brain are formed temporally in a valence-dependent manner and may be sustained by recurrent neural interactions among distributed brain areas.
Collapse
Affiliation(s)
- Ke Bo
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA; Department of Psychological and Brain Sciences, Dartmouth college, Hanover, NH 03755, USA
| | - Lihan Cui
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Siyang Yin
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Zhenhong Hu
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Xiangfei Hong
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA; Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, 200030, China
| | - Sungkean Kim
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA; Department of Human-Computer Interaction, Hanyang University, Ansan, Republic of Korea
| | - Andreas Keil
- Department of Psychology, University of Florida, Gainesville, FL 32611, USA.
| | - Mingzhou Ding
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA.
| |
Collapse
|
10
|
Reisch LM, Wegrzyn M, Mielke M, Mehlmann A, Woermann FG, Kissler J, Bien CG. Effects of left and right medial temporal lobe resections on hemodynamic correlates of negative and neutral scene processing. Hum Brain Mapp 2022; 43:3293-3305. [PMID: 35384132 PMCID: PMC9189037 DOI: 10.1002/hbm.25852] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Revised: 03/07/2022] [Accepted: 03/21/2022] [Indexed: 01/04/2023] Open
Abstract
Enhanced visual cortex activation by negative compared to neutral stimuli is often attributed to modulating feedback from the amygdala, but evidence from lesion studies is scarce, particularly regarding differential effects of left and right amygdala lesions. Therefore, we compared visual cortex activation by negative and neutral complex scenes in an event‐related fMRI study between 40 patients with unilateral temporal lobe resection (TLR; 19 left [lTLR], 21 right [rTLR]), including the amygdala, and 20 healthy controls. We found preserved hemodynamic emotion modulation of visual cortex in rTLR patients and only subtle reductions in lTLR patients. In contrast, rTLR patients showed a significant decrease in visual cortex activation irrespective of picture content. In line with this, healthy controls showed small emotional modulation of the left amygdala only, while their right amygdala was activated equally by negative and neutral pictures. Correlations of activation in amygdala and visual cortex were observed for both negative and neutral pictures in the controls. In both patient groups, this relationship was attenuated ipsilateral to the TLR. Our results support the notion of reentrant mechanisms between amygdala and visual cortex and suggest laterality differences in their emotion‐specificity. While right medial temporal lobe structures including the amygdala seem to influence visual processing in general, the left medial temporal lobe appears to contribute specifically to emotion processing. Still, effects of left TLR on visual emotion processing were relatively subtle. Therefore, hemodynamic correlates of visual emotion processing are likely supported by a distributed cerebral network, challenging an amygdalocentric view of emotion processing.
Collapse
Affiliation(s)
- Lea Marie Reisch
- Department of Psychology, Bielefeld University, Bielefeld, Germany.,Department of Epileptology (Krankenhaus Mara), Bielefeld University, Bielefeld, Germany
| | - Martin Wegrzyn
- Department of Psychology, Bielefeld University, Bielefeld, Germany
| | - Malena Mielke
- Department of Psychology, Bielefeld University, Bielefeld, Germany
| | | | - Friedrich G Woermann
- Department of Epileptology (Krankenhaus Mara), Bielefeld University, Bielefeld, Germany
| | - Johanna Kissler
- Department of Psychology, Bielefeld University, Bielefeld, Germany
| | - Christian G Bien
- Department of Epileptology (Krankenhaus Mara), Bielefeld University, Bielefeld, Germany
| |
Collapse
|
11
|
Sambuco N. fMRI replicability during emotional scene viewing: Functional regions and sample size. Psychophysiology 2022; 59:e14000. [PMID: 35001394 DOI: 10.1111/psyp.14000] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 11/04/2021] [Accepted: 12/13/2021] [Indexed: 11/28/2022]
Abstract
Recent findings have questioned the replicability of functional magnetic resonance imaging (fMRI) in the study of affective processing, reporting low replicability of emotional enhancement during a face-matching task. However, poor replicability may instead reflect a lack of emotional engagement for face matching. In the current study, replicability of emotional enhancement was tested in a large (N = 160) sample when emotional engagement was assessed during pleasant, neutral, and unpleasant picture viewing, which reliably engages affective reactions in both the brain and the body. Replicability was computed using a subsampling technique, in which random sets of subjects of different sample sizes (N = 20, 40, 60, 80) were selected from the entire dataset, and replicability of emotional enhancement for peaks, clusters, and voxels were averaged across 500 permutations for each sample size. Consistent with previous findings, fMRI replicability increased with increasing sample size. On the other hand, even with relatively small samples, fMRI replicability for peaks, clusters, and voxels during emotional, compared to neutral, scene viewing was good to excellent. Importantly, replicability varied in different brain regions, with excellent replicability at both the cluster and peak level with an N of 40, at the most conservative threshold (p < .001), in the amygdala and the visual cortex. The data argue against general recommendations regarding sample size in fMRI studies of emotion, suggesting instead that degree of replicability depends on successful emotional engagement in task-related brain regions.
Collapse
Affiliation(s)
- Nicola Sambuco
- Center for the Study of Emotion and Attention, University of Florida, Gainesville, Florida, USA
| |
Collapse
|
12
|
Bo K, Yin S, Liu Y, Hu Z, Meyyappan S, Kim S, Keil A, Ding M. Decoding Neural Representations of Affective Scenes in Retinotopic Visual Cortex. Cereb Cortex 2021; 31:3047-3063. [PMID: 33594428 DOI: 10.1093/cercor/bhaa411] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Revised: 12/18/2020] [Accepted: 12/21/2020] [Indexed: 12/28/2022] Open
Abstract
The perception of opportunities and threats in complex visual scenes represents one of the main functions of the human visual system. The underlying neurophysiology is often studied by having observers view pictures varying in affective content. It has been shown that viewing emotionally engaging, compared with neutral, pictures (1) heightens blood flow in limbic, frontoparietal, and anterior visual structures and (2) enhances the late positive event-related potential (LPP). The role of retinotopic visual cortex in this process has, however, been contentious, with competing theories predicting the presence versus absence of emotion-specific signals in retinotopic visual areas. Recording simultaneous electroencephalography-functional magnetic resonance imaging while observers viewed pleasant, unpleasant, and neutral affective pictures, and applying multivariate pattern analysis, we found that (1) unpleasant versus neutral and pleasant versus neutral decoding accuracy were well above chance level in retinotopic visual areas, (2) decoding accuracy in ventral visual cortex (VVC), but not in early or dorsal visual cortex, was correlated with LPP, and (3) effective connectivity from amygdala to VVC predicted unpleasant versus neutral decoding accuracy, whereas effective connectivity from ventral frontal cortex to VVC predicted pleasant versus neutral decoding accuracy. These results suggest that affective scenes evoke valence-specific neural representations in retinotopic visual cortex and that these representations are influenced by reentry signals from anterior brain regions.
Collapse
Affiliation(s)
- Ke Bo
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Siyang Yin
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Yuelu Liu
- Center for Mind and Brain, University of California, Davis, CA 95618, USA
| | - Zhenhong Hu
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Sreenivasan Meyyappan
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Sungkean Kim
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Andreas Keil
- Department of Psychology, University of Florida, Gainesville, FL 32611, USA
| | - Mingzhou Ding
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| |
Collapse
|
13
|
Schindler S, Bruchmann M, Steinweg AL, Moeck R, Straube T. Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces. Soc Cogn Affect Neurosci 2020; 15:765-774. [PMID: 32701163 PMCID: PMC7511883 DOI: 10.1093/scan/nsaa098] [Citation(s) in RCA: 45] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 06/17/2020] [Accepted: 07/11/2020] [Indexed: 11/14/2022] Open
Abstract
The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.
Collapse
Affiliation(s)
- Sebastian Schindler
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Münster D-48149, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Münster D-48149, Germany
| | - Maximilian Bruchmann
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Münster D-48149, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Münster D-48149, Germany
| | - Anna-Lena Steinweg
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Münster D-48149, Germany
| | - Robert Moeck
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Münster D-48149, Germany
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University of Muenster, Münster D-48149, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Münster D-48149, Germany
| |
Collapse
|
14
|
Schindler S, Bublatzky F. Attention and emotion: An integrative review of emotional face processing as a function of attention. Cortex 2020; 130:362-386. [DOI: 10.1016/j.cortex.2020.06.010] [Citation(s) in RCA: 86] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Revised: 05/28/2020] [Accepted: 06/29/2020] [Indexed: 11/25/2022]
|
15
|
Sambuco N, Costa VD, Lang PJ, Bradley MM. Aversive perception in a threat context: Separate and independent neural activation. Biol Psychol 2020; 154:107926. [PMID: 32621851 PMCID: PMC7490760 DOI: 10.1016/j.biopsycho.2020.107926] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2020] [Revised: 06/22/2020] [Accepted: 06/26/2020] [Indexed: 11/19/2022]
Abstract
Unpleasant, compared to neutral, scenes reliably prompt enhanced functional brain activity in the amygdala and inferotemporal cortex. Considering data from psychophysiological studies in which defensive reactivity is further enhanced when viewing unpleasant scenes under threat of shock (compared to safety), the current study investigates functional activation in the amygdala-inferotemporal circuit when unpleasant (or neutral) scenes are viewed under threat of shock or safety. In this paradigm, a cue signaling threat or safety was presented in conjunction with either an unpleasant or neutral picture. Replicating previous studies, unpleasant, compared to neutral, scenes reliably enhanced activation in the amygdala and inferotemporal cortex. Functional activity in these regions, however, did not differ whether scenes were presented in a context threatening shock exposure, compared to safety, which instead activated regions of the anterior insula and cingulate cortex. Taken together, the data support a view in which neural regions activated in different defensive situations act independently.
Collapse
Affiliation(s)
- Nicola Sambuco
- Center for the Study of Emotion and Attention, University of Florida, Gainesville, FL, United States.
| | - Vincent D Costa
- Department of Behavioral Neuroscience, Oregon Health & Science University, United States
| | - Peter J Lang
- Center for the Study of Emotion and Attention, University of Florida, Gainesville, FL, United States
| | - Margaret M Bradley
- Center for the Study of Emotion and Attention, University of Florida, Gainesville, FL, United States
| |
Collapse
|
16
|
Schindler S, Straube T. Selective visual attention to emotional pictures: Interactions of task‐relevance and emotion are restricted to the late positive potential. Psychophysiology 2020; 57:e13585. [DOI: 10.1111/psyp.13585] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Revised: 03/17/2020] [Accepted: 03/23/2020] [Indexed: 01/31/2023]
Affiliation(s)
- Sebastian Schindler
- Institute of Medical Psychology and Systems Neuroscience University of Muenster Münster Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience University of Muenster Münster Germany
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience University of Muenster Münster Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience University of Muenster Münster Germany
| |
Collapse
|
17
|
Functional Imaging of Visuospatial Attention in Complex and Naturalistic Conditions. Curr Top Behav Neurosci 2020. [PMID: 30547430 DOI: 10.1007/7854_2018_73] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/30/2023]
Abstract
One of the ultimate goals of cognitive neuroscience is to understand how the brain works in the real world. Functional imaging with naturalistic stimuli provides us with the opportunity to study the brain in situations similar to the everyday life. This includes the processing of complex stimuli that can trigger many types of signals related both to the physical characteristics of the external input and to the internal knowledge that we have about natural objects and environments. In this chapter, I will first outline different types of stimuli that have been used in naturalistic imaging studies. These include static pictures, short video clips, full-length movies, and virtual reality, each comprising specific advantages and disadvantages. Next, I will turn to the main issue of visual-spatial orienting in naturalistic conditions and its neural substrates. I will discuss different classes of internal signals, related to objects, scene structure, and long-term memory. All of these, together with external signals about stimulus salience, have been found to modulate the activity and the connectivity of the frontoparietal attention networks. I will conclude by pointing out some promising future directions for functional imaging with naturalistic stimuli. Despite this field of research is still in its early days, I consider that it will play a major role in bridging the gap between standard laboratory paradigms and mechanisms of brain functioning in the real world.
Collapse
|
18
|
Frank DW, Costa VD, Averbeck BB, Sabatinelli D. Directional interconnectivity of the human amygdala, fusiform gyrus, and orbitofrontal cortex in emotional scene perception. J Neurophysiol 2019; 122:1530-1537. [PMID: 31166811 DOI: 10.1152/jn.00780.2018] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
The perception of emotionally arousing scenes modulates neural activity in ventral visual areas via reentrant signals from the amygdala. The orbitofrontal cortex (OFC) shares dense interconnections with amygdala and has been strongly implicated in emotional stimulus processing in primates, but our understanding of the functional contribution of this region to emotional perception in humans is poorly defined. In this study we acquired targeted rapid functional imaging from lateral OFC, amygdala, and fusiform gyrus (FG) over multiple scanning sessions (resulting in over 1,000 trials per participant) in an effort to define the activation amplitude and directional connectivity among these regions during naturalistic scene perception. All regions of interest showed enhanced activation during emotionally arousing, compared with neutral scenes. In addition, we identified bidirectional connectivity between amygdala, FG, and OFC in the great majority of individual subjects, suggesting that human emotional perception is implemented in part via nonhierarchical causal interactions across these three regions.NEW & NOTEWORTHY Due to the practical limitations of noninvasive recording methodologies, there is a scarcity of data regarding the interactions of human amygdala and orbitofrontal cortex (OFC). Using rapid functional MRI sampling and directional connectivity, we found that the human amygdala influences emotional perception via distinct interactions with late-stage ventral visual cortex and OFC, in addition to distinct interactions between OFC and fusiform gyrus. Future efforts may leverage these patterns of directional connectivity to noninvasively distinguish clinical groups from controls with respect to network causal hierarchy.
Collapse
Affiliation(s)
- David W Frank
- Department of Behavioral Science, The University of Texas MD Anderson Cancer Center, Houston, Texas.,Department of Neuroscience, University of Georgia, Athens, Georgia
| | - Vincent D Costa
- Laboratory of Neuropsychology, National Institute of Mental Health, Bethesda, Maryland
| | - Bruno B Averbeck
- Laboratory of Neuropsychology, National Institute of Mental Health, Bethesda, Maryland
| | - Dean Sabatinelli
- Department of Neuroscience, University of Georgia, Athens, Georgia.,Department of Psychology, University of Georgia, Athens, Georgia
| |
Collapse
|
19
|
Sabatinelli D, Frank DW. Assessing the Primacy of Human Amygdala-Inferotemporal Emotional Scene Discrimination with Rapid Whole-Brain fMRI. Neuroscience 2019; 406:212-224. [DOI: 10.1016/j.neuroscience.2019.03.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2018] [Revised: 02/28/2019] [Accepted: 03/01/2019] [Indexed: 01/09/2023]
|
20
|
Frank DW, Sabatinelli D. Hemodynamic and electrocortical reactivity to specific scene contents in emotional perception. Psychophysiology 2019; 56:e13340. [DOI: 10.1111/psyp.13340] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2018] [Revised: 12/21/2018] [Accepted: 01/04/2019] [Indexed: 12/19/2022]
Affiliation(s)
- David W. Frank
- Department of Neuroscience, BioImaging Research Center University of Georgia Athens Georgia
- Department of Behavioral Science MD Anderson Cancer Center Houston Texas
| | - Dean Sabatinelli
- Department of Neuroscience, BioImaging Research Center University of Georgia Athens Georgia
- Department of Psychology University of Georgia Athens Georgia
| |
Collapse
|
21
|
Rüther T, Schultz Y, Wirth C, Chrobok A, Rabenstein A, Keeser D, Ertl-Wagner B, Pogarell O, Karch S. Effect of smoking status on neuronal responses to graphic cigarette warning labels. PLoS One 2018; 13:e0201360. [PMID: 30235214 PMCID: PMC6147412 DOI: 10.1371/journal.pone.0201360] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2017] [Accepted: 07/13/2018] [Indexed: 11/19/2022] Open
Abstract
Background Smoking is responsible for a large proportion of cancer, respiratory and cardiovascular deaths. Nevertheless the health risks of smoking are still underestimated in many smokers. The present study aimed to examine neurobiological responses to graphical warnings on cigarette packings in non-smokers and patients with tobacco dependence. Methods Twenty non-smokers and twenty-four patients with tobacco dependence participated in a functional MRI study during that pictures of different categories were presented ((a) EU-warning pictures, (b) text-only warnings, (c) neutral pictures with short information). Patients contributed twice in the experiment (after 10 hours nicotine withdrawal / about 5 minutes after nicotine consumption). Results Smokers during withdrawal demonstrated increased neuronal responses predominantly in subcortical, temporal and frontal brain regions that are associated with emotional and cognitive processes during the presentation of graphical warnings compared to neutral pictures. In smokers after smoking and non-smokers, the differences between graphical warnings and neutral pictures were increased compared to smokers during withdrawal. The comparison of the graphical warnings with text-only labels demonstrated the importance of affective brain regions especially in smokers after smoking and in non-smokers. During withdrawal, the neural responses associated with graphical warnings and text-only labels differed only marginally. Discussion and conclusion The results suggest that emotional and cognitive reactions to graphical warnings are predominantly seen in smokers after smoking and in non-smokers. The impact of these pictures during withdrawal seems to be less pronounced; in this case, more unspecific processes seem to be important, including the projection of sensory signals to the cerebral cortex.
Collapse
Affiliation(s)
- Tobias Rüther
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
- * E-mail:
| | - Yannick Schultz
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
| | - Christina Wirth
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
| | - Agnieszka Chrobok
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
| | - Andrea Rabenstein
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
| | - Daniel Keeser
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
- Institute of Clinical Radiology, Ludwig Maximilian University, Munich, Germany
| | - Birgit Ertl-Wagner
- Institute of Clinical Radiology, Ludwig Maximilian University, Munich, Germany
| | - Oliver Pogarell
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
| | - Susanne Karch
- Department of Psychiatry und Psychotherapy, Ludwig Maximilian University, Munich, Germany
| |
Collapse
|
22
|
Bast N, Poustka L, Freitag CM. The locus coeruleus-norepinephrine system as pacemaker of attention - a developmental mechanism of derailed attentional function in autism spectrum disorder. Eur J Neurosci 2018; 47:115-125. [DOI: 10.1111/ejn.13795] [Citation(s) in RCA: 51] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2016] [Revised: 12/04/2017] [Accepted: 12/07/2017] [Indexed: 12/31/2022]
Affiliation(s)
- Nico Bast
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy; University Hospital; Goethe University Frankfurt am Main; Deutschordenstraße 50 60528 Frankfurt am Main Germany
- Department of Child and Adolescent Psychiatry and Psychotherapy; Medical Faculty Mannheim; Central Institute of Mental Health; Heidelberg University; Heidelberg Germany
| | - Luise Poustka
- Department of Child and Adolescent Psychiatry and Psychotherapy; Medical Faculty Mannheim; Central Institute of Mental Health; Heidelberg University; Heidelberg Germany
- Department of Child and Adolescent Psychiatry/Psychotherapy; University Medical Center Göttingen; Medical University of Göttingen; Göttingen Germany
| | - Christine M. Freitag
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy; University Hospital; Goethe University Frankfurt am Main; Deutschordenstraße 50 60528 Frankfurt am Main Germany
| |
Collapse
|
23
|
Miller KJ, Hermes D, Pestilli F, Wig GS, Ojemann JG. Face percept formation in human ventral temporal cortex. J Neurophysiol 2017; 118:2614-2627. [PMID: 28814631 DOI: 10.1152/jn.00113.2017] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2017] [Revised: 08/09/2017] [Accepted: 08/10/2017] [Indexed: 01/19/2023] Open
Abstract
Loci in ventral temporal cortex are selectively active during viewing of faces and other objects, but it remains unclear whether these areas represent accumulation of simple visual information or processing of intact percept. We measured broadband electrocorticographic changes from implanted electrodes on the ventral temporal brain surface while showing patients noise-degraded images of faces and houses. In a subset of posterior fusiform gyrus face-selective regions, cortical activity decreased parametrically with noise increase, until the perceptual threshold was surpassed. At noise levels higher than the perceptual threshold, and for house stimuli, activity remained at baseline. We propose that this convergence of proportional and thresholded response may identify active areas where face percepts are extracted from simple visual features. These loci exist within a topological structure of face percept formation in the human ventral visual stream, preceded by category-nonselective activity in pericalcarine early visual areas and in concert with all-or-nothing activity in postperceptual subregions of the ventral temporal lobe. This topological organization suggests a physiological basis for the anatomy of face perception, explaining different perceptual deficits following temporal lobe injury.NEW & NOTEWORTHY Philosophers have puzzled for millennia about how humans build abstract conceptual objects (house/face/tool) from the simple features of the world they see around them (line/patch/lighting). Understanding the biological foundation of this process requires detailed knowledge of the spatial-temporal characteristics of cerebral cortex. By examining the physiology of the human temporal lobe via implanted electrodes while showing subjects noise-degraded images, we find that face percept formation happens in specific subregions within known face-processing areas.
Collapse
Affiliation(s)
- Kai J Miller
- Department of Neurosurgery, Stanford University, Stanford, California; .,Program in Neurobiology and Behavior, University of Washington, Seattle, Washington
| | - Dora Hermes
- Department of Psychology, Stanford University, Stanford, California
| | - Franco Pestilli
- Department of Psychology, Stanford University, Stanford, California.,Department of Psychology, Program in Neuroscience and Cognitive Science, and Indiana Network Science Institute, Indiana University, Bloomington, Indiana
| | - Gagan S Wig
- School of Behavioral & Brain Sciences, University of Texas at Dallas, Dallas, Texas.,Department of Psychiatry, University of Texas Southwestern Medical Center, Dallas, Texas; and
| | - Jeffrey G Ojemann
- Program in Neurobiology and Behavior, University of Washington, Seattle, Washington.,Department of Neurological Surgery, University of Washington, Seattle, Washington
| |
Collapse
|
24
|
Owens MM, MacKillop J, Gray JC, Hawkshead BE, Murphy CM, Sweet LH. Neural correlates of graphic cigarette warning labels predict smoking cessation relapse. Psychiatry Res 2017; 262:63-70. [PMID: 28236714 PMCID: PMC5404379 DOI: 10.1016/j.pscychresns.2017.02.005] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2016] [Accepted: 02/14/2017] [Indexed: 01/12/2023]
Abstract
Exposure to graphic warning labels (GWLs) on cigarette packaging has been found to produce heightened activity in brain regions central to emotional processing and higher-order cognitive processes. The current study extends this literature by using functional magnetic resonance imaging (fMRI) to investigate neural activation in response to GWLs and use it to predict relapse in an evidence-based smoking cessation treatment program. Participants were 48 treatment-seeking nicotine-dependent smokers who completed an fMRI paradigm in which they were exposed to GWLs, text-only warning labels (TOLs), and matched control stimuli. Subsequently, they enrolled in smoking cessation treatment and their smoking behavior was monitored. Activation in bilateral amygdala, right dorsolateral prefrontal cortex, right inferior frontal gyrus, left medial temporal gyrus, bilateral occipital lobe, and bilateral fusiform gyrus was greater during GWLs than TOLs. Neural response in the ventromedial prefrontal cortex (vmPFC) during exposure to GWLs (relative to a visual control image) predicted relapse during treatment beyond baseline demographic and dependence severity, but response in the amygdala to GWLs did not. These findings suggest that neurocognitive processes in the vmPFC may be critical to understanding how GWL's induce behavior change and may be useful as a predictor of smoking cessation treatment prognosis.
Collapse
Affiliation(s)
- Max M Owens
- Department of Psychology, The University of Georgia, Athens, GA, USA.
| | - James MacKillop
- Department of Psychology, The University of Georgia, Athens, GA, USA; Peter Boris Centre for Addictions Research and Department of Psychiatry and Behavioural Neurosciences, McMaster University/St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada; Department of Psychiatry, Brown University, Providence, RI, USA
| | - Joshua C Gray
- Department of Psychology, The University of Georgia, Athens, GA, USA; Department of Psychiatry, Brown University, Providence, RI, USA
| | | | - Cara M Murphy
- Peter Boris Centre for Addictions Research and Department of Psychiatry and Behavioural Neurosciences, McMaster University/St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada
| | - Lawrence H Sweet
- Department of Psychology, The University of Georgia, Athens, GA, USA; Department of Psychiatry, Brown University, Providence, RI, USA
| |
Collapse
|
25
|
Frank DW, Sabatinelli D. Primate Visual Perception: Motivated Attention in Naturalistic Scenes. Front Psychol 2017; 8:226. [PMID: 28265250 PMCID: PMC5316551 DOI: 10.3389/fpsyg.2017.00226] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2016] [Accepted: 02/06/2017] [Indexed: 12/14/2022] Open
Abstract
Research has consistently revealed enhanced neural activation corresponding to attended cues coupled with suppression to unattended cues. This attention effect depends both on the spatial features of stimuli and internal task goals. However, a large majority of research supporting this effect involves circumscribed tasks that possess few ecologically relevant characteristics. By comparison, natural scenes have the potential to engage an evolved attention system, which may be characterized by supplemental neural processing and integration compared to mechanisms engaged during reduced experimental paradigms. Here, we describe recent animal and human studies of naturalistic scene viewing to highlight the specific impact of social and affective processes on the neural mechanisms of attention modulation.
Collapse
Affiliation(s)
- David W Frank
- Oklahoma Tobacco Research Center, Stephenson Cancer Center, University of Oklahoma Health Sciences CenterOklahoma City, OK, USA; BioImaging Research Center, University of GeorgiaAthens, GA, USA; Division of Neuroscience, University of GeorgiaAthens, GA, USA
| | - Dean Sabatinelli
- BioImaging Research Center, University of GeorgiaAthens, GA, USA; Division of Neuroscience, University of GeorgiaAthens, GA, USA; Department of Psychology, University of GeorgiaAthens, GA, USA
| |
Collapse
|
26
|
On the Neuroscience of Approach and Withdrawal Motivation, with a Focus on the Role of Asymmetrical Frontal Cortical Activity. ACTA ACUST UNITED AC 2016. [DOI: 10.1108/s0749-742320160000019003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register]
|
27
|
Kanayama N, Morandi A, Hiraki K, Pavani F. Causal Dynamics of Scalp Electroencephalography Oscillation During the Rubber Hand Illusion. Brain Topogr 2016; 30:122-135. [PMID: 27620801 DOI: 10.1007/s10548-016-0519-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2016] [Accepted: 09/06/2016] [Indexed: 10/21/2022]
Abstract
Rubber hand illusion (RHI) is an important phenomenon for the investigation of body ownership and self/other distinction. The illusion is promoted by the spatial and temporal contingencies of visual inputs near a fake hand and physical touches to the real hand. The neural basis of this phenomenon is not fully understood. We hypothesized that the RHI is associated with a fronto-parietal circuit, and the goal of this study was to determine the dynamics of neural oscillation associated with this phenomenon. We measured electroencephalography while delivering spatially congruent/incongruent visuo-tactile stimulations to fake and real hands. We applied time-frequency analyses and calculated renormalized partial directed coherence (rPDC) to examine cortical dynamics during the bodily illusion. When visuo-tactile stimulation was spatially congruent, and the fake and real hands were aligned, we observed a reduced causal relationship from the medial frontal to the parietal regions with respect to baseline, around 200 ms post-stimulus. This change in rPDC was negatively correlated with a subjective report of the RHI intensity. Moreover, we observed a link between the proprioceptive drift and an increased causal relationship from the parietal cortex to the right somatosensory cortex during a relatively late period (550-750 ms post-stimulus). These findings suggest a two-stage process in which (1) reduced influence from the medial frontal regions over the parietal areas unlocks the mechanisms that preserve body integrity, allowing RHI to emerge; and (2) information processed at the parietal cortex is back-projected to the somatosensory cortex contralateral to the real hand, inducing proprioceptive drift.
Collapse
Affiliation(s)
- Noriaki Kanayama
- Institute of Biomedical and Health Sciences, Hiroshima University, 1-2-3 Kasumi, Minami, Hiroshima, 734-8551, Japan.
| | - Alberto Morandi
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, Italy
| | - Kazuo Hiraki
- Department of General Systems Studies in Graduate School of Arts and Sciences, University of Tokyo, 3-8-1 Komaba, Meguro, Tokyo, 153-8902, Japan
| | - Francesco Pavani
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, Italy.,Centre for Mind/Brain Sciences, University of Trento, Rovereto, Italy
| |
Collapse
|
28
|
Ventura-Bort C, Löw A, Wendt J, Dolcos F, Hamm AO, Weymar M. When neutral turns significant: brain dynamics of rapidly formed associations between neutral stimuli and emotional contexts. Eur J Neurosci 2016; 44:2176-83. [DOI: 10.1111/ejn.13319] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2016] [Revised: 06/17/2016] [Accepted: 06/22/2016] [Indexed: 01/11/2023]
Affiliation(s)
- Carlos Ventura-Bort
- Department of Biological and Clinical Psychology; University of Greifswald; Franz-Mehring-Str. 47 17487 Greifswald Germany
- Department of Basic and Clinical Psychology, and Psychobiology; Universitat Jaume I; Castellón Spain
| | - Andreas Löw
- Department of Humanities and Social Sciences; Helmut-Schmidt-University/University of the Federal Armed Forces Hamburg; Hamburg Germany
| | - Julia Wendt
- Department of Biological and Clinical Psychology; University of Greifswald; Franz-Mehring-Str. 47 17487 Greifswald Germany
| | - Florin Dolcos
- Psychology Department; Neuroscience Program; Beckman Institute for Advanced Science and Technology; University of Illinois at Urbana-Champaign; Champaign IL USA
| | - Alfons O. Hamm
- Department of Biological and Clinical Psychology; University of Greifswald; Franz-Mehring-Str. 47 17487 Greifswald Germany
| | - Mathias Weymar
- Department of Biological and Clinical Psychology; University of Greifswald; Franz-Mehring-Str. 47 17487 Greifswald Germany
| |
Collapse
|
29
|
Silverstein SM, Elliott CM, Feusner JD, Keane BP, Mikkilineni D, Hansen N, Hartmann A, Wilhelm S. Comparison of visual perceptual organization in schizophrenia and body dysmorphic disorder. Psychiatry Res 2015; 229:426-33. [PMID: 26184989 PMCID: PMC4546849 DOI: 10.1016/j.psychres.2015.05.107] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/13/2014] [Revised: 05/05/2015] [Accepted: 05/17/2015] [Indexed: 02/04/2023]
Abstract
People with schizophrenia are impaired at organizing potentially ambiguous visual information into well-formed shape and object representations. This perceptual organization (PO) impairment has not been found in other psychiatric disorders. However, recent data on body dysmorphic disorder (BDD), suggest that BDD may also be characterized by reduced PO. Similarities between these groups could have implications for understanding the RDoC dimension of visual perception in psychopathology, and for modeling symptom formation across these two conditions. We compared patients with SCZ (n=24) to those with BDD (n=20), as well as control groups of obsessive-compulsive disorder (OCD) patients (n=20) and healthy controls (n=20), on two measures of PO that have been reliably associated with schizophrenia-related performance impairment. On both the contour integration and Ebbinghaus illusion tests, only the SCZ group demonstrated abnormal performance relative to controls; the BDD group performed similarly to the OCD and CON groups. In addition, on both tasks, the SCZ group performed more abnormally than the BDD group. Overall, these data suggest that PO reductions observed in SCZ are not present in BDD. Visual processing impairments in BDD may arise instead from other perceptual disturbances or attentional biases related to emotional factors.
Collapse
Affiliation(s)
- Steven M. Silverstein
- Department of Psychiatry and University Behavioral Health Care, Rutgers University, Piscataway, New Jersey, USA,Corresponding author: Steven M. Silverstein, Ph.D. Rutgers University Behavioral Health Care, 151 Centennial Avenue, Piscataway, NJ 08854, USA. Tel.: +1-732-235-5149.
| | - Corinna M. Elliott
- Department of Psychiatry, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
| | - Jamie D. Feusner
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine at University of California-Los Angeles, Los Angeles, CA, USA
| | - Brian P. Keane
- Department of Psychiatry and University Behavioral Health Care, Rutgers University, Piscataway, New Jersey, USA
| | - Deepthi Mikkilineni
- Department of Psychiatry and University Behavioral Health Care, Rutgers University, Piscataway, New Jersey, USA
| | - Natasha Hansen
- Department of Psychiatry, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
| | - Andrea Hartmann
- Department of Psychiatry, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
| | - Sabine Wilhelm
- Department of Psychiatry, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
| |
Collapse
|
30
|
Wang AL, Lowen SB, Romer D, Giorno M, Langleben DD. Emotional reaction facilitates the brain and behavioural impact of graphic cigarette warning labels in smokers. Tob Control 2015; 24:225-32. [PMID: 25564288 PMCID: PMC4495960 DOI: 10.1136/tobaccocontrol-2014-051993] [Citation(s) in RCA: 88] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2014] [Accepted: 12/16/2014] [Indexed: 12/25/2022]
Abstract
BACKGROUND Warning labels on cigarette packages are an important venue for information about the hazards of smoking. The 2009 US Family Smoking Prevention and Tobacco Control Act mandated replacing the current text-only labels with graphic warning labels. However, labels proposed by the Food and Drug Administration (FDA) were challenged in court by the tobacco companies, who argued successfully that the proposed labels needlessly encroached on their right to free speech, in part because they included images of high emotional salience that indiscriminately frightened rather than informed consumers. METHODS We used functional MRI to examine the effects of graphic warning labels' emotional salience on smokers' brain activity and cognition. Twenty-four smokers viewed a random sequence of blocks of graphic warning labels that have been rated high or low on an 'emotional reaction' scale in previous research. RESULTS We found that labels rated high on emotional reaction were better remembered, associated with reduction in the urge to smoke, and produced greater brain response in the amygdala, hippocampi, inferior frontal gyri and the insulae. CONCLUSIONS Recognition memory and craving are, respectively, correlates of effectiveness of addiction-related public health communications and interventions, and amygdala activation facilitates the encoding of emotional memories. Thus, our results suggest that emotional reaction to graphic warning labels contributes to their public health impact and may be an integral part of the neural mechanisms underlying their effectiveness. Given the urgency of the debate about the constitutional risks and public health benefits of graphic warning labels, these preliminary findings warrant consideration while longitudinal clinical studies are underway.
Collapse
Affiliation(s)
- An-Li Wang
- Annenberg Public Policy Center, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Steven B Lowen
- Department of Psychiatry, Harvard Medical School, Belmont, Massachusetts, MA 02178, USA
| | - Daniel Romer
- Annenberg Public Policy Center, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Mario Giorno
- Annenberg Public Policy Center, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Daniel D Langleben
- Annenberg Public Policy Center, University of Pennsylvania, Philadelphia, PA 19104, USA
- Department of Psychiatry, School of Medicine, University of Pennsylvania Philadelphia, PA 19104, USA
| |
Collapse
|
31
|
Frank DW, Sabatinelli D. Human thalamic and amygdala modulation in emotional scene perception. Brain Res 2014; 1587:69-76. [DOI: 10.1016/j.brainres.2014.08.061] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2014] [Revised: 08/16/2014] [Accepted: 08/19/2014] [Indexed: 11/27/2022]
|