1
|
de Echegaray J, Keil A, Müller MM. Neural dynamics of attentional resource allocation in early visual cortex: emotional scenes produce competitive interactions. Cereb Cortex 2024; 34:bhae428. [PMID: 39656648 DOI: 10.1093/cercor/bhae428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 09/09/2024] [Accepted: 10/16/2024] [Indexed: 12/17/2024] Open
Abstract
Salient emotional visual cues receive prioritized processing in human visual cortex. To what extent emotional facilitation relies on preattentional stimulus processing preceding semantic analysis remains controversial. Making use of steady-state visual evoke potentials frequency-tagged to meaningful complex emotional scenes and their scrambled versions, presented in a 4-Hz rapid serial visual presentation fashion, the current study tested temporal dynamics of semantic and emotional cue processing. The neural dynamics of bottom-up capture of attention driven by concrete images were analyzed under a passive-viewing-like scenario and in a competitive context, where a concurrent foreground task realized with a random dot kinematogram flickering at 15 Hz enabled the concurrent monitoring of top-down selective attention. Aligned with the semantic primacy hypothesis, the steady-state visual evoke potentials' results provide evidence of an initial rapid capture of attention driven by objecthood, followed by heightened deployment of attentional resources to emotional scenes that remained stable for the entire stimulation period. We replicated previous findings in which emotional distractors first prompt visuocortical facilitation, followed by suppression of a concurrent foreground task. Modeling this time-delayed competition process fit the data better than a time-invariant trade-off between concurrent cues as assumed by most models of selective attention.
Collapse
Affiliation(s)
- Javier de Echegaray
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Neumarkt 9-19, Leipzig 04109, Germany
| | - Andreas Keil
- Department of Psychology, University of Florida, Gainesville, FL 32611, United States
| | - Matthias M Müller
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Neumarkt 9-19, Leipzig 04109, Germany
| |
Collapse
|
2
|
Zhang S, Cui H, Li Y, Chen X, Gao X, Guan C. Improving SSVEP-BCI Performance Through Repetitive Anodal tDCS-Based Neuromodulation: Insights From Fractal EEG and Brain Functional Connectivity. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1647-1656. [PMID: 38625770 DOI: 10.1109/tnsre.2024.3389051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/18/2024]
Abstract
This study embarks on a comprehensive investigation of the effectiveness of repetitive transcranial direct current stimulation (tDCS)-based neuromodulation in augmenting steady-state visual evoked potential (SSVEP) brain-computer interfaces (BCIs), alongside exploring pertinent electroencephalography (EEG) biomarkers for assessing brain states and evaluating tDCS efficacy. EEG data were garnered across three distinct task modes (eyes open, eyes closed, and SSVEP stimulation) and two neuromodulation patterns (sham-tDCS and anodal-tDCS). Brain arousal and brain functional connectivity were measured by extracting features of fractal EEG and information flow gain, respectively. Anodal-tDCS led to diminished offsets and enhanced information flow gains, indicating improvements in both brain arousal and brain information transmission capacity. Additionally, anodal-tDCS markedly enhanced SSVEP-BCIs performance as evidenced by increased amplitudes and accuracies, whereas sham-tDCS exhibited lesser efficacy. This study proffers invaluable insights into the application of neuromodulation methods for bolstering BCI performance, and concurrently authenticates two potent electrophysiological markers for multifaceted characterization of brain states.
Collapse
|
3
|
Minarik T, Berger B, Jensen O. Optimal parameters for rapid (invisible) frequency tagging using MEG. Neuroimage 2023; 281:120389. [PMID: 37751812 PMCID: PMC10577447 DOI: 10.1016/j.neuroimage.2023.120389] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 09/18/2023] [Accepted: 09/23/2023] [Indexed: 09/28/2023] Open
Abstract
Frequency tagging has been demonstrated to be a useful tool for identifying representational-specific neuronal activity in the auditory and visual domains. However, the slow flicker (<30 Hz) applied in conventional frequency tagging studies is highly visible and might entrain endogenous neuronal oscillations. Hence, stimulation at faster frequencies that is much less visible and does not interfere with endogenous brain oscillatory activity is a promising new tool. In this study, we set out to examine the optimal stimulation parameters of rapid frequency tagging (RFT/RIFT) with magnetoencephalography (MEG) by quantifying the effects of stimulation frequency, size and position of the flickering patch. Rapid frequency tagging using flickers above 50 Hz results in almost invisible stimulation which does not interfere with slower endogenous oscillations; however, the signal is weaker as compared to tagging at slower frequencies so certainty over the optimal parameters of stimulation delivery are crucial. The here presented results examining the frequency range between 60 Hz and 96 Hz suggest that RFT induces brain responses with decreasing strength up to about 84 Hz. In addition, even at the smallest flicker patch (2°) focally presented RFT induces a significant and measurable oscillatory brain signal (steady state visual evoked potential/field, SSVEP/F) at the stimulation frequency (66 Hz); however, the elicited response increases with patch size. While focal RFT presentation elicits the strongest response, off-centre presentations do generally mainly elicit a measureable response if presented below the horizontal midline. Importantly, the results also revealed considerable individual differences in the neuronal responses to RFT stimulation. Finally, we discuss the comparison of oscillatory measures (coherence and power) and sensor types (planar gradiometers and magnetometers) in order to achieve optimal outcomes. Based on our extensive findings we set forward concrete recommendations for using rapid frequency tagging in human cognitive neuroscience investigations.
Collapse
Affiliation(s)
- Tamas Minarik
- Center of Functionally Integrative Neuroscience, Aarhus University, Denmark.
| | - Barbara Berger
- Center of Functionally Integrative Neuroscience, Aarhus University, Denmark; Aarhus Institute of Advanced Studies, Aarhus University, Denmark
| | - Ole Jensen
- Centre for Human Brain Health, University of Birmingham, United Kingdom
| |
Collapse
|
4
|
Zhang S, Yan X, Wang Y, Liu B, Gao X. Modulation of brain states on fractal and oscillatory power of EEG in brain-computer interfaces. J Neural Eng 2021; 18. [PMID: 34517346 DOI: 10.1088/1741-2552/ac2628] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Accepted: 09/13/2021] [Indexed: 11/11/2022]
Abstract
Objective. Electroencephalogram (EEG) is an objective reflection of the brain activities, which provides potential possibilities for brain state estimation based on EEG characteristics. However, how to mine the effective EEG characteristics is still a distressing problem in brain state monitoring.Approach. The phase-scrambled method was used to generate images with different noise levels. Images were encoded into a rapid serial visual presentation paradigm. N-back working memory method was employed to induce and assess fatigue state. The irregular-resampling auto-spectral analysis method was adopted to extract and parameterize (exponent and offset) the characteristics of EEG fractal components, which were analyzed in the four dimensions: fatigue, sustained attention, visual noise and experimental tasks.Main results. The degree of fatigue and visual noise level had positive effects on exponent and offset in the prefrontal lobe, and the ability of sustained attention negatively affected exponent and offset. Compared with visual stimuli task, rest task induced even larger values of exponent and offset and statistically significant in the most cerebral cortex. In addition, the steady-state visual evoked potential amplitudes were negatively and positively affected by the degree of fatigue and noise levels, respectively.Significance. The conclusions of this study provide insights into the relationship between brain states and EEG characteristics. In addition, this study has the potential to provide objective methods for brain states monitoring and EEG modeling.
Collapse
Affiliation(s)
- Shangen Zhang
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, People's Republic of China
| | - Xinyi Yan
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, People's Republic of China
| | - Yijun Wang
- China State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
| | - Baolin Liu
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, People's Republic of China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, People's Republic of China
| |
Collapse
|
5
|
Wang L, Han D, Qian B, Zhang Z, Zhang Z, Liu Z. The Validity of Steady-State Visual Evoked Potentials as Attention Tags and Input Signals: A Critical Perspective of Frequency Allocation and Number of Stimuli. Brain Sci 2020; 10:brainsci10090616. [PMID: 32906625 PMCID: PMC7563221 DOI: 10.3390/brainsci10090616] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Revised: 09/01/2020] [Accepted: 09/03/2020] [Indexed: 01/23/2023] Open
Abstract
Steady-state visual evoked potential (SSVEP) is a periodic response to a repetitive visual stimulus at a specific frequency. Currently, SSVEP is widely treated as an attention tag in cognitive activities and is used as an input signal for brain-computer interfaces (BCIs). However, whether SSVEP can be used as a reliable indicator has been a controversial issue. We focused on the independence of SSVEP from frequency allocation and number of stimuli. First, a cue-target paradigm was adopted to examine the interaction between SSVEPs evoked by two stimuli with different frequency allocations under different attention conditions. Second, we explored whether signal strength and the performance of SSVEP-based BCIs were affected by the number of stimuli. The results revealed that no significant interaction of SSVEP responses appeared between attended and unattended stimuli under various frequency allocations, regardless of their appearance in the fundamental or second-order harmonic. The amplitude of SSVEP suffered no significant gain or loss under different numbers of stimuli, but the performance of SSVEP-based BCIs varied along with duration of stimuli; that is, the recognition rate was not affected by the number of stimuli when the duration of stimuli was long enough, while the information transfer rate (ITR) presented the opposite trend. It can be concluded that SSVEP is a reliable tool for marking and monitoring multiple stimuli simultaneously in cognitive studies, but much caution should be taken when choosing a suitable duration and the number of stimuli, in order to achieve optimal utility of BCIs in the future.
Collapse
Affiliation(s)
- Lu Wang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China; (L.W.); (D.H.); (B.Q.); (Z.Z.)
| | - Dan Han
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China; (L.W.); (D.H.); (B.Q.); (Z.Z.)
| | - Binbin Qian
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China; (L.W.); (D.H.); (B.Q.); (Z.Z.)
| | - Zhenhao Zhang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China; (L.W.); (D.H.); (B.Q.); (Z.Z.)
| | - Zhijun Zhang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China; (L.W.); (D.H.); (B.Q.); (Z.Z.)
- Correspondence: ; Tel.: +86-571-88273337
| | - Zhifang Liu
- Department of Psychology and Special Education, Hangzhou Normal University, Hangzhou 311121, China;
| |
Collapse
|
6
|
Abstract
In the fatigue state, the neural response characteristics of the brain might be different from those in the normal state. Brain functional connectivity analysis is an effective tool for distinguishing between different brain states. For example, comparative studies on the brain functional connectivity have the potential to reveal the functional differences in different mental states. The purpose of this study was to explore the relationship between human mental states and brain control abilities by analyzing the effect of fatigue on the brain response connectivity. In particular, the phase‐scrambling method was used to generate images with two noise levels, while the N‐back working memory task was used to induce the fatigue state in subjects. The paradigm of rapid serial visual presentation (RSVP) was used to present visual stimuli. The analysis of brain connections in the normal and fatigue states was conducted using the open‐source eConnectome toolbox. The results demonstrated that the control areas of neural responses were mainly distributed in the parietal region in both the normal and fatigue states. Compared to the normal state, the brain connectivity power in the parietal region was significantly weakened under the fatigue state, which indicates that the control ability of the brain is reduced in the fatigue state.
Collapse
Affiliation(s)
- Shangen Zhang
- Department of School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China
| | - Jingnan Sun
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| |
Collapse
|
7
|
Gong W, Li J, Luo F. Time Course of Attention Interruption After Transient Pain Stimulation. THE JOURNAL OF PAIN 2020; 21:1247-1256. [PMID: 32553619 DOI: 10.1016/j.jpain.2020.02.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Revised: 01/08/2020] [Accepted: 02/08/2020] [Indexed: 11/28/2022]
Abstract
Although pain has been shown to affect attentional performance, little is known about the time course of attention interruption after pain stimulus perception. The present study examined the time course of the effects of transient heat pain stimulation on 2 components of attention. Three groups of subjects performed attention tasks under pain, warmth, and no-stimulation control conditions, respectively. The pain and warmth groups received brief physical stimulation. Attention tasks were presented 0 ms, 250 ms, 750 ms, or 1500 ms after the end of stimulation. The 2 attention tasks, namely the spatial cue task (Experiment 1, N = 92) and a Stroop task (Experiment 2, N = 86), were conducted separately. In Experiment 1, attentional orientation of the pain and warmth groups was significantly impaired for at least 1.5 seconds after the physical stimulation had ended. Interestingly, this effect lasted longer for the warmth group than for the pain group. In Experiment 2, pain stimulation had no effect on executive attention at any time. We concluded that attentional orientation is selectively disrupted by both pain and warmth stimuli, but recovers earlier from pain. PERSPECTIVE: This article is concerned with the subsequent interruptive effect of pain on attentional orientation and executive attention by using the spatial cue task and the Stroop task, respectively. These measures offer options for investigating the time course of attention interruption after transient pain stimulation.
Collapse
Affiliation(s)
- Wenxiao Gong
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, PR China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, PR China
| | - Jifang Li
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, PR China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, PR China; Sino-Danish College, University of Chinese Academy of Sciences, Beijing, PR China; Sino-Danish Center for Education and Research, Beijing, PR China
| | - Fei Luo
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, PR China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, PR China.
| |
Collapse
|
8
|
Zhang S, Gao X. The effect of visual stimuli noise and fatigue on steady-state visual evoked potentials. J Neural Eng 2019; 16:056023. [DOI: 10.1088/1741-2552/ab1f4e] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
|
9
|
Bekhtereva V, Craddock M, Gundlach C, Müller MM. Rapid sensory gain with emotional distracters precedes attentional deployment from a foreground task. Neuroimage 2019; 202:116115. [PMID: 31442485 DOI: 10.1016/j.neuroimage.2019.116115] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2019] [Revised: 07/18/2019] [Accepted: 08/19/2019] [Indexed: 11/24/2022] Open
Abstract
The steady-state visual evoked potential (SSVEP), an electrophysiological marker of attentional resource allocation, has recently been demonstrated to serve as a neural signature of emotional content extraction from a rapid serial visual presentation (RSVP). SSVEP amplitude was reduced for streams of emotional relative to neutral scenes passively viewed at 6 Hz (~167 ms per image), but it was enhanced for emotional relative to neutral scenes when viewed as 4 Hz RSVP (250 ms per image). Here, we investigated whether these seemingly contradictory observations may be related to different dynamics in the allocation of attentional resources as a consequence of stimulation frequency. To this end, we advanced our distraction paradigm by presenting a visual foreground task consisting of randomly moving squares flickering at 15 Hz superimposed on task-irrelevant RSVP streams shown at 6 or 4 Hz, which could unpredictably switch from neutral to unpleasant content during the trial or remained neutral. Critically, our findings demonstrate that affective distractors captured attentional resources more strongly than their neutral counterparts, irrespective of whether they were presented at 6 or 4 Hz rate. Moreover, the emotion-dependent attentional deployment from the foreground task was temporally preceded by sustained sensory facilitation in response to emotional background images. Together, present findings provide evidence for rapid sustained visual facilitation but a rather slow attentional bias in favor of emotional distractors in early visual areas.
Collapse
Affiliation(s)
| | - Matt Craddock
- Department of Psychology, University of Lincoln, Lincoln, UK
| | | | | |
Collapse
|
10
|
Rapid Extraction of Emotion Regularities from Complex Scenes in the Human Brain. COLLABRA-PSYCHOLOGY 2019. [DOI: 10.1525/collabra.226] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
Adaptive behavior requires the rapid extraction of behaviorally relevant information in the environment, with particular emphasis on emotional cues. However, the speed of emotional feature extraction from complex visual environments is largely undetermined. Here we use objective electrophysiological recordings in combination with frequency tagging to demonstrate that the extraction of emotional information from neutral, pleasant, or unpleasant naturalistic scenes can be completed at a presentation speed of 167 ms (i.e., 6 Hz) under high perceptual load. Emotional compared to neutral pictures evoked enhanced electrophysiological responses with distinct topographical activation patterns originating from different neural sources. Cortical facilitation in early visual cortex was also more pronounced for scenes with pleasant compared to unpleasant or neutral content, suggesting a positivity offset mechanism dominating under conditions of rapid scene processing. These results significantly advance our knowledge of complex scene processing in demonstrating rapid integrative content identification, particularly for emotional cues relevant for adaptive behavior in complex environments.
Collapse
|
11
|
Bekhtereva V, Pritschmann R, Keil A, Müller MM. The neural signature of extracting emotional content from rapid visual streams at multiple presentation rates: A cross-laboratory study. Psychophysiology 2018; 55:e13222. [DOI: 10.1111/psyp.13222] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2018] [Revised: 06/01/2018] [Accepted: 06/01/2018] [Indexed: 12/13/2022]
Affiliation(s)
| | - Ricarda Pritschmann
- Department of Health Education and Behavior; University of Florida; Gainsville Florida
| | - Andreas Keil
- Department of Psychology; University of Florida; Gainesville Florida
| | | |
Collapse
|
12
|
Jiang Y, Wu X, Saab R, Xiao Y, Gao X. Time course of influence on the allocation of attentional resources caused by unconscious fearful faces. Neuropsychologia 2018; 113:104-110. [PMID: 29626497 DOI: 10.1016/j.neuropsychologia.2018.04.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2017] [Revised: 03/19/2018] [Accepted: 04/03/2018] [Indexed: 11/19/2022]
Abstract
Emotionally affective stimuli have priority in our visual processing even in the absence of conscious processing. However, the influence of unconscious emotional stimuli on our attentional resources remains unclear. Using the continuous flash suppression (CFS) paradigm, we concurrently recorded and analyzed visual event-related potential (ERP) components evoked by the images of suppressed fearful and neutral faces, and the steady-state visual evoked potential (SSVEP) elicited by dynamic Mondrian pictures. Fearful faces, relative to neutral faces, elicited larger late ERP components on parietal electrodes, indicating emotional expression processing without consciousness. More importantly, the presentation of a suppressed fearful face in the CFS resulted in a significantly greater decrease in SSVEP amplitude which started about 1-1.2 s after the face images first appeared. This suggests that the time course of the attentional bias occurs at about 1 s after the appearance of the fearful face and demonstrates that unconscious fearful faces may influence attentional resource allocation. Moreover, we proposed a new method that could eliminate the interaction of ERPs and SSVEPs when recorded concurrently.
Collapse
Affiliation(s)
- Yunpeng Jiang
- Department of Biomedical Engineering, Tsinghua University, Beijing 100084, China
| | - Xia Wu
- Department of Psychology, Tianjin Normal University, Tianjin 300387, China
| | - Rami Saab
- Department of Biomedical Engineering, Tsinghua University, Beijing 100084, China
| | - Yi Xiao
- National Key Laboratory of Human Factors Engineering, Astronaut Research and Training Center, Beijing 100094, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, Tsinghua University, Beijing 100084, China.
| |
Collapse
|
13
|
Carboni A, Kessel D, Capilla A, Carretié L. The influence of affective state on exogenous attention to emotional distractors: behavioral and electrophysiological correlates. Sci Rep 2017; 7:8068. [PMID: 28808233 PMCID: PMC5556118 DOI: 10.1038/s41598-017-07249-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2017] [Accepted: 06/26/2017] [Indexed: 11/12/2022] Open
Abstract
The interplay between exogenous attention to emotional distractors and the baseline affective state has not been well established yet. The present study aimed to explore this issue through behavioral measures and event-related potentials (ERPs). Participants (N = 30) completed a digit categorization task depicted over negative, positive or neutral distractor background pictures, while they experienced negative, positive and neutral affective states elicited by movie scenes. Behavioral results showed higher error rates and longer reaction times for negative distractors than for neutral and positive ones, irrespective of the current emotional state. Neural indices showed that the participants' affective state modulated N1 amplitudes, irrespective of distractor type, while the emotional charge of distractors modulated N2, irrespective of the emotional state. Importantly, an interaction of state and distractor type was observed in LPP. These results demonstrate that exogenous attention to emotional distractors is independent from modulating effects of the emotional baseline state at early, automatic stages of processing. However, attention to emotional distractors and affective state interact at later latencies.
Collapse
Affiliation(s)
| | - Dominique Kessel
- Universidad de la República del Uruguay, Montevideo, Uruguay
- Universidad Autónoma de Madrid, Madrid, Spain
| | | | | |
Collapse
|
14
|
Bringing color to emotion: The influence of color on attentional bias to briefly presented emotional images. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2017; 17:1028-1047. [DOI: 10.3758/s13415-017-0530-z] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
|
15
|
Kouptsova JE, Leung RC, Taylor MJ. Stimulus exposure duration alters implicit processing of neutral and emotional faces. Neuroscience 2017; 341:154-159. [DOI: 10.1016/j.neuroscience.2016.11.030] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2016] [Revised: 11/14/2016] [Accepted: 11/21/2016] [Indexed: 01/16/2023]
|
16
|
Müller MM, Gundlach C. Competition for attentional resources between low spatial frequency content of emotional images and a foreground task in early visual cortex. Psychophysiology 2016; 54:429-443. [PMID: 27990660 DOI: 10.1111/psyp.12792] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2016] [Accepted: 10/04/2016] [Indexed: 11/28/2022]
Abstract
Low spatial frequency (LSF) image content has been proposed to play a superior functional role in emotional content extraction via the magnocellular pathway biasing attentional resources toward emotional content in visual cortex. We investigated whether emotionally unpleasant complex images that were presented either unfiltered or with LSF content only in the background while subjects performed a foreground task will withdraw more attentional resources from the task compared to unemotional, neutral images (distraction paradigm). We measured steady-state visual evoked potentials (SSVEPs) driven by flickering stimuli of a foreground task. Unfiltered unpleasant images resulted in a significant reduction of SSVEP amplitude compared to neutral images. No statistically significant differences were found with LSF background images. In a behavioral control experiment, we found no significant differences for complexity ratings between unfiltered and LSF pictures. Content identification was possible for unfiltered and LSF picture (correct responses > 74%). An additional EEG study examined typical emotion-related components for complex images presented either as unfiltered, LSF, or high spatial frequency (HSF, as an additional control) filtered, unpleasant, and neutral images. We found a significant main effect of emotional valence in the early posterior negativity. Late positive potential differences were only found for unfiltered and HSF images. Results suggest that, while LSF content is sufficient to allow for content and emotional cue extraction when images were presented alone, LSF content is not salient enough to serve as emotional distractor that withdraws attentional resources from a foreground task in early visual cortex.
Collapse
|
17
|
Wieser MJ, Miskovic V, Keil A. Steady-state visual evoked potentials as a research tool in social affective neuroscience. Psychophysiology 2016; 53:1763-1775. [PMID: 27699794 DOI: 10.1111/psyp.12768] [Citation(s) in RCA: 58] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2016] [Accepted: 09/06/2016] [Indexed: 11/29/2022]
Abstract
Like many other primates, humans place a high premium on social information transmission and processing. One important aspect of this information concerns the emotional state of other individuals, conveyed by distinct visual cues such as facial expressions, overt actions, or by cues extracted from the situational context. A rich body of theoretical and empirical work has demonstrated that these socioemotional cues are processed by the human visual system in a prioritized fashion, in the service of optimizing social behavior. Furthermore, socioemotional perception is highly dependent on situational contexts and previous experience. Here, we review current issues in this area of research and discuss the utility of the steady-state visual evoked potential (ssVEP) technique for addressing key empirical questions. Methodological advantages and caveats are discussed with particular regard to quantifying time-varying competition among multiple perceptual objects, trial-by-trial analysis of visual cortical activation, functional connectivity, and the control of low-level stimulus features. Studies on facial expression and emotional scene processing are summarized, with an emphasis on viewing faces and other social cues in emotional contexts, or when competing with each other. Further, because the ssVEP technique can be readily accommodated to studying the viewing of complex scenes with multiple elements, it enables researchers to advance theoretical models of socioemotional perception, based on complex, quasinaturalistic viewing situations.
Collapse
Affiliation(s)
- Matthias J Wieser
- Institute of Psychology, Erasmus University Rotterdam, Rotterdam, Netherlands.,Department of Psychology, University of Würzburg, Würzburg, Germany
| | - Vladimir Miskovic
- Department of Psychology, State University of New York at Binghamton, Binghamton, New York, USA
| | - Andreas Keil
- Department of Psychology, University of Florida, Gainesville, Florida, USA
| |
Collapse
|
18
|
Schettino A, Keil A, Porcu E, Müller MM. Shedding light on emotional perception: Interaction of brightness and semantic content in extrastriate visual cortex. Neuroimage 2016; 133:341-353. [DOI: 10.1016/j.neuroimage.2016.03.020] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2015] [Revised: 02/15/2016] [Accepted: 03/11/2016] [Indexed: 11/25/2022] Open
|
19
|
Bekhtereva V, Müller MM. Affective facilitation of early visual cortex during rapid picture presentation at 6 and 15 Hz. Soc Cogn Affect Neurosci 2015; 10:1623-33. [PMID: 25971598 DOI: 10.1093/scan/nsv058] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2015] [Accepted: 05/07/2015] [Indexed: 11/14/2022] Open
Abstract
The steady-state visual evoked potential (SSVEP), a neurophysiological marker of attentional resource allocation with its generators in early visual cortex, exhibits enhanced amplitude for emotional compared to neutral complex pictures. Emotional cue extraction for complex images is linked to the N1-EPN complex with a peak latency of ∼140-160 ms. We tested whether neural facilitation in early visual cortex with affective pictures requires emotional cue extraction of individual images, even when a stream of images of the same valence category is presented. Images were shown at either 6 Hz (167 ms, allowing for extraction) or 15 Hz (67 ms per image, causing disruption of processing by the following image). Results showed SSVEP amplitude enhancement for emotional compared to neutral images at a presentation rate of 6 Hz but no differences at 15 Hz. This was not due to featural differences between the two valence categories. Results strongly suggest that individual images need to be displayed for sufficient time allowing for emotional cue extraction to drive affective neural modulation in early visual cortex.
Collapse
Affiliation(s)
| | - Matthias M Müller
- Institute of Psychology, University of Leipzig, 04109, Leipzig, Germany
| |
Collapse
|
20
|
Bekhtereva V, Craddock M, Müller MM. Attentional bias to affective faces and complex IAPS images in early visual cortex follows emotional cue extraction. Neuroimage 2015; 112:254-266. [PMID: 25818682 DOI: 10.1016/j.neuroimage.2015.03.052] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2014] [Revised: 01/29/2015] [Accepted: 03/18/2015] [Indexed: 10/23/2022] Open
Abstract
Emotionally arousing stimuli are known to rapidly draw the brain's processing resources, even when they are task-irrelevant. The steady-state visual evoked potential (SSVEP) response, a neural response to a flickering stimulus which effectively allows measurement of the processing resources devoted to that stimulus, has been used to examine this process of attentional shifting. Previous studies have used a task in which participants detected periods of coherent motion in flickering random dot kinematograms (RDKs) which generate an SSVEP, and found that task-irrelevant emotional stimuli withdraw more attentional resources from the task-relevant RDKs than task-irrelevant neutral stimuli. However, it is not clear whether the emotion-related differences in the SSVEP response are conditional on higher-level extraction of emotional cues as indexed by well-known event-related potential (ERPs) components (N170, early posterior negativity, EPN), or if affective bias in competition for visual attention resources is a consequence of a time-invariant shifting process. In the present study, we used two different types of emotional distractors - IAPS pictures and facial expressions - for which emotional cue extraction occurs at different speeds, being typically earlier for faces (at ~170ms, as indexed by the N170) than for IAPS images (~220-280ms, EPN). We found that emotional modulation of attentional resources as measured by the SSVEP occurred earlier for faces (around 180ms) than for IAPS pictures (around 550ms), after the extraction of emotional cues as indexed by visual ERP components. This is consistent with emotion related re-allocation of attentional resources occurring after emotional cue extraction rather than being linked to a time-fixed shifting process.
Collapse
Affiliation(s)
| | - Matt Craddock
- Institute of Psychological Sciences, University of Leeds, Leeds, UK
| | | |
Collapse
|
21
|
Olatunji BO, Armstrong T, Ciesielski BG. Differential effects of emotional expressions and scenes on visual search. MOTIVATION AND EMOTION 2015. [DOI: 10.1007/s11031-015-9477-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
22
|
Xu P, Tian C, Zhang Y, Jing W, Wang Z, Liu T, Hu J, Tian Y, Xia Y, Yao D. Cortical network properties revealed by SSVEP in anesthetized rats. Sci Rep 2014; 3:2496. [PMID: 23970104 PMCID: PMC3750539 DOI: 10.1038/srep02496] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2013] [Accepted: 08/07/2013] [Indexed: 11/09/2022] Open
Abstract
Steady state visual evoked potentials (SSVEP) are assumed to be regulated by multiple brain areas, yet the underlying mechanisms are not well understood. In this study, we utilized multi-channel intracranial recordings together with network analysis to investigate the underlying relationships between SSVEP and brain networks in anesthetized rat. We examined the relationship between SSVEP amplitude and the network topological properties for different stimulation frequencies, the synergetic dynamic changes of the amplitude and topological properties in each rat, the network properties of the control state, and the individual difference of SSVEP network attributes existing among rats. All these aspects consistently indicate that SSVEP response is closely correlated with network properties, the reorganization of the background network plays a crucial role in SSVEP production, and the background network may provide a physiological marker for evaluating the potential of SSVEP generation.
Collapse
Affiliation(s)
- Peng Xu
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | | | | | | | | | | | | | | | | | | |
Collapse
|
23
|
Schupp HT, Schmälzle R, Flaisch T. Explicit semantic stimulus categorization interferes with implicit emotion processing. Soc Cogn Affect Neurosci 2013; 9:1738-45. [PMID: 24194577 DOI: 10.1093/scan/nst171] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Previous functional magnetic resonance imaging and event-related brain potential studies revealed that performing a cognitive task may suppress the preferential processing of emotional stimuli. However, these studies utilized simple and artificial tasks (i.e. letter, shape or orientation discrimination tasks), unfamiliar to the participants. The present event-related potential study examined the emotion-attention interaction in the context of a comparably more natural scene categorization task. Deciding whether a natural scene contains an animal or not is a familiar and meaningful task to the participants and presumed to require little attentional resources. The task images were presented centrally and were overlaid upon emotional or neutral background pictures. Thus, implicit emotion and explicit semantic categorization may compete for processing resources in neural regions implicated in object recognition. Additionally, participants passively viewed the same stimulus materials without the demand to categorize task images. Significant interactions between task condition and emotional picture valence were observed for the occipital negativity and late positive potential. In the passive viewing condition, emotional background images elicited an increased occipital negativity followed by an increased late positive potential. In contrast, during the animal-/non-animal-categorization task, emotional modulation effects were replaced by strong target categorization effects. These results suggest that explicit semantic categorization interferes with implicit emotion processing when both processes compete for shared resources.
Collapse
Affiliation(s)
- Harald T Schupp
- Department of Psychology, University of Konstanz, 78457 Konstanz, Germany
| | - Ralf Schmälzle
- Department of Psychology, University of Konstanz, 78457 Konstanz, Germany
| | - Tobias Flaisch
- Department of Psychology, University of Konstanz, 78457 Konstanz, Germany
| |
Collapse
|
24
|
Wieser MJ, Keil A. Fearful faces heighten the cortical representation of contextual threat. Neuroimage 2013; 86:317-25. [PMID: 24125792 DOI: 10.1016/j.neuroimage.2013.10.008] [Citation(s) in RCA: 58] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2013] [Revised: 09/26/2013] [Accepted: 10/02/2013] [Indexed: 10/26/2022] Open
Abstract
Perception of facial expressions is typically investigated by presenting isolated face stimuli. In everyday life, however, faces are rarely seen without a surrounding visual context that affects perception and interpretation of the facial expression. Conversely, fearful faces may act as a cue, heightening the sensitivity of the visual system to effectively detect potential threat in the environment. In the present study, we used steady-state visually evoked potentials (ssVEPs) to examine the mutual effects of facial expressions (fearful, neutral, happy) and affective visual context (pleasant, neutral, threat). By assigning two different flicker frequencies (12 vs. 15Hz) to the face and the visual context scene, cortical activity to the concurrent stimuli was separated, which represents a novel approach to independently tracking the cortical processes associated with the face and the context. Twenty healthy students viewed flickering faces overlaid on flickering visual scenes, while performing a simple change-detection task at fixation, and high-density EEG was recorded. Arousing background scenes generally drove larger ssVEP amplitudes than neutral scenes. Importantly, background and expression interacted: When viewing fearful facial expressions, the ssVEP in response to threat context was amplified compared to other backgrounds. Together, these findings suggest that fearful faces elicit vigilance for potential threat in the visual periphery.
Collapse
Affiliation(s)
- Matthias J Wieser
- University of Würzburg, Department of Psychology, Würzburg, Germany.
| | - Andreas Keil
- University of Florida, Center for the Study of Emotion and Attention, Gainesville, FL, USA
| |
Collapse
|
25
|
Schönwald LI, Müller MM. Slow biasing of processing resources in early visual cortex is preceded by emotional cue extraction in emotion-attention competition. Hum Brain Mapp 2013; 35:1477-90. [PMID: 23450516 DOI: 10.1002/hbm.22267] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2012] [Revised: 12/12/2012] [Accepted: 01/07/2013] [Indexed: 11/08/2022] Open
Abstract
In our previous studies on competition for attentional processing resources in early visual cortex between a foreground task and distracting emotional background images we found that emotional background images withdraw attentional resources from the foreground task after about 400 ms. Costs in behavioral data and a significant reduction of the steady state visual evoked potential (SSVEP) amplitude that was elicited by the foreground task lasted for several hundred milliseconds. We speculated that the differential effect in SSVEP amplitudes is preceded by the extraction of the emotional cue. Event related potential (ERP) studies to emotional and neutral complex images identified an early posterior negativity (EPN) as a robust neural signature of emotional cue extraction. The late positive potential (LPP) was related to in-depth processing of the emotional image. We extracted ERPs that were evoked by the onset of background images concurrently with the SSVEP that was elicited by the foreground task. Emotional compared to neutral background pictures evoked a more negative EPN at about 190 ms and a more positive LPP at about 700 ms after image onset. SSVEP amplitudes became significantly smaller with emotional background images after about 400 ms lasting for several hundred ms. Interestingly, we found no significant correlations between the three components, indicating that they act independently. Source localizations resulted in nonoverlapping cortical generators. Results suggest a cascade of perceptual processes: Extraction of the emotional cue preceded biasing of attentional resources away from the foreground task towards the emotional image for an evaluation of the picture content.
Collapse
|
26
|
Li Y, Lou B, Gao X, Sajda P. Post-stimulus endogenous and exogenous oscillations are differentially modulated by task difficulty. Front Hum Neurosci 2013; 7:9. [PMID: 23386819 PMCID: PMC3560344 DOI: 10.3389/fnhum.2013.00009] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2012] [Accepted: 01/09/2013] [Indexed: 11/23/2022] Open
Abstract
We investigate the modulation of post-stimulus endogenous and exogenous oscillations when a visual discrimination is made more difficult. We use exogenous frequency tagging to induce steady-state visually evoked potentials (SSVEP) while subjects perform a face-car discrimination task, the difficulty of which varies on a trial-to-trial basis by varying the noise (phase coherence) in the image. We simultaneously analyze amplitude modulations of the SSVEP and endogenous alpha activity as a function of task difficulty. SSVEP modulation can be viewed as a neural marker of attention toward/away from the primary task, while modulation of post-stimulus alpha is closely related to cortical information processing. We find that as the task becomes more difficult, the amplitude of SSVEP decreases significantly, approximately 250-450 ms post-stimulus. Significant changes in endogenous alpha amplitude follow SSVEP modulation, occurring at approximately 400-700 ms post-stimulus and, unlike the SSVEP, the alpha amplitude is increasingly suppressed as the task becomes less difficult. Our results demonstrate simultaneous measurement of endogenous and exogenous oscillations that are modulated by task difficulty, and that the specific timing of these modulations likely reflects underlying information processing flow during perceptual decision-making.
Collapse
Affiliation(s)
- Yun Li
- Department of Biomedical Engineering, Tsinghua UniversityBeijing, China
- Department of Biomedical Engineering, Columbia UniversityNew York, NY, USA
| | - Bin Lou
- Department of Biomedical Engineering, Columbia UniversityNew York, NY, USA
| | - Xiaorong Gao
- Department of Biomedical Engineering, Tsinghua UniversityBeijing, China
| | - Paul Sajda
- Department of Biomedical Engineering, Columbia UniversityNew York, NY, USA
| |
Collapse
|
27
|
Abstract
The steady-state visual evoked potential (SSVEP) is a powerful tool to study basic perceptual functions in the human electroencephalogram (EEG) (e.g. selective attention). The present study aimed at finding support for the SSVEP's sensitivity to higher cognitive functions (e.g. memory). We tagged pictures of meaningless objects with 15 Hz within a combined subsequent-memory and recognition-memory design. The EEG was recorded from 128 electrodes. The subsequent-memory design revealed that SSVEPs are influenced by encoding-related processes. In particular, successful encoding was associated with higher SSVEP amplitudes at central-parietal scalp electrodes and reduced activity at left occipital sites. Recognition memory led to higher SSVEP amplitudes at right temporal scalp regions and to an amplitude reduction at midline electrodes. For the first time it was demonstrated that the SSVEP technique is a useful tool to study memory encoding and retrieval. SSVEPs might reflect the ongoing dynamics within an externally driven and widespread task-relevant network. This offers remarkable possibilities for future research on electrophysiological correlates of mnemonic functioning.
Collapse
|
28
|
Hindi Attar C, Müller MM. Selective attention to task-irrelevant emotional distractors is unaffected by the perceptual load associated with a foreground task. PLoS One 2012; 7:e37186. [PMID: 22649513 PMCID: PMC3359362 DOI: 10.1371/journal.pone.0037186] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2011] [Accepted: 04/18/2012] [Indexed: 11/18/2022] Open
Abstract
A number of studies have shown that emotionally arousing stimuli are preferentially processed in the human brain. Whether or not this preference persists under increased perceptual load associated with a task at hand remains an open question. Here we manipulated two possible determinants of the attentional selection process, perceptual load associated with a foreground task and the emotional valence of concurrently presented task-irrelevant distractors. As a direct measure of sustained attentional resource allocation in early visual cortex we used steady-state visual evoked potentials (SSVEPs) elicited by distinct flicker frequencies of task and distractor stimuli. Subjects either performed a detection (low load) or discrimination (high load) task at a centrally presented symbol stream that flickered at 8.6 Hz while task-irrelevant neutral or unpleasant pictures from the International Affective Picture System (IAPS) flickered at a frequency of 12 Hz in the background of the stream. As reflected in target detection rates and SSVEP amplitudes to both task and distractor stimuli, unpleasant relative to neutral background pictures more strongly withdrew processing resources from the foreground task. Importantly, this finding was unaffected by the factor 'load' which turned out to be a weak modulator of attentional processing in human visual cortex.
Collapse
Affiliation(s)
- Catherine Hindi Attar
- Institute of Psychology, University of Leipzig, Leipzig, Germany
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Matthias M. Müller
- Institute of Psychology, University of Leipzig, Leipzig, Germany
- * E-mail:
| |
Collapse
|