1
|
Arslan C, Schneider D, Getzmann S, Wascher E, Klatt L. The Interplay Between Multisensory Processing and Attention in Working Memory: Behavioral and Neural Indices of Audiovisual Object Storage. Psychophysiology 2025; 62:e70018. [PMID: 39981616 PMCID: PMC11843526 DOI: 10.1111/psyp.70018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2024] [Revised: 11/19/2024] [Accepted: 01/28/2025] [Indexed: 02/22/2025]
Abstract
Although real-life events are multisensory, how audio-visual objects are stored in working memory is an open question. At a perceptual level, evidence shows that both top-down and bottom-up attentional processes can play a role in multisensory interactions. To understand how attention and multisensory processes interact in working memory, we designed an audiovisual delayed match-to-sample task in which participants were presented with one or two audiovisual memory items, followed by an audiovisual probe. In different blocks, participants were instructed to either (a) attend to the auditory features, (b) attend to the visual features, or (c) attend to both auditory and visual features. Participants were instructed to indicate whether the task-relevant features of the probe matched one of the task-relevant feature(s) or objects in working memory. Behavioral results showed interference from task-irrelevant features, suggesting bottom-up integration of audiovisual features and their automatic encoding into working memory, irrespective of task relevance. Yet, event-related potential analyses revealed no evidence for active maintenance of these task-irrelevant features, while they clearly taxed greater attentional resources during recall. Notably, alpha oscillatory activity revealed that linking information between auditory and visual modalities required more attentional demands at retrieval. Overall, these results offer critical insights into how and at which processing stage multisensory interactions occur in working memory.
Collapse
Affiliation(s)
- Ceren Arslan
- Leibniz Research Centre for Working Environment and Human FactorsDortmundGermany
| | - Daniel Schneider
- Leibniz Research Centre for Working Environment and Human FactorsDortmundGermany
| | - Stephan Getzmann
- Leibniz Research Centre for Working Environment and Human FactorsDortmundGermany
| | - Edmund Wascher
- Leibniz Research Centre for Working Environment and Human FactorsDortmundGermany
| | - Laura‐Isabelle Klatt
- Leibniz Research Centre for Working Environment and Human FactorsDortmundGermany
| |
Collapse
|
2
|
Szaszkó B, Schmid RR, Pomper U, Maiworm M, Laiber S, Lange MJ, Tschenett H, Nater UM, Ansorge U. Testing the impact of hatha yoga on task switching: a randomized controlled trial. Front Hum Neurosci 2024; 18:1438017. [PMID: 39568547 PMCID: PMC11577087 DOI: 10.3389/fnhum.2024.1438017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 10/10/2024] [Indexed: 11/22/2024] Open
Abstract
Switching attention between or within tasks is part of the implementation and maintenance of executive control processes and plays an indispensable role in our daily lives: It allows us to perform on distinct tasks and with variable objects, enabling us to adapt to and respond in dynamically changing environments. Here, we tested if yoga could benefit switching of attention between distinct objects of one’s focus (e.g., through practicing switching between one’s own body, feelings, and different postures) in particular and executive control in general. We therefore conducted a randomized controlled trial with 98 participants and a waitlisted control group. In the intervention group, healthy yoga novices practiced Hatha yoga 3x a week, for 8 weeks. We conducted two experiments: A purely behavioral task investigating changes in behavioral costs during switching between attentional control sets (74 participants analyzed), and a modality-switching task focusing on electrophysiology (EEG data of 47 participants analyzed). At the electrophysiological level, frequency-tagging indicated no interventional effect on participants’ ability to switch between the auditory and visual modalities. However, increases in task-related frontocentral theta activity, resulting from the intervention, indicated an ability to increasingly deploy executive resources to the prioritized task when needed. At the behavioral level, our intervention resulted in more efficient holding of target representations in working memory, indicated by decreased mixing costs. Again, however, intervention effects on switching costs were missing. We, thus, conclude that Hatha yoga has a positive influence on executive control, potentially through improvements in working memory rather than directly on switching.Clinical trial registrationclinicaltrials.gov, identifier [NCT05232422].
Collapse
Affiliation(s)
- Bence Szaszkó
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
| | - Rebecca Rosa Schmid
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
| | - Ulrich Pomper
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
| | - Mira Maiworm
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
| | - Sophia Laiber
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
| | - Max Josef Lange
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
| | - Hannah Tschenett
- Department of Clinical and Health Psychology, University of Vienna, Vienna, Austria
- University Research Platform "The Stress of Life-Processes and Mechanisms Underlying Everyday Life Stress", University of Vienna, Vienna, Austria
| | - Urs Markus Nater
- Department of Clinical and Health Psychology, University of Vienna, Vienna, Austria
- University Research Platform "The Stress of Life-Processes and Mechanisms Underlying Everyday Life Stress", University of Vienna, Vienna, Austria
| | - Ulrich Ansorge
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
- Vienna Cognitive Science Hub, University of Vienna, Vienna, Austria
- Research Platform Mediatised Lifeworlds, University of Vienna, Vienna, Austria
| |
Collapse
|
3
|
Li M, Pan J, Li Y, Gao Y, Qin H, Shen Y. Multimodal Physiological Analysis of Impact of Emotion on Cognitive Control in VR. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2024; 30:2044-2054. [PMID: 38437118 DOI: 10.1109/tvcg.2024.3372101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2024]
Abstract
Cognitive control is often perplexing to elucidate and can be easily influenced by emotions. Understanding the individual cognitive control level is crucial for enhancing VR interaction and designing adaptive and self-correcting VR/AR applications. Emotions can reallocate processing resources and influence cognitive control performance. However, current research has primarily emphasized the impact of emotional valence on cognitive control tasks, neglecting emotional arousal. In this study, we comprehensively investigate the influence of emotions on cognitive control based on the arousal-valence model. A total of 26 participants are recruited, inducing emotions through VR videos with high ecological validity and then performing related cognitive control tasks. Leveraging physiological data including EEG, HRV, and EDA, we employ classification techniques such as SVM, KNN, and deep learning to categorize cognitive control levels. The experiment results demonstrate that high-arousal emotions significantly enhance users' cognitive control abilities. Utilizing complementary information among multi-modal physiological signal features, we achieve an accuracy of 84.52% in distinguishing between high and low cognitive control. Additionally, time-frequency analysis results confirm the existence of neural patterns related to cognitive control, contributing to a better understanding of the neural mechanisms underlying cognitive control in VR. Our research indicates that physiological signals measured from both the central and autonomic nervous systems can be employed for cognitive control classification, paving the way for novel approaches to improve VR/AR interactions.
Collapse
|
4
|
Karimova ED, Ovakimian AS, Katermin NS. Live vs video interaction: sensorimotor and visual cortical oscillations during action observation. Cereb Cortex 2024; 34:bhae168. [PMID: 38679481 DOI: 10.1093/cercor/bhae168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 03/28/2024] [Accepted: 04/01/2024] [Indexed: 05/01/2024] Open
Abstract
Increasingly, in the field of communication, education, and business, people are switching to video interaction, and interlocutors frequently complain that the perception of nonverbal information and concentration suffer. We investigated this issue by analyzing electroencephalogram (EEG) oscillations of the sensorimotor (mu rhythm) and visual (alpha rhythm) cortex of the brain in an experiment with action observation live and on video. The mu rhythm reflects the activity of the mirror neuron system, and the occipital alpha rhythm shows the level of visual attention. We used 32-channel EEG recorded during live and video action observation in 83 healthy volunteers. The ICA method was used for selecting the mu- and alpha-components; the Fourier Transform was used to calculate the suppression index relative to the baseline (stationary demonstrator) of the rhythms. The main range of the mu rhythm was indeed sensitive to social movement and was highly dependent on the conditions of interaction-live or video. The upper mu-range appeared to be less sensitive to the conditions, but more sensitive to different movements. The alpha rhythm did not depend on the type of movement; however, a live performance initially caused a stronger concentration of visual attention. Thus, subtle social and nonverbal perceptions may suffer in remote video interactions.
Collapse
Affiliation(s)
- Ekaterina D Karimova
- Laboratory of Applied Physiology of Human Higher Nervous Activity, Institute of Higher Nervous Activity and Neurophysiology of RAS (IHNA&NPh RAS), 5A Butlerova street, 117485 Moscow, the Russian Federation
| | - Alena S Ovakimian
- Laboratory of Applied Physiology of Human Higher Nervous Activity, Institute of Higher Nervous Activity and Neurophysiology of RAS (IHNA&NPh RAS), 5A Butlerova street, 117485 Moscow, the Russian Federation
| | - Nikita S Katermin
- Flow cytometry data processing group, BostonGene Technologies, Hrachya Qochar Str., 2A, 0033, Yerevan, Armenia
| |
Collapse
|
5
|
Jia S, Meng Y, Gao Y, Ao L, Yang L, Wang H, Liu Y. The absence of one's intimate partner promotes dyadic competition through enhanced interbrain synchronization between opponents. Front Psychol 2024; 15:1298175. [PMID: 38328380 PMCID: PMC10847280 DOI: 10.3389/fpsyg.2024.1298175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Accepted: 01/09/2024] [Indexed: 02/09/2024] Open
Abstract
Competition is a common occurrence in life, but the influence of intimate relationships on people's competitiveness remains unknown. Grounded in Darwin's theory of sexual selection, this study utilized EEG hyperscanning technology to investigate the influence of the presence of romantic partners and the gender of competitors on the interbrain synchronization of female individuals during competitive contexts. The research results showed that in competitive interactions, there was a significant increase in Theta and Alpha frequency band activity between females and their competitors. Interbrain synchronization was strongest when their partners were not nearby and females competed with same gender competitors. The research results indicate that intimate companionship has an impact on the early alertness and late cognitive execution mechanisms of female individuals in competition, and due to intimate relationships, females pay more attention to same-gender competitors. This study demonstrates that the presence of intimate partners can affect a female's competitive state and brain synchronization with opponents of different genders, improving the theoretical explanation of intimate relationships and competitive interactions.
Collapse
Affiliation(s)
- Shuyu Jia
- School of Psychology and Mental Health, North China University of Science and Technology, Tangshan, Hebei, China
| | - Yujia Meng
- School of Psychology and Mental Health, North China University of Science and Technology, Tangshan, Hebei, China
| | - Yuan Gao
- School of Psychology and Mental Health, North China University of Science and Technology, Tangshan, Hebei, China
| | - Lihong Ao
- School of Psychology and Mental Health, North China University of Science and Technology, Tangshan, Hebei, China
| | - Lei Yang
- School of Psychology and Mental Health, North China University of Science and Technology, Tangshan, Hebei, China
| | - He Wang
- School of Public Health, School of Psychology and Mental Health, North China University of Science and Technology, Tangshan, Hebei, China
| | - Yingjie Liu
- School of Public Health, School of Psychology and Mental Health, North China University of Science and Technology, Tangshan, Hebei, China
| |
Collapse
|