1
|
Chen NX, Wei P. Task demand modulates the effects of reward learning on emotional stimuli. Cogn Neurodyn 2024; 18:2263-2275. [PMID: 39555264 PMCID: PMC11564495 DOI: 10.1007/s11571-024-10082-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 01/19/2024] [Accepted: 01/28/2024] [Indexed: 11/19/2024] Open
Abstract
The current study used event-related potentials (ERPs) to examine the ability of task demand in modulating the effect of reward association on the processing of emotional faces. In the learning phase, a high or low reward probability was paired with male or female facial photos of angry, happy, or neutral expressions. Then, in the test phase, task demand was manipulated by asking participants to discriminate the emotionality or the gender of the pre-learned face with no reward at stake. The ERP results in the test phase revealed that the fronto-central N1 (60-100 ms) and the VPP (160-210 ms) components were sensitive to the interaction between reward and emotion, in that the differences between the mean amplitudes for high- and low-reward conditions were significantly larger in the neutral face and angry face conditions than in the happy face condition. Moreover, reward association and task demand showed a significant interaction over the right hemisphere for the N170 component (140-180 ms), with amplitude difference between high- and low-reward conditions being larger in the emotion task than that in the gender task. The later N2pc component exhibited an interaction between task demand and emotionality, in that happy faces elicited larger N2pc difference waves than angry and neutral faces did in the emotion task, but neutral faces elicited larger N2pc difference waves than angry faces did in the gender task. The N2pc effect aligned with behavioral performance. These results suggest that reward association acts as an 'emotional tagging' to imbue neutral or angry faces with motivational significance at early time windows. Task demand functions in a top-down way to modulate the deployment of attentional resources at the later attentional selection stage, but does not affect the early automatic processing of either emotion or reward association.
Collapse
Affiliation(s)
- Ning-Xuan Chen
- Beijing Key Laboratory of Learning and Cognition, School of Psychology, Capital Normal University, Beijing, 100048 China
| | - Ping Wei
- Beijing Key Laboratory of Learning and Cognition, School of Psychology, Capital Normal University, Beijing, 100048 China
| |
Collapse
|
2
|
Schaaf JV, Weidinger L, Molleman L, van den Bos W. Test-retest reliability of reinforcement learning parameters. Behav Res Methods 2024; 56:4582-4599. [PMID: 37684495 PMCID: PMC11289054 DOI: 10.3758/s13428-023-02203-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/18/2023] [Indexed: 09/10/2023]
Abstract
It has recently been suggested that parameter estimates of computational models can be used to understand individual differences at the process level. One area of research in which this approach, called computational phenotyping, has taken hold is computational psychiatry. One requirement for successful computational phenotyping is that behavior and parameters are stable over time. Surprisingly, the test-retest reliability of behavior and model parameters remains unknown for most experimental tasks and models. The present study seeks to close this gap by investigating the test-retest reliability of canonical reinforcement learning models in the context of two often-used learning paradigms: a two-armed bandit and a reversal learning task. We tested independent cohorts for the two tasks (N = 69 and N = 47) via an online testing platform with a between-test interval of five weeks. Whereas reliability was high for personality and cognitive measures (with ICCs ranging from .67 to .93), it was generally poor for the parameter estimates of the reinforcement learning models (with ICCs ranging from .02 to .52 for the bandit task and from .01 to .71 for the reversal learning task). Given that simulations indicated that our procedures could detect high test-retest reliability, this suggests that a significant proportion of the variability must be ascribed to the participants themselves. In support of that hypothesis, we show that mood (stress and happiness) can partly explain within-participant variability. Taken together, these results are critical for current practices in computational phenotyping and suggest that individual variability should be taken into account in the future development of the field.
Collapse
Affiliation(s)
- Jessica V Schaaf
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands.
- Cognitive Neuroscience Department, Radboud University Medical Centre, Nijmegen, the Netherlands.
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, the Netherlands.
| | - Laura Weidinger
- DeepMind, London, United Kingdom
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | - Lucas Molleman
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | - Wouter van den Bos
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| |
Collapse
|
3
|
Grabowska A, Zabielski J, Senderecka M. Machine learning reveals differential effects of depression and anxiety on reward and punishment processing. Sci Rep 2024; 14:8422. [PMID: 38600089 PMCID: PMC11366008 DOI: 10.1038/s41598-024-58031-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 03/25/2024] [Indexed: 04/12/2024] Open
Abstract
Recent studies suggest that depression and anxiety are associated with unique aspects of EEG responses to reward and punishment, respectively; also, abnormal responses to punishment in depressed individuals are related to anxiety, the symptoms of which are comorbid with depression. In a non-clinical sample, we aimed to investigate the relationships between reward processing and anxiety, between punishment processing and anxiety, between reward processing and depression, and between punishment processing and depression. Towards this aim, we separated feedback-related brain activity into delta and theta bands to isolate activity that indexes functionally distinct processes. Based on the delta/theta frequency and feedback valence, we then used machine learning (ML) to classify individuals with high severity of depressive symptoms and individuals with high severity of anxiety symptoms versus controls. The significant difference between the depression and control groups was driven mainly by delta activity; there were no differences between reward- and punishment-theta activities. The high severity of anxiety symptoms was marginally more strongly associated with the punishment- than the reward-theta feedback processing. The findings provide new insights into the differences in the impacts of anxiety and depression on reward and punishment processing; our study shows the utility of ML in testing brain-behavior hypotheses and emphasizes the joint effect of theta-RewP/FRN and delta frequency on feedback-related brain activity.
Collapse
Affiliation(s)
- Anna Grabowska
- Doctoral School in the Social Sciences, Jagiellonian University, Main Square 34, 30-010, Kraków, Poland.
- Institute of Philosophy, Jagiellonian University, Grodzka 52, 31-044, Kraków, Poland.
| | - Jakub Zabielski
- Institute of Philosophy, Jagiellonian University, Grodzka 52, 31-044, Kraków, Poland
| | - Magdalena Senderecka
- Institute of Philosophy, Jagiellonian University, Grodzka 52, 31-044, Kraków, Poland.
| |
Collapse
|
4
|
Shen Y, Tanabe HC. Neural correlates of evaluations of non-binary social feedback: An EEG study. Int J Psychophysiol 2023; 191:57-68. [PMID: 37524121 DOI: 10.1016/j.ijpsycho.2023.07.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 07/13/2023] [Accepted: 07/25/2023] [Indexed: 08/02/2023]
Abstract
PURPOSE In complex and diverse social circumstances, decision making is affected by social feedback. Although previous studies have examined the electrophysiological correlates of social feedback with a binary valence, those related to non-binary feedback, or the magnitude of social feedback, remain unclear. This study investigated the electrophysiological correlates of non-binary social feedback and subsequent action selection processing. METHODS Participants were asked to complete a Gabor patch direction judgment task in which they were required to make judgments before and after receiving social feedback. They were informed that the feedback stimuli represented the degree to which other participants made the same choice. RESULTS & CONCLUSION The results revealed that feedback that was highly concordant with the participant's judgments elicited greater P300 activity, which was associated with the fulfillment of expectations regarding social reward. Moreover, moderately concordant feedback induced stronger theta band power, which may indicate monitoring of subjective conflict. Temporal changes in theta power during feedback phase may also relate to adjustments in prediction error. Additionally, when an initial judgment was maintained following social feedback, we observed a stronger increase in beta power, indicating an association with post-social-feedback action processing.
Collapse
Affiliation(s)
- Yulei Shen
- Department of Psychological and Cognitive Sciences, Graduate School of Informatics, Nagoya University, Japan
| | - Hiroki C Tanabe
- Department of Psychological and Cognitive Sciences, Graduate School of Informatics, Nagoya University, Japan.
| |
Collapse
|
5
|
Park M, Song R, Ju K, Shin JC, Seo J, Fan X, Gao X, Ryu A, Li Y. Effects of Tai Chi and Qigong on cognitive and physical functions in older adults: systematic review, meta-analysis, and meta-regression of randomized clinical trials. BMC Geriatr 2023; 23:352. [PMID: 37280512 DOI: 10.1186/s12877-023-04070-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 05/25/2023] [Indexed: 06/08/2023] Open
Abstract
BACKGROUND Older adults experience age-related declines in physical and cognitive functions due to interactions between aging and chronic diseases. Tai Chi and Qigong (TCQ) might be beneficial in improving the physical function and delaying the cognitive decline of this population. The potential underlying mechanism was explored to determine the effects of TCQ on cognitive function via direct or indirect pathways. PURPOSE The objective of this systematic review was to determine the effects of TCQ on cognitive and physical functions in older adults using meta-analysis, and to determine the impact of TCQ on cognitive function while controlling for physical function using a meta-regression approach. METHODS A systematic search of 13 electronic databases (in English, Korean, and Chinese languages) identified 10,292 potentially eligible studies published between inception and May 2022. The bias in individual studies was assessed using the Cochrane Risk of Bias (version 2.0) tool. The heterogeneity of the studies was evaluated using a 95% prediction interval, and the meta-analysis and meta-regression were implemented using the Comprehensive Meta-Analysis (version 3) software. RESULTS Our search identified 17 randomized studies (n = 2,365, mean age = 70.3 years). The results of the meta-analysis that used a random-effects model indicated that TCQ had significant effects on both cognitive (Hedges' g = 0.29, 95% confidence interval [CI] = 0.17 to 0.42) and physical (Hedges' g = 0.32, 95% CI = 0.19 to 0.44) functions. We used meta-regression to explore the effect size of TCQ in association with physical function level. The regression model was significant (Q = 25.01, p = .070), and 55% of the heterogeneity was explained by physical function as a moderator variable. The effects of TCQ on cognitive function remained significant in this model when controlling for the effect of physical function (β = 0.46, p = .011). CONCLUSION This meta-regression of 17 randomized studies strongly suggests that TCQ has beneficial effects on physical and cognitive functions in older adults. The effect of TCQ on cognitive function remained significant after taking into account the significant effects of physical function as a moderator. The findings imply the potential health benefits of TCQ by promoting cognitive function in older adults directly and indirectly through enhancing physical function. PROSPERO REGISTRATION NUMBER: *PROSPERO international prospective register of systematic reviews, registration ID CRD42023394358.
Collapse
Affiliation(s)
- Moonkyoung Park
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea
| | - Rhayun Song
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea.
| | - Kyoungok Ju
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea
| | - Jacqueline C Shin
- Indiana State University, Department of Psychology, Terre Haute, IN, 47802, USA
| | - Jisu Seo
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea
| | - Xing Fan
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea
| | - Xianqi Gao
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea
| | - Ahyun Ryu
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea
| | - Yuelin Li
- Chungnam National University, College of Nursing, Daejeon, 35015, Republic of Korea
| |
Collapse
|
6
|
Wang X, Li Y, Li X, Dai DY, Hu W. The influence of varying positive affect in approach-motivation intensity on creative idea generation and creative idea evaluation: an fNIRS study. THINKING & REASONING 2022. [DOI: 10.1080/13546783.2022.2039293] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Xuewei Wang
- Centre for Mental Health Education, Xidian University, Xi’an, China
| | - Yadan Li
- Key Laboratory of Modern Teaching Technology (Ministry of Education), Center for Teacher Professional Ability Development, Shaanxi Normal University, Xi’an, China
- Collaborative Innovation Center of Assessment Towards Basic Education Quality at, Beijing Normal University, Beijing, China
| | - Xinyi Li
- Key Laboratory of Modern Teaching Technology (Ministry of Education), Center for Teacher Professional Ability Development, Shaanxi Normal University, Xi’an, China
| | - David Yun Dai
- Educational Psychology and Methodology, University at Albany, SUNY, Albany, NY, USA
| | - Weiping Hu
- Key Laboratory of Modern Teaching Technology (Ministry of Education), Center for Teacher Professional Ability Development, Shaanxi Normal University, Xi’an, China
- Collaborative Innovation Center of Assessment Towards Basic Education Quality at, Beijing Normal University, Beijing, China
| |
Collapse
|
7
|
Pierce JE, Péron J. The basal ganglia and the cerebellum in human emotion. Soc Cogn Affect Neurosci 2021; 15:599-613. [PMID: 32507876 PMCID: PMC7328022 DOI: 10.1093/scan/nsaa076] [Citation(s) in RCA: 110] [Impact Index Per Article: 27.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2019] [Revised: 04/03/2020] [Accepted: 06/02/2020] [Indexed: 12/26/2022] Open
Abstract
The basal ganglia (BG) and the cerebellum historically have been relegated to a functional role in producing or modulating motor output. Recent research, however, has emphasized the importance of these subcortical structures in multiple functional domains, including affective processes such as emotion recognition, subjective feeling elicitation and reward valuation. The pathways through the thalamus that connect the BG and cerebellum directly to each other and with extensive regions of the cortex provide a structural basis for their combined influence on limbic function. By regulating cortical oscillations to guide learning and strengthening rewarded behaviors or thought patterns to achieve a desired goal state, these regions can shape the way an individual processes emotional stimuli. This review will discuss the basic structure and function of the BG and cerebellum and propose an updated view of their functional role in human affective processing.
Collapse
Affiliation(s)
- Jordan E Pierce
- Clinical and Experimental Neuropsychology Laboratory, University of Geneva, 1205 Geneva, Switzerland
| | - Julie Péron
- Clinical and Experimental Neuropsychology Laboratory, University of Geneva, 1205 Geneva, Switzerland.,Neuropsychology Unit, Neurology Department, University Hospitals of Geneva, 1205 Geneva, Switzerland
| |
Collapse
|
8
|
Gable PA, Paul K, Pourtois G, Burgdorf J. Utilizing electroencephalography (EEG) to investigate positive affect. Curr Opin Behav Sci 2021. [DOI: 10.1016/j.cobeha.2021.03.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|