1
|
Hassall CD, Hunt LT, Holroyd CB. Task-level value affects trial-level reward processing. Neuroimage 2022; 260:119456. [PMID: 35809889 DOI: 10.1016/j.neuroimage.2022.119456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 07/05/2022] [Accepted: 07/06/2022] [Indexed: 10/17/2022] Open
Abstract
Despite disagreement about how anterior cingulate cortex (ACC) supports decision making, a recent hypothesis suggests that activity in this region is best understood in the context of a task or series of tasks. One important task-level variable is average reward because it is both a known driver of effortful behaviour and an important determiner of the tasks in which we choose to engage. Here we asked how average task value affects reward-related ACC activity. To answer this question, we measured a reward-related signal said to be generated in ACC called the reward positivity (RewP) while participants gambled in three tasks of differing average value. The RewP was reduced in the high-value task, an effect that was not explainable by either reward magnitude or outcome expectancy. This result suggests that ACC does not evaluate outcomes and cues in isolation, but in the context of the value of the current task.
Collapse
Affiliation(s)
| | | | - Clay B Holroyd
- Department of Experimental Psychology, Ghent University, Ghent, Belgium; Department of Psychology, University of Victoria, Victoria, BC, Canada.
| |
Collapse
|
2
|
Do food images as action outcomes evoke a reward positivity? Brain Cogn 2021; 154:105804. [PMID: 34592683 DOI: 10.1016/j.bandc.2021.105804] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 09/14/2021] [Accepted: 09/20/2021] [Indexed: 11/24/2022]
Abstract
Favourable compared to unfavourable action outcomes typically evoke a positive-going amplitude shift at frontomedial electrodes in the scalp-recorded electroencephalogram. Since prior studies on this Reward Positivity (RewP) have heavily relied on monetary outcomes, it is still debated whether the RewP is also elicited by other kinds of reward. We addressed this issue by focussing on food as another major category of daily reward. Twenty-eight healthy participants completed a decision task, in which they received images of personally liked, neutral or disliked food as outcome stimuli. Importantly, single trial outcomes were of relevance for a prolonged task goal (i.e., obtaining the liked foods and avoiding the disliked foods). The observed amplitude pattern did not correspond to the typical RewP effect observed for monetary outcomes. In particular, disliked foods evoked a similar positive-going amplitude shift as liked foods when compared to neutral foods. Exploratory analyses indicated that this pattern may result from a spatiotemporal overlap between a potential RewP response and other, emotion-related ERP components (i.e., the Early Posterior Negativity and the Late Positive Potential). We discuss our findings with regard to theoretical and methodological implications for the usage of the RewP in the study of reward processing.
Collapse
|
3
|
Carsten T, Kostandyan M, Boehler CN, Krebs RM. Comparing the motivational value of rewards and losses in an EEG-pupillometry study. Eur J Neurosci 2020; 53:1822-1838. [PMID: 33244798 DOI: 10.1111/ejn.15064] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 11/14/2020] [Accepted: 11/15/2020] [Indexed: 01/10/2023]
Abstract
We found earlier that performance-contingent rewards lead to faster performance than equivalent losses [Carsten, Hoofs, Boehler, & Krebs, 2019. Motivation Science, 5(3). http://dx.doi.org/10.1037/mot0000117]. Here, we further tested the hypothesis that motivation to gain rewards is higher than to avoid losses, even when incentive values are matched. As implicit markers of motivation, we assessed electroencephalography (EEG) focusing on the P3 after target and feedback onset, and the Feedback-Related Negativity (FRN), as well as simultaneously recorded pupil size. Comparing only reward and loss prospect trials in Experiment 1, we found no consistent differences in behavior and electrophysiological markers of motivation, although pupil data suggested higher arousal after feedback in potential-loss trials. Including additional no-incentive trials in Experiment 2, we found consistent evidence that motivation to gain rewards was higher than to avoid losses: In line with behavior, the target-P3 was most pronounced for reward-related stimuli, followed by loss and no-incentive ones. This same ranking was found in the P3 and the FRN after positive outcomes (i.e., reward, avoided loss, and correct feedback in no-incentive trials). Negative outcomes featured a different pattern in line with the pupil response, which suggests that losses are emotionally salient events, without invigorating behavior proportionally. In sum, these findings suggest that the motivation to gain rewards is more pronounced than motivation to avoid equivalent losses, at least in tasks promoting transient increases in attention triggered by incentive prospect. These motivational differences may arise as avoided losses are not profitable in the long term, in contrast to gained rewards.
Collapse
Affiliation(s)
- Thomas Carsten
- Department of Experimental Psychology, Ghent University, Gent, Belgium.,Institute of Neuroscience, Université catholique de Louvain, Brussels, Belgium
| | - Mariam Kostandyan
- Department of Experimental Psychology, Ghent University, Gent, Belgium
| | - C Nico Boehler
- Department of Experimental Psychology, Ghent University, Gent, Belgium
| | - Ruth M Krebs
- Department of Experimental Psychology, Ghent University, Gent, Belgium
| |
Collapse
|
4
|
Lange L, Osinsky R. Aiming at ecological validity-Midfrontal theta oscillations in a toy gun shooting task. Eur J Neurosci 2020; 54:8214-8224. [PMID: 32954574 DOI: 10.1111/ejn.14977] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Revised: 08/23/2020] [Accepted: 09/02/2020] [Indexed: 11/29/2022]
Abstract
Laboratory electroencephalography (EEG) studies have already provided important insights into the neuronal mechanisms of performance monitoring. However, to our knowledge no study so far has examined neuronal correlates of performance monitoring using an ecologically valid task outside a typical laboratory setting. Therefore, we examined midfrontal theta and the feedback-related negativity (FRN) using mobile EEG in a physical shooting task within an ecologically valid environment with highly dynamical visual feedback. Participants shot a target using a toy gun while moving and looking around freely. Shots that missed the target evoked stronger midfrontal theta activity than hits and this response was rather phase-unlocked. There was no difference between misses and hits in the FRN. The results raise the question whether the absence of certain ERP components like the FRN could be due to methodological reasons or to the fact that partially different neuronal processes may be activated in the laboratory as compared to more ecologically valid tasks. Overall, our results indicate that crucial neurocognitive processes of performance monitoring can be assessed in highly dynamic and ecologically valid settings by mobile EEG.
Collapse
Affiliation(s)
- Leon Lange
- Institute of Psychology, Osnabrück University, Germany
| | - Roman Osinsky
- Institute of Psychology, Osnabrück University, Germany
| |
Collapse
|
5
|
Leue A, Nieden K, Scheuble V, Beauducel A. Individual differences of conflict monitoring and feedback processing during reinforcement learning in a mock forensic context. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2020; 20:408-426. [PMID: 32043207 PMCID: PMC7105439 DOI: 10.3758/s13415-020-00776-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
This study investigated individual differences of conflict monitoring (N2 component), feedback processing (feedback negativity component), and reinforcement learning in a discrimination learning task using a mock (fictitious) forensic scenario to set participants in a semantic task context. We investigated individual differences of anxiety-related, impulsivity-related traits and reasoning ability during trial-and-error learning of mock suspect and nonsuspect faces. Thereby, we asked how the differential investment of cognitive-motivational processes facilitates learning in a mock forensic context. As learning can be studied by means of time-on-task effects (i.e., variations of cognitive processes across task blocks), we investigated the differential investment of cognitive-motivational processes block-wise in N = 100 participants. By performing structural equation modeling, we demonstrate that conflict monitoring decreased across task blocks, whereas the percentage of correct responses increased across task blocks. Individuals with higher reasoning scores and higher impulsivity-related traits relied rather on feedback processing (i.e., external indicators) during reinforcement learning. Individuals with higher anxiety-related traits intensified their conflict monitoring throughout the task to learn successfully. Observation by relevant others intensified conflict monitoring more than nonobservation. Our data highlight that individual differences and social context modulate the intensity of information processing in a discrimination learning task using a mock forensic task scenario. We discuss our data with regard to recent cognitive-motivational approaches and in terms of reinforcement learning.
Collapse
Affiliation(s)
- Anja Leue
- Institute of Psychology, University of Kiel, Olshausenstrasse 75, 24118, Kiel, Germany.
| | - Katharina Nieden
- Institute of Psychology, University of Kiel, Olshausenstrasse 75, 24118, Kiel, Germany
| | - Vera Scheuble
- Institute of Psychology, University of Bonn, Bonn, Germany
| | | |
Collapse
|
6
|
Yu H, Nan W, Yang G, Li Q, Wu H, Liu X. Your Performance Is My Concern: A Perspective-Taking Competition Task Affects ERPs to Opponent's Outcomes. Front Neurosci 2019; 13:1162. [PMID: 31736696 PMCID: PMC6829177 DOI: 10.3389/fnins.2019.01162] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Accepted: 10/14/2019] [Indexed: 12/30/2022] Open
Abstract
Previous research has shown that people have more empathic responses to in-group members and more schadenfreude to out-group members. As a dimension of cognitive empathy, perspective-taking has been considered to be related to the enhancement of empathy. We tried to combine these effects through manipulation of a competitive task with opponents and an in-group partner and investigated the potential effect of in-group bias or the perspective-taking effect on outcome evaluation. We hypothesized that the neural activities would provide evidence of in-group bias. We tested it with a simple gambling observation task and recorded subjects' electroencephalographic (EEG) signals. Our results showed that the opponent's loss evoked larger feedback-related negativity (FRN) and smaller P300 activity than the partner's loss condition, and there was a win vs. loss differential effect in P300 for the opponent only. The principal component analysis (PCA) replicated the loss vs. win P300 effect to opponent's performance. Moreover, the correlation between the inclusion of the other in the self (IOS) scores and FRN suggests perspective-taking may induce greater monitoring to opponent's performance, which increases the win vs. loss differentiation brain response to the out-group agent. Our results thus provide evidence for the enhanced attention toward out-group individuals after competition manipulation, as well as the motivation significance account of FRN.
Collapse
Affiliation(s)
- Hao Yu
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
| | - Weizhi Nan
- Department of Psychology, Center for Brain and Cognitive Sciences, School of Education, Guangzhou University, Guangzhou, China
| | - Guochun Yang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Qi Li
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Haiyan Wu
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Xun Liu
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
7
|
Modulation of feedback processing by social context in social anxiety disorder (SAD)-an event-related potentials (ERPs) study. Sci Rep 2019; 9:4795. [PMID: 30886233 PMCID: PMC6423138 DOI: 10.1038/s41598-019-41268-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2018] [Accepted: 02/27/2019] [Indexed: 01/08/2023] Open
Abstract
The ability to learn from feedback, especially under social scrutiny, is an essential prerequisite for successful interaction with the environment. Patients suffering from social anxiety disorder (SAD) have been proposed to show altered processing of and learning from feedback, especially depending on social context. However, the neural basis and behavioral consequences of altered reinforcement learning in SAD are not clear yet. In the present event-related potentials (ERPs) study, 34 SAD patients and 30 healthy control subjects (HC) performed an adapted version of a probabilistic feedback learning task in two distinct social conditions. In the observation condition, participants were observed by a confederate; in the control condition, they performed the task without being observed. Patients as compared to healthy controls experienced more subjective discomfort under social observation. Moreover, they showed better learning from negative feedback in the control condition, but reduced learning from negative feedback in the observation condition. This effect correlated with reduced differentiation of positive and negative feedback in the time range of the feedback-related negativity (FRN) under high action-feedback contingency. In addition, SAD patients demonstrated increased FRN amplitudes in the first half of the observation condition, in particular to positive feedback. The present results demonstrate that processing of and learning from feedback are altered in SAD, especially under social scrutiny. In particular, it appears that SAD patients do not process positive information adequately on the neural level, which may impair their ability to differentiate between negative and positive outcomes.
Collapse
|
8
|
Goals matter: Amplification of the motivational significance of the feedback when goal impact is increased. Brain Cogn 2018; 128:56-72. [DOI: 10.1016/j.bandc.2018.11.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2018] [Revised: 10/15/2018] [Accepted: 11/06/2018] [Indexed: 11/18/2022]
|
9
|
Shahnazian D, Shulver K, Holroyd CB. Electrophysiological responses of medial prefrontal cortex to feedback at different levels of hierarchy. Neuroimage 2018; 183:121-131. [DOI: 10.1016/j.neuroimage.2018.07.064] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2018] [Revised: 07/27/2018] [Accepted: 07/28/2018] [Indexed: 11/28/2022] Open
|
10
|
Osinsky R, Holst K, Ulrich N. When two become one: Electrocortical correlates of the integration of multiple action consequences. Int J Psychophysiol 2018; 132:252-261. [DOI: 10.1016/j.ijpsycho.2017.11.014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2017] [Revised: 10/20/2017] [Accepted: 11/21/2017] [Indexed: 12/22/2022]
|
11
|
Huberth M, Dauer T, Nanou C, Román I, Gang N, Reid W, Wright M, Fujioka T. Performance monitoring of self and other in a turn-taking piano duet: A dual-EEG study. Soc Neurosci 2018; 14:449-461. [PMID: 29938589 DOI: 10.1080/17470919.2018.1492968] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
During joint action tasks, expectations for outcomes of one's own and other's actions are collectively monitored. Recent evidence suggests that trait empathy levels may also influence performance monitoring processes. The present study investigated how outcome expectation and empathy interact during a turn-taking piano duet task, using simultaneous electroencephalography (EEG) recording. During the performances, one note in each player's part was altered in pitch to elicit the feedback-related negativity (FRN) and subsequent P3 complex. Pianists memorized and performed pieces containing either a similar or dissimilar sequence as their partner. For additional blocks, pianists also played both sequence types with an audio-only computer partner. The FRN and P3a were larger in response to self than other, while P3b occurred only in response to self, suggesting greater online monitoring of self- compared to other-produced actions during turn-taking joint action. P3a was larger when pianists played a similar sequence as their partner. Finally, as trait empathy level increased, FRN in response to self decreased. This association was absent for FRN in response to other. This may reflect that highly-empathetic musicians during joint performance could use a strategy to suppress exclusive focus on self-monitoring.
Collapse
Affiliation(s)
- Madeline Huberth
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA
| | - Tysen Dauer
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA
| | - Chryssie Nanou
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA
| | - Irán Román
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA
| | - Nick Gang
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA
| | - Wisam Reid
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA
| | - Matthew Wright
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA
| | - Takako Fujioka
- a Center for Computer Research in Music and Acoustics, Department of Music , Stanford University , Stanford , CA , USA.,b Stanford Neurosciences Institute , Stanford University , Stanford , CA , USA
| |
Collapse
|
12
|
Threadgill AH, Gable PA. The sweetness of successful goal pursuit: Approach-motivated pregoal states enhance the reward positivity during goal pursuit. Int J Psychophysiol 2017; 132:277-286. [PMID: 29274365 DOI: 10.1016/j.ijpsycho.2017.12.010] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2017] [Revised: 11/06/2017] [Accepted: 12/19/2017] [Indexed: 11/18/2022]
Abstract
Traditionally, the reward positivity (RewP) is thought to index a binary performance monitoring system sensitive to approach motivation. However, recent theoretical models have argued that feedback processing extends beyond simple "good" vs. "bad" associations, such that performance monitoring incorporates the complex, multi-step sequence of behaviors often necessary to attain rewards. The present study sought to go beyond simple stimulus-response paradigms to examine how approach-motivated states occurring in multi-step goal pursuit impacts the RewP. Additionally, outcome frequency was varied to examine how the P3, a neural marker of expectancy, influences the RewP. Using a modified monetary incentive delay paradigm, participants played a reaction time game where multiple correct responses were required to attain a reward. Additionally, each trial had the potential for a reward (approach-motivated state) or no reward (neutral state). Results revealed that RewP amplitudes were larger after reward trial win feedback than after reward trial no-win feedback across multiple stages of goal pursuit. Additionally, after for controlling outcome frequency via the P3, RewP amplitudes were larger in reward trials than in neutral trials across incremental stages of goal pursuit. The RewP appears to be sensitive to feedback indicating successfully completing sub-goals during pursuit of a goal, even when no immediate reward is given. Approach motivation enhances performance monitoring when multiple steps are needed to attain a desired outcome, which may increase the likelihood of goal acquisition and attainment.
Collapse
|
13
|
Chen X, Zheng T, Han L, Chang Y, Luo Y. The neural dynamics underlying the interpersonal effects of emotional expression on decision making. Sci Rep 2017; 7:46651. [PMID: 28425491 PMCID: PMC5397974 DOI: 10.1038/srep46651] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2016] [Accepted: 03/24/2017] [Indexed: 11/20/2022] Open
Abstract
Although numerous studies explore the effects of emotion on decision-making, the existing research has mainly focused on the influence of intrapersonal emotions, leaving the influence of one person’s emotions on another’s decisions underestimated. To specify how interpersonal emotions shape decision-making and delineate the underlying neural dynamics involved, the present study examined brain responses to utilitarian feedback combined with angry or happy faces in competitive and cooperative contexts. Behavioral results showed that participants responded slower following losses than wins when competitors express happiness but responded faster following losses than wins when cooperators express anger. Importantly, angry faces in competitive context reversed the differentiation pattern of feedback-related negativity (FRN) between losses and wins and diminished the difference between losses and wins on both P300 and theta power, but only diminished the difference on FRN between losses and wins in cooperative context. However, when partner displays happiness, losses versus wins elicited larger FRN and theta power in competitive context but smaller P300 in both contexts. These results suggest that interpersonal emotions shape decisions during both automatic motivational salience valuation (FRN) and conscious cognitive appraisal (P300) stages of processing, in which different emotional expressions exert interpersonal influence through different routes.
Collapse
Affiliation(s)
- Xuhai Chen
- Key Laboratory of Behavior and Cognitive Psychology in Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an 710062, China.,Key Laboratory of Modern Teaching Technology, Ministry of Education, Shaanxi Normal University, Xi'an 710062, China
| | - Tingting Zheng
- Key Laboratory of Behavior and Cognitive Psychology in Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an 710062, China
| | - Lingzi Han
- Key Laboratory of Behavior and Cognitive Psychology in Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an 710062, China
| | - Yingchao Chang
- Key Laboratory of Behavior and Cognitive Psychology in Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an 710062, China
| | - Yangmei Luo
- Key Laboratory of Behavior and Cognitive Psychology in Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an 710062, China
| |
Collapse
|
14
|
Reward-based contextual learning supported by anterior cingulate cortex. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2017; 17:642-651. [DOI: 10.3758/s13415-017-0502-3] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|