1
|
Luna R, Vadillo MA, Luque D. Model-free decision making resists improved instructions and is enhanced by stimulus-response associations. Cortex 2023; 168:102-113. [PMID: 37690266 DOI: 10.1016/j.cortex.2023.06.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 05/16/2023] [Accepted: 06/20/2023] [Indexed: 09/12/2023]
Abstract
Human behaviour may be thought of as supported by two different computational-learning mechanisms, model-free and model-based respectively. In model-free strategies, stimulus-response associations are strengthened when actions are followed by a reward and weakened otherwise. In model-based learning, previous to selecting an action, the current values of the different possible actions are computed based on a detailed model of the environment. Previous research with the two-stage task suggests that participants' behaviour usually shows a mixture of both strategies. But, interestingly, a recent study by da Silva and Hare (2020) found that participants primarily deploy model-based behaviour when they are given detailed instructions about the structure of the task. In the present study, we reproduce this essential experiment. Our results confirm that improved instructions give rise to a stronger model-based component. Crucially, we also found a significant effect of reward that became stronger under conditions that favoured the development of strong stimulus-response associations. This suggests that the effect of reward, often taken as indicator of a model-free component, is related to stimulus-response learning.
Collapse
Affiliation(s)
- Raúl Luna
- Institute of Optics, Spanish National Research Council (CSIC), Spain.
| | - Miguel A Vadillo
- Department of Basic Psychology, Faculty of Psychology, Universidad Autónoma de Madrid, Spain
| | - David Luque
- Department of Basic Psychology and Speech Therapy, Faculty of Psychology, Universidad de Málaga, Spain.
| |
Collapse
|
2
|
Weissbach A, Moyé J, Takacs A, Verrel J, Chwolka F, Friedrich J, Paulus T, Zittel S, Bäumer T, Frings C, Pastötter B, Beste C, Münchau A. Perception-Action Integration Is Altered in Functional Movement Disorders. Mov Disord 2023; 38:1399-1409. [PMID: 37315159 DOI: 10.1002/mds.29458] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Revised: 04/25/2023] [Accepted: 05/12/2023] [Indexed: 06/16/2023] Open
Abstract
BACKGROUND Although functional neurological movement disorders (FMD) are characterized by motor symptoms, sensory processing has also been shown to be disturbed. However, how the integration of perception and motor processes, essential for the control of goal-directed behavior, is altered in patients with FMD is less clear. A detailed investigation of these processes is crucial to foster a better understanding of the pathophysiology of FMD and can systematically be achieved in the framework of the theory of event coding (TEC). OBJECTIVE The aim was to investigate perception-action integration processes on a behavioral and neurophysiological level in patients with FMD. METHODS A total of 21 patients and 21 controls were investigated with a TEC-related task, including concomitant electroencephalogram (EEG) recording. We focused on EEG correlates established to reflect perception-action integration processes. Temporal decomposition allowed to distinguish between EEG codes reflecting sensory (S-cluster), motor (R-cluster), and integrated sensory-motor processing (C-cluster). We also applied source localization analyses. RESULTS Behaviorally, patients revealed stronger binding between perception and action, as evidenced by difficulties in reconfiguring previously established stimulus-response associations. Such hyperbinding was paralleled by a modulation of neuronal activity clusters, including reduced C-cluster modulations of the inferior parietal cortex and altered R-cluster modulations in the inferior frontal gyrus. Correlations of these modulations with symptom severity were also evident. CONCLUSIONS Our study shows that FMD is characterized by altered integration of sensory information with motor processes. Relations between clinical severity and both behavioral performance and neurophysiological abnormalities indicate that perception-action integration processes are central and a promising concept for the understanding of FMD. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
Collapse
Affiliation(s)
- Anne Weissbach
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Josephine Moyé
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Adam Takacs
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, TU Dresden, Dresden, Germany
| | - Julius Verrel
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Fabian Chwolka
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Julia Friedrich
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Theresa Paulus
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
- Department of Neurology, University of Lübeck, Lübeck, Germany
| | - Simone Zittel
- Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Tobias Bäumer
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Christian Frings
- Department of Cognitive Psychology, Trier University Trier, Trier, Germany
| | - Bernhard Pastötter
- Department of Cognitive Psychology, Trier University Trier, Trier, Germany
| | - Christian Beste
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, TU Dresden, Dresden, Germany
| | - Alexander Münchau
- Institute of Systems Motor Science, Center of Brain, Behavior, and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| |
Collapse
|
3
|
Molinero S, Giménez-Fernández T, López FJ, Carretié L, Luque D. Stimulus-response learning and expected reward value enhance stimulus cognitive processing: An ERP study. Psychophysiology 2021; 58:e13795. [PMID: 33604885 DOI: 10.1111/psyp.13795] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 01/20/2021] [Accepted: 02/03/2021] [Indexed: 12/15/2022]
Abstract
Reward affects our attention to stimuli, prioritizing those that lead to high-value outcomes. Recently, it has been suggested that such reward-related cognitive prioritization might be associated with the process of learning new stimulus-response (S-R) associations, because both are acquired through extended reward training, and once established, they are hard to overcome. We used event-related potentials (ERP) to analyze the contribution of S-R links to the formation of reward-related cognitive prioritization during reinforcement learning. Reward-related cognitive prioritization was measured by comparing the ERP signals for stimuli predicting high-value and low-value outcomes. In addition, we compared a strong S-R link (same stimulus, same response), with a weak S-R link condition (same stimulus, two different responses). The participants' performance was more accurate and faster when the procedure allowed for establishing strong S-R links and for high-value outcomes. Furthermore, those stimuli associated with strong S-R links showed a larger P3 amplitude at parietal sites. Value effects (larger ERP activity for those stimuli predicting a high-value outcome) were obtained at parietal and occipital sites in the P3 time window. However, value effects did not benefit from strong S-R links in either the P1 or the P3 components. These results suggest that strong S-R learning is not necessary to develop reward-related modulations of ERP activity.
Collapse
Affiliation(s)
- Sara Molinero
- Departamento de Psicología Básica, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain.,Departamento de Psicología Básica, Facultad de Psicología, Universidad de Málaga, Málaga, Spain
| | - Tamara Giménez-Fernández
- Departamento de Psicología Básica, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - Francisco J López
- Departamento de Psicología Básica, Facultad de Psicología, Universidad de Málaga, Málaga, Spain.,Instituto de Investigación Biomédica de Málaga-IBIMA, Málaga, Spain
| | - Luis Carretié
- Departamento de Psicología Básica, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - David Luque
- Departamento de Psicología Básica, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain.,Departamento de Psicología Básica, Facultad de Psicología, Universidad de Málaga, Málaga, Spain
| |
Collapse
|
4
|
Verleger R. Effects of relevance and response frequency on P3b amplitudes: Review of findings and comparison of hypotheses about the process reflected by P3b. Psychophysiology 2020; 57:e13542. [DOI: 10.1111/psyp.13542] [Citation(s) in RCA: 61] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2019] [Revised: 01/08/2020] [Accepted: 01/14/2020] [Indexed: 01/23/2023]
Affiliation(s)
- Rolf Verleger
- Department of Neurology University of Lübeck Lübeck Germany
- Institute of Psychology II University of Lübeck Lübeck Germany
| |
Collapse
|
5
|
Revisiting the relationship between the P3b and working memory updating. Biol Psychol 2019; 148:107769. [PMID: 31525391 DOI: 10.1016/j.biopsycho.2019.107769] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2018] [Revised: 08/04/2019] [Accepted: 09/10/2019] [Indexed: 12/29/2022]
Abstract
The P3b is an extensively studied neurophysiological phenomenon that is predominantly explained in the cognitive neuroscience literature as reflecting context updating, presumably in working memory (WM). Despite the prevalence and influence of the context updating hypothesis, direct empirical support for the role of WM updating in eliciting the P3b is still missing. The present study was designed to address the empirical gap in understanding the functional role of P3b in general, and specifically in relation to WM updating. A mass-univariate approach was used to test the unique contribution of WM updating, categorization, and stimulus probability to the P3b. The results indicated that the P3b is only modulated by the categorization process, a finding that challenges the WM updating hypothesis. Taken together these results, we suggest that the P3b reflects a WM guided target identification mechanism, which operates as part of a goal-directed learning strategy.
Collapse
|
6
|
Cerebral cortical networking for mental workload assessment under various demands during dual-task walking. Exp Brain Res 2019; 237:2279-2295. [DOI: 10.1007/s00221-019-05550-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2018] [Accepted: 04/24/2019] [Indexed: 01/22/2023]
|
7
|
The oddball effect on P3 disappears when feature relevance or feature-response mappings are unknown. Exp Brain Res 2018; 236:2781-2796. [DOI: 10.1007/s00221-018-5334-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2018] [Accepted: 07/16/2018] [Indexed: 11/26/2022]
|
8
|
Harper J, Malone SM, Iacono WG. Theta- and delta-band EEG network dynamics during a novelty oddball task. Psychophysiology 2017; 54:1590-1605. [PMID: 28580687 PMCID: PMC5638675 DOI: 10.1111/psyp.12906] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2016] [Revised: 04/12/2017] [Accepted: 05/15/2017] [Indexed: 11/27/2022]
Abstract
While the P3 component during target detection and novelty processing has been widely studied, less is known about its underlying network dynamics. A recent cognitive model suggests that frontal-parietal and frontal-temporal interregional connectivity are related to attention/action selection and target-related memory updating during the P3, respectively, but empirical work testing this model is lacking. Other work suggests the importance of theta- and delta-band connectivity between the medial frontal cortex and distributed cortical regions during attention, stimulus detection, and response selection processes, and similar dynamics may underlie P3-related network connectivity. The present study evaluated the functional connectivity elicited during a visual task, which combined oddball target and novelty stimuli, in a sample of 231 same-sex twins. It was hypothesized that both target and novel conditions would involve theta frontoparietal connectivity and medial frontal theta power, but that target stimuli would elicit the strongest frontotemporal connectivity. EEG time-frequency analysis revealed greater theta-band frontoparietal connectivity and medial frontal power during both target and novel conditions compared to standards, which may index conflict/uncertainty resolution processes. Theta-band frontotemporal connectivity was maximal during the target condition, potentially reflecting context updating or stimulus-response activation. Delta-band frontocentral-parietal connectivity was also strongest following targets, which may be sensitive to response-related demands. These results suggest the existence of functional networks related to P3 that are differentially engaged by target oddballs and novel distractors. Compared to simple P3 amplitude, network measures may provide a more nuanced view of the neural dynamics during target detection/novelty processing in normative and pathological populations.
Collapse
Affiliation(s)
- Jeremy Harper
- Department of Psychology, University of Minnesota, Minneapolis, Minnesota, USA
| | - Stephen M Malone
- Department of Psychology, University of Minnesota, Minneapolis, Minnesota, USA
| | - William G Iacono
- Department of Psychology, University of Minnesota, Minneapolis, Minnesota, USA
| |
Collapse
|
9
|
Verleger R, Cäsar S, Siller B, Śmigasiewicz K. On Why Targets Evoke P3 Components in Prediction Tasks: Drawing an Analogy between Prediction and Matching Tasks. Front Hum Neurosci 2017; 11:497. [PMID: 29066965 PMCID: PMC5641317 DOI: 10.3389/fnhum.2017.00497] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2017] [Accepted: 09/27/2017] [Indexed: 11/30/2022] Open
Abstract
P3 is the most conspicuous component in recordings of stimulus-evoked EEG potentials from the human scalp, occurring whenever some task has to be performed with the stimuli. The process underlying P3 has been assumed to be the updating of expectancies. More recently, P3 has been related to decision processing and to activation of established stimulus-response associations (S/R-link hypothesis). However, so far this latter approach has not provided a conception about how to explain the occurrence of P3 with predicted stimuli, although P3 was originally discovered in a prediction task. The present article proposes such a conception. We assume that the internal responses right or wrong both become associatively linked to each predicted target and that one of these two response alternatives gets activated as a function of match or mismatch of the target to the preceding prediction. This seems similar to comparison tasks where responses depend on the matching of the target stimulus with a preceding first stimulus (S1). Based on this idea, this study compared the effects of frequencies of first events (predictions or S1) on target-evoked P3s in prediction and comparison tasks. Indeed, frequencies not only of targets but also of first events had similar effects across tasks on target-evoked P3s. These results support the notion that P3 evoked by predicted stimuli reflects activation of appropriate internal “match” or “mismatch” responses, which is compatible with S/R-link hypothesis.
Collapse
Affiliation(s)
- Rolf Verleger
- Department of Neurology, University of Lübeck, Lübeck, Germany.,Institute of Psychology II, University of Lübeck, Lübeck, Germany
| | - Stephanie Cäsar
- Department of Neurology, University of Lübeck, Lübeck, Germany
| | - Bastian Siller
- Department of Neurology, University of Lübeck, Lübeck, Germany
| | - Kamila Śmigasiewicz
- Department of Neurology, University of Lübeck, Lübeck, Germany.,Laboratoire de Neuroscience Cognitive, Aix-Marseille Université, CNRS, Marseille, France
| |
Collapse
|
10
|
Effects on P3 of spreading targets and response prompts apart. Biol Psychol 2017; 126:1-11. [DOI: 10.1016/j.biopsycho.2017.03.011] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2016] [Revised: 02/08/2017] [Accepted: 03/28/2017] [Indexed: 11/21/2022]
|
11
|
Van der Lubbe RHJ, Kuniecki M. Editorial Special Issue: Neuronus. Adv Cogn Psychol 2016; 12:150-153. [PMID: 28154611 PMCID: PMC5279853 DOI: 10.5709/acp-0194-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
This special issue of the 12th volume of Advances in Cognitive Psychology is
devoted to the Neuronus conference that took place in Kraków in 2015. In this
editorial letter, we will focus on a selection of the materials and some
follow-up research that was presented during this conference. We will also
briefly introduce the conference contributions that successfully passed an
external reviewing process.
Collapse
Affiliation(s)
| | - Michał Kuniecki
- Psychophysiological Laboratory of the Jagiellonian University,
Kraków, Poland
| |
Collapse
|