1
|
Observational reinforcement learning in children and young adults. NPJ SCIENCE OF LEARNING 2024; 9:18. [PMID: 38480747 PMCID: PMC10937639 DOI: 10.1038/s41539-024-00227-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Accepted: 02/21/2024] [Indexed: 03/17/2024]
Abstract
Observational learning is essential for the acquisition of new behavior in educational practices and daily life and serves as an important mechanism for human cognitive and social-emotional development. However, we know little about its underlying neurocomputational mechanisms from a developmental perspective. In this study we used model-based fMRI to investigate differences in observational learning and individual learning between children and younger adults. Prediction errors (PE), the difference between experienced and predicted outcomes, related positively to striatal and ventral medial prefrontal cortex activation during individual learning and showed no age-related differences. PE-related activation during observational learning was more pronounced when outcomes were worse than predicted. Particularly, negative PE-coding in the dorsal medial prefrontal cortex was stronger in adults compared to children and was associated with improved observational learning in children and adults. The current findings pave the way to better understand observational learning challenges across development and educational settings.
Collapse
|
2
|
Diminished State Space Theory of Human Aging. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2023:17456916231204811. [PMID: 37931229 DOI: 10.1177/17456916231204811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2023]
Abstract
Many new technologies, such as smartphones, computers, or public-access systems (like ticket-vending machines), are a challenge for older adults. One feature that these technologies have in common is that they involve underlying, partially observable, structures (state spaces) that determine the actions that are necessary to reach a certain goal (e.g., to move from one menu to another, to change a function, or to activate a new service). In this work we provide a theoretical, neurocomputational account to explain these behavioral difficulties in older adults. Based on recent findings from age-comparative computational- and cognitive-neuroscience studies, we propose that age-related impairments in complex goal-directed behavior result from an underlying deficit in the representation of state spaces of cognitive tasks. Furthermore, we suggest that these age-related deficits in adaptive decision-making are due to impoverished neural representations in the orbitofrontal cortex and hippocampus.
Collapse
|
3
|
Neural evidence for age-related deficits in the representation of state spaces. Cereb Cortex 2023; 33:1768-1781. [PMID: 35510942 DOI: 10.1093/cercor/bhac171] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Revised: 04/08/2022] [Accepted: 04/09/2022] [Indexed: 11/12/2022] Open
Abstract
Under high cognitive demands, older adults tend to resort to simpler, habitual, or model-free decision strategies. This age-related shift in decision behavior has been attributed to deficits in the representation of the cognitive maps, or state spaces, necessary for more complex model-based decision-making. Yet, the neural mechanisms behind this shift remain unclear. In this study, we used a modified 2-stage Markov task in combination with computational modeling and single-trial EEG analyses to establish neural markers of age-related changes in goal-directed decision-making under different demands on the representation of state spaces. Our results reveal that the shift to simpler decision strategies in older adults is due to (i) impairments in the representation of the transition structure of the task and (ii) a diminished signaling of the reward value associated with decision options. In line with the diminished state space hypothesis of human aging, our findings suggest that deficits in goal-directed, model-based behavior in older adults result from impairments in the representation of state spaces of cognitive tasks.
Collapse
|
4
|
Changes in the Prevalence of Thin Bodies Bias Young Women's Judgments About Body Size. Psychol Sci 2022; 33:1212-1225. [PMID: 35802627 DOI: 10.1177/09567976221082941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Body dissatisfaction is pervasive among young women in Western countries. Among the many forces that contribute to body dissatisfaction, the overrepresentation of thin bodies in visual media has received notable attention. In this study, we proposed that prevalence-induced concept change may be one of the cognitive mechanisms that explain how beauty standards shift. We conducted a preregistered online experiment with young women (N = 419) and found that when the prevalence of thin bodies in the environment increased, the concept of being overweight expanded to include bodies that would otherwise be judged as "normal." Exploratory analyses revealed significant individual differences in sensitivity to this effect, in terms of women's judgments about other bodies as well as their own. These results suggest that women's judgments about other women's bodies are biased by an overrepresentation of thinness and lend initial support to policies designed to increase size-inclusive representation in the media.
Collapse
|
5
|
Need for cognition does not account for individual differences in metacontrol of decision making. Sci Rep 2022; 12:8240. [PMID: 35581395 PMCID: PMC9114337 DOI: 10.1038/s41598-022-12341-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Accepted: 05/09/2022] [Indexed: 12/05/2022] Open
Abstract
Humans show metacontrol of decision making, that is they adapt their reliance on decision-making strategies toward situational differences such as differences in reward magnitude. Specifically, when higher rewards are at stake, individuals increase reliance on a more accurate but cognitively effortful strategy. We investigated whether the personality trait Need for Cognition (NFC) explains individual differences in metacontrol. Based on findings of cognitive effort expenditure in executive functions, we expected more metacontrol in individuals low in NFC. In two independent studies, metacontrol was assessed by means of a decision-making task that dissociates different reinforcement-learning strategies and in which reward magnitude was manipulated across trials. In contrast to our expectations, NFC did not account for individual differences in metacontrol of decision making. In fact, a Bayesian analysis provided moderate to strong evidence against a relationship between NFC and metacontrol. Beyond this, there was no consistent evidence for relationship between NFC and overall model-based decision making. These findings show that the effect of rewards on the engagement of effortful decision-making strategies is largely independent of the intrinsic motivation for engaging in cognitively effortful tasks and suggest a differential role of NFC for the regulation of cognitive effort in decision making and executive functions.
Collapse
|
6
|
Abstract
The development of metacontrol of decision making and its susceptibility to framing effects were investigated in a sample of 201 adolescents and adults in Germany (12-25 years, 111 female, ethnicity not recorded). In a task that dissociates model-free and model-based decision making, outcome magnitude and outcome valence were manipulated. Both adolescents and adults showed metacontrol and metacontrol tended to increase across adolescence. Furthermore, model-based decision making was more pronounced for loss compared to gain frames but there was no evidence that this framing effect differed with age. Thus, the strategic adaptation of decision making continues to develop into young adulthood and for both adolescents and adults, losses increase the motivation to invest cognitive resources into an effortful decision-making strategy.
Collapse
|
7
|
Seizing the opportunity: Lifespan differences in the effects of the opportunity cost of time on cognitive control. Cognition 2021; 216:104863. [PMID: 34384965 DOI: 10.1016/j.cognition.2021.104863] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Revised: 07/21/2021] [Accepted: 07/23/2021] [Indexed: 12/30/2022]
Abstract
Previous work suggests that lifespan developmental differences in cognitive control reflect maturational and aging-related changes in prefrontal cortex functioning. However, complementary explanations exist: It could be that children and older adults differ from younger adults in how they balance the effort of engaging in control against its potential benefits. Here we test whether the degree of cognitive effort expenditure depends on the opportunity cost of time (average reward rate per unit time): if the average reward rate is high, participants should withhold cognitive effort whereas if it is low, they should invest more. In Experiment 1, we examine this hypothesis in children, adolescents, younger, and older adults, by applying a reward rate manipulation in two cognitive control tasks: a modified Erikson Flanker and a task-switching paradigm. We found that young adults and adolescents reflexively withheld effort when the opportunity cost of time was high, whereas older adults and, to a lesser degree children, invested more resources to accumulate reward as quickly as possible. We tentatively interpret these results in terms of age- and task-specific differences in the processing of the opportunity cost of time. We qualify our findings in a second experiment in younger adults in which we address an alternative explanation of our results and show that the observed age differences in effort expenditure may not result from differences in task difficulty. To conclude, we think that our results present an interesting first step at relating opportunity costs to motivational processes across the lifespan. We frame the implications of further work in this area within a recent developmental model of resource-rationality, which points to developmental sweet spots in cognitive control.
Collapse
|
8
|
Human aging alters social inference about others' changing intentions. Neurobiol Aging 2021; 103:98-108. [PMID: 33845400 DOI: 10.1016/j.neurobiolaging.2021.01.034] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Revised: 01/08/2021] [Accepted: 01/09/2021] [Indexed: 01/28/2023]
Abstract
Decoding others' intentions accurately in order to adapt one's own behavior is pivotal throughout life. In this study, we asked how younger and older adults deal with uncertainty in dynamic social environments. We used an advice-taking paradigm together with Bayesian modeling to characterize effects of aging on learning about others' time-varying intentions. We observed age differences when comparing learning on two levels of social uncertainty: the fidelity of the adviser and the volatility of intentions. Older adults expected the adviser to change his/her intentions more frequently (i.e., a higher volatility of the adviser). They also showed higher confidence (i.e., precision) in their volatility beliefs and were less willing to change their beliefs about volatility over the course of the experiment. This led them to update their predictions about the fidelity of the adviser more quickly. Potentially indicative of stereotype effects, we observed that older advisers were perceived as more volatile, but also more faithful than younger advisers. This offers new insights into adult age differences in response to social uncertainty.
Collapse
|
9
|
Resource‐rational approach to meta‐control problems across the lifespan. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2021; 12:e1556. [DOI: 10.1002/wcs.1556] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 12/09/2020] [Accepted: 01/19/2021] [Indexed: 01/26/2023]
|
10
|
Abstract
Humans employ different strategies when making decisions. Previous research has reported reduced reliance on model-based strategies with aging, but it remains unclear whether this is due to cognitive or motivational factors. Moreover, it is not clear how aging affects the metacontrol of decision making, that is the dynamic adaptation of decision-making strategies to varying situational demands. In this cross-sectional study, we tested younger and older adults in a sequential decision-making task that dissociates model-free and model-based strategies. In contrast to previous research, model-based strategies led to higher payoffs. Moreover, we manipulated the costs and benefits of model-based strategies by varying reward magnitude and the stability of the task structure. Compared to younger adults, older adults showed reduced model-based decision making and less adaptation of decision-making strategies. Our findings suggest that aging affects the metacontrol of decision-making strategies and that reduced model-based strategies in older adults are due to limited cognitive abilities.
Collapse
|
11
|
Risk contagion by peers affects learning and decision-making in adolescents. J Exp Psychol Gen 2019; 148:1494-1504. [PMID: 30667261 DOI: 10.1037/xge0000512] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Adolescence is a period of life in which social influences-particularly if they come from peers-play a critical role in shaping learning and decision preferences. Recent studies in adults show evidence of a risk contagion effect; that is, individual risk preferences are modulated by observing and learning from others' risk-related decisions. In this study, using choice data and computational modeling, we demonstrate stronger risk contagion in male adolescents when observing peers compared to nonpeers. This effect was only present when the observed peer showed risk-seeking preferences. Moreover, adolescents represented the peers' decisions better than those of adults. Intriguingly, the degree of peer-biased risk contagion in adolescents was positively associated with real-life social integration. Contrary to previous accounts, our data suggest that peer conformity during risky decision-making in adolescence is a socially motivated, deliberative process. Susceptibility to peer influence in adolescence might be adaptive, associated with higher degrees of social functioning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
|
12
|
Computational neuroscience across the lifespan: Promises and pitfalls. Dev Cogn Neurosci 2018; 33:42-53. [PMID: 29066078 PMCID: PMC5916502 DOI: 10.1016/j.dcn.2017.09.008] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Revised: 08/19/2017] [Accepted: 09/29/2017] [Indexed: 11/26/2022] Open
Abstract
In recent years, the application of computational modeling in studies on age-related changes in decision making and learning has gained in popularity. One advantage of computational models is that they provide access to latent variables that cannot be directly observed from behavior. In combination with experimental manipulations, these latent variables can help to test hypotheses about age-related changes in behavioral and neurobiological measures at a level of specificity that is not achievable with descriptive analysis approaches alone. This level of specificity can in turn be beneficial to establish the identity of the corresponding behavioral and neurobiological mechanisms. In this paper, we will illustrate applications of computational methods using examples of lifespan research on risk taking, strategy selection and reinforcement learning. We will elaborate on problems that can occur when computational neuroscience methods are applied to data of different age groups. Finally, we will discuss potential targets for future applications and outline general shortcomings of computational neuroscience methods for research on human lifespan development.
Collapse
|
13
|
Repetitive transcranial magnetic stimulation over dorsolateral prefrontal cortex modulates value-based learning during sequential decision-making. Neuroimage 2017; 167:384-395. [PMID: 29191478 DOI: 10.1016/j.neuroimage.2017.11.057] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2017] [Revised: 11/04/2017] [Accepted: 11/24/2017] [Indexed: 11/26/2022] Open
Abstract
Adaptive behavior in daily life often requires the ability to acquire and represent sequential contingencies between actions and the associated outcomes. Although accumulating evidence implicates the role of dorsolateral prefrontal cortex (dlPFC) in complex value-based learning and decision-making, direct evidence for involvements of this region in integrating information across sequential decision states is still scarce. Using a 3-stage deterministic Markov decision task, here we applied offline, inhibitory low-frequency 1-Hz repetitive transcranial magnetic stimulation (rTMS) over the left dlPFC in young male adults (n = 31, mean age = 23.8 years, SD = 2.5 years) in a within-subject cross-over design to study the roles of this region in influencing value-based sequential decision-making. In two separate sessions, each participant received 1-Hz rTMS stimulation either over the left dlPFC or over the vertex. The results showed that transiently inhibiting the left dlPFC impaired choice accuracy, particularly in situations in which the acquisition of sequential transitions between decision states and temporally lagged action-outcome contingencies played a greater role. Estimating parameters of a diffusion model from behavioral choices, we found that the diffusion drift rate, which reflects the efficiency of information integration, was attenuated by the stimulation. Moreover, the effects of rTMS interacted with session: individuals who could not efficiently integrate information across sequential states in the first session due to disrupted dlPFC function also could not catch up in performance during the second session with those individuals who could learn sequential transitions with intact dlPFC function in the first session. Taken together, our findings suggest that the left dlPFC is crucially involved in the acquisition of complex sequential relations and in the potential of such learning.
Collapse
|
14
|
Developmental Changes in Learning: Computational Mechanisms and Social Influences. Front Psychol 2017; 8:2048. [PMID: 29250006 PMCID: PMC5715389 DOI: 10.3389/fpsyg.2017.02048] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2017] [Accepted: 11/09/2017] [Indexed: 11/13/2022] Open
Abstract
Our ability to learn from the outcomes of our actions and to adapt our decisions accordingly changes over the course of the human lifespan. In recent years, there has been an increasing interest in using computational models to understand developmental changes in learning and decision-making. Moreover, extensions of these models are currently applied to study socio-emotional influences on learning in different age groups, a topic that is of great relevance for applications in education and health psychology. In this article, we aim to provide an introduction to basic ideas underlying computational models of reinforcement learning and focus on parameters and model variants that might be of interest to developmental scientists. We then highlight recent attempts to use reinforcement learning models to study the influence of social information on learning across development. The aim of this review is to illustrate how computational models can be applied in developmental science, what they can add to our understanding of developmental mechanisms and how they can be used to bridge the gap between psychological and neurobiological theories of development.
Collapse
|
15
|
Age Differences in the Neural Mechanisms of Intertemporal Choice Under Subjective Decision Conflict. Cereb Cortex 2017; 28:3764-3774. [DOI: 10.1093/cercor/bhx239] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2016] [Accepted: 08/31/2017] [Indexed: 11/14/2022] Open
|
16
|
Age differences in learning emerge from an insufficient representation of uncertainty in older adults. Nat Commun 2016; 7:11609. [PMID: 27282467 PMCID: PMC4906358 DOI: 10.1038/ncomms11609] [Citation(s) in RCA: 56] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2015] [Accepted: 04/12/2016] [Indexed: 11/16/2022] Open
Abstract
Healthy aging can lead to impairments in learning that affect many laboratory and real-life tasks. These tasks often involve the acquisition of dynamic contingencies, which requires adjusting the rate of learning to environmental statistics. For example, learning rate should increase when expectations are uncertain (uncertainty), outcomes are surprising (surprise) or contingencies are more likely to change (hazard rate). In this study, we combine computational modelling with an age-comparative behavioural study to test whether age-related learning deficits emerge from a failure to optimize learning according to the three factors mentioned above. Our results suggest that learning deficits observed in healthy older adults are driven by a diminished capacity to represent and use uncertainty to guide learning. These findings provide insight into age-related cognitive changes and demonstrate how learning deficits can emerge from a failure to accurately assess how much should be learned. The ability to learn decreases with old age especially in a dynamically changing environment, however the precise nature of this decline is not understood. Nassar and colleagues report that older adults show a reduced ability to learn from uncertain outcomes compared to younger adults.
Collapse
|
17
|
|
18
|
Electrophysiological correlates of observational learning in children. Dev Sci 2015; 19:699-709. [PMID: 26074422 DOI: 10.1111/desc.12317] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2014] [Accepted: 03/27/2015] [Indexed: 11/28/2022]
Abstract
Observational learning is an important mechanism for cognitive and social development. However, the neurophysiological mechanisms underlying observational learning in children are not well understood. In this study, we used a probabilistic reward-based observational learning paradigm to compare behavioral and electrophysiological markers of individual and observational reinforcement learning in 8- to 10-year-old children. Specifically, we manipulated the amount of observable information as well as children's similarity in age to the observed person (same-aged child vs. adult) to examine the effects of similarity in age on the integration of observed information in children. We show that the feedback-related negativity (FRN) during individual reinforcement learning reflects the valence of outcomes of own actions. Furthermore, we found that the feedback-related negativity during observational reinforcement learning (oFRN) showed a similar distinction between outcome valences of observed actions. This suggests that the oFRN can serve as a measure of observational learning in middle childhood. Moreover, during observational learning children profited from the additional social information and imitated the choices of their own peers more than those of adults, indicating that children have a tendency to conform more with similar others (e.g. their own peers) compared to dissimilar others (adults). Taken together, our results show that children can benefit from integrating observable information and that oFRN may serve as a measure of observational learning in children.
Collapse
|
19
|
Age-related prefrontal impairments implicate deficient prediction of future reward in older adults. Neurobiol Aging 2015; 36:2380-90. [PMID: 26004018 DOI: 10.1016/j.neurobiolaging.2015.04.010] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2014] [Revised: 04/16/2015] [Accepted: 04/17/2015] [Indexed: 11/29/2022]
Abstract
Foresighted decision-making depends on the ability to learn the value of future outcomes and the sequential choices necessary to achieve them. Using a 3-stage Markov decision task and functional magnetic resonance imaging, we investigated age differences in the ability to extract state transition structures while learning to predict future reward. In younger adults learning was associated with enhanced activity in the prefrontal cortex (PFC). In older adults (OA) we found no evidence for PFC recruitment. However, high-performing OA showed enhanced striatal activity, suggesting that they may engage in a model-free (experience-based) learning strategy. Change point analyses revealed that in younger adults learning was characterized by distinct and abrupt shifts in PFC activity, which were predictive of behavioral change points. In OA PFC activity was less pronounced and not predictive of behavior. Our findings suggest that age-related impairments in learning future reward value can be attributed to a deficit in extracting sequential state transition structures. This deficit may lead to myopic decisions in OA if contextual information has to be temporally integrated.
Collapse
|
20
|
Of goals and habits: age-related and individual differences in goal-directed decision-making. Front Neurosci 2013; 7:253. [PMID: 24399925 PMCID: PMC3871973 DOI: 10.3389/fnins.2013.00253] [Citation(s) in RCA: 75] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2013] [Accepted: 12/06/2013] [Indexed: 11/13/2022] Open
Abstract
In this study we investigated age-related and individual differences in habitual (model-free) and goal-directed (model-based) decision-making. Specifically, we were interested in three questions. First, does age affect the balance between model-based and model-free decision mechanisms? Second, are these age-related changes due to age differences in working memory (WM) capacity? Third, can model-based behavior be affected by manipulating the distinctiveness of the reward value of choice options? To answer these questions we used a two-stage Markov decision task in in combination with computational modeling to dissociate model-based and model-free decision mechanisms. To affect model-based behavior in this task we manipulated the distinctiveness of reward probabilities of choice options. The results show age-related deficits in model-based decision-making, which are particularly pronounced if unexpected reward indicates the need for a shift in decision strategy. In this situation younger adults explore the task structure, whereas older adults show perseverative behavior. Consistent with previous findings, these results indicate that older adults have deficits in the representation and updating of expected reward value. We also observed substantial individual differences in model-based behavior. In younger adults high WM capacity is associated with greater model-based behavior and this effect is further elevated when reward probabilities are more distinct. However, in older adults we found no effect of WM capacity. Moreover, age differences in model-based behavior remained statistically significant, even after controlling for WM capacity. Thus, factors other than decline in WM, such as deficits in the in the integration of expected reward value into strategic decisions may contribute to the observed impairments in model-based behavior in older adults.
Collapse
|
21
|
Reduced sensitivity to immediate reward during decision-making in older than younger adults. PLoS One 2012; 7:e36953. [PMID: 22655032 PMCID: PMC3359996 DOI: 10.1371/journal.pone.0036953] [Citation(s) in RCA: 91] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2011] [Accepted: 04/17/2012] [Indexed: 11/18/2022] Open
Abstract
We examined whether older adults differ from younger adults in the degree to which they favor immediate over delayed rewards during decision-making. To examine the neural correlates of age-related differences in delay discounting we acquired functional MR images while participants made decisions between smaller but sooner and larger but later monetary rewards. The behavioral results show age-related reductions in delay discounting. Less impulsive decision-making in older adults was associated with lower ventral striatal activations to immediate reward. Furthermore, older adults showed an overall higher percentage of delayed choices and reduced activity in the dorsal striatum than younger adults. This points to a reduced reward sensitivity of the dorsal striatum in older adults. Taken together, our findings indicate that less impulsive decision-making in older adults is due to a reduced sensitivity of striatal areas to reward. These age-related changes in reward sensitivity may result from transformations in dopaminergic neuromodulation with age.
Collapse
|
22
|
Dopaminergic and prefrontal contributions to reward-based learning and outcome monitoring during child development and aging. Dev Psychol 2012; 48:862-74. [PMID: 22390655 DOI: 10.1037/a0027342] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In many instances, children and older adults show similar difficulties in reward-based learning and outcome monitoring. These impairments are most pronounced in situations in which reward is uncertain (e.g., probabilistic reward schedules) and if outcome information is ambiguous (e.g., the relative value of outcomes has to be learned). Furthermore, whereas children show a greater sensitivity to external outcome information, older adults focus less on a rapid differentiation of rewarding outcomes. In this article, we review evidence for the idea that these phenomenologically similar impairments in learning and outcome monitoring in children and older adults can be attributed to deficits in different underlying neurophysiological mechanisms. We propose that in older adults learning impairments are the result of reduced dopaminergic projections to the ventromedial prefrontal cortex, which lead to less differentiated representations of reward value. In contrast, in children, impairments in learning can be primarily attributed to deficits in executive control, which may be due to a protracted development of the dorsal medial and lateral prefrontal cortices. We think that this framework maps well onto recent neurophysiological models of reward processing and is plausible from a broader developmental perspective.
Collapse
|
23
|
Abstract
In this paper, we review the current literature to highlight relations between age-associated declines in dopaminergic and serotonergic neuromodulation and adult age differences in adaptive goal-directed behavior. Specifically, we focus on evidence suggesting that deficits in neuromodulation contribute to older adults' behavioral disadvantages in learning and decision making. These deficits are particularly pronounced when reward information is uncertain or the task context requires flexible adaptations to changing stimulus-reward contingencies. Moreover, emerging evidence points to age-related differences in the sensitivity to rewarding and aversive outcomes during learning and decision making if the acquisition of behavior critically depends on outcome processing. These age-related asymmetries in outcome valuation may be explained by age differences in the interplay of dopaminergic and serotonergic neuromodulation. This hypothesis is based on recent neurocomputational and psychopharmacological approaches, which suggest that dopamine and serotonin serve opponent roles in regulating the balance between approach behavior and inhibitory control. Studying adaptive regulation of behavior across the adult life span may shed new light on how the aging brain changes functionally in response to its diminishing resources.
Collapse
|
24
|
Younger but Not Older Adults Benefit from Salient Feedback during Learning. Front Psychol 2011; 2:171. [PMID: 21886630 PMCID: PMC3154404 DOI: 10.3389/fpsyg.2011.00171] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2011] [Accepted: 07/11/2011] [Indexed: 11/30/2022] Open
Abstract
Older adults are impaired in reinforcement learning (RL) when feedback is partially ambiguous (e.g., Eppinger and Kray, 2011). In this study we examined whether older adults benefit from salient feedback information during learning. We used an electrophysiological approach and investigated 15 younger and 15 older adults with a RL task in which they had to learn stimulus–response associations under two learning conditions. In the positive learning conditions, participants could gain 50 Cents for a correct response but did not gain or lose money (*00 Cent) for an incorrect response. In negative learning conditions, they could lose 50 Cents for an incorrect response but did not gain or lose money (*00 Cent) for a correct response. As the identical outcome “00 Cent” is either better or worse than the alternative outcome depending on the learning condition, this feedback type is ambiguous. To examine the influence of feedback salience we compared this condition with a condition in which positive and negative outcomes were color-coded and thereby clearly separable. The behavioral results indicated that younger adults reached higher accuracy levels under salient feedback conditions. Moreover, the error-related negativity and the feedback-related negativity for losses were larger if the good–bad dimension of feedback was salient. Hence, in younger adults salient feedback facilitates the rapid evaluation of outcomes on a good–bad dimension and by this supports learning. In contrast, for older adults we obtained neither behavioral nor electrophysiological effects of feedback salience. The older adults’ performance monitoring system therefore appears less flexible in integrating additional information in this evaluation process.
Collapse
|
25
|
To choose or to avoid: age differences in learning from positive and negative feedback. J Cogn Neurosci 2011; 23:41-52. [PMID: 19925176 DOI: 10.1162/jocn.2009.21364] [Citation(s) in RCA: 54] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
In this study, we investigated whether older adults learn more from bad than good choices than younger adults and whether this is reflected in the error-related negativity (ERN). We applied a feedback-based learning task with two learning conditions. In the positive learning condition, participants could learn to choose responses that lead to monetary gains, whereas in the negative learning condition, they could learn to avoid responses that lead to monetary losses. To test the stability of learning preferences, the task involved a reversal phase in which stimulus-response assignments were inverted. Negative learners were defined as individuals that performed better in the negative than in the positive learning condition (and vice versa for positive learners). The behavioral data showed strong individual differences in learning from positive and negative outcomes that persisted throughout the reversal phase and were more pronounced for older than younger adults. Older negative learners showed a stronger tendency to avoid negative outcomes than younger negative learners. However, contrary to younger adults, this negative learning bias was not associated with a larger ERN, suggesting that avoidance learning in older negative learners might be decoupled from error processing. Furthermore, older adults showed learning impairments compared to younger adults. The ERP analyses suggest that these impairments reflect deficits in the ability to build up relational representations of ambiguous outcomes.
Collapse
|
26
|
Abstract
This study examined developmental differences in the ERP correlates of internal and external error processing (ERN and FRN) during learning. A probabilistic learning task was applied in which feedback validity was manipulated. The behavioral data showed similar accuracy for children and adults when feedback was valid, whereas age differences were obtained when it was partially invalid. We found no reduction of the ERN for children compared to adults when performance levels were equated. Yet, contrary to adults, children did not differentiate between responses when feedback was partially invalid, indicating that they are less able to represent the correctness of a response when there is interference during learning. Moreover, we found a larger FRN and reduced ERP learning effects for positive feedback for children, suggesting that they are more sensitive to external error feedback and less able to disengage from positive feedback during learning.
Collapse
|
27
|
Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia 2008; 46:521-39. [PMID: 17936313 DOI: 10.1016/j.neuropsychologia.2007.09.001] [Citation(s) in RCA: 179] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2007] [Revised: 08/23/2007] [Accepted: 09/04/2007] [Indexed: 10/22/2022]
|
28
|
Age differences in task switching and response monitoring: evidence from ERPs. Biol Psychol 2007; 75:52-67. [PMID: 17250949 DOI: 10.1016/j.biopsycho.2006.12.001] [Citation(s) in RCA: 76] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2005] [Revised: 09/29/2006] [Accepted: 12/07/2006] [Indexed: 10/23/2022]
Abstract
This study investigates age differences in the flexible adaptation to changing demands on task switching and conflict processing. We applied a cued task-switching version of the Stroop task and manipulated the ratio of conflict trials. During task preparation, the P300 varied as a function of conflict ratio and a later positive component was larger for switch than non-switch trials. Stimulus-related conflict processing as indicated by a negativity for incompatible trials (Ni) was delayed for older adults. Moreover, the Ni varied as a function of conflict ratio and was larger for switch than for non-switch trials. Age differences were also obtained in the correct response negativity (CRN). CRN was larger on incompatible trials and this CRN-compatibility effect was enhanced when incompatible trials were infrequent in younger, but not in older adults. Our findings suggest impairments of older adults primarily in response-related conflict processing and in the flexible adaptation to changing task contexts.
Collapse
|
29
|
Effects of associative learning on age differences in task-set switching. Acta Psychol (Amst) 2006; 123:187-203. [PMID: 16564483 DOI: 10.1016/j.actpsy.2005.12.009] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2005] [Revised: 12/09/2005] [Accepted: 12/22/2005] [Indexed: 11/25/2022] Open
Abstract
Costs of switching between tasks may disappear when subjects are able to learn associations between tasks, stimuli, and responses (cf. Rogers, R. D., & Monsell, S. (1995). Costs of a predictable switch between simple cognitive tasks. Journal of Experimental Psychology: General, 124, 207-231). The first aim of this study was to examine this possibility by manipulating stimulus-set size. We expected that costs of switching between tasks would be strongly reduced under conditions of small stimulus-set sizes (n=4) as compared to large stimulus-set sizes (n=96) with increasing time on task. The second aim was to determine whether younger as well as older adults were able to create associations between task components. As age differences in task switching are often found to be larger when response mappings are incompatible we also investigated interactions with response compatibility. Results of our study indicated that practice effects on switch costs were much more pronounced for small than large stimulus-set sizes, consistent with the view that the strength of associations between task components facilitates task switching. Furthermore, we found that practice benefits on task switching for small stimulus-set sizes were sensitive to age and response compatibility. In contrast to younger adults, who showed a reduction of switch costs for both response mapping conditions, older adults showed a reduction of switch costs only when response mappings were compatible. That is, older adults showed less associative learning when the currently irrelevant task feature had to be suppressed, supporting the view that older adults have primarily problems in separating overlapping task-set representations.
Collapse
|
30
|
Abstract
We examined age differences in event-related potentials (ERPs) associated with attentional control of task-set selection and response interference by means of a cue-based switching paradigm in which participants performed the color or word Stroop task. The results of ERPs in the cue interval indicated that P3 latencies were slowed for older adults, suggesting age-related slowing in updating currently relevant task sets. Older adults also showed a larger CNV under switching than nonswitching conditions, indicating age differences in maintaining task sets over longer periods of time. The results of target-locked ERPs revealed a negativity to incompatible Stroop trials (Ni) that was prolonged for older adults, suggesting age differences in early conflict processing. Response-locked ERPs showed a negative deflection to incompatible Stroop trials (CRN) only for younger adults, suggesting age differences also in response-related conflict processing.
Collapse
|
31
|
Screening for drugs in serum by electrospray ionization/collision-induced dissociation and library searching. JOURNAL OF THE AMERICAN SOCIETY FOR MASS SPECTROMETRY 1999; 10:1028-1037. [PMID: 10497811 DOI: 10.1016/s1044-0305(99)00070-7] [Citation(s) in RCA: 47] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Factors influencing in-source collision-induced dissociation (ESI/CID) of organic molecules in a Perkin-Elmer/SCIEX ionspray source have been investigated. Breakdown curves of four drugs and organic compounds were acquired by monitoring the intensities of MH+ and specific fragment ions while ramping the orifice voltage. Haloperidol, diazepam, 1,4-acetamido-acetoxybenzene and diacetamido-1,2-benzene were found to be substances with characteristic breakdown curves, with maximums and points of intersection at orifice voltages between 20 and 70 V. The breakdown curves of haloperidol were used for comparison of ESI/CID with ionspray and turboionspray sources on three PE/SCIEX-API instruments. Using standardized source parameters and mass resolution, very similar fragmentation graphs were obtained for haloperidol with all instruments. Infusion of varying concentrations of haloperidol (0.1 to 10 micrograms/mL with ionspray, and 0.01 to 1 microgram/mL with turboionspray) yielded comparable breakdown curves. With turboionspray, a preconcentration of the aerosol occurred, yielding higher ion abundances. Solvent pH and the ratio of aqueous ammonium formate/acetonitrile had minor effects on the degree of fragmentation of haloperidol in a wide range. With these preconditions, a currently expanding mass spectral library of 400 drugs was set up by liquid chromatography/mass spectrometry with alternating orifice voltages (20, 50, and 80 V, respectively) in a looped experiment. An example of drug identification in a patient's serum with library search is shown.
Collapse
|
32
|
Effects of storing initiated 2-hydroxyethyl methacrylate solutions for embedding tissues for light microscopy: some practical implications. Biotech Histochem 1995; 70:155-63. [PMID: 7548437 DOI: 10.3109/10520299509108332] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023] Open
Abstract
The effects of storing 2-hydroxyethyl methacrylate (HEMA) solutions for embedding tissues for light microscopy were studied using three commercially available HEMA embedding kits: Technovit 7100, Technovit 8100, and JB-4. These HEMA solutions were examined at various times of storage over a period of one year using a panel of physicochemical techniques including gas chromatography, titration, viscosimetry, determination of the maximum polymerization temperature and the time required to reach the maximum temperature, and detection of degradation products of HEMA monomers by histochemical procedures. The quality of the resin blocks was examined by the observation of mini-folds in sections. Data obtained from these tests showed that the release of by-products as a result of the degradation of the HEMA monomer during storage of HEMA solutions does not occur. Development of cross-linking agents by transesterification of HEMA monomer was not detected either. Gradual decrease of the inhibitor concentration during storage proved to be the main cause of the reduction of shelf-life of HEMA solutions. Inconsistent tissue infiltration after storage may be due to decreased rates of tissue penetration as a result of HEMA chain lengthening. Guidelines for safe and economical handling of HEMA mixtures are given.
Collapse
|
33
|
[Spontaneous regression of significant stenoses and occlusions of the internal carotid artery]. DER NERVENARZT 1992; 63:363-70. [PMID: 1635619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
19 patients with severe stenoses or occlusions of the internal carotid artery showed spontaneous recanalization at follow-up. The cause of the stenotic process was spontaneous or traumatic dissection, fibromuscular dysplasia, ergotism or arteriosclerotic disease. Total recanalization occurred in carotid artery dissections coinciding with the best clinical outcome. In fibromuscular dysplasia and arteriosclerotic process, recanalization was seldom found, incomplete, and the clinical course was less favourable.
Collapse
|
34
|
[Computerized tomography findings and the clinical course in infratentorial trauma]. AKTUELLE TRAUMATOLOGIE 1988; 18:235-9. [PMID: 2907250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Clinical examination of severe brain injuries often suggests involvement of the brain stem and pontine structures not only via functional but also via structural lesions. Computer tomographic evidence of infratentorial trauma, however appears comparably rarely. 32 of 436 brain injured patients examined by CT showed traumatic infratentorial lesions. We examined these patients with regard to the distribution of structural damage, place of primary impact of force, incidence of skull fractures and accompanying supratentorial injuries, initial clinical status and clinical outcome. All but 2 patients were primarily unconscious. The lethal outcome in 7 patients was presumably due to the traumatic involvement of supratentorial structures. Patients with mainly infratentorial lesions--even with large epidural haematoma--showed a good recovery and fair rehabilitative outcome if the operation was performed immediately.
Collapse
|
35
|
[Calcinosis of the carotid siphon--morphology, differential diagnosis and clinical relevance]. RONTGEN-BLATTER; ZEITSCHRIFT FUR RONTGEN-TECHNIK UND MEDIZINISCH-WISSENSCHAFTLICHE PHOTOGRAPHIE 1986; 39:333-8. [PMID: 2949360] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
In order to determine the clinical significance and hemodynamic relevance of carotid siphon calcification 241 patients were investigated by doppler sonography and skull x-ray. Comparing 139 patients with and 60 patients without siphon calcification, we examined the predictive value of carotid calcification regarding obstructive vessel disease as indicated by doppler sonography. Both groups were compared with 42 patients who all had doppler sonographic signs of severe carotid stenosis. No significant difference was found regarding the incidence of stenosis between the groups with and without siphon calcification (13% vs. 15%). Interpreting siphon calcification as a general sign of atherosclerosis seems therefore not justified. An over proportionally high rate (61.9%) of siphon calcification can only be expected by selected patients with severe obstructive vessels disease. Etiological factors are discussed and differential diagnosis of siphon calcification is demonstrated by cases.
Collapse
|