A common mechanism underlying choice's influence on preference and memory

A cross-cultural comparison of intrinsic and extrinsic motivational drives for learning

Intrinsic motivational drives, like the autonomous feeling of control, and extrinsic motivational drives, like monetary reward, can benefit learning. Extensive research has focused on neurobiological and psychological factors that affect these drives, but our understanding of the sociocultural factors is limited. Here, we compared the effects of autonomy and rewards on episodic recognition memory between students from Dutch and Chinese universities. In an exploratory learning task, participants viewed partially obscured objects that they needed to subsequently remember. We independently manipulated autonomy, as volitional control over an exploration trajectory, as well as the chance to receive monetary rewards. The learning task was followed by memory tests for objects and locations. For both cultural groups, we found that participants learned better in autonomous than non-autonomous conditions. However, the beneficial effect of reward on memory performance was stronger for Chinese than for Dutch participants. By incorporating the sociocultural brain perspective, we discuss how differences in norms and values between Eastern and Western cultures can be integrated with the neurocognitive framework about dorsal lateral and ventral medial prefrontal cortex and dopaminergic reward modulations on learning and memory. These findings have important implications for understanding the neurocognitive mechanisms in which both autonomy and extrinsic rewards are commonly used to motivate students in the realm of education and urge more attention to investigate cultural differences in learning.

Self-Choice Emotion Regulation Enhances Stress Reduction: Neural Basis of Self-Choice Emotion Regulation

BACKGROUND/OBJECTIVES

Opting to perform emotion regulation when facing high-arousal stimuli enhances the reduction in negative emotions. Previous research has indicated that self-choice, that is, personally choosing from multiple alternatives, can improve performance. However, it is unclear whether the emotion regulation strategy chosen among multiple alternatives in daily life enhances stress reduction compared to a forced strategy. This study aimed to reveal the effects of self-choice emotion regulation and its underlying neural basis.

METHODS

Participants were 40 healthy adults who met the inclusion criteria; they performed self-choice emotion regulation, forced emotion regulation, and no emotion regulation (the control condition) while their brain activity was captured using a functional magnetic resonance imaging scanner. First, the participants were shown a stressful scenario. Secondly, they rated the stress they experienced. Thirdly, they performed self-choice or forced emotion regulation or did nothing. Finally, participants rated their stress level again.

RESULTS

Self-choice emotion regulation reduced stress better than forced-choice emotion regulation. The stress reduction was associated with decreases in the activation of the left opercular part of the inferior frontal gyrus.

CONCLUSIONS

Self-choice can improve emotion regulation, and this effect is likely mediated by the neural efficiency of the left inferior frontal gyrus.

The effect of choice on memory across development

Numerous studies have demonstrated the role of making choices as an internal motivator to improve performance, and recent studies in the domain of memory have focused on adults. To chart the developmental trend of the choice effect on memory, we conducted a series of seven experiments involving children, adolescents, and young adults. Participants (N = 512) aged 5 to 26 years performed a choice encoding task that manipulated the opportunities to choose and then took a memory test. Using different types of experimental materials and corroborated by a mini meta-analysis, we found that the choice effect on memory was significant in childhood and early adolescence but not significant in late adolescence and early adulthood. The developmental changes were statistically significant, particularly evident during the transition from early to late adolescence. These findings suggest that the internal value of choice decreases across development and contributes to our understanding of developmental differences in the role of choice in memory.

Autobiographical phenomenology of memories of fiction

Most autobiographical memories are based on real-life experiences, but memories of fiction have many similarities to real-life autobiographical memories. However, the phenomenological nature of this similarity, the potential differences between media types, and the role of individual differences need further investigation. Based on previous findings, we expected differences between media types on emotional intensity, sensory vividness, and confidence about the recall. To provide insight into these issues, we collected one real-life autobiographical memory and one memory of fiction (book, film, or video game) from 291 participants. We asked them to rate their memories phenomenologically. The participants also provided information regarding their motivations for engaging with fictional stories. Our results show phenomenological differences in several dimensions between media types and differences in the similarity of media types to real-life memories. While absorption seems to be a good predictor for immersion, escapism tendency is a motivation to engage with fiction frequently.

Distinguishing between intrinsic and instrumental sources of the value of choice

Considerable evidence suggests that people value the freedom to choose. However, it is unclear whether this preference for choice stems purely from choice's intrinsic value, or whether people prefer to choose because it tends to provide instrumental information about desirable outcomes. To address this question, participants completed a novel choice task in which they could freely choose to exert choice or not, manipulating the level of instrumental contingency between participants' choices and eventual outcomes, which we operationalized using the information-theoretic concept of mutual information. Across two experiments (N = 100 each), we demonstrate a marked preference for choice, but importantly found that participants' preference for free choice is weakened when actions are decoupled from outcomes. Taken together, our results demonstrate that a significant factor in people's preference for choice is an assumption about the instrumental value of choice, suggesting against a purely intrinsic value of choice.

Drinking the waters of Lethe: Bringing voluntary choice into the study of voluntary forgetting

The directed forgetting paradigm has long been used to test whether humans can voluntarily choose to forget learned information. However, to date, nearly all directed forgetting paradigms have involved a forced-choice paradigm, in which the participants are instructed about which learned information they should forget. While studies have repeatedly shown that this directed forgetting does lead to a decreased ability to later remember the information, it is still unclear whether these effects would be present if participants were allowed to, of their own accord, choose which information they wanted to forget. In two experiments here, we introduce a free-choice variety of the item method directed forgetting paradigm and show that directed forgetting effects are robust, both for instructed and voluntary forgetting. We discuss the implications of our findings for notions of voluntary forgetting and for the self-choice effect in memory.

Option similarity modulates the link between choice and memory

Choices made in everyday life are highly variable. Sometimes, you may find yourself choosing between two similar options (e.g., breakfast foods to eat) and other times between two dissimilar options (e.g., what to buy with a gift certificate). The goal of the present study was to understand how the similarity of choice options affects our ability to remember what we choose and what we did not choose. We hypothesized that choosing between similar as compared to dissimilar options would evoke a comparison-based strategy (evaluating options with respect to one another), fostering a relational form of encoding and leading to better memory for both the chosen and unchosen options. In Experiment 1, participants reported their strategy when choosing between pairs of similar or dissimilar options, revealing that participants were more likely to use a comparison-based strategy when faced with similar options. In Experiment 2, we tested memory after participants made choices between similar or dissimilar options, finding improved memory for both chosen and unchosen options from the similar compared to dissimilar choice trials. In Experiment 3, we examined strategy use when choosing between pairs of similar or dissimilar options and memory for these options. Replicating and extending the results of the first two experiments, we found that participants were more likely to use a comparison-based strategy when choosing between similar than dissimilar options, and that the positive effect of similarity on memory was stronger for unchosen than chosen options when controlling for strategy use. We interpret our results as evidence that option similarity impacts the mnemonic processes used during choice, altering what we encode and ultimately remember about our choices.

Memory precision and age differentially predict the use of decision-making strategies across the lifespan

Memory function declines in normal aging, in a relatively continuous fashion following middle-age. The effect of aging on decision-making is less well-understood, with seemingly conflicting results on both the nature and direction of these age effects. One route for clarifying these mixed findings is to understand how age-related differences in memory affect decisions. Recent work has proposed memory sampling as a specific computational role for memory in decision-making, alongside well-studied mechanisms of reinforcement learning (RL). Here, we tested the hypothesis that age-related declines in episodic memory alter memory sampling. Participants (total N = 361; ages 18-77) performed one of two variants of a standard reward-guided decision experiment with additional trial-unique mnemonic content and a separately-administered task for assessing memory precision. When we fit participants' choices with a hybrid computational model implementing both memory-based and RL-driven valuation side-by-side, we found that memory precision tracked the contribution of memory sampling to choice. At the same time, age corresponded to decreasing influence of RL and increasing perseveration. A second experiment confirmed these results and further revealed that memory precision tracked the specificity of memories selected for sampling. Together, these findings suggest that differences in decision-making across the lifespan may be related to memory function, and that interventions which aim to improve the former may benefit from targeting the latter.

The interactive effect of external rewards and self-determined choice on memory

Both external motivational incentives (e.g., monetary reward) and internal motivational incentives (e.g., self-determined choice) have been found to promote memory, but much less is known about how these two types of incentives interact with each other to affect memory. The current study (N = 108) examined how performance-dependent monetary rewards affected the role of self-determined choice in memory performance, also known as the choice effect. Using a modified and better controlled version of the choice paradigm and manipulating levels of reward, we demonstrated an interactive effect between monetary reward and self-determined choice on 1-day delayed memory performance. Specifically, the choice effect on memory decreased when we introduced the performance-dependent external rewards. These results are discussed in terms of understanding how external and internal motivators interact to impact learning and memory.

The role of memory in counterfactual valuation

Value-based decisions are often guided by past experience. If a choice led to a good outcome, we are more likely to repeat it. This basic idea is well-captured by reinforcement-learning models. However, open questions remain about how we assign value to options we did not choose and which we therefore never had the chance to learn about directly. One solution to this problem is proposed by policy gradient reinforcement-learning models; these do not require direct learning of value, instead optimizing choices according to a behavioral policy. For example, a logistic policy predicts that if a chosen option was rewarded, the unchosen option would be deemed less desirable. Here, we test the relevance of these models to human behavior and explore the role of memory in this phenomenon. We hypothesize that a policy may emerge from an associative memory trace formed during deliberation between choice options. In a preregistered study (n = 315) we show that people tend to invert the value of unchosen options relative to the outcome of chosen options, a phenomenon we term inverse decision bias. The inverse decision bias is correlated with memory for the association between choice options; moreover, it is reduced when memory formation is experimentally interfered with. Finally, we present a new memory-based policy gradient model that predicts both the inverse decision bias and its dependence on memory. Our findings point to a significant role of associative memory in valuation of unchosen options and introduce a new perspective on the interaction between decision-making, memory, and counterfactual reasoning. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Better Controlled, Better Maintained: Sense of Agency Facilitates Working Memory

The cognitive effects of sense of agency (SoA) attract increasing attention. It is unclear how SoA influences working memory (WM). In the present study, participants first moved several boxes. One of the boxes was more or less controllable than the majority. After boxes stopped moving, to-be-remembered items appeared. Memory performance and SoA over them were subsequently tested. In Experiments 1a and 1b, the majority of boxes, serving as context, were under low and high control respectively. To further examine whether the maintenance stage was influenced, the effect of selective encoding was minimized in Experiments 2a and 2b. Experiment 2b further eliminated the impact of agency judgments and tested the relationship among SoA, WM, and preference. Memory was better for items with strong SoA in the high and low control contexts. The effect partly stems from the modulation of the maintenance stage in WM, in which reward-based processes could be engaged.

The effect of choice on intentional and incidental memory

Recent studies have revealed that memory performance is better when participants have the opportunity to make a choice regarding the experimental task (choice condition) than when they do not have such a choice (fixed condition). These studies, however, used intentional memory tasks, leaving open the question whether the choice effect also applies to incidental memory. In the current study, we first repeated the choice effect on the 24-h delayed intentional memory performance (experiment 1). Next, using an incidental paradigm in which participants were asked to judge the category of the items instead of intentionally memorizing them, we observed the choice effect on judgment during encoding and memory performance in a 24-h delayed surprise test (experiment 2). Participants judged more accurately and quickly and had better recognition memory for items in the choice condition than for items in the fixed condition. These results are discussed in terms of the role of choice in both intentional and incidental memory.

Mixing memory and desire: How memory reactivation supports deliberative decision-making

Memories affect nearly every aspect of our mental life. They allow us to both resolve uncertainty in the present and to construct plans for the future. Recently, renewed interest in the role memory plays in adaptive behavior has led to new theoretical advances and empirical observations. We review key findings, with particular emphasis on how the retrieval of many kinds of memories affects deliberative action selection. These results are interpreted in a sequential inference framework, in which reinstatements from memory serve as "samples" of potential action outcomes. The resulting model suggests a central role for the dynamics of memory reactivation in determining the influence of different kinds of memory in decisions. We propose that representation-specific dynamics can implement a bottom-up "product of experts" rule that integrates multiple sets of action-outcome predictions weighted based on their uncertainty. We close by reviewing related findings and identifying areas for further research. This article is categorized under: Psychology > Reasoning and Decision Making Neuroscience > Cognition Neuroscience > Computation.

Memory for individual items is related to nonreinforced preference change

It is commonly assumed that memories contribute to value-based decisions. Nevertheless, most theories of value-based decision-making do not account for memory influences on choice. Recently, new interest has emerged in the interactions between these two fundamental processes, mainly using reinforcement-based paradigms. Here, we aimed to study the role memory processes play in preference change following the nonreinforced cue-approach training (CAT) paradigm. In CAT, the mere association of cued items with a speeded motor response influences choices. Previous studies with this paradigm showed that a single training session induces a long-lasting effect of enhanced preferences for high-value trained stimuli, that is maintained for several months. We hypothesized that CAT increases memory of trained items, leading to enhanced accessibility of their positive associative memories and in turn to preference changes. In two preregistered experiments, we found evidence that memory is enhanced for trained items and that better memory is correlated with enhanced preferences at the individual item level, both immediately and 1 mo following CAT. Our findings suggest that memory plays a central role in value-based decision-making following CAT, even in the absence of external reinforcements. These findings contribute to new theories relating memory and value-based decision-making and set the groundwork for the implementation of novel nonreinforced behavioral interventions that lead to long-lasting behavioral change.

The choice levels modulate outcome processing during outcome independent of behavior selection: Evidence from event-related potentials

Having a choice is a basic demand to influence human behavior. However, how various choice levels modulate outcome processing when the outcome is independent of the choices remains unclear. In this event-related potential (ERP) study, thirty-seven participants were instructed to perform a one-person choice task in which they were required to choose one card from 1 (no-choice level), 2 (medium-choice level), and 8 cards (high-choice level) to win a reward, with a 50% chance. Behavioral results indicated that pleasure and perceived control rating scores were linearly promoted with increased choice levels. ERP results revealed that having choices (medium- and high-choice level) elicited greater original-RewP and PCA-RewP amplitudes than having no choice (no-choice level), suggesting the amplification of the reward prediction error by quickly detecting whether there is a choice or not. Moreover, ERP results revealed that the original-P300 amplitudes were linearly enhanced with increased choice levels, suggesting the increased attentional allocation based on the motivational and emotional significance, due to advanced processing of the value of choice levels. Therefore, these results suggest that choice levels can modulate outcome processing, even when the outcome is independent of the choices, and provide further evidence to support the intrinsic value of having choices.

Memory and decision making interact to shape the value of unchosen options

The goal of deliberation is to separate between options so that we can commit to one and leave the other behind. However, deliberation can, paradoxically, also form an association in memory between the chosen and unchosen options. Here, we consider this possibility and examine its consequences for how outcomes affect not only the value of the options we chose, but also, by association, the value of options we did not choose. In five experiments (total n = 612), including a preregistered experiment (n = 235), we found that the value assigned to unchosen options is inversely related to their chosen counterparts. Moreover, this inverse relationship was associated with participants' memory of the pairs they chose between. Our findings suggest that deciding between options does not end the competition between them. Deliberation binds choice options together in memory such that the learned value of one can affect the inferred value of the other.

Reward prediction errors drive declarative learning irrespective of agency

Recent years have witnessed a steady increase in the number of studies investigating the role of reward prediction errors (RPEs) in declarative learning. Specifically, in several experimental paradigms, RPEs drive declarative learning, with larger and more positive RPEs enhancing declarative learning. However, it is unknown whether this RPE must derive from the participant's own response, or whether instead, any RPE is sufficient to obtain the learning effect. To test this, we generated RPEs in the same experimental paradigm where we combined an agency and a nonagency condition. We observed no interaction between RPE and agency, suggesting that any RPE (irrespective of its source) can drive declarative learning. This result holds implications for declarative learning theory.

Attempted recall of biographical information influences face attractiveness

We examined affective consequences arising from the kinds of memory retrieval failures that often accompany social interaction. To do so, we measured the influence of cued-recall outcomes for biographical information on the rated attractiveness of faces. The data demonstrate that retrieval of names (Experiment 1a) and professions (Experiment 1b) increases the rated attractiveness of target faces relative to faces that failed to produce recall of associative information. This was predicted by a confirmation of search (COS) model originally developed on verbal memoranda, which assumes that confirmation bias during memory search leads to affective consequences depending upon retrieval's success or failure. The current study extends this model, showing that evaluative judgments of individuals are in part contingent upon the memory retrieval skills of their assessors. We conclude by discussing potential extensions of the COS paradigm to the measurement of implicit attitudes and special populations.

Effective brain connectivity at rest is associated with choice-induced preference formation

Preferences can change as a consequence of making hard decisions whereby the value of chosen options increases and the value of rejected options decreases. Such choice-induced preference changes have been associated with brain areas detecting choice conflict (anterior cingulate cortex, ACC), updating stimulus value (dorsolateral prefrontal cortex, dlPFC) and supporting memory of stimulus value (hippocampus and ventromedial prefrontal cortex, vmPFC). Here we investigated whether resting-state neuronal activity within these regions is associated with the magnitude of individuals' preference updates. We fitted a dynamic causal model (DCM) to resting-state neuronal activity in the spectral domain (spDCM) and estimated the causal connectivity among core regions involved in preference formation following hard choices. The extent of individuals' choice-induced preference changes were found to be associated with a diminished resting-state excitation between the left dlPFC and the vmPFC, whereas preference consistency was related to a higher resting-state excitation from the ACC to the left hippocampus and vmPFC. Our results point to a model of preference formation during which the dynamic network configurations between left dlPFC, ACC, vmPFC and left hippocampus at rest are linked to preference change or stability.