Memory and Reward-Based Learning: A Value-Directed Remembering Perspective

Less Than Zero?

Not all information encountered is equally important to remember. Some information may be valuable, while others may be irrelevant. Importantly, retrieving and acting upon some information may even have negative consequences. Research has shown that information associated with negative consequences when retrieved is remembered worse than information associated with positive consequences when retrieved. The current experiments address a hitherto understudied aspect of memory for values, namely about how neutral and negative valued information is remembered and which processes underly the encoding and retrieval of this information. Across four experiments, we presented participants with words and an associated positive, neutral, or negative point value. Participants thought the associated values would be added to their total score, thus incentivizing the recall of positive value words and forgetting of negative value words. However, at retrieval participants were told to ignore previously associated values and to try to retrieve as many words from the study phase as possible. Replicating previous research, we found superior retrieval for words associated with positive compared to negative values. More importantly for the current investigation, across four experiments, we found no evidence that words associated with negative values were remembered worse than words associated with a neutral value.

Differences between children and young adults in the effects of difficulty and value of learning items on cognitive offloading strategies

Cognitive offloading refers to the use of external tools to assist in memory processes.This study investigates the effects of item difficulty and value on cognitive offloading during a word-pair learning task, comparing children and young adults in a context where both cues coexist. In Experiment 1, we examined the impact of difficulty and value cues on cognitive offloading using a 2 (difficulty: easy vs. difficult) × 2 (value: high vs. low) × 2 (age group: children vs. young adults) mixed design.The results indicated that young adults accounted for both difficulty and value cues in their cognitive offloading strategies, in contrast to children, who relied only on difficulty cues. In Experiment 2, we retained the experimental design of Experiment 1, with one notable change: difficulty and value cues were simultaneously displayed on the same interface. This change aimed to reduce working memory load, thereby helping children better perceive the value cues. Our results showed that when value and difficulty cues were presented on the same interface, children took both cues into account in their cognitive offloading decisions. In contrast, young adults were more influenced by the value of the learning items when adopting cognitive offloading strategies. We conducted an exploratory analysis to examine the impact of serial position on offloading decisions. The results showed that children were more likely to use cognitive offloading strategies for items from the early and middle positions than for those from the later positions. In contrast, young adults (as observed in Experiment 2) tended to use cognitive offloading strategies for items from the middle positions. Our findings suggest that age affects the utilization of cues in the strategies of cognitive offloading. We interpreted the observed differences in cognitive offloading strategies through the lens of developmental changes in metacognitive abilities.

Monitoring-Based Rewards Enhance Both Learning Performance and Metacognitive Monitoring Accuracy

Utilization of monetary rewards in educational settings remains contentious due to its potential adverse effects such as performance-related anxiety, metacognitive inaccuracy, and diminished intrinsic motivation. The current study developed a novel reward-based learning paradigm wherein rewards are granted based on monitoring accuracy rather than learning performance. Specifically, learners receive rewards for items that they predict they will remember and subsequently successfully remember them during the final test. Two experiments were conducted to assess the efficacy of this paradigm: Experiment 1 focused on learning Chinese medicine images, while Experiment 2 examined the transfer of math knowledge in classroom settings. The results indicated that rewarding the alignment between performance and metacognitive accuracy improved learning performance compared to both a baseline group and a group receiving performance-based rewards. Furthermore, this paradigm effectively mitigated performance-related anxiety and preserved intrinsic motivation. Overall, our findings highlight the critical role of reward-based learning design and emphasize the importance of addressing metacognitive accuracy alongside performance in educational practice.

Serial and strategic memory processes in younger and older adults

We investigated age-related differences in serial and strategic processing during the encoding and retrieval of high-value words. Younger and older adults were presented with word triads positioned left, center, and right, with one word being more valuable than the others. In Experiment 1, younger adults more effectively recalled the middle, high-value word, demonstrating enhanced strategic memory. Younger adults were more likely to initiate recall with a high-value word whereas older adults were equally likely to initiate recall with a left and high-value word. Additionally, older adults were more likely to recall words in their presented order while younger adults strategically recalled successive high-value words. However, both age groups demonstrated strategic processing in Experiments 2 and 3, even without prior knowledge of the high-value word's location. Thus, serial and strategic processing may differ based on age and task demands, but strategic processing is preserved in older adults in certain contexts.

Responsible remembering: The role of metacognition, forgetting, attention, and retrieval in adaptive memory

In our everyday lives, we must remember important information, especially if there are consequences for forgetting. In this review, I discuss recent work on responsible remembering: the strategic and effortful prioritization of important information with consequences for forgetting. Thus far, research regarding responsible remembering has revealed several key factors and mechanisms that work together to enhance memory for important information that will continue to be refined: the identification and selection of what to remember (metacognitive reflectivity), the forgetting of less important information to facilitate memory for items that do need to be remembered (responsible forgetting), the functional prioritization of attention at the expense of competing factors (responsible attention), and the selective recall of important information via efficient retrieval strategies (responsible retrieval). Together, these functions form a cohesive system that aims to selectively prioritize, encode, and recall information that is deemed important based on its anticipated utility or the consequences of forgetting, and considering the importance of information may be a critical memory adaptation as we age. Specifically, if younger and older adults learn to self-assess and prioritize important information that has negative consequences if forgotten, engage in strategic forgetting, efficiently allocate their attentional resources, and utilize effective retrieval operations, memory for said important information can be enhanced.

Getting value out of working memory through strategic prioritisation: Implications for storage and control

Working memory is an active system responsible for the temporary maintenance and processing of information in the support of cognition and action. In keeping with this, a growing body of research has explored the close links between working memory and attention, and how these might be harnessed to impact performance and possibly improve working memory efficiency. This is theoretically and practically important, given that working memory is a central hub in complex cognition yet is extremely capacity- and resource-limited. We review work carried out over the last 10 years or so looking at how high "value" items in working memory can be strategically prioritised through selective attention, drawing principally from visual working memory paradigms with young adult participants, while also discussing how the core effects extend to different task domains and populations. A consistent set of core findings emerges, with improved memory for items that are allocated higher value but no change in overall task performance, and a recency advantage regardless of point allocation when items are encountered sequentially. Value-directed prioritisation is effortful, under top-down strategic control, and appears to vary with perceptual distraction and executive load. It is driven by processes operating during encoding, maintenance, and retrieval, though the extent to which these are influenced by different features of the task context remains to be mapped out. We discuss implications for working memory, attention, and strategic control, and note some possible future directions of travel for this promising line of research.

The modulation of cholecystokinin receptor 1 in the NAc core input from VTA on METH-induced CPP acquisition

BACKGROUND

Methamphetamine (METH) is a potent psychostimulant that interferes the functionality of various brain regions and nervous connections, leading to addiction. The nucleus accumbens core (NAcC), primarily composed of gamma-aminobutyric acid (GABAergic) neurons, serves as a critical nucleus intimately related to addictive behavior. Previous research has indicated the involvement of cholecystokinin (CCK) receptors in drug addiction, yet the precise function of CCK receptors within the neural circuitry mediating METH-induced addiction remains elusive.

METHODS

METH-induced conditioned place preference (CPP) model was established in mice. In CCK receptor 1 conditional knockout (CCK1Rflox/flox) or CCK receptor 2 conditional knockout (CCK2Rflox/flox) mice, we then utilized the adeno-associated virus (AAV) transfection system to knock out the specific CCK receptor subtype and explore the function of the CCK receptors in the ventral tegmental area (VTA) to NAcC circuit during METH-induced CPP acquisition.

RESULTS

During the acquisition of METH-induced CPP, the expression of CCK1R, but not CCK2R, was upregulated specifically in NAcC. Genetic disruption of either CCK1R in the NAcC effectively hindered METH-induced CPP acquisition and prevented the hyper-excitability of neurons triggered by METH. Furthermore, CCK is released by dopaminergic neurons in the VTA, projecting to the NAcC. Notably, specifically knocking out CCK1R in the VTADA → NAcCGABA circuit blocked the presynaptic release and synaptic plasticity enhancement induced by METH.

CONCLUSIONS

These discoveries highlight the critical effect of CCK1R in the VTADA → NAcCGABA circuit on METH-induced CPP acquisition and provide a more comprehensive understanding of the mechanisms underlying CCK receptors contributing to the METH-induced addictive behavior.

The effect of reward and voluntary choice on the motor learning of serial reaction time task

Objective

Reward and voluntary choice facilitate motor skill learning through motivation. However, it remains unclear how their combination influences motor skill learning. The purpose of the present study is to investigate the effects of reward and voluntary choice on motor skill learning in a serial reaction time task (SRTT).

Methods

Participants completed six parts of SRTT, including pre-test, training phase, immediate post-test, a random session, delayed post-test, and retention test on the following day. During the training phase, participants were divided into four groups (reward_choice, reward_no-choice, no-reward_choice, no-reward_no-choice). In the reward condition, participants received reward for correct and faster (than a baseline) responses while those in the no-reward groups did not. For the choice manipulation, participants in the voluntary choice groups chose the color of the target, whereas in the forced choice groups, the same color was assigned by the computer.

Results

The results showed that the four groups did not exhibit any significant differences in reaction time and error rate in the pre-test phase. Importantly, both reward and voluntary choice significantly enhanced sequence-specific learning effects, while no interaction was found. No significant effects of reward and voluntary choice were observed in the retention test.

Conclusions

These findings suggest that reward and voluntary choice enhance motor skill performance and training independently, potentially at the action-selection level, which implies different mechanisms underlying the influences of reward and voluntary choice.

Memory and automatic processing of valuable information in younger and older adults

People often engage in the selective remembering of valuable or important information, whether strategic and/or automatic. We examined potential age-related differences in the automatic processing of value during encoding on later remembering by presenting participants with words paired with point values (range: 1-10 twice or 1-20) to remember for a later test. On the first three lists, participants were told that they would receive the points associated with each word if they recalled it on the test (their goal was to maximize their score). On the last three lists, we told participants that all words were worth the same number of points if recalled on the tests, thus making the point value paired with each word meaningless. Results revealed that selective memory may be impaired in older adults using procedures with larger value ranges. Additionally, we demonstrated that the automatic effects of value may have a greater effect on younger adults relative to older adults, but there may be instances where older adults also exhibit these automatic effects. Finally, strategic and automatic processes may not be related within each learner, suggesting that these processes may rely on different cognitive mechanisms. This indicates that these processes could be underpinned by distinct cognitive mechanisms: strategic processes might engage higher-level cognitive operations like imagery, while automatic processes appear to be more perceptually driven.

Striatal-hippocampal functional connectivity contributes to real-life positive anticipatory experiences and subjective well-being

Positive anticipatory experiences are key to daily well-being. However, the brain's functional architecture underlying real-world positive anticipatory experiences and well-being remains unexplored. In the present study, we combined an ecological momentary assessment and resting-state functional neuroimaging to identify the neural predictors of real-world positive anticipatory experiences and explore their relationships with subjective well-being (SWB). With a model-based approach, we quantified participants' accuracy in predicting positive events and the degree to which participants' affective states were influenced by the positive anticipation. We found that individuals with higher accuracy in predicting upcoming positive events showed greater SWB, and this relationship was mediated by greater positive anticipatory feelings. Importantly, functional connectivity of the dorsal and ventral striatal-hippocampal networks significantly predicted the accuracy and positive anticipatory feelings, respectively. These functional networks were further predictive of SWB. Our findings provide novel and ecologically valid evidence that the interaction between neural systems for reward-processing and memory plays an important role in real-life positive anticipatory experiences and everyday SWB.

The mnemonic potency of functional facts

Learning and remembering what things are used for is a capacity that is central to successfully living in any human culture. The current paper investigates whether functional facts (information about what an object is used for) are remembered more efficiently compared with nonfunctional facts. Experiment 1 presented participants with images of functionally ambiguous objects associated with a (made-up) name and a (made-up) fact that could relate either to the object's function or to something nonfunctional. Results show that recall of object names did not depend on whether they were associated with a functional or nonfunctional fact, while recall of the functional facts was significantly better than the nonfunctional facts. The second experiment replicated this main effect and further found that functional facts are remembered more efficiently after they have been associated with confirmatory (as opposed to disconfirmatory) feedback. It is suggested that semantic information is not unitary, and that one way of categorising semantic information is in terms of its adaptive relevance. Potential mechanisms are proposed and discussed, along with suggestions for future research.

Does value-based prioritization at working memory enhance long-term memory?

Research has demonstrated that individuals can direct their attention to valuable information in both working memory and long-term memory tasks with observable effects on performance. However, it is currently unclear whether prioritising an item for a working memory task automatically translates into a boost at long-term memory. This was examined in two experiments using relatively short (250 ms per item; Experiment 1) and longer (500 ms per item; Experiment 2) encoding times. Participants first completed a visual working memory task, in which they were presented with series of photographs of everyday objects. Following a brief delay (1,000 ms), they completed a four-alternative forced-choice test. Prior to encoding, participants were informed of the point values associated with each item. In some trials, the first item in the sequence was worth more points than the rest. In other trials, all items were equally valuable. After a filled delay, participants completed a surprise long-term memory task. At working memory, a value effect was reliably observed on recognition accuracy, along with some evidence of faster response times for high-value items. However, there was little consistent evidence of this effect automatically persisting into long-term memory. Thus, the benefits of attentional prioritization in working memory do not always translate into longer-term performance. More broadly, this provides further evidence that manipulations that enhance working memory performance do not necessarily enhance long-term memory.

The perceived importance of words in large font guides learning and selective memory

People are often presented with large amounts of information to remember, and in many cases, the font size of information may be indicative of its importance (such as headlines or warnings). In the present study, we examined how learners perceive the importance of information in different font sizes and how beliefs about font size influence selective memory. In Experiment 1, participants were presented with to-be-remembered words that were either unrelated or related to a goal (e.g., items for a camping trip) in either small or large font. Participants rated words in large font as more important to remember than words in small font when the words in a list were unrelated but not when the words were schematically related to a goal. In Experiments 2 and 3, we were interested in how learners' belief that font size is indicative of importance translates to their ability to selectively encode and recall valuable information. Specifically, we presented participants with words in various font sizes, and larger fonts either corresponded to greater point values or smaller point values (values counted towards participants' scores if recalled). When larger fonts corresponded with greater point values, participants were better able to selectively remember high-value words relative to low-value words. Thus, when to-be-remembered information varies in value, font size may be less diagnostic of an item's importance (the item's importance drives memory), and when the value of information is consistent with a learner's belief, learners can better engage in selective memory.

The role of attention and verbal rehearsal in remembering more valuable item-colour binding

Selectively remembering more valuable information can improve memory efficiency. Such value effects have been observed on long-term memory for item-colour binding, but the possible contributory factors are unclear. The current study explored contributions from attention (Experiment 1) and verbal rehearsal (Experiment 2). Across two experiments, memory was superior for item-colour bindings that were associated with high (relative to low) point values at encoding, both in an immediate test and a delayed re-test. When availability of attentional resources was reduced during encoding, value only influenced immediate and not delayed memory (Experiment 1). This indicates that a transient value effect can be obtained with little attentional resources, but attentional resources are involved in creating a longer lasting effect. When articulatory suppression was implemented during encoding (Experiment 2), value effects were somewhat reduced in the immediate test and abolished in the delayed re-test, suggesting a role for verbal rehearsal in value effects on item-colour binding memory. These patterns of value effects did not interact with encoding presentation format (i.e., sequential vs. simultaneous presentation of objects). Together, these results suggest that attentional resources and verbal rehearsal both contribute to value effects on item-colour binding memory, with varying impacts on the durability of these effects.

A preliminary investigation of physical and mental health features of cannabis & nicotine co-use among adolescents and young adults by sex

INTRODUCTION

Cannabis and nicotine/tobacco products (NTP) are commonly co-used in adolescence and young adulthood; however, limited research has been done on predictive health behaviors to co-use. The current study is a preliminary investigation into the relationships of modifiable health behaviors on cannabis and NTP co-use in adolescents and young adults.

METHOD

221 participants (ages 16-22) were characterized into cannabis use only (N = 55), NTP use only (N = 20), cannabis and NTP co-use (used cannabis and NTP; N = 96) and control (no use; N = 50) groups based on past 30-day use. Self-report measures for physical activity, sleep quality, mental health, and reward responsivity were utilized. Participants were given a comprehensive neurocognitive battery. Logistic regressions of self-report measures and fluid intelligence composite scores on substance use group status were run stratified by sex.

RESULTS

Higher approach reward sensitivity traits were associated with increased likelihood of cannabis use only (Odds Ratio (OR) = 1.15, p = .036) in female participants. Increased aerobic activity was associated with decreased likelihood of cannabis use only (OR = 0.91, p = .047) and cannabis and NTP co-use (OR = 0.88, p = .007) in female participants. Higher anxiety was associated with increased likelihood of cannabis NTP co-use (OR = 1.51, p = 0.025) in male participants.

DISCUSSION

Several health behaviors were linked with cannabis use and cannabis and NTP co-use in both females and male adolescents and young adults. Health markers differed by sex suggesting differing mechanisms of substance co-use. This study informs targetable health behaviors for prevention and intervention efforts.

Longitudinal associations of effort and reward at work with changes in cognitive function: evidence from a national study of U.S. workers

PURPOSE

This study aimed to examine longitudinal associations of workplace effort and reward with changes in cognitive function among United States workers.

METHODS

Data from the national, population-based Midlife in the United States (MIDUS) study with a 9-year follow-up were used. Validated workplace effort and reward scales were measured at baseline, and cognitive outcomes (including composite cognition, episodic memory, and executive functioning) were measured with the Brief Test of Adult Cognition by Telephone (BTACT) at baseline and follow-up. Multivariable linear regression analyses based on generalized estimating equations (GEE) examined the longitudinal associations under study.

RESULTS

Among this worker sample of 1,399, after accounting for demographics, socioeconomics, lifestyle behaviors, health conditions, and job control, high reward at baseline was associated with increased composite cognition (regression coefficient: 0.118 [95% CI: 0.049, 0.187]), episodic memory (0.106 [0.024, 0.188]), and executive functioning (0.123 [0.055, 0.191]) during follow-up. The joint exposure of 'high effort and high reward' was also associated with increased composite cognition (0.130 [0.030, 0.231]), episodic memory (0.131 [0.012, 0.250]), and executive functioning (0.117 [0.017, 0.216]), while the combination of 'low effort and high reward' was associated with increased composite cognition (0.106 [0.009, 0.204]) and executive functioning (0.139 [0.042, 0.235]).

CONCLUSION

Findings suggest that workplace high reward is related to improved cognitive scores among United States workers. Future research should investigate larger cohorts over longer timespans and expand into disease outcomes such as dementia. If these findings emerge as causal, relevant workplace rewards to promote worker cognitive health should be considered.

Goal-directed remembering in older adults

Compared to younger adults, older adults show a reduced difference in memory between items they are directed to remember and items they are directed to forget. This effect may result from increased processing of goal-irrelevant information in aging. In contrast, healthy older adults are often able to selectively remember valuable information, suggesting preservation of goal-directed encoding in aging. Here, we examined how value may differentially affect directed-forgetting and memory for irrelevant details for younger and older adults in a value-directed remembering task. In Experiment 1, participants studied words paired with a directed-forgetting cue and a point-value they earned for later recognition. Participants' memory was then tested, either after an 8-min or 24-hr retention interval. In Experiment 2 words were presented in two colors and the recognition test assessed whether the participant could retrieve the incidentally-presented point value and the color of each recognized words. In both experiments, older and younger adults displayed a comparable ability to selectively encode valuable items. However, older adults showed a reduced directed-forgetting effect compared to younger adults that was maintained across the 24-hr retention interval. In Experiment 2, older adults showed both intact directed-forgetting and similar incidental detail retrieval compared to younger adults. These findings suggest that older adults maintained selectivity to value, demonstrating that aging does not impact the differential encoding of valuable information. Furthermore, younger and older adults may be similarly goal-directed in terms of item features to encode, but that instructions to forget presented items are less effective in older adults.

The limited memory of value following value directed encoding

Items associated with higher values during encoding are later recognized and recalled better than are lower valued items. During recall paradigms, these value directed encoding (VDE) effects heavily depend upon learned strategies acquired during repeated testing with earnings feedback. However, because VDE effects also occur in single test recognition designs, precluding such learning, it has been suggested that high value may automatically induce good encoding. We tested this by manipulating encoding instructions (Experiments 1a and 1b) and manipulating concurrent levels of processing (LOP) requirements during encoding (Experiment 2a and 2b). Two main findings emerged. First, subject initiated strategies played a dominant role in VDE effects with little evidence for automaticity. This was demonstrated in Experiment 1 by a more than three-fold increase in the VDE recognition effect when instructions specifically encouraged selective elaboration of high-value items. It was also shown by the complete elimination of VDE recognition effects in Experiment 2 when LOP tasks were concurrently performed during encoding. Critically, the blocking of VDE effects occurred even though a catch trial procedure verified that value was being processed during encoding and remained even when subjects had unlimited time to process the materials during encoding. Second, the data showed, for the first time, that when subjects attempted to specify the value of recognized items, they heavily depended upon a recognition heuristic in which increases in recognition strength, even when nondiagnostic, were inferred to reflect high encoding value. The tendency for subjects to conflate recognition strength and value may have important implications for behavioral economics.

The effect of value on context and target recollection in memory for truth and falsity

Memory for truth and falsity has recently been investigated from the perspective of the dual-recollection theory, showing better context and target recollection for truth than falsity. In this paper, we examine whether these memory effects obtained for true statements are similar to the value effect, whereby true statements are given higher priority in encoding. For this purpose, we implemented value-directed remembering (VDR) into the conjoint-recognition paradigm. In our first experiment, the primary goal was to verify how VDR influences the processes defined by dual-recollection theory. At study, prioritized/important items were linked to higher numerical values (e.g., 10), while unimportant ones had lower values (e.g., 1). At test, the participants' task was to recognize whether a particular sentence was important, unimportant, or new. We found that both context and target recollection were better for important items. In the second experiment, the main goal was to study the combined effects of importance and veracity on memory. In the between-subjects design, participants were monetarily rewarded for memorizing true or false sentences. The results demonstrated differences in the ability to prioritize truth over falsity. Specifically, we found a substantial increase in context recollection for prioritized true information but not for prioritized false information. Moreover, we found higher context recollection for true than false sentences in the true-prioritized condition, but not in the false-prioritized condition. These results indicated that people are able to prioritize true information better than false, and suggested that memory for truth may be a special case of the value effect.

Age-related differences in selective associative memory: implications for responsible remembering

While often showing associative memory deficits, there may be instances when older adults selectively remember important associative information. We presented younger and older adults with children they would be hypothetically babysitting, and each child had three preferences: a food they like, a food they dislike, and a food they are allergic to and must avoid. In Experiment 1, all foods associated with each child were simultaneously presented while in Experiments 2 and 3, participants self-regulated their study of the different preferences for each child. We were interested in whether people, particularly older adults who often display associative memory impairments, can prioritize the most important information with consequences for forgetting (i.e., allergies), especially with increased task experience. Overall, compared with younger adults, older adults were better at selectively studying and recalling the children's allergies relative to the other preferences, and these patterns increased with task experience. Together, the present results suggest that both younger and older adults can employ strategies that enhance the recall of important information, illustrating responsible remembering. Specifically, both younger and older adults can learn to self-assess and prioritize the information that they need to remember, and despite memory deficits, older adults can learn to employ strategies that enhance the recall of important information, using metacognition and goal-directed remembering to engage in responsible remembering.

Age-Related Differences in Framing Selective Memory in Terms of Gains and Losses

We examined whether framing younger and older adults learning goals in terms of maximizing gains or minimizing losses impacts their ability to selectively remember high-value information. Specifically, we presented younger and older adults with lists of words paired with point values and participants were either told that they would receive the value associated with each word if they recalled it on a test or that they would lose the points associated with each word if they failed to recall it on the test. We also asked participants to predict the likelihood of recalling each word to determine if younger and older adults were metacognitively aware of any potential framing effects. Results revealed that older adults expected to be more selective when their goals were framed in terms of losses, but younger adults expected to be more selective when their goals were framed in terms of gains. However, this was not the case as both younger and older adults were more selective for high-value information when their goals were framed in terms of maximizing gains compared with minimizing losses. Thus, the framing of learning goals can impact metacognitive decisions and subsequent memory in both younger and older adults.

Cognitive offloading is value-based decision making: Modelling cognitive effort and the expected value of memory

How do people decide between maintaining information in short-term memory or offloading it to external reminders? How does this affect subsequent memory? This article presents a simple computational model based on two principles: A) items stored in brain-based memory occupy its limited capacity, generating an opportunity cost; B) reminders incur a small physical-action cost, but capacity is effectively unlimited. These costs are balanced against the value of remembering, which determines the optimal strategy. Simulations reproduce many empirical findings, including: 1) preferential offloading of high-value items; 2) increased offloading at higher memory loads; 3) offloading can cause forgetting of offloaded items ('Google effect') but 4) improved memory for other items ('saving-enhanced memory'); 5) reduced saving-enhanced-memory effect when reminders are unreliable; 6) influence of item-value: people may preferentially offload high-value items and store additional low-value items in brain-based memory; 7) greatest sensitivity to the effort of reminder-setting at intermediate rather than highest/lowest levels of task difficulty; 8) increased offloading in individuals with poorer memory ability. Therefore, value-based decision-making provides a simple unifying account of many cognitive offloading phenomena. These results are consistent with an opportunity-cost model of cognitive effort, which can explain why internal memory feels effortful but reminders do not.

How False Memory and True Memory Affect Decision Making in Older Adults: A Dissociative Account

OBJECTIVES

Remembering past rewarding experiences plays a crucial rule in guiding people's decision making in the future. However, as people age, they become less accurate in remembering past events and more susceptible to forming false memories. An important question is how the decline of episodic memory and the increase of false memory may affect older adults' decision-making performance.

METHODS

The current study used a newly developed paradigm in which the Deese-Roediger-McDermott (DRM) false memory paradigm was combined with a reward learning task to create robust false memories of rewarding experiences. Participants learned that some DRM picture lists brought them a monetary reward and some DRM picture lists did not bring reward. Later, their memories were tested and decision-making preferences were measured.

RESULTS

We found that older and younger adults had almost equivalent false and true memories under the rewarding context, but older adults showed significantly lower decision-making preferences for lure pictures and rewarded pictures than younger adults. Furthermore, true and false memories were a stronger predictor of decision-making preferences for younger than for older adults.

DISCUSSION

These results together suggest an age-related dissociation between memory and decision making that older adults may be less efficient in using their memory to guide decision making than younger adults. Future research may further investigate its underlying mechanisms and develop potential interventions aiming at strengthening the connection between memory and decision making in older adults to help improve their decision-making performance.

Memory for rewards guides retrieval

Rewards paid out for successful retrieval motivate the formation of long-term memory. However, it has been argued that the Motivated Learning Task does not measure reward effects on memory strength but decision-making during retrieval. We report three large-scale online experiments in healthy participants (N = 200, N = 205, N = 187) that inform this debate. In experiment 1, we found that explicit stimulus-reward associations formed during encoding influence response strategies at retrieval. In experiment 2, reward affected memory strength and decision-making strategies. In experiment 3, reward affected decision-making strategies only. These data support a theoretical framework that assumes that promised rewards not only increase memory strength, but additionally lead to the formation of stimulus-reward associations that influence decisions at retrieval.

More widespread and rigid neuronal representation of reward expectation underlies impulsive choices

Impulsive choices prioritize smaller, more immediate rewards over larger, delayed, or potentially uncertain rewards. Impulsive choices are a critical aspect of substance use disorders and maladaptive decision-making across the lifespan. Here, we sought to understand the neuronal underpinnings of expected reward and risk estimation on a trial-by-trial basis during impulsive choices. To do so, we acquired electrical recordings from the human brain while participants carried out a risky decision-making task designed to measure choice impulsivity. Behaviorally, we found a reward-accuracy tradeoff, whereby more impulsive choosers were more accurate at the task, opting for a more immediate reward while compromising overall task performance. We then examined how neuronal populations across frontal, temporal, and limbic brain regions parametrically encoded reinforcement learning model variables, namely reward and risk expectation and surprise, across trials. We found more widespread representations of reward value expectation and prediction error in more impulsive choosers, whereas less impulsive choosers preferentially represented risk expectation. A regional analysis of reward and risk encoding highlighted the anterior cingulate cortex for value expectation, the anterior insula for risk expectation and surprise, and distinct regional encoding between impulsivity groups. Beyond describing trial-by-trial population neuronal representations of reward and risk variables, these results suggest impaired inhibitory control and model-free learning underpinnings of impulsive choice. These findings shed light on neural processes underlying reinforced learning and decision-making in uncertain environments and how these processes may function in psychiatric disorders.

Age-Related Differences in Overcoming Interference When Selectively Remembering Important Information

We examined the effects of interference on value-based memory in younger and older adults by presenting participants with lists of words paired with point values counting toward their score if recalled. In Experiment 1, we created a situation where there was a buildup of interference such that participants could recall words from any studied list to earn points. However, to increase participants' motivation to combat interference, we told participants that if they recalled words from previously studied lists, those words would be worth double the original point value of the word. In Experiment 2, to examine age-related differences in the absence of any interference, participants studied and were tested on the same set of words throughout several study-test cycles. The buildup of interference caused by participants needing to recall both just-studied and previously studied words in Experiment 1 impaired selectivity in older adults relative to younger adults and this effect was particularly pronounced when considering the recall of just prior-list words. However, in the absence of interference, there was not an overall recall deficit or any selectivity impairments in older adults. Thus, proactive and retroactive interference seem to be largely responsible for age-related deficits in selective memory for important information.

Memory selectivity in older age

Memory often declines with age, but older adults can off-set memory challenges by selectively remembering important information. When encountering large amounts of information and knowing that memory is limited, older adults may choose to focus on what is most important and forget less relevant details. Prioritizing what to remember becomes essential when memory is limited, and influences what information can be off-loaded. While forgetting can be frustrating and consequential, a lifetime of these experiences may help older adults learn to focus on strategically remembering important information and life events. Curiosity and emotion may also guide what older adults remember, such that selective remembering can be an adaptive way to use memory efficiently in older age.

Value-directed learning: Schematic reward structure facilitates learning

When learning, it is often necessary to identify important themes to organize key concepts into categories. In value-directed remembering tasks, words are paired with point values to communicate item importance, and participants prioritize high-value words over low-value words, demonstrating selective memory. In the present study, we paired values with words based on category membership to examine whether being selective in this task would lead to a transfer of learning of the "schematic reward structure" of the lists with task experience. Participants studied lists of words paired with numeric values corresponding to the categories the words belonged to and were asked to assign a value to novel exemplars from the studied categories on a final test. In Experiment 1, instructions about the schematic structure of the lists were manipulated between participants to either explicitly inform participants about the list categories or to offer more general instructions about item importance. The presence of a visible value cue during encoding was also manipulated between participants such that participants either studied the words paired with visible value cues or studied them alone. Results revealed a benefit of both explicit schema instructions and visible value cues for learning, and this persisted even after a short delay. In Experiment 2, participants had fewer study trials and received no instructions about the schematic structure of the lists. Results showed that participants could learn the schematic reward structure with fewer study trials, and value cues enhanced adaptation to new themes with task experience.

Read carefully, because this is important! How value-driven strategies impact sentence memory

Little is understood about how people strategically process and remember important but complex information, such as sentences. In the current study, we asked whether people can effectively prioritize memory for sentences as a function of their relative importance (operationalized as a reward point value) and whether they do so, in part, by changing their sentence processing strategies when value information is available in advance. We adapted the value-directed remembering paradigm (Castel, Psychol Learn Motiv 48:225-270, 2007) for sentences that varied in constraint and predictability. Each sentence was associated with a high or low value for subsequent free recall (whole sentence) and recognition (sentence-final words) tests. Value information appeared after or before each sentence as a between-subject manipulation. Regardless of condition, we observed that high-value sentences were recalled more often than low-value sentences, showing that people can strategically prioritize their encoding of sentences. However, memory patterns differed depending on when value information was available. Recall for high-value sentences that ended unexpectedly (and therefore violated one's predictions) was reduced in the Before compared to the After condition. Before condition participants also showed a greater tendency to false alarm to lures (words that were the predicted - but not obtained - ending) from strongly constraining sentences. These observations suggest that when people try to prioritize sentence-level information that they know is valuable, the reading strategies they employ may paradoxically lead to worse memory.

Does point value structure influence measures of memory selectivity?

ABSTRACTIn reward-based learning and value-directed remembering, many different value structures for the to-be-remembered information have been used by researchers. I was interested in whether different scoring structures used in a value-directed remembering task impact measures of memory selectivity. Participants studied lists of words paired with point values and some lists included words paired with values ranging from 1 to 20, 1 to 10 (repeating twice), either a high value (10 points) or a low value (1 point), and either a high value (10 points), a medium value (5 points) or a low value (1 point). Results suggest that (1) in tests of free recall, if using a continuous value scale, the range of values matters in terms of selective memory, (2) analysing the selectivity index can yield different results than modelling item-level recall using point values (and the latter may be a preferable approach), (3) measures of selectivity using different value structures may lack construct validity when testing memory via recognition tests, and (4) the effect of value on memory is much larger on recall than recognition tests. Thus, I suggest that researchers carefully consider and justify the value structure used when examining selective memory for valuable information in list learning tasks.

Instructed motivational states bias reinforcement learning and memory formation

Motivation influences goals, decisions, and memory formation. Imperative motivation links urgent goals to actions, narrowing the focus of attention and memory. Conversely, interrogative motivation integrates goals over time and space, supporting rich memory encoding for flexible future use. We manipulated motivational states via cover stories for a reinforcement learning task: The imperative group imagined executing a museum heist, whereas the interrogative group imagined planning a future heist. Participants repeatedly chose among four doors, representing different museum rooms, to sample trial-unique paintings with variable rewards (later converted to bonus payments). The next day, participants performed a surprise memory test. Crucially, only the cover stories differed between the imperative and interrogative groups; the reinforcement learning task was identical, and all participants had the same expectations about how and when bonus payments would be awarded. In an initial sample and a preregistered replication, we demonstrated that imperative motivation increased exploitation during reinforcement learning. Conversely, interrogative motivation increased directed (but not random) exploration, despite the cost to participants' earnings. At test, the interrogative group was more accurate at recognizing paintings and recalling associated values. In the interrogative group, higher value paintings were more likely to be remembered; imperative motivation disrupted this effect of reward modulating memory. Overall, we demonstrate that a prelearning motivational manipulation can bias learning and memory, bearing implications for education, behavior change, clinical interventions, and communication.

The effects of typical ageing on cognitive control: recent advances and future directions

Cognitive control is one of the most fundamental aspects of human life. Its ageing is an important contemporary research area due to the needs of the growing ageing population, such as prolonged independence and quality of life. Traditional ageing research argued for a global decline in cognitive control with age, typically characterised by slowing processing speed and driven by changes in the frontal cortex. However, recent advances questioned this perspective by demonstrating high heterogeneity in the ageing data, domain-specific declines, activity changes in resting state networks, and increased functional connectivity. Moreover, improvements in neuroimaging techniques have enabled researchers to develop compensatory models of neural reorganisation that helps negate the effects of neural losses and promote cognitive control. In this article on typical ageing, we review recent behavioural and neural findings related to the decline in cognitive control among older adults. We begin by reviewing traditional perspectives and continue with how recent work challenged those perspectives. In the discussion section, we propose key areas of focus for future research in the field.

Establishing a causal role for left ventrolateral prefrontal cortex in value-directed memory encoding with high-definition transcranial direct current stimulation

One critical approach for promoting the efficiency of memory is to adopt selective encoding strategies to prioritize more valuable information. Past neuroimaging studies have shown that value-directed modulation of verbal memory depends heavily on the engagement of left-lateralized semantic processing regions, particularly in the ventrolateral prefrontal cortex (VLPFC). In the present study, we used high-definition transcranial direct current stimulation (HD-tDCS) to seek evidence for a causal role of left VLPFC in supporting the memory advantage for high-value items. Three groups of healthy young adult participants were presented with lists of words to remember, with each word accompanied by an arbitrarily assigned point value. During the first session, all participants received sham stimulation as they encoded five lists of 30 words each. Two of these lists were immediately tested with free recall, with feedback given to allow participants to develop metacognitive insight and strategies to maximize their point total. The second session had the exact same structure as the first, but the groups differed in whether they received continued sham stimulation (N = 22) or anodal stimulation of the left VLPFC (N = 21) or right VLPFC (N = 20). Those lists not tested with immediate recall were tested with recognition judgments after a one-day delay. Since no brain stimulation was applied during this Day 2 test, any performance differences can be attributed to the effects of stimulation on Day 1 encoding processes. Anodal stimulation of left VLPFC significantly boosted participants' memory encoding selectivity. In comparison, no such effect was seen in participants who received right VLPFC or sham stimulation. Estimates of recollection- and familiarity-based responding revealed that left VLPFC stimulation specifically amplified the effects of item value on recollection. These results demonstrate a causal role for left VLPFC in the implementation of selective value-directed encoding strategies, putatively by boosting deep semantic processing of high-value words. Our findings also provide further evidence on the hemispheric lateralization of value-directed verbal memory encoding.

Continuously changing memories: a framework for proactive and non-linear consolidation

The traditional view of long-term memory is that memory traces mature in a predetermined 'linear' process: their neural substrate shifts from rapidly plastic medial temporal regions towards stable neocortical networks. We propose that memories remain malleable, not by repeated reinstantiations of this linear process but instead via dynamic routes of proactive and non-linear consolidation: memories change, their trajectory is flexible and reversible, and their physical basis develops continuously according to anticipated demands. Studies demonstrating memory updating, increasing hippocampal dependence to support adaptive use, and rapid neocortical plasticity provide evidence for continued non-linear consolidation. Although anticipated demand can affect all stages of memory formation, the extent to which it shapes the physical memory trace repeatedly and proactively will require further dedicated research.

Responsible Remembering and Forgetting in Younger and Older Adults

Although older adults are often concerned about instances of forgetting, forgetting can be a useful feature of our memory system. Specifically, strategically forgetting less important information can benefit memory for goal-relevant information (i.e., responsible remembering and responsible forgetting). In two experiments, we presented younger and older adults with a list of words (either unrelated words or items to bring on a camping trip) with a cue indicating whether participants ("You") or their "Friend" was responsible for remembering each item. Results revealed that both younger and older adults engaged in responsible remembering and forgetting by better remembering items they were responsible for remembering, indicating a strategic utilization of their limited memory capacity. Additionally, regardless of age and the cue indicating who was responsible for remembering each item, participants used importance to guide the encoding and retrieval of information. Thus, people may be able to engage strategic cognitive mechanisms to maximize memory utility for important, goal-relevant information, and responsible forgetting can enhance memory utility in both younger and older adults by using importance to drive memory and reduce consequences for forgetting.

Framing effects in value-directed remembering

Changing how an issue is framed can influence both decision-making and metacognition, but framing a memory task in terms of gains and losses could also impact how learners prioritize information according to its value or importance. We investigated how framing task instructions and feedback in terms of gains and losses influences learners’ ability to selectively remember valuable information at the expense of low-value information. Specifically, we presented learners with to-be-remembered words paired with point values and either told participants how many points they scored (the sum of the values of recalled words) or lost (the sum of the values of not-recalled words) on each list, with participants’ goal being to maximize their scores or minimize their losses, respectively. Overall, participants were more selective for high-value words when their goals were framed in terms of point gains compared with when their goals were framed in terms of losses, and learners’ metacognitive predictions of performance (JOLs) generally mapped onto this trend. Thus, framing in terms of losses for forgetting can reduce memory selectivity, perhaps because even small losses are salient, indicating that framing effects are not limited to decision-making but can influence memory and metacognitive processes as well.

Responsible attention: the effect of divided attention on metacognition and responsible remembering

We are frequently exposed to situations where we need to remember important information when our attentional resources are divided; however, it was previously unclear how divided attention impacts responsible remembering: selective memory for important information to avoid consequences for forgetting. In the present study, we examined participants' memory for valuable information, metacognitive accuracy, and goal-directed cognitive control mechanisms when under full and divided attention. In Experiment 1, participants were presented with words paired with point values counting towards their score if recalled but were required to "bet" on whether they would remember it. Results revealed that selective memory for high-value information was impaired under divided attention. In Experiment 2, we presented participants with unassociated word pairs and solicited metacognitive predictions of recall (i.e., JOLs). Results revealed that the relative accuracy of participants' metacognitive judgments was enhanced when studying under divided attention. Experiment 3 examined cognitive control mechanisms to selectively remember goal-relevant information at the expense of information that could potentially be offloaded (i.e., responsible forgetting). Results revealed that participants' ability to strategically prioritize goal-relevant information at the expense of information that could be offloaded was preserved under divided attention. Collectively, responsible attention encompasses how attentional resources impact one's ability to engage in responsible remembering and we demonstrate that responsible remembering can be impaired, enhanced, and preserved in certain contexts.

Selective remembering and directed forgetting are influenced by similar stimulus properties

Do the properties of to-be-remembered events influence the ability to remember, and also intentionally forget, these events in similar ways? Prior work has examined how the font size, animacy, emotionality, concreteness (the degree to which a word denotes something perceptible), frequency (how often a word appears in language), and length of to-be-remembered words influence memory. However, it was previously unclear whether the forgetting of information is also influenced by these characteristics. In six experiments, we used an item-method directed forgetting task where we presented participants with to-be-remembered and to-be-forgotten words varying in font size (large or small), animacy (animate or inanimate), emotionality (negative or neutral), concreteness (high or low), frequency (high or low), and word length (long or short). Results revealed that animacy, emotionality, concreteness, frequency, and word length (but not font size) influenced both remembering and forgetting. Together, the present findings indicate that the characteristics of presented words can influence remembering as well as directed forgetting, providing further evidence that the remembering and forgetting processes are governed by similar properties.

Disrupted Value-Directed Strategic Processing in Individuals with Mild Cognitive Impairment: Behavioral and Neural Correlates

Value-directed strategic processing involves attending to higher-value information while inhibiting lower-value information. This preferential processing is relatively preserved in cognitively normal older adults but is impaired in individuals with dementia. No studies have investigated whether value-directed strategic processing is disrupted in earlier stages of cognitive decline, namely, mild cognitive impairment (MCI). The current study examined behavioral and EEG differences in value-directed strategic processing between 18 individuals with MCI and 18 cognitively normal older controls using a value-directed list learning task. Behaviorally, individuals with MCI recalled fewer total and high-value words compared to controls, but no group differences were observed in low-value word recall. Neurally, individuals with MCI had reduced theta synchronization relative to controls between 100 and 200 ms post-stimulus. Greater alpha desynchronization was observed for high- versus low-value words between 300 and 400 ms in controls but not in the MCI group. The groups showed some processing similarities, with greater theta synchronization for low-value words between 700 and 800 ms and greater alpha desynchronization for high-value words between 500 and 1100 ms. Overall, value-directed strategic processing was compromised in individuals with MCI on both behavioral and neural measures relative to controls. These findings add to the growing body of literature on differences between typical cognitive aging and MCI.

The effect of external store reliance on actual and predicted value-directed remembering

We often rely on external devices to store to-be-remembered information in our everyday lives (e.g., writing grocery lists, setting reminders), yet there is limited research about how certain information (i.e., valuable information) may be differentially encoded when we rely on our internal memory versus an external store. Across three preregistered experiments, we examined the effect of relying on an external store on the recall of high-value and low-value information. In Experiments 1a and 1b, we presented participants with words associated with point values and examined mean recall performance during two critical trials in which the external store was not available: (1) a trial in which participants were told that they would have access to an external memory store at test (told-external-store) and (2) a trial in which participants were told that they would not have access to their external store at test (told-no-external-store). In Experiment 2, we explored participants' metacognitive predictions of performance on the recall test. Critically, across all of the experiments, we found that the value effect (i.e., better recall for valuable information) was significantly reduced when individuals were told that they could rely on an external store. The same pattern was present in participant's metacognitive judgements. Together, these results suggest that when relying on external stores, individuals forgo (to some extent, at least) selective encoding by value and that individuals might be aware of this change in strategy.