The impact of working memory testing on long-term associative memory

The long-term fate of to-be-remembered information depends in part on the conditions of initial learning, including mental operations engaged via working memory. However, the mechanistic role of working memory (WM) processes in subsequent episodic memory (EM) remains unclear. Does re-exposure to word-pairs during WM recognition testing improve EM for those associations? Are benefits from WM re-exposure greater after an opportunity for retrieval practice compared to mere re-exposure to the memoranda? These questions are addressed in three experiments (N = 460) designed to assess whether WM-based recognition testing benefits long-term associative memory relative to WM-based restudying. Our results show null or negative benefits of WM recognition testing minutes later when initial WM accuracy was not considered. An EM benefit of WM recognition testing only emerges when the analyses are limited to pairs responded to correctly during WM. However, even when compared with accurate WM recognition, restudying can lead to similar associative EM benefits in specific experimental conditions. Taken together, the present results suggest that while WM re-exposure to studied pairs is beneficial to long-term associative memory, successful retrieval on initial tests may be a necessary but insufficient condition for the emergence of a "WM-based testing effect." We consider these results in relation to several hypotheses proposed to explain the testing effect in long-term memory (LTM). In view of empirical parallels with the LTM testing effect, we propose that similar processes influence the benefits of practice tests administered within the canonical boundaries of WM, suggesting continuities in memory over the short and long term.

The influence of repeated study and repeated testing on the testing effect and the transfer effect over time

Many studies have shown that compared to the restudy condition (RS), retrieval practice (RP) enhances the long-retention memory of retrieved items (i.e., the testing effect), and facilitates later memory of non-retrieved but related items (i.e., the transfer effect). However, previous studies have usually used repeated study and repeated testing, which are included in study-testing cycles. Therefore, it is unclear to what extent the factors of repeated study and repeated testing influence testing and transfer effects over time. In this study, participants studied sentences that described various episodes, then tested a half subset of the original sentences under three conditions (RP, RS, control). After retention intervals of 10 min, 1 day and 7 days, they recalled all of the information in the sentences. The results showed that the testing effect was enhanced by repeated study or repeated testing, while the transfer effect occurred only after both repeated study and repeated testing. Furthermore, repeated study or repeated testing slowed down the forgetting of retrieved items, while the forgetting of non-retrieved items occurred after both repeated study and repeated testing. The testing effect increased over time, but the transfer effect remained relatively stable over time. These results clarified different roles of multiple study repetitions and testing opportunities in the testing effect and the transfer effect, and suggest that the repeated retrieval could be combined with repeated study to optimally promote long-term retention of the memory of tested and non-tested items.

Retrieval practice reduces relative forgetting over time

There is overwhelming evidence in the literature that retrieval practice of studied material can lead to better final recall than restudy of the same material. Far less clear is whether this recall benefit is accompanied by reduced subsequent forgetting over time. This study revisited the issue in two experiments by comparing the effects of retrieval practice - with and without feedback -, restudy, and a no-practice condition on recall across different delay intervals ranging between three minutes and several days. We fitted power functions of time to the recall rates of each practice condition and compared relative forgetting rates between conditions. The comparisons showed that relative forgetting was reduced after retrieval practice relative to restudy, the relative forgetting rate after retrieval practice was unaffected by the presence of feedback, and forgetting after restudy did not differ from the no-practice condition. Together with other findings in the literature, the results provide evidence that retrieval practice reduces relative forgetting over time.

Cognitive perspectives on maintaining physicians' medical expertise: IV. Best practices and open questions in using testing to enhance learning and retention

Although tests and assessments-such as those used to maintain a physician's Board certification-are often viewed merely as tools for decision-making about one's performance level, strong evidence now indicates that the experience of being tested is a powerful learning experience in its own right: The act of retrieving targeted information from memory strengthens the ability to use it again in the future, known as the testing effect. We review meta-analytic evidence for the learning benefits of testing, including in the domain of medicine, and discuss theoretical accounts of its mechanism(s). We also review key moderators-including the timing, frequency, order, and format of testing and the content of feedback-and what they indicate about how to most effectively use testing for learning. We also identify open questions for the optimal use of testing, such as the timing of feedback and the sequencing of complex knowledge domains. Lastly, we consider how to facilitate adoption of this powerful study strategy by physicians and other learners.

Language-switching and retrieval-based learning: an unfavorable combination

Language-switching costs arise when learners encode information in one language and subsequently recall that information in a different language. The assumed cognitive mechanism behind these costs is the principle of encoding specificity that implies language-dependent representations of information. The aim of our study was to test this mechanism and to gain insights into the impact of language-switching on subsequent learning. To this end, we used retrieval-based learning as a carrier-paradigm. In a 2×3-design, 117 participants learned mathematical concepts with a practice-test or a restudy opportunity (within-subjects factor). In addition, the sample was divided into three groups regarding language-switching (between-subjects factor): one group without switching, one switched for the final tests, and one switched between initial learning and subsequent learning. Results show the expected main effects: participants performed better for the items learned via retrieval-based learning (testing-effect) and worse in conditions with language-switching (language-switching-costs). Most importantly, we were able to find an interaction between learning condition and language-switching: retrieval-based learning suffers particularly from language-switching. Additionally, our results indicate that language switching before subsequent learning seems to be particularly detrimental. These results provide both validation for encoding specificity as mechanism underlying language-switching costs and new information on the impact of the time of language-switching that can be considered in educational designs such as "Content and Language Integrated Learning."

The Forward Testing Effect Is Resistant to Acute Psychosocial Retrieval Stress

The forward testing effect refers to the finding that testing of previously studied information improves memory for subsequently studied newer information. Recent research showed that the effect is immune to acute psychosocial encoding/retrieval stress, i.e., stress that is induced before initial encoding. The present study investigated whether the forward testing effect is also robust to acute psychosocial retrieval stress, i.e., stress that is induced after encoding but before retrieval of the critical item list. Participants (N = 128) studied three lists of words in anticipation of a final cumulative recall test. Participants were tested immediately on Lists 1 and 2 (testing condition) or restudied the two lists after initial study (restudy condition). After study of the critical List 3, psychosocial stress was induced in half of the participants (stress group), whereas no stress was induced in the other half (control group). The Trier Social Stress Test for Groups (TSST-G) was used for stress induction. Salivary cortisol, alpha amylase, and subjective stress were repeatedly measured. The results of the criterion test showed a generally detrimental effect of psychosocial retrieval stress on List 3 recall. Importantly, the forward testing effect was unaffected by retrieval stress. The findings are discussed with respect to current theories of the forward testing effect.

Brief memory reactivations induce learning in the numeric domain

Learning of arithmetic facts such as the multiplication table requires time-consuming, repeated practice. In light of evidence indicating that reactivation of encoded memories can modulate learning and memory processes at the synaptic, system and behavioral levels, we asked whether brief memory reactivations can induce human learning in the numeric domain. Adult participants performed a number-fact retrieval task in which they learned arbitrary numeric facts. Following encoding and a baseline test, 3 passive, brief reactivation sessions of only 40 s each were conducted on separate days. Learning was evaluated in a retest session. Results showed reactivations induced learning, with improved performance at retest relative to baseline test. Furthermore, performance was superior compared to a control group performing test-retest sessions without reactivations, who showed significant memory deterioration. A standard practice group completed active-retrieval sessions on 3 separate days, and showed significant learning gains. Interestingly, while these gains were higher than those of the reactivations group, subjects showing reactivation-induced learning were characterized by superior efficiency relative to standard practice subjects, with higher rate of improvement per practice time. A follow-up long-term retention experiment showed that 30 days following initial practice, weekly brief reactivations reduced forgetting, with participants performing superior to controls undergoing the same initial practice without reactivations. Overall, the results demonstrate that brief passive reactivations induce efficient learning and reduce forgetting within a numerical context. Time-efficient practice in the numeric domain carries implications for enhancement of learning strategies in daily-life settings.

EXPRESS: Where was the Toaster? A systematic investigation of semantic construction in a new virtual episodic memory paradigm

Retrieved memories of past events are often inaccurate. The scenario construction model (SCM) postulates that during encoding, only the gist of an episode is stored in the episodic memory trace and during retrieval, information missing from that trace is constructed from semantic information. The current study aimed to find behavioural evidence for semantic construction in a realistic, yet controlled setting by introducing a new paradigm and adjusted memory tests that measure semantic construction. Using a desktop virtual reality (VR) participants navigated through a flat in which some household objects appeared in unexpected rooms, creating conflicts between the experienced episode and semantic expectations. The manipulation of congruence enabled us to identify influences from semantic information in cases of episodic memory failure. Besides we controlled for objects to be task-relevant or -irrelevant to the sequence of action. In addition to an established old/new recognition task we introduced spatial and temporal recall measures as possible superior memory measures quantifying semantic construction. The recognition task and the spatial recall revealed, that both congruence and task-relevance predicted correct episodic memory retrieval. In cases of episodic memory failure semantic construction was more likely than guessing and occurred more frequently for task-irrelevant objects. In the temporal recall object-pairs belonging to the same semantic room-category were temporally clustered together compared to object-pairs from different semantic categories (at the second retrieval). Taken together, our findings support the predictions of the SCM. The new VR-paradigm, including the new memory measures appears to be a promising tool for investigating semantic construction.

Pedagogical Strategies for the Enhancement of Medical Education

Clearly, memory and learning are essential to medical education. To make memory and learning more robust and long-term, educators should turn to the advances in neuroscience and cognitive science to direct their efforts. This paper describes the memory pathways and stages with emphasis leading to long-term memory storage. Particular stress is placed on this storage as a construct known as schema. Leading from this background, several pedagogical strategies are described: cognitive load, dual encoding, spiral syllabus, bridging and chunking, sleep consolidation, and retrieval practice.

Abrufeffekte im Gedächtnis: Ein Überblick zur aktuellen Grundlagenforschung

Zusammenfassung. Der Frage, wie Erinnern das Gedächtnis formt, wurde in der Kognitiven Psychologie in letzter Zeit große Aufmerksamkeit gewidmet. Testungseffekte, die in einer durch Gedächtnisabruf in der Folge verbesserten Zugänglichkeit von Gedächtniseinträgen bestehen, wurden in diesem Zusammenhang insbesondere auch hinsichtlich ihres pädagogischen Potentials diskutiert. Neben erleichterter Zugänglichkeit kann Gedächtnisabruf allerdings auch Vergessen nicht abgerufener Information verursachen. Der aktuelle Stand der Grundlagenforschung zu Abrufeffekten wird in diesem Überblicksartikel dargestellt und eine integrative Betrachtung unterschiedlicher Arten von Abrufeffekten unter Berücksichtigung wichtiger Moderatorvariablen versucht.

Homework questions designed to require higher-order cognitive skills in an undergraduate animal physiology course did not produce desirable difficulties, testing effects, or improvements in information retention

Studies show that retrieval practices such as homework assignments that are completed during the encoding phase of learning benefit knowledge acquisition and retention. In addition, desirable difficulties, which are strategies that intentionally create a greater challenge during initial learning to enhance encoding and retrieval pathways, also benefit learning long term. Our objective was to determine whether weekly homework questions intended to create desirable difficulties by requiring higher-order cognitive skills (HOCS) benefited students' long-term retention of physiology concepts compared to questions designed to require lower-order cognitive skills (LOCS). Undergraduate students in a junior-level animal physiology course were presented information during weekly laboratory periods, and then required to complete retrieval practices in the form of online homework assignments 5 d after each lab. Homework questions were formatted per Bloom's Taxonomy to require HOCS (i.e., level 4 or 5) or LOCS (i.e., level 1 or 2). Information retention was assessed the next week via performance on an in-class quiz and again at semesters' end via performance on a final practical exam. We observed no differences in performance on the in-class quiz or final practical exam between students randomly assigned to complete homework with HOCS questions compared to LOCS questions. However, students that received homework with HOCS questions had decreased (P < 0.05) performance scores on 9 out of the 11 homework assignments compared to those receiving homework with LOCS questions. These findings indicate that desirable difficulties were not created by our HOCS homework questions because students receiving these more difficult retrieval practices did not achieve equal success on them. As a result, this attempt to create variations in cognitive demand did not enhance retention of knowledge in this study.

Learning new word meanings from story reading: the benefit of immediate testing

This study investigated how word meanings can be learned from natural story reading. Three experiments with adult participants compared naturalistic incidental learning with intentional learning of new meanings for familiar words, and examined the role of immediate tests in maintaining memory of new word meanings. In Experiment 1, participants learned new meanings for familiar words through incidental (story reading) and intentional (definition training task) conditions. Memory was tested with cued recall of meanings and multiple-choice meaning-to-word matching immediately and 24 h later. Results for both measures showed higher accuracy for intentional learning, which was also more time efficient than incidental learning. However, there was reasonably good learning from both methods, and items learned incidentally through stories appeared less susceptible to forgetting over 24 h. It was possible that retrieval practice at the immediate test may have aided learning and improved memory of new word meanings 24 h later, especially for the incidental story reading condition. Two preregistered experiments then examined the role of immediate testing in long-term retention of new meanings for familiar words. There was a strong testing effect for word meanings learned through intentional and incidental conditions (Experiment 2), which was non-significantly larger for items learned incidentally through stories. Both cued recall and multiple-choice tests were each individually sufficient to enhance retention compared to having no immediate test (Experiment 3), with a larger learning boost from multiple-choice. This research emphasises (i) the resilience of word meanings learned incidentally through stories and (ii) the key role that testing can play in boosting vocabulary learning from story reading.

Retrieval Practice for Improving Long-Term Retention in Anatomical Education: A Quasi-Experimental Study

It is generally assumed by students that learning takes place during repeated episodes of rereading and rote memorization of course materials. Over the past few decades, however, research has increasingly indicated that the said notion can and should be enhanced with learning paradigms such as retrieval practice (RP). RP occurs when students practice retrieving their consolidated semantic memories by informally testing themselves. This strategy results in the re-encoding and re-consolidation of existing semantic memories, thus strengthening their schemas. The purpose of this quasi-experimental design was to assess the effects of the implementation of RP on student performance on the final exam in a large, undergraduate Gross Anatomy course. It was hypothesized that student participation in RP during class would improve their performance on the final exam in the course. The participants (N = 248) were mainly in Life Sciences, Kinesiology, and Physical Education programs. They answered RP questions using TopHat©, an online educational software platform. The results of this study indicated that student performance on the final exam was enhanced when students engaged in RP. It was concluded that the use of RP effectively enhances learning and long-term retention of semantic memory. In addition to the traditional testing 'of' learning, teachers are encouraged to implement testing, in the form of RP, in their classrooms 'for' learning.

Long-term inference and memory following retrieval practice

One exceptional characteristic of the testing effect is its generalizability over time and circumstance. The benefits of testing over rote restudy appear to grow with time, as forgetting occurs, and also have been documented to extend to tasks of inference on previously unstudied stimuli. In the two experiments reported here, we evaluated inference and memory for members of natural categories over time. Rote memory and generalization were tested shortly after the study phase and again after varying delays. Results from both experiments indicate that retrieval practice does indeed enhance inference for novel members of previously learned categories, and that the benefits are maintained over the duration of our experiments-up to 25 days. An analysis of forgetting rates indicates that retrieval practice does not, however, decelerate forgetting when compared with restudy. Rates of forgetting were not discernibly different, for either rote memory or conceptual knowledge, between the two conditions. These results indicate that although testing does not appear to reduce forgetting, it is a potent means of enhancing inference, and the benefits to memory and inference are long lasting.

The retention benefits of cumulative versus non-cumulative midterms in introductory biology may depend on students' reasoning skills

Assessment has long played an important role as a measurement tool of student mastery over course content. However, testing has also been shown to be an effective learning tool. Cumulative testing, in which all material from the entire learning period is covered, has been assumed to be effective, yet few studies have explicitly tested its effectiveness compared to non-cumulative testing. Studies in psychology and mathematics courses suggest that cumulative final exams increase long-term retention of information, and cumulative testing during the semester can increase cumulative final exam performance and long-term retention. Because frequent testing has also been shown to increase student learning, the purpose of this quasi-experimental study is to investigate the effects of cumulative versus non-cumulative midterms on student learning in a course that uses frequent assessment. In this study, one section of an introductory biology course for non-majors was given seven cumulative midterms, with about half of the questions drawn from previous units and the rest covering the current unit. The other section was given seven non-cumulative midterms that focused on current material while other course characteristics were held constant. Student performance on a common, cumulative final exam and a retention exam five months later were compared. Midterm format had no effect on final exam performance, contradicting the few studies done in psychology and mathematics courses. Thus, there may be no additional benefit of cumulative testing if exams are given frequently. Cumulative midterms appeared to increase retention after five months, but only for students who entered the course with low reasoning skills. Interestingly, students with high reasoning skills appeared to retain more from the course if they were given non-cumulative midterms. Possible explanations and ideas for future research are discussed.

Practicing Retrieval Facilitates Learning

How do we go about learning new information? This article reviews the importance of practicing retrieval of newly experienced information if one wants to be able to retrieve it again in the future. Specifically, practicing retrieval shortly after learning can slow the forgetting process. This benefit can be seen across various material types, and it seems prevalent in all ages and learner abilities and on all types of test. It can also be used to enhance student learning in a classroom setting. I review theoretical understanding of this phenomenon (sometimes referred to as the testing effect or as retrieval-based learning) and consider directions for future research.

The Forward Testing Effect is Immune to Acute Psychosocial Encoding/Retrieval Stress

The forward testing effect (FTE) refers to the finding that testing of previously studied information enhances memory for subsequently studied other information. Previous research demonstrated that the FTE is a robust phenomenon that generalizes across different materials and populations. The present study examined whether the FTE is robust under acute psychosocial encoding/retrieval stress. In each of two experimental conditions, participants studied three item lists in anticipation of final cumulative recall testing. In the testing condition, participants were tested immediately on lists 1 and 2, whereas in the restudy condition, they restudied lists 1 and 2. In both conditions, participants were tested immediately on list 3. Acute psychosocial stress was induced in participants prior to the encoding of item lists using the Trier social stress test for groups protocol. No stress was induced in a control group. Salivary cortisol, alpha amylase, and subjective stress were measured repeatedly to capture the biopsychological stress response. The results showed a significant FTE on list 3 recall, that is, testing of lists 1 and 2 enhanced the recall of list 3. No significant effect of stress on the FTE was observed, suggesting that the FTE is robust under acute psychosocial encoding/retrieval stress. The discussion provides suggestions for future research directions.

Testing can facilitate forgetting of tested items

Previous research has shown that taking a test facilitates memory retention on later retesting, although facilitation is stronger when retesting is delayed. On the basis of the finding that testing prevents later forgetting without affecting memory recovery, we investigated immediate effects of taking a test on retrievability of a tested item. In two experiments, forty participants recalled studied items, then performed a retest of the studied items (test condition) and a non-episodic-memory task (distractor condition), and immediately afterward re-recalled the items. The test condition elicited more item losses (i.e. forgetting) than the distractor condition, whereas there were no condition differences in the number of item gains (i.e. remembering) and recall clustering. These results suggest that taking a test on a target item facilitates forgetting of the very same item for a short interval of time, a possible reason for the late appearance of the testing effect.

Learning Mathematics Problem Solving through Test Practice: a Randomized Field Experiment on a Global Scale

We measure the effect of a single test practice on 15-year-old students’ ability to solve mathematics problems using large, representative samples of the schooled population in 32 countries. We exploit three unique features of the 2012 administration of the Programme for International Student Assessment (PISA), a large-scale, low-stakes international assessment. During the 2012 PISA administration, participating students were asked to sit two separate tests consisting of problem-solving tasks. Both tests included questions that covered the same internationally recognized and validated framework for mathematics assessment. Students were randomly assigned in the first, 2-h-long test to one of three test versions containing varying amounts of mathematics, reading, and science problems. We found that the amount of mathematics problems in the first test had a small positive effect on mean mathematics performance on the second test, but no effect on general reasoning and problem-solving ability. Subject-specific effects of test practice on subsequent test performance were found over both short lags (same day) and medium lags (1–7 days). The learning gains ascribed to mathematics problem-solving practice were larger for boys than for girls.

Retrieval Practice Improves Recollection-Based Memory Over a Seven-Day Period in Younger and Older Adults

Retrieving information improves subsequent memory performance more strongly than restudying. However, despite recent evidence for this retrieval practice effect (RPE), the temporal dynamics, age-related changes, and their possible interactions remain unclear. Therefore, we tested 45 young (18–30 years) and 41 older (50 + years) participants with a previously established RP paradigm. Specifically, subjects retrieved and restudied scene images on Day 1; subsequently, their recognition memory for the presented items was tested on the same day of learning and 7 days later using a remember/know paradigm. As main findings we can show that both young and older adults benefited from RP, however, the older participants benefited to a lesser extent. Importantly, the RPE was present immediately after learning on Day 1 and 7 days later, with no significant differences between time points. Finally, RP improved recollection rates more strongly than familiarity rates, independent of age and retrieval interval. Together, our results provide evidence that the RPE is reduced but still existing in older adults, it is stable over a period of seven days and relies more strongly on hippocampus-based recollection.

How to activate students’ natural desire to test themselves

Testing oneself (i.e., doing retrieval practice) is an effective way to study. We attempted to make learners choose to test themselves more often. In Experiment 1, participants were asked how they wanted to study and were given four options: retrieval with no hint (e.g., idea: ______), a two-letter hint (e.g., idea: s____r), a four-letter hint (e.g., idea: se__er), or a presentation trial (e.g., idea: seeker). They tested themselves on the majority of trials. In Experiment 2, when the hint options were removed, they chose restudy rather than pure test on the majority of trials. These findings show that people prefer self-testing over restudy as long as they can get the answer right on the test. However, we would not recommend hints if they impaired learning compared to pure testing. Experiment 3 showed that this was not the case; the three retrieval conditions from Experiment 1 led to equivalent amounts of learning, and all three outperformed the pure presentation condition. We used different materials in Experiment 4 and found that the hints made retrieval slightly less beneficial when the hints made it possible to guess the answers without thinking back to the study phase (e.g., whip: pu__sh). In summary, hints catalyzed people’s intuitive desire to self-test, without any downside for learning, thus making their self-regulated study more enjoyable and effective.

Educational impact of assessment on medical students' learning at Tehran University of Medical Sciences: a qualitative study

OBJECTIVES

It has been shown that assessment strongly affects students' performance. A deeper insight needs to be gained into the interplay of assessment and learning. The aim of the current study was to develop a model to explain the educational impact of assessments on students' learning, before, during and after the test.

DESIGN

This study used semistructured interviews, focus group discussions and observation and collection of field notes. A qualitative methodology using the grounded theory data analysis approach was then used to generate an explanation of the process of how assessment impacts students' learning.

SETTING

School of Medicine, Tehran University of Medical Sciences.

PARTICIPANTS

Participants were medical students and teachers with first-hand experience or expertise in assessment as well as their willingness to participate in the study. Fifteen people (eight medical students, seven faculty members) were interviewed. One focus group discussion (with five students) was held.

RESULTS

The extracted concepts from our study were classified into four main categories. These categories include elements of the assessment programme which affect learning, the mechanism through which they exert their effects, contextual factors and the impact they have on learning. These elements and their interplay occur within an environment with its antecedent characteristics.

CONCLUSIONS

This study suggested a model for understanding the elements of the assessment which, within the context, affect learning, the mechanisms through which they impart their effects and the final outcomes obtained.

Divided attention and the encoding effects of retrieval

Retrieving from memory both reveals as well as modifies memory. It is important to understand how these encoding effects of retrieval differ from other forms of encoding. One possible difference relates to attention: divided attention is well known to disrupt memory encoding but typically has much less impact on memory retrieval. However, less is known about the relative attentional demands of the encoding consequences of retrieval. The current experiments examined retrieval-based encoding using free recall, a retrieval task purported to require substantial attentional resources. In three experiments, participants studied common category exemplars (Phase 1), restudied or freely recalled the exemplars (Phase 2), and then took a final free-recall test (Phase 3). Phase 2 occurred under full attention (FA) or divided attention (DA). In all three experiments, the negative effect of DA on final recall was significant in the restudy but not retrieval condition. The pattern persisted with short (Experiment 1) or long study lists (Experiment 2), requiring lesser or greater retrieval effort, and with multiple Phase 2 tests, permitting the development of more elaborate retrieval strategies (Experiment 3). The encoding effects of retrieval appear resilient to distraction, even using a memory task that is more effortful and easily disrupted by DA (i.e., free recall). In addition, these results are inconsistent with elaboration and effort accounts of retrieval-based learning.

Age-Related Decreases in the Retrieval Practice Effect Directly Relate to Changes in Alpha-Beta Oscillations

The retrieval (or testing) of information leads to better memory performance compared with reencoding. This phenomenon is known as "testing effect" or "retrieval practice effect" and has been primarily described in behavioral studies with healthy young subjects. However, possible age-related changes and their associated underlying neural processes, in particular neural oscillations, remain unclear. To address this issue, we used a previously established paradigm in healthy young (N = 27) and elderly (N = 28) male and female human adults while their brain activity was being recorded using EEG. Subjects viewed prefamiliarized scene images intermixed with new scenes and classified them as indoor versus outdoor (encoding task) or old versus new (retrieval task). Subsequently, subjects performed a recognition memory task 10 min and 24 h after encoding. Behaviorally, both age groups showed the testing effect at both time points but, importantly, it was less pronounced in the elderly. At the neural level, the retrieval compared with the encoding task was accompanied by power decreases in the alpha (9-12 Hz) and beta bands (13-30 Hz), possibly reflecting task demands, and this difference was more pronounced in the elderly. Finally, a correlation analysis revealed that those elderly who displayed a more pronounced testing effect exhibited a neural pattern that was more similar to the younger subjects. These findings provide evidence that the testing effect decreases across the life span, and they suggest that changes in alpha-beta oscillations play a direct role.SIGNIFICANCE STATEMENT Learning new and retrieving old information is part of everyday human life. Understanding how learning processes can be optimized therefore has direct applications in the realm of educational and rehabilitative contexts. Here, we show that retrieval practice is a strategy to optimize encoding into long-term memory in both young and elderly humans. Importantly, retrieval practice was significantly reduced in the elderly and closely related to changes in alpha (9-13 Hz) and beta band (13-30 Hz) oscillations. Our findings suggest that decreased retrieval practice effects across the life span contribute to, and may reflect, age-related declines in memory performance. They further provide new insights into the underlying neural mechanisms and point toward future avenues for neuro-modulatory interventions.

Open-Book Versus Closed-Book Tests in University Classes: A Field Experiment

The present field study compared open-book testing and closed-book testing in two (parallel) introductory university courses in cognitive psychology. The critical manipulation concerned seven lessons. In these lessons, all students received two to three questions concerning the content of the respective lesson. Half the participants (open-book group) were allowed to use their notes and the course materials, which had been distributed at the beginning of each class; the other half was not allowed to use these materials (closed-book group). A surprise test conducted in the eighth week demonstrated better results for the closed-book group. Further 6 weeks later, the final module exam took place. A number of questions in this exam concerned the learning matters instructed during the critical seven lessons. Even with respect to these questions, the closed-book group performed better than the open-book group. We discuss these results with respect to two possible explanations, retrieval practice and motivational differences.

Multimedia learning trumps retrieval practice in psychology teaching

It is well established that studying with (vs. without) visual illustrations as well as taking tests (vs. restudying) is beneficial for learning, but on which strategy should one put the efforts, or should they be combined for best learning? Eighty-eight upper secondary school students were given a brief lecture presented verbally (6 classes) or with the aid of a visual illustration (visuoverbal, 6 classes). The information was processed again by taking a memory test or by restudying. Recall and transfer tests were conducted after some few minutes and again after one week. The visuoverbal lecture resulted in better learning than verbal presentation only. A significant study strategy by retention interval interaction was found. However, this interaction was not qualified by a testing effect. Hence, taking tests (retrieval practice) did not lead to better learning than restudying. It was concluded that it is worthwhile to use visual illustrations in teaching. However, the present study did not reveal any synergistic effects from the combination of visuoverbal presentation and retrieval practice.

A dual memory theory of the testing effect

A new theoretical framework for the testing effect-the finding that retrieval practice is usually more effective for learning than are other strategies-is proposed, the empirically supported tenet of which is that separate memories form as a consequence of study and test events. A simplest case quantitative model is derived from that framework for the case of cued recall. With no free parameters, that model predicts both proportion correct in the test condition and the magnitude of the testing effect across 10 experiments conducted in our laboratory, experiments that varied with respect to material type, retention interval, and performance in the restudy condition. The model also provides the first quantitative accounts of (a) the testing effect as a function of performance in the restudy condition, (b) the upper bound magnitude of the testing effect, (c) the effect of correct answer feedback, (d) the testing effect as a function of retention interval for the cases of feedback and no feedback, and (e) the effect of prior learning method on subsequent learning through testing. Candidate accounts of several other core phenomena in the literature, including test-potentiated learning, recognition versus cued recall training effects, cued versus free recall final test effects, and other select transfer effects, are also proposed. Future prospects and relations to other theories are discussed.

Testing the primary and convergent retrieval model of recall: Recall practice produces faster recall success but also faster recall failure

The primary and convergent retrieval (PCR) model assumes that the act of successful recall not only boosts associations between the item and retrieval cues but additionally strengthens associations within the item (i.e., between the features of an item), speeding the rate of information retrieval from memory. The latter effect is termed intra-item learning and is a unique benefit of recall practice (i.e., the "testing effect"). Prior work confirmed the prediction that recall practice produces faster subsequent recall than restudy practice even if accuracy is higher following restudy. The current study replicated this result, but also examined the downside of recall practice: that after a failure to recall during practice, participants will be faster in their failure to recall on a subsequent recall test. This prediction was confirmed in a multisession cued recall experiment that collected accuracy and recall latency measurements for no practice, recall practice, or restudy, with an immediate or delayed final test. The linear ballistic accumulator model was fit to latency distributions, and model comparison determined that these effects reflect differences in drift rates, as predicted by the PCR model.

The Direct Testing Effect Is Pervasive in Action Memory: Analyses of Recall Accuracy and Recall Speed

Successful retrieval from memory is a desirably difficult learning event that reduces the recall decrement of studied materials over longer delays more than restudying does. The present study was the first to test this direct testing effect for performed and read action events (e.g., "light a candle") in terms of both recall accuracy and recall speed. To this end, subjects initially encoded action phrases by either enacting them or reading them aloud (i.e., encoding type). After this initial study phase, they received two practice phases, in which the same number of action phrases were restudied or retrieval-practiced (Exp. 1-3), or not further processed (Exp. 3; i.e., practice type). This learning session was ensued by a final cued-recall test both after a short delay (2 min) and after a long delay (1 week: Exp. 1 and 2; 2 weeks: Exp. 3). To test the generality of the results, subjects retrieval practiced with either noun-cued recall of verbs (Exp. 1 and 3) or verb-cued recall of nouns (Exp. 2) during the intermediate and final tests (i.e., test type). We demonstrated direct benefits of testing on both recall accuracy and recall speed. Repeated retrieval practice, relative to repeated restudy and study-only practice, reduced the recall decrement over the long delay, and enhanced phrases' recall speed already after 2 min, and this independently of type of encoding and recall test. However, a benefit of testing on long-term retention only emerged (Exp. 3), when prolonging the recall delay from 1 to 2 weeks, and using different sets of phrases for the immediate and delayed final tests. Thus, the direct testing benefit appears to be highly generalizable even with more complex, action-oriented stimulus materials, and encoding manipulations. We discuss these results in terms of the distribution-based bifurcation model.

Metacognitive control in self-regulated learning: Conditions affecting the choice of restudying versus retrieval practice

In two experiments, learners studied word pairs one or two times and took a final cued recall test. They studied each pair upon its initial presentation and decided whether they would restudy it later, take a practice test on it later (retrieval practice), or forego all further practice with the pair. Whether learners preferred restudying or testing depended upon conditions. Regardless of whether practice tests were followed by feedback, they chose to take practice tests relatively more often when items were easy and the lag or spacing interval between the first and second occurrence was short, whereas they chose to restudy relatively more when items were hard and the lag was long. That is, they preferred testing under conditions in which successful retrieval on the practice test was likely. In Experiment 2, we varied the number of points each item was worth if recalled on the final test. A high point value led to a marked increase in both the preference for testing when the lag was short and the preference for restudying when the lag was long. Results support the hypothesis that learners appreciate at some level that retrieval practice can be a more effective learning strategy than restudying. However, they appear to believe that successful retrieval is necessary to reap the benefits of retrieval practice. As a consequence, their tendency to choose testing is influenced by conditions (item difficulty and spacing interval) that affect the likelihood of successful practice-test retrieval.

The Effect of Type of Feedback in Multiple-Choice Testing on Long-Term Retention

We investigated how different types of feedback in multiple-choice testing influence long-term retention. Participants completed an initial multiple-choice test on general-knowledge questions. Then, they were randomly placed into one of the following four conditions: feedback displaying the original question and four alternative options including the correct answer (Feedback 1); feedback displaying the original question and the correct answer (Feedback 2); feedback displaying only the correct answer (Feedback 3); and no feedback (Control). On the final test two days later, participants in the feedback conditions showed improved retention-even participants who received Feedback 3 outperformed the control group, regardless of whether feedback followed correct or incorrect responses. There was no difference between the feedback conditions when feedback followed correct responses, but Feedback 1 was superior to Feedback 3 when feedback followed incorrect responses. The function of feedback in multiple-choice testing is to maintain correct responses and to correct erroneous responses.

The two processes underlying the testing effect- Evidence from Event-Related Potentials (ERPs)

Theoretical explanations of the testing effect (why people learn better from a test than a re-study) have largely focused on either the benefit of attempting to retrieve the answer or on the benefit of re-encoding the queried information after a successful retrieval. While a less parsimonious account, prior neuroimaging evidence has led us to postulate that both of these processes contribute to the benefit of testing over re-study. To provide further empirical support for our position, we recorded ERPs while subjects attempted to recall the second word of a pair when cued with the first. These ERPs were analyzed based on the current response accuracy and as a function of accuracy on the subsequent test, yielding three groups: the first and second tests were correct, the first was correct and the second was not, both were incorrect. Mean amplitude waveforms during the first test showed different patterns depending on the outcome patterns: Between 400 and 700 ms the amplitudes were most positive when both tests were correct and least positive when both were incorrect; mean amplitudes between 700 and 1000 ms only differed as a function of subsequent memory. They were more positive when the second test was correct. Importantly, the later component only predicted subsequent memory when the answers were not overlearned, i.e. only correctly recalled once previously. We interpret the 400-700 ms time window as a component reflecting a retrieval attempt process, which differs as a function of both current and subsequent accuracy, and the later time window as a component reflecting a re-encoding process, which only involves learning from tests, both of which are involved in the testing effect.

The effect of recall, reproduction, and restudy on word learning: a pre-registered study

Background

Certain manipulations, such as testing oneself on newly learned word associations (recall), or the act of repeating a word during training (reproduction), can lead to better learning and retention relative to simply providing more exposure to the word (restudy). Such benefit has been observed for written words. Here, we test how these training manipulations affect learning of words presented aurally, when participants are required to produce these novel phonological forms in a recall task.

Methods

Participants (36 English-speaking adults) learned 27 pseudowords, which were paired with 27 unfamiliar pictures. They were given cued recall practice for 9 of the words, reproduction practice for another set of 9 words, and the remaining 9 words were restudied. Participants were tested on their recognition (3-alternative forced choice) and recall (saying the pseudoword in response to a picture) of these items immediately after training, and a week after training. Our hypotheses were that reproduction and restudy practice would lead to better learning immediately after training, but that cued recall practice would lead to better retention in the long term.

Results

In all three conditions, recognition performance was extremely high immediately after training, and a week following training, indicating that participants had acquired associations between the novel pictures and novel words. In addition, recognition and cued recall performance was better immediately after training relative to a week later, confirming that participants forgot some words over time. However, results in the cued recall task did not support our hypotheses. Immediately after training, participants showed an advantage for cued Recall over the Restudy condition, but not over the Reproduce condition. Furthermore, there was no boost for the cued Recall condition over time relative to the other two conditions. Results from a Bayesian analysis also supported this null finding. Nonetheless, we found a clear effect of word length, with shorter words being better learned than longer words, indicating that our method was sufficiently sensitive to detect an impact of condition on learning.

Conclusions

Our primary hypothesis about training conditions conferring specific advantages for production of novel words presented aurally, especially over long intervals, was not supported by this data. Although there may be practical reasons for preferring a particular method for training expressive vocabulary, no difference in effectiveness was detected when presenting words aurally: reproducing, recalling or restudying a word led to the same production accuracy.

Retrieval Practice Fails to Insulate Episodic Memories against Interference after Stroke

Recent work in cognitive psychology showed that retrieval practice of previously studied information can insulate this information against retroactive interference from subsequently studied other information in healthy individuals. The present study examined whether this beneficial effect of interference reduction is also present in patients with stroke. Twenty-two patients with stroke, 4.6 months post injury on average, and 22 healthy controls participated in the experiment. In each of two experimental sessions, participants first studied a list of items (list 1) and then underwent a practice phase in which the list 1 items were either restudied or retrieval practiced. Participants then either studied a second list of items (list 2) or fulfilled an unrelated distractor task. Recall of the two lists’ items was assessed in a final criterion test. Results showed that, in healthy controls, additional study of list 2 items impaired final recall of list 1 items in the restudy condition but not in the retrieval practice condition. In contrast, in patients with stroke, list 2 learning impaired final list 1 recall in both conditions. The results indicate that retrieval practice insulated the tested information against retroactive interference in healthy controls, but failed to do so in patients with stroke. Possible implications of the findings for the understanding of long-term memory impairment after stroke are discussed.

Rethinking the Use of Tests: A Meta-Analysis of Practice Testing

The testing effect is a well-known concept referring to gains in learning and retention that can occur when students take a practice test on studied material before taking a final test on the same material. Research demonstrates that students who take practice tests often outperform students in nontesting learning conditions such as restudying, practice, filler activities, or no presentation of the material. However, evidence-based meta-analysis is needed to develop a comprehensive understanding of the conditions under which practice tests enhance or inhibit learning. This meta-analysis fills this gap by examining the effects of practice tests versus nontesting learning conditions. Results reveal that practice tests are more beneficial for learning than restudying and all other comparison conditions. Mean effect sizes were moderated by the features of practice tests, participant and study characteristics, outcome constructs, and methodological features of the studies. Findings may guide the use of practice tests to advance student learning, and inform students, teachers, researchers, and policymakers. This article concludes with the theoretical and practical implications of the meta-analysis.

Repeated recall as an intervention to improve memory performance in heart failure patients

Background:

Up to 50% of heart failure patients demonstrate aspects of cognitive impairment, including memory deficit. Novel interventions are needed to address memory deficit among heart failure patients.

Aim:

The goal of this study was to evaluate the testing effect as an intervention to improve memory performance in heart failure patients.

Methods:

This was a randomized controlled clinical trial ( N=84) comparing the memory performance of heart failure patients with and without mild cognitive impairment after a repeated testing intervention. Memory performance was measured by verbal word pair associates recall scores, between attention control and experimental subjects.

Results:

Patients had a mean age of 71.7 ± 13.3 years and similar baseline memory (immediate p=.79 and delayed p=.47). Overall, there were no significant differences in memory between experimental and control subjects, respectively (67.2±18.87 vs. 61.9±22.3, verbal word pair associates, t = −1.179, p=.24). In the final hierarchical regression model, age ( p=.018) and education ( p=.006) were significant predictors of memory performance, with the intervention approaching significance ( p=.079).

Conclusions:

Although not statistically significant, the intervention group reported better memory. Age and education continue to be significant contributors to memory performance in the heart failure population. Continued development of interventions to improve memory performance in heart failure patients is indicated.

Reversing the testing effect by feedback: Behavioral and electrophysiological evidence

The testing effect refers to the finding that retrieval practice of previously studied information enhances its long-term retention more than restudy practice does. Recent work showed that the testing effect can be dramatically reversed when feedback is provided to participants during final recall testing (Storm, Friedman, Murayama, & Bjork, 2014). Following this prior work, in this study, we examined the reversal of the testing effect by investigating oscillatory brain activity during final recall testing. Twenty-six healthy participants learned cue-target word pairs and underwent a practice phase in which half of the items were retrieval practiced and half were restudy practiced. Two days later, two cued recall tests were administered, and immediate feedback was provided to participants in Test 1. Behavioral results replicated the prior work by showing a testing effect in Test 1, but a reversed testing effect in Test 2. Extending the prior work, EEG results revealed a feedback-related effect in alpha/lower-beta and retrieval-related effects in slow and fast theta power, with practice condition modulating the fast theta power effect for items that were not recalled in Test 1. The results indicate that the reversed testing effect can arise without differential strengthening of restudied and retrieval-practiced items via feedback learning. Theoretical implications of the findings, in particular with respect to the distribution-based bifurcation model of testing effects (Kornell, Bjork, & Garcia, 2011), are discussed.

Testing enhances both encoding and retrieval for both tested and untested items

In forward testing effects, taking a test enhances memory for subsequently studied material. These effects have been observed for previously studied and tested items, a potentially item-specific testing effect, and newly studied untested items, a purely generalized testing effect. We directly compared item-specific and generalized forward testing effects using procedures to separate testing benefits due to encoding versus retrieval. Participants studied two lists of Swahili-English word pairs, with the second study list containing "new" pairs intermixed with the previously studied "old" pairs. Participants completed a review phase in which they took a cued-recall test on only the "old" pairs or restudied them. In Experiments 1a, 1b, and 2, the review phase was given either before or after the second study list. Testing benefited memory to the same degree for both "new" and "old" pairs, suggesting that there were no pair-specific benefits of testing. The larger benefit from testing when review was given before rather than after the second study list suggests that the memory enhancement was due to both testing-enhanced encoding and testing-enhanced retrieval. To better equate generalized testing effects for "new" and "old" pairs, Experiment 3 intermixed them in the review phase. A statistically significant pair-specific testing effect for "old" items was now observed. Overall, these results show that forward testing effects are due to both testing-enhanced encoding and retrieval effects and that direct, pair-specific forward testing benefits are considerably smaller than indirect, generalized forward testing benefits.

Recovering and preventing loss of detailed memory: differential rates of forgetting for detail types in episodic memory

Episodic memories undergo qualitative changes with time, but little is known about how different aspects of memory are affected. Different types of information in a memory, such as perceptual detail, and central themes, may be lost at different rates. In patients with medial temporal lobe damage, memory for perceptual details is severely impaired, while memory for central details is relatively spared. Given the sensitivity of memory to loss of details, the present study sought to investigate factors that mediate the forgetting of different types of information from naturalistic episodic memories in young healthy adults. The study investigated (1) time-dependent loss of “central” and “peripheral” details from episodic memories, (2) the effectiveness of cuing with reminders to reinstate memory details, and (3) the role of retrieval in preventing forgetting. Over the course of 7 d, memory for naturalistic events (film clips) underwent a time-dependent loss of peripheral details, while memory for central details (the core or gist of events) showed significantly less loss. Giving brief reminders of the clips just before retrieval reinstated memory for peripheral details, suggesting that loss of details is not always permanent, and may reflect both a storage and retrieval deficit. Furthermore, retrieving a memory shortly after it was encoded prevented loss of both central and peripheral details, thereby promoting retention over time. We consider the implications of these results for behavioral and neurobiological models of retention and forgetting.

Is retrieval the key? Metamemory judgment and testing as learning strategies

Re-reading is the most common learning strategy, albeit not a very efficient one. Testing is highly efficient, but not perceived by students as a learning strategy. Prospective judgment-of-learning (JOL) reflect the learner's impression of subsequently being able to retrieve the ongoing learning in a cued-recall task. Estimating JOL involves attempting to retrieve the information, as in testing. The few studies that have explored the potential mnemonic benefit of JOL have yielded contradictory results. Our aim was to compare JOL and testing with re-study and to examine the impact of these strategies according to the relative difficulty of the material (cue-target association strength) in two experiments. After a first encoding phase, participants re-studied, provided JOL, or took a test. Forty-eight hours later, they participated in a final cued-recall test, during which their confidence level judgments were collected. The main result was that delayed JOL behaved in the same way as testing, and both yielded better performances than re-study when material was of moderate difficulty. The easy or very difficult material revealed no differences between these strategies. JOL is proposed as an alternative to testing when faced with difficult material.