Electrophysiological evidence for the modulation of retrieval orientation by depth of study processing

Memory orientation and success: separable neurocognitive components underlying episodic recognition

Episodic recognition can be based on recollection of contextual details, on a sense of recent encounter, or some combination of the two. According to several cognitive models, selectively attending to these distinct aspects of memory may require different retrieval orientations and result in different neural responses depending upon whether or not retrieval is successful. Using event-related fMRI, we examined retrieval orientation by having subjects discriminate between two test words in one of two manners. During source recollection, they selected the member of the pair previously associated with a particular encoding task. In contrast, recency judgment required selection of the most recently encountered item of the pair, regardless of how it had been encoded. Furthermore, successful and unsuccessful trials within each retrieval task were contrasted to determine whether retrieval success effects occurred in overlapping or dissimilar neural populations compared to those associated with each retrieval orientation. The results revealed distinct lateral prefrontal and parietal activations that distinguished attempted source recollection from judgments of relative recency; these orientation effects were largely independent of retrieval success. In contrast, medial temporal lobe structures (hippocampus and parahippocampal gyrus) were differentially more active during successful recollection of encoding context, showing similar reduced responses during failed source recollection and judgments of recency. These results indicate that different memory orientations recruit distinct prefrontal and parietal networks and that the recovery of episodic context is associated with the hippocampus and surrounding medial temporal cortices.

Using ERPs to dissociate recollection from familiarity in picture recognition

Dual process theories posit that separate recollection and familiarity processes contribute to recognition memory. Previous research, testing recognition memory for words, indicates that event-related brain potentials (ERPs) can be used to dissociate recollection from familiarity. It has been hypothesized that the FN400 ERP old/new effect (300-500 ms) varies with stimulus familiarity, but the parietal ERP old/new effect (400-800 ms) varies with recollection. The results reported here are consistent with this hypothesis, extending it to the recognition of pictures when subjects had to discriminate between studied pictures, highly familiar lures (mirror-reversals of studied pictures), and new pictures. Furthermore, the parietal old/new effect showed significant recollection-related differences only for subjects with good behavioral discrimination between studied items and similar lures.

The effect of specific test queries on source-monitoring event-related potentials

Source-monitoring decision processes were manipulated during retrieval while event-related potentials (ERPs) were recorded. Words were either seen or heard at study, and memory for modality was measured on two separate yes-no source tests. Decision processes were varied across the two tests by asking participants to respond to leading questions. One leading question asked if the items were seen at study, whereas the second question asked if the items were heard at study (cf., Marsh & Hicks, 1998). Behavioral responses indicated that leading questions altered the way in which memory was evaluated to determine the source of information. Varying the decision processes affected frontal--but not parietal ERPs--indicating that frontal ERPs reflect processing that is used to evaluate activated information. Furthermore, left and right frontal ERP activity was affected by the combination of test query and type of source supporting the hypothesis that both the right and left frontal lobes contribute to memory retrieval processes. The pattern of frontal ERP effects supports the hypothesis that activation in right frontal areas reflect basic decision processes that are used to determine source and that the left frontal lobes are recruited when more systematic processing is required by the test context (cf., Nolde, Johnson, & Raye, 1998b).

Event-related potentials reveal processing differences in honest vs malingered memory performance

Twenty-two undergraduate students completed a recognition memory test while event-related potentials (ERPs) were recorded. During the testing phase, subjects distinguished old from new words in a forced-choice format. There were two counterbalanced within-subject conditions, one in which subjects performed to the best of their abilities, and another with instructions to feign memory impairment. Test scores and response latencies differed significantly between the two conditions. Analysis of PCA-defined epochs revealed that old words were more positive than new in the control condition, with this difference confined to frontal regions and interpreted as reflecting familiarity-based recognition judgements. In the malingering task, this old/new word difference emerged earlier and was broadly distributed across the scalp. A discriminant function analysis using reaction time and ERP measures resulted in 82% correct classification of honest and simulated performance, with 79% correct on cross-validation.

Electrophysiological dissociation of retrieval orientation and retrieval effort

The neural correlates of retrieval orientation-the differential processing of retrieval cues according to the form of the sought-for information-and retrieval effort were investigated in a factorial design. ERPs elicited by test words were recorded during four recognition memory tests. Orientation was manipulated by varying study material: The study phases preceding two of the tests employed pictures, whereas the study phases preceding the other two tests employed words. Effort was manipulated by varying difficulty, using a combination of the variables of length of study list and study-test interval. ERPs elicited by correctly classified new test words were sensitive to both the study material and, to a much lesser extent, the difficulty of manipulations. Whereas difficulty effects onset early and were short-lived, the effects of study material onset later, extended for several hundred milliseconds, and did not vary according to difficulty. It was concluded that retrieval orientation exerts a major influence on the processing of recognition memory test items.

The neural basis of episodic memory: evidence from functional neuroimaging

We review some of our recent research using functional neuroimaging to investigate neural activity supporting the encoding and retrieval of episodic memories, that is, memories for unique events. Findings from studies of encoding indicate that, at the cortical level, the regions responsible for the effective encoding of a stimulus event as an episodic memory include some of the regions that are also engaged to process the event 'online'. Thus, it appears that there is no single cortical site or circuit responsible for episodic encoding. The results of retrieval studies indicate that successful recollection of episodic information is associated with activation of lateral parietal cortex, along with more variable patterns of activity in dorsolateral and anterior prefrontal cortex. Whereas parietal regions may play a part in the representation of retrieved information, prefrontal areas appear to support processes that act on the products of retrieval to align behaviour with the demands of the retrieval task.

Switching languages, switching palabras (words): an electrophysiological study of code switching

Switching languages has often been associated with a processing cost. In this study, the authors used event-related potentials to compare switches between two languages with within-language lexical switches as bilinguals read for comprehension. Stimuli included English sentences and idioms ending either with the expected English words, their Spanish translations (code switches), or English synonyms (lexical switches). As expected, lexical switches specifically enhanced the N400 response in both context types. Code switches, by contrast, elicited an increased negativity over left fronto-central sites in the regular nonidiomatic sentences (250-450 ms) and a large posterior positivity (450-850 ms) in both context types. In addition, both lexical and code switches elicited a late frontal positivity (650-850 ms) relative to expected completions, especially in idioms. Analysis of the individual response patterns showed correlations with vocabulary skills in English and in Spanish. Overall, the electrophysiological data suggest that for some speakers in some contexts, the processing of a code switch may actually be less costly than the processing of an unexpected within-language item.

Task-switching and memory retrieval processing: electrophysiological evidence

Participants attempted to retrieve phonological or imagery-based information under conditions where either the two kinds of retrieval were required in separate blocks, or where frequent switches between retrieval tasks were required within blocks. Electrophysiological indices of processes engaged in pursuit of accurate memory judgments, elicited by contrasting ERPs evoked by correctly identified new test items, differed according to retrieval task only when the tasks were completed in separate blocks. The principal conclusion suggested by these findings is that the requirement to alternate frequently between the two retrieval tasks attenuated the engagement of task-specific processes that form part of a retrieval attempt.

Levels of word processing and incidental memory: dissociable mechanisms in the temporal lobe

Word recall is facilitated when deep (e.g. semantic) processing is applied during encoding. This fact raises the question of the existence of specific brain mechanisms supporting different levels of information processing that can modulate incidental memory performance. In this study we obtained spatiotemporal brain activation profiles, using magnetic source imaging, from 10 adult volunteers as they performed a shallow (phonological) processing task and a deep (semantic) processing task. When phonological analysis of the word stimuli into their constituent phonemes was required, activation was largely restricted to the posterior portion of the left superior temporal gyrus (area 22). Conversely, when access to lexical/semantic representations was required, activation was found predominantly in the left middle temporal gyrus and medial temporal cortex. The differential engagement of each mechanism during word encoding was associated with dramatic changes in subsequent incidental memory performance.

Event-related functional imaging and episodic memory

Electrical and haemodynamic measures of neural activity can be time-locked to an event-of-interest, such as the presentation of a stimulus or a behavioural response. Both of these measures can be employed in studies where the aim is to elucidate the relationship between neural activity and cognitive processes. This review highlights a number of considerations that arise when these techniques are employed in pursuit of this goal, with a particular emphasis on functional imaging studies of retrieval from episodic memory. The review includes: a discussion of some limitations that each technique imposes at the stage of experimental design, consideration of the relative strengths and weaknesses of each technique, a commentary on assumptions that are common to both, and a brief review of the ways in which these techniques can be extended in order to index two distinct classes of cognitive operations that have correspondingly distinct neural signatures.

Recognition memory for emotionally negative and neutral words: an ERP study

Scalp recorded event-related potentials were used to investigate the neural activity elicited by emotionally negative and emotionally neutral words during the performance of a recognition memory task. Behaviourally, the principal difference between the two word classes was that the false alarm rate for negative items was approximately double that for the neutral words. Correct recognition of neutral words was associated with three topographically distinct ERP memory 'old/new' effects: an early, bilateral, frontal effect which is hypothesised to reflect familiarity-driven recognition memory; a subsequent left parietally distributed effect thought to reflect recollection of the prior study episode; and a late onsetting, right-frontally distributed effect held to be a reflection of post-retrieval monitoring. The old/new effects elicited by negative words were qualitatively indistinguishable from those elicited by neutral items and, in the case of the early frontal effect, of equivalent magnitude also. However, the left parietal effect for negative words was smaller in magnitude and shorter in duration than that elicited by neutral words, whereas the right frontal effect was not evident in the ERPs to negative items. These differences between neutral and negative words in the magnitude of the left parietal and right frontal effects were largely attributable to the increased positivity of the ERPs elicited by new negative items relative to the new neutral items. Together, the behavioural and ERP findings add weight to the view that emotionally valenced words influence recognition memory primarily by virtue of their high levels of 'semantic cohesion', which leads to a tendency for 'false recollection' of unstudied items.

Confidence in recognition memory for words: dissociating right prefrontal roles in episodic retrieval

We used event-related functional magnetic resonance imaging (efMRI) to investigate brain regions showing differential responses as a function of confidence in an episodic word recognition task. Twelve healthy volunteers indicated whether their old-new judgments were made with high or low confidence. Hemodynamic responses associated with each judgment were modeled with an "early" and a "late" response function. As predicted by the monitoring hypothesis generated from a previous recognition study [Henson, R. N. A., Rugg, M. D., Shallice, T., Josephs, O., & Dolan, R. J. (1999a). Recollection and familiarity in recognition memory: An event-related fMRI study. Journal of Neuroscience, 19, 3962-3972], a right dorsolateral prefrontal region showed a greater response to correct low- versus correct high-confidence judgements. Several regions, including the precuneus, posterior cingulate, and left lateral parietal cortex, showed greater responses to correct old than correct new judgements. The anterior left and right prefrontal regions also showed an old-new difference, but for these regions the difference emerged relatively later in time. These results further support the proposal that different subregions of the prefrontal cortex subserve different functions during episodic retrieval. These functions are discussed in relation to a monitoring process, which operates when familiarity levels are close to response criterion and is associated with nonconfident judgements, and a recollective process, which is associated with the confident recognition of old words.

Retrieval processing and episodic memory

The emergence of brain imaging has had a major impact on research into the cognitive and neural bases of human memory. An area in which this impact has been particularly strong is retrieval processing - the processes engaged when attempting to retrieve information during a memory test. Several different classes of retrieval process - such as 'mode', 'effort' and 'success' - have been invoked to account for findings from neuroimaging studies of episodic retrieval. In this article we discuss how these different kinds of process, along with a fourth kind associated with 'retrieval orientation', can be investigated in brain imaging experiments. We then review studies of retrieval processing, and assess how well their designs match up to our proposed criteria for dissociating the neural correlates of different classes of retrieval process. We conclude that few studies have used designs that permit these different kinds of process to be independently identified, and that presently there is little evidence to indicate which kinds of processing can be fractionated in terms of their neural correlates.