Semantic and perceptual effects on recognition memory: evidence from ERP

A meta-analysis of event-related potential correlates of recognition memory

A longstanding question in memory research is whether recognition is supported by more than one mnemonic process. Dual-process models distinguish recollection of episodic detail from familiarity, while single-process models explain recognition in terms of one process that varies in strength. Dual process models have drawn support from findings that recollection and familiarity elicit distinct electroencephalographic event-related potentials (ERPs): a mid-frontal ERP effect that occurs at around 300-500 ms post-stimulus onset and is often larger for familiarity than recollection contrasts, and a parietal ERP effect that occurs at around 500-800 ms and is larger for recollection than familiarity contrasts. We sought to adjudicate between dual- and single-process models by investigating whether the dissociation between these two ERP effects is reliable over studies. We extracted effect sizes from 41 experiments that had used Remember-Know, source memory, and associative memory paradigms (1,000 participants). Meta-analysis revealed a strong interaction between ERP effect and mnemonic process of the form predicted by dual-process models. Although neither ERP effect was significantly process-selective taken alone, a moderator analysis revealed a larger mid-frontal effect for familiarity than recollection contrasts in studies using the Remember-Know paradigm. Mega-analysis of raw data from six studies further showed significant process-selectivity for both mid-frontal and parietal ERPs in the predicted time windows. On balance, the findings favor dual- over single-process theories of recognition memory, but point to a need to promote sharing of raw data.

EEG Correlates of Old/New Discrimination Performance Involving Abstract Figures and Non-Words

The processing of pre-experimentally unfamiliar stimuli such as abstract figures and non-words is poorly understood. Here, we considered the role of memory strength in the discrimination process of such stimuli using a three-phase old/new recognition memory paradigm. Memory strength was manipulated as a function of the levels of processing (deep vs. shallow) and repetition. Behavioral results were matched to brain responses using EEG. We found that correct identification of the new abstract figures and non-words was superior to old item recognition when they were merely studied without repetition, but not when they were semantically processed or drawn. EEG results indicated that successful new item identification was marked by a combination of the absence of familiarity (N400) and recollection (P600) for the studied figures. For both the abstract figures and the non-words, the parietal P600 was found to differentiate between the old and new items (late old/new effects). The present study extends current knowledge on the processing of pre-experimentally unfamiliar figurative and verbal stimuli by showing that their discrimination depends on experimentally induced memory strength and that the underlying brain processes differ. Nevertheless, the P600, similar to pre-experimentally familiar figures and words, likely reflects improved recognition memory of meaningless pictorial and verbal items.

Interactions of Emotion and Self-reference in Source Memory: An ERP Study

The way emotional information is encoded (e.g., deciding whether it is self-related or not) has been found to affect source memory. However, few studies have addressed how the emotional quality and self-referential properties of a stimulus interactively modulate brain responses during stimulus encoding and source memory recognition. In the current study, 22 participants completed five study-test cycles with negative, neutral, and positive words encoded in self-referential versus non-self-referential conditions, while event-related potentials of the electroencephalogram were recorded. An advantage of self-referential processing in source memory performance, reflected in increased recognition accuracy, was shown for neutral and positive words. At the electrophysiological level, self-referential words elicited increased amplitudes in later processing stages during encoding (700-1,200 ms) and were associated with the emergence of old/new effects in the 300-500 ms latency window linked to familiarity effects. In the 500-800 ms latency window, old/new effects emerged for all valence conditions except for negative words studied in the non-self-referential condition. Negative self-referential words also elicited a greater mobilization of post-retrieval monitoring processes, reflected in an enhanced mean amplitude in the 800-1,200 ms latency window. Together, the current findings suggest that valence and self-reference interactively modulate source memory. Specifically, negative self-related information is more likely to interfere with the recollection of source memory features.

Early Visual Processing and Perception Processes in Object Discrimination Learning

A brief image presentation is sufficient to discriminate and individuate objects of expertise. Although perceptual expertise is acquired through extensive practice that increases the resolution of representations and reduces the latency of image decoding and coarse and fine information extraction, it is not known how the stages of visual processing impact object discrimination learning (ODL). Here, we compared object discrimination with brief (100 ms) and long (1,000 ms) perceptual encoding times to test if the early and late visual processes are required for ODL. Moreover, we evaluated whether encoding time and discrimination practice shape perception and recognition memory processes during ODL. During practice of a sequential matching task with initially unfamiliar complex stimuli, we find greater discrimination with greater encoding times regardless of the extent of practice, suggesting that the fine information extraction during late visual processing is necessary for discrimination. Interestingly, the overall discrimination learning was similar for brief and long stimuli, suggesting that early stages of visual processing are sufficient for ODL. In addition, discrimination practice enhances perceive and know for brief and long stimuli and both processes are associated with performance, suggesting that early stage information extraction is sufficient for modulating the perceptual processes, likely reflecting an increase in the resolution of the representations and an early availability of information. Conversely, practice elicited an increase of familiarity which was not associated with discrimination sensitivity, revealing the acquisition of a general recognition memory. Finally, the recall is likely enhanced by practice and is associated with discrimination sensitivity for long encoding times, suggesting the engagement of recognition memory in a practice independent manner. These findings contribute to unveiling the function of early stages of visual processing in ODL, and provide evidence on the modulation of the perception and recognition memory processes during discrimination practice and its relationship with ODL and perceptual expertise acquisition.

Reward anticipation selectively boosts encoding of gist for visual objects

Reward anticipation at encoding enhances later recognition, but it is unknown to what extent different levels of processing at encoding (gist vs. detail) can benefit from reward-related memory enhancement. In the current study, participants (N = 50) performed an incidental encoding task in which they made gist-related or detail-related judgments about pairs of visual objects while in anticipation of high or low reward. Results of a subsequent old/new recognition test revealed a reward-related memory benefit that was specific to objects from pairs encoded in the attention-to-gist condition. These findings are consistent with the theory of long-axis specialization along the human hippocampus, which localizes gist-based memory processes to the anterior hippocampus, a region highly interconnected with the dopaminergic reward network.

An ERP investigation of item-scene incongruity at encoding on subsequent recognition

The aim of the present study was to investigate how item-scene incongruity at encoding influences subsequent item recognition and the associated event-related potential (ERP) old/new effects. Participants (N = 26) studied pictures showing an item in a scene, either in a congruent condition (e.g., a tent in a field) or an incongruent condition (e.g., a shower cabin in a field). Items were presented alone at test. Behavioral data revealed a benefit of incongruent information, with greater source memory performance but no significant effect on old/new recognition judgments. Longer response times for old compared to new items showed that participants not only evaluated the old-new status of objects during recognition, but also worked already on the scene context decision relative to the source memory judgment. An ERP incongruity effect was found at study, with greater N400 amplitude in the incongruent condition than the congruent condition. During recognition, the results provide evidence that item-scene incongruity at study increases the amplitude of ERP old/new effects. A mid-frontal N400 old/new effect was found in the early time window (300-500 ms), and a right frontal sub-component was modulated by item-scene incongruity at encoding. The modulation observed in the later time window (500-800 ms) confirmed previous studies showing that the parietal old/new effect reflects the retrieval of episodic contextual details. The present study shows that the magnitude of ERP old/new effects is sensitive to item-scene incongruity at encoding from the early time window in the right frontal region to the later retrieval processes.

Assessment of Aesthetic Preferences in Relation to Vegetation-Created Enclosure in Chinese Urban Parks: A Case Study of Shenzhen Litchi Park

Building on the mystery/complexity/legibility/coherence model of Kaplan and Kaplan (1989) and up-to-date landscape visualization techniques, this paper presents a case study analyzing people’s aesthetic preferences for scenes with varying levels of enclosure created through vegetation. Participants were asked to view 48 computer-generated urban park scenes with different levels of enclosure and to rate them for three aesthetic preference factors: coherence, complexity, and legibility. The results are as follows: (1) If the visual and/or physical setting is enclosed, participants will give lower ratings for legibility than in open scenes. (2) Physically open scenes are rated as more coherent than physically enclosed scenes. (3) Participants rate complexity for physically enclosed scenes lower than for physically open scenes. It is concluded that enclosure as a predictor variable for landscape preference has a practical significance for future urban landscape research and designs.

Evidence that neural information flow is reversed between object perception and object reconstruction from memory

Remembering is a reconstructive process, yet little is known about how the reconstruction of a memory unfolds in time in the human brain. Here, we used reaction times and EEG time-series decoding to test the hypothesis that the information flow is reversed when an event is reconstructed from memory, compared to when the same event is initially being perceived. Across three experiments, we found highly consistent evidence supporting such a reversed stream. When seeing an object, low-level perceptual features were discriminated faster behaviourally, and could be decoded from brain activity earlier, than high-level conceptual features. This pattern reversed during associative memory recall, with reaction times and brain activity patterns now indicating that conceptual information was reconstructed more rapidly than perceptual details. Our findings support a neurobiologically plausible model of human memory, suggesting that memory retrieval is a hierarchical, multi-layered process that prioritises semantically meaningful information over perceptual details.

MAO-A Phenotype Effects Response Sensitivity and the Parietal Old/New Effect during Recognition Memory

A critical problem for developing personalized treatment plans for cognitive disruptions is the lack of understanding how individual differences influence cognition. Recognition memory is one cognitive ability that varies from person to person and that variation may be related to different genetic phenotypes. One gene that may impact recognition memory is the monoamine oxidase A gene (MAO-A), which influences the transcription rate of MAO-A. Examination of how MAO-A phenotypes impact behavioral and event-related potentials (ERPs) correlates of recognition memory may help explain individual differences in recognition memory performance. Therefore, the current study uses electroencephalography (EEG) in combination with genetic phenotyping of the MAO-A gene to determine how well-characterized ERP components of recognition memory, the early frontal old/new effect, left parietal old/new effect, late frontal old/new effect, and the late posterior negativity (LPN) are impacted by MAO-A phenotype during item and source memory. Our results show that individuals with the MAO-A phenotype leading to increased transcription have lower response sensitivity during both item and source memory. Additionally, during item memory the left parietal old/new effect is not present due to increased ERP amplitude for correct rejections. The results suggest that MAO-A phenotype changes EEG correlates of recognition memory and influences how well individuals differentiate between old and new items.

An Event Related Potentials Study of Semantic Coherence Effect during Episodic Encoding in Schizophrenia Patients

The objective of this electrophysiological study was to investigate the processing of semantic coherence during encoding in relation to episodic memory processes promoted at test, in schizophrenia patients, by using the N400 paradigm. Eighteen schizophrenia patients and 15 healthy participants undertook a recognition memory task. The stimuli consisted of pairs of words either semantically related or unrelated to a given category name (context). During encoding, both groups exhibited an N400 external semantic coherence effect. Healthy controls also showed an N400 internal semantic coherence effect, but this effect was not present in patients. At test, related stimuli were accompanied by an FN400 old/new effect in both groups and by a parietal old/new effect in the control group alone. In the patient group, external semantic coherence effect was associated with FN400, while, in the control group, it was correlated to the parietal old/new effect. Our results indicate that schizophrenia patients can process the contextual information at encoding to enhance familiarity process for related stimuli at test. Therefore, cognitive rehabilitation therapies targeting the implementation of semantic encoding strategies can mobilize familiarity which in turn can overcome the recollection deficit, promoting successful episodic memory performance in schizophrenia patients.

Format change and semantic relatedness effects on the ERP correlates of recognition: old pairs, new pairs, different stories

In this event-related potential (ERP) study, we investigated the effects of format change and semantic relatedness in a recognition task using pairs composed of a word and a line drawing. The semantic relatedness of the pairs (related: rabbit-carrot; unrelated: duck-artichoke) influenced their associative properties and corresponding distinctiveness, while format change refers to the switching of an item from the verbal form to the line drawing form between study and recognition (e.g., the word "egg" is associated with a drawing of a hen at study, and a line drawing of an egg is associated with the word "hen" at test). Study-test format change thus prevents visual matching while maintaining conceptual matching. While the N300 potential was only modulated by the semantic relatedness of the pair, both factors modulated recognition performance and corresponding ERP old/new effects with larger mid-frontal N400 old/new effect (300-500 ms) and larger parietal old/new effect (500-800 ms) in the same compared to the different-format condition, as well as for related compared to unrelated pairs. Furthermore, the semantic relatedness of correctly recognized old pairs modulated the anterior N400 while it modulated the posterior N400 for correctly rejected pairs. These results suggest that semantic relatedness and familiarity related to the amount of change between study and test present distinct ERP signatures in the N400 window. They suggest also that the distinctiveness and the ease of the retrieval of the pair could be determining for the parietal old/new effect.

Can color changes alter the neural correlates of recognition memory? Manipulation of processing affects an electrophysiological indicator of conceptual implicit memory

It has been widely shown that recognition memory includes two distinct retrieval processes: familiarity and recollection. Many studies have shown that recognition memory can be facilitated when there is a perceptual match between the studied and the tested items. Most event-related potential studies have explored the perceptual match effect on familiarity on the basis of the hypothesis that the specific event-related potential component associated with familiarity is the FN400 (300-500 ms mid-frontal effect). However, it is currently unclear whether the FN400 indexes familiarity or conceptual implicit memory. In addition, on the basis of the findings of a previous study, the so-called perceptual manipulations in previous studies may also involve some conceptual alterations. Therefore, we sought to determine the influence of perceptual manipulation by color changes on recognition memory when the perceptual or the conceptual processes were emphasized. Specifically, different instructions (perceptually or conceptually oriented) were provided to the participants. The results showed that color changes may significantly affect overall recognition memory behaviorally and that congruent items were recognized with a higher accuracy rate than incongruent items in both tasks, but no corresponding neural changes were found. Despite the evident familiarity shown in the two tasks (the behavioral performance of recognition memory was much higher than at the chance level), the FN400 effect was found in conceptually oriented tasks, but not perceptually oriented tasks. It is thus highly interesting that the FN400 effect was not induced, although color manipulation of recognition memory was behaviorally shown, as seen in previous studies. Our findings of the FN400 effect for the conceptual but not perceptual condition support the explanation that the FN400 effect indexes conceptual implicit memory.

FN400 and LPC memory effects for concrete and abstract words

According to dual-process models, recognition memory depends on two neurocognitive mechanisms: familiarity, which has been linked to the frontal N400 (FN400) effect in studies using ERPs, and recollection, which is reflected by changes in the late positive complex (LPC). Recently, there has been some debate over the relationship between FN400 familiarity effects and N400 semantic effects. According to one view, these effects are one and the same. Proponents of this view have suggested that the frontal distribution of the FN400 could be due to stimulus concreteness: recognition memory experiments commonly use highly imageable or concrete words (or pictures), which elicit semantic ERPs with a frontal distribution. In the present study, we tested this claim using a recognition memory paradigm in which subjects memorized concrete and abstract nouns; half of the words changed font color between study and test. FN400 and LPC old/new effects were observed for abstract as well as concrete words, and were stronger over right hemisphere electrodes for concrete words. However, there was no difference in anteriority of the FN400 effect for the two word types. These findings challenge the notion that the frontal distribution of the FN400 old/new effect is fully explained by stimulus concreteness.

Hitting the reset button: An ERP investigation of memory for temporal context

This study explored how temporal context influences recognition. In an ERP experiment, subjects were asked to judge whether pictures, presented one at a time, had been seen since the previous appearance of a special reset screen. The reset screen separated sequences of successively presented stimuli and signaled a change in temporal context. A "new-repeat" picture was one that had been seen before but was to be called "new" because it had not appeared since the previous reset screen. New-repeat pictures elicited a more negative FN400 component than did "old" pictures even though both had seen before during the experiment. This suggests that familiarity, as indexed by the FN400, is sensitive to temporal context. An earlier frontopolar old/new effect distinguished pictures that were seen for the first time in the experiment from all other pictures. The late positive component (LPC), which is typically greater for old stimuli, was smaller for new-repeat pictures than for pictures seen for the first time in the experiment. Finally, individual differences in task performance were predicted by the differences in amplitude of P3b that was evoked by the onset of the reset screen.

Genetic variation in the serotonin transporter gene influences ERP old/new effects during recognition memory

Recognition memory is defined as the ability to recognize a previously encountered stimulus and has been associated with spatially and temporally distinct event-related potentials (ERPs). Allelic variations of the serotonin transporter gene (SLC6A4) have recently been shown to impact memory performance. Common variants of the serotonin transporter-linked polymorphic region (5HTTLPR) of the SLC6A4 gene result in long (l) and short (s) allelic variants with carriers of the s allele having lowered transcriptional efficiency. Thus, the current study examines the effects polymorphisms of the SLC6A4 gene have on performance and ERP amplitudes commonly associated with recognition memory. Electroencephalogram (EEG), genetic, and behavioral data were collected from sixty participants as they performed an item and source memory recognition task. In both tasks, participants studied and encoded 200 words, which were then mixed with 200 new words during retrieval. Participants were monitored with EEG during the retrieval portion of each memory task. EEG electrodes were grouped into four ROIs, left anterior superior, right anterior superior, left posterior superior, and right posterior superior. ERP mean amplitudes during hits in the item and source memory task were compared to correctly recognizing new items (correct rejections). Results show that s-carriers have decreased mean hit amplitudes in both the right anterior superior ROI 1000-1500ms post stimulus during the source memory task and the left anterior superior ROI 300-500ms post stimulus during the item memory task. These results suggest that individual differences due to genetic variation of the serotonin transporter gene influences recognition memory.

Basic perceptual changes that alter meaning and neural correlates of recognition memory

It is difficult to pinpoint the border between perceptual and conceptual processing, despite their treatment as distinct entities in many studies of recognition memory. For instance, alteration of simple perceptual characteristics of a stimulus can radically change meaning, such as the color of bread changing from white to green. We sought to better understand the role of perceptual and conceptual processing in memory by identifying the effects of changing a basic perceptual feature (color) on behavioral and neural correlates of memory in circumstances when this change would be expected to either change the meaning of a stimulus or to have no effect on meaning (i.e., to influence conceptual processing or not). Abstract visual shapes (“squiggles”) were colorized during study and presented during test in either the same color or a different color. Those squiggles that subjects found to resemble meaningful objects supported behavioral measures of conceptual priming, whereas meaningless squiggles did not. Further, changing color from study to test had a selective effect on behavioral correlates of priming for meaningful squiggles, indicating that color change altered conceptual processing. During a recognition memory test, color change altered event-related brain potential (ERP) correlates of memory for meaningful squiggles but not for meaningless squiggles. Specifically, color change reduced the amplitude of frontally distributed N400 potentials (FN400), implying that these potentials indicated conceptual processing during recognition memory that was sensitive to color change. In contrast, color change had no effect on FN400 correlates of recognition for meaningless squiggles, which were overall smaller in amplitude than for meaningful squiggles (further indicating that these potentials signal conceptual processing during recognition). Thus, merely changing the color of abstract visual shapes can alter their meaning, changing behavioral and neural correlates of memory. These findings are relevant to understanding similarities and distinctions between perceptual and conceptual processing as well as the functional interpretation of neural correlates of recognition memory.

The effects of a distracting N-back task on recognition memory are reduced by negative emotional intensity

Memory performance is usually impaired when participants have to encode information while performing a concurrent task. Recent studies using recall tasks have found that emotional items are more resistant to such cognitive depletion effects than non-emotional items. However, when recognition tasks are used, the same effect is more elusive as recent recognition studies have obtained contradictory results. In two experiments, we provide evidence that negative emotional content can reliably reduce the effects of cognitive depletion on recognition memory only if stimuli with high levels of emotional intensity are used. In particular, we found that recognition performance for realistic pictures was impaired by a secondary 3-back working memory task during encoding if stimuli were emotionally neutral or had moderate levels of negative emotionality. In contrast, when negative pictures with high levels of emotional intensity were used, the detrimental effects of the secondary task were significantly attenuated.

Stages of Processing in Associative Recognition: Evidence from Behavior, EEG, and Classification

In this study, we investigated the stages of information processing in associative recognition. We recorded EEG data while participants performed an associative recognition task that involved manipulations of word length, associative fan, and probe type, which were hypothesized to affect the perceptual encoding, retrieval, and decision stages of the recognition task, respectively. Analyses of the behavioral and EEG data, supplemented with classification of the EEG data using machine-learning techniques, provided evidence that generally supported the sequence of stages assumed by a computational model developed in the Adaptive Control of Thought-Rational cognitive architecture. However, the results suggested a more complex relationship between memory retrieval and decision-making than assumed by the model. Implications of the results for modeling associative recognition are discussed. The study illustrates how a classifier approach, in combination with focused manipulations, can be used to investigate the timing of processing stages.

Familiarity in source memory

Familiarity and recollection are thought to be separate processes underlying recognition memory. Event-related potentials (ERPs) dissociate these processes, with an early (approximately 300-500ms) frontal effect relating to familiarity (the FN400) and a later (500-800ms) parietal old/new effect relating to recollection. It has been debated whether source information for a studied item (i.e., contextual associations from when the item was previously encountered) is only accessible through recollection, or whether familiarity can contribute to successful source recognition. It has been shown that familiarity can assist in perceptual source monitoring when the source attribute is an intrinsic property of the item (e.g., an object's surface color), but few studies have examined its contribution to recognizing extrinsic source associations. Extrinsic source associations were examined in three experiments involving memory judgments for pictures of common objects. In Experiment 1, source information was spatial and results suggested that familiarity contributed to accurate source recognition: the FN400 ERP component showed a source accuracy effect, and source accuracy was above chance for items judged to only feel familiar. Source information in Experiment 2 was an extrinsic color association; source accuracy was at chance for familiar items and the FN400 did not differ between correct and incorrect source judgments. Experiment 3 replicated the results using a within-subjects manipulation of spatial vs. color source. Overall, the results suggest that familiarity's contribution to extrinsic source monitoring depends on the type of source information being remembered.

Examining ERP correlates of recognition memory: evidence of accurate source recognition without recollection

Recollection is typically associated with high recognition confidence and accurate source memory. However, subjects sometimes make accurate source memory judgments even for items that are not confidently recognized, and it is not known whether these responses are based on recollection or some other memory process. In the current study, we measured event related potentials (ERPs) while subjects made item and source memory confidence judgments in order to determine whether recollection supported accurate source recognition responses for items that were not confidently recognized. In line with previous studies, we found that recognition memory was associated with two ERP effects: an early on-setting FN400 effect, and a later parietal old-new effect [late positive component (LPC)], which have been associated with familiarity and recollection, respectively. The FN400 increased gradually with item recognition confidence, whereas the LPC was only observed for highly confident recognition responses. The LPC was also related to source accuracy, but only for items that had received a high confidence item recognition response; accurate source judgments to items that were less confidently recognized did not exhibit the typical ERP correlate of recollection or familiarity, but rather showed a late, broadly distributed negative ERP difference. The results indicate that accurate source judgments of episodic context can occur even when recollection fails.

More than a feeling: Pervasive influences of memory without awareness of retrieval

The subjective experiences of recollection and familiarity have featured prominently in the search for neurocognitive mechanisms of memory. However, these two explicit expressions of memory, which involve conscious awareness of memory retrieval, are distinct from an entire category of implicit expressions of memory that do not entail such awareness. This review summarizes recent evidence showing that neurocognitive processing related to implicit memory can powerfully influence the behavioral and neural measures typically associated with explicit memory. Although there are striking distinctions between the neurocognitive processing responsible for implicit versus explicit memory, tests designed to measure only explicit memory nonetheless often capture implicit memory processing as well. In particular, the evidence described here suggests that investigations of familiarity memory are prone to the accidental capture of implicit memory processing. These findings have considerable implications for neurocognitive accounts of memory, as they suggest that many neural and behavioral measures often accepted as signals of explicit memory instead reflect the distinct operation of implicit memory mechanisms that are only sometimes related to explicit memory expressions. Proper identification of the explicit and implicit mechanisms for memory is vital to understanding the normal operation of memory, in addition to the disrupted memory capabilities associated with many neurological disorders and mental illnesses. We suggest that future progress requires utilizing neural, behavioral, and subjective evidence to dissociate implicit and explicit memory processing so as to better understand their distinct mechanisms as well as their potential relationships. When searching for the neurocognitive mechanisms of memory, it is important to keep in mind that memory involves more than a feeling.

Behavioural and magnetoencephalographic evidence for the interaction between semantic and episodic memory in healthy elderly subjects

The relationship between episodic and semantic memory systems has long been debated. Some authors argue that episodic memory is contingent on semantic memory (Tulving 1984), while others postulate that both systems are independent since they can be selectively damaged (Squire 1987). The interaction between these memory systems is particularly important in the elderly, since the dissociation of episodic and semantic memory defects characterize different aging-related pathologies. Here, we investigated the interaction between semantic knowledge and episodic memory processes associated with faces in elderly subjects using an experimental paradigm where the semantic encoding of famous and unknown faces was compared to their episodic recognition. Results showed that the level of semantic awareness of items affected the recognition of those items in the episodic memory task. Event-related magnetic fields confirmed this interaction between episodic and semantic memory: ERFs related to the old/new effect during the episodic task were markedly different for famous and unknown faces. The old/new effect for famous faces involved sustained activities maximal over right temporal sensors, showing a spatio-temporal pattern partly similar to that found for famous versus unknown faces during the semantic task. By contrast, an old/new effect for unknown faces was observed on left parieto-occipital sensors. These findings suggest that the episodic memory for famous faces activated the retrieval of stored semantic information, whereas it was based on items' perceptual features for unknown faces. Overall, our results show that semantic information interfered markedly with episodic memory processes and suggested that the neural substrates of these two memory systems overlap.

Study–Test Congruency Affects Encoding-related Brain Activity for Some but Not All Stimulus Materials

Memory improves when encoding and retrieval processes overlap. Here, we investigated how the neural bases of long-term memory encoding vary as a function of the degree to which functional processes engaged at study are engaged again at test. In an incidental learning paradigm, electrical brain activity was recorded from the scalps of healthy adults while they made size judgments on intermixed series of pictures and words. After a 1-hr delay, memory for the items was tested with a recognition task incorporating remember/know judgments. In different groups of participants, studied items were either probed in the same mode of presentation (word–word; picture–picture) or in the alternative mode of presentation (word–picture; picture–word). Activity over anterior scalp sites predicted later memory of words, irrespective of type of test probe. Encoding-related activity for pictures, by contrast, differed qualitatively depending on how an item was cued at test. When a picture was probed with a picture, activity over anterior scalp sites predicted encoding success. When a picture was probed with a word, encoding-related activity was instead maximal over posterior sites. Activity differed according to study–test congruency from around 100 msec after picture onset. These findings indicate that electrophysiological correlates of encoding are sensitive to the similarity between processes engaged at study and test. The time course supports a direct and not merely consequential role of encoding–retrieval overlap in encoding. However, because congruency only affected one type of stimulus material, encoding–retrieval overlap may not be a universal organizing principle of neural correlates of memory.

ERP investigation of study-test background mismatch during face recognition in schizophrenia

Old/new effects on event-related potentials (ERP) were explored in 20 patients with schizophrenia and 20 paired comparison subjects during unfamiliar face recognition. Extrinsic perceptual changes - which influence the overall familiarity of an item while retaining face-intrinsic features for use in structural face encoding - were manipulated between the study phase and the test. The question raised here concerns whether these perceptual incongruities would have a different effect on the sense of familiarity and the corresponding behavioral and ERP measures in the two groups. The results showed that schizophrenia patients were more inclined to consider old faces shown against a new background as distractors. This drop in face familiarity was accompanied by the disappearance of ERP old/new effects in this condition, i.e., FN400 and parietal old/new effects. Indeed, while ERP old/new recognition effects were found in both groups when the picture of the face was physically identical to the one presented for study, the ERP correlates of recognition disappeared among patients when the background behind the face was different. This difficulty in disregarding a background change suggests that recognition among patients with schizophrenia is based on a global perceptual matching strategy rather than on the extraction of configural information from the face. The correlations observed between FN400 amplitude, the rejection of faces with a different background, and the reality-distortion scores support the idea that the recognition deficit found in schizophrenia results from early anomalies that are carried over onto the parietal ERP old/new effect. Face-extrinsic perceptual variations provide an opportune situation for gaining insight into the social difficulties that patients encounter throughout their lives.

Midazolam-induced amnesia reduces memory for details and affects the ERP correlates of recollection and familiarity

Dual process models suggest that recognition memory is supported by familiarity and recollection processes. Previous research administering amnesic drugs and measuring ERPs during recognition memory have provided evidence for separable neural correlates of familiarity and recollection. This study examined the effect of midazolam-induced amnesia on memory for details and the proposed ERP correlates of recognition. Midazolam or saline was administered while subjects studied oriented pictures of common objects. ERPs were recorded during a recognition test 1 day later. Subjects' discrimination of old and new pictures as well as orientation discrimination was worse when they were given midazolam instead of saline. As predicted, the parietal old/new effect was decreased with the administration of midazolam. However, weaker effects on FN400 old/new effects were also observed. These results provide converging pharmacological and electrophysiological evidence that midazolam primarily affects recollection as indexed by parietal ERP old/new effects and memory for orientation, while also exerting some weaker effects on familiarity as indexed by FN400 old/new effects.

FN400 potentials are functionally identical to N400 potentials and reflect semantic processing during recognition testing

The "F" in FN400 denotes a more frontal scalp distribution relative to the morphologically similar N400 component-a distinction consistent with the hypothesized distinct roles of FN400 in familiarity memory versus N400 in language. However, no direct comparisons have substantiated these assumed dissimilarities. To this end, we manipulated short-term semantic priming during a recognition test. Semantic priming effects on N400 were indistinguishable from memory effects at the same latency, and semantic priming strongly modulated the "FN400," despite having no influence on familiarity memory. Thus, no evidence suggested either electrophysiological or functional differences between the N400 and FN400, and findings were contrary to the linking of the "FN400" to familiarity. Instead, it appears that semantic/conceptual priming (reflected in the N400) occurs during recognition tests and is frequently (mis)labeled as FN400 and attributed to familiarity.

Picture superiority doubly dissociates the ERP correlates of recollection and familiarity

Two experiments investigated the processes underlying the picture superiority effect on recognition memory. Studied pictures were associated with higher accuracy than studied words, regardless of whether test stimuli were words (Experiment 1) or pictures (Experiment 2). Event-related brain potentials (ERPs) recorded during test suggested that the 300-500 msec FN400 old/new effect, hypothesized to be related to familiarity-based recognition, benefited from study/test congruity, such that it was larger when study and test format remained constant than when they differed. The 500-800 msec parietal old/new effect, hypothesized to be related to recollection, benefited from studying pictures, regardless of test format. The parallel between the accuracy and parietal ERP results suggests that picture superiority may arise from encoding the distinctive attributes of pictures in a manner that enhances their later recollection. Furthermore, when words were tested, opposite effects of studying words versus studying pictures were observed on the FN400 (word > picture) versus parietal (picture > word) old/new effects--providing strong evidence for a crossover interaction between these components that is consistent with a dual-process perspective.

Remembering perceptual features unequally bound in object and episodic tokens: Neural mechanisms and their electrophysiological correlates

We present a neurocognitive model of long-term object memory. We propose that perceptual priming and episodic recognition are phenomena based on three distinct kinds of representations. We label these representations types and tokens. Types are prototypical representations needed for object identification. The network of non-arbitrary features necessary for object categorization is sharpened in the course of repeated identification, an effect that we call type trace and which causes perceptual priming. Tokens, on the other hand, support episodic recognition. Perirhinal structures are proposed to bind intrinsic within-object features into an object token that can be thought of as a consolidated perceptual object file. Hippocampal structures integrate object- with contextual information in an episodic token. The reinstatement of an object token is assumed to generate a feeling of familiarity, whereas recollection occurs when the reinstatement of an episodic token occurs. Retrieval mode and retrieval orientation dynamically modulate access to these representations. In this review, we apply the model to recent empirical research (behavioral, fMRI, and ERP data) including a series of studies from our own lab. We put specific emphasis on the effects that sensory features and their study-test match have on familiarity. The type-token approach fits the data and additionally provides a framework for the analysis of concepts like unitization and associative reinstatement.

Dissociation of the electrophysiological correlates of familiarity strength and item repetition

Event-related potentials (ERPs) were employed to investigate the relationship between the familiarity strength of recognition memory test items (pictures of animate and inanimate objects) and a putative ERP correlate of familiarity, the mid-frontal 'old/new' effect. A modified Remember/Know task was used in which subjects endorsed items as 'remembered' if any detail of the study presentation could be retrieved and, if not, judged the old/new status of the item using a 4-point confidence scale ('confident old' to 'confident new'). Studied test items elicited a mid-frontal old/new effect that varied according to the rated familiarity of the eliciting item. Thus, prior findings that the mid-frontal effect is graded according to familiarity strength are not attributable to the confounding influence of study status, as has been suggested. ERPs elicited by studied and unstudied items that were rated equally familiar differed in the same latency range as that occupied by the mid-frontal old/new effect. Furthermore, the scalp topography of this repetition effect differed significantly from the topography of the mid-frontal effect. The findings suggest that ERPs elicited by recognition memory test items are modulated during the 300-500 ms latency range both by the familiarity strength of the item and, separately, by an implicit memory process that acts independently of the processes supporting familiarity-driven recognition judgments.