ERP correlates of recognition memory: Effects of retention interval and false alarms

From encoding to recognition: Exploring the shared neural signatures of visual memory

This study investigated the shared neural dynamics underlying encoding and recognition processes across diverse visual object stimulus types in short term experimental familiarization, using EEG-based representational similarity analysis and multivariate cross-classification. Building upon previous research, we extended our exploration to the encoding phase. We show early visual stimulus category effects around 150 ms post-stimulus onset and old/new effects around 400 to 600 ms. Notably, a divergence in neural responses for encoding, old, and new stimuli emerged around 300 ms, with items encountered during the study phase showing the highest differentiation from old items during the test phase. Cross-category classification demonstrated discernible memory-related effects as early as 150 ms. Anterior regions of interest, particularly in the right hemisphere, did not exhibit differentiation between experimental phases or between study and new items, hinting at similar processing for items first encountered, irrespective of experiment phase. While short-term experimental familiarity did not consistently adhere to the old >new pattern observed in long-term personal familiarity, statistically significant effects are observed specifically for experimentally familiarized faces, suggesting a potential unique phenomenon specific to facial stimuli. Further investigation is warranted to elucidate underlying mechanisms and determine the extent of face-specific effects. Lastly, our findings underscore the utility of multivariate cross-classification and cross-dataset classification as promising tools for probing abstraction and shared neural signatures of cognitive processing.

Improving memory through choice and deliberation in decision-making: Evidence from ERPs

The goal of decision-making is to select one option and disregard the others. However, deliberation can also create a memory association between the chosen and unchosen options. This study aims to investigate how choice and deliberation affect the memory of postdecision options and the underlying mechanisms. Using event-related potentials (ERPs), we examined item recognition (Experiment 1) and associative recognition (Experiment 2) following certain and uncertain decisions. In Experiment 1, items that were chosen in certain decisions were remembered better than unchosen items. There was no difference between chosen and unchosen items in uncertain decisions. Moreover, a late recollection-related LPC (a late positive component) old/new effect was larger for chosen items than unchosen items in certain decisions. The early familiarity-related FN400 and the late recollection-related LPC old/new effects were significant for chosen and unchosen items in uncertain decisions. In Experiment 2, there was no difference in performance on associative memory. A FN400 old/new effect (an index of integration) in certain or uncertain decisions was not observed. Although significant LPC old/new effects were found in both certain and uncertain decisions, no difference was found between them. These results propose that decision-making can enhance item memory performance through two distinct processes: value and elaboration. Elaboration involves focusing on the details within items rather than integrating items into a cohesive whole.

Shared neural codes of recognition memory

Recognition memory research has identified several electrophysiological indicators of successful memory retrieval, known as old-new effects. These effects have been observed in different sensory domains using various stimulus types, but little attention has been given to their similarity or distinctiveness and the underlying processes they may share. Here, a data-driven approach was taken to investigate the temporal evolution of shared information content between different memory conditions using openly available EEG data from healthy human participants of both sexes, taken from six experiments. A test dataset involving personally highly familiar and unfamiliar faces was used. The results show that neural signals of recognition memory for face stimuli were highly generalized starting from around 200 ms following stimulus onset. When training was performed on non-face datasets, an early (around 200-300 ms) to late (post-400 ms) differentiation was observed over most regions of interest. Successful cross-classification for non-face stimuli (music and object/scene associations) was most pronounced in late period. Additionally, a striking dissociation was observed between familiar and remembered objects, with shared signals present only in the late window for correctly remembered objects, while cross-classification for familiar objects was successful in the early period as well. These findings suggest that late neural signals of memory retrieval generalize across sensory modalities and stimulus types, and the dissociation between familiar and remembered objects may provide insight into the underlying processes.

A meta-analysis of event-related potential correlates of recognition memory

A longstanding question in memory research is whether recognition is supported by more than one mnemonic process. Dual-process models distinguish recollection of episodic detail from familiarity, while single-process models explain recognition in terms of one process that varies in strength. Dual process models have drawn support from findings that recollection and familiarity elicit distinct electroencephalographic event-related potentials (ERPs): a mid-frontal ERP effect that occurs at around 300-500 ms post-stimulus onset and is often larger for familiarity than recollection contrasts, and a parietal ERP effect that occurs at around 500-800 ms and is larger for recollection than familiarity contrasts. We sought to adjudicate between dual- and single-process models by investigating whether the dissociation between these two ERP effects is reliable over studies. We extracted effect sizes from 41 experiments that had used Remember-Know, source memory, and associative memory paradigms (1,000 participants). Meta-analysis revealed a strong interaction between ERP effect and mnemonic process of the form predicted by dual-process models. Although neither ERP effect was significantly process-selective taken alone, a moderator analysis revealed a larger mid-frontal effect for familiarity than recollection contrasts in studies using the Remember-Know paradigm. Mega-analysis of raw data from six studies further showed significant process-selectivity for both mid-frontal and parietal ERPs in the predicted time windows. On balance, the findings favor dual- over single-process theories of recognition memory, but point to a need to promote sharing of raw data.

The ERP correlates of color-based center-surround inhibition in working memory

The color-based center-surround inhibition (CSI) in working memory (WM) refers to that remembering a color inhibits the memory of similar colors but not of distinct colors. This study aimed to investigate the neural activity of color-based CSI in WM. Two WM items (distance 0°, 10°, 20°, 30°, 40°, 50°, or 60° in color space) were displayed sequentially, then one of them was retrieved to compare with a later probe. Behavioral results revealed that participants showed longer RTs for distances 20° and 30° than distances 0° and 40°, suggesting a CSI between similar items. ERP results revealed that: 1) WM item-induced late positive component (LPC) was more positive for distance 30° than the other distances, suggesting an enhanced resource allocation process for encoding similar items; 2) Cue-induced LPC was more positive for distances 20° and 30° than distances 0° and 60°, suggesting a greater difficulty for retrieving similar items; Cue-induced contingent negative variation was less negative for distance 20° than distances 40°, 50°, and 60°, suggesting a reduced response preparation process during retrieving similar items; 3) Probe-induced LPC was more positive for distances 20° and 30° than distances 50° and 60°, suggesting a greater effort for comparing probe with one item retrieved from two similar items. These results revealed a colored-based CSI during WM encoding and retrieval processes. An enhanced top-down control might be required to resolve the greater interference between similar items than identical or distinct items conditions.

Effects of emotion and semantic relatedness on recognition memory: Behavioral and electrophysiological evidence

Some aspects of our memory are enhanced by emotion, whereas others can be unaffected or even hindered. Previous studies reported impaired associative memory of emotional content, an effect termed associative "emotional interference". The current study used EEG and an associative recognition paradigm to investigate the cognitive and neural mechanisms associated with this effect. In two experiments, participants studied negative and neutral stimulus-pairs that were either semantically related or unrelated. In Experiment 1 emotions were relevant to the encoding task (valence judgment) whereas in Experiment 2 emotions were irrelevant (familiarity judgment). In a subsequent associative recognition test, EEG was recorded while participants discriminated between intact, rearranged, and new pairs. An associative emotional interference effect was observed in both experiments, but was attenuated for semantically related pairs in Experiment 1, where valence was relevant to the task. Moreover, a modulation of an early associative memory ERP component (300-550 ms) occurred for negative pairs when valence was task-relevant (Experiment 1), but for semantically related pairs when valence was irrelevant (Experiment 2). A later ERP component (550-800 ms) showed a more general pattern, and was observed in all experimental conditions. These results suggest that both valence and semantic relations can act as an organizing principle that promotes associative binding. Their ability to contribute to successful retrieval depends on specific task demands.

Behavioural and neurophysiological signatures in the retrieval of individual memories of recent and remote real-life routine episodic events

Autobiographical memory (AM) has been largely investigated as the ability to recollect specific events that belong to an individual's past. However, how we retrieve real-life routine episodes and how the retrieval of these episodes changes with the passage of time remain unclear. Here, we asked participants to use a wearable camera that automatically captured pictures to record instances during a week of their routine life and implemented a deep neural network-based algorithm to identify picture sequences that represented episodic events. We then asked each participant to return to the lab to retrieve AMs for single episodes cued by the selected pictures 1 week, 2 weeks and 6-14 months after encoding while scalp electroencephalographic (EEG) activity was recorded. We found that participants were more accurate in recognizing pictured scenes depicting their own past than pictured scenes encoded in the lab, and that memory recollection of personally experienced events rapidly decreased with the passing of time. We also found that the retrieval of real-life picture cues elicited a strong and positive 'ERP old/new effect' over frontal regions and that the magnitude of this ERP effect was similar throughout memory tests over time. However, we observed that recognition memory induced a frontal theta power decrease and that this effect was mostly seen when memories were tested after 1 and 2 weeks but not after 6-14 months from encoding. Altogether, we discuss the implications for neuroscientific accounts of episodic retrieval and the potential benefits of developing individual-based AM exploration strategies at the clinical level.

Spatiotemporal pattern of brain electrical activity related to immediate and delayed episodic memory retrieval

In the present study we used the event-related brain potentials (ERP) technique and eLORETA (exact low-resolution electromagnetic tomography) method in order to characterize and compare the performance and the spatiotemporal pattern of the brain electrical activity related to the immediate episodic retrieval of information (words) that is being learned relative to delayed episodic retrieval twenty-minutes later. For this purpose, 16 young participants carried out an old/new word recognition task with source memory (word colour). The task included an immediate memory phase (with three study-test blocks) followed (20 min later) by a delayed memory phase with one test block. The behavioural data showed progressive learning and consolidation of the information (old words) during the immediate memory phase. The ERP data to correctly identified old words for which the colour was subsequently recollected (H/H) compared to the correctly rejected new words (CR) showed: (1) a significant more positive-going potential in the 500-675 ms post-stimulus interval (parietal old/new effect, related to recollection), and (2) a more negative-going potential in the 950-1850 ms interval (LPN effect, related to retrieval and post-retrieval processes). The eLORETA data also revealed that the successful recognition of old words (and probably retrieval of their colour) was accompanied by activation of (1) left medial temporal (parahippocampal gyrus) and parietal regions involved in the recollection in both memory phases, and (2) prefrontal regions and the superior temporal gyrus (in the immediate and delayed memory phases respectively) involved in monitoring, evaluating and maintaining the retrieval products. These findings indicate that episodic memory retrieval depends on a network involving medial temporal lobe and frontal, parietal and temporal neocortical structures. That network was involved in immediate and delayed memory retrieval and during the course of memory consolidation, with greater activation of some nodes (mobilization of more processing resources) for the delayed respect to the immediate retrieval condition.

Scale-invariant Characteristics of Forgetting: Toward a Unifying Account of Hippocampal Forgetting across Short and Long Timescales

After over 100 years of relative silence in the cognitive literature, recent advances in the study of the neural underpinnings of memory-specifically, the hippocampus-have led to a resurgence of interest in the topic of forgetting. This review draws a theoretically driven picture of the effects of time on forgetting of hippocampus-dependent memories. We review evidence indicating that time-dependent forgetting across short and long timescales is reflected in progressive degradation of hippocampal-dependent relational information. This evidence provides an important extension to a growing body of research accumulated in recent years, showing that-in contrast to the once prevailing view that the hippocampus is exclusively involved in memory and forgetting over long timescales-the role of the hippocampus also extends to memory and forgetting over short timescales. Thus, we maintain that similar rules govern not only remembering but also forgetting of hippocampus-dependent information over short and long timescales.

Tracking Your Mind's Eye during Recollection: Decoding the Long-Term Recall of Short Audiovisual Clips

Unlike familiarity, recollection involves the ability to reconstruct mentally previous events that results in a strong sense of reliving. According to the reinstatement hypothesis, this specific feature emerges from the reactivation of cortical patterns involved during information exposure. Over time, the retrieval of specific details becomes more difficult, and memories become increasingly supported by familiarity judgments. The multiple trace theory (MTT) explains the gradual loss of episodic details by a transformation in the memory representation, a view that is not shared by the standard consolidation model. In this study, we tested the MTT in light of the reinstatement hypothesis. The temporal dynamics of mental imagery from long-term memory were investigated and tracked over the passage of time. Participant EEG activity was recorded during the recall of short audiovisual clips that had been watched 3 weeks, 1 day, or a few hours beforehand. The recall of the audiovisual clips was assessed using a Remember/Know/New procedure, and snapshots of clips were used as recall cues. The decoding matrices obtained from the multivariate pattern analyses revealed sustained patterns that occurred at long latencies (>500 msec poststimulus onset) that faded away over the retention intervals and that emerged from the same neural processes. Overall, our data provide further evidence toward the MTT and give new insights into the exploration of our "mind's eye."

English only? Monolinguals in linguistically diverse contexts have an edge in language learning

Accumulating evidence shows how language context shapes bilingual language use and its cognitive consequences. However, few studies have considered the impact of language context for monolinguals. Although monolinguals' language processing is assumed to be relatively stable and homogeneous, some research has shown novel learning through exposure alone. Monolinguals living in linguistically diverse contexts regularly overhear languages they do not understand, and may absorb information about those languages in ways that shape their language networks. The current study used behavioral and ERP measures to compare monolinguals living in a linguistically diverse environment and a unilingual environment in their ability to learn vowel harmony in Finnish. Monolinguals in both contexts demonstrated similar learning of studied words; however, their ERPs differed for generalization. Monolinguals in the diverse context revealed an anterior late positivity, whereas monolinguals in the unilingual context showed no effect. The results suggest that linguistic diversity promotes new language learning.

Downstream Behavioral and Electrophysiological Consequences of Word Prediction on Recognition Memory

When people process language, they can use context to predict upcoming information, influencing processing and comprehension as seen in both behavioral and neural measures. Although numerous studies have shown immediate facilitative effects of confirmed predictions, the downstream consequences of prediction have been less explored. In the current study, we examined those consequences by probing participants' recognition memory for words after they read sets of sentences. Participants read strongly and weakly constraining sentences with expected or unexpected endings ("I added my name to the list/basket"), and later were tested on their memory for the sentence endings while EEG was recorded. Critically, the memory test contained words that were predictable ("list") but were never read (participants saw "basket"). Behaviorally, participants showed successful discrimination between old and new items, but false alarmed to the expected-item lures more often than to new items, showing that predicted words or concepts can linger, even when predictions are disconfirmed. Although false alarm rates did not differ by constraint, event-related potentials (ERPs) differed between false alarms to strongly and weakly predictable words. Additionally, previously unexpected (compared to previously expected) endings that appeared on the memory test elicited larger N1 and LPC amplitudes, suggesting greater attention and episodic recollection. In contrast, highly predictable sentence endings that had been read elicited reduced LPC amplitudes during the memory test. Thus, prediction can facilitate processing in the moment, but can also lead to false memory and reduced recollection for predictable information.

Single-Trial EEG Analysis Predicts Memory Retrieval and Reveals Source-Dependent Differences

We used pattern classifiers to extract features related to recognition memory retrieval from the temporal information in single-trial electroencephalography (EEG) data during attempted memory retrieval. Two-class classification was conducted on correctly remembered trials with accurate context (or source) judgments vs. correctly rejected trials. The average accuracy for datasets recorded in a single session was 61% while the average accuracy for datasets recorded in two separate sessions was 56%. To further understand the basis of the classifier’s performance, two other pattern classifiers were trained on different pairs of behavioral conditions. The first of these was designed to use information related to remembering the item and the second to use information related to remembering the contextual information (or source) about the item. Mollison and Curran (2012) had earlier shown that subjects’ familiarity judgments contributed to improved memory of spatial contextual information but not of extrinsic associated color information. These behavioral results were similarly reflected in the event-related potential (ERP) known as the FN400 (an early frontal effect relating to familiarity) which revealed differences between correct and incorrect context memories in the spatial but not color conditions. In our analyses we show that a classifier designed to distinguish between correct and incorrect context memories, more strongly involves early activity (400–500 ms) over the frontal channels for the location distinctions, than for the extrinsic color associations. In contrast, the classifier designed to classify memory for the item (without memory for the context), had more frontal channel involvement for the color associated experiments than for the spatial experiments. Taken together these results argue that location may be bound more tightly with the item than an extrinsic color association. The multivariate classification approach also showed that trial-by-trial variation in EEG corresponding to these ERP components were predictive of subjects’ behavioral responses. Additionally, the multivariate classification approach enabled analysis of error conditions that did not have sufficient trials for standard ERP analyses. These results suggested that false alarms were primarily attributable to item memory (as opposed to memory of associated context), as commonly predicted, but with little previous corroborating EEG evidence.

Late Positive Component Event-related Potential Amplitude Predicts Long-term Classroom-based Learning

It is difficult to predict whether newly learned information will be retrievable in the future. A biomarker of long-lasting learning, capable of predicting an individual's future ability to retrieve a particular memory, could positively influence teaching and educational methods. ERPs were investigated as a potential biomarker of long-lasting learning. Prior ERP studies have supported a dual-process model of recognition memory that categorizes recollection and familiarity as distinct memorial processes with distinct ERP correlates. The late positive component is thought to underlie conscious recollection and the frontal N400 signal is thought to reflect familiarity [Yonelinas, A. P. Components of episodic memory: The contribution of recollection and familiarity. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 356, 1363-1374, 2001]. Here we show that the magnitude of the late positive component, soon after initial learning, is predictive of subsequent recollection of anatomical terms among medical students 6 months later.

ERP evidence for consumer evaluation of copycat brands

Copycat brands mimic brand leaders to free ride on the latter's equity. However, little is known regarding if and how consumers confuse copycat as leading brand in purchasing. In this study, we applied a word-pair evaluation paradigm in which the first word was a brand name (copycat vs. normal brand both similar with a leading brand in category), followed by a product name (near vs. far from the leading brand’s category). Behavioral results showed that, when the product is near the leader’s category, the copycat strategy (CN) was more preferred compared to the normal brand (NN) but not different in the far product condition (CF and NF). Event-related potential (ERP) data provided further insight into the mechanism. The N400 amplitude elicited by the CN condition was significantly smaller than NN. However, when products are far from the leader’s category, there was no significant difference in N400 amplitudes. For the late positive component (LPC), the CN gave rise to a larger amplitude than the CF. The N400 amplitude was suggested to reflect the categorization process, and the LPC demonstrated the recollection process in long-term memory. These findings imply that the copycat brand strategy is generally only effective when products are within the category of the leading brand, which offers important implications for marketing practices.

Decision-related factors in pupil old/new effects: Attention, response execution, and false memory

In this study, we investigate the effects of decision-related factors on recognition memory in pupil old/new paradigms. In Experiment 1, we used an old/new paradigm with words and pseudowords and participants made lexical decisions during recognition rather than old/new decisions. Importantly, participants were instructed to focus on the nonword-likeness of presented items, not their word-likeness. We obtained no old/new effects. In Experiment 2, participants discriminated old from new words and old from new pseudowords during recognition, and they did so as quickly as possible. We found old/new effects for both words and pseudowords. In Experiment 3, we used materials and an old/new design known to elicit a large number of incorrect responses. For false alarms ("old" response for new word), we found larger pupils than for correctly classified new items, starting at the point at which response execution was allowed (2750ms post stimulus onset). In contrast, pupil size for misses ("new" response for old word) was statistically indistinguishable from pupil size in correct rejections. Taken together, our data suggest that pupil old/new effects result more from the intentional use of memory than from its automatic use.

Electrophysiological Correlates of Familiarity and Recollection in Associative Recognition: Contributions of Perceptual and Conceptual Processing to Unitization

It is generally accepted that associative recognition memory is supported by recollection. In addition, recent research indicates that familiarity can support associative memory, especially when two items are unitized into a single item. Both perceptual and conceptual manipulations can be used to unitize items, but few studies have compared these two methods of unitization directly. In the present study, we investigated the effects of familiarity and recollection on successful retrieval of items that were unitized perceptually or conceptually. Participants were instructed to remember either a Chinese two-character compound or unrelated word-pairs, which were presented simultaneously or sequentially. Participants were then asked to recognize whether word-pairs were intact or rearranged. Event-related potential (ERP) recordings were performed during the recognition phase of the study. Two-character compounds were better discriminated than unrelated word-pairs and simultaneous presentation was found to elicit better discrimination than sequential presentation for unrelated word-pairs only. ERP recordings indicated that the early intact/rearranged effects (FN400), typically associated with familiarity, were elicited in compound word-pairs with both simultaneous and sequential presentation, and in simultaneously presented unrelated word-pairs, but not in sequentially presented unrelated word-pairs. In contrast, the late positive complex (LPC) effects associated with recollection were elicited in all four conditions. Together, these results indicate that while the engagement of familiarity in associative recognition is affected by both perceptual and conceptual unitization, conceptual unitization promotes a higher level of unitization (LOU). In addition, the engagement of recollection was not affected by unitized manipulations. It should be noted, however, that due to experimental design, the effects presented here may be due to semantic rather than episodic memory and future studies should take this into consideration when manipulating rearranged pairs.

Forget all that nonsense: The role of meaning during the forgetting of recollective and familiarity-based memories

Memory can be divided into recollection and familiarity. Recollection is characterized as the ability to vividly re-experience past events, and is believed to be supported by the hippocampus, whereas familiarity is defined as an undifferentiated feeling of knowing or acquaintance, and is believed to be supported by extra-hippocampal regions, such as the perirhinal cortex. Recent evidence suggests that the neural architectures of the hippocampus and neocortex lead information in these regions being susceptible to different forgetting processes. We expand on these accounts and propose that the neocortex may be sensitive to the semantic content of a trace, with more meaningful traces being more easily retained. The hippocampus, in contrast, is not hypothesized to be influenced by semantics in the same way. To test this new account, we use a continuous-recognition paradigm to examine the forgetting rates words and nonwords that are either recollected or familiar. We find that words and nonwords that are recollected are equally likely to be forgotten over time. However, nonwords that are familiar are more likely to be forgotten over time than are words that are familiar. Our results support recent neuropsychologically-based forgetting theories of recollection and familiarity and provide new insight into how and why representations are forgotten over time.

Old-new ERP effects and remote memories: the late parietal effect is absent as recollection fails whereas the early mid-frontal effect persists as familiarity is retained

Understanding the electrophysiological correlates of recognition memory processes has been a focus of research in recent years. This study investigated the effects of retention interval on recognition memory by comparing memory for objects encoded four weeks (remote) or 5 min (recent) before testing. In Experiment 1, event related potentials (ERPs) were acquired while participants performed a yes-no recognition memory task involving remote, recent and novel objects. Relative to correctly rejected new items, remote and recent hits showed an attenuated frontal negativity from 300–500 ms post-stimulus. This effect, also known as the FN400, has been previously associated with familiarity memory. Recent and remote recognition ERPs did not differ from each other at this time-window. By contrast, recent but not remote recognition showed increased parietal positivity from around 500 ms post-stimulus. This late parietal effect (LPE), which is considered a correlate of recollection-related processes, also discriminated between recent and remote memories. A second, behavioral experiment confirmed that remote memories unlike recent memories were based almost exclusively on familiarity. These findings support the idea that the FN400 and LPE are indices of familiarity and recollection memory, respectively and show that remote and recent memories are functionally and anatomically distinct.

Attentional Capacity Limits Gap Detection during Concurrent Sound Segregation

Detecting a brief silent interval (i.e., a gap) is more difficult when listeners perceive two concurrent sounds rather than one in a sound containing a mistuned harmonic in otherwise in-tune harmonics. This impairment in gap detection may reflect the interaction of low-level encoding or the division of attention between two sound objects, both of which could interfere with signal detection. To distinguish between these two alternatives, we compared ERPs during active and passive listening with complex harmonic tones that could include a gap, a mistuned harmonic, both features, or neither. During active listening, participants indicated whether they heard a gap irrespective of mistuning. During passive listening, participants watched a subtitled muted movie of their choice while the same sounds were presented. Gap detection was impaired when the complex sounds included a mistuned harmonic that popped out as a separate object. The ERP analysis revealed an early gap-related activity that was little affected by mistuning during the active or passive listening condition. However, during active listening, there was a marked decrease in the late positive wave that was thought to index attention and response-related processes. These results suggest that the limitation in detecting the gap is related to attentional processing, possibly divided attention induced by the concurrent sound objects, rather than deficits in preattentional sensory encoding.

Separating recognition processes of declarative memory via anodal tDCS: boosting old item recognition by temporal and new item detection by parietal stimulation

There is emerging evidence from imaging studies that parietal and temporal cortices act together to achieve successful recognition of declarative information; nevertheless, the precise role of these regions remains elusive. To evaluate the role of these brain areas in declarative memory retrieval, we applied bilateral tDCS, with anode over the left and cathode over the right parietal or temporal cortices separately, during the recognition phase of a verbal learning paradigm using a balanced old-new decision task. In a parallel group design, we tested three different groups of healthy adults, matched for demographic and neurocognitive status: two groups received bilateral active stimulation of either the parietal or the temporal cortex, while a third group received sham stimulation. Accuracy, discriminability index (d') and reaction times of recognition memory performance were measurements of interest. The d' sensitivity index and accuracy percentage improved in both active stimulation groups, as compared with the sham one, while reaction times remained unaffected. Moreover, the analysis of accuracy revealed a different effect of tDCS for old and new item recognition. While the temporal group showed enhanced performance for old item recognition, the parietal group was better at correctly recognising new ones. Our results support an active role of both of these areas in memory retrieval, possibly underpinning different stages of the recognition process.

Associative Recognition Processes Are Modulated by Modality Relations

Although memory of episodic associations is generally considered to be recollective in nature, it has been suggested that when stimuli are experienced as a unit, familiarity-related processes might contribute to their subsequent associative recognition. Furthermore, intradomain associations are believed to be unitized more readily than interdomain associations. To assess these claims, we tested associative recognition following two types of pair associate learning. In the unimodal task, stimulus pairs were pictures of common objects, whereas in the cross-modal task, stimulus pairs consisted of an object picture and an unrelated environmental sound. At test, participants discriminated intact from recombined pairs while ERPs were recorded. In the unimodal task only, associative recognition was accompanied by a robust frontal deflection reminiscent of a component commonly interpreted as related to familiarity processes. In contrast, ERP correlates of associative recognition observed at more posterior sites, akin to a component that has been related to recollection, were apparent in both tasks. These findings indicate that retrieval of unimodal associations can be supported by familiarity-related processes that are dissociable from recollective processes required for the retrieval of cross-modal associations.

Electrophysiological correlates of cross-linguistic semantic integration in hearing signers: N400 and LPC

We explored semantic integration mechanisms in native and non-native hearing users of sign language and non-signing controls. Event-related brain potentials (ERPs) were recorded while participants performed a semantic decision task for priming lexeme pairs. Pairs were presented either within speech or across speech and sign language. Target-related ERP responses were subjected to principal component analyses (PCA), and neurocognitive basis of semantic integration processes were assessed by analyzing the N400 and the late positive complex (LPC) components in response to spoken (auditory) and signed (visual) antonymic and unrelated targets. Semantically-related effects triggered across modalities would indicate a similar tight interconnection between the signers׳ two languages like that described for spoken language bilinguals. Remarkable structural similarity of the N400 and LPC components with varying group differences between the spoken and signed targets were found. The LPC was the dominant response. The controls׳ LPC differed from the LPC of the two signing groups. It was reduced to the auditory unrelated targets and was less frontal for all the visual targets. The visual LPC was more broadly distributed in native than non-native signers and was left-lateralized for the unrelated targets in the native hearing signers only. Semantic priming effects were found for the auditory N400 in all groups, but only native hearing signers revealed a clear N400 effect to the visual targets. Surprisingly, the non-native signers revealed no semantically-related processing effect to the visual targets reflected in the N400 or the LPC; instead they appeared to rely more on visual post-lexical analyzing stages than native signers. We conclude that native and non-native signers employed different processing strategies to integrate signed and spoken semantic content. It appeared that the signers׳ semantic processing system was affected by group-specific factors like language background and/or usage.

Recognition memory in amnestic-mild cognitive impairment: insights from event-related potentials

Episodic memory loss is the hallmark cognitive dysfunction associated with Alzheimer’s disease (AD). Amnestic mild cognitive impairment (a-MCI) frequently represents a transitional stage between normal aging and early AD. A better understanding of the qualitative features of memory loss in a-MCI may have important implications for predicting those most likely to harbor AD-related pathology and for disease monitoring. Dual process models of memory argue that recognition memory is subserved by the dissociable processes of recollection and familiarity. Work studying recognition memory in a-MCI from this perspective has been controversial, particularly with regard to the integrity of familiarity. Event-related potentials (ERPs) offer an alternative means for assessing these functions without the associated assumptions of behavioral estimation methods. ERPs were recorded while a-MCI patients and cognitively normal (CN) age-matched adults performed a recognition memory task. When retrieval success was measured (hits versus correct rejections) in which performance was matched by group, a-MCI patients displayed similar neural correlates to that of the CN group, including modulation of the FN400 and the late positive complex (LPC) which are thought to index familiarity and recollection, respectively. Alternatively, when the integrity of these components was measured based on retrieval attempts (studied versus unstudied items), a-MCI patients displayed a reduced FN400 and LPC. Furthermore, modulation of the FN400 correlated with a behavioral estimate of familiarity and the LPC with a behavioral estimate of recollection obtained in a separate experiment in the same individuals, consistent with the proposed mappings of these indices. These results support a global decline of recognition memory in a-MCI, which suggests that the memory loss of prodromal AD may be qualitatively distinct from normal aging.

The male advantage in child facial resemblance detection: behavioral and ERP evidence

Males have been suggested to have advantages over females in reactions to child facial resemblance, which reflects the evolutionary pressure on males to solve the adaptive paternal uncertainty problem and to identify biological offspring. However, previous studies showed inconsistent results and the male advantage in child facial resemblance perception, as a kin detection mechanism, is still unclear. Here, we investigated the behavioral and brain mechanisms underlying the self-resembling faces processing and how it interacts with sex and age using event-related potential (ERP) technique. The results showed a stable male advantage in self-resembling child faces processing, such that males have higher detectability to self-resembling child faces than females. For ERP results, males showed smaller N2 and larger late positive component (LPC) amplitudes for self-resembling child faces, which may reflect face-matching and self-referential processing in kin detection, respectively. Further source analysis showed that the N2 component and LPC were originated from the anterior cingulate cortex and medial frontal gyrus, respectively. Our results support the male advantage in self-resembling child detection and further indicate that such distinctions can be found in both early and late processing stages in the brain at different regions.

The "subjective" pupil old/new effect: is the truth plain to see?

Human memory is an imperfect process, prone to distortion and errors that range from minor disturbances to major errors that can have serious consequences on everyday life. In this study, we investigated false remembering of manipulatory verbs using an explicit recognition task and pupillometry. Our results replicated the "classical" pupil old/new effect as well as data in false remembering literature that show how items must be recognize as old in order for the pupil size to increase (e.g., "subjective" pupil old/new effect), even though these items do not necessarily have to be truly old. These findings support the strength-of-memory trace account that affirms that pupil dilation is related to experience rather than to the accuracy of recognition. Moreover, behavioral results showed higher rates of true and false recognitions for manipulatory verbs and a consequent larger pupil diameter, supporting the embodied view of language.

Neural correlates of familiarity and conceptual fluency in a recognition test with ancient pictographic characters

Familiarity and conceptual priming refer to distinct memory expressions and are subtypes of explicit memory and implicit memory, respectively. Given that the neural events that produce conceptual priming may in some cases promote familiarity, distinguishing between neural signals of these two types of memory may further our understanding of recognition memory mechanisms. Although FN400 event-related potentials observed during recognition tests have often been ascribed to familiarity, much evidence suggests that they should instead be ascribed to conceptual fluency. To help resolve this controversy, we studied potentials elicited by unrecognizable ancient Chinese characters. These stimuli were categorized as high or low in meaningfulness based on subjective ratings. Conceptual priming was produced exclusively by repetition of characters high in meaningfulness. During a recognition test in which recollection was discouraged, FN400 old-new effects were observed, and amplitudes of the FN400 potentials varied inversely with familiarity confidence. However, these effects were absent for old items given low meaningfulness ratings. For both high and low meaningfulness, late positive (LPC) potentials were found in old-new comparisons, and LPC amplitudes were greater when higher familiarity confidence was registered during the recognition test. These findings linked familiarity and conceptual fluency with different brain potentials - LPC and FN400, respectively - and provide additional evidence that explicit memory and implicit memory have distinct neural substrates.

Familiarity in source memory

Familiarity and recollection are thought to be separate processes underlying recognition memory. Event-related potentials (ERPs) dissociate these processes, with an early (approximately 300-500ms) frontal effect relating to familiarity (the FN400) and a later (500-800ms) parietal old/new effect relating to recollection. It has been debated whether source information for a studied item (i.e., contextual associations from when the item was previously encountered) is only accessible through recollection, or whether familiarity can contribute to successful source recognition. It has been shown that familiarity can assist in perceptual source monitoring when the source attribute is an intrinsic property of the item (e.g., an object's surface color), but few studies have examined its contribution to recognizing extrinsic source associations. Extrinsic source associations were examined in three experiments involving memory judgments for pictures of common objects. In Experiment 1, source information was spatial and results suggested that familiarity contributed to accurate source recognition: the FN400 ERP component showed a source accuracy effect, and source accuracy was above chance for items judged to only feel familiar. Source information in Experiment 2 was an extrinsic color association; source accuracy was at chance for familiar items and the FN400 did not differ between correct and incorrect source judgments. Experiment 3 replicated the results using a within-subjects manipulation of spatial vs. color source. Overall, the results suggest that familiarity's contribution to extrinsic source monitoring depends on the type of source information being remembered.

Sensation seeking predicts brain responses in the old-new task: converging multimodal neuroimaging evidence

Novel images and message content enhance visual attention and memory for high sensation seekers, but the neural mechanisms associated with this effect are unclear. To investigate the individual differences in brain responses to new and old (studied) visual stimuli, we utilized event-related potentials (ERP) and functional Magnetic Resonance Imaging (fMRI) measures to examine brain reactivity among high and low sensation seekers during a classic old-new memory recognition task. Twenty low and 20 high sensation seekers completed separate, but parallel, ERP and fMRI sessions. For each session, participants initially studied drawings of common images, and then performed an old-new recognition task during scanning. High sensation seekers showed greater ERP responses to new objects at the frontal N2 ERP component, compared to low sensation seekers. The ERP Novelty-N2 responses were correlated with fMRI responses in the orbitofrontal gyrus. Sensation seeking status also modulated the FN400 ERP component indexing familiarity and conceptual learning, along with fMRI responses in the caudate nucleus, which correlated with FN400 activity. No group differences were found in the late ERP positive components indexing classic old-new amplitude effects. Our combined ERP and fMRI results suggest that sensation-seeking personality affects the early brain responses to visual processing, but not the later stage of memory recognition.

Emotional memories are resilient to time: evidence from the parietal ERP old/new effect

Emotional memories can be extremely robust and long-lasting and can contribute to the development of anxiety disorders. Despite tremendous work on neural responses underlying the memory formation of emotional events, less is known about long-term retention. In the present study, behavioral and electrophysiological measures were used to investigate long-term recognition memory for emotional (unpleasant and pleasant) and neutral pictures after two retention intervals (1 week vs. 1 year) in 21 male subjects. The results show enhanced recognition performance for emotional relative to neutral pictures for both test delays. On the neural side, the retrieval of emotional pictures compared to neutral pictures was accompanied after 1 week by an enhanced old/new effect (500-800 ms), originating in the parietal cortex. After 1-year retention delay, only unpleasant but not pleasant pictures were different from neutral pictures in the recollection-sensitive ERP component. Analysis of the subjective awareness (confidence ratings) during recognition indicated that behavioral and electrocortical response patterns were exclusively driven by high confidence responses, an indication for recollection-based recognition. These results suggest that high arousing emotional memories were highly consistent over time relative to neutral memories.

Effects of task-set adoption on ERP correlates of controlled and automatic recognition memory

Successful memory retrieval depends not only on memory fidelity but also on the mental preparedness on the part of the subject. ERP studies of recognition memory have identified two topographically distinct ERP components, the FN400 old/new effect and the late posterior component (LPC) old/new effect, commonly associated with familiarity and recollection, respectively. Here we used a task-switching paradigm to examine the extent to which adoption of a retrieval task-set influences FN400 and LPC old/new effects, in light of the presumption that recollection, as a control process, relies on the adoption of a retrieval task-set, but that familiarity-based retrieval does not. Behavioral accuracy indicated that source memory (experiment 2), but not item recognition (experiment 1), improved with task-set adoption. ERP data demonstrated a larger LPC on stay trials when a task-set had been adopted even with a simple recognition memory judgment. We conclude that adopting a retrieval task-set impacts recollection memory but not familiarity. These data indicate that attentional state immediately prior to retrieval can influence objective measures of recollection memory.

Multiple forms of learning yield temporally distinct electrophysiological repetition effects

Prior experience with a stimulus leads to multiple forms of learning that facilitate subsequent behavior (repetition priming) and neural processing (repetition suppression). Learning can occur at the level of stimulus-specific features (stimulus learning), associations between stimuli and selected decisions (stimulus-decision learning), and associations between stimuli and selected responses (stimulus-response learning). Although recent functional magnetic resonance imaging results suggest that these distinct forms of learning are associated with repetition suppression (neural priming) in dissociable regions of frontal and temporal cortex, a critical question is how these different forms of learning influence cortical response dynamics. Here, electroencephalography (EEG) measured the temporal structure of neural responses when participants classified novel and repeated stimuli, using a design that isolated the effects of distinct levels of learning. Event-related potential and spectral EEG analyses revealed electrophysiological effects due to stimulus, stimulus-decision, and stimulus-response learning, demonstrating experience-dependent cortical modulation at multiple levels of representation. Stimulus-level learning modulated cortical dynamics earlier in the temporal-processing stream relative to stimulus-decision and stimulus-response learning. These findings indicate that repeated stimulus processing, including the mapping of stimuli to decisions and actions, is influenced by stimulus-level and associative learning mechanisms that yield multiple forms of experience-dependent cortical plasticity.

Effects of amisulpride on emotional memory using a dual-process model in healthy male volunteers

Memory dysfunction occurs in a number of neuropsychiatric disorders. Therapeutic psychopharmacological agents may exacerbate such memory impairment. Detailed characterisation of drug-induced memory impairment is therefore important. We recently showed that the D(2)/D(3) antagonist amisulpride quantitatively impairs emotional memory in a randomised placebo-controlled study of 33 healthy volunteers. Current evidence suggests that two qualitatively different processes (recollection and familiarity) contribute to recognition memory and can be investigated using a Dual-Process Signal Detection model. Using such a model, we found that amisulpride levels at encoding were significantly inversely correlated with recollection estimates for emotional but not neutral stimuli or familiarity estimates in healthy male volunteers. This suggests that dopamine antagonism at encoding preferentially impairs the recollection component of emotional memory, relative to the familiarity component. This was supported by receiver operating characteristic analysis. We also found a significantly increased false recognition rate, associated with significantly shorter reaction times for emotional but not neutral stimuli in the amisulpride group. These findings have important implications for our understanding of recognition memory processes, as well as the interpretation of neuropsychological findings in medicated patients.

ERP Evidence for Flexible Adjustment of Retrieval Orientation and Its Influence on Familiarity

The assumption was tested that familiarity memory as indexed by a mid-frontal ERP old–new effect is modulated by retrieval orientation. A randomly cued category-based versus exemplar-specific recognition memory test, requiring flexible adjustment of retrieval orientation, was conducted. Results show that the mid-frontal ERP old–new effect is sensitive to the manipulation of study-test congruency—that is, whether the same object is repeated identically or a different category exemplar is presented at test. Importantly, the effect pattern depends on subjects' retrieval orientation. With a specific orientation, only same items elicited an early old–new effect (same > different = new), whereas in the general condition, the old–new effect was graded (same > different > new). This supports the view that both perceptual and conceptual processes can contribute to familiarity memory and demonstrates that the rather automatic process of familiarity is not only data driven but influenced by top–down retrieval orientation, which subjects are able to adjust on a flexible basis.

Retrieval Processes Supporting Judgments of Recency

The circumstances under which different retrieval processes can support judgments about how long ago events occurred remain a matter of debate, as do the ways in which retrieved information can be employed in support of such judgments. In order to contribute to an understanding of the nature and number of distinct retrieval processes that support time judgments, event-related potentials (ERPs) were acquired during a continuous verbal memory task, where the lag between presentation and re-presentation of words was varied. Participants made judgments of recency (JORs), indicating the number of words that had intervened between presentation and re-presentation. Two spatially and temporally separable ERP effects predicted JORs, and the two effects bore correspondences with ERP modulations that have been linked to the processes of recollection and familiarity, suggesting that both of these processes contributed to JORs. The two effects predicting recency judgments also did so in the same way, with larger effects uniformly predicting shorter lag judgments. In so far as the sizes of the effects index memory strength, these findings are consistent with theoretical accounts of JORs where strength is employed heuristically: The more information recovered, the more recently the event occurred.

ERP correlates of item recognition memory: effects of age and performance

Decline in episodic memory is a common feature of healthy aging. Event-related potential (ERP) studies in young adults have consistently reported several modulations thought to index memory retrieval processes, but relatively limited work has explored the impact of aging on them. Further, work with functional imaging has demonstrated differential neural recruitment in elderly subjects depending on their level of cognitive performance which may reflect compensatory or, alternatively, inefficient processing. In the present study we examined the effect of aging and level of performance on both early (FN400, LPC) and later [late frontal effect (LFE)] ERP indices of recognition memory. We found that the FN400 and LPC were absent or attenuated in the older group relative to young adults, but that the LFE was actually increased, analogous to findings in the functional imaging literature. Additionally, the latter effect was most prominent in the poorer performing older participants. These findings suggest that weak memory retrieval supported by earlier ERP modulations, may lead to an enhanced LFE in the service of additional retrieval attempts.

Event-related potentials and the study of memory retrieval: A critical review

Memory retrieval has been extensively investigated by a variety of techniques and methodological approaches. The present article reports a critical review on the research investigating this subject by means of event-related potentials (ERP). The main goal is to elucidate the key contributions of this technique regarding episodic memory retrieval, as well as to perform a critical analysis taking into account its major advantages and limitations in the framework of current cognitive neuroscience. Considerations concerning its theoretical contributions and implementation in national universities are also discussed.

Parietal contributions to recollection: electrophysiological evidence from aging and patients with parietal lesions

There has been much recent investigation into the role of parietal cortex in memory retrieval. Proposed hypotheses include attention to internal memorial representations, an episodic working memory-type buffer, and an accumulator of retrieved memorial information. The current investigation used event-related potentials (ERPs) to test the episodic buffer hypothesis, and to assess the memorial contribution of parietal cortex in younger and older adults, and in patients with circumscribed lateral parietal lesions. In a standard recognition memory paradigm, subjects studied color pictures of common objects. One-third of the test items were presented in the same viewpoint as the study phase, one-third were presented in a 90 degrees rotated viewpoint, and one-third were presented in a noncanonical viewpoint. Conflicting with the episodic buffer hypothesis, results revealed that the duration of the parietal old/new effect was longest for the canonical condition and shortest for the noncanonical condition. Results also revealed that older adults demonstrated a diminished parietal old/new effect relative to younger adults. Consistent with previous data reported by Simons et al., patients with lateral parietal lesions showed no behavioral impairment compared to controls. Behavioral and ERP data from parietal lesion patients are presented and discussed. From these results, the authors speculate that the parietal old/new effect may be the neural correlate of an individual's subjective recollective experience.

Neuroimaging techniques for memory detection: scientific, ethical, and legal issues

There is considerable interest in the use of neuroimaging techniques for forensic purposes. Memory detection techniques, including the well-publicized Brain Fingerprinting technique (Brain Fingerprinting Laboratories, Inc., Seattle WA), exploit the fact that the brain responds differently to sensory stimuli to which it has been exposed before. When a stimulus is specifically associated with a crime, the resulting brain activity should differentiate between someone who was present at the crime and someone who was not. This article reviews the scientific literature on three such techniques: priming, old/new, and P300 effects. The forensic potential of these techniques is evaluated based on four criteria: specificity, automaticity, encoding flexibility, and longevity. This article concludes that none of the techniques are devoid of forensic potential, although much research is yet to be done. Ethical issues, including rights to privacy and against self-incrimination, are discussed. A discussion of legal issues concludes that current memory detection techniques do not yet meet United States standards of legal admissibility.

Memory-related ERP components for experimentally learned faces and names: characteristics and parallel-test reliabilities

Previous research with preexperimentally familiar faces and names has identified several memory-related components in the event-related potential (ERP). Here we aimed to characterize these components while controlling the quality of long-term memory with a standardized learning procedure for unfamiliar faces and names. After 1 week, recognition was tested in a repetition priming paradigm. Both early repetition effects (ERE/N250r) and old/new effects had very similar time course and domain-related scalp topographies as has been reported for preexperimentally familiar stimuli. The late repetition effects (LRE/N400) showed domain-specific scalp topographies, possibly reflecting the greater ease of deriving semantic codes from faces. Importantly, parallel-test reliabilities of performance and memory-related ERP components were high, thus demonstrating the utility of face learning for formal assessment procedures in person recognition.

Event-related potentials and recognition memory

According to dual-process models, recognition memory is supported by distinct retrieval processes known as familiarity and recollection. Important evidence supporting the dual-process framework has come from studies using event-related brain potentials (ERPs). These studies have identified two topographically distinct ERP correlates of recognition memory--the "parietal" and "mid-frontal" old/new effects--that are dissociated by variables that selectively modulate recollection and familiarity, respectively. We evaluate the extent to which ERP data support dual-process models in light of the proposal that recollection is a continuous rather than a discrete memory process. We also examine the claim that the putative ERP index of familiarity is a reflection of implicit rather than explicit memory. We conclude that ERP findings continue to offer strong support for the dual-process perspective.