Dissociating recollection from familiarity: Electrophysiological evidence that familiarity for faces is associated with a posterior old/new effect

Shared neural codes of recognition memory

Recognition memory research has identified several electrophysiological indicators of successful memory retrieval, known as old-new effects. These effects have been observed in different sensory domains using various stimulus types, but little attention has been given to their similarity or distinctiveness and the underlying processes they may share. Here, a data-driven approach was taken to investigate the temporal evolution of shared information content between different memory conditions using openly available EEG data from healthy human participants of both sexes, taken from six experiments. A test dataset involving personally highly familiar and unfamiliar faces was used. The results show that neural signals of recognition memory for face stimuli were highly generalized starting from around 200 ms following stimulus onset. When training was performed on non-face datasets, an early (around 200-300 ms) to late (post-400 ms) differentiation was observed over most regions of interest. Successful cross-classification for non-face stimuli (music and object/scene associations) was most pronounced in late period. Additionally, a striking dissociation was observed between familiar and remembered objects, with shared signals present only in the late window for correctly remembered objects, while cross-classification for familiar objects was successful in the early period as well. These findings suggest that late neural signals of memory retrieval generalize across sensory modalities and stimulus types, and the dissociation between familiar and remembered objects may provide insight into the underlying processes.

Improving associative memory in younger and older adults with unitization: evidence from meta-analysis and behavioral studies

Introduction

The finding that familiarity can support associative memory by unitizing the to -be-learned items into a novel representation has been widely accepted, but its effects on overall performance of associative memory and recollection are still controversial.

Methods

The current study aims to elucidate these discrepancies by identifying potential moderating factors through a combined approach of meta-analysis and behavioral experiment.

Results

Results consistently showed that changes in the level of unitization and age groups were two important moderators. Specifically, unitization enhanced younger and older adults' associative memory and its supporting processes (i.e., familiarity and recollection) when the level of unitization between studied and rearranged pairs was changed. However, when this level remained constant, unitization exhibited no impact on associative memory and familiarity in younger adults, but showed an enhanced effect in older adults. Furthermore, results revealed a marked group difference between younger and older adults in associative memory when the unitization level of noncompound words remained unaltered. Upon breaking this condition, the group difference was reduced by enhancing familiarity or recollection.

Discussion

These findings not only clarify some of the inconsistencies in the literature concerning the impact of unitization on associative memory, but also suggest that unitization is a beneficial strategy for reducing group difference in associative memory, with its effectiveness varying according to the level of unitization changes.

Electrophysiological analysis of signal detection outcomes emphasizes the role of decisional factors in recognition memory

Introduction

Event-related potential (ERP) studies have identified two time windows associated with recognition memory and interpreted them as reflecting two processes: familiarity and recollection. However, using relatively simple stimuli and achieving high recognition rates, most studies focused on hits and correct rejections. This leaves out some information (misses and false alarms) that according to Signal Detection Theory (SDT) is necessary to understand signal processing.

Methods

We used a difficult visual recognition task with colored pictures of different categories to obtain enough of the four possible SDT outcomes and analyzed them with modern ERP methods.

Results

Non-parametric analysis of these outcomes identified a single time window (470 to 670 ms) which reflected activity within fronto-central and posterior-left clusters of electrodes, indicating differential processing. The posterior-left cluster significantly distinguished all STD outcomes. The fronto-central cluster only distinguished ERPs according to the subject's response: yes vs. no. Additionally, only electrophysiological activity within the posterior-left cluster correlated with the discrimination index (d').

Discussion

We show that when all SDT outcomes are examined, ERPs of recognition memory reflect a single-time window that may reveal a bottom-up factor discriminating the history of items (i.e. memory strength), as well as a top-down factor indicating participants' decision.

How neural representations of newly learnt faces change over time: Event-related brain potential evidence for overnight consolidation

Previous experiments have shown that a brief encounter with a previously unfamiliar person leads to the establishment of new facial representations, which can be activated by completely novel pictures of the newly learnt face. The present study examined how stable such novel neural representations are over time, and, specifically, how they become consolidated within the first 24 h after learning. Using event-related brain potentials (ERPs) in a between-participants design, we demonstrate that clear face familiarity effects in the occipito-temporal N250 are evident immediately after learning. These effects then undergo change, with a nearly complete absence of familiarity-related ERP differences 4 h after the initial encounter. Critically, 24 h after learning, the original familiarity effect re-emerges. These findings suggest that the neural correlates of novel face representations are not stable over time but change during the first day after learning. The resulting pattern of change is consistent with a process of consolidation.

Effects of cognitive reappraisal on directed forgetting of negative emotional memory: an ERP study

This study aimed to adopt the item-method directed forgetting (DF) paradigm to explore the effects of cognitive reappraisal on intentional forgetting of negative emotional pictures. Behavioral results showed that the recognition of to-be-forgotten but remembered (TBF-r) was significantly greater than that of to-be-remembered and remembered (TBR-r) in the recognition test, which was the opposite result to the DF effect. Event-related potential (ERP) results showed that in the 450-660 ms (ms) of cue presentation, the F-cue of the cognitive reappraisal condition (imagining the upcoming pictures to be "fake or performed by actors" to avoid or reduce the intensity of negative emotions caused by the pictures) elicited more positive late positive potential (LPP) than passive viewing (participants watched freely and paid attention to the characters, scenes, and other details in the picture). This indicated that cognitive reappraisal required stronger inhibition than passive viewing for the to-be- forgotten (TBF) items. In the test phase, both the TBR-r and TBF-r items in the cognitive reappraisal condition evoked more positive ERP than correctly rejected (CR) unseen items in the study phase, which induced the frontal old/new effect (P200, 160-240 ms). In addition, this study also found that the LPP amplitudes of 450-660 ms in the frontal area induced by F-cues in cognitive reappraisal were significantly negatively correlated with the LPP amplitudes of 300-3500 ms induced by cognitive reappraisal instructions, and positive waves in the frontal area were significantly positively correlated with the TBF-r behavioral results. However, these results were not observed in the passive viewing group. The above results show that cognitive reappraisal enhances the retrieval ability for TBR and TBF items, and TBF-r is associated with cognitive reappraisal in the study phase and inhibitory control of F-cues.

Neural timing of the other-race effect across the lifespan: A review

Face race influences the way we process faces, so that faces of a different ethnic group are processed for identity less efficiently than faces of one's ethnic group - a phenomenon known as the Other-Race Effect (ORE). Although widely replicated, the ORE is still poorly characterized in terms of its development and the underlying mechanisms. In the last two decades, the Event-Related Potential (ERP) technique has brought insight into the mechanisms underlying the ORE and has demonstrated potential to clarify its development. Here, we review the ERP evidence for a differential neural processing of own-race and other-race faces throughout the lifespan. In infants, race-related processing differences emerged at the N290 and P400 (structural encoding) stages. In children, race affected the P100 (early processing, attention) perceptual stage and was implicitly encoded at the N400 (semantic processing) stage. In adults, processing difficulties for other-race faces emerged at the N170 (structural encoding), P200 (configuration processing) and N250 (accessing individual representations) perceptual stages. Early in processing, race was implicitly encoded from other-race faces (N100, P200 attentional biases) and in-depth processing preferentially applied to own-race faces (N200 attentional bias). Encoding appeared less efficient (Dm effects) and retrieval less recollection-based (old/new effects) for other-race faces. Evidence admits the contribution of perceptual, attentional, and motivational processes to the development and functioning of the ORE, offering no conclusive support for perceptual or socio-cognitive accounts. Cross-racial and non-cross-racial studies provided convergent evidence. Future research would need to include less represented ethnic populations and the developmental population.

From encoding to retrieval: Change in level of unitization resolves debate about Unitization's effect on associative recognition

Although it is widely accepted that familiarity could support associative recognition when the to-be-learn items are 'unitized' into a new representation, the effects of unitization on associative recognition and recollection remain much debated. The current study aimed to explain these debates by exploring when and how unitization benefits associative recognition using event-related potentials (ERPs). During the encoding phase, participants learned compound words and unrelated word pairs (i.e., High vs. Low level of unitization). At retrieval, the compound words were rearranged into new compound words (i.e., no-change) and unrelated word pairs (i.e., change). Similarly, the unrelated word pairs were rearranged into new unrelated word pairs (i.e., no-change) and compound words (i.e., change). Results showed that under the no-change condition, unitization did not affect associative recognition, nor its underlying processes. In contrast, under the change condition, unitization improved associative recognition by increasing both familiarity-related FN400 effect and recollection-related LPC effect. In addition, a planned comparison between the compound-change and unrelated-no change conditions-a common index for unitization effect in past studies-revealed that unitization could not only elicit significant FN400 effect, but also improve associative recognition by increasing LPC effect. Collectively, these results not only allowed to explain the current discrepancies in the literature concerning the effect of unitization on associative recognition, but also emphasized the importance of matching the level of unitization between the studied and rearranged word pairs.

Event-related brain potential correlates of the other-race effect: A review

People are better at remembering own-race relative to other-race faces. Here, we review event-related brain potential (ERP) correlates of this so-called other-'race' effect (ORE) by discussing three critical aspects that characterize the neural signature of this phenomenon. First, difficulties with other-race faces initially emerge during perceptual processing, which is indexed by an increased N170. Second, as evidenced by 'difference due to subsequent memory' effects, more effortful processing of other-race faces is needed for successful encoding into long-term memory. Third, ERP old/new effects reveal that a stronger engagement of processing resources is also required for successful retrieval of other-race faces from memory. The ERP evidence available to date thus suggests widespread ethnicity-related modulations during both perceptual and mnemonic processing stages. We further discuss how findings from the ORE compared with potentially related memory biases (e.g. other-gender or other-age effects) and how ERP findings inform the ongoing debate regarding the mechanisms underlying the ORE. Finally, we outline open questions and potential future directions with an emphasis on using multiple, ecologically more valid 'ambient' images for each face to assess the ORE in paradigms that capture identity rather than image recognition.

Individual differences in behavioral and electrophysiological signatures of familiarity- and recollection-based recognition memory

Our everyday memories can vary in terms of accuracy and phenomenology. According to one theoretical account, these differences hinge on whether the memories contain information about both an item itself as well as associated details (remember) versus those that are devoid of these associated contextual details (familiar). This distinction has been supported by computational modeling of behavior, studies in patients, and neuroimaging work including differences both in electrophysiological and functional magnetic resonance imaging. At present, however, little evidence has emerged to suggest that neurophysiological measures track individual differences in estimates of recollection and familiarity. Here, we conducted electrophysiological recordings of brain activity during a recognition memory task designed to differentiate between behavioral indices of recollection and familiarity. Non-parametric cluster-based permutation analyses revealed associations between electrophysiological signatures of familiarity and recollection with their respective behavioral estimates. These results support the idea that recollection and familiarity are distinct phenomena and is the first, to our knowledge, to identify distinct electrophysiological signatures that track individual differences in these processes.

Recollection and familiarity in schizophrenia:An ERP investigation using face recognition exclusion tasks

Recent studies suggest that the recollection deficit observed in schizophrenia may not be a unitary phenomenon but could depend on the information to retrieve. Here we investigated whether the nature of the perceptual information affects recollection and familiarity in schizophrenia. ERP old/new effects were explored in 20 patients with schizophrenia and 20 healthy controls during unfamiliar face exclusion tasks, with either intrinsic (expression) or extrinsic (background) information either changing or remaining the same between study and test. Schizophrenia patients rejected old faces as distractors in a greater extent than healthy controls. The FN400 old/new effect (300-500ms) was found in both groups. It was sensitive to facial expression change for healthy controls but not schizophrenia patients. In addition, the parietal old/new effect was lower for correctly excluded faces for patients, but not for controls. This points to the conclusion that schizophrenia patients discriminate between target and non-target faces on the basis of the memory strength signal corresponding to the study-test mismatch rather than the recollection of the critical information, as observed in healthy controls. This functioning can be useful when study-test perceptual mismatch must be detected but, in return, can lead to the over-exclusion of old stimuli.

The Inhibitory Effect of Emotional Conflict Control on Memory Retrieval

Evidence is mounting that emotional conflict is mainly resolved by the rostral anterior cingulate inhibiting the processing of emotional distractors. However, this theory has not been verified from the perspective of memory retrieval. This experiment aimed to explore the offline effect of emotional conflict processing on memory retrieval. We adopted a modified encoding-retrieval paradigm to explore this issue. Participants' electroencephalography (EEG) signal were also collected. A face-word Stroop task was used to create the congruency factor. In addition, an old/new judgment task was used to evaluate the recognition performance. During the retrieval phase, the response time of the incongruent condition was longer and the recognition accuracy was lower compared with congruent and neutral conditions in the behavioral data. For event-related potentials (ERP), we detected two well-established old/new effects related to memory retrieval under both neutral and emotional conditions: the frontal negativity (FN400) related to familiarity-driven recognition and the late posterior negativity (LPN) related to reconstructive processing or evaluation of retrieval outcomes. More importantly, the old/new effects were missing for incongruent condition during the early stage of FN400 (300-400 ms). Besides, for LPN (700-900 ms), the old/new effects of the incongruent condition are greater than the congruent condition. The results prove that the encoding phase's emotional congruency factor has a regulatory effect on the retrieval phase's early familiarity processing and evaluation of retrieval outcomes. Our data confirm the inhibitory effect of emotional conflict control on memory retrieval and support the emotional conflict control mechanism found in previous studies.

The challenge of learning a new language in adulthood: Evidence from a multi-methodological neuroscientific approach

Being proficient in several foreign languages is an essential part of every-day life. In contrast to childhood, learning a new language can be highly challenging for adults. The present study aims at investigating neural mechanisms supporting very initial foreign language learning in adulthood. For this reason, subjects underwent an implicit semantic associative training in which they had to learn new pseudoword-picture pairings. Learning success was measured via a recognition experiment presenting learned versus new pseudoword-picture pairings. Neural correlates were assessed by an innovative multi-methodological approach simultaneously applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). Results indicate memory-related processes based on familiarity and mechanisms of cognitive control to be present during initial vocabulary learning. Findings underline the fascinating plasticity of the adult brain during foreign language learning, even after a short semantic training of only 18 minutes as well as the importance of comparing evidence from different neuroscientific methods and behavioral data.

Unitization of internal and external features contributes to associative recognition for faces: Evidence from modulations of the FN400

Associative recognition requires discriminating between old items and conjunction lures constructed by recombining elements from two different study items. This task can be solved not only by recollection but also by familiarity if the to-be-remembered stimuli are perceived as a unitized representation. In two event-related potential (ERP) studies, we provide evidence for the integration of internal and external facial features by showing that the early frontal old-new effect (considered a correlate of familiarity) is modulated by the specific combination of facial features. Participants studied faces consisting of internal features (eyes, eyebrows, nose, and mouth) paired with external features (hair, head shape, and ears). During the testing phase, intact, recombined, and new faces were presented. Recombined faces consisted of internal and external features taken from two different studied faces. The results showed that at the frontal sites, during the time window from 300 to 500 ms, ERPs to intact faces were more positive than those to new and recombined faces; the latter two did not differ from one another. The late parietal effect was observed only after a more extended study phase in Experiment 2. We take the modulation of the early frontal old-new effect as evidence for the contribution of familiarity to associative recognition for combinations of internal and external facial features.

How Does Gender Stereotype Affect the Memory of Advertisements? A Behavioral and Electroencephalography Study

Previous studies have shown equivocal results about whether atypical or unusual events, compared with typical ones, facilitate or inhibit memory. We suspect that the indefinite findings could be partly due to the recall task used in these studies, as the participants might have used inference instead of recall in their responses. In the present study, we tested the recognition memory for real (Experiment 1) and fabricated (Experiment 2) advertisements, which could be congruent or incongruent with gender stereotypes. In congruent advertisements, a female endorser presented a traditionally considered feminine product or a male endorser presented a traditionally considered masculine product, whereas the gender-product type matching reversed in incongruent advertisements. The results of both behavioral experiments revealed that the participants’ memory performance for stereotype-incongruent advertisements was higher than for congruent ones. In the event-related potential (ERP) recordings in Experiment 3, larger positive amplitudes were found for stereotype-incongruent advertisements than for congruent advertisements on the left parietal sites, suggesting a deeper encoding process for stereotype-incongruent information than for stereotype-congruent information.

Electrocortical indices of subjectively perceived confidence in episodic memory

Electrophysiological studies on recognition memory have identified several brain signals that are associated with subjective perceived confidence. However, the extent these brain signals reflect a generic process and are independent of the type of information recognized remains an open question. To address this issue, twenty-seven healthy volunteers performed an episodic memory task while their electro-encephalogram (EEG) was recorded. Participants encoded a set of abstract pictures, and subsequently rated their confidence on recognition decisions. Similar to results reported in previous studies using concrete words, we found retrieval-related theta power, FN400 and late positive component (LPC) effects. In contrast to previous studies using verbal material, a subsequent memory effect for encoding-related evoked theta power, sensitive to subjectively perceived memory confidence, was observed. Our findings suggest that brain signals that are associated with subjectively perceived confidence reflect specific encoding, but generic retrieval processes.

Happy emotion cognition of bimodal audiovisual stimuli optimizes the performance of the P300 speller

OBJECTIVE

Prior studies of emotional cognition have found that emotion-based bimodal face and voice stimuli can elicit larger event-related potential (ERP) amplitudes and enhance neural responses compared with visual-only emotional face stimuli. Recent studies on brain-computer interface have shown that emotional face stimuli have significantly improved the performance of the traditional P300 speller system, but its performance needs to be further improved for practical applications. Therefore, we herein propose a novel audiovisual P300 speller based on bimodal emotional cognition to further improve the performance of the P300 system.

METHODS

The audiovisual P300 speller we proposed is based on happy emotions, with visual and auditory stimuli that consist of several pairs of smiling faces and audible chuckles (E-AV spelling paradigm) of different ages and sexes. The control paradigm was the visual-only emotional face P300 speller (E-V spelling paradigm).

RESULTS

We compared the ERP amplitudes, accuracy, and raw bit rate between the E-AV and E-V spelling paradigms. The target stimuli elicited significantly increased P300 amplitudes (p < .05) and P600 amplitudes (p < .05) in the E-AV spelling paradigm compared with those in the E-V paradigm. The E-AV spelling paradigm also significantly improved the spelling accuracy and the raw bit rate compared with those in the E-V paradigm at one superposition (p < .05) and at two superpositions (p < .05).

SIGNIFICANCE

The proposed emotion-based audiovisual spelling paradigm not only significantly improves the performance of the P300 speller, but also provides a basis for the development of various bimodal P300 speller systems, which is a step forward in the clinical application of brain-computer interfaces.

Enhanced spontaneous retrieval of cues from emotional events: An ERP study

Recent evidence points to enhanced episodic memory retrieval not only for emotional items but also for neutral information encoded in emotional contexts. However, prior research only tested instructed explicit recognition, and hence here we investigated whether memory retrieval is also heightened for cues from emotional contexts when retrieval is not explicitly probed. During the first session of a two-session experiment, neutral objects were presented on different background scenes varying in emotional and neutral contents. One week later, objects were presented again (with no background) intermixed with novel objects. In both sessions, participants were instructed to attentively watch the stimuli (free viewing procedure), and during the second session, ERPs were also collected to measure the ERP Old/New effect, an electrophysiological correlate of episodic memory retrieval. Analyses were performed using cluster-based permutation tests in order to identify reliable spatio-temporal ERP differences. Based on this approach, old relative to new objects, were associated with larger ERP positivity in an early (364-744 ms) and late time window (760-1148 ms) over distinct central electrode clusters. Interestingly, significant late ERP Old/New differences were only observed for objects previously encoded with emotional, but not neutral scenes (504 to 1144 ms). Because these ERP differences were observed in a non-instructed retrieval context, our results indicate that long-term, spontaneous retrieval for neutral objects, is particularly heightened if encoded within emotionally salient contextual information. These findings may assist in understanding mechanisms underlying spontaneous retrieval of emotional associates and the utility of ERPs to study maladaptive involuntary memories in trauma- and stress-related disorders.

Can Brain Waves Really Tell If a Product Will Be Purchased? Inferring Consumer Preferences From Single-Item Brain Potentials

Recent research has shown that event-related brain potentials (ERPs) recorded while participants view lists of different consumer goods can be modulated by their preferences toward these products. However, it remains largely unknown whether ERP activity specific to a single consumer item can be informative about whether or not this item will be preferred in a shopping context. In this study, we examined whether single-item ERPs could reliably predict consumer preferences toward specific consumer goods. We recorded scalp EEG from 40 participants while they were viewing pictures of consumer goods and we subsequently asked them to indicate their preferences for each of these items. Replicating previous results, we found that ERP activity averaged over the six most preferred products was significantly differentiated from ERP activity averaged across the six least preferred products for three ERP components: The N200, the late positive potential (LPP) and positive slow waves (PSW). We also found that using single-item ERPs to infer behavioral preferences about specific consumer goods led to an overall predictive accuracy of 71%, although this figure varied according to which ERPs were targeted. Later positivities such as the LPP and PSW yielded relatively higher predictive accuracy rates than the frontal N200. Our results suggest that ERPs related to single consumer items can be relatively accurate predictors of behavioral preferences depending on which type of ERP effects are chosen by the researcher, and ultimately on the level of prediction errors that users choose to tolerate.

The relevance of the first two eye fixations for recognition memory processes

Stimuli can be recognised based on information from only one or two eye fixations. With only one fixation, item recognition is typically above chance level and performance generally saturates by the second fixation. Thus, the first two eye fixations play an important role for recognition memory performance. However, little is known about the involved processes. Therefore, two experiments were conducted to investigate hypotheses regarding the role of the first two eye fixations for specific recognition memory processes, that is, familiarity and recollection. In addition, we looked in detail at the unique contributions of (a) longer input duration and (b) additional information provided by a second fixation for familiarity- and recollection-based recognition, using a gaze-contingent stimulus presentation technique. The experiments showed that recollection- but not familiarity-based recognition increased with two compared to only one fixation, and that the second fixation boosted recollection both due to longer availability of the input and additional stimulus information gathered.

The temporal dynamics of perceptual and conceptual fluency on recognition memory

Recognition memory can be driven by both perceptual and conceptual fluency, but when and to what extent they contribute to recognition memory remains an open question. The present study used event-related potentials (ERPs) to investigate the neural correlates of perceptual and conceptual fluency, when they gave rise to recognition. We manipulated the perceptual and conceptual fluency of retrieval cues in the recognition test independently to obtain the effects of different types of fluency. Behavioral results showed that perceptual fluency selectively affected K hits, while conceptual fluency affected R hits and K false alarms. In addition, conceptual fluency facilitated the response times of R hits. The ERP results showed that perceptual fluency effect appeared at 100-200 ms and conceptual fluency effect appeared at 300-500 ms. The parietal LPC peaked earlier for conceptually primed trials compared to unprimed trials. These results suggest that perceptual and conceptual fluency had different effects on recognition judgments, and these two types of fluency can be delineated by distinct ERP correlates. The current finding indicates that unconscious memory processes can support recognition and have provided insights into the underlying mechanism involved in recognition memory.

An item's status in semantic memory determines how it is recognized: Dissociable patterns of brain activity observed for famous and unfamiliar faces

Are all faces recognized in the same way, or does previous experience with a face change how it is retrieved? Previous research using human scalp-recorded Event-Related Potentials (ERPs) demonstrates that recognition memory can produce dissociable brain signals under a variety of circumstances. While many studies have reported dissociations between the putative ‘dual processes’ of familiarity and recollection, a growing number of reports demonstrate that recollection itself may be fractionated into component processes. Many recognition memory studies using lexical materials as stimuli have reported a left parietal ERP old/new effect for recollection; however, when unfamiliar faces are recollected, an anterior effect can be observed. This paper addresses two separate hypotheses concerning the functional significance of the anterior old/new effect: perceptual retrieval and semantic status. The perceptual retrieval view is that the anterior effect reflects reinstatement of perceptual information bound up in an episodic representation, while the semantic status view is that information not represented in semantic memory pre-experimentally elicits the anterior effect instead of the left parietal effect. We tested these two competing accounts by investigating recognition memory for unfamiliar faces and famous faces in two separate experiments, in which same or different pictures of studied faces were presented as test items to permit brain activity associated with retrieving face and perceptual information to be examined independently. The difference in neural activity between same and different picture hits was operationalized as a pattern of activation associated with perceptual retrieval; while the contrast between different picture hits and correct rejection of new faces was assumed to reflect face retrieval. In Experiment 1, using unfamiliar faces, the anterior old/new effect (500–700 ms) was observed for face retrieval but not for perceptual retrieval, challenging the perceptual retrieval hypothesis. In Experiment 2, using famous faces, face retrieval was associated with a left parietal effect (500–700 ms), supporting the semantic representation hypothesis. A between-subjects analysis comparing scalp topography across the two experiments found that the anterior effect observed for unfamiliar faces is dissociable from the left parietal effect found for famous faces. This pattern of results supports the hypothesis that an item's status in semantic memory determines how it is recognized.

•

Famous faces are recognized more easily than unfamiliar faces.

•

Left parietal ERP old/new effect is observed for famous faces.

•

Anterior ERP old/new effect is observed for unfamiliar faces.

•

Semantic status determines how faces are recognized.

Incidental memory for faces in children with different genetic subtypes of Prader-Willi syndrome

The present study examined the effects of genetic subtype on social memory in children (7–16 years) with Prader–Willi syndrome (PWS). Visual event-related potentials (ERPs) during a passive viewing task were used to compare incidental memory traces for repeated vs single presentations of previously unfamiliar social (faces) and nonsocial (houses) images in 15 children with the deletion subtype and 13 children with maternal uniparental disomy (mUPD). While all participants perceived faces as different from houses (N170 responses), repeated faces elicited more positive ERP amplitudes (‘old/new’ effect, 250–500ms) only in children with the deletion subtype. Conversely, the mUPD group demonstrated reduced amplitudes suggestive of habituation to the repeated faces. ERP responses to repeated vs single house images did not differ in either group. The results suggest that faces hold different motivational value for individuals with the deletion vs mUPD subtype of PWS and could contribute to the explanation of subtype differences in the psychiatric symptoms, including autism symptomatology.

Intact word processing in developmental prosopagnosia

A wealth of evidence from behavioural, neuropsychological and neuroimaging research supports the view that face recognition is reliant upon a domain-specific network that does not process words. In contrast, the recent many-to-many model of visual recognition posits that brain areas involved in word and face recognition are functionally integrated. Developmental prosopagnosia (DP) is characterised by severe deficits in the recognition of faces, which the many-to-many model predicts should negatively affect word recognition. Alternatively, domain-specific accounts suggest that impairments in face and word processing need not go hand in hand. To test these possibilities, we ran a battery of 7 tasks examining word processing in a group of DP cases and controls. One of our prosopagnosia cases exhibited a severe reading impairment with delayed response times during reading aloud tasks, but not lexical decision tasks. Overall, however, we found no evidence of global word processing deficits in DP, consistent with a dissociation account for face and word processing.

Speak My Language and I Will Remember Your Face Better: An ERP Study

Here we investigated how the language in which a person addresses us, native or foreign, influences subsequent face recognition. In an old/new paradigm, we explored the behavioral and electrophysiological activity associated with face recognition memory. Participants were first presented with faces accompanied by voices speaking either in their native (NL) or foreign language (FL). Faces were then presented in isolation and participants decided whether the face was presented before (old) or not (new). The results revealed that participants were more accurate at remembering faces previously paired with their native as opposed to their FL. At the event-related potential (ERP) level, we obtained evidence that faces in the NL were differently encoded from those in the FL condition, potentially due to differences in processing demands. During recognition, the frontal old/new effect was present (with a difference in latency) regardless of the language with which a face was associated, while the parietal old/new effect appeared only for faces associated with the native language. These results suggest that the language of our social interactions has an impact on the memory processes underlying the recognition of individuals.

Separating content-specific retrieval from post-retrieval processing

According to cortical reinstatement accounts, neural processes engaged at the time of encoding are re-engaged at the time of memory retrieval. The temporal precision of event-related potentials (ERPs) has been exploited to assess this possibility, and in this study ERPs were acquired while people made memory judgments to visually presented words encoded in two different ways. There were reliable differences between the scalp distributions of the signatures of successful retrieval of different contents from 300 to 1100 ms after stimulus presentation. Moreover, the scalp distributions of these content-sensitive effects changed during this period. These findings are, to our knowledge, the first demonstration in one study that ERPs reflect content-specific processing in two separable ways: first, via reinstatement, and second, via downstream processes that operate on recovered information in the service of memory judgments.

Elements of person knowledge: Episodic recollection helps us to identify people but not to recognize their faces

Faces automatically draw attention, allowing rapid assessments of personality and likely behaviour. How we respond to people is, however, highly dependent on whether we know who they are. According to face processing models person knowledge comes from an extended neural system that includes structures linked to episodic memory. Here we use scalp recorded brain signals to demonstrate the specific role of episodic memory processes during face processing. In two experiments we recorded Event-Related Potentials (ERPs) while participants made identify, familiar or unknown responses to famous faces. ERPs revealed neural signals previously associated with episodic recollection for identify but not familiar faces. These findings provide novel evidence suggesting that recollection is central to face processing, providing one source of person knowledge that can be used to moderate the initial impressions gleaned from the core neural system that supports face recognition.

Electrophysiological Correlates of Emotional Source Memory in High-Trait-Anxiety Individuals

The interaction between recognition memory and emotion has become a research hotspot in recent years. Dual process theory posits that familiarity and recollection are two separate processes contributing to recognition memory, but further experimental evidence is needed. The present study explored the emotional context effects on successful and unsuccessful source retrieval amongst 15 high-trait-anxiety college students by using event-related potentials (ERPs) measurement. During study, a happy, fearful, or neutral face picture first was displayed, then a Chinese word was superimposed centrally on the picture and subjects were asked to remember the word and the corresponding type of picture. During the test participants were instructed to press one of four buttons to indicate whether the displayed word was an old or new word. And then, for the old word, indicate whether it had been shown with a fearful, happy, or neutral face during the study. ERPs were generally more positive for remembered words than for new words and the ERP difference was termed as an old/new effect. It was found that, for successful source retrieval (it meant both the item and the source were remembered accurately) between 500 and 700 ms (corresponding to a late positive component, LPC), there were significant old/new effects in all contexts. However, for unsuccessful source retrieval (it meant the correct recognition of old items matched with incorrect source attribution), there were no significant old/new effects in happy and neutral contexts, though significant old/new effects were observed in the fearful context. Between 700 and 1200 ms (corresponding to a late slow wave, LSW), there were significant old/new effects for successful source retrieval in happy and neutral contexts. However, in the fearful context, the old/new effects were reversed, ERPs were more negative for successful source retrieval compared to correct rejections. Moreover, there were significant emotion effects for successful source retrieval at this time window. Further analysis showed ERPs of old items were more negative in fearful context than in neutral context. The results showed that early unsuccessful fearful source retrieval processes (related to familiarity) were enhanced, but late successful fearful source retrieval processes during source retrieval monitoring (related to recollection) were weakened. This provided preliminary evidence for the dual processing theory.

Separating the FN400 and N400 potentials across recognition memory experiments

There is a growing debate as to whether frontally distributed FN400 potentials reflect familiarity-based recognition or are functionally identical to centro-parietal N400 reflecting semantic processing. We conducted two experiments in which event-related potentials (ERPs) associated with semantic priming and recognition were recorded, either when priming was embedded within a recognition test (Experiment 1), or when these two phases were separated (Experiment 2). In Experiment 1, we observed 300-500 ms differences between primed and unprimed old words as well as differences between old and new primed words, but these two effects did not differ topographically and both showed midline central maxima. In Experiment 2, the N400 for priming was recorded exclusively during encoding and again showed a midline central distribution. The ERP component of recognition was only found for unrelated words (not primed previously during encoding), and also showed a midline central maximum, but, in addition, was present in the left frontal area of the scalp. Conversely, the priming effect was absent in the left frontal cluster. This pattern of results indicate that FN400 and N400 potentials share similar neural generators; but when priming and recognition are not confounded, these potentials do not entirely overlap in terms of topographical distribution and presumably reflect functionally distinct processes.

Face repetition detection and social interest: An ERP study in adults with and without Williams syndrome

The present study examined possible neural mechanisms underlying increased social interest in persons with Williams syndrome (WS). Visual event-related potentials (ERPs) during passive viewing were used to compare incidental memory traces for repeated vs. single presentations of previously unfamiliar social (faces) and nonsocial (houses) images in 26 adults with WS and 26 typical adults. Results indicated that participants with WS developed familiarity with the repeated faces and houses (frontal N400 response), but only typical adults evidenced the parietal old/new effect (previously associated with stimulus recollection) for the repeated faces. There was also no evidence of exceptional salience of social information in WS, as ERP markers of memory for repeated faces vs. houses were not significantly different. Thus, while persons with WS exhibit behavioral evidence of increased social interest, their processing of social information in the absence of specific instructions may be relatively superficial. The ERP evidence of face repetition detection in WS was independent of IQ and the earlier perceptual differentiation of social vs. nonsocial stimuli. Large individual differences in ERPs of participants with WS may provide valuable information for understanding the WS phenotype and have relevance for educational and treatment purposes.

Event-related potentials in response to cheating and cooperation in a social dilemma game

A sequential prisoner's dilemma game was combined with psychophysiological measures to examine the cognitive underpinnings of reciprocal exchange. Participants played four rounds of the game with partners who either cooperated or cheated. In a control condition, the partners' faces were shown, but no interaction took place. The partners' behaviors were consistent in the first three rounds of the game, but in the last round some of the partners unexpectedly changed strategies. In the first round of the game, the feedback about a partner's decision elicited a feedback P300, which was more pronounced for cooperation and cheating in comparison to the control condition, but did not vary as a function of feedback valence. In the last round, both the feedback negativity and the feedback P300 were sensitive to expectancy violations. There was no consistent evidence for a negativity bias, that is, enhanced allocation of attention to feedback about another person's cheating in comparison to feedback about another person's cooperation. Instead, participants focused on both positive and negative information, and flexibly adjusted their processing biases to the diagnosticity of the information. This conclusion was corroborated by the ERP correlates of memory retrieval. Successful retrieval of a partner's reputation was associated with an anterior positivity between 400 and 600 ms after face onset. This anterior positivity was more pronounced for both cooperator and cheater faces in comparison to control faces. The results suggest that it is not the negativity of social information, but rather its motivational and behavioral relevance that determines its processing.

Conceptual fluency increases recollection: behavioral and electrophysiological evidence

It is widely established that fluency can contribute to recognition memory. Previous studies have found that enhanced fluency increases familiarity, but not recollection. The present study was motivated by a previous finding that conceptual priming affected recollection. We used event-related potentials to investigate the electrophysiological correlates of these effects with conceptually related two-character Chinese words. We found that previous conceptual priming effects on conceptual fluency only increased the incidence of recollection responses. We also found that enhanced conceptual fluency was associated with N400 attenuation, which was also correlated with the behavioral indicator of recollection. These results suggest that the N400 effect might be related to the impact of conceptual fluency on recollection recognition. These study findings provide further evidence for the relationship between fluency and recollection.

Electrophysiological correlates associated with contributions of perceptual and conceptual fluency to familiarity

The present research manipulated the fluency of unstudied items using masked repetition priming procedures during an explicit recognition test. Based on fluency-attribution accounts, which posit that familiarity can be driven by multiple forms of fluency, the relationship between masked priming-induced fluency and familiarity was investigated. We classified pictographic characters into High-Meaningfulness (High-M) and Low-Meaningfulness (Low-M) categories on the basis of subjective meaningfulness ratings and identified the distinct electrophysiological correlates of perceptual and conceptual fluency. The two types of fluency differed in associated ERP effects: 150-250 ms effects for perceptual fluency and FN400 effects for conceptual fluency. The ERPs of Low-M MP-same (items that were preceded by matching masked items) false alarms were more positive than correct rejections during 150-250 ms, whereas the ERPs of High-M MP-same false alarms were more positive than correct rejections during 300-500 ms. The topographic patterns of FN400 effects between High-M MP-same false alarms and Low-M MP-same false alarms were not different from those of High-M hits and Low-M hits. These results indicate that both forms of fluency can contribute to familiarity, and the neural correlates of conceptual fluency are not different from those of conceptual priming induced by prior study-phase exposure. We conclude that multiple neural signals potentially contribute to recognition memory, such as numerous forms of fluency differing in terms of their time courses.

ERP responses to face repetition during passive viewing: a nonverbal measure of social motivation in children with autism and typical development

This study examined whether individual differences in social motivation affect the extent of processing of social versus nonsocial information. Event-related potentials were recorded in 13 children with autism spectrum disorder and 11 typically developing children during passive viewing of unfamiliar faces and houses. One image in each category was presented repeatedly, the rest were shown once. Analyses indicated no group differences in the early perceptual responses. Only typical children evidenced larger P600 for the repeated faces. These results were replicated during a retest session. Individual differences in memory for the repeated faces correlated with standardized behavioral assessments of social skills.

Recognition memory in developmental prosopagnosia: electrophysiological evidence for abnormal routes to face recognition

Dual process models of recognition memory propose two distinct routes for recognizing a face: recollection and familiarity. Recollection is characterized by the remembering of some contextual detail from a previous encounter with a face whereas familiarity is the feeling of finding a face familiar without any contextual details. The Remember/Know (R/K) paradigm is thought to index the relative contributions of recollection and familiarity to recognition performance. Despite researchers measuring face recognition deficits in developmental prosopagnosia (DP) through a variety of methods, none have considered the distinct contributions of recollection and familiarity to recognition performance. The present study examined recognition memory for faces in eight individuals with DP and a group of controls using an R/K paradigm while recording electroencephalogram (EEG) data at the scalp. Those with DP were found to produce fewer correct “remember” responses and more false alarms than controls. EEG results showed that posterior “remember” old/new effects were delayed and restricted to the right posterior (RP) area in those with DP in comparison to the controls. A posterior “know” old/new effect commonly associated with familiarity for faces was only present in the controls whereas individuals with DP exhibited a frontal “know” old/new effect commonly associated with words, objects and pictures. These results suggest that individuals with DP do not utilize normal face-specific routes when making face recognition judgments but instead process faces using a pathway more commonly associated with objects.

Parallel effects of processing fluency and positive affect on familiarity-based recognition decisions for faces

According to attribution models of familiarity assessment, people can use a heuristic in recognition-memory decisions, in which they attribute the subjective ease of processing of a memory probe to a prior encounter with the stimulus in question. Research in social cognition suggests that experienced positive affect may be the proximal cue that signals fluency in various experimental contexts. In the present study, we compared the effects of positive affect and fluency on recognition-memory judgments for faces with neutral emotional expression. We predicted that if positive affect is indeed the critical cue that signals processing fluency at retrieval, then its manipulation should produce effects that closely mirror those produced by manipulations of processing fluency. In two experiments, we employed a masked-priming procedure in combination with a Remember-Know (RK) paradigm that aimed to separate familiarity- from recollection-based memory decisions. In addition, participants performed a prime-discrimination task that allowed us to take inter-individual differences in prime awareness into account. We found highly similar effects of our priming manipulations of processing fluency and of positive affect. In both cases, the critical effect was specific to familiarity-based recognition responses. Moreover, in both experiments it was reflected in a shift toward a more liberal response bias, rather than in changed discrimination. Finally, in both experiments, the effect was found to be related to prime awareness; it was present only in participants who reported a lack of such awareness on the prime-discrimination task. These findings add to a growing body of evidence that points not only to a role of fluency, but also of positive affect in familiarity assessment. As such they are consistent with the idea that fluency itself may be hedonically marked.

Neural correlates of the in-group memory advantage on the encoding and recognition of faces

People have a memory advantage for faces that belong to the same group, for example, that attend the same university or have the same personality type. Faces from such in-group members are assumed to receive more attention during memory encoding and are therefore recognized more accurately. Here we use event-related potentials related to memory encoding and retrieval to investigate the neural correlates of the in-group memory advantage. Using the minimal group procedure, subjects were classified based on a bogus personality test as belonging to one of two personality types. While the electroencephalogram was recorded, subjects studied and recognized faces supposedly belonging to the subject’s own and the other personality type. Subjects recognized in-group faces more accurately than out-group faces but the effect size was small. Using the individual behavioral in-group memory advantage in multivariate analyses of covariance, we determined neural correlates of the in-group advantage. During memory encoding (300 to 1000 ms after stimulus onset), subjects with a high in-group memory advantage elicited more positive amplitudes for subsequently remembered in-group than out-group faces, showing that in-group faces received more attention and elicited more neural activity during initial encoding. Early during memory retrieval (300 to 500 ms), frontal brain areas were more activated for remembered in-group faces indicating an early detection of group membership. Surprisingly, the parietal old/new effect (600 to 900 ms) thought to indicate recollection processes differed between in-group and out-group faces independent from the behavioral in-group memory advantage. This finding suggests that group membership affects memory retrieval independent of memory performance. Comparisons with a previous study on the other-race effect, another memory phenomenon influenced by social classification of faces, suggested that the in-group memory advantage is dominated by top-down processing whereas the other-race effect is also influenced by extensive perceptual experience.

Effects of oxytocin on behavioral and ERP measures of recognition memory for own-race and other-race faces in women and men

Oxytocin has been shown to affect human social information processing including recognition memory for faces. Here we investigated the neural processes underlying the effect of oxytocin on memorizing own-race and other-race faces in men and women. In a placebo-controlled, double-blind, between-subject study, participants received either oxytocin or placebo before studying own-race and other-race faces. We recorded event-related potentials (ERPs) during both the study and recognition phase to investigate neural correlates of oxytocin's effect on memory encoding, memory retrieval, and perception. Oxytocin increased the accuracy of familiarity judgments in the recognition test. Neural correlates for this effect were found in ERPs related to memory encoding and retrieval but not perception. In contrast to its facilitating effects on familiarity, oxytocin impaired recollection judgments, but in men only. Oxytocin did not differentially affect own-race and other-race faces. This study shows that oxytocin influences memory, but not perceptual processes, in a face recognition task and is the first to reveal sex differences in the effect of oxytocin on face memory. Contrary to recent findings in oxytocin and moral decision making, oxytocin did not preferentially improve memory for own-race faces.