Dissociable neural correlates for familiarity and recollection during the encoding and retrieval of pictures

Neural signatures of recollection are sensitive to memory quality and specific event features

Episodic memories reflect a bound representation of multimodal features that can be recollected with varying levels of precision. Recent fMRI investigations have demonstrated that the precision and content of information retrieved from memory engage a network of posterior medial temporal and parietal regions co-activated with the hippocampus. Yet, comparatively little is known about how memory content and precision affect common neural signatures of memory captured by electroencephalography (EEG), where recollection has been associated with changes in event-related potential (ERP) and oscillatory measures of neural activity. Here, we used a multi-feature paradigm previously reported in Cooper & Ritchey (2019) with continuous measures of memory, in conjunction with scalp EEG, to characterize the content and quality of information that drives ERP and oscillatory markers of episodic memory. A common signature of memory retrieval in left posterior regions, called the late positive component (LPC), was sensitive to overall memory quality and also to precision of recollection for spatial features. Analysis of oscillatory markers during recollection revealed that alpha/beta desynchronization was modulated by overall memory quality and also by individual features in memory. Importantly, we found evidence of a relationship between these two neural markers of memory retrieval, suggesting that they may represent complementary aspects of the recollection experience. These findings demonstrate how time-sensitive and dynamic processes identified with EEG correspond to overall episodic recollection, and also to the retrieval of precise features in memory.

Context familiarity is a third kind of episodic memory distinct from item familiarity and recollection

Episodic memory is accounted for with two processes: "familiarity" when generally recognizing an item and "recollection" when retrieving the full contextual details bound with the item. We tested a combination of item recognition confidence and source memory, focusing upon three conditions: "item-only hits with source unknown" ('item familiarity'), "low-confidence hits with correct source memory" ('context familiarity'), and "high-confidence hits with correct source memory" ('recollection'). Behaviorally, context familiarity was slower than the others during item recognition, but faster during source memory. Electrophysiologically, a triple dissociation was evident in event-related potentials (ERPs), which was independently replicated. Context familiarity exhibited a negative effect from 800 to 1200 ms, differentiated from positive ERPs for item-familiarity (400-600 ms) and recollection (600-900 ms). These three conditions thus reflect mutually exclusive, fundamentally different processes of episodic memory, and we offer a new, tri-component model of memory. Context familiarity is a third distinct process of episodic memory.

Pattern separation during encoding and Subsequent Memory Effect

Memory retrieval has been extensively studied in relation to the encoding processes that precede access to stored information. Event related potentials (ERP) research has compared brain potentials elicited during the study phase of successful and unsuccessful retrieval, finding greater activation for the subsequent retrieval information. In this work we were interested in exploring the neural markers associated to subsequent recognition when similar memories are subsequently encoded. We used a Subsequent Memory paradigm in which we manipulated the number of similar items within a category (2 or 6) that participants encoded. Manipulating the number of similar encoded items within a category allowed us to test whether encoding markers of subsequent recognition depend solely on memory trace strength or, on the contrary, successful recognition is influenced by subsequently presented similar memories, and consequently may not be reflected in higher activation in such cases. After a 20-minute period, participants performed a recognition task providing one of a three-option judgement: "old", "similar" and "new", which allowed us to test if the amplitude of ERP waveforms varied based on the similarity judgement of the unrecognized encoded item. We did not observe a significant parietal subsequent memory effect, however, old hits and similar false alarms were both significantly different from similar correct rejections and old false alarms in ERP retrieval. These findings suggest that differences in brain responses between conditions are specifically related to the retrieval process and not the encoding process, indicating potential differential effects on memory during retrieval. Moreover, it is also possible that differences in brain responses develop or change over the rest time between phases, influencing how these conditions manifest across different stages of information processing.

Memory-related brain potentials for visual objects in early AD show impairment and compensatory mechanisms

Impaired episodic memory is the primary feature of early Alzheimer's disease (AD), but not all memories are equally affected. Patients with AD and amnestic Mild Cognitive Impairment (aMCI) remember pictures better than words, to a greater extent than healthy elderly. We investigated neural mechanisms for visual object recognition in 30 patients (14 AD, 16 aMCI) and 36 cognitively unimpaired healthy (19 in the "preclinical" stage of AD). Event-related brain potentials (ERPs) were recorded while participants performed a visual object recognition task. Hippocampal occupancy (integrity), amyloid (florbetapir) PET, and neuropsychological measures of verbal & visual memory, executive function were also collected. A right-frontal ERP recognition effect (500-700 ms post-stimulus) was seen in cognitively unimpaired participants only, and significantly correlated with memory and executive function abilities. A later right-posterior negative ERP effect (700-900 ms) correlated with visual memory abilities across participants with low verbal memory ability, and may reflect a compensatory mechanism. A correlation of this retrieval-related negativity with right hippocampal occupancy (r = 0.55), implicates the hippocampus in the engagement of compensatory perceptual retrieval mechanisms. Our results suggest that early AD patients are impaired in goal-directed retrieval processing, but may engage compensatory perceptual mechanisms which rely on hippocampal function.

Event-related potentials during encoding coincide with subsequent forced-choice mnemonic discrimination

Computational models and eye-tracking research suggest that encoding variability accounts for the reduced recognition of targets (A) when paired with non-corresponding lures (B') relative to corresponding lures (A'). The current study examined whether neural activity during learning coincided with subsequent performance on the forced-choice Mnemonic Similarity Task (MST). Event-related potential responses were collected during encoding while young adults completed A-B' and A-A' trials of the forced-choice MST. Consistent with previous research, performance was lower on A-B' trials than A-A' trials. The subsequent memory effect was not significant for the A-A' test format. However, for A-B' trials, we observed a significant Accuracy × Stimulus interaction 1000-1200 ms poststimulus onset across frontal and fronto-central electrodes. As hypothesized, subsequently correct A-B' trials were associated with a larger amplitude response at encoding to the target (A) than the original version of the non-corresponding lure (B). However, subsequently incorrect trials were associated with a larger amplitude response to the non-corresponding lure (B) than the target stimulus (A). These findings provide additional support for the effect of encoding variability on mnemonic discrimination.

Effects of congruent emotional contexts during encoding on recognition: An ERPs study

Past research showed that emotional contexts can impair recognition memory for the target item. Given that item-context congruity may enhance recognition memory, the present study aims to examine the effect of the congruent emotional encoding contexts on recognition memory. Participants studied congruent word-picture pairs (e.g., the word "cow" - a picture describing a cow) and incongruent word-picture pairs (e.g., the word "cow" - a picture describing a goat) and, subsequently, were asked to report the nature of the picture (emotional or neutral). Behavioral results revealed that emotional contexts impaired source but not item recognition, with congruent word-context mitigating this impairment and enhancing item recognition. Neural results from ERPs and theta oscillations found the recollection process, as shown by the LPC old/new effect and theta oscillations, for both item and source recognition across emotional contexts, irrespective of congruity. Meanwhile, the familiarity process as indexed by the FN400 old/new effect was found only for item recognition in congruent emotional contexts. These findings suggest that the congruent relationship of item-context could mitigate the emotion-induced source memory impairment and enhance item memory, with neural results elucidating the memory processes involved in retrieval of emotional information. Specifically, while emotion-related information generally elicits the recollection-based memory process, only congruent emotional information elicits the familiarity-based process.

Beyond the ears: A review exploring the interconnected brain behind the hierarchical memory of music

Music is a ubiquitous element of daily life. Understanding how music memory is represented and expressed in the brain is key to understanding how music can influence human daily cognitive tasks. Current music-memory literature is built on data from very heterogeneous tasks for measuring memory, and the neural correlates appear to differ depending on different forms of memory function targeted. Such heterogeneity leaves many exceptions and conflicts in the data underexplained (e.g., hippocampal involvement in music memory is debated). This review provides an overview of existing neuroimaging results from music-memory related studies and concludes that although music is a special class of event in our lives, the memory systems behind it do in fact share neural mechanisms with memories from other modalities. We suggest that dividing music memory into different levels of a hierarchy (structural level and semantic level) helps understand overlap and divergence in neural networks involved. This is grounded in the fact that memorizing a piece of music recruits brain clusters that separately support functions including-but not limited to-syntax storage and retrieval, temporal processing, prediction versus reality comparison, stimulus feature integration, personal memory associations, and emotion perception. The cross-talk between frontal-parietal music structural processing centers and the subcortical emotion and context encoding areas explains why music is not only so easily memorable but can also serve as strong contextual information for encoding and retrieving nonmusic information in our lives.

A meta-analysis of event-related potential correlates of recognition memory

A longstanding question in memory research is whether recognition is supported by more than one mnemonic process. Dual-process models distinguish recollection of episodic detail from familiarity, while single-process models explain recognition in terms of one process that varies in strength. Dual process models have drawn support from findings that recollection and familiarity elicit distinct electroencephalographic event-related potentials (ERPs): a mid-frontal ERP effect that occurs at around 300-500 ms post-stimulus onset and is often larger for familiarity than recollection contrasts, and a parietal ERP effect that occurs at around 500-800 ms and is larger for recollection than familiarity contrasts. We sought to adjudicate between dual- and single-process models by investigating whether the dissociation between these two ERP effects is reliable over studies. We extracted effect sizes from 41 experiments that had used Remember-Know, source memory, and associative memory paradigms (1,000 participants). Meta-analysis revealed a strong interaction between ERP effect and mnemonic process of the form predicted by dual-process models. Although neither ERP effect was significantly process-selective taken alone, a moderator analysis revealed a larger mid-frontal effect for familiarity than recollection contrasts in studies using the Remember-Know paradigm. Mega-analysis of raw data from six studies further showed significant process-selectivity for both mid-frontal and parietal ERPs in the predicted time windows. On balance, the findings favor dual- over single-process theories of recognition memory, but point to a need to promote sharing of raw data.

Observing memory encoding while it unfolds: Functional interpretation and current debates regarding ERP subsequent memory effects

Our ability to remember the past depends on neural processes set in train in the moment an event is experienced. These processes can be studied by segregating brain activity according to whether an event is later remembered or forgotten. The present review integrates a large number of studies examining this differential brain activity, labeled subsequent memory effect (SME), with the ERP technique, into a functional organization and discusses routes for further research. Based on the reviewed literature, we suggest that memory encoding is implemented by multiple processes, typically reflected in three functionally different subcomponents of the ERP SME elicited by study stimuli, which presumably interact with preparatory SME activity preceding the to be encoded event. We argue that ERPs are a valuable method in the SME paradigm because they have a sufficiently high temporal resolution to disclose the subcomponents of encoding-related brain activity. Implications of the proposed functional organization for future studies using the SME procedure in basic and applied settings will be discussed.

Effect of retrieval reward on episodic recognition with different difficulty: ERP evidence

Previous studies found that the reward effect is stronger in more difficult retrieval tasks of item memory. However, it remains unclear whether the effect of reward is influenced by the memory task difficulty level in the source memory. We investigated the effects and neural mechanisms of the processing depth during encoding and rewards at retrieval on the item and source memory using event-related potentials (ERPs). Participants were required to carry out the congruity-judgment (deep processing) and size-judgment (shallow processing) tasks during encoding, and they completed separate object and background tests (half presented with reward) immediately after encoding. The results revealed that congruity-judgment (compare to size-judgment) task had longer response time in encoding phase, and evoked significantly greater reward differences at Prs (the hit rate minus the false alarm rate) in item retrieval, and the reward (relative to no reward) significantly improved recognition accuracy in source retrieval. ERP results also showed that congruity-judgment (compare to size-judgment) task evoked the larger N170, P3a, LPP and a decreased P3b of the stimuli in encoding phase, and elicited the wider distribution of LPC and LPN reward effects (i.e., the average amplitudes under the reward condition were significantly more positive than under the non-reward condition) in item retrieval, and the reward effects at FN400, LPC, and LPN were found only in the congruity-judged items with optimal difficulty in source retrieval. The results suggest that reward at retrieval evoked a greater boost in the congruity-judged stimuli, whether in item or source retrieval, which maybe be related to their optimal retrieval difficulty (Pr is closer to medium 0.50). This meant that the reward is more effective in memory retrieval with optimal difficulty.

Deficient Novelty Detection and Encoding in Early Alzheimer’s Disease: An ERP Study

Patients with early Alzheimer’s disease (AD) have difficulty in learning new information and in detecting novel stimuli. The underlying physiological mechanisms are not well known. We investigated the electrophysiological correlates of the early (< 400 ms), automatic phase of novelty detection and encoding in AD. We used high-density EEG Queryin patients with early AD and healthy age-matched controls who performed a continuous recognition task (CRT) involving new stimuli (New), thought to provoke novelty detection and encoding, which were then repeated up to 4 consecutive times to produce over-familiarity with the stimuli. Stimuli then reappeared after 9–15 intervening items (N-back) to be re-encoded. AD patients had substantial difficulty in detecting novel stimuli and recognizing repeated ones. Main evoked potential differences between repeated and new stimuli emerged at 180–260 ms: neural source estimations in controls revealed more extended MTL activation for N-back stimuli and anterior temporal lobe activations for New stimuli compared to highly familiar repetitions. In contrast, AD patients exhibited no activation differences between the three stimulus types. In direct comparison, healthy subjects had significantly stronger MTL activation in response to New and N-back stimuli than AD patients. These results point to abnormally weak early MTL activity as a correlate of deficient novelty detection and encoding in early AD.

Individual differences in behavioral and electrophysiological signatures of familiarity- and recollection-based recognition memory

Our everyday memories can vary in terms of accuracy and phenomenology. According to one theoretical account, these differences hinge on whether the memories contain information about both an item itself as well as associated details (remember) versus those that are devoid of these associated contextual details (familiar). This distinction has been supported by computational modeling of behavior, studies in patients, and neuroimaging work including differences both in electrophysiological and functional magnetic resonance imaging. At present, however, little evidence has emerged to suggest that neurophysiological measures track individual differences in estimates of recollection and familiarity. Here, we conducted electrophysiological recordings of brain activity during a recognition memory task designed to differentiate between behavioral indices of recollection and familiarity. Non-parametric cluster-based permutation analyses revealed associations between electrophysiological signatures of familiarity and recollection with their respective behavioral estimates. These results support the idea that recollection and familiarity are distinct phenomena and is the first, to our knowledge, to identify distinct electrophysiological signatures that track individual differences in these processes.

Temporal Expectation Improves Recognition Memory for Spatially Attended Objects

Recent evidence suggests that temporal expectation is beneficial to memory formation. Rhythmic presentation of stimuli during encoding enhances subsequent recognition and is associated with distinct neural activity compared with when stimuli are presented in an arrhythmic manner. However, no prior study has examined how temporal expectation interacts with another important form of facilitation-spatial attention-to affect memory. This study systematically manipulated temporal expectation and spatial attention during encoding to examine their combined effect on behavioral recognition and associated ERPs. Participants performed eight experimental blocks consisting of an encoding phase and recognition test, with EEG recorded throughout. During encoding, pairs of objects and checkerboards were presented and participants were cued to attend to the left or right stream and detect targets as quickly as possible. In four blocks, stimulus presentation followed a rhythmic (constant, predictable) temporal structure, and in the other four blocks, stimulus onset was arrhythmic (random, unpredictable). An interaction between temporal expectation and spatial attention emerged, with greater recognition in the rhythmic than the arrhythmic condition for spatially attended items. Analysis of memory-specific ERP components uncovered effects of spatial attention. There were late positive component and FN400 old/new effects in the attended condition for both rhythmic and arrhythmic items, whereas in the unattended condition, there was an FN400 old/new effect and no late positive component effect. The study provides new evidence that memory improvement as a function of temporal expectation is dependent upon spatial attention.

Recruitment of a long-term memory supporting neural network during repeated maintenance of a multi-item abstract visual image in working memory

Humans can flexibly transfer information between different memory systems. Information in visual working memory (VWM) can for instance be stored in long-term memory (LTM). Conversely, information can be retrieved from LTM and temporarily held in WM when needed. It has previously been suggested that a neural transition from parietal- to midfrontal activity during repeated visual search reflects transfer of information from WM to LTM. Whether this neural transition indeed reflects consolidation and is also observed when memorizing a rich visual scene (rather than responding to a single target), is not known. To investigate this, we employed an EEG paradigm, in which abstract six-item colour-arrays were repeatedly memorized and explicitly visualized, or merely attended to. Importantly, we tested the functional significance of a potential neural shift for longer-term consolidation in a subsequent recognition task. Our results show a gradually enhanced- and sustained modulation of the midfrontal P170 component and a decline in parietal CDA, during repeated WM maintenance. Improved recollection/visualization of memoranda upon WM-cueing, was associated with contralateral parietal- and right temporal activity. Importantly, only colour-arrays previously held in WM, induced a greater midfrontal P170-response, together with left temporal- and late centro-parietal activity, upon re-exposure. These findings provide evidence for recruitment of an LTM-supporting neural network which facilitates visual WM maintenance.

Effect of the congruity of emotional contexts at encoding on source memory: Evidence from ERPs

Emotion's influence on source memory has proven more elusive and the lack of studies investigates the effect of the congruent emotional contexts on source memory. Here, we investigated these issues using event-related potentials (ERPs) to assess emotional-induced neural correlates. During encoding, congruent word-picture (a word 'shoes' - a picture described shoes) and incongruent word-picture (a word 'pepper' - a picture described shoes) with a prompt (Common? or Natural?) were presented. At retrieval, participants indicated which prompts were concomitantly presented with the word during encoding. Behavioral results revealed that source memory accuracy was enhanced in the neutral contexts compared to the negative contexts, and enhanced in the incongruent condition relative to the congruent condition, suggesting that emotional contexts impaired source memory performance, and incongruent information enhanced source memory. ERPs results showed that early P2 old/new effect (150-250 ms) and FN400 old/new effect (300-450 ms) were observed for words with correct source that had been encoded in the congruent emotional contexts, and that a larger parietal old/new effect, between 500 and 700 ms, was observed for words with correct source that had been encoded in the incongruent condition than in the congruent condition, irrespective the nature of context. The ERPs results indicate that retrieval of source details for the associated emotionally congruent information supports the idea that emotional events could attract more attentional resources, and reflects the contribution of familiarity-based process. Meanwhile, retrieval of source details for the associated incongruent information reflects a stronger contribution of recollection-based process.

Rapid Sequential Implication of the Human Medial Temporal Lobe in Memory Encoding and Recognition

The medial temporal lobe (MTL) is crucial for memory encoding and recognition. The time course of these processes is unknown. The present study juxtaposed encoding and recognition in a single paradigm. Twenty healthy subjects performed a continuous recognition task as brain activity was monitored with a high-density electroencephalography. The task presented New pictures thought to evoke encoding. The stimuli were then repeated up to 4 consecutive times to produce over-familiarity. These repeated stimuli served as "baseline" for comparison with the other stimuli. Stimuli later reappeared after 9-15 intervening items, presumably associated with new encoding and recognition. Encoding-related differences in evoked response potential amplitudes and in spatiotemporal analysis were observed at 145-300 ms, whereby source estimation indicated MTL and orbitofrontal activity from 145 to 205 ms. Recognition-related activity evoked by late repetitions occurred at 405-470 ms, implicating the MTL and neocortical structures. These findings indicate that encoding of information is initiated before it is recognized. The result helps to explain modifications of memories over time, including false memories, confabulation, and consolidation.

Memory after visual search: Overlapping phonology, shared meaning, and bilingual experience influence what we remember

How we remember the things that we see can be shaped by our prior experiences. Here, we examine how linguistic and sensory experiences interact to influence visual memory. Objects in a visual search that shared phonology (cat-cast) or semantics (dog-fox) with a target were later remembered better than unrelated items. Phonological overlap had a greater influence on memory when targets were cued by spoken words, while semantic overlap had a greater effect when targets were cued by characteristic sounds. The influence of overlap on memory varied as a function of individual differences in language experience -- greater bilingual experience was associated with decreased impact of overlap on memory. We conclude that phonological and semantic features of objects influence memory differently depending on individual differences in language experience, guiding not only what we initially look at, but also what we later remember.

Late frontal positivity effects in Self-referential Memory: Unique to the Self?

The self-reference effect in memory (SRE), in which stimuli related to self are better remembered than other stimuli, has been studied often in the fMRI literature, but much less with EEG. In two experiments, we investigated how self-referencing modulated event-related potential (ERP) markers of the subsequent memory effect, testing whether the same components that reflect memory success are impacted or whether unique components are modulated by self-referencing. Participants were asked to evaluate whether an adjective accurately described either the self or a given other by making a yes/no key press during EEG recording. Then participants were given a surprise recognition memory test where they judged each adjective as old or new. We observed a main effect of self-relevance on a late positivity at right frontal electrodes. A very similar effect was observed when comparing words subsequently remembered to those that were forgotten. However, no interaction was found between self-relevance and subsequent memory, suggesting the frontal positivity is not exclusive to the SRE, but instead a reflection of deeper encoding that leads to better memory. Thus, this frontal positivity may be a marker of a deeper encoding process that is elicited by self-referencing but not exclusive to the SRE.

Source memory and social exchange in young children

Reciprocal interactions require memories of social exchanges; however, little is known about how we remember social partner actions, especially during childhood when we start forming peer-to-peer relationships. This study examined if the expectation-violation effect, which has been observed in adults' source memory, exists among 5-6-year-old children. Forty participants played a coin collection game where they either received or lost coins after being shown an individual with a smiling or angry expression. This set-up generated congruent (smiling-giver and angry-taker) versus incongruent (smiling-taker and angry-giver) conditions. In the subsequent tasks, the children were asked to recall which actions accompanied each individual. The children considered the person with incongruent conditions as being stranger than the person with congruent conditions, suggesting that the former violated the children's emotion-based expectations. However, no heightened source memory was found for the incongruent condition. Instead, children seem to better recognise the action of angry individuals than smiling individuals, suggesting that angry facial expressions are more salient for children's source memory in a social exchange.

Neural substrates of long-term item and source memory for emotional associates: An fMRI study

Since Tulving's influential work on the distinction between familiarity and recollection-based retrieval, numerous studies have found evidence for differential contribution of these retrieval mechanisms on emotional episodic memory. Particularly, retrieval advantage for emotional, compared to neutral, information has been related to recollection-, but not familiarity-mediated processes. Neuroimaging studies suggest that this recollection-based retrieval for emotional information is related to stronger engagement of regions in the medial temporal lobe (MTL), posterior parietal cortex (PPC), and prefrontal cortex (PFC). In the present study, we investigated neural correlates related to long-term memory of neutral information that has been associated with emotional and neutral contexts, using functional magnetic resonance imaging (fMRI). During encoding, different neutral objects integrated with emotional or neutral scenes were presented. One week later, the encoded objects were intermixed with new ones and participants had to indicate whether the objects were previously seen or not, using the Remember/Know procedure (item memory). Furthermore, memory for the correct scene background category was also tested (contextual source memory). First, replicating previous findings, we observed a preference for recollection-dependent memory retrieval versus familiarity-dependent memory retrieval for those neutral objects encoded in emotional compared to neutral contexts. Second, consistent with these behavioral effects, objects encoded with emotional, compared to neutral, scenes produced larger memory-related activity in recollection-sensitive brain regions, including PPC and PFC regions. Third, correctly retrieved emotional compared to neutral contextual information was associated with increased activity in these brain areas. Together, these results suggest that memory for information encoded in emotional contexts is remarkably robust over time and mediated by recollection-based processes.

Age differences in the neural correlates of the specificity of recollection: An event-related potential study

In young adults, the neural correlates of successful recollection vary with the specificity (or amount) of information retrieved. We examined whether the neural correlates of recollection are modulated in a similar fashion in older adults. We compared event-related potential (ERP) correlates of recollection in samples of healthy young and older adults (N = 20 per age group). At study, participants were cued to make one of two judgments about each of a series of words. Subsequently, participants completed a memory test for studied and unstudied words in which they first made a Remember/Know/New (RKN) judgment, followed by a source memory judgment when a word attracted a 'Remember' (R) response. In young adults, the 'left parietal effect' - a putative ERP correlate of successful recollection - was largest for test items endorsed as recollected (R judgment) and attracting a correct source judgment, intermediate for items endorsed as recollected but attracting an incorrect or uncertain source judgment, and, relative to correct rejections, absent for items endorsed as familiar only (K judgment). In marked contrast, the left parietal effect was not detectable in older adults. Rather, regardless of source accuracy, studied items attracting an R response elicited a sustained, centrally maximum negative-going deflection relative to both correct rejections and studied items where recollection failed (K judgment). A similar retrieval-related negativity has been described previously in older adults, but the present findings are among the few to link this effect specifically to recollection. Finally, relative to correct rejections, all classes of correctly recognized old items elicited an age-invariant, late-onsetting positive deflection that was maximal over the right frontal scalp. This finding, which replicates several prior results, suggests that post-retrieval monitoring operations were engaged to an equivalent extent in the two age groups. Together, the present results suggest that there are circumstances where young and older adults engage qualitatively distinct retrieval-related processes during successful recollection.

Happy emotion cognition of bimodal audiovisual stimuli optimizes the performance of the P300 speller

OBJECTIVE

Prior studies of emotional cognition have found that emotion-based bimodal face and voice stimuli can elicit larger event-related potential (ERP) amplitudes and enhance neural responses compared with visual-only emotional face stimuli. Recent studies on brain-computer interface have shown that emotional face stimuli have significantly improved the performance of the traditional P300 speller system, but its performance needs to be further improved for practical applications. Therefore, we herein propose a novel audiovisual P300 speller based on bimodal emotional cognition to further improve the performance of the P300 system.

METHODS

The audiovisual P300 speller we proposed is based on happy emotions, with visual and auditory stimuli that consist of several pairs of smiling faces and audible chuckles (E-AV spelling paradigm) of different ages and sexes. The control paradigm was the visual-only emotional face P300 speller (E-V spelling paradigm).

RESULTS

We compared the ERP amplitudes, accuracy, and raw bit rate between the E-AV and E-V spelling paradigms. The target stimuli elicited significantly increased P300 amplitudes (p < .05) and P600 amplitudes (p < .05) in the E-AV spelling paradigm compared with those in the E-V paradigm. The E-AV spelling paradigm also significantly improved the spelling accuracy and the raw bit rate compared with those in the E-V paradigm at one superposition (p < .05) and at two superpositions (p < .05).

SIGNIFICANCE

The proposed emotion-based audiovisual spelling paradigm not only significantly improves the performance of the P300 speller, but also provides a basis for the development of various bimodal P300 speller systems, which is a step forward in the clinical application of brain-computer interfaces.

The effect of conceptual priming on subsequent familiarity: Behavioral and electrophysiological evidence

Previous studies on the neural mechanisms of how priming influences subsequent recognition memory have mainly focused on repetition priming, whereas the neural mechanisms of how conceptual priming affects subsequent recognition memory is still not clear. The present study investigated the electrophysiological correlates of how conceptual priming influences subsequent recognition memory. The behavioral results showed that conceptual priming only affected subsequent familiarity. The ERP results showed that conceptual priming was associated with reduced N400, and that the N400 conceptual priming effect predicted the behavioral effect of conceptual priming on subsequent familiarity. These results indicated that conceptual priming could influence subsequent familiarity by facilitating semantic processing in the encoding phase.

Tracking Your Mind's Eye during Recollection: Decoding the Long-Term Recall of Short Audiovisual Clips

Unlike familiarity, recollection involves the ability to reconstruct mentally previous events that results in a strong sense of reliving. According to the reinstatement hypothesis, this specific feature emerges from the reactivation of cortical patterns involved during information exposure. Over time, the retrieval of specific details becomes more difficult, and memories become increasingly supported by familiarity judgments. The multiple trace theory (MTT) explains the gradual loss of episodic details by a transformation in the memory representation, a view that is not shared by the standard consolidation model. In this study, we tested the MTT in light of the reinstatement hypothesis. The temporal dynamics of mental imagery from long-term memory were investigated and tracked over the passage of time. Participant EEG activity was recorded during the recall of short audiovisual clips that had been watched 3 weeks, 1 day, or a few hours beforehand. The recall of the audiovisual clips was assessed using a Remember/Know/New procedure, and snapshots of clips were used as recall cues. The decoding matrices obtained from the multivariate pattern analyses revealed sustained patterns that occurred at long latencies (>500 msec poststimulus onset) that faded away over the retention intervals and that emerged from the same neural processes. Overall, our data provide further evidence toward the MTT and give new insights into the exploration of our "mind's eye."

Enhanced spontaneous retrieval of cues from emotional events: An ERP study

Recent evidence points to enhanced episodic memory retrieval not only for emotional items but also for neutral information encoded in emotional contexts. However, prior research only tested instructed explicit recognition, and hence here we investigated whether memory retrieval is also heightened for cues from emotional contexts when retrieval is not explicitly probed. During the first session of a two-session experiment, neutral objects were presented on different background scenes varying in emotional and neutral contents. One week later, objects were presented again (with no background) intermixed with novel objects. In both sessions, participants were instructed to attentively watch the stimuli (free viewing procedure), and during the second session, ERPs were also collected to measure the ERP Old/New effect, an electrophysiological correlate of episodic memory retrieval. Analyses were performed using cluster-based permutation tests in order to identify reliable spatio-temporal ERP differences. Based on this approach, old relative to new objects, were associated with larger ERP positivity in an early (364-744 ms) and late time window (760-1148 ms) over distinct central electrode clusters. Interestingly, significant late ERP Old/New differences were only observed for objects previously encoded with emotional, but not neutral scenes (504 to 1144 ms). Because these ERP differences were observed in a non-instructed retrieval context, our results indicate that long-term, spontaneous retrieval for neutral objects, is particularly heightened if encoded within emotionally salient contextual information. These findings may assist in understanding mechanisms underlying spontaneous retrieval of emotional associates and the utility of ERPs to study maladaptive involuntary memories in trauma- and stress-related disorders.

Gender-specific effects of vasopressin on human social communication: An ERP study

The quick and efficient perception of facial expressions represents a special and fundamental capacity of humans to engage in social communication. Here, we examined the effects of vasopressin (AVP, a neuropeptide) on the processing of same- and other-gender facial expressions among males and females. After receiving either AVP or placebo (PBO) intranasally in a randomized and double-blind manner, participants were asked to rate their approachability to facial expressions while event-related potentials (ERPs) were recorded. Males rated lower approachability scores to neutral and positive male faces relative to the scores to emotion-matched female faces after AVP but not following PBO administration. These behavioral effects were correlated with the AVP-induced increased P1 and decreased N170 responses to male faces among male participants. Females rated higher approachability scores to negative female faces than the scores to negative male faces after AVP but not following PBO treatment. These results suggest that AVP decreases friendly responses to neutral/positive male faces in males and increases friendly responses to negative female faces in females. Overall, these results demonstrate the gender-specific effects of AVP in response to same- and other-gender facial expressions, indicating there are sex- and context-dependent effects of AVP on socioemotional processes.

Rhythmic Temporal Structure at Encoding Enhances Recognition Memory

Presenting events in a rhythm has been shown to enhance perception and facilitate responses for stimuli that appear in synchrony with the rhythm, but little is known about how rhythm during encoding influences later recognition. In this study, participants were presented with images of everyday objects in an encoding phase before a recognition task in which they judged whether or not objects were previously presented. Blockwise, object presentation during encoding followed either a rhythmic (constant, predictable) or arrhythmic (random, unpredictable) temporal structure, of which participants were unaware. Recognition was greater for items presented in a rhythmic relative to an arrhythmic manner. During encoding, there was a differential neural activity based on memory effect with larger positivity for rhythmic over arrhythmic stimuli. At recognition, memory-specific ERP components were differentially affected by temporal structure: The FN400 old/new effect was unaffected by rhythmic structure, whereas the late positive component old/new effect was observed only for rhythmically encoded items. Taken together, this study provides new evidence that memory-specific processing at recognition is affected by temporal structure at encoding.

The electrophysiology of subjectively perceived memory confidence in relation to recollection and familiarity

Subjectively perceived confidence is critically involved in distinguishing recollection from familiarity in episodic memory retrieval. However, the extent to which recollection and familiarity share similar electrophysiological processes associated with subjectively perceived memory confidence remains an open question. In addition, the role of memory encoding in subjectively perceived confidence during retrieval has not yet been investigated. To address these issues, an EEG study was performed in thirty healthy volunteers. During a memory task, participants encoded a subset of words while rating the words on pleasantness. Memory recognition and subjectively perceived confidence concerning these 'old' and additional 'new' words was tested. Results showed that during retrieval, correctly classifying an old item with high subjectively perceived confidence was associated with a parietal ERP and parietal theta power, while frontal theta activity was related to high-confident novelty processing. During the memory encoding phase, a parietal ERP and frontal theta oscillations were related to subsequent subjectively perceived memory confidence. Our findings provide the first evidence that subjectively perceived memory confidence is associated with distinct electrophysiological correlates during both memory encoding and retrieval.

Examining the neural mechanism behind testing effect with concrete and abstract words

The testing effect refers to the fact that testing enhances delayed memory more than restudying does. Previous studies revealed that the testing effect can be influenced by the delay period, the type of testing, and other factors. However, a few studies have focused on how the testing effect interacts with the properties of words, such as the concreteness effect. In an event-related potential study, we investigated how concreteness affects the testing effect. The behavioral results showed that concrete words benefited more from retrieval practice than the abstract words. The event-related potential amplitude of concrete words was significantly different between retrieval practice and restudying. Source analyses showed that only concrete words elicited activity in superior parietal lobule after being retrieved. We suggest that this difference is owing to the additional imaging during the encoding and retrieving of concrete words.

A promising structural magnetic resonance imaging assessment in patients with preclinical cognitive decline and diabetes mellitus

Subjective cognitive decline (SCD) is frequently reported in diabetic patients. Diabetes mellitus (DM) is associated with changes in the microstructure of the brain arise in diabetic patients, including changes in gray matter volume (GMV). However, the underlying mechanisms of changes in GMV in DM patients with cognitive impairment remain uncertain. Here, we present an overview of amyloid-β-dependent cognitive impairment in DM patients with SCD. Moreover, we review the evolving insights from studies on the GMV changes in GMV and cognitive dysfunction to which provide the mechanisms of cognitive impairment in T2DM. Ultimately, the novel structural magnetic resonance imaging (MRI) protocol was used for detecting neuroimaging biomarkers that can predict the clinical outcomes in diabetic patients with SCD. A reliable MRI protocol would be helpful to detect neurobiomarkers, and to understand the pathological mechanisms of preclinical cognitive impairment in diabetic patients.

Localization and Elimination of Attentional Dysfunction in Schizophrenia During Visual Search

Theories of the locus of visual selective attention dysfunction in schizophrenia propose that the deficits arise from either an inability to maintain working memory representations that guide attention, or difficulty focusing lower-level visual attention mechanisms. However, these theoretical accounts neglect the role of long-term memory representations in controlling attention. Here, we show that the control of visual attention is impaired in people with schizophrenia, and that this impairment is driven by an inability to shift top-down attentional control from working memory to long-term memory across practice. Next, we provide converging evidence for the source of attentional impairments in long-term memory by showing that noninvasive electrical stimulation of medial frontal cortex normalizes long-term memory related neural signatures and patients' behavior. Our findings suggest that long-term memory structures may be a source of impaired attentional selection in schizophrenia when visual attention is taxed during the processing of multi-object arrays.

Incidental memory for faces in children with different genetic subtypes of Prader-Willi syndrome

The present study examined the effects of genetic subtype on social memory in children (7–16 years) with Prader–Willi syndrome (PWS). Visual event-related potentials (ERPs) during a passive viewing task were used to compare incidental memory traces for repeated vs single presentations of previously unfamiliar social (faces) and nonsocial (houses) images in 15 children with the deletion subtype and 13 children with maternal uniparental disomy (mUPD). While all participants perceived faces as different from houses (N170 responses), repeated faces elicited more positive ERP amplitudes (‘old/new’ effect, 250–500ms) only in children with the deletion subtype. Conversely, the mUPD group demonstrated reduced amplitudes suggestive of habituation to the repeated faces. ERP responses to repeated vs single house images did not differ in either group. The results suggest that faces hold different motivational value for individuals with the deletion vs mUPD subtype of PWS and could contribute to the explanation of subtype differences in the psychiatric symptoms, including autism symptomatology.

Age-related Differences in Prestimulus Subsequent Memory Effects Assessed with Event-related Potentials

Prestimulus subsequent memory effects (preSMEs)-differences in neural activity elicited by a task cue at encoding that are predictive of later memory performance-are thought to reflect differential engagement of preparatory processes that benefit episodic memory encoding. We investigated age differences in preSMEs indexed by differences in ERP amplitude just before the onset of a study item. Young and older adults incidentally encoded words for a subsequent memory test. Each study word was preceded by a task cue that signaled a judgment to perform on the word. Words were presented for either a short (300 msec) or long (1000 msec) duration with the aim of placing differential benefits on engaging preparatory processes initiated by the task cue. ERPs associated with subsequent successful and unsuccessful recollection, operationalized here by source memory accuracy, were estimated time-locked to the onset of the task cue. In a late time window (1000-2000 msec after onset of the cue), young adults demonstrated frontally distributed preSMEs for both the short and long study durations, albeit with opposite polarities in the two conditions. This finding suggests that preSMEs in young adults are sensitive to perceived task demands. Although older adults showed no evidence of preSMEs in the same late time window, significant preSMEs were observed in an earlier time window (500-1000 msec) that was invariant with study duration. These results are broadly consistent with the proposal that older adults differ from their younger counterparts in how they engage preparatory processes during memory encoding.

Personality correlates of individual differences in the recruitment of cognitive mechanisms when rewards are at stake

Individuals differ greatly in their sensitivity to rewards and punishments. In the extreme, these differences are implicated in a range of psychiatric disorders from addiction to depression. However, it is unclear how these differences influence the recruitment of attention, working memory, and long-term memory when responding to potential rewards. Here, we used a rewarded memory-guided visual search task and ERPs to examine the influence of individual differences in self-reported reward/punishment sensitivity, as measured by the Behavioral Inhibition System (BIS)/Behavioral Activation System (BAS) scales, on the recruitment of cognitive mechanisms in conditions of potential reward. Select subscales of the BAS, including the fun seeking and reward responsiveness scales, showed unique relationships with context updating to reward cues and working memory maintenance of potentially rewarded stimuli. In contrast, BIS scores showed unique relationships with deployment of attention at different points in the task. These results suggest that sensitivity to rewards (i.e., BAS) and to punishment (i.e., BIS) may play an important role in the recruitment of specific and distinct cognitive mechanisms in conditions of potential rewards.

ERP evidence for the control of emotional memories during strategic retrieval

Neural evidence for the strategic retrieval of task-relevant 'target' memories at the expense of less relevant 'nontarget' memories has been demonstrated across a wide variety of studies. In ERP studies, this evidence consists of the ERP correlate of recollection (i.e. the 'left parietal old/new effect') being evident for targets and attenuated for nontargets. It is not yet known, however, whether this degree of strategic control can be extended to emotionally valenced words, or whether these items instead reactivate associated memories. The present study used a paradigm previously employed to demonstrate the strategic retrieval of neutral words (Herron & Rugg, Psychonomic Bulletin and & Review, 10(3), 703--710, 2003b) to assess the effects of stimulus valence on behavioural and event-related potential (ERP) measures of strategic retrieval. While response accuracy and reaction times associated with targets were unaffected by valence, negative nontargets and new items were both associated with an elevated false alarm rate and longer RTs than their neutral equivalents. Both neutral and negative targets and nontargets elicited early old/new effects between 300 and 500 ms. Critically, whereas neutral and negative targets elicited robust and statistically equivalent left parietal old/new effects between 500 and 800 ms, these were absent for neutral and negative nontargets. A right frontal positivity associated with postretrieval monitoring was evident for neutral targets versus nontargets, for negative versus neutral nontargets, and for targets versus new items. It can therefore be concluded that the recollection of negatively valenced words is subject to strategic control during retrieval, and that postretrieval monitoring processes are influenced by emotional valence.

Age-related differences in subjective recollection: ERP studies of encoding and retrieval

The ability to mentally re-experience past events improves significantly from childhood to young adulthood; however, the mechanisms underlying this ability remain poorly understood, partially because different tasks are used across the lifespan. This study was designed to address this gap by assessing the development of event-related potential (ERP) correlates associated with subjective indices of recollection. Children, adolescents, and adults performed Tulving's () remember/know paradigm while ERPs were recorded during memory encoding (Experiment 1) and retrieval (Experiment 2). Behaviorally, children recognized fewer items than adolescents and adults. All age groups reliably made subjective judgments of recollection, although the ability to make these judgments improved with age. At encoding, the ERP effect associated with recollection was present and comparable across age groups. In contrast, the ERP effect associated with recollection at retrieval differed as a function of age group; specifically, this effect was absent in children, topographically widespread in adolescents, and, consistent with previous literature, maximal over left centro-parietal leads in adults. These findings suggest that encoding processes associated with the subsequent subjective experience of recollection may be similar among children, adolescents, and adults and that age-related improvement in recollection may be primarily attributable to the development of processes that follow the initial encoding of stimuli (i.e., consolidation, storage, retrieval).

Event-related potentials during encoding: Comparing unitization to relational processing

Context details are typically encoded into episodic memory via arbitrary associations to the relevant item, known as relational binding. Subsequent retrieval of those context details is primarily supported by recollection. Research suggests that context retrieval can rely on familiarity if the context details are "unitized" and thereby encoded as features of the item itself in a single new representation. With most investigations into unitization focusing on the contributions of familiarity and recollection during retrieval, little is known about unitization during encoding. In an effort to begin understanding unitization as an encoding process, we used event-related potentials to monitor brain activity while participants were instructed to encode words with color information using relational association or unitization. Results showed that unitization-based encoding elicited significantly more negative potentials in the left parietal region than relational encoding during presentation of the second segment of strategically-specific sentences. This difference continued through presentation of the third sentence segment, becoming less lateralized, and ended before the final two segments were presented. During the mental imagery period, unitization-based encoding elicited significantly more positive potentials than relational encoding in the first 200ms centrally and from 400 through 1000ms in left fronto-temporal and parieto-occipital regions. Our findings indicate that unitization and relational processing diverged at approximately the time that the context item was presented in the relational condition. During mental imagery, unitization diverged from relational processing immediately, suggesting that unitization affected the nature of the item representation, and possibly the brain regions involved, during memory encoding.

Age-related changes in neural oscillations supporting context memory retrieval

Recent evidence suggests that directing attention toward single item-context associations during encoding improves young and older adults' context memory performance and reduces demands on executive functions during retrieval. In everyday situations, there are many event features competing for our attention, and our ability to successfully recover those details may depend on our ability to ignore others. Failures of selective attention may contribute to older adults' context memory impairments. In the current electroencephalogram (EEG) study, we assessed the effects of age on processes supporting successful context memory retrieval of selectively attended features as indexed by neural oscillations. During encoding, young and older adults were directed to attend to a picture of an object and its relationship to one of two concurrently presented contextual details: a color or scene. At retrieval, we tested their memory for the object, its attended and unattended context features, and their confidence for both the attended and unattended features. Both groups showed greater memory for attended than unattended contextual features. However, older adults showed evidence of hyper-binding between attended and unattended context features while the young adults did not. EEG results in the theta band suggest that young and older adults recollect similar amounts of information but brain-behavior correlations suggest that this information was supportive of contextual memory performance, particularly for young adults. By contrast, sustained beta desynchronization, indicative of sensory reactivation and episodic reconstruction, was correlated with contextual memory performance for older adults only. We conclude that older adults' inhibition deficits during encoding reduced the selectivity of their contextual memories, which led to reliance on executive functions like episodic reconstruction to support successful memory retrieval.

Separating content-specific retrieval from post-retrieval processing

According to cortical reinstatement accounts, neural processes engaged at the time of encoding are re-engaged at the time of memory retrieval. The temporal precision of event-related potentials (ERPs) has been exploited to assess this possibility, and in this study ERPs were acquired while people made memory judgments to visually presented words encoded in two different ways. There were reliable differences between the scalp distributions of the signatures of successful retrieval of different contents from 300 to 1100 ms after stimulus presentation. Moreover, the scalp distributions of these content-sensitive effects changed during this period. These findings are, to our knowledge, the first demonstration in one study that ERPs reflect content-specific processing in two separable ways: first, via reinstatement, and second, via downstream processes that operate on recovered information in the service of memory judgments.

How Negative Social Bias Affects Memory for Faces: An Electrical Neuroimaging Study

During social interactions, we make inferences about people’s personal characteristics based on their appearance. These inferences form a potential prejudice that can positively or negatively bias our interaction with them. Not much is known about the effects of negative bias on face perception and the ability to recognize people faces. This ability was investigated by recording event-related potentials (ERPs) from 128 sites in 16 volunteers. In the first session (encoding), they viewed 200 faces associated with a short fictional story that described anecdotal positive or negative characteristics about each person. In the second session (recognition), they underwent an old/new memory test, in which they had to distinguish 100 new faces from the previously shown faces. ERP data relative to the encoding phase showed a larger anterior negativity in response to negatively (vs. positively) biased faces, indicating an additional processing of faces with unpleasant social traits. In the recognition task, ERPs recorded in response to new faces elicited a larger FN400 than to old faces, and to positive than negative faces. Additionally, old faces elicited a larger Old-New parietal response than new faces, in the form of an enlarged late positive (LPC) component. An inverse solution SwLORETA (450–550 ms) indicated that remembering old faces was associated with the activation of right superior frontal gyrus (SFG), left medial temporal gyrus, and right fusiform gyrus. Only negatively connoted faces strongly activated the limbic and parahippocampal areas and the left SFG. A dissociation was found between familiarity (modulated by negative bias) and recollection (distinguishing old from new faces).

Old/New Effect of Digital Memory Retrieval in Chinese Dyscalculia

This study reports the neurophysiological and behavioral correlates of digital memory retrieval features in Chinese individuals with and without dyscalculia. A total of 18 children with dyscalculia (ages 11.5-13.5) and 18 controls were tested, and their event-related potentials were digitally recorded simultaneously with behavior measurement. Behavioral data showed that the dyscalculia group had lower hit rates and higher false rates than the control group. The electroencephalography results showed that both groups had a significant old/new effect and that this effect was greater in the control group. In the 300 to 400 ms processing stages, both groups showed significant differences in digital memory retrieval in the frontal regions. In the 400 to 500 and 500 to 600 ms epochs, the old/new effect in the control group was significantly greater than it was in the dyscalculia group at the frontal, central, and parietal regions. In the 600 to 700 ms processing stages, both groups showed significant differences in digital memory retrieval in the frontal, central, parietal, and occipital regions. These results suggest that individuals with dyscalculia exhibit impaired digital memory retrieval. Extraction failure may be an important cause of calculation difficulties.

Electrophysiological Correlates of Emotional Source Memory in High-Trait-Anxiety Individuals

The interaction between recognition memory and emotion has become a research hotspot in recent years. Dual process theory posits that familiarity and recollection are two separate processes contributing to recognition memory, but further experimental evidence is needed. The present study explored the emotional context effects on successful and unsuccessful source retrieval amongst 15 high-trait-anxiety college students by using event-related potentials (ERPs) measurement. During study, a happy, fearful, or neutral face picture first was displayed, then a Chinese word was superimposed centrally on the picture and subjects were asked to remember the word and the corresponding type of picture. During the test participants were instructed to press one of four buttons to indicate whether the displayed word was an old or new word. And then, for the old word, indicate whether it had been shown with a fearful, happy, or neutral face during the study. ERPs were generally more positive for remembered words than for new words and the ERP difference was termed as an old/new effect. It was found that, for successful source retrieval (it meant both the item and the source were remembered accurately) between 500 and 700 ms (corresponding to a late positive component, LPC), there were significant old/new effects in all contexts. However, for unsuccessful source retrieval (it meant the correct recognition of old items matched with incorrect source attribution), there were no significant old/new effects in happy and neutral contexts, though significant old/new effects were observed in the fearful context. Between 700 and 1200 ms (corresponding to a late slow wave, LSW), there were significant old/new effects for successful source retrieval in happy and neutral contexts. However, in the fearful context, the old/new effects were reversed, ERPs were more negative for successful source retrieval compared to correct rejections. Moreover, there were significant emotion effects for successful source retrieval at this time window. Further analysis showed ERPs of old items were more negative in fearful context than in neutral context. The results showed that early unsuccessful fearful source retrieval processes (related to familiarity) were enhanced, but late successful fearful source retrieval processes during source retrieval monitoring (related to recollection) were weakened. This provided preliminary evidence for the dual processing theory.

Age-related deficits in selective attention during encoding increase demands on episodic reconstruction during context retrieval: An ERP study

Previous event-related potential (ERP) and neuroimaging evidence suggests that directing attention toward single item-context associations compared to intra-item features at encoding improves context memory performance and reduces demands on strategic retrieval operations in young and older adults. In everyday situations, however, there are multiple event features competing for our attention. It is not currently known how selectively attending to one contextual feature while attempting to ignore another influences context memory performance and the processes that support successful retrieval in the young and old. We investigated this issue in the current ERP study. Young and older participants studied pictures of objects in the presence of two contextual features: a color and a scene, and their attention was directed to the object's relationship with one of those contexts. Participants made context memory decisions for both attended and unattended contexts and rated their confidence in those decisions. Behavioral results showed that while both groups were generally successful in applying selective attention during context encoding, older adults were less confident in their context memory decisions for attended features and showed greater dependence in context memory accuracy for attended and unattended contextual features (i.e., hyper-binding). ERP results were largely consistent between age groups but older adults showed a more pronounced late posterior negativity (LPN) implicated in episodic reconstruction processes. We conclude that age-related suppression deficits during encoding result in reduced selectivity in context memory, thereby increasing subsequent demands on episodic reconstruction processes when sought after details are not readily retrieved.

Using electrophysiology to demonstrate that cueing affects long-term memory storage over the short term

As researchers who study working memory, we often assume that participants keep a representation of an object in working memory when we present a cue that indicates that the object will be tested in a couple of seconds. This intuitively accounts for how well people can remember a cued object, relative to their memory for that same object presented without a cue. However, it is possible that this superior memory does not purely reflect storage of the cued object in working memory. We tested the hypothesis that cues presented during a stream of objects, followed by a short retention interval and immediate memory test, can change how information is handled by long-term memory. We tested this hypothesis by using a family of frontal event-related potentials believed to reflect long-term memory storage. We found that these frontal indices of long-term memory were sensitive to the task relevance of objects signaled by auditory cues, even when the objects repeated frequently, such that proactive interference was high. Our findings indicate the problematic nature of assuming process purity in the study of working memory, and demonstrate that frequent stimulus repetitions fail to isolate the role of working memory mechanisms.

The Role of Familiarity on Viewpoint Adaptation for Self-Face and Other-Face Images

An adaptation method was used to investigate whether self-face processing is dissociable from general face processing. We explored the viewpoint aftereffect with face images having different degrees of familiarity (never-before-seen faces, recently familiarized faces, personally familiar faces, and the participant’s own face). A face viewpoint aftereffect occurs after prolonged viewing of a face viewed from one side, with the result that the perceived viewing direction of a subsequently presented face image shown near the frontal view is biased in a direction which is the opposite of the adapting orientation. We found that (1) the magnitude of the viewpoint aftereffect depends on the level of familiarity of the adapting and test faces, (2) a cross-identity transfer of the viewpoint aftereffect is found between all categories of faces, but not between an unfamiliar adaptor face and the self-face test, and (3) learning affects the processing of the self-face in greater measure than any other category of faces. These results highlight the importance of familiarity on the face aftereffects, but they also suggest the possibility of separate representations for the self-face, on the one side, and for highly familiar faces, on the other.

Attention's Accelerator

How do people get attention to operate at peak efficiency in high-pressure situations? We tested the hypothesis that the general mechanism that allows this is the maintenance of multiple target representations in working and long-term memory. We recorded subjects' event-related potentials (ERPs) indexing the working memory and long-term memory representations used to control attention while performing visual search. We found that subjects used both types of memories to control attention when they performed the visual search task with a large reward at stake, or when they were cued to respond as fast as possible. However, under normal circumstances, one type of target memory was sufficient for slower task performance. The use of multiple types of memory representations appears to provide converging top-down control of attention, allowing people to step on the attentional accelerator in a variety of high-pressure situations.