Memory strength and repetition suppression: multimodal imaging of medial temporal cortical contributions to recognition

False memories in forensic psychology: do cognition and brain activity tell the same story?

One of the most important problems in forensic psychology is the impossibility of reliably discriminating between true and false memories when the only prosecution evidence comes from the memory of a witness or a victim. Unfortunately, both children and adults can be persuaded that they have been victims of past criminal acts, usually of a sexual nature. In adults, suggestion often occurs in the context of suggestive therapies based on the belief that traumatic events are repressed, while children come to believe and report events that never occurred as a result of repeated suggestive questioning. Cognitive Researchers have designed false memory paradigms (i.e., misinformation effect, Deese-Roediger-McDermott paradigm, event implantation paradigm) to first form false memories and then determine whether it is possible to reliably differentiate between false and true memories. In the present study, we review the contribution of cognitive research to the formation of false memories and the neuropsychological approaches aimed to discriminate between true and false memories. Based on these results, we analyze the applicability of the cognitive and neuropsychological evidence to the forensic setting.

"I heard it before … or not": time-course of ERP response and behavioural correlates associated with false recognition memory

Electrophysiological and behavioural correlates of true and false memories were examined in the Deese/Roediger-McDermont (DRM) paradigm. A mass univariate approach for analysing event-related potentials (ERP) in the temporal domain was used to examine the electrophysiological effects associated with this paradigm precisely (point-by-point) and without bias (data-driven). Behaviourally, true and false recognition did not differ, and the predicted DRM effect was observed, as false recognition of critical lures (i.e., new words semantically related to studied words) was higher than false alarms of new (unrelated) words. Neurally, an expected old/new effect was observed during the time-range of the late positive component (LPC) over left centro-parietal scalp electrodes. Furthermore, true recognition also evoked larger LPC amplitudes than false recognition over both left centro-parietal and fronto-central scalp electrodes. However, we did not observe LPC-related differences between critical lures and new words, nor between correct rejections of critical lures and new words. In contrast, correct rejections of critical lures were accompanied by higher activation of a sustained positive slow wave (SPSW) in right fronto-central electrodes beyond 1200 ms. This result reveals a key role of post-retrieval processes in recognition. Results are discussed in light of theoretical approaches to false memory in the DRM paradigm.

Effects of cognitive reappraisal on directed forgetting of negative emotional memory: an ERP study

This study aimed to adopt the item-method directed forgetting (DF) paradigm to explore the effects of cognitive reappraisal on intentional forgetting of negative emotional pictures. Behavioral results showed that the recognition of to-be-forgotten but remembered (TBF-r) was significantly greater than that of to-be-remembered and remembered (TBR-r) in the recognition test, which was the opposite result to the DF effect. Event-related potential (ERP) results showed that in the 450-660 ms (ms) of cue presentation, the F-cue of the cognitive reappraisal condition (imagining the upcoming pictures to be "fake or performed by actors" to avoid or reduce the intensity of negative emotions caused by the pictures) elicited more positive late positive potential (LPP) than passive viewing (participants watched freely and paid attention to the characters, scenes, and other details in the picture). This indicated that cognitive reappraisal required stronger inhibition than passive viewing for the to-be- forgotten (TBF) items. In the test phase, both the TBR-r and TBF-r items in the cognitive reappraisal condition evoked more positive ERP than correctly rejected (CR) unseen items in the study phase, which induced the frontal old/new effect (P200, 160-240 ms). In addition, this study also found that the LPP amplitudes of 450-660 ms in the frontal area induced by F-cues in cognitive reappraisal were significantly negatively correlated with the LPP amplitudes of 300-3500 ms induced by cognitive reappraisal instructions, and positive waves in the frontal area were significantly positively correlated with the TBF-r behavioral results. However, these results were not observed in the passive viewing group. The above results show that cognitive reappraisal enhances the retrieval ability for TBR and TBF items, and TBF-r is associated with cognitive reappraisal in the study phase and inhibitory control of F-cues.

A whole-task brain model of associative recognition that accounts for human behavior and neuroimaging data

Brain models typically focus either on low-level biological detail or on qualitative behavioral effects. In contrast, we present a biologically-plausible spiking-neuron model of associative learning and recognition that accounts for both human behavior and low-level brain activity across the whole task. Based on cognitive theories and insights from machine-learning analyses of M/EEG data, the model proceeds through five processing stages: stimulus encoding, familiarity judgement, associative retrieval, decision making, and motor response. The results matched human response times and source-localized MEG data in occipital, temporal, prefrontal, and precentral brain regions; as well as a classic fMRI effect in prefrontal cortex. This required two main conceptual advances: a basal-ganglia-thalamus action-selection system that relies on brief thalamic pulses to change the functional connectivity of the cortex, and a new unsupervised learning rule that causes very strong pattern separation in the hippocampus. The resulting model shows how low-level brain activity can result in goal-directed cognitive behavior in humans.

Chinese character unitization enhances recollection-based associative recognition: Evidence from fMRI

Previous research has suggested that familiarity can enhance associative memory after unitization, but the cognitive mechanisms underlying unitization remain debated. To explore the neural mechanisms of associative memory after unitization in the absence of semantic relations, we used Chinese characters as stimuli and recorded participants' blood oxygen level-dependent signals during recognition. Behavioral results showed that after Chinese character unitization, not only the associative performance of recognition (Pr, hit rate minus false alarm rate) and general Pr but also the hit rate and correct rejection rate increased. Neuroimaging results revealed activation of the hippocampus and parahippocampal gyrus during associative recognition in both the unitized and the non-unitized condition, and hippocampal activation increased after unitization. However, activation of the perirhinal cortex was not observed in either condition. These findings, in contrast to those from previous studies on unitization, suggest that Chinese character unitization enhances recollection-based, rather than familiarity-based, associative recognition. This suggests that the encoding of semantic relations during unitization is critical for subsequent familiarity-based associative recognition.

Perirhinal cortex automatically tracks multiple types of familiarity regardless of task-relevance

Perirhinal cortex (PrC) has long been implicated in familiarity assessment for objects and corresponding concepts. However, extant studies have focused mainly on changes in familiarity induced by recent exposure in laboratory settings. There is an increasing appreciation of other types of familiarity signals, in particular graded familiarity accumulated throughout one's lifetime. In prior work (Duke et al., 2017, Cortex, 89, 61-70), PrC has been shown to track lifetime familiarity ratings when participants make related judgements. A theoretically important characteristic of familiarity is its proposed automaticity. Support for automaticity comes from a documented impact of recent stimulus exposure on behavioral performance, and on PrC signals, under conditions in which this exposure is not task relevant. In the current fMRI study, we tested whether PrC also tracks lifetime familiarity of object concepts automatically, and whether this type of familiarity influences behavior even when it is not task relevant. During scanning, neurotypical participants (N = 30, age range 18-40, 7 males) provided animacy judgements about concrete object concepts presented at differing frequencies in an initial study phase. In a subsequent test phase, they made graded judgements of recent or lifetime familiarity. Behavioral performance showed sensitivity to lifetime familiarity even when it was not relevant for the task at hand. Across five sets of fMRI analyses, we found that PrC consistently tracked recent and lifetime familiarity of object concepts regardless of the task at hand. Critically, while several other temporal-lobe regions also showed isolated familiarity effects, none of them tracked familiarity with the same consistency. These findings demonstrate that PrC automatically tracks multiple types of familiarity. They support models that assign a broad role in the representation of information about object concepts to this structure.

Examining the transition of novel information toward familiarity

Throughout their lives, humans encounter multiple instances of new information that can be inconsistent with prior knowledge (novel). Over time, the once-novel information becomes integrated into their established knowledge base, shifting from novelty to familiarity. In this study, we investigated the processes by which the first steps of this transition take place. We hypothesized that the neural representations of initially novel items gradually change over the course of repeated presentations, expressing a shift toward familiarity. We further assumed that this shift could be traced by examining neural patterns using fMRI. In two experiments, while being scanned, participants read noun-adjective word pairs that were either consistent or inconsistent with their prior knowledge. Stimuli were repeated 3-6 times within the scans. Employing mass univariate and multivariate similarity analyses, we showed that the neural representations associated with the initial presentation of familiar versus novel objects differed in lateral frontal and temporal regions, the medial prefrontal cortex, and the medial temporal lobe. Importantly, the neural representations of novel stimuli gradually changed throughout repetitions until they became indistinguishable from their respective familiar items. We interpret these findings as indicating that an early phase of familiarization can be completed within a few repetitions. This initial familiarization can then serve as the prerequisite to the integration of novel items into existing knowledge. Future empirical and theoretical works can build on the current findings to develop a comprehensive model of the transition from novelty to familiarity.

Developmental change in prefrontal cortex recruitment supports the emergence of value-guided memory

Prioritizing memory for valuable information can promote adaptive behavior across the lifespan, but it is unclear how the neurocognitive mechanisms that enable the selective acquisition of useful knowledge develop. Here, using a novel task coupled with functional magnetic resonance imaging, we examined how children, adolescents, and adults (N = 90) learn from experience what information is likely to be rewarding, and modulate encoding and retrieval processes accordingly. We found that the ability to use learned value signals to selectively enhance memory for useful information strengthened throughout childhood and into adolescence. Encoding and retrieval of high- vs. low-value information was associated with increased activation in striatal and prefrontal regions implicated in value processing and cognitive control. Age-related increases in value-based lateral prefrontal cortex modulation mediated the relation between age and memory selectivity. Our findings demonstrate that developmental increases in the strategic engagement of the prefrontal cortex support the emergence of adaptive memory.

Decoding Spatial Memory Retrieval in Cubical Space Using fMRI Signals

The way spatial memory retrieval is represented in the brain remains unclear to date. Previous studies have displayed a hippocampus-centered navigation network using functional magnetic resonance imaging (fMRI) analysis. There have been some studies on the representation of navigation behavior by signal distribution patterns, but only in the hippocampus and adjacent structures. In this study, we aimed to determine (1) the brain regions that represent information in both intensity and distribution patterns during spatial memory retrieval and (2) whether the patterns of neural responses represent spatial memory retrieval behavior performance. Both univariate analysis [general linear model (GLM)] and multivariate pattern analysis (MVPA) were employed to reveal the spatial distributions of brain responses elicited by spatial memory retrieval. Correlation analyses were performed to detect the correspondences between brain responses and behavior performance. We found that spatial memory retrieval occurred in widespread brain regions, including the bilateral hippocampi, bilateral superior frontal gyrus, bilateral superior parietal lobules, bilateral occipital lobes, and cerebellum. The amplitude of activation in the left hippocampus showed a significant negative correlation (r = −0.46, p = 0.039) with the number of task completions. Additionally, within-subject classification accuracies based on the blood oxygenation level-dependent (BOLD) signal patterns of the right middle temporal gyrus (rMTG) rostral areas in the Brainnetome Atlas showed a significant positive correlation (r = 0.78, p < 0.0001) with retrieval accuracy. In summary, our findings have implications for understanding the separation between navigational and non-navigational states and emphasizing the utility of MVPA in the whole brain.

Pinpointing the neural signatures of single-exposure visual recognition memory

Memories of the images that we have seen are thought to be reflected in the reduction of neural responses in high-level visual areas such as inferotemporal (IT) cortex, a phenomenon known as repetition suppression (RS). We challenged this hypothesis with a task that required rhesus monkeys to report whether images were novel or repeated while ignoring variations in contrast, a stimulus attribute that is also known to modulate the overall IT response. The monkeys' behavior was largely contrast invariant, contrary to the predictions of an RS-inspired decoder, which could not distinguish responses to images that are repeated from those that are of lower contrast. However, the monkeys' behavioral patterns were well predicted by a linearly decodable variant in which the total spike count was corrected for contrast modulation. These results suggest that the IT neural activity pattern that best aligns with single-exposure visual recognition memory behavior is not RS but rather sensory referenced suppression: reductions in IT population response magnitude, corrected for sensory modulation.

Imaging recollection, familiarity, and novelty in the frontoparietal control and default mode networks and the anterior-posterior medial temporal lobe: An integrated view and meta-analysis

A network-level model of recollection-based recognition (R), familiarity-based recognition (F), and novelty recognition (N) was constructed, and its validity was evaluated through meta-analyses to produce an integrated view of neuroimaging data. The model predicted the following: (a) the overall magnitude of the frontoparietal control network (FPCN) activity (which supports retrieval and decision effort) is in the order of F > R > N; (b) that of the posterior medial temporal network (MTL) activity (which plays a direct role in retrieval) is in the order of R > N > F; (c) that of the anterior MTL activity (which supports novelty-encoding) is in the order of N > R > F; (d) that of the default mode network (DMN) activity (which supports the subjective experience of remembering) is in the order of R > N > F. The meta-analyses results were consistent with these predictions. Subsystem analysis indicated a functional dissociation between the cingulo-opercular vs. frontoparietal components of the FPCN and between the core vs. medial temporal components of the DMN.

Hippocampus Guides Adaptive Learning during Dynamic Social Interactions

How do we evaluate whether someone will make a good friend or collaborative peer? A hallmark of human cognition is the ability to make adaptive decisions based on information garnered from limited prior experiences. Using an interactive social task measuring adaptive choice (deciding who to reengage or avoid) in male and female participants, we find the hippocampus supports value-based social choices following single-shot learning. These adaptive choices elicited a suppression signal in the hippocampus, revealing sensitivity for the subjective perception of a person and how well they treat you during choice. The extent to which the hippocampus was suppressed was associated with flexibly interacting with prior generous individuals and avoiding selfish individuals. Further, we found that hippocampal signals during decision-making were related to subsequent memory for a person and the offer they made before. Consistent with the hippocampus leveraging previously executed choices to solidify a reliable neural signature for future adaptive behavior, we also observed a later hippocampal enhancement. These findings highlight the hippocampus playing a multifaceted role in socially adaptive learning.SIGNIFICANCE STATEMENT Adaptively navigating social interactions requires an integration of prior experiences with information gleaned from the current environment. While most research has focused on striatal-based feedback learning, open questions remain regarding the role of hippocampal-based episodic memory systems. Here, we show that during social decisions based on prior experience, hippocampal suppression signals were sensitive to adaptive choice, while hippocampal enhancements was related to subsequent memory for the original social interaction. These findings highlight the hippocampus playing a multifaceted role in socially adaptive learning.

Tracking prototype and exemplar representations in the brain across learning

There is a long-standing debate about whether categories are represented by individual category members (exemplars) or by the central tendency abstracted from individual members (prototypes). Neuroimaging studies have shown neural evidence for either exemplar representations or prototype representations, but not both. Presently, we asked whether it is possible for multiple types of category representations to exist within a single task. We designed a categorization task to promote both exemplar and prototype representations and tracked their formation across learning. We found only prototype correlates during the final test. However, interim tests interspersed throughout learning showed prototype and exemplar representations across distinct brain regions that aligned with previous studies: prototypes in ventromedial prefrontal cortex and anterior hippocampus and exemplars in inferior frontal gyrus and lateral parietal cortex. These findings indicate that, under the right circumstances, individuals may form representations at multiple levels of specificity, potentially facilitating a broad range of future decisions.

Stress Impairs Episodic Retrieval by Disrupting Hippocampal and Cortical Mechanisms of Remembering

Despite decades of science investigating the neural underpinnings of episodic memory retrieval, a critical question remains: how does stress influence remembering and the neural mechanisms of recollection in humans? Here, we used functional magnetic resonance imaging and multivariate pattern analyses to examine the effects of acute stress during retrieval. We report that stress reduced the probability of recollecting the details of past experience, and that this impairment was driven, in part, by a disruption of the relationship between hippocampal activation, cortical reinstatement, and memory performance. Moreover, even memories expressed with high confidence were less accurate under stress, and this stress-induced decline in accuracy was explained by reduced posterior hippocampal engagement despite similar levels of category-level cortical reinstatement. Finally, stress degraded the relationship between the engagement of frontoparietal control networks and retrieval decision uncertainty. Collectively, these findings demonstrate the widespread consequences of acute stress on the neural systems of remembering.

No evidence for an effect of explicit relevance instruction on consolidation of associative memories

Newly encoded memories are stabilized over time through a process or a set of processes termed consolidation, which happens preferentially during sleep. However, not all memories profit equally from this offline stabilization. Previous research suggested that one factor, which determines whether a memory will benefit from sleep consolidation, is future relevance. The aim of our current study was to replicate these findings and expand them to investigate their neural underpinnings. In our experiment, 38 participants learned two sets of object-location associations. The two sets of stimuli were presented to each participant intermixed and in random order. After study, participants performed a baseline retention test and were thereafter instructed that, after a delay containing sleep, they would be tested and rewarded only on one of the two sets of stimuli. This relevance instruction was revoked, however, immediately before the test. Thus, this manipulation affected memory consolidation while having no influence on encoding and retrieval. This retention interval was monitored via actigraphy recordings. While the study session was purely behavioral, the test session was conducted in an MRI scanner, thus we collected neuroimaging data at retrieval of relevant compared with non-relevant items. Behaviorally, we found no effect of the relevance manipulation on memory retention, confidence rating, or reaction time. At a neural level, no effect of relevance on memory retrieval-related brain operations was observed. Contrary to our expectations, the relevance manipulation did not result in improved consolidation, nor in improved subsequent performance at retrieval. These findings challenge previously published results and suggest that future relevance as manipulated here may not be sufficient to produce enhanced memory consolidation.

A Fast Visual Recognition Memory System in Humans Identified Using Intracerebral ERP

One key item of information retrieved when surveying our visual world is whether or not objects are familiar. However, there is no consensus on the respective roles of medial temporal lobe structures, particularly the perirhinal cortex (PRC) and hippocampus. We considered whether the PRC could support a fast recognition memory system independently from the hippocampus. We recorded the intracerebral electroencephalograph activity of epileptic patients while they were performing a fast visual recognition memory task, constraining them to use their quickest strategy. We performed event-related potential (ERP) and classification analyses. The PRC was, by far, the earliest region involved in recognition memory. This activity occurred before the first behavioral responses and was found to be related to reaction times, unlike the hippocampus. Single-trial analyses showed that decoding power was equivalent in the PRC and hippocampus but occurred much earlier in the PRC. A critical finding was that recognition memory-related activity occurred in different frontal and parietal regions, including the supplementary motor area, before the hippocampus. These results, based on ERP analyses, suggest that the human brain is equipped with a fast recognition memory system, which may bypass the hippocampus and in which the PRC plays a critical role.

Activation of stimulus-specific processing regions at retrieval tracks the strength of relational memory

Many theories of episodic memory posit that the subjective experience of recollection may be driven by the activation of stimulus-specific cortical regions during memory retrieval. This study examined cortical activation during associative memory retrieval to identify brain regions that support confidence judgments of source memory in stimulus-specific ways. Adjectives were encoded with either a picture of a face or a scene. During a source memory test, the word was presented alone and the participant was asked if the word had been previously paired with a face or a scene. We identified brain regions that were selectively active when viewing pictures of scenes or faces with a separate localizer scan. We then identified brain regions that were differentially activated to words during the source memory test that had been previously paired with faces or scenes, masked by the localizer activations, and examined how those regions were modulated by the strength of the source memory. Bilateral amygdala activation tracked source memory confidence for faces, while parahippocampal cortex tracked source memory confidence for scenes. The magnitude of the activation of these domain-specific perceptual-processing brain regions during memory retrieval may contribute to the subjective strength of episodic recollection.

Reduced Visual and Frontal Cortex Activation During Visual Working Memory in Grapheme-Color Synaesthetes Relative to Young and Older Adults

The sensory recruitment model envisages visual working memory (VWM) as an emergent property that is encoded and maintained in sensory (visual) regions. The model implies that enhanced sensory-perceptual functions, as in synaesthesia, entail a dedicated VWM-system, showing reduced visual cortex activity as a result of neural specificity. By contrast, sensory-perceptual decline, as in old age, is expected to show enhanced visual cortex activity as a result of neural broadening. To test this model, young grapheme-color synaesthetes, older adults and young controls engaged in a delayed pair-associative retrieval and a delayed matching-to-sample task, consisting of achromatic fractal stimuli that do not induce synaesthesia. While a previous analysis of this dataset (Pfeifer et al., 2016) has focused on cued retrieval and recognition of pair-associates (i.e., long-term memory), the current study focuses on visual working memory and considers, for the first time, the crucial delay period in which no visual stimuli are present, but working memory processes are engaged. Participants were trained to criterion and demonstrated comparable behavioral performance on VWM tasks. Whole-brain and region-of-interest-analyses revealed significantly lower activity in synaesthetes’ middle frontal gyrus and visual regions (cuneus, inferior temporal cortex), respectively, suggesting greater neural efficiency relative to young and older adults in both tasks. The results support the sensory recruitment model and can explain age and individual WM-differences based on neural specificity in visual cortex.

Self-initiated learning reveals memory performance and electrophysiological differences between younger, older and older adults with relative memory impairment

Older adults display difficulties in encoding and retrieval of information, resulting in poorer memory. This may be due to an inability of older adults to engage elaborative encoding strategies during learning. This study examined behavioural and electrophysiological effects of explicit cues to self-initiate learning during encoding and subsequent recognition of words in younger adults (YA), older control adults (OA) and older adults with relative memory impairment (OD). The task was a variation of the old/new paradigm, some study items were preceded by a cue to learn the word (L) while others by a do not learn cue (X). Behaviourally, YA outperformed OA and OD on the recognition task, with no significant difference between OA and OD. Event-related potentials at encoding revealed enhanced early visual processing (70-140 ms) for L- versus X-words in young and old. Only YA exhibited a greater late posterior positivity (LPP; 200-500 ms) for all words during encoding perhaps reflecting superior encoding strategy. During recognition, only YA differentiated L- versus X-words with enhanced frontal P200 (150-250 ms) suggesting impaired early word selection for retrieval in older groups; however, OD had enhanced P200 activity compared to OA during L-word retrieval. The LPP (250-500 ms) was reduced in amplitude for L-words compared to both X- and new words. However, YA showed greater LPP amplitude for all words compared to OA. For older groups, we observed reduced left parietal hemispheric asymmetry apparent in YA during encoding and recognition, especially for OD. Findings are interpreted in the light of models of compensation and dedifferentiation associated with age-related changes in memory function.

A Neuro-Operant Analysis of Mnemonic Recognition

Historically, the fields of operant selection and recognition memory have not interacted substantially with one another. However, both deal with how behavioral repertoires change over time as a function of environmental stimulation. In this article, we propose neuro-operant interpretations of behavioral phenomena occurring in recognition memory procedures based on (a) the ability to discriminate changes in the strength of responses caused by environmental stimulation and (b) the occasioning of supplementary responses by current stimulation. A neuro-operant interpretation of mnemonic behavior may further the understanding of the phenomena in place and simplify the current taxonomy of learning and memory.

Retrieval orientation alters neural activity during autobiographical memory recollection

When an autobiographical memory is retrieved, the underlying memory representation is constructed by flexibly activating a broad neural network. As such, the content used to reconstruct a memory can bias activity within this neural network. Here, we tested the hypothesis that focusing on the conceptual and contextual aspects of a memory to construct a memory representation will recruit distinct neural subsystems. To test this hypothesis, we measured neural activity as participants retrieved memories under retrieval orientations that biased remembering towards these elements of a past autobiographical experience. In an MRI scanner, participants first retrieved autobiographical memories and then were re-oriented towards the conceptual or contextual elements of that memory. They then used this re-oriented content (conceptual or contextual elements) to access and elaborate upon a new autobiographical memory. Confirming our hypothesis, we found a neural dissociation between these retrieval orientation conditions that aligned with established models of memory. We also found evidence that this neural dissociation was most prominent when the re-oriented mnemonic content was used to access a new memory. Altogether, the reported results provide critical insight into how and when retrieval orientations alter neural support for autobiographical memory retrieval and inform on the neural organization of autobiographical knowledge.

Visual mismatch negativity and stimulus-specific adaptation: the role of stimulus complexity

The present study investigated the function of the brain activity underlying the visual mismatch negativity (vMMN) event-related potential (ERP) component. Snowflake patterns (complex stimuli) were presented as deviants and oblique bar patterns (simple stimuli) as standards, and vice versa in a passive oddball paradigm. Control (equiprobable) sequences of either complex shape patterns or oblique bar patterns with various orientations were also presented. VMMN appeared as the difference between the ERP to the oddball deviant and the ERP to the control (deviant minus control ERP difference). Apart from the shorter latency of the vMMN to the oblique bar pattern as deviant, vMMN to both deviants was similar, i.e., there was no amplitude difference. We attributed the function of the brain processes underlying vMMN to the detection of the infrequent stimulus type (also represented in memory) instead of a call for further processing (a possibility for acquiring more precise representation) of the deviant. An unexpected larger adaptation (control minus standard ERP difference) to the snowflake pattern was also obtained. We suggest that this was due to the acquisition of a more elaborate memory representation of the more complex stimulus.

Rehearsal initiates systems memory consolidation, sleep makes it last

After encoding, memories undergo a transitional process termed systems memory consolidation. It allows fast acquisition of new information by the hippocampus, as well as stable storage in neocortical long-term networks, where memory is protected from interference. Whereas this process is generally thought to occur slowly over time and sleep, we recently found a rapid memory systems transition from hippocampus to posterior parietal cortex (PPC) that occurs over repeated rehearsal within one study session. Here, we use fMRI to demonstrate that this transition is stabilized over sleep, whereas wakefulness leads to a reset to naïve responses, such as observed during early encoding. The role of sleep therefore seems to go beyond providing additional rehearsal through memory trace reactivation, as previously thought. We conclude that repeated study induces systems consolidation, while sleep ensures that these transformations become stable and long lasting. Thus, sleep and repeated rehearsal jointly contribute to long-term memory consolidation.

Episodic recognition memory and the hippocampus in Parkinson's disease: A review

Parkinson's disease is a progressive neurodegenerative disorder of aging. The hallmark pathophysiology includes the development of neuronal Lewy bodies in the substantia nigra of the midbrain with subsequent loss of dopaminergic neurons. These neuronal losses lead to the characteristic motor symptoms of bradykinesia, rigidity, and rest tremor. In addition to these cardinal motor symptoms patients with PD experience a wide range of non-motor symptoms, the most important being cognitive impairments that in many circumstances lead to dementia. People with PD experience a wide range of cognitive impairments; in this review we will focus on memory impairment in PD and specifically episodic memory, which are memories of day-to-day events of life. Importantly, these memory impairments severely impact the lives of patients and caregivers alike. Traditionally episodic memory is considered to be markedly dependent on the hippocampus; therefore, it is important to understand the exact nature of PD episodic memory deficits in relation to hippocampal function and dysfunction. In this review, we discuss an aspect of episodic memory called recognition memory and its subcomponents called recollection and familiarity. Recognition memory is believed to be impaired in PD; thus, we discuss what aspects of the hippocampus are expected to be deficient in function as they relate to these recognition memory impairments. In addition to the hippocampus as a whole, we will discuss the role of hippocampal subfields in recognition memory impairments.

Visual integration of objects and scenes increases recollection-based responding despite differential MTL recruitment in young and older adults

Unitization, the process of encoding previously independent units as one coherent representation, improves associative memory in both young and older adults, or in some cases, differentially benefits older adults. Unitization of verbal associative pairs may reduce reliance on the hippocampus (HC) for successful encoding and recognition by shifting to familiarity-based processing mediated by perirhinal cortex (PRC). However, this shift was not observed in a recent study of visual associative memory, with equivalent activation in HC and PRC during encoding of visually integrated (unitized) and nonintegrated object and scene pairs. Furthermore, behavioral findings from this study suggested an increase in recollection rather than familiarity during recognition of visually integrated pairs. The present study extends our previous work by focusing on the influence of visual integration on fMRI activation during associative recognition, rather than encoding and these patterns between young and older adults. In contrast to our findings from encoding, visual integration reduced HC and PRC activation during retrieval of object and scene associative pairs across both age groups. However, visual integration increased the correlation between bilateral HC and left parahippocampal (PHC) activation and behavioral performance among older adults, consistent with an increased reliance on recollection. In contrast, visual integration reduced the correlation between HC activation and behavioral performance in young adults, more consistent with findings from the verbal unitization literature. Taken together, these results suggest that associative memory for visually integrated pairs may involve differential recruitment of medial temporal regions in young and older adults.

Briefly Flashed Scenes Can Be Stored in Long-Term Memory

The capacity of human memory is impressive. Previous reports have shown that when asked to memorize images, participants can recognize several thousands of visual objects in great details even with a single viewing of a few seconds per image. In this experiment, we tested recognition performance for natural scenes that participants saw for 20 ms only once (untrained group) or 22 times over many days (trained group) in an unrelated task. 400 images (200 previously viewed and 200 novel images) were flashed one at a time and participants were asked to lift their finger from a pad whenever they thought they had already seen the image (go/no-go paradigm). Compared to previous reports of excellent recognition performance with only single presentations of a few seconds, untrained participants were able to recognize only 64% of the 200 images they had seen few minutes before. On the other hand, trained participants, who had processed the flashed images (20 ms) several times, could correctly recognize 89% of them. EEG recordings confirmed these behavioral results. As early as 230 ms after stimulus onset, a significant event-related-potential (ERP) difference between familiar and new images was observed for the trained but not for the untrained group. These results show that briefly flashed unmasked scenes can be incidentally stored in long-term memory when repeated.

On the sensitivity of event-related fields to recollection and familiarity

The sensitivity of event-related potentials (ERPs) to the processes of recollection and familiarity has been explored extensively, and ERPs have been used subsequently to infer the contributions these processes make to memory judgments under a range of different circumstances. It has also been shown that event-related fields (ERFs, the magnetic counterparts of ERPs) are sensitive to memory retrieval processes. The links between ERFs, recollection and familiarity are, however, established only weakly. In this experiment, the sensitivity of ERFs to these processes was investigated in a paradigm used previously with ERPs. An early frontally distributed modulation varied with memory confidence in a way that aligns it with the process of familiarity, while a later parietally distributed modulation tracked subjective claims of recollection in a way that aligns it with this process. These data points strengthen the argument for employing ERFs to assess the contributions these processes can make to memory judgments, as well as for investigating the nature of the processes themselves.

What does the functional organization of cortico-hippocampal networks tell us about the functional organization of memory?

Historically, research on the cognitive processes that support human memory proceeded, to a large extent, independently of research on the neural basis of memory. Accumulating evidence from neuroimaging, however, has enabled the field to develop a broader and more integrative perspective. Here, we briefly outline how advances in cognitive neuroscience can potentially shed light on concepts and controversies in human memory research. We argue that research on the functional properties of cortico-hippocampal networks informs us about how memories might be organized in the brain, which, in turn, helps to reconcile seemingly disparate perspectives in cognitive psychology. Finally, we discuss several open questions and directions for future research.

Single-exposure visual memory judgments are reflected in inferotemporal cortex

Our visual memory percepts of whether we have encountered specific objects or scenes before are hypothesized to manifest as decrements in neural responses in inferotemporal cortex (IT) with stimulus repetition. To evaluate this proposal, we recorded IT neural responses as two monkeys performed a single-exposure visual memory task designed to measure the rates of forgetting with time. We found that a weighted linear read-out of IT was a better predictor of the monkeys’ forgetting rates and reaction time patterns than a strict instantiation of the repetition suppression hypothesis, expressed as a total spike count scheme. Behavioral predictions could be attributed to visual memory signals that were reflected as repetition suppression and were intermingled with visual selectivity, but only when combined across the most sensitive neurons.

As we go about our daily lives, we store visual memories of the objects and scenes that we encounter. This type of memory, known as visual recognition memory, can be remarkably powerful. Imagine viewing thousands of images for only a few seconds each, for example. Several days later, you will still be able to distinguish most of those images from previously unseen ones. How does the brain do this?

Visual information travels from the eyes to an area of the brain called visual cortex. Neurons in a region of visual cortex called inferotemporal cortex fire in a particular pattern to reflect what is being seen. These neurons also reflect memories of whether those things have been seen before, by firing more when things are new and less when they are viewed again. This decrease in firing, known as repetition suppression, may be the signal in the brain responsible for the sense of remembering.

Meyer and Rust have now tested this idea by training macaque monkeys to report whether images on a screen were new or familiar. The monkeys were very good at remembering the images they had seen more recently, although they tended to forget some of the images with time. Then, the rate at which the monkeys forgot the images was compared with the rate at which repetition suppression disappeared in inferotemporal cortex. The results showed that the total number of firing events in this region was not a great predictor of how long the monkeys remembered images. However, a decrease in the number of firing events for a particular subset of the neurons did predict the remembering and forgetting. Repetition suppression in certain inferotemporal cortex neurons can thus account for visual recognition memory.

Brain disorders and aging can both give rise to memory deficits. Identifying the mechanisms underlying memory may lead to new treatments for memory-related disorders. Visual recognition memory may be a good place to start because of our existing knowledge of how the brain processes visual information. Understanding visual recognition memory could help us understand the mechanisms of memory more broadly.

The Role of Working Memory in the Probabilistic Inference of Future Sensory Events

The ability to represent the emerging regularity of sensory information from the external environment has been thought to allow one to probabilistically infer future sensory occurrences and thus optimize behavior. However, the underlying neural implementation of this process is still not comprehensively understood. Through a convergence of behavioral and neurophysiological evidence, we establish that the probabilistic inference of future events is critically linked to people's ability to maintain the recent past in working memory. Magnetoencephalography recordings demonstrated that when visual stimuli occurring over an extended time series had a greater statistical regularity, individuals with higher working-memory capacity (WMC) displayed enhanced slow-wave neural oscillations in the θ frequency band (4-8 Hz.) prior to, but not during stimulus appearance. This prestimulus neural activity was specifically linked to contexts where information could be anticipated and influenced the preferential sensory processing for this visual information after its appearance. A separate behavioral study demonstrated that this process intrinsically emerges during continuous perception and underpins a realistic advantage for efficient behavioral responses. In this way, WMC optimizes the anticipation of higher level semantic concepts expected to occur in the near future.

Role of the Hippocampus in Distinct Memory Traces: Timing of Match and Mismatch Enhancement Revealed by Intracranial Recording

A previous functional magnetic resonance imaging study reported evidence for parallel memory traces in the hippocampus: a controlled match signal detecting matches to internally-generated goal states and an automatic mismatch signal identifying unpredicted perceptual novelty. However, the timing information in this process is unknown. In the current study, facilitated by the high spatial and temporal resolution of intracranial recording from human patients, we confirmed that the left posterior hippocampus played an important role in the goal match enhancement effect, in which combinations of object identity and location were involved. We also found that this effect happened within 520 ms to 735 ms after the probe onset, ~150 ms later than the perceptual mismatch enhancement found bilaterally in both the anterior and posterior hippocampus. More specifically, the latency of the perceptual mismatch enhancement effect of the right hippocampus was positively correlated with the performance accuracy. These results suggested that the hippocampus is crucial in working memory if features binding with location are involved in the task and the goal match enhancement effect happens after perceptual mismatch enhancement, implying the dissociation of different components of working memory at the hippocampus. Moreover, single trial decoding results suggested that the intracranial field potential response in the right hippocampus can classify the match or switch task. This is consistent with the findings that the right hippocampal activity observed during the simulation of the future events may reflect the encoding of the simulation into memory.

Perirhinal cortex tracks degree of recent as well as cumulative lifetime experience with object concepts

Evidence from numerous sources indicates that recognition of the prior occurrence of objects requires computations of perirhinal cortex (PrC) in the medial temporal lobe (MTL). Extant research has primarily probed recognition memory based on item exposure in a recent experimental study episode. Outside the laboratory, however, familiarity for objects typically accrues gradually with learning across many different episodic contexts, which can be distributed over a lifetime of experience. It is currently unknown whether PrC also tracks this cumulative lifetime experience with object concepts. To address this issue, we conducted a functional magnetic resonance imaging (fMRI) experiment in healthy individuals in which we compared judgments of the perceived lifetime familiarity with object concepts, a task that has previously been employed in many normative studies on concept knowledge, with frequency judgments for recent laboratory exposure in a study phase. Guided by neurophysiological data showing that neurons in primate PrC signal prior object exposure at multiple time scales, we predicted that PrC responses would track perceived prior experience in both types of judgments. Left PrC and a number of cortical regions that are often co-activated as part of the default-mode network showed an increase in Blood-Oxygen-Level Dependent (BOLD) response in relation to increases in the perceived cumulative lifetime familiarity of object concepts. These regions included the left hippocampus, left mid-lateral temporal cortex, as well as anterior and posterior cortical midline structures. Critically, left PrC was found to be the only region that showed this response in combination with the typically observed decrease in signal for perceived recent exposure in the experimental study phase. These findings provide, to our knowledge, the first evidence that ties signals in human PrC to variations in cumulative lifetime experience with object concepts. They offer a new link between the role of PrC in recognition memory and its broader role in conceptual processing.

Hyperfamiliarity in Amnestic and Vascular Mild Cognitive Impairment

Objective:Hyperfamiliarity is a phenomenon where new stimuli are perceived as familiar. Previous studies have demonstrated familiarity disorder in mild cognitive impairment (MCI), but mostly from the perspective of a neuropsychological approach, and the exact correlation of MCI aetiologies with the phenomenon remains uncertain. Based on current evidence suggesting a frontal-subcortical pathway contributing to familiarity processing, we hypothesize that individuals with a vascular aetiology of MCI will likely suffer more familiarity deficits. This study aims to examine the real-life hyperfamiliarity symptoms in amnestic versus vascular MCI.Methods:Informants of 11 amnestic and 9 vascular cognitive impairment patients were interviewed about the frequency of hyperfamiliarity symptoms in the previous month. MRI brain images of vascular cognitive impairment patients were analysed as well.Results:Patients with vascular cognitive impairment with no dementia (VCIND) showed a significantly higher frequency of hyperfamiliarity for people but not places or objects. Within VCIND patients, overall basal ganglia hyperintensities, particularly in the putamen, were found to significantly correlate to hyperfamiliarity.Conclusions:Patients with VCIND suffer more real-life hyperfamiliarity during people recognition compared to patients with amnestic mild cognitive impairment (aMCI), despite a comparative global decline in cognitive. This is likely due to impaired memory retrieval and matching processes resulting from subcortical ischaemic lesions.

Brain regions that show repetition suppression and enhancement: A meta-analysis of 137 neuroimaging experiments

Repetition suppression and enhancement refer to the reduction and increase in the neural responses for repeated rather than novel stimuli, respectively. This study provides a meta-analysis of the effects of repetition suppression and enhancement, restricting the data used to that involving fMRI/PET, visual stimulus presentation, and healthy participants. The major findings were as follows. First, the global topography of the repetition suppression effects was strikingly similar to that of the "subsequent memory" effects, indicating that the mechanism for repetition suppression is the reduced engagement of an encoding system. The lateral frontal cortex effects involved the frontoparietal control network regions anteriorly and the dorsal attention network regions posteriorly. The left fusiform cortex effects predominantly involved the dorsal attention network regions, whereas the right fusiform cortex effects mainly involved the visual network regions. Second, the category-specific meta-analyses and their comparisons indicated that most parts of the alleged category-specific regions showed repetition suppression for more than one stimulus category. In this regard, these regions may not be "dedicated cortical modules," but are more likely parts of multiple overlapping large-scale maps of simple features. Finally, the global topography of the repetition enhancement effects was similar to that of the "retrieval success" effects, suggesting that the mechanism for repetition enhancement is voluntary or involuntary explicit retrieval during an implicit memory task. Taken together, these results clarify the network affiliations of the regions showing reliable repetition suppression and enhancement effects and contribute to the theoretical interpretations of the local and global topography of these two effects. Hum Brain Mapp 38:1894-1913, 2017. © 2017 Wiley Periodicals, Inc.

The effects of item familiarity on the neural correlates of successful associative memory encoding

Associative memory is considered to be resource-demanding, requiring individuals to learn individual items and the specific relationships between those items. Previous research has shown that prior studying of items aids in associative memory for pairs composed of those same items, as compared to pairs of items that have not been prelearned (e.g., Kilb & Naveh-Benjamin, 2011). In the present study, we sought to elucidate the neural correlates mediating this memory facilitation. After being trained on individual items, participants were scanned while encoding item pairs composed of items from the pretrained phase (familiarized-item pairs) and pairs whose items had not been previously learned (unfamiliarized-item pairs). Consistent with previous findings, the overall subsequent recollection showed the engagement of bilateral parahippocampal gyrus (PHG) and hippocampus, when compared to subsequent forgetting. However, a direct comparison between familiarized- and unfamiliarized-item pairs showed that subsequently recollected familiarized-item pairs were associated with decreased activity across much of the encoding network, including bilateral PHG, hippocampus, prefrontal cortex, and regions associated with item-specific processing within occipital cortex. Increased activity for familiarized-item pairs was found in a more limited set of regions, including bilateral parietal cortex, which has been associated with the formation of novel associations. Additionally, activity in the right parietal cortex correlated with associative memory success in the familiarized condition. Taken together, these results suggest that prior exposure to items can reduce the demands incurred on neural processing throughout the associative encoding network and can enhance associative memory performance by focusing resources within regions supporting the formation of associative links.

Repetition suppression in the medial temporal lobe and midbrain is altered by event overlap

Repeated encounters with the same event typically lead to decreased activation in the medial temporal lobe (MTL) and dopaminergic midbrain, a phenomenon known as repetition suppression. In contrast, encountering an event that overlaps with prior experience leads to increased response in the same regions. Such increased responding is thought to reflect an associative novelty signal that promotes memory updating to resolve differences between current events and stored memories. Here, we married these ideas to test whether event overlap significantly modulates MTL and midbrain responses-even when events are repeated and expected-to promote memory updating through integration. While undergoing high-resolution functional MRI, participants were repeatedly presented with objects pairs, some of which overlapped with other, intervening pairs and some of which contained elements unique from other pairs. MTL and midbrain regions showed widespread repetition suppression for nonoverlapping pairs containing unique elements; however, the degree of repetition suppression was altered for overlapping pairs. Entorhinal cortex, perirhinal cortex (PRc), midbrain, and PRc-midbrain connectivity showed repetition-related increases across overlapping pairs. Notably, increased PRc activation for overlapping pairs tracked individual differences in the ability to reason about the relationships among pairs-our behavioral measure of memory integration. Within the hippocampus, activation increases across overlapping pairs were unique to CA₁ , consistent with its hypothesized comparator function. These findings demonstrate that event overlap engages MTL and midbrain functions traditionally implicated in novelty processing, even when overlapping events themselves are repeated. Our findings further suggest that the MTL-midbrain response to event overlap may promote integration of new content into existing memories, leading to the formation of relational memory networks that span experiences. Moreover, the results inform theories about the division of labor within MTL, demonstrating that the role of PRc in episodic encoding extends beyond familiarity processing and item-level recognition. © 2016 Wiley Periodicals, Inc.

Slow to warm up: the role of habituation in social fear

Neural habituation allows familiar information to be ignored in favor of salient or novel stimuli. In contrast, failure to rapidly habituate likely reflects deficits in the ability to learn that an environment is predictable, familiar and safe. Differences in habituation rate may underlie individual differences in the tendency to approach or avoid novelty; however, many questions remain unanswered. Given the importance of adaptive social functioning, here we tested whether habituation differences to social stimuli are associated with differences in social fearfulness, a trait that ranges from low social fear-the adaptive tendency to approach novel social stimuli-to high social fear-the maladaptive tendency to avoid novel social stimuli. Higher social fearfulness was associated with slower habituation across regions of the social brain, including the hippocampus, amygdala, ventromedial prefrontal cortex, medial orbitofrontal cortex, fusiform face area, primary visual cortex, and extrastriate visual cortex. Interestingly, habituation differences were driven by sustained amygdala-visual cortex interactions, but not deficient amygdala-prefrontal cortex interactions. Together, these findings provide evidence that a failure to filter social stimuli is associated with a key social trait. In light of the link between social fear and dysfunction, individual differences in habituation may provide an important neurobiological marker for risk for psychiatric illness, such as social anxiety disorder.

Memory-Guided Attention: Independent Contributions of the Hippocampus and Striatum

Memory can strongly influence how attention is deployed in future encounters. Though memory dependent on the medial temporal lobes has been shown to drive attention, how other memory systems could concurrently and comparably enhance attention is less clear. Here, we demonstrate that both reinforcement learning and context memory facilitate attention in a visual search task. Using functional magnetic resonance imaging, we dissociate the mechanisms by which these memories guide attention: trial by trial, the hippocampus (not the striatum) predicted attention benefits from context memory, while the striatum (not the hippocampus) predicted facilitation from rewarded stimulus-response associations. Responses in these regions were also distinctly correlated with individual differences in each type of memory-guided attention. This study provides novel evidence for the role of the striatum in guiding attention, dissociable from hippocampus-dependent context memory.

The Role of Medial Temporal Lobe Regions in Incidental and Intentional Retrieval of Item and Relational Information in Aging

Considerable neuropsychological and neuroimaging work indicates that the medial temporal lobes are critical for both item and relational memory retrieval. However, there remain outstanding issues in the literature, namely the extent to which medial temporal lobe regions are differentially recruited during incidental and intentional retrieval of item and relational information, and the extent to which aging may affect these neural substrates. The current fMRI study sought to address these questions; participants incidentally encoded word pairs embedded in sentences and incidental item and relational retrieval were assessed through speeded reading of intact, rearranged, and new word-pair sentences, while intentional item and relational retrieval were assessed through old/new associative recognition of a separate set of intact, rearranged, and new word pairs. Results indicated that, in both younger and older adults, anterior hippocampus and perirhinal cortex indexed incidental and intentional item retrieval in the same manner. In contrast, posterior hippocampus supported incidental and intentional relational retrieval in both age groups and an adjacent cluster in posterior hippocampus was recruited during both forms of relational retrieval for older, but not younger, adults. Our findings suggest that while medial temporal lobe regions do not differentiate between incidental and intentional forms of retrieval, there are distinct roles for anterior and posterior medial temporal lobe regions during retrieval of item and relational information, respectively, and further indicate that posterior regions may, under certain conditions, be over-recruited in healthy aging. © 2016 Wiley Periodicals, Inc.

Can predictive coding explain repetition suppression?

While in earlier work various local or bottom-up neural mechanisms were proposed to give rise to repetition suppression (RS), current theories suggest that top-down processes play a role in determining the repetition related reduction of the neural responses. In the current review we summarise those results, which support the role of these top-down processes, concentrating on the Bayesian models of predictive coding (PC). Such models assume that RS is related to the statistical probabilities of prior stimulus occurrences and to the future predictability of these stimuli. Here we review the current results that support or argue against this explanation. We point out that the heterogeneity of experimental manipulations that are thought to reflect predictive processes are likely to measure different processing steps, making their direct comparison difficult. In addition we emphasize the importance of identifying these sub-processes and clarifying their role in explaining RS. Finally, we propose a two-stage model for explaining the relationships of repetition and expectation phenomena in the human cortex.

On Known Unknowns: Fluency and the Neural Mechanisms of Illusory Truth

The "illusory truth" effect refers to the phenomenon whereby repetition of a statement increases its likelihood of being judged true. This phenomenon has important implications for how we come to believe oft-repeated information that may be misleading or unknown. Behavioral evidence indicates that fluency, the subjective ease experienced while processing information, underlies this effect. This suggests that illusory truth should be mediated by brain regions previously linked to fluency, such as the perirhinal cortex (PRC). To investigate this possibility, we scanned participants with fMRI while they rated the truth of unknown statements, half of which were presented earlier (i.e., repeated). The only brain region that showed an interaction between repetition and ratings of perceived truth was PRC, where activity increased with truth ratings for repeated, but not for new, statements. This finding supports the hypothesis that illusory truth is mediated by a fluency mechanism and further strengthens the link between PRC and fluency.

Bidirectional Modulation of Recognition Memory

Perirhinal cortex (PER) has a well established role in the familiarity-based recognition of individual items and objects. For example, animals and humans with perirhinal damage are unable to distinguish familiar from novel objects in recognition memory tasks. In the normal brain, perirhinal neurons respond to novelty and familiarity by increasing or decreasing firing rates. Recent work also implicates oscillatory activity in the low-beta and low-gamma frequency bands in sensory detection, perception, and recognition. Using optogenetic methods in a spontaneous object exploration (SOR) task, we altered recognition memory performance in rats. In the SOR task, normal rats preferentially explore novel images over familiar ones. We modulated exploratory behavior in this task by optically stimulating channelrhodopsin-expressing perirhinal neurons at various frequencies while rats looked at novel or familiar 2D images. Stimulation at 30-40 Hz during looking caused rats to treat a familiar image as if it were novel by increasing time looking at the image. Stimulation at 30-40 Hz was not effective in increasing exploration of novel images. Stimulation at 10-15 Hz caused animals to treat a novel image as familiar by decreasing time looking at the image, but did not affect looking times for images that were already familiar. We conclude that optical stimulation of PER at different frequencies can alter visual recognition memory bidirectionally. Significance statement: Recognition of novelty and familiarity are important for learning, memory, and decision making. Perirhinal cortex (PER) has a well established role in the familiarity-based recognition of individual items and objects, but how novelty and familiarity are encoded and transmitted in the brain is not known. Perirhinal neurons respond to novelty and familiarity by changing firing rates, but recent work suggests that brain oscillations may also be important for recognition. In this study, we showed that stimulation of the PER could increase or decrease exploration of novel and familiar images depending on the frequency of stimulation. Our findings suggest that optical stimulation of PER at specific frequencies can predictably alter recognition memory.

Dissociable Effects of Valence and Arousal on Different Subtypes of Old/New Effect: Evidence from Event-Related Potentials

Here, we utilized the study-test paradigm combined with recognition confidence assessment and behavioral and event-related potential (ERP) measurements to investigate the effects of valence and arousal on the different subtypes of the old-new effect. We also test the effect of valence and arousal at encoding stage to investigate the underlying mechanism of the effect of the two emotional dimension on different retrieval process. In order to test the effects of valence and arousal on old/new effect precisely, we used the “subject-oriented orthogonal design” which manipulated valence and arousal independently according to subjects’ verbal reporting to investigate the effects of valence and arousal on old/new effect respectively. Three subtypes of old/new effect were obtained in the test phase, which were FN400, LPC, and late positivity over right frontal. They are supposed to be associated with familiarity, recollection, and post-retrieval processes respectively according to previous studies. For the FN400 component, valence affected mid-frontal negativity from 350–500 ms. Pleasant items evoked an enhanced ERP old/new effect relative to unpleasant items. However, arousal only affected LPC amplitude from 500–800 ms. The old/new effect for high-arousal items was greater than for low-arousal items. Valence also affected the amplitude of a positive-going slow wave at right frontal sites from 800–1000 ms, possibly serving as an index of post-retrieval processing. At encoding stage, the valence and arousal also have dissociable effect on the frontal slow wave between 350–800 ms and the centro-parietal positivity in 500–800 ms. The pleasant items evoked a more positive frontal slow wave relative to unpleasant ones, and the high arousal items evoked a larger centro-parietal positivity relative to low arousal ones. These results suggest that valence and arousal may differentially impact these different memory processes: valence affects familiarity and post-retrieval processing, whereas arousal affects recollection. These effects may be due to the conceptual encoding strategies for pleasant information and sensory encoding strategies for high arousal information.