The time course of episodic associative retrieval: electrophysiological correlates of cued recall of unimodal and crossmodal pair-associate learning

Sensitivity of associative priming to semantic relations: Insights from behavior and event-related potentials

The priming effects have raised significant concerns. Previous research has solely focused on the priming of individual items, where both the prime and the target are single items. This study innovatively examines the priming effect for pairs and also considers the pair type for the target. In this experiment, the semantic relations of the prime and target pairs were categorized into thematic, taxonomic, and unrelated cases. The prime pairs were considered new, while the target pairs consisted of intact, rearranged, and "old + new" pairs. Behaviorally, we found that the priming effects were more pronounced when considering thematic relations compared to taxonomic relations. This indicates a stronger unitization between the items in taxonomic relations. Neurally, the N300 and N400 amplitudes were significantly larger for thematic relations compared to taxonomic relations. These results suggest that both object identification and semantic processing were more influenced by the semantic relation within the pairs. Moreover, we observed that the pair type exhibited distinct patterns in the ERP priming effect across different semantic relations. This indicates that semantic priming and repetition priming of associative pairs result in different effects.

Don't Throw Away Your Notebook: Effects of Task Difficulty and Presentation Medium on Memory Performance

People are increasingly reliant on various electrical devices for learning and memory, yet the implications and consequences of this dependence remain poorly understood. The present study aimed to investigate how learning through electrical media impacts recall under varying task difficulties. During this study, participants encoded information related to daily life situations (low difficulty), academic conceptual knowledge (middle difficulty), or associative word pairs (high difficulty), presented on smartphones, computers, or paper. At test, they recalled the omitted content based on the provided cue information. A significant screen-inferiority effect was observed for both computers and smartphones. However, the impairment related to computers disappeared in the retrieval of daily life situations and academic conceptual knowledge, whereas the impairment associated with smartphones was consistently present across all tasks. These results suggest that memory performance is modulated by the interaction between the presentation medium and the specific demands of the task, highlighting a more pronounced screen-inferiority memory effect when the media restrict the depth of processing or when the memory tasks pose greater external challenges. A deeper understanding of these factors can guide the optimization of electrical devices to enhance human memory abilities and functions.

Chinese character unitization enhances item memory in addition to associative memory: Evidence from ERP and TFR

While the effect of unitization on associative memory has been established, its effect on item memory remains debated. This study aimed to investigate the influence of unitization on item memory using Chinese characters to manipulate unitization and recording scalp EEG to elucidate the underlying neural mechanisms. In the learning phase, participants were asked to determine whether the character pairs presented could form a Chinese compound character. In the subsequent testing phase, participants performed item recognition and associative recognition tasks. Behavioral results revealed that unitization not only improved associative memory but also facilitated item memory. Event-related potential analysis indicated there were FN400 effect (related to familiarity) and LPC effect (related to recollection) during associative recognition after unitization, however, only the LPC effect was observed for the item recognition. More importantly, time-frequency analysis demonstrated stronger θ oscillations (associated with recollection) in the unitized condition compared to the non-unitized condition, which further partially mediated the reduction in RT during the item recognition. These results suggest that unitization enhances item memory through recollection, thereby leading to more confident recognition judgments, and that unitization does not impair item processing within an association but rather enables more precise and accurate processing.

Unraveling the Electrophysiological Activity Behind Recognition Memory

Abstract. Traditionally, most event related potential (ERP) studies of memory retrieval have been reported during item-recognition tasks. Those studies lead to two well-known ERP memory components termed FN400 (familiarity) and LPC (recollection). Nevertheless, some critics have raised concerns regarding the actual meaning of that activity since it emerges as the result of contrasting two different memory traces (previously studied vs. seen for the first time), and it is registered after the target presentation. Therefore, they possibly depict operations not related to memory itself but some cognitive processes associated with recognition memory. Based on those critics, we propose an innovative approach to study electrophysiological activity underlying recognition memory. We compared two very similar tasks with only one of them requiring subjects to actively retrieve a “cue-target” pair of visual stimuli from memory, while the other task required subjects to recognize the target stimulus as equal/different to the cue. Because of this experimental manipulation, we assured that active memory retrieval processes take place between the presentation of the cue and the target stimuli for only one of the tasks. As a result, responses upon the targets can give us valuable information regarding ERP components associated with recognition based on memory retrieval. We found three components possibly related to brain computations necessary to achieve correct target recognition. A N200-like component linked to executive functions (inhibition) from frontal cortices, a P300-like component, related to the expectation of the target stimulus, and a P600-like component associated to recognition based on LTM retrieval. These results help us to understand the complexity behind ERP components associated with recognition memory.

Unitization modulates recognition of within-domain and cross-domain associations: Evidence from event-related potentials

Although it is often assumed that memory of episodic associations requires recollection, it has been suggested that, when stimuli are experienced as a unit, earlier memory processes might contribute to their subsequent associative recognition. We investigated the effects of associative relations and perceptual domain during episodic encoding on the ability to utilize early memory processes to retrieve associative information. During the study phase, participants encoded compound and noncompound words pairs, presented either to the same sensory modality (visual presentation) or to different sensory modalities (audiovisual presentation). At the test phase, they discriminated between old, rearranged, and new pairs while ERPs were recorded. In an early ERP component, differences related to associative memory emerged only for compounds, regardless of their encoding modality. These findings indicate that episodic retrieval of compound words can be supported by early-onset recognition processes regardless of whether both words were presented to the same or different sensory modalities, and suggests that unitization can operate at an abstract level, across a broad range of materials.

Multimodal Integration and Vividness in the Angular Gyrus During Episodic Encoding and Retrieval

Much evidence suggests that the angular gyrus (AnG) is involved in episodic memory, but its precise role has yet to be determined. We examined two possible accounts within the same experimental paradigm: the “cortical binding of relational activity” (CoBRA) account (Shimamura, 2011), which suggests that the AnG acts as a convergence zone that binds multimodal episodic features, and the subjectivity account (Yazar et al., 2012), which implicates AnG involvement in subjective mnemonic experience (such as vividness or confidence). fMRI was used during both encoding and retrieval of paired associates. During study, female and male human participants memorized picture-pairs of common objects (in the unimodal task) or of an object-picture and an environmental sound (in the crossmodal task). At test, they performed a cued-recall task and further indicated the vividness of their memory. During retrieval, BOLD activation in the AnG was greatest for vividly remembered associates, consistent with the subjectivity account. During encoding, the same effect of vividness was found, but this was further modulated by task: greater activations were associated with subsequent recall in the crossmodal than the unimodal task. Therefore, encoding data suggest an additional role to the AnG in crossmodal integration, consistent with its role at retrieval proposed by CoBRA. These results resolve some of the puzzles in the literature and indicate that the AnG can play different roles during encoding and retrieval as determined by the cognitive demands posed by different mnemonic tasks.

SIGNIFICANCE STATEMENT We offer new insights into the multiplicity of processes that are associated with angular gyrus (AnG) activation during encoding and retrieval of newly formed memories. We used fMRI while human participants learned and subsequently recalled pairs of objects presented to the same sensory modality or to different modalities. We were able to show that the AnG is involved when vivid memories are created and retrieved, as well as when encoded information is integrated across different sensory modalities. These findings provide novel evidence for the contribution of the AnG to our subjective experience of remembering alongside its role in integrative processes that promote subsequent memory.

Impact of Semantic Relatedness on Associative Memory: An ERP Study

Encoding and retrieval processes in memory for pairs of pictures are thought to be influenced by inter-item similarity and by features of individual items. Using Event-Related Potentials (ERP), we aimed to identify how these processes impact on both the early mid-frontal FN400 and the Late Positive Component (LPC) potentials during associative retrieval of pictures. Twenty young adults undertook a sham task, using an incidental encoding of semantically related and unrelated pairs of drawings. At test, we conducted a recognition task in which participants were asked to identify target identical pairs of pictures, which could be semantically related or unrelated, among new and rearranged pairs. We observed semantic (related and unrelated pairs) and condition effects (old, rearranged and new pairs) on the early mid-frontal potential. First, a lower amplitude was shown for identical and rearranged semantically related pairs, which might reflect a retrieval process driven by semantic cues. Second, among semantically unrelated pairs, we found a larger negativity for identical pairs, compared to rearranged and new ones, suggesting additional retrieval processing that focuses on associative information. We also observed an LPC old/new effect with a mid-parietal and a right occipito-parietal topography for semantically related and unrelated old pairs, demonstrating a recollection phenomenon irrespective of the degree of association. These findings suggest that associative recognition using visual stimuli begins at early stages of retrieval, and differs according to the degree of semantic relatedness among items. However, either strategy may ultimately lead to recollection processes.

Electrophysiological Correlates of Familiarity and Recollection in Associative Recognition: Contributions of Perceptual and Conceptual Processing to Unitization

It is generally accepted that associative recognition memory is supported by recollection. In addition, recent research indicates that familiarity can support associative memory, especially when two items are unitized into a single item. Both perceptual and conceptual manipulations can be used to unitize items, but few studies have compared these two methods of unitization directly. In the present study, we investigated the effects of familiarity and recollection on successful retrieval of items that were unitized perceptually or conceptually. Participants were instructed to remember either a Chinese two-character compound or unrelated word-pairs, which were presented simultaneously or sequentially. Participants were then asked to recognize whether word-pairs were intact or rearranged. Event-related potential (ERP) recordings were performed during the recognition phase of the study. Two-character compounds were better discriminated than unrelated word-pairs and simultaneous presentation was found to elicit better discrimination than sequential presentation for unrelated word-pairs only. ERP recordings indicated that the early intact/rearranged effects (FN400), typically associated with familiarity, were elicited in compound word-pairs with both simultaneous and sequential presentation, and in simultaneously presented unrelated word-pairs, but not in sequentially presented unrelated word-pairs. In contrast, the late positive complex (LPC) effects associated with recollection were elicited in all four conditions. Together, these results indicate that while the engagement of familiarity in associative recognition is affected by both perceptual and conceptual unitization, conceptual unitization promotes a higher level of unitization (LOU). In addition, the engagement of recollection was not affected by unitized manipulations. It should be noted, however, that due to experimental design, the effects presented here may be due to semantic rather than episodic memory and future studies should take this into consideration when manipulating rearranged pairs.

Cognitive dissonance resolution depends on episodic memory

The notion that past choices affect preferences is one of the most influential concepts of social psychology since its first report in the 50 s, and its theorization within the cognitive dissonance framework. In the free-choice paradigm (FCP) after choosing between two similarly rated items, subjects reevaluate chosen items as more attractive and rejected items as less attractive. However the relations prevailing between episodic memory and choice-induced preference change (CIPC) remain highly debated: is this phenomenon dependent or independent from memory of past choices? We solve this theoretical debate by demonstrating that CIPC occurs exclusively for items which were correctly remembered as chosen or rejected during the choice stage. We used a combination of fMRI and intra-cranial electrophysiological recordings to reveal a modulation of left hippocampus activity, a hub of episodic memory retrieval, immediately before the occurrence of CIPC during item reevaluation. Finally, we show that contrarily to a previous influential report flawed by a statistical artifact, this phenomenon is absent in amnesic patients for forgotten items. These results demonstrate the dependence of cognitive dissonance on conscious episodic memory. This link between current preferences and previous choices suggests a homeostatic function of this regulative process, aiming at preserving subjective coherence.

Binding neutral information to emotional contexts: Brain dynamics of long-term recognition memory

There is abundant evidence in memory research that emotional stimuli are better remembered than neutral stimuli. However, effects of an emotionally charged context on memory for associated neutral elements is also important, particularly in trauma and stress-related disorders, where strong memories are often activated by neutral cues due to their emotional associations. In the present study, we used event-related potentials (ERPs) to investigate long-term recognition memory (1-week delay) for neutral objects that had been paired with emotionally arousing or neutral scenes during encoding. Context effects were clearly evident in the ERPs: An early frontal ERP old/new difference (300-500 ms) was enhanced for objects encoded in unpleasant compared to pleasant and neutral contexts; and a late central-parietal old/new difference (400-700 ms) was observed for objects paired with both pleasant and unpleasant contexts but not for items paired with neutral backgrounds. Interestingly, objects encoded in emotional contexts (and novel objects) also prompted an enhanced frontal early (180-220 ms) positivity compared to objects paired with neutral scenes indicating early perceptual significance. The present data suggest that emotional--particularly unpleasant--backgrounds strengthen memory for items encountered within these contexts and engage automatic and explicit recognition processes. These results could help in understanding binding mechanisms involved in the activation of trauma-related memories by neutral cues.

Associative recognition processes are modulated by the semantic unitizability of memoranda

Although memory of episodic associations is generally considered to be recollective in nature, it has been suggested that when stimuli are experienced as a unit, familiarity processes might contribute to their subsequent associative recognition. To investigate the effect of semantic relatedness during episodic encoding on the processes of retrieval of associative information, we had participants interactively encode pairs of object pictures, vertically arranged so as to suggest a functional or configural relationship between them. Half the pairs were independently judged to be of related objects (e.g., a lamp over a table) and half of unrelated objects (e.g., a key-ring over an apple). At test, participants discriminated between intact, recombined, and new pairs while event related potentials (ERPs) were recorded. In an early ERP marker of retrieval success generally associated with familiarity processes, differences related to associative memory only emerged for related pairs, while differences associated with item memory emerged for both related and unrelated pairs. In contrast, in a later ERP effect associated with recollection, differences related to associative memory emerged for both related and unrelated pairs. These findings may indicate that retrieval of episodic associations formed between two semantically related visual stimuli can be supported by familiarity-related processes.

Temporal texture of associative encoding modulates recall processes

Binding aspects of an experience that are distributed over time is an important element of episodic memory. In the current study, we examined how the temporal complexity of an experience may govern the processes required for its retrieval. We recorded event-related potentials during episodic cued recall following pair associate learning of concurrently and sequentially presented object-picture pairs. Cued recall success effects over anterior and posterior areas were apparent in several time windows. In anterior locations, these recall success effects were similar for concurrently and sequentially encoded pairs. However, in posterior sites clustered over parietal scalp the effect was larger for the retrieval of sequentially encoded pairs. We suggest that anterior aspects of the mid-latency recall success effects may reflect working-with-memory operations or direct access recall processes, while more posterior aspects reflect recollective processes which are required for retrieval of episodes of greater temporal complexity.