Lower Parietal Encoding Activation Is Associated with Sharper Information and Better Memory

Cognitive neuroscience perspective on memory: overview and summary

This paper explores memory from a cognitive neuroscience perspective and examines associated neural mechanisms. It examines the different types of memory: working, declarative, and non-declarative, and the brain regions involved in each type. The paper highlights the role of different brain regions, such as the prefrontal cortex in working memory and the hippocampus in declarative memory. The paper also examines the mechanisms that underlie the formation and consolidation of memory, including the importance of sleep in the consolidation of memory and the role of the hippocampus in linking new memories to existing cognitive schemata. The paper highlights two types of memory consolidation processes: cellular consolidation and system consolidation. Cellular consolidation is the process of stabilizing information by strengthening synaptic connections. System consolidation models suggest that memories are initially stored in the hippocampus and are gradually consolidated into the neocortex over time. The consolidation process involves a hippocampal-neocortical binding process incorporating newly acquired information into existing cognitive schemata. The paper highlights the role of the medial temporal lobe and its involvement in autobiographical memory. Further, the paper discusses the relationship between episodic and semantic memory and the role of the hippocampus. Finally, the paper underscores the need for further research into the neurobiological mechanisms underlying non-declarative memory, particularly conditioning. Overall, the paper provides a comprehensive overview from a cognitive neuroscience perspective of the different processes involved in memory consolidation of different types of memory.

Cortical and subcortical signatures of conscious object recognition

The neural mechanisms underlying conscious recognition remain unclear, particularly the roles played by the prefrontal cortex, deactivated brain areas and subcortical regions. We investigated neural activity during conscious object recognition using 7 Tesla fMRI while human participants viewed object images presented at liminal contrasts. Here, we show both recognized and unrecognized images recruit widely distributed cortical and subcortical regions; however, recognized images elicit enhanced activation of visual, frontoparietal, and subcortical networks and stronger deactivation of the default-mode network. For recognized images, object category information can be decoded from all of the involved cortical networks but not from subcortical regions. Phase-scrambled images trigger strong involvement of inferior frontal junction, anterior cingulate cortex and default-mode network, implicating these regions in inferential processing under increased uncertainty. Our results indicate that content-specific activity in both activated and deactivated cortical networks and non-content-specific subcortical activity support conscious recognition.

Cortical and subcortical neural activity supporting conscious object recognition has not yet been well defined. Here, the authors describe these networks and show recognition-related category information can be decoded from widespread cortical activity but not subcortical activity.

Cortical Representations of Visual Stimuli Shift Locations with Changes in Memory States

Episodic memory retrieval is thought to rely on reactivation of the same content-sensitive neural activity patterns initially expressed during memory encoding.^1-6 Yet there are emerging examples of content representations expressed in different brain regions during encoding versus retrieval.^7-14 Although these differences have been observed by comparing encoding and retrieval tasks that differ in terms of perceptual experience and cognitive demands, there are many real-world contexts-e.g., meeting a new colleague who reminds you of an old acquaintance-where the memory system might be intrinsically biased either toward encoding (the new colleague) or retrieval (the old acquaintance).¹⁵¹⁶ Here, we test whether intrinsic memory states, independent of task demands, determine the cortical location of content representations. In a human fMRI study, subjects (n = 33) viewed object images and were instructed to either encode the current object or retrieve a similar object from memory. Using pattern classifiers, we show that biases toward encoding versus retrieval were reflected in large-scale attentional networks.^17-19 Critically, memory states decoded from these networks-even when entirely independent from task instructions-predicted shifts of object representations from visual cortex (encoding) to ventral parietal cortex (retrieval). Finally, visual versus ventral parietal cortices exhibited differential connectivity with the hippocampus during memory encoding versus retrieval, consistent with the idea that the hippocampus mediates cortical shifts in content representations. Collectively, these findings demonstrate that intrinsic biases toward memory encoding versus retrieval determine the specific cortical locations that express content information.

Visual and Semantic Representations Predict Subsequent Memory in Perceptual and Conceptual Memory Tests

It is generally assumed that the encoding of a single event generates multiple memory representations, which contribute differently to subsequent episodic memory. We used functional magnetic resonance imaging (fMRI) and representational similarity analysis to examine how visual and semantic representations predicted subsequent memory for single item encoding (e.g., seeing an orange). Three levels of visual representations corresponding to early, middle, and late visual processing stages were based on a deep neural network. Three levels of semantic representations were based on normative observed ("is round"), taxonomic ("is a fruit"), and encyclopedic features ("is sweet"). We identified brain regions where each representation type predicted later perceptual memory, conceptual memory, or both (general memory). Participants encoded objects during fMRI, and then completed both a word-based conceptual and picture-based perceptual memory test. Visual representations predicted subsequent perceptual memory in visual cortices, but also facilitated conceptual and general memory in more anterior regions. Semantic representations, in turn, predicted perceptual memory in visual cortex, conceptual memory in the perirhinal and inferior prefrontal cortex, and general memory in the angular gyrus. These results suggest that the contribution of visual and semantic representations to subsequent memory effects depends on a complex interaction between representation, test type, and storage location.

Functional Fractionation of the Cingulo-opercular Network: Alerting Insula and Updating Cingulate

The anterior insula (AI) and dorsal anterior cingulate cortex (dACC) are engaged in various cognitive and affective processes. An influential account posits that the AI and dACC's ubiquitous engagements reflect their role in the transient capture of attention by salient stimuli. Using fMRI here we tested this claim and functionally dissociated these regions. In the first experiment, we compared these regions' responses to emotion-laden and emotion-neutral salient "oddball" movie events. We found that while the AI only responded transiently to the onset and offset of neutral events, its response to affective events was sustained, challenging the transient attention capture account. By contrast, dACC remained transient regardless of event type. A second experiment distinguished the information encoded by these brain regions with the presentation of behaviorally salient events that require either maintaining the current task set or updating to a different one; the AI was found to signal the presence of the behaviorally relevant events, while the dACC was associated with switching of attention settings in response to the events. We conclude that AI and dACC are involved in signaling the presence of potentially or de facto behaviorally significant events and updating internal attention settings in response to these events, respectively.

Age-related change in episodic memory: role of functional and structural connectivity between the ventral posterior cingulate and the parietal cortex

While the neural correlates of age-related episodic memory decline have been extensively studied, the precise involvement of the Posterior Cingulate Cortex (PCC) and posterior parietal cortex (the precuneus and the angular gyrus), remains unclear. The present study examined functional and structural neural correlates of age-related episodic memory change assessed over 12 years in 120 older adults (range 76-90 years). Episodic memory performance was measured using the Free and Cued Selective Reminding Test (FCSRT); functional connectivity metrics were computed from resting-state fMRI images and structural connectivity metrics were assessed through microstructural properties of reconstructed tract using a native space pipeline. We found that FCSRT change was significantly associated with the functional connectivity between the ventral PCC and three parietal regions, the ventral superior, the inferior part of the precuneus, and the rostro dorsal part of the angular gyrus. This association was independent of hippocampal volume. In addition, we found the that change in FCSRT scores was associated with fractional anisotropy of the tract connecting the ventral PCC and the ventral superior part of the precuneus. Change in episodic memory in aging was therefore related to a combination of high functional connectivity and low structural connectivity between the ventral PCC and the ventral superior part of the precuneus.

Neural evidence for age-related differences in representational quality and strategic retrieval processes

Mounting behavioral evidence suggests that declines in both representational quality and controlled retrieval processes contribute to episodic memory decline with age. The present study sought neural evidence for age-related change in these factors by measuring neural differentiation during encoding of paired associates and changes in regional blood oxygenation level-dependent activity and functional connectivity during retrieval conditions that placed low (intact pairs) and high (recombined pairs) demands on controlled retrieval processes. Pattern similarity analysis revealed age-related declines in the differentiation of stimulus representations at encoding, manifesting as both reduced pattern similarity between closely related events and increased pattern similarity between distinct events. During retrieval, both groups increased recruitment of areas within the core recollection network when endorsing studied pairs, including the hippocampus and angular gyrus. In contrast, only younger adults increased recruitment of, and hippocampal connectivity with, lateral prefrontal regions during correct rejections of recombined pairs. These results provide evidence for age-related changes in representational quality and in the neural mechanisms supporting memory retrieval under conditions of high, but not low, control demand.

Multimodal Integration and Vividness in the Angular Gyrus During Episodic Encoding and Retrieval

Much evidence suggests that the angular gyrus (AnG) is involved in episodic memory, but its precise role has yet to be determined. We examined two possible accounts within the same experimental paradigm: the “cortical binding of relational activity” (CoBRA) account (Shimamura, 2011), which suggests that the AnG acts as a convergence zone that binds multimodal episodic features, and the subjectivity account (Yazar et al., 2012), which implicates AnG involvement in subjective mnemonic experience (such as vividness or confidence). fMRI was used during both encoding and retrieval of paired associates. During study, female and male human participants memorized picture-pairs of common objects (in the unimodal task) or of an object-picture and an environmental sound (in the crossmodal task). At test, they performed a cued-recall task and further indicated the vividness of their memory. During retrieval, BOLD activation in the AnG was greatest for vividly remembered associates, consistent with the subjectivity account. During encoding, the same effect of vividness was found, but this was further modulated by task: greater activations were associated with subsequent recall in the crossmodal than the unimodal task. Therefore, encoding data suggest an additional role to the AnG in crossmodal integration, consistent with its role at retrieval proposed by CoBRA. These results resolve some of the puzzles in the literature and indicate that the AnG can play different roles during encoding and retrieval as determined by the cognitive demands posed by different mnemonic tasks.

SIGNIFICANCE STATEMENT We offer new insights into the multiplicity of processes that are associated with angular gyrus (AnG) activation during encoding and retrieval of newly formed memories. We used fMRI while human participants learned and subsequently recalled pairs of objects presented to the same sensory modality or to different modalities. We were able to show that the AnG is involved when vivid memories are created and retrieved, as well as when encoded information is integrated across different sensory modalities. These findings provide novel evidence for the contribution of the AnG to our subjective experience of remembering alongside its role in integrative processes that promote subsequent memory.

Visual Organization of the Default Network

The default network (DN) is a brain network with correlated activities spanning frontal, parietal, and temporal cortical lobes. The DN activates for high-level cognition tasks and deactivates when subjects are actively engaged in perceptual tasks. Despite numerous observations, the role of DN deactivation remains unclear. Using computational neuroimaging applied to a large dataset of the Human Connectome Project (HCP) and to two individual subjects scanned over many repeated runs, we demonstrate that the DN selectively deactivates as a function of the position of a visual stimulus. That is, we show that spatial vision is encoded within the DN by means of deactivation relative to baseline. Our results suggest that the DN functions as a set of high-level visual regions, opening up the possibility of using vision-science tools to understand its putative function in cognition and perception.

Hippocampal-targeted Theta-burst Stimulation Enhances Associative Memory Formation

The hippocampus plays a critical role in episodic memory, among other cognitive functions. However, few tools exist to causally manipulate hippocampal function in healthy human participants. Recent work has targeted hippocampal-cortical networks by performing TMS to a region interconnected with the hippocampus, posterior inferior parietal cortex (pIPC). Such hippocampal-targeted TMS enhances associative memory and influences hippocampal functional connectivity. However, it is currently unknown which stages of mnemonic processing (encoding or retrieval) are affected by hippocampal-targeted TMS. Here, we examined whether hippocampal-targeted TMS influences the initial encoding of associations (vs. items) into memory. To selectively influence encoding and not retrieval, we performed continuous theta-burst TMS before participants encoded object-location associations and assessed memory after the direct effect of stimulation dissipated. Relative to control TMS and baseline memory, pIPC TMS enhanced associative memory success and confidence. Item memory was unaffected, demonstrating a selective influence on associative versus item memory. The strength of hippocampal-pIPC functional connectivity predicted TMS-related memory benefits, which was mediated by parahippocampal and retrosplenial cortices. Our findings indicate that hippocampal-targeted TMS can specifically modulate the encoding of new associations into memory without directly influencing retrieval processes and suggest that the ability to influence associative memory may be related to the fidelity of hippocampal TMS targeting. These results support the notion that pIPC TMS may serve as a potential tool for manipulating hippocampal function in healthy participants. Nonetheless, future work combining hippocampal-targeted continuous theta-burst TMS with neuroimaging is needed to better understand the neural basis of TMS-induced memory changes.

The Posterior Parietal Cortex in Adaptive Visual Processing

Although the primate posterior parietal cortex (PPC) has been largely associated with space, attention, and action-related processing, a growing number of studies have reported the direct representation of a diverse array of action-independent nonspatial visual information in the PPC during both perception and visual working memory. By describing the distinctions and the close interactions of visual representation with space, attention, and action-related processing in the PPC, here I propose that we may understand these diverse PPC functions together through the unique contribution of the PPC to adaptive visual processing and form a more integrated and structured view of the role of the PPC in vision, cognition, and action.

Parietal Representations of Stimulus Features Are Amplified during Memory Retrieval and Flexibly Aligned with Top-Down Goals

In studies of human episodic memory, the phenomenon of reactivation has traditionally been observed in regions of occipitotemporal cortex (OTC) involved in visual perception. However, reactivation also occurs in lateral parietal cortex (LPC), and recent evidence suggests that stimulus-specific reactivation may be stronger in LPC than in OTC. These observations raise important questions about the nature of memory representations in LPC and their relationship to representations in OTC. Here, we report two fMRI experiments that quantified stimulus feature information (color and object category) within LPC and OTC, separately during perception and memory retrieval, in male and female human subjects. Across both experiments, we observed a clear dissociation between OTC and LPC: while feature information in OTC was relatively stronger during perception than memory, feature information in LPC was relatively stronger during memory than perception. Thus, while OTC and LPC represented common stimulus features in our experiments, they preferentially represented this information during different stages. In LPC, this bias toward mnemonic information co-occurred with stimulus-level reinstatement during memory retrieval. In Experiment 2, we considered whether mnemonic feature information in LPC was flexibly and dynamically shaped by top-down retrieval goals. Indeed, we found that dorsal LPC preferentially represented retrieved feature information that addressed the current goal. In contrast, ventral LPC represented retrieved features independent of the current goal. Collectively, these findings provide insight into the nature and significance of mnemonic representations in LPC and constitute an important bridge between putative mnemonic and control functions of parietal cortex.SIGNIFICANCE STATEMENT When humans remember an event from the past, patterns of sensory activity that were present during the initial event are thought to be reactivated. Here, we investigated the role of lateral parietal cortex (LPC), a high-level region of association cortex, in representing prior visual experiences. We find that LPC contained stronger information about stimulus features during memory retrieval than during perception. We also found that current task goals influenced the strength of stimulus feature information in LPC during memory. These findings suggest that, in addition to early sensory areas, high-level areas of cortex, such as LPC, represent visual information during memory retrieval, and that these areas may play a special role in flexibly aligning memories with current goals.

Discovering Event Structure in Continuous Narrative Perception and Memory

During realistic, continuous perception, humans automatically segment experiences into discrete events. Using a novel model of cortical event dynamics, we investigate how cortical structures generate event representations during narrative perception and how these events are stored to and retrieved from memory. Our data-driven approach allows us to detect event boundaries as shifts between stable patterns of brain activity without relying on stimulus annotations and reveals a nested hierarchy from short events in sensory regions to long events in high-order areas (including angular gyrus and posterior medial cortex), which represent abstract, multimodal situation models. High-order event boundaries are coupled to increases in hippocampal activity, which predict pattern reinstatement during later free recall. These areas also show evidence of anticipatory reinstatement as subjects listen to a familiar narrative. Based on these results, we propose that brain activity is naturally structured into nested events, which form the basis of long-term memory representations.

Ventral lateral parietal cortex and episodic memory retrieval

With the advent of functional neuroimaging it quickly became apparent that successful episodic memory retrieval was consistently associated with enhanced activity in ventral lateral parietal cortex (VLPC), especially the left angular gyrus. Here, we selectively review recent neuropsychological and functional neuroimaging evidence relevant to the question of the functional significance of this activity. We argue that the balance of the evidence suggests that the angular gyrus supports the representation of retrieved episodic information, and that this likely reflects a more general role for the region in representing multi-modal and multi-domain information.

Trial timing and pattern-information analyses of fMRI data

Pattern-information approaches to fMRI data analysis are becoming increasingly popular but few studies to date have investigated experimental design optimization for these analyses. Here, we tested several designs that varied in the number of trials and trial timing within fixed duration scans while participants encoded images of animals and tools. Trial timing conditions with fixed onset-to-onset timing ranged from slow 12-s trials with two repetitions of each item to quick 6-s trials with four repetitions per item. We also tested a jittered version of the quick design with 4-8s trials. We assessed the effect of trial timing on three dependent measures: category-level (animals vs. tools) decoding accuracy using a multivoxel pattern analysis, item-level (e.g., cat vs. dog vs. lion) information estimates using pattern similarity analysis, and memory effects comparing pattern similarity scores across repetitions of individual items subsequently remembered vs. forgotten. For single trial estimates, category decoding was equal across all trial timing conditions while item-level information and memory effects were better detected using slow trial timing. When modeling events on an item-by-item basis across all repetitions of a given item, a larger number of quick, regularly spaced trials provided an advantage over fewer slow trials for category decoding while item-level information was comparable across conditions. Jittered and non-jittered versions of the quick trial timing did not differ significantly in any analysis. These results will help inform experimental design choices in future studies planning to employ pattern-information analyses and demonstrate that design optimization guidelines developed for univariate analyses of a few conditions are not necessarily optimal for pattern-information analyses and condition-rich designs.

Brain correlates of memory reconsolidation: A role for the TPJ

In this paper, we investigate the process by which new experiences reactivate and potentially update old memories. Such memory reconsolidation appears dependent on the extent to which current experience deviates from what is predicted by the reactivated memory (i.e. prediction error). If prediction error is low, the reactivated memory is likely to be updated with new information. If it is high, however, a new, separate, memory is more likely to be formed. The temporal parietal junction TPJ has been shown across a broad range of content areas (attention, social cognition, decision making and episodic memory) to be sensitive to the degree to which current information violates the observer's expectations - in other words, prediction error. In the current paper, we investigate whether the level of TPJ activation during encoding predicts if the encoded information will be used to form a new memory or update a previous memory. We find that high TPJ activation predicts new memory formation. In a secondary analysis, we examine whether reactivation strength - which we assume leads to a strong memory-based prediction - mediates the likelihood that a given individual will use new information to form a new memory rather than update a previous memory. Individuals who strongly reactivate previous memories are less likely to update them than individuals who weakly reactivate them. We interpret this outcome as indicating that strong predictions lead to high prediction error, which favors new memory formation rather than updating of a previous memory.

Hippocampal Mismatch Signals Are Modulated by the Strength of Neural Predictions and Their Similarity to Outcomes

The hippocampus is thought to compare predicted events with current perceptual input, generating a mismatch signal when predictions are violated. However, most prior studies have only inferred when predictions occur without measuring them directly. Moreover, an important but unresolved question is whether hippocampal mismatch signals are modulated by the degree to which predictions differ from outcomes. Here, we conducted a human fMRI study in which subjects repeatedly studied various word-picture pairs, learning to predict particular pictures (outcomes) from the words (cues). After initial learning, a subset of cues was paired with a novel, unexpected outcome, whereas other cues continued to predict the same outcome. Critically, when outcomes changed, the new outcome was either "near" to the predicted outcome (same visual category as the predicted picture) or "far" from the predicted outcome (different visual category). Using multivoxel pattern analysis, we indexed cue-evoked reactivation (prediction) within neocortical areas and related these trial-by-trial measures of prediction strength to univariate hippocampal responses to the outcomes. We found that prediction strength positively modulated hippocampal responses to unexpected outcomes, particularly when unexpected outcomes were close, but not identical, to the prediction. Hippocampal responses to unexpected outcomes were also associated with a tradeoff in performance during a subsequent memory test: relatively faster retrieval of new (updated) associations, but relatively slower retrieval of the original (older) associations. Together, these results indicate that hippocampal mismatch signals reflect a comparison between active predictions and current outcomes and that these signals are most robust when predictions are similar, but not identical, to outcomes.

SIGNIFICANCE STATEMENT

Although the hippocampus is widely thought to signal "mismatches" between memory-based predictions and outcomes, previous research has not linked hippocampal mismatch signals directly to neural measures of prediction strength. Here, we show that hippocampal mismatch signals increase as a function of the strength of predictions in neocortical regions. This increase in hippocampal mismatch signals was particularly robust when outcomes were similar, but not identical, to predictions. These results indicate that hippocampal mismatch signals are driven by both the active generation of predictions and the similarity between predictions and outcomes.