Distinct neural mechanisms underlie the success, precision, and vividness of episodic memory

Emotion schema effects on associative memory differ across emotion categories at the behavioural, physiological and neural level: Emotion schema effects on associative memory differs for disgust and fear

Previous behavioural and neuroimaging studies have consistently reported that memory is enhanced for associations congruent or incongruent with the structure of prior knowledge, termed as schemas. However, it remains unclear if similar effects arise with emotion-related associations, and whether they depend on the type of emotions. Here, we addressed this question using a novel face-word pair association paradigm combined with fMRI and eye-tracking techniques. In two independent studies, we demonstrated and replicated that both congruency with emotion schemas and emotion category interact to affect associative memory. Overall, memory retrieval was higher for faces from pairs congruent vs. incongruent with emotion schemas, paralleled by a greater recruitment of left inferior frontal gyrus (IFG) during successful encoding. However, emotion schema effects differed across two negative emotion categories. Disgust was remembered better than fear, and only disgust activated left IFG stronger during encoding of congruent vs. incongruent pairs, suggestive of deeper semantic processing for the associations. On the contrary, encoding of congruent fear vs. disgust-related pairs was accompanied with greater activity in right fusiform gyrus (FG), suggesting a stronger sensory processing of faces. In addition, successful memory formation for congruent disgust pairs was associated with a higher pupil dilation index related to sympathetic activation, longer gaze time on words compared to faces, and more gaze switches between paired words and faces. This was reversed for fear-related congruent pairs where the faces attracted longer gaze time (compared to words). Overall, our results provide converging evidence from behavioural, physiological, and neural measures to suggest that congruency with available emotion schemas influence memory associations in a similar manner to semantic schemas. However, these effects vary across distinct emotion categories, pointing to a differential role of semantic processing and visual attention processes in the modulation of memory by disgust and fear, respectively.

Neural reactivation and judgements of vividness reveal separable contributions to mnemonic representation

Mnemonic representations vary in fidelity, sharpness, and strength-qualities that can be examined using both introspective judgements of mental states and objective measures of brain activity. Subjective and objective measures are both valid ways of "reading out" the content of someone's internal mnemonic states, each with different strengths and weaknesses. St-Laurent and colleagues (2015) compared the neural correlates of memory vividness ratings with patterns of neural reactivation evoked during memory recall and found considerable overlap between the two, suggesting a common neural basis underlying these different markers of representational quality. Here we extended this work with meta-analytic methods by pooling together four neuroimaging datasets in order to contrast the neural substrates of neural reactivation and those of vividness judgements. While reactivation and vividness judgements correlated positively with one another and were associated with common univariate activity in the dorsal attention network and anterior hippocampus, some notable differences were also observed. Vividness judgments were tied to stronger activation in the striatum and dorsal attention network, together with activity suppression in default mode network nodes. We also observed a trend for reactivation to be more closely associated with early visual cortex activity. A mediation analysis found support for the hypothesis that neural reactivation is necessary for memory vividness, with activity in the anterior hippocampus associated with greater reactivation. Our results suggest that neural reactivation and vividness judgements reflect common mnemonic processes but differ in the extent to which they engage effortful, attentional processes. Additionally, the similarity between reactivation and vividness appears to arise, partly, through hippocampal engagement during memory retrieval.

The functional dissociation of posterior parietal regions during multimodal memory formation

The incidental acquisition of multimodal associations is a key memory function for everyday life. While the posterior parietal cortex has been frequently shown to be involved for these memory functions, ventral and dorsal regions revealed differences in their functional recruitment and the precise difference in multimodal memory processing with respect to the associative process has not been differentiated. Using an incidental multimodal learning task, we isolated the associative process during multimodal learning and recollection. The result of the present functional magnetic resonance imaging (fMRI) study demonstrated that during both learning and recollection a clear functional differentiation between ventral and dorsal posterior parietal regions was found and can be related directly to the associative process. The recruitment of a ventral region, the angular gyrus, was specific for learning and recollection of multimodal associations. In contrast, a dorsal region, the superior parietal lobule, could be attributed to memory guided attentional processing. Independent of the memory stage, we assumed a general role for the angular gyrus in the generation of associative representations and updating of fixed association, episodic memory.

Volume of the posterior hippocampus mediates age-related differences in spatial context memory and is correlated with increased activity in lateral frontal, parietal and occipital regions in healthy aging

Healthy aging is associated with episodic memory decline, particularly in the ability to encode and retrieve object-context associations (context memory). Neuropsychological and neuroimaging studies have highlighted the importance of the medial temporal lobes (MTL) in supporting episodic memory across the lifespan. However, given the functional heterogeneity of the MTL, volumetric declines in distinct regions may impact performance on specific episodic memory tasks, and affect the function of the large-scale neurocognitive networks supporting episodic memory encoding and retrieval. In the current study, we investigated how MTL structure may mediate age-related differences in performance on spatial and temporal context memory tasks, in a sample of 125 healthy adults aged 19-76 years old. Standard T1-weighted MRIs were segmented into the perirhinal, entorhinal and parahippocampal cortices, as well as the anterior and posterior hippocampal subregions. We observed negative linear and quadratic associations between age and volume of the parahippocampal cortex, and anterior and posterior hippocampal subregions. We also found that volume of the posterior hippocampus fully mediated the association between age and spatial, but not temporal context memory performance. Further, we employed a multivariate behavior partial-least-squares analysis to assess how age and regional MTL volumes correlated with brain activity during the encoding and retrieval of spatial context memories. We found that greater activity within lateral prefrontal, parietal, and occipital regions, as well as within the anterior MTL was related to older age and smaller volume of the posterior hippocampus. Our results highlight the heterogeneity of MTL contributions to episodic memory across the lifespan and provide support for the posterior-anterior shift in aging, and scaffolding theory of aging and cognition.

Suppression weakens unwanted memories via a sustained reduction of neural reactivation

Aversive events sometimes turn into intrusive memories. However, prior evidence indicates that such memories can be controlled via a mechanism of retrieval suppression. Here, we test the hypothesis that suppression exerts a sustained influence on memories by deteriorating their neural representations. This deterioration, in turn, would hinder their subsequent reactivation and thus impoverish the vividness with which they can be recalled. In an fMRI study, participants repeatedly suppressed memories of aversive scenes. As predicted, this process rendered the memories less vivid. Using a pattern classifier, we observed that suppression diminished the neural reactivation of scene information both globally across the brain and locally in the parahippocampal cortices. Moreover, the decline in vividness was associated with reduced reinstatement of unique memory representations in right parahippocampal cortex. These results support the hypothesis that suppression weakens memories by causing a sustained reduction in the potential to reactivate their neural representations.

Sensitivity of the hippocampus to objective but not subjective episodic memory judgments

We assessed whether neural activity in the hippocampus dissociates according to whether memory test items elicit a subjective sense of recollection or accurate retrieval of contextual information. We reanalyzed a previously acquired dataset from a study in which participants made both objective (source memory for spatial context) and subjective (Remember-Know) judgments for each test item. Results indicated that the hippocampus was exclusively sensitive to the amount of contextual information retrieved, such that accurate source memory judgments were associated with greater activity than inaccurate judgments, regardless of Remember/Know status. The findings add to the evidence that the hippocampus is insensitive to the subjective experience of recollection, but supports retrieval of contextual information.

mixtur: An R package for designing, analysing, and modelling continuous report visual short-term memory studies

Visual short-term memory (vSTM) is often measured via continuous-report tasks whereby participants are presented with stimuli that vary along a continuous dimension (e.g., colour) with the goal of memorising the stimulus features. At test, participants are probed to recall the feature value of one of the memoranda in a continuous manner (e.g., by clicking on a colour wheel). The angular deviation between the participant response and the true feature value provides an estimate of recall precision. Two prominent models of performance on such tasks are the two- and three-component mixture models (Bays et al., Journal of Vision, 9(10), Article 7, 2009; Zhang and Luck, Nature, 453(7192), 233–235, 2008). Both models decompose participant responses into probabilistic mixtures of: (1) responses to the true target value based on a noisy memory representation; (2) random guessing when memory fails. In addition, the three-component model proposes (3) responses to a non-target feature value (i.e., binding errors). Here we report the development of mixtur, an open-source package written for the statistical programming language R that facilitates the fitting of the two- and three-component mixture models to continuous report data. We also conduct simulations to develop recommendations for researchers on trial numbers, set sizes, and memoranda similarity, as well as parameter recovery and model recovery. In the Discussion, we discuss how mixtur can be used to fit the slots and the slots-plus-averaging models, as well as how mixtur can be extended to fit explanatory models of visual short-term memory. It is our hope that mixtur will lower the barrier of entry for utilising mixture modelling.

Distinct medial-tempora lobe mechanisms of encoding and amygdala-mediated memory reinstatement for disgust and fear

Current models of episodic memory posit that retrieval involves the reenactment of encoding processes. Recent evidence has shown that this reinstatement process - indexed by subsequent encoding-retrieval similarity of brain activity patterns - is related to the activity in the hippocampus during encoding. However, we tend to re-experience emotional events in memory more richly than dull events. The role of amygdala - a critical hub of emotion processing - in reinstatement of emotional events was poorly understood. To investigate it, we leveraged a previously overlooked divergence in the role of amygdala in memory modulation by distinct emotions - disgust and fear. Here we used a novel paradigm in which participants encoded complex events (word pairs) and their memory was tested after 3 weeks, both phases during fMRI scanning. Using representational similarity analysis and univariate analyses, we show that the strength of amygdala activation during encoding was correlated with memory reinstatement of individual event representations in emotion-specific regions. Critically, amygdala modulated reinstatement more for disgust than fear. This was in line with other differences observed at the level of memory performance and neural mechanisms of encoding. Specifically, amygdala and perirhinal cortex were more involved during encoding of disgust-related events, whereas hippocampus and parahippocampal gyrus during encoding of fear-related events. Together, these findings shed a new light on the role of the amygdala and medial temporal lobe regions in encoding and reinstatement of specific emotional memories.

Episodic Memory Precision and Reality Monitoring Following Stimulation of Angular Gyrus

The qualities of remembered experiences are often used to inform "reality monitoring" judgments, our ability to distinguish real and imagined events [Johnson, M. K., & Raye, C. L. Reality monitoring. Psychological Review, 88, 67-85, 1981]. Previous experiments have tended to investigate only whether reality monitoring decisions are accurate or not, providing little insight into the extent to which reality monitoring may be affected by qualities of the underlying mnemonic representations. We used a continuous-response memory precision task to measure the quality of remembered experiences that underlie two different types of reality monitoring decisions: self/experimenter decisions that distinguish actions performed by participants and the experimenter and imagined/perceived decisions that distinguish imagined and perceived experiences. The data revealed memory precision to be associated with higher accuracy in both self/experimenter and imagined/perceived reality monitoring decisions, with lower precision linked with a tendency to misattribute self-generated experiences to external sources. We then sought to investigate the possible neurocognitive basis of these observed associations by applying brain stimulation to a region that has been implicated in precise recollection of personal events, the left angular gyrus. Stimulation of angular gyrus selectively reduced the association between memory precision and self-referential reality monitoring decisions, relative to control site stimulation. The angular gyrus may, therefore, be important for the mnemonic processes involved in representing remembered experiences that give rise to a sense of self-agency, a key component of "autonoetic consciousness" that characterizes episodic memory [Tulving, E. Elements of episodic memory. Oxford, United Kingdom: Oxford University Press, 1985].

Memory and eating: A bidirectional relationship implicated in obesity

This paper reviews evidence demonstrating a bidirectional relationship between memory and eating in humans and rodents. In humans, amnesia is associated with impaired processing of hunger and satiety cues, disrupted memory of recent meals, and overconsumption. In healthy participants, meal-related memory limits subsequent ingestive behavior and obesity is associated with impaired memory and disturbances in the hippocampus. Evidence from rodents suggests that dorsal hippocampal neural activity contributes to the ability of meal-related memory to control future intake, that endocrine and neuropeptide systems act in the ventral hippocampus to provide cues regarding energy status and regulate learned aspects of eating, and that consumption of hypercaloric diets and obesity disrupt these processes. Collectively, this evidence indicates that diet-induced obesity may be caused and/or maintained, at least in part, by a vicious cycle wherein excess intake disrupts hippocampal functioning, which further increases intake. This perspective may advance our understanding of how the brain controls eating, the neural mechanisms that contribute to eating-related disorders, and identify how to treat diet-induced obesity.

Missing links: The functional unification of language and memory (L∪M)

The field of neurocognition is currently undergoing a significant change of perspective. Traditional neurocognitive models evolved into an integrative and dynamic vision of cognitive functioning. Dynamic integration assumes an interaction between cognitive domains traditionally considered to be distinct. Language and declarative memory are regarded as separate functions supported by different neural systems. However, they also share anatomical structures (notably, the inferior frontal gyrus, the supplementary motor area, the superior and middle temporal gyrus, and the hippocampal complex) and cognitive processes (such as semantic and working memory) that merge to endorse our quintessential daily lives. We propose a new model, "L∪M" (i.e., Language/union/Memory), that considers these two functions interactively. We fractionated language and declarative memory into three fundamental dimensions or systems ("Receiver-Transmitter", "Controller-Manager" and "Transformer-Associative" Systems), that communicate reciprocally. We formalized their interactions at the brain level with a connectivity-based approach. This new taxonomy overcomes the modular view of cognitive functioning and reconciles functional specialization with plasticity in neurological disorders.

I remember it like it was yesterday: Age-related differences in the subjective experience of remembering

It has been frequently described that older adults subjectively report the vividness of their memories as being as high, or even higher, than young adults, despite poorer objective memory performance. Here, we review studies that examined age-related differences in the subjective experience of memory vividness. By examining vividness calibration and resolution, studies using different types of approaches converge to suggest that older adults overestimate the intensity of their vividness ratings relative to young adults, and that they rely on retrieved memory details to a lesser extent to judge vividness. We discuss potential mechanisms underlying these observations. Inflation of memory vividness with regard to the richness of memory content may stem from age-differences in vividness criterion or scale interpretation and psycho-social factors. The reduced reliance on episodic memory details in older adults may stem from age-related differences in how they monitor these details to make their vividness ratings. Considered together, these findings emphasize the importance of examining age-differences in memory vividness using different analytical methods and they provide valuable evidence that the subjective experience of remembering is more than the reactivation of memory content. In this vein, we recommend that future studies explore the links between memory vividness and other subjective memory scales (e.g., ratings of details or memory confidence) in healthy aging and/or other populations, as it could be used as a window to better characterize the cognitive processes that underpin the subjective assessment of the quality of recollected events.

Delineating insight-processing-related functional activations in the precuneus in first-episode psychosis patients

Poor insight is a central characteristic of psychotic disorders, and it has been suggested to result from a general dysfunction in self-reflection. However, brain processing of clinical insight and more general self-reflection has not been directly compared. We compared tasks on (1) self-reflection on psychosis-related mental functioning (clinical insight, in patients only), (2) self-reflection on mental functioning unrelated to psychosis (general metacognition), and (3) semantic control during blood-oxygenation-level-dependent (BOLD) functional magnetic resonance imaging with 19 first-episode psychosis patients and 24 control participants. Arterial-spin-labeling (ASL) images were collected at rest. Clinical insight was evaluated with the Schedule for the Assessment of Insight. In patients, posterosuperior precuneus showed stronger activation during the insight task than during the semantic control task, while anteroinferior precuneus and posterior cingulate cortex (PCC) showed stronger activation during the insight task than during the general metacognition task. No significant group differences in brain activation emerged during the general metacognition task. Although the BOLD measures did not correlate with clinical insight measures, ASL-measured cerebral blood flow (CBF) values did correlate when extracted from the task-selective precuneus/PCC areas: higher CBF correlated with higher clinical insight scores. These results suggest that regions in the posteromedial cortex are selective for clinical insight.

The Hippocampal Horizon: Constructing and Segmenting Experience for Episodic Memory

How do we recollect specific events that have occurred during continuous ongoing experience? There is converging evidence from non-human animals that spatially modulated cellular activity of the hippocampal formation supports the construction of ongoing events. On the other hand, recent human oriented event cognition models have outlined that our experience is segmented into discrete units, and that such segmentation can operate on shorter or longer timescales. Here, we describe a unification of how these dynamic physiological mechanisms of the hippocampus relate to ongoing externally and internally driven event segmentation, facilitating the demarcation of specific moments during experience. Our cross-species interdisciplinary approach offers a novel perspective in the way we construct and remember specific events, leading to the generation of many new hypotheses for future research.

Hippocampal-Cortical Encoding Activity Predicts the Precision of Episodic Memory

Our recollections of past experiences can vary in both the number of specific event details accessible from memory and the precision with which such details are reconstructed. Prior neuroimaging evidence suggests the success and precision of episodic recollection to rely on distinct neural substrates during memory retrieval. In contrast, the specific encoding mechanisms supporting later memory precision, and whether they differ from those underlying successful memory formation in general, are currently unknown. Here, we combined continuous measures of memory retrieval with model-based analyses of behavioral and neuroimaging data to tease apart the encoding correlates of successful memory formation and mnemonic precision. In the MRI scanner, participants encoded object-scene displays and later reconstructed features of studied objects using a continuous scale. We observed overlapping encoding activity in inferior prefrontal and posterior perceptual regions to predict both which object features were later remembered versus forgotten and the precision with which they were reconstructed from memory. In contrast, hippocampal encoding activity significantly predicted the precision, but not overall success, of subsequent memory retrieval. The current results align with theoretical accounts proposing the hippocampus to be critical for representation of high-fidelity associative information and suggest a contribution of shared cortical encoding mechanisms to the formation of both accessible and precise memory representations.

Brain Mechanisms Underlying the Subjective Experience of Remembering

The ability to remember events in vivid, multisensory detail is a significant part of human experience, allowing us to relive previous encounters and providing us with the store of memories that shape our identity. Recent research has sought to understand the subjective experience of remembering, that is, what it feels like to have a memory. Such remembering involves reactivating sensory-perceptual features of an event and the thoughts and feelings we had when the event occurred, integrating them into a conscious first-person experience. It allows us to reflect on the content of our memories and to understand and make judgments about them, such as distinguishing events that actually occurred from those we might have imagined or been told about. In this review, we consider recent evidence from functional neuroimaging in healthy participants and studies of neurological and psychiatric conditions, which is shedding new light on how we subjectively experience remembering. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Sustained Attention and Spatial Attention Distinctly Influence Long-term Memory Encoding

Our attention is critically important for what we remember. Prior measures of the relationship between attention and memory, however, have largely treated "attention" as a monolith. Here, across three experiments, we provide evidence for two dissociable aspects of attention that influence encoding into long-term memory. Using spatial cues together with a sensitive continuous report procedure, we find that long-term memory response error is affected by both trial-by-trial fluctuations of sustained attention and prioritization via covert spatial attention. Furthermore, using multivariate analyses of EEG, we track both sustained attention and spatial attention before stimulus onset. Intriguingly, even during moments of low sustained attention, there is no decline in the representation of the spatially attended location, showing that these two aspects of attention have robust but independent effects on long-term memory encoding. Finally, sustained and spatial attention predicted distinct variance in long-term memory performance across individuals. That is, the relationship between attention and long-term memory suggests a composite model, wherein distinct attentional subcomponents influence encoding into long-term memory. These results point toward a taxonomy of the distinct attentional processes that constrain our memories.

The diminishing precision of memory for time

Knowing when an event took place can provide several benefits to episodic memory, such as distinguishing among multiple traces, learning sequences of events, and guiding a search strategy. As a tool for understanding memory, time is particularly appealing given its ever-changing quality, the constant possibility to associate it with encoded events, and the ease with which it can be targeted at retrieval. Whereas studies of episodic retrieval typically employ categorical and probabilistic measures of retrieval success, characterizing a continuous feature such as time warrants measures particularly sensitive to the fidelity, or precision, of retrieved information. Here, we adapt a paradigm for assessing the fine-grained precision of retrieval to understand the nature of judging the time at which a memory was encoded. Subjects studied a series of pictures and then undertook a test in which they placed each picture, as precisely as possible, along a continuous time line representing the study list. Based on mixture-modeling analyses of the test response errors, the primary results were that temporal judgments were less accurate with passing time, and this change was due to diminished precision as opposed to an increased rate of guessing. Moreover, although we observed a negligible influence of guessing, subjects exhibited a clear effect of bias that favored recent responses. Together, in contrast to numerous studies of memory for other continuous features (e.g., color and location), our findings demonstrate a novel pattern of decision factors, suggesting that the retrieval of time might highlight distinct attributes of episodic memory.

Mapping the organization and dynamics of the posterior medial network during movie watching

Brain regions within a posterior medial network (PMN) are characterized by sensitivity to episodic tasks, and they also demonstrate strong functional connectivity as part of the default network. Despite its cohesive structure, delineating the intranetwork organization and functional diversity of the PMN is crucial for understanding its contributions to multidimensional event cognition. Here, we probed functional connectivity of the PMN during movie watching to identify its pattern of connections and subnetwork functions in a split-sample replication of 136 participants. Consistent with prior findings of default network fractionation, we identified distinct PMN subsystems: a Ventral PM subsystem (retrosplenial cortex, parahippocampal cortex, posterior angular gyrus) and a Dorsal PM subsystem (medial prefrontal cortex, hippocampus, precuneus, posterior cingulate cortex, anterior angular gyrus). Ventral and Dorsal PM subsystems were differentiated by functional connectivity with parahippocampal cortex and precuneus and integrated by retrosplenial cortex and posterior cingulate cortex, respectively. Finally, the distinction between PMN subsystems is functionally relevant: whereas both Dorsal and Ventral PM connectivity tracked the movie content, only Ventral PM connections increased in strength at event transitions and appeared sensitive to episodic memory. Overall, these findings reveal PMN functional pathways and the distinct functional roles of intranetwork subsystems during event cognition.

Neuroanatomical correlates of self-awareness of highly practiced visuomotor skills

Metacognition is the ability to introspect and control ongoing cognitive processes. Despite the extensive investigation of the brain architectures supporting metacognition for perception and memory, little is known about the neural basis of metacognitive capacity for motor function, a vital aspect of human behavior. Here, using functional and structural magnetic resonance imaging (MRI), we examined the brain substrates underlying self-awareness of handwriting, a highly practiced visuomotor skill. Results showed that experienced adult writers generally overestimated their handwriting quality, and such overestimation was more pronounced in men relative to women. Individual variations in self-awareness of handwriting quality were positively correlated with gray matter volume in the left fusiform gyrus, right middle frontal gyrus and right precuneus. The left fusiform gyrus and right middle frontal gyrus are thought to represent domain-specific brain mechanisms for handwriting self-awareness, while the right precuneus that has been reported in other domains likely represents a domain-general brain mechanism for metacognition. Furthermore, the activity of these structurally related regions in a handwriting task was not correlated with self-awareness of handwriting, suggesting the correlation with metacognition was independent of task performance. Together, this study reveals that metacognition for practiced motor skills relies on both domain-general and domain-specific brain systems, extending our understanding about the neural basis of human metacognition.

Are efficient learners of verbal stimuli also efficient and precise learners of visuospatial stimuli?

People differ in how quickly they learn information and how long they remember it, and these two variables are correlated such that people who learn more quickly tend to retain more of the newly learned information. Zerr and colleagues [2018. Learning efficiency: Identifying individual differences in learning rate and retention in healthy adults. Psychological Science, 29(9), 1436-1450] termed the relation between learning rate and retention as learning efficiency, with more efficient learners having both a faster acquisition rate and better memory performance after a delay. Zerr et al. also demonstrated in separate experiments that how efficiently someone learns is stable across a range of days and years with the same kind of stimuli. The current experiments (combined N = 231) replicate the finding that quicker learning coincides with better retention and demonstrate that the correlation extends to multiple types of materials. We also address the generalisability of learning efficiency: A person's efficiency with learning Lithuanian-English (verbal-verbal) pairs predicts their efficiency with Chinese-English (visuospatial-verbal) and (to a lesser extent) object-location (visuospatial-visuospatial) paired associates. Finally, we examine whether quicker learners also remember material more precisely by using a continuous measure of recall accuracy with object-location pairs.

Memory precision of object-location binding is unimpaired in APOE ε4-carriers with spatial navigation deficits

Research suggests that tests of memory fidelity, feature binding and spatial navigation are promising for early detection of subtle behavioural changes related to Alzheimer's disease. In the absence of longitudinal data, one way of testing the early detection potential of cognitive tasks is through the comparison of individuals at different genetic risk for Alzheimer's dementia. Most studies have done so using samples aged 70 years or older. Here, we tested whether memory fidelity of long-term object-location binding may be a sensitive marker even among cognitively healthy individuals in their mid-60s by comparing participants at low and higher risk based on presence of the ε4-allele of the apolipoprotein gene (n = 26 ε3ε3, n = 20 ε3ε4 carriers). We used a continuous report paradigm in a visual memory task that required participants to recreate the spatial position of objects in a scene. We employed mixture modelling to estimate the two distinct memory processes that underpin the trial-by-trial variation in localization errors: retrieval success which indexes the proportion of trials where participants recalled any information about an object's position and the precision with which participants retrieved this information. Prior work has shown that these memory paradigms that separate retrieval success from precision are capable of detecting subtle differences in mnemonic fidelity even when retrieval success could not. Nonetheless, Bayesian analyses found good evidence that ε3ε4 carriers did not remember fewer object locations [F(1, 42) = 0.450, P = 0.506, BF01 = 3.02], nor was their precision for the spatial position of objects reduced compared to ε3ε3 carriers [F(1, 42) = 0.12, P = 0.726, BF01 = 3.19]. Because the participants in the sample presented here were a subset of a study on apolipoprotein ε4-carrier status and spatial navigation in the Sea Hero Quest game [Coughlan et al., 2019. PNAS, 116(9)], we obtained these data to contrast genetic effects on the two tasks within the same sample (n = 33). Despite the smaller sample size, wayfinding deficits among ε3ε4 carriers could be replicated [F(1, 33) = 5.60, P = 0.024, BF10 = 3.44]. Object-location memory metrics and spatial navigation scores were not correlated (all r < 0.25, P > 0.1, 0 < BF10 < 3). These findings show spared object-location binding in the presence of a detrimental apolipoprotein ε4 effect on spatial navigation. This suggests that the sensitivity of memory fidelity and binding tasks may not extend to individuals with one ε4-allele in their early to mid-60s. The results provide further support to prior proposals that spatial navigation may be a sensitive marker for the earliest cognitive changes in Alzheimer's disease, even before episodic memory.

Diffusion property and functional connectivity of superior longitudinal fasciculus underpin human metacognition

Metacognition as the capacity of monitoring one's own cognition operates across domains. Here, we addressed whether metacognition in different cognitive domains rely on common or distinct neural substrates with combined diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI) techniques. After acquiring DTI and resting-state fMRI data, we asked participants to perform a temporal-order memory task and a perceptual discrimination task, followed by trial-specific confidence judgments. DTI analysis revealed that the structural integrity (indexed by fractional anisotropy) in the anterior portion of right superior longitudinal fasciculus (SLF) was associated with both perceptual and mnemonic metacognitive abilities. Using perturbed mnemonic metacognitive scores produced by inhibiting the precuneus using TMS, the mnemonic metacognition scores did not correlate with individuals' SLF structural integrity anymore, revealing the relevance of this tract in memory metacognition. To further verify the involvement of several cortical regions connected by SLF, we took the TMS-targeted precuneus region as a seed in a functional connectivity analysis and found the functional connectivity between precuneus and two SLF-connected regions (inferior parietal cortex and precentral gyrus) mediated mnemonic metacognition performance. These results illustrate the importance of SLF and a putative white-matter grey-matter circuitry that supports human metacognition.

The neural correlates of ongoing conscious thought

A core goal in cognitive neuroscience is identifying the physical substrates of the patterns of thought that occupy our daily lives. Contemporary views suggest that the landscape of ongoing experience is heterogeneous and can be influenced by features of both the person and the context. This perspective piece considers recent work that explicitly accounts for both the heterogeneity of the experience and context dependence of patterns of ongoing thought. These studies reveal that systems linked to attention and control are important for organizing experience in response to changing environmental demands. These studies also establish a role of the default mode network beyond task-negative or purely episodic content, for example, implicating it in the level of vivid detail in experience in both task contexts and in spontaneous self-generated experiential states. Together, this work demonstrates that the landscape of ongoing thought is reflected in the activity of multiple neural systems, and it is important to distinguish between processes contributing to how the experience unfolds from those linked to how these experiences are regulated.

Roles of the Default Mode and Multiple-Demand Networks in Naturalistic versus Symbolic Decisions

The default mode network (DMN) is often associated with representing semantic, social, and situational content of contexts and episodes. The DMN may therefore be important for contextual decision-making, through representing situational constraints and simulating common courses of events. Most decision-making paradigms, however, use symbolic stimuli and instead implicate cognitive control regions, such as the multiple demand (MD) system. This fMRI study aimed to contrast the brain mechanisms underlying decision-making based on rich naturalistic contexts or symbolic cues. While performing an ongoing task, 40 human participants (25 female) responded to different sounds. For one sound, the stimulus-response mapping was fixed; responses for the other sounds depended on the visual context: either lifelike scenes or letter symbols, varying across participants. Despite minimal behavioral differences between the groups, posterior DMN regions showed increased activity during context-dependent decision-making using the naturalistic scenes only, compared with symbolic cues. More anterior temporal and frontal DMN regions showed a different pattern, with sensitivity to the need for contextual control, but not to the type of context. Furthermore, in the scenes group, widespread DMN regions showed stronger representation of not just the context but also the sound whose significance it modulated. In comparison, the MD system showed strong univariate activity for every decision, but, intriguingly, somewhat reduced activity in the case of a scene-based but demanding context-dependent decision. Depending on context, we suggest, either DMN or MD regions may play a prominent role in selection and control of appropriate behavior.

SIGNIFICANCE STATEMENT Contextual knowledge is widely believed to be important for guiding real-world goal-directed behavior. Much remains to be understood, however, regarding the underlying brain mechanisms. Using a novel paradigm to contrast decisions based on richly meaningful naturalistic scenes with decisions based on symbolic cues, we find that both multiple demand regions and default mode regions may contribute to the cognitive control of behavior. Rich semantic context enhances representation not just of the context itself, but also of the contents of the decision that it controls. Dependence of a decision on naturalistic context can also reverse the common pattern of multiple demand regions responding more, and default mode regions responding less, to more difficult decisions.

Distinct neural mechanisms underlie subjective and objective recollection and guide memory-based decision making

Accurate memories are often associated with vivid experiences of recollection. However, the neural mechanisms underlying subjective recollection and their unique role in decision making beyond accuracy have received limited attention. We dissociated subjective recollection from accuracy during a forced-choice task. Distractors corresponded either to non-studied exemplars of the targets (A-A’ condition) or to non-studied exemplars of different studied items (A-B’ condition). The A-A’ condition resulted in higher accuracy and greater activation in the superior parietal lobe, whereas the A-B’ condition resulted in higher subjective recollection and greater activation in the precuneus and retrosplenial regions, indicating a dissociation between objective and subjective memory. Activation in insular, cingulate, and lateral prefrontal regions was also associated with subjective recollection; however, during a subsequent decision phase, activation in these same regions was greater for discarded than for selected responses in anticipation of a social reward, underscoring their role in evaluating memory evidence flexibly based on current goals.

Harnessing Visual Imagery and Oculomotor Behaviour to Understand Prospection

Much of the rich internal world constructed by humans is derived from, and experienced through, visual mental imagery. Despite growing appreciation of visual exploration in guiding episodic memory processes, extant theories of prospection have yet to accommodate the precise role of visual mental imagery in the service of future-oriented thinking. We propose that the construction of future events relies on the assimilation of perceptual details originally experienced, and subsequently reinstantiated, predominantly in the visual domain. Individual differences in the capacity to summon discrete aspects of visual imagery can therefore account for the diversity of content generated by humans during future simulation. Our integrative framework provides a novel testbed to query alterations in future thinking in health and disease.

A Unifying Account of Angular Gyrus Contributions to Episodic and Semantic Cognition

The angular gyrus (AG) region of lateral parietal cortex has been implicated in a wide variety of tasks and functions, generating numerous influential theories. However, these theories largely fail to explain why so many apparently distinct cognitive activities implicate common parietal structures. We propose a unifying model, based on a set of central principles, to account for coalescences of cognitive task activations across AG. To illustrate the proposed framework, we show how these principles account for findings from studies of episodic and semantic memory that have independently implicated the same AG regions but thus far been considered from largely domain-specific perspectives. We conclude that AG computations, as part of a wider lateral parietal system, enable the online dynamic buffering of multisensory spatiotemporally extended representations.

A voxel-wise meta-analysis of task-based functional MRI studies on impaired gain and loss processing in adults with addiction

BACKGROUND

Disturbances in gain and loss processing have been extensively reported in adults with addiction, a brain disorder characterized by obsession with addictive substances or behaviours. Previous studies have provided conflicting results with respect to neural abnormalities in gain processing in addiction, and few investigations into loss processing.

METHODS

We conducted voxel-wise meta-analyses of abnormal task-evoked regional activities in adults with substance dependence and gambling addiction during the processing of gains and losses not related to their addiction (mainly monetary). We identified 24 studies, including 465 participants with substance dependence, 81 with gambling addiction and 490 healthy controls.

RESULTS

Compared with healthy controls, all participants with addictions showed hypoactivations in the prefrontal cortex, striatum and insula and hyperactivations in the default mode network during gain anticipation; hyperactivations in the prefrontal cortex and both hyper- and hypoactivations in the striatum during loss anticipation; and hyperactivations in the occipital lobe during gain outcome. In the substance dependence subgroup, activity in the occipital lobe was increased during gain anticipation but decreased during loss anticipation.

LIMITATIONS

We were unable to conduct meta-analyses in the gambling addiction subgroup because of a limited data set. We did not investigate the effects of clinical variables because of limited information.

CONCLUSION

The current study identified altered brain activity associated with higher- and lower-level function during gain and loss processing for non-addiction (mainly monetary) stimuli in adults with substance dependence and gambling addiction. Adults with addiction were more sensitive to anticipatory gains than losses at higher- and lower-level brain areas. These results may help us to better understand the pathology of gain and loss processing in addiction.

Increased regional homogeneity modulated by metacognitive training predicts therapeutic efficacy in patients with schizophrenia

Previous studies have demonstrated the efficacy of metacognitive training (MCT) in schizophrenia. However, the underlying mechanisms related to therapeutic effect of MCT remain unknown. The present study explored the treatment effects of MCT on brain regional neural activity using regional homogeneity (ReHo) and whether these regions' activities could predict individual treatment response in schizophrenia. Forty-one patients with schizophrenia and 20 healthy controls were scanned using resting-state functional magnetic resonance imaging. Patients were randomly divided into drug therapy (DT) and drug plus psychotherapy (DPP) groups. The DT group received only olanzapine treatment, whereas the DPP group received olanzapine and MCT for 8 weeks. The results revealed that ReHo in the right precuneus, left superior medial prefrontal cortex (MPFC), right parahippocampal gyrus and left rectus was significantly increased in the DPP group after 8 weeks of treatment. Patients in the DT group showed significantly increased ReHo in the left ventral MPFC/anterior cingulate cortex (ACC), left superior MPFC/middle frontal gyrus (MFG), left precuneus, right rectus and left MFG, and significantly decreased ReHo in the bilateral cerebellum VIII and left inferior occipital gyrus (IOG) after treatment. Support vector regression analyses showed that high ReHo levels at baseline in the right precuneus and left superior MPFC could predict symptomatic improvement of Positive and Negative Syndrome Scale (PANSS) after 8 weeks of DPP treatment. Moreover, high ReHo levels at baseline and alterations of ReHo in the left ventral MPFC/ACC could predict symptomatic improvement of PANSS after 8 weeks of DT treatment. This study suggests that MCT is associated with the modulation of ReHo in schizophrenia. ReHo in the right precuneus and left superior MPFC may predict individual therapeutic response for MCT in patients with schizophrenia.

Neural Development of Memory and Metamemory in Childhood and Adolescence: Toward an Integrative Model of the Development of Episodic Recollection

Memory and metamemory processes are essential to retrieve detailed memories and appreciate the phenomenological experience of recollection. Developmental cognitive neuroscience has made strides in revealing the neural changes associated with improvements in memory and metamemory during childhood and adolescence. We argue that hippocampal changes, in concert with surrounding cortical regions, support developmental improvements in the precision, complexity, and flexibility of memory representations. In contrast, changes in frontoparietal regions promote efficient encoding and retrieval strategies. A smaller body of literature on the neural substrates of metamemory development suggests that error monitoring processes implemented in the anterior insula and dorsal anterior cingulate cortex trigger, and perhaps support the development of, metacognitive evaluationsin the prefrontal cortex, while developmental changes in the parietal cortex support changes in the phenomenological experience of episodic retrieval. Our conclusions highlight the necessity of integrating these lines of research into a comprehensive model on the neurocognitive development of episodic recollection.

Age-related alterations of default mode network in autobiographical memory: Recent versus remote events

Previous studies have shown that the vividness of autobiographical memory decreases over time, and older adults often retrieve fewer details than young adults. However, the age-by-temporal distance (i.e., recent versus remote events) effect on autobiographical memory and underlying neural mechanisms are less understood. We recruited 25 young adults and 27 older adults to perform an fMRI-adapted autobiographical memory task with different temporal distances. The results showed that older adults' vividness ratings were generally higher than that of young adults, but were less sensitive to temporal distances. For neural imaging, an age-by-temporal distance effect was found in the left precuneus, manifested as young adults had more activation for recent events than for remote events, whereas no temporal distance effect was found in older adults. Interestingly, for older adults, the temporal distance effect was reflected by functional connectivity within the default mode network (DMN), with a stronger anterior DMN-posterior DMN coupling for remote events than for recent events, whereas no temporal distance difference on functional connectivity was found in young adults. The results suggest that older adults exhibit age-related neural differences in both activation and functional connectivity during the processing of autobiographical memory with different temporal distances, shedding new light for the understanding of the relationship between the DMN, autobiographical memory, and aging.

Probing the relevance of the hippocampus for conflict-induced memory improvement

The hippocampus plays a key role for episodic memory. In addition, a small but growing number of studies has shown that it also contributes to the resolution of response conflicts. It is less clear how these two functions are related, and how they are affected by hippocampal lesions in patients with mesial temporal lobe epilepsy (MTLE). Previous studies suggested that conflict stimuli might be better remembered, but whether the hippocampus is critical for supporting this interaction between conflict processing and memory formation is unknown. Here, we tested 19 patients with MTLE due to hippocampal sclerosis and 19 matched healthy controls. Participants performed a face-word Stroop task during functional magnetic resonance imaging (fMRI) followed by a recognition task for the faces. We tested whether memory performance and activity in brain regions implicated in long-term memory were modulated by conflict during encoding, and whether this differed between MTLE patients and controls. In controls, we largely replicated previous findings of improved memory for conflict stimuli. While MTLE patients showed response time slowing during conflict trials as well, they did not exhibit a memory benefit. In controls, neural activity of conflict resolution and memory encoding interacted within a hippocampal region of interest. Here, left hippocampal recruitment was less efficient for memory performance in incongruent trials than in congruent trials, suggesting an intrahippocampal competition for limited resources. They also showed an involvement of precuneus and posterior cingulate cortex during conflict resolution. Both effects were not observed in MTLE patients, where activation of the precuneus and posterior cingulate cortex instead predicted later memory. Further research is needed to find out whether our findings reflect widespread functional reorganization of the episodic memory network due to hippocampal dysfunction.

Does hippocampal volume explain performance differences on hippocampal-dependant tasks?

Marked disparities exist across healthy individuals in their ability to imagine scenes, recall autobiographical memories, think about the future and navigate in the world. The importance of the hippocampus in supporting these critical cognitive functions has prompted the question of whether differences in hippocampal grey matter volume could be one source of performance variability. Evidence to date has been somewhat mixed. In this study we sought to mitigate issues that commonly affect these types of studies. Data were collected from a large sample of 217 young, healthy adult participants, including whole brain structural MRI data (0.8 mm isotropic voxels) and widely-varying performance on scene imagination, autobiographical memory, future thinking and navigation tasks. We found little evidence that hippocampal grey matter volume was related to task performance in this healthy sample. This was the case using different analysis methods (voxel-based morphometry, partial correlations), when whole brain or hippocampal regions of interest were examined, when comparing different sub-groups (divided by gender, task performance, self-reported ability), and when using latent variables derived from across the cognitive tasks. Hippocampal grey matter volume may not, therefore, significantly influence performance on tasks known to require the hippocampus in healthy people. Perhaps only in extreme situations, as in the case of licensed London taxi drivers, are measurable ability-related hippocampus volume changes consistently exhibited.

Schematic memories develop quickly, but are not expressed unless necessary

Episodic memory retrieval is increasingly influenced by schematic information as memories mature, but it is unclear whether this is due to the slow formation of schemas over time, or the slow forgetting of the episodes. To address this, we separately probed memory for newly learned schemas as well as their influence on episodic memory decisions. In this experiment, participants encoded images from two categories, with the location of images in each category drawn from a different spatial distribution. They could thus learn schemas of category locations by encoding specific episodes. We found that images that were more consistent with these distributions were more precisely retrieved, and this schematic influence increased over time. However, memory for the schema distribution, measured using generalization to novel images, also became less precise over time. This incongruity suggests that schemas form rapidly, but their influence on episodic retrieval is dictated by the need to bolster fading memory representations.

Neurocognitive patterns dissociating semantic processing from executive control are linked to more detailed off-task mental time travel

Features of ongoing experience are common across individuals and cultures. However, certain people express specific patterns of thought to a greater extent than others. Contemporary psychological theory assumes that individual differences in thought patterns occur because different types of experience depend on the expression of different neurocognitive processes. Consequently, individual variation in the underlying neurocognitive architecture is hypothesised to determine the ease with which certain thought patterns are generated or maintained. Our study (N = 178) tested this hypothesis using multivariate pattern analysis to infer shared variance among measures of cognitive function and neural organisation and examined whether these latent variables explained reports of the patterns of on-going thoughts people experienced in the lab. We found that relatively better performance on tasks relying primarily on semantic knowledge, rather than executive control, was linked to a neural functional organisation associated, via meta-analysis, with task labels related to semantic associations (sentence processing, reading and verbal semantics). Variability of this functional mode predicted significant individual variation in the types of thoughts that individuals experienced in the laboratory: neurocognitive patterns linked to better performance at tasks that required guidance from semantic representation, rather than those dependent on executive control, were associated with patterns of thought characterised by greater subjective detail and a focus on time periods other than the here and now. These relationships were consistent across different days and did not vary with level of task demands, indicating they are relatively stable features of an individual’s cognitive profile. Together these data confirm that individual variation in aspects of ongoing experience can be inferred from hidden neurocognitive architecture and demonstrate that performance trade-offs between executive control and long-term semantic knowledge are linked to a person’s tendency to imagine situations that transcend the here and now.

Dissociating memory accessibility and precision in forgetting

Forgetting involves the loss of information over time; however, we know little about what form this information loss takes. Do memories become less precise over time, or do they instead become less accessible? Here we assessed memory for word-location associations across four days, testing whether forgetting involves losses in precision versus accessibility and whether such losses are modulated by learning a generalizable pattern. We show that forgetting involves losses in memory accessibility with no changes in memory precision. When participants learned a set of related word-location associations that conformed to a general pattern, we saw a strong trade-off; accessibility was enhanced, whereas precision was reduced. However, this trade-off did not appear to be modulated by time or confer a long-term increase in the total amount of information maintained in memory. Our results place theoretical constraints on how models of forgetting and generalization account for time-dependent memory processes. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on 4 June 2019. The protocol, as accepted by the journal, can be found at https://doi.org/10.6084/m9.figshare.c.4368464.v1 .

Hippocampal and cortical mechanisms at retrieval explain variability in episodic remembering in older adults

Age-related episodic memory decline is characterized by striking heterogeneity across individuals. Hippocampal pattern completion is a fundamental process supporting episodic memory. Yet, the degree to which this mechanism is impaired with age, and contributes to variability in episodic memory, remains unclear. We combine univariate and multivariate analyses of fMRI data from a large cohort of cognitively normal older adults (N=100) to measure hippocampal activity and cortical reinstatement during retrieval of trial-unique associations. Trial-wise analyses revealed that (a) hippocampal activity scaled with reinstatement strength, (b) cortical reinstatement partially mediated the relationship between hippocampal activity and associative retrieval, (c) older age weakened cortical reinstatement and its relationship to memory behaviour. Moreover, individual differences in the strength of hippocampal activity and cortical reinstatement explained unique variance in performance across multiple assays of episodic memory. These results indicate that fMRI indices of hippocampal pattern completion explain within- and across-individual memory variability in older adults.

Deconstructing the Posterior Medial Episodic Network

Our ability to remember or imagine specific events involves the construction of complex mental representations, a process that engages cortical and hippocampal regions in a core posterior medial (PM) brain network. Existing theoretical approaches have described the overarching contributions of the PM network, but less is known about how episodic content is represented and transformed throughout this system. Here, we review evidence of key functional interactions among PM regions and their relation to the core cognitive operations and representations supporting episodic construction. Recent demonstrations of intranetwork functional diversity are integrated with existing accounts to inform a network-based model of episodic construction, in which PM regions flexibly share and manipulate event information to support the variable phenomenology of episodic memory and simulation.

Functionally Distinct Neuronal Ensembles within the Memory Engram

Memories are believed to be encoded by sparse ensembles of neurons in the brain. However, it remains unclear whether there is functional heterogeneity within individual memory engrams, i.e., if separate neuronal subpopulations encode distinct aspects of the memory and drive memory expression differently. Here, we show that contextual fear memory engrams in the mouse dentate gyrus contain functionally distinct neuronal ensembles, genetically defined by the Fos- or Npas4-dependent transcriptional pathways. The Fos-dependent ensemble promotes memory generalization and receives enhanced excitatory synaptic inputs from the medial entorhinal cortex, which we find itself also mediates generalization. The Npas4-dependent ensemble promotes memory discrimination and receives enhanced inhibitory drive from local cholecystokinin-expressing interneurons, the activity of which is required for discrimination. Our study provides causal evidence for functional heterogeneity within the memory engram and reveals synaptic and circuit mechanisms used by each ensemble to regulate the memory discrimination-generalization balance.

Age differences in the neural correlates of the specificity of recollection: An event-related potential study

In young adults, the neural correlates of successful recollection vary with the specificity (or amount) of information retrieved. We examined whether the neural correlates of recollection are modulated in a similar fashion in older adults. We compared event-related potential (ERP) correlates of recollection in samples of healthy young and older adults (N = 20 per age group). At study, participants were cued to make one of two judgments about each of a series of words. Subsequently, participants completed a memory test for studied and unstudied words in which they first made a Remember/Know/New (RKN) judgment, followed by a source memory judgment when a word attracted a 'Remember' (R) response. In young adults, the 'left parietal effect' - a putative ERP correlate of successful recollection - was largest for test items endorsed as recollected (R judgment) and attracting a correct source judgment, intermediate for items endorsed as recollected but attracting an incorrect or uncertain source judgment, and, relative to correct rejections, absent for items endorsed as familiar only (K judgment). In marked contrast, the left parietal effect was not detectable in older adults. Rather, regardless of source accuracy, studied items attracting an R response elicited a sustained, centrally maximum negative-going deflection relative to both correct rejections and studied items where recollection failed (K judgment). A similar retrieval-related negativity has been described previously in older adults, but the present findings are among the few to link this effect specifically to recollection. Finally, relative to correct rejections, all classes of correctly recognized old items elicited an age-invariant, late-onsetting positive deflection that was maximal over the right frontal scalp. This finding, which replicates several prior results, suggests that post-retrieval monitoring operations were engaged to an equivalent extent in the two age groups. Together, the present results suggest that there are circumstances where young and older adults engage qualitatively distinct retrieval-related processes during successful recollection.

Neural Patterns are More Similar across Individuals during Successful Memory Encoding than during Failed Memory Encoding

After experiencing the same episode, some people can recall certain details about it, whereas others cannot. We investigate how common (intersubject) neural patterns during memory encoding influence whether an episode will be subsequently remembered, and how divergence from a common organization is associated with encoding failure. Using functional magnetic resonance imaging with intersubject multivariate analyses, we measured brain activity as people viewed episodes within wildlife videos and then assessed their memory for these episodes. During encoding, greater neural similarity was observed between the people who later remembered an episode (compared with those who did not) within the regions of the declarative memory network (hippocampus, posterior medial cortex [PMC], and dorsal Default Mode Network [dDMN]). The intersubject similarity of the PMC and dDMN was episode-specific. Hippocampal encoding patterns were also more similar between subjects for memory success that was defined after one day, compared with immediately after retrieval. The neural encoding patterns were sufficiently robust and generalizable to train machine learning classifiers to predict future recall success in held-out subjects, and a subset of decodable regions formed a network of shared classifier predictions of subsequent memory success. This work suggests that common neural patterns reflect successful, rather than unsuccessful, encoding across individuals.

Progression from Feature-Specific Brain Activity to Hippocampal Binding during Episodic Encoding

The hallmark of episodic memory is recollecting multiple perceptual details tied to a specific spatial-temporal context. To remember an event, it is therefore necessary to integrate such details into a coherent representation during initial encoding. Here we tested how the brain encodes and binds multiple, distinct kinds of features in parallel, and how this process evolves over time during the event itself. We analyzed data from 27 human subjects (16 females, 11 males) who learned a series of objects uniquely associated with a color, a panoramic scene location, and an emotional sound while fMRI data were collected. By modeling how brain activity relates to memory for upcoming or just-viewed information, we were able to test how the neural signatures of individual features as well as the integrated event changed over the course of encoding. We observed a striking dissociation between early and late encoding processes: left inferior frontal and visuo-perceptual signals at the onset of an event tracked the amount of detail subsequently recalled and were dissociable based on distinct remembered features. In contrast, memory-related brain activity shifted to the left hippocampus toward the end of an event, which was particularly sensitive to binding item color and sound associations with spatial information. These results provide evidence of early, simultaneous feature-specific neural responses during episodic encoding that predict later remembering and suggest that the hippocampus integrates these features into a coherent experience at an event transition.SIGNIFICANCE STATEMENT Understanding and remembering complex experiences are crucial for many socio-cognitive abilities, including being able to navigate our environment, predict the future, and share experiences with others. Probing the neural mechanisms by which features become bound into meaningful episodes is a vital part of understanding how we view and reconstruct the rich detail of our environment. By testing memory for multimodal events, our findings show a functional dissociation between early encoding processes that engage lateral frontal and sensory regions to successfully encode event features, and later encoding processes that recruit hippocampus to bind these features together. These results highlight the importance of considering the temporal dynamics of encoding processes supporting multimodal event representations.

Precision, binding, and the hippocampus: Precisely what are we talking about?

Endel Tulving's proposal that episodic memory is distinct from other memory systems like semantic memory remains an extremely influential idea in cognitive neuroscience research. As originally suggested by Tulving, episodic memory involves three key components that differentiate it from all other memory systems: spatiotemporal binding, mental time travel, and autonoetic consciousness. Here, we focus on the idea of spatiotemporal binding in episodic memory and, in particular, how consideration of the precision of spatiotemporal context helps expand our understanding of episodic memory. Precision also helps shed light on another key issue in cognitive neuroscience, the role of the hippocampus outside of episodic memory in perception, attention, and working memory. By considering precision alongside item-context bindings, we attempt to shed new light on both the nature of how we represent context and what roles the hippocampus plays in episodic memory and beyond.

Long-term memory specificity depends on inhibition of related items

Long-term memory relies on both accurately retrieving specific details and inhibiting competing information. In the current investigation, we evaluated the specificity of long-term memory representations for faces. During each study phase, participants were presented with neutral Caucasian male and female faces. During the corresponding test phase, old faces, related faces, and new faces were presented and participants made "old"-"new" recognition judgments. Related faces were created by morphing along a continuum in steps of 20% (i.e., 20%, 40%, 60% and 80% morphs) between old faces and new faces (independent ratings indicated that the pairs of to-be-morphed old faces and new faces were perceptually dissimilar). In two experiments, memory representations were very specific as the "old" response rate for old faces was significantly higher than closely related faces (i.e., 20% morphs). Furthermore, there was evidence of memory inhibition, as the "old" response rate for 20% morphs was significantly lower than 40% morphs (the identical pattern of results was observed with a d' analysis). These findings may reflect an evolutionary advantage for recognising specific faces, which may require inhibition of closely related faces.

The ventral lateral parietal cortex in episodic memory: From content to attribution

The ventral lateral parietal cortex (VLPC) shows robust activation during episodic retrieval, and is involved in content representation, as well as in the evaluation of memory traces. This suggests that the VLPC has a crucial contribution to the quality of recollection and the subjective experience of remembering, and situates it at the intersection of the core and attribution systems.