Have you been there before? Decoding recognition of spatial scenes from fMRI signals in precuneus

One potential application of forensic "brain reading" is to test whether a suspect has previously experienced a crime scene. Here, we investigated whether it is possible to decode real life autobiographic exposure to spatial locations using fMRI. In the first session, participants visited four out of eight possible rooms on a university campus. During a subsequent scanning session, subjects passively viewed pictures and videos from these eight possible rooms (four old, four novel) without giving any responses. A multivariate searchlight analysis was employed that trained a classifier to distinguish between "seen" versus "unseen" stimuli from a subset of six rooms. We found that bilateral precuneus encoded information that can be used to distinguish between previously seen and unseen rooms and that also generalized to the two stimuli left out from training. We conclude that activity in bilateral precuneus is associated with the memory of previously visited rooms, irrespective of the identity of the room, thus supporting a parietal contribution to episodic memory for spatial locations. Importantly, we could decode whether a room was visited in real life without the need of explicit judgments about the rooms. This suggests that recognition is an automatic response that can be decoded from fMRI data, thus potentially supporting forensic applications of concealed information tests for crime scene recognition.

How does the "default mode" network contribute to semantic cognition?

This review examines whether and how the "default mode" network (DMN) contributes to semantic processing. We review evidence implicating the DMN in the processing of individual word meanings and in sentence- and discourse-level semantics. Next, we argue that the areas comprising the DMN contribute to semantic processing by coordinating and integrating the simultaneous activity of local neuronal ensembles across multiple unimodal and multimodal cortical regions, creating a transient, global neuronal ensemble. The resulting ensemble implements an integrated simulation of phenomenological experience - that is, an embodied situation model - constructed from various modalities of experiential memory traces. These situation models, we argue, are necessary not only for semantic processing but also for aspects of cognition that are not traditionally considered semantic. Although many aspects of this proposal remain provisional, we believe it provides new insights into the relationships between semantic and non-semantic cognition and into the functions of the DMN.

Lesion-behavior mapping indicates a strategic role for parietal substrates of associative memory

Numerous neuroimaging studies indicate that ventral parietal cortex (VPC), especially angular gyrus, plays an important role in episodic memory. However, the nature of the mnemonic processes supported by this region is far from clear. We previously found that stroke lesions in VPC and lateral temporal cortex caused deficits in cued recall of unimodal word pairs and picture pairs, and cross-modal picture-sound pairs, with larger deficits in the cross-modal task. However, those findings leave open the question whether those regions' integrity is necessary for maintenance of associative representations, or for strategic processes required for their recall. We addressed this question using associative recognition versions of those tasks. We additionally manipulated semantic relatedness of the associated memoranda, to assess VPC's involvement in semantic processing in the context of episodic memory. We analyzed performance of 62 first-event, sub-acute phase stroke patients (31 right- and 31 left-hemisphere damage) relative to 65 healthy participants, and employed voxel-based lesion-behavior mapping (VLBM) to identify task-relevant structures. Patients displayed greater false associative recognition of semantically related compared to unrelated recombined pairs. VLBM analysis implicated right lateral temporo-parietal regions in associative recognition deficits in the cross-modal pairs task, specifically for related recombined and new pairs, seemingly because of difficulty overcoming semantic relatedness bias effects on episodic discrimination. In contrast, damage to ventral parietal and lateral temporal cortex was not implicated in memory for unrelated memoranda. We interpret this pattern of lesion-behavior effects as indicating lateral temporo-parietal cortex involvement in strategic, rather than representational, roles in episodic associative memory.

Script-driven imagery of socially salient autobiographical memories in major depressive disorder

Cues of social rejection and affiliation represent proximal risk and protective factors in the onset and maintenance of depression. Such cues are thought to activate an evolutionarily primed neuro-cognitive alarm system, alerting the agent to the benefits of inclusion or the risk of social exclusion within social hierarchies focused on ensuring continued access to resources. In tandem, autobiographical memory is thought to be over-general and negatively biased in Major Depressive Disorder (MDD) which can contribute to maintenance and relapse. How memories of social rejection and affiliation are experienced and processed in MDD remains unexplored. Eighteen participants with recurrent and chronic MDD and 18 never-depressed controls listened to and vividly revisited autobiographical social experiences in an ecologically valid script-driven imagery paradigm using naturalistic memory narratives in an fMRI paradigm. Memories of Social Inclusion and Social Rejection broadly activated a common network of regions including the bilateral insula, thalamus and pre/postcentral gyrus across both groups. However, having a diagnosis of MDD was associated with an increased activation of the right middle frontal gyrus irrespective of memory type. Changes in positive affect were associated with activity in the dorsal ACC in the MDD group and in the insular cortex of the Control group. Our findings add to the evidence for complex representations for both positive and negative social signals in MDD and suggest neural sensitivity in MDD towards any socially salient information as opposed to selective sensitivity towards negative social experiences.

Common and distinct correlates of construction and elaboration of episodic-autobiographical memory: An ALE meta-analysis

The recollection of episodic-autobiographical memories (EAMs) entails a complex temporal dynamic, from initial "construction" to subsequent "elaboration" of memories. While there is consensus that EAM retrieval involves a distributed network of brain regions, it is still largely debated which regions specifically contribute to EAM construction and/or elaboration. To clarify this issue, we conducted an Activation Likelihood Estimation (ALE) meta-analysis based on the Preferred Reporting Items for Systematic-Reviews and Meta-Analyses (PRISMA) method. We found common recruitment of the left hippocampus and posterior cingulate cortex (PCC) during both phases. Additionally, EAM construction led to activations in the ventromedial prefrontal cortex, left angular gyrus (AG), right hippocampus, and precuneus, while the right inferior frontal gyrus was activated by EAM elaboration. Although most of these regions are distributed over the default mode network, the current findings highlight a differential contribution according to early (midline regions, left/right hippocampus, and left AG) versus later (left hippocampus, and PCC) recollection. Overall, these findings contribute to clarify the neural correlates that support the temporal dynamics of EAM recollection.

VR for Cognition and Memory

This chapter will provide a review of research into human cognition through the lens of VR-based paradigms for studying memory. Emphasis is placed on why VR increases the ecological validity of memory research and the implications of such enhancements.

Proper and common names in the semantic system

Proper names are an important part of language and communication. They are thought to have a special status due to their neuropsychological and psycholinguistic profile. To what extent proper names rely on the same semantic system as common names is not clear. In an fMRI study, we presented the same group of participants with both proper and common names to compare the associated activations. Both person and place names, as well as personally familiar and famous names were used, and compared with words representing concrete and abstract concepts. A whole-brain analysis was followed by a detailed analysis of subdivisions of four regions of interest known to play a central role in the semantic system: angular gyrus, anterior temporal lobe, posterior cingulate complex, and medial temporal lobe. We found that most subdivisions within these regions bilaterally were activated by both proper names and common names. The bilateral perirhinal and right entorhinal cortex showed a response specific to proper names, suggesting an item-specific role in retrieving person and place related information. While activation to person and place names overlapped greatly, place names were differentiated by activating areas associated with spatial memory and navigation. Person names showed greater right hemisphere involvement compared to places, suggesting a wider range of associations. Personally familiar names showed stronger activation bilaterally compared to famous names, indicating representations that are enhanced by autobiographic and episodic details. Both proper and common names are processed in the wider semantic system that contains associative, episodic, and spatial components. Processing of proper names is characterized by a somewhat stronger involvement these components, rather than by a fundamentally different system.

Neurolaw: Challenges and limits

This chapter canvasses the current relevance of behavioral neuroscience to the law, especially to issues of criminal responsibility and competence. It begins with an explanation of the legal doctrines at stake. I then explore the source of the often-inflated claims for the legal relevance of neuroscience. The next section discusses the scientific status of behavioral neuroscience. Then, it addresses two radical challenges to current conceptions of criminal responsibility that neuroscience allegedly poses: determinism and the death of agency. The question of the specific relevance of neuroscience to criminal law doctrine, practice, and institutions is considered next. This is followed by a discussion of how neuroscience evidence is being used in criminal cases in five different countries, including the United States. The penultimate section points to some areas warranting modest optimism. A brief conclusion suggests that neuroscience is at present of limited legal relevance, and advances in the science might alter that judgment.

Multidimensional memory topography in the medial parietal cortex identified from neuroimaging of thousands of daily memory videos

Our memories form a tapestry of events, people, and places, woven across the decades of our lives. However, research has often been limited in assessing the nature of episodic memory by using artificial stimuli and short time scales. The explosion of social media enables new ways to examine the neural representations of naturalistic episodic memories, for features like the memory's age, location, memory strength, and emotions. We recruited 23 users of a video diary app ("1 s Everyday"), who had recorded 9266 daily memory videos spanning up to 7 years. During a 3 T fMRI scan, participants viewed 300 of their memory videos intermixed with 300 from another individual. We find that memory features are tightly interrelated, highlighting the need to test them in conjunction, and discover a multidimensional topography in medial parietal cortex, with subregions sensitive to a memory's age, strength, and the familiarity of the people and places involved.

In search of a naturalistic neuroimaging approach: Exploration of general feasibility through the case of VR-fMRI and application in the domain of episodic memory

Virtual Reality (VR) is an increasingly widespread tool for research as it allows the creation of experiments taking place in multimodal and daily-life-like environments, while keeping a strong experimental control. Adding neuroimaging to VR leads to a better understanding of the underlying brain networks activated during a naturalistic task, whether for research purposes or rehabilitation. The present paper focuses on the specific use of concurrent VR and fMRI and its technical challenges and feasibility, with a brief examination of the general existing solutions. Following the PRISMA guidelines, the review investigates the particular case of how VR-fMRI has explored episodic memory so far, with a comparison of object- and place-based episodic memory. This review confirms the involvement of cerebral regions well-known to be implicated in episodic memory and unravels other regions devoted to bodily and narrative aspects of the self, promoting new avenues of research in the domain of naturalistic episodic memory. Future studies should develop more immersive and interactive virtual neuroimaging features to increase ecological and embodied neurocognition aspects.

Soundtrack of life: An fMRI study

Most people have a soundtrack of life, a set of special musical pieces closely linked to certain biographical experiences. Autobiographical memories (AM) and music listening (ML) involve complex mental processes ruled by differentiate brain networks. The aim of the paper was to determine the way both networks interact in linked occurrences. We performed an fMRI experiment on 31 healthy participants (age: 32.4 ± 7.6, 11 men, 4 left-handers). Participants had to recall AMs prompted by music they reported to be associated with personal biographical events (LMM: linked AM-ML events). In the main control task, participants were prompted to recall emotional AMs while listening known tracks from a pool of popular music (UMM: unlinked AM-ML events). We wanted to investigate to what extent LMM network exceeded the overlap of AM and ML networks by contrasting the activation obtained in LMM versus UMM. The contrast LMM>UMM showed the areas (at P < 0.05 FWE corrected at voxel level and cluster size>20): right frontal inferior operculum, frontal middle gyrus, pars triangularis of inferior frontal gyrus, occipital superior gyrus and bilateral basal ganglia (caudate, putamen and pallidum), occipital (middle and inferior), parietal (inferior and superior), precentral and cerebellum (6, 7 L, 8 and vermis 6 and 7). Complementary results were obtained from additional control tasks. Provided part of tLMM>UMM areas might not be related to ML-AM linkage, we assessed LMM brain network by an independent component analysis (ICA) on contrast images. Results from ICA suggest the existence of a cortico-ponto-cerebellar network including left precuneus, bilateral anterior cingulum, parahippocampal gyri, frontal inferior operculum, ventral anterior part of the insula, frontal medial orbital gyri, caudate nuclei, cerebellum 6 and vermis, which might rule the ML-induced retrieval of AM in closely linked AM-ML events. This topography may suggest that the pathway by which ML is linked to AM is attentional and directly related to perceptual processing, involving salience network, instead of the natural way of remembering typically associated with default mode network.

Neural processing of personal, relational, and collective self-worth reflected individual differences of self-esteem

INTRODUCTION

Self-esteem stems from an individual's attributes (PSE), relationships with important others (RSE), and collective membership (CSE). Our study aimed to identify neurological indicators in the processing of personal, relational, and collective self-worth, and to investigate whether these neural indicators could reflect individual differences of self-esteem.

METHODS

Fifty students underwent the evaluation of personal, relational, and collective self-worth using a self-referential paradigm while brain activities were recorded using functional-magnetic-resonance-imaging. Meanwhile, their PSE, RSE, and CSE were measured through questionnaires.

RESULTS

Conjunction analysis found self-worth processing recruited the precuneus, posterior cingulate cortex, and posterior insula. Multivariate pattern analysis showed compared to relational and collective self-worth, personal self-worth processing was distinguished by cortical-midline-structures and affective-related regions, including caudate and putamen, and that these neural patterns could reflect individual differences of PSE. Compared to personal self-worth, relational self-worth was distinguished by the neural activity of temporoparietal-junction, and this neural pattern reflected individual differences of RSE. Compared to relational self-worth, collective self-worth was distinguished by neural activity of the anterior insula, and this neural pattern reflected individual differences of CSE.

DISCUSSION

These results suggested the neurological indicators of self-worth can be recognized as an alternative way to reflect individual differences of self-esteem.

Multivariable pattern classification differentiates relational self-esteem from personal self-esteem

Relational self-esteem (RSE) refers to one’s sense of self-worth based on the relationship with significant others, such as family and best friends. Although previous neuroimaging research has investigated the neural processes of RSE, it is less clear how RSE is represented in multivariable neural patterns. Being able to identify a stable RSE signature could contribute to knowledge about relational self-worth. Here, using multivariate pattern classification to differentiate RSE from personal self-esteem (PSE), which pertains to self-worth derived from personal attributes, we obtained a stable diagnostic signature of RSE relative to PSE. We found that multivariable neural activities in the superior/middle temporal gyrus, precuneus, posterior cingulate cortex, dorsal medial Prefrontal Cortex (dmPFC) and temporo-parietal junction were responsible for diagnosis of RSE, suggesting that the evaluation of RSE involves the retrieval of relational episodic memory, perspective-taking and value calculation. Further, these diagnostic neural signatures were able to sensitively decode neural activities related to RSE in another independent test sample, indicating the reliability of the brain state represented. By providing a reliable multivariate brain pattern for RSE relative to PSE, our results informed more cognitively prominent processing of RSE than that of PSE and enriched our knowledge about how relational self-worth is generated in the brain.

Behavioural and neurophysiological signatures in the retrieval of individual memories of recent and remote real-life routine episodic events

Autobiographical memory (AM) has been largely investigated as the ability to recollect specific events that belong to an individual's past. However, how we retrieve real-life routine episodes and how the retrieval of these episodes changes with the passage of time remain unclear. Here, we asked participants to use a wearable camera that automatically captured pictures to record instances during a week of their routine life and implemented a deep neural network-based algorithm to identify picture sequences that represented episodic events. We then asked each participant to return to the lab to retrieve AMs for single episodes cued by the selected pictures 1 week, 2 weeks and 6-14 months after encoding while scalp electroencephalographic (EEG) activity was recorded. We found that participants were more accurate in recognizing pictured scenes depicting their own past than pictured scenes encoded in the lab, and that memory recollection of personally experienced events rapidly decreased with the passing of time. We also found that the retrieval of real-life picture cues elicited a strong and positive 'ERP old/new effect' over frontal regions and that the magnitude of this ERP effect was similar throughout memory tests over time. However, we observed that recognition memory induced a frontal theta power decrease and that this effect was mostly seen when memories were tested after 1 and 2 weeks but not after 6-14 months from encoding. Altogether, we discuss the implications for neuroscientific accounts of episodic retrieval and the potential benefits of developing individual-based AM exploration strategies at the clinical level.

Differentiating Real-World Autobiographical Experiences without Recourse to Behaviour

Investigating human consciousness based on brain activity alone is a key challenge in cognitive neuroscience. One of its central facets, the ability to form autobiographical memories, has been investigated through several fMRI studies that have revealed a pattern of activity across a network of frontal, parietal, and medial temporal lobe regions when participants view personal photographs, as opposed to when they view photographs from someone else's life. Here, our goal was to attempt to decode when participants were re-experiencing an entire event, captured on video from a first-person perspective, relative to a very similar event experienced by someone else. Participants were asked to sit passively in a wheelchair while a researcher pushed them around a local mall. A small wearable camera was mounted on each participant, in order to capture autobiographical videos of the visit from a first-person perspective. One week later, participants were scanned while they passively viewed different categories of videos; some were autobiographical, while others were not. A machine-learning model was able to successfully classify the video categories above chance, both within and across participants, suggesting that there is a shared mechanism differentiating autobiographical experiences from non-autobiographical ones. Moreover, the classifier brain maps revealed that the fronto-parietal network, mid-temporal regions and extrastriate cortex were critical for differentiating between autobiographical and non-autobiographical memories. We argue that this novel paradigm captures the true nature of autobiographical memories, and is well suited to patients (e.g., with brain injuries) who may be unable to respond reliably to traditional experimental stimuli.

Keep it real: rethinking the primacy of experimental control in cognitive neuroscience

Naturalistic experimental paradigms in neuroimaging arose from a pressure to test the validity of models we derive from highly-controlled experiments in real-world contexts. In many cases, however, such efforts led to the realization that models developed under particular experimental manipulations failed to capture much variance outside the context of that manipulation. The critique of non-naturalistic experiments is not a recent development; it echoes a persistent and subversive thread in the history of modern psychology. The brain has evolved to guide behavior in a multidimensional world with many interacting variables. The assumption that artificially decoupling and manipulating these variables will lead to a satisfactory understanding of the brain may be untenable. We develop an argument for the primacy of naturalistic paradigms, and point to recent developments in machine learning as an example of the transformative power of relinquishing control. Naturalistic paradigms should not be deployed as an afterthought if we hope to build models of brain and behavior that extend beyond the laboratory into the real world.

Reminders activate the prefrontal-medial temporal cortex and attenuate forgetting of event memory

Replicas of an aspect of an experienced event can serve as effective reminders, yet little is known about the neural basis of such reminding effects. Here we examined the neural activity underlying the memory-enhancing effect of reminders 1 week after encoding of naturalistic film clip events. We used fMRI to determine differences in network activity associated with recently reactivated memories relative to comparably aged, non-reactivated memories. Reminders were effective in facilitating overall retrieval of memory for film clips, in an all-or-none fashion. Prefrontal cortex and hippocampus were activated during both reminders and retrieval. Peak activation in ventro-lateral prefrontal cortex (vPFC) preceded peak activation in the right hippocampus during the reminders. For film clips that were successfully retrieved after 7 days, pre-retrieval reminders did not enhance the quality of the retrieved memory or the number of details retrieved, nor did they more strongly engage regions of the recollection network than did successful retrieval of a non-reminded film clip. These results suggest that reminders prior to retrieval are an effective means of boosting retrieval of otherwise inaccessible episodic events, and that the inability to recall certain events after a delay of a week largely reflects a retrieval deficit, rather than a storage deficit for this information. The results extend other evidence that vPFC drives activation of the hippocampus to facilitate memory retrieval and scene construction, and show that this facilitation also occurs when reminder cues precede successful retrieval attempts. The time course of vPFC-hippocampal activity during the reminder suggests that reminders may first engage schematic information meditated by vPFC followed by a recollection process mediated by the hippocampus.

Regional Specialization and Coordination Within the Network for Perceiving and Knowing About Others

Seeing familiar faces prompts the recall of diverse kinds of person-related knowledge. How this information is encoded within the well-characterized face-/person-selective network remains an outstanding question. In this functional magnetic resonance imaging study, participants rated famous faces in 10 tasks covering 5 domains of person knowledge (social, episodic, semantic, physical, and nominal). Comparing different cognitive domains enabled us to 1) test the relative roles of brain regions in specific cognitive processes and 2) apply a multivariate network-level representational similarity analysis (NetRSA) to gain insight into underlying system-level organization. Comparing across cognitive domains revealed the importance of multiple domains in most regions, the importance of social over nominal knowledge in the anterior temporal lobe, and the functional subdivision of the temporoparietal junction into perceptual superior temporal sulcus and knowledge-related angular gyrus. NetRSA revealed a strong divide between regions implicated in "default-mode" cognition and the fronto-lateral elements that coordinated more with "core" perceptual components (fusiform/occipital face areas and posterior superior temporal sulcus). NetRSA also revealed a taxonomy of cognitive processes, with semantic retrieval being more similar to episodic than nominal knowledge. Collectively, these results illustrate the importance of coordinated activity of the person knowledge network in the instantiation of the diverse cognitive capacities of this system.

Neural correlates of retrieval-based enhancement of autobiographical memory in older adults

Lifelog photo review is considered to enhance the recall of personal events. While a sizable body of research has explored the neural basis of autobiographical memory (AM), there is limited neural evidence on the retrieval-based enhancement effect on event memory among older adults in the real-world environment. This study examined the neural processes of AM as was modulated by retrieval practice through lifelog photo review in older adults. In the experiment, blood-oxygen-level dependent response during subjects’ recall of recent events was recorded, where events were cued by photos that may or may not have been exposed to a priori retrieval practice (training). Subjects remembered more episodic details under the trained relative to non-trained condition. Importantly, the neural correlates of AM was exhibited by (1) dissociable cortical areas related to recollection and familiarity, and (2) a positive correlation between the amount of recollected episodic details and cortical activation within several lateral temporal and parietal regions. Further analysis of the brain activation pattern at a few regions of interest within the core remember network showed a training_condition × event_detail interaction effect, suggesting that the boosting effect of retrieval practice depended on the level of recollected event details.

Differential Contributions of Default and Dorsal Attention Networks to Remembering Thoughts and External Stimuli From Real-Life Events

Episodic memories are typically composed of perceptual information derived from the external environment and representations of internal states (e.g., one's thoughts during prior episodes). To date, however, research has mostly focused on the remembrance of external stimuli, such that little is known about how internal mentation is represented within episodic memory. In the present fMRI study, we examined the neural correlates of these 2 components of episodic memories using a novel method of cuing memories from photographs taken during real-life events. We found that, compared with corresponding semantic memory tasks, memories for internal thoughts and external elements were associated with activity in brain areas supporting episodic recollection. Most importantly, however, the 2 kinds of memories also showed differential activation in large-scale brain networks: the remembrance of external elements was associated with greater activity in the dorsal attention network, whereas memories of internal thoughts mainly recruited default network areas. These findings shed new light on the representation of internal and external aspects of prior experience within episodic memory. The default network may contribute to the reinstatement of thoughts experienced during past events, whereas the dorsal attention network may support the allocation of attention to visuospatial features within episodic memory representations.

Tracking Your Mind's Eye during Recollection: Decoding the Long-Term Recall of Short Audiovisual Clips

Unlike familiarity, recollection involves the ability to reconstruct mentally previous events that results in a strong sense of reliving. According to the reinstatement hypothesis, this specific feature emerges from the reactivation of cortical patterns involved during information exposure. Over time, the retrieval of specific details becomes more difficult, and memories become increasingly supported by familiarity judgments. The multiple trace theory (MTT) explains the gradual loss of episodic details by a transformation in the memory representation, a view that is not shared by the standard consolidation model. In this study, we tested the MTT in light of the reinstatement hypothesis. The temporal dynamics of mental imagery from long-term memory were investigated and tracked over the passage of time. Participant EEG activity was recorded during the recall of short audiovisual clips that had been watched 3 weeks, 1 day, or a few hours beforehand. The recall of the audiovisual clips was assessed using a Remember/Know/New procedure, and snapshots of clips were used as recall cues. The decoding matrices obtained from the multivariate pattern analyses revealed sustained patterns that occurred at long latencies (>500 msec poststimulus onset) that faded away over the retention intervals and that emerged from the same neural processes. Overall, our data provide further evidence toward the MTT and give new insights into the exploration of our "mind's eye."

A contextual binding theory of episodic memory: systems consolidation reconsidered

Episodic memory reflects the ability to recollect the temporal and spatial context of past experiences. Episodic memories depend on the hippocampus but have been proposed to undergo rapid forgetting unless consolidated during offline periods such as sleep to neocortical areas for long-term storage. Here, we propose an alternative to this standard systems consolidation theory (SSCT) - a contextual binding account - in which the hippocampus binds item-related and context-related information. We compare these accounts in light of behavioural, lesion, neuroimaging and sleep studies of episodic memory and contend that forgetting is largely due to contextual interference, episodic memory remains dependent on the hippocampus across time, contextual drift produces post-encoding activity and sleep benefits memory by reducing contextual interference.

Effects of Long-Lasting High-Definition Transcranial Direct Current Stimulation in Chronic Disorders of Consciousness: A Pilot Study

Transcranial direct current stimulation (tDCS) recently was shown to benefit rehabilitation of patients with disorders of consciousness (DOC). However, high-Definition tDCS (HD-tDCS) has not been applied in DOC. In this study, we tried to use HD-tDCS protocol (2 mA, 20 min, the precuneus, and sustaining 14 days) to rehabilitate 11 patients with DOC. Electroencephalography (EEG) and Coma Recovery Scale–Revised (CRS-R) scores were recorded at before (T0), after a single session (T1), after 7 days’ (T2), and 14 days’ HD-tDCS (T3) to assess the modulation effects. EEG coherence was measured to evaluate functional connectivity during the experiment. It showed that 9 patients’ scores increased compared with the baseline. The central-parietal coherence significantly decreased in the delta band in patients with DOC. EEG coherence might be useful for assessing the effect of HD-tDCS in patients with DOC. Long-lasting HD-tDCS over the precuneus is promising for the treatment of patients with DOC.

Effects of age on across-participant variability of cortical reinstatement effects

Using functional magnetic resonance imaging data, we assessed whether across-participant variability of content-selective retrieval-related neural activity differs with age. We addressed this question by employing across-participant multi-voxel pattern analysis (MVPA), predicting that increasing age would be associated with reduced variability of retrieval-related cortical reinstatement across participants. During study, 24 young and 24 older participants viewed objects and concrete words. Test items comprised studied words, names of studied objects, and unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'Remember', 'Know' and 'New' responses, respectively. MVPA was conducted on each region belonging to the 'core recollection network', dorsolateral prefrontal cortex, and a previously identified content-selective voxel set. A leave-one-participant-out classification approach was employed whereby a classifier was trained on a subset of participants and tested on the data from a yoked pair of held-out participants. Classifiers were trained on the study phase data to discriminate the study trials as a function of content (picture or word). The classifiers were then applied to the test phase data to discriminate studied test words according to their study condition. In all of the examined regions, classifier performance demonstrated little or no sensitivity to age and, for the test data, was robustly above chance. Thus, there was little evidence to support the hypothesis that across-participant variability of retrieval-related cortical reinstatement differs with age. The findings extend prior evidence by demonstrating that content-selective cortical reinstatement is sufficiently invariant to support across-participant multi-voxel classification across the healthy adult lifespan.

Effective connectivity within the ventromedial prefrontal cortex-hippocampus-amygdala network during the elaboration of emotional autobiographical memories

Autobiographical memories (AMs) are often colored by emotions experienced during an event or those arising following further appraisals. However, how affective components of memories affect the brain-wide network recruited during the recollection of AMs remains largely unknown. Here, we examined effective connectivity during the elaboration of AMs - when retrieved episodic details are integrated to form a vivid construct - in the network composed by ventromedial prefrontal cortex (vmPFC), hippocampus and amygdala, three key regions associated with memory and affective processes. Functional MRI data was collected while volunteers recollected personal events of different types of valence and emotional intensity. Using dynamic causal modeling, we characterized the connections within the triadic network, and examined how they were modulated by the emotional intensity experienced during an event, and the valence of the affect evoked when recollecting the associated memory. Results primarily indicated the existence of a vmPFC to hippocampus effective connectivity during memory elaboration. Furthermore, the strength of the connectivity increased when participants relived memories of highly emotionally arousing events or that elicited stronger positive affect. These results indicate that the vmPFC drives hippocampal activity during memory elaboration, and plays a critical role in shaping affective responses that emanate from AMs.

Social, self, (situational), and affective processes in medial prefrontal cortex (MPFC): Causal, multivariate, and reverse inference evidence

The medial prefrontal cortex (MPFC) has been posited to serve a variety of social, affective, and cognitive functions. These conclusions have largely been driven by forward inference analyses (e.g. GLM fMRI studies and meta-analyses) that indicate where domain-specific tasks tend to produce activity but tell us little about what those regions do. Here, we take a multi-method, multi-domain approach to the functionality of MPFC subdivisions within Brodmann areas 9-11. We consider four methods that each have reverse inference or causal inference value: lesion work, transcranial magnetic stimulation, multivariate pattern analysis, and Neurosynth analyses. The Neurosynth analyses include multi-term reverse inference analyses that compare several domains of interest to one another at once. We examine the evidence supporting structure-function links in five domains: social cognition, self, value, emotional experience, and mental time travel. The evidence is considered for each of three MPFC subdivisions: dorsomedial prefrontal cortex (DMPFC), anteromedial prefrontal cortex (AMPFC), and ventromedial prefrontal cortex (VMPFC). Although there is evidentiary variability across methods, the results suggest that social processes are functionally linked to DMPFC (and somewhat surprisingly in VMPFC), self processes are linked to AMPFC, and affective processes are linked to AMPFC and VMPFC. There is also a relatively non-selective region of VMPFC that may support situational processing, a process key to each domain, but also independent of each.

The experience of vivid autobiographical reminiscence is supported by subjective content representations in the precuneus

The human posteromedial cortex, which includes core regions of the default mode network (DMN), is thought to play an important role in episodic memory. However, the nature and functional role of representations in these brain regions remain unspecified. Nine participants (all female) wore smartphone devices to record episodes from their daily lives for multiple weeks, each night indicating the personally-salient attributes of each episode. Participants then relived their experiences in an fMRI scanner cued by images from their own lives. Representational Similarity Analysis revealed a broad network, including parts of the DMN, that represented personal semantics during autobiographical reminiscence. Within this network, activity in the right precuneus reflected more detailed representations of subjective contents during vivid relative to non-vivid, recollection. Our results suggest a more specific mechanism underlying the phenomenology of vivid autobiographical reminiscence, supported by rich subjective content representations in the precuneus, a hub of the DMN previously implicated in metacognitive evaluations during memory retrieval.

Encoding the local connectivity patterns of fMRI for cognitive task and state classification

In this work, we propose a novel framework to encode the local connectivity patterns of brain, using Fisher vectors (FV), vector of locally aggregated descriptors (VLAD) and bag-of-words (BoW) methods. We first obtain local descriptors, called mesh arc descriptors (MADs) from fMRI data, by forming local meshes around anatomical regions, and estimating their relationship within a neighborhood. Then, we extract a dictionary of relationships, called brain connectivity dictionary by fitting a generative Gaussian mixture model (GMM) to a set of MADs, and selecting codewords at the mean of each component of the mixture. Codewords represent connectivity patterns among anatomical regions. We also encode MADs by VLAD and BoW methods using k-Means clustering. We classify cognitive tasks using the Human Connectome Project (HCP) task fMRI dataset and cognitive states using the Emotional Memory Retrieval (EMR). We train support vector machines (SVMs) using the encoded MADs. Results demonstrate that, FV encoding of MADs can be successfully employed for classification of cognitive tasks, and outperform VLAD and BoW representations. Moreover, we identify the significant Gaussians in mixture models by computing energy of their corresponding FV parts, and analyze their effect on classification accuracy. Finally, we suggest a new method to visualize the codewords of the learned brain connectivity dictionary.

Facing the Language-Memory Problem in the Study of Autobiographical Memory

This paper discusses the problem of the role of language in autobiographical memory, that is barely considered in studies on autobiographical memories and narratives. As a matter of fact, most of the current studies on autobiographical memory confounded memory and narrative together. The present paper focuses on two main issues. Firstly, it debates how narratives contribute to the construction of autobiographical memories through self-other communication. Secondly, it reflects on how language and communication should be manipulated in studies about autobiographical memory. This paper is made of three sections: the first section discusses the role of language, particularly in the form of narrative, as a social tool by which autobiographical memories can be organised in a life story; the second section examines previous methods of investigation used in the study of autobiographical memories; finally, the third section proposes different methodological alternatives to overcome the problems emerging from our analysis of literature.

Neural activation and memory for natural scenes: Explicit and spontaneous retrieval

Stimulus repetition elicits either enhancement or suppression in neural activity, and a recent fMRI meta-analysis of repetition effects for visual stimuli (Kim, 2017) reported cross-stimulus repetition enhancement in medial and lateral parietal cortex, as well as regions of prefrontal, temporal, and posterior cingulate cortex. Repetition enhancement was assessed here for repeated and novel scenes presented in the context of either an explicit episodic recognition task or an implicit judgment task, in order to study the role of spontaneous retrieval of episodic memories. Regardless of whether episodic memory was explicitly probed or not, repetition enhancement was found in medial posterior parietal (precuneus/cuneus), lateral parietal cortex (angular gyrus), as well as in medial prefrontal cortex (frontopolar), which did not differ by task. Enhancement effects in the posterior cingulate cortex were significantly larger during explicit compared to implicit task, primarily due to a lack of functional activity for new scenes. Taken together, the data are consistent with an interpretation that medial and (ventral) lateral parietal cortex are associated with spontaneous episodic retrieval, whereas posterior cingulate cortical regions may reflect task or decision processes.

Differential Medial Temporal Lobe and Parietal Cortical Contributions to Real-world Autobiographical Episodic and Autobiographical Semantic Memory

Autobiographical remembering can depend on two forms of memory: episodic (event) memory and autobiographical semantic memory (remembering personally relevant semantic knowledge, independent of recalling a specific experience). There is debate about the degree to which the neural signals that support episodic recollection relate to or build upon autobiographical semantic remembering. Pooling data from two fMRI studies of memory for real-world personal events, we investigated whether medial temporal lobe (MTL) and parietal subregions contribute to autobiographical episodic and semantic remembering. During scanning, participants made memory judgments about photograph sequences depicting past events from their life or from others’ lives, and indicated whether memory was based on episodic or semantic knowledge. Results revealed several distinct functional patterns: activity in most MTL subregions was selectively associated with autobiographical episodic memory; the hippocampal tail, superior parietal lobule, and intraparietal sulcus were similarly engaged when memory was based on retrieval of an autobiographical episode or autobiographical semantic knowledge; and angular gyrus demonstrated a graded pattern, with activity declining from autobiographical recollection to autobiographical semantic remembering to correct rejections of novel events. Collectively, our data offer insights into MTL and parietal cortex functional organization, and elucidate circuitry that supports different forms of real-world autobiographical memory.

Association between precuneus volume and autobiographical memory impairment in posterior cortical atrophy: Beyond the visual syndrome

Posterior cortical atrophy is a neurodegenerative syndrome characterised by progressive disruption of visual and perceptual processing, associated with atrophy in the parieto-occipital cortex. Current diagnostic criteria describe relative sparing of episodic memory function, but recent findings suggest that anterograde memory is often impaired. Whether these deficits extend to remote memory has not been addressed. A large body of evidence suggests that the recollection of an autobiographical event from the remote past coincides with the successful retrieval of visual images. We hypothesised that the profound visual processing deficits in posterior cortical atrophy would result in impaired autobiographical memory retrieval. Fourteen posterior cortical atrophy patients, eighteen typical Alzheimer's disease patients and twenty-eight healthy controls completed the Autobiographical Interview. Autobiographical memory in posterior cortical atrophy was characterised by a striking loss of internal, episodic detail relative to controls and to same extent as typical Alzheimer's disease patients, in conjunction with an increase in external details tangential to the memory described. The memory narratives of posterior cortical atrophy patients showed a specific reduction in spatiotemporal and perceptual detail. Voxel-based morphometry analysis revealed atrophy of the parieto-occipital cortices in posterior cortical atrophy but relatively spared hippocampi bilaterally, compared with characteristic atrophy of the medial temporal lobes in typical Alzheimer's disease. Analysis of brain regions showing posterior cortical atrophy-specific atrophy revealed a correlation between perceptual details in autobiographical memory and grey matter density in the right precuneus. This study demonstrates remote memory impairment in posterior cortical atrophy despite relatively preserved medial temporal lobe structures. The results demonstrate, for the first time, profound autobiographical memory impairment in PCA and suggest that this is driven by the well-recognised deficits in higher-order visual processing. The findings are discussed in the context of posterior parietal contributions to imagery and memory, and the clinical implications of autobiographical memory impairment for diagnostic and management protocols in posterior cortical atrophy.

•

Autobiographical memory in PCA shows a striking loss of internal, episodic detail.

•

Narratives showed a specific reduction in spatiotemporal and perceptual detail.

•

Loss of perceptual details correlated with grey matter density in the right precuneus.

•

Impaired autobiographical memory is driven by deficient higher-order visual processing.

Two years later - Revisiting autobiographical memory representations in vmPFC and hippocampus

A long-standing question in memory neuroscience concerns how and where autobiographical memories of personal experiences are represented in the brain. In a previous high resolution multivoxel pattern analysis fMRI study, we examined two week old (recent) and ten year old (remote) autobiographical memories (Bonnici et al., 2012, J. Neurosci. 32:16982-16991). We found that remote memories were particularly well represented in ventromedial prefrontal cortex (vmPFC) compared to recent memories. Moreover, while both types of memory were represented within anterior and posterior hippocampus, remote memories were more easily distinguished in the posterior portion. These findings suggested that a change of some kind had occurred between two weeks and ten years in terms of where autobiographical memories were represented in the brain. In order to examine this further, here participants from the original study returned two years later and recalled the memories again. We found that there was no difference in the detectability of memory representations within vmPFC for the now 2 year old and 12 year old memories, and this was also the case for the posterior hippocampus. Direct comparison of the two week old memories (original study) with themselves two years later (present study) confirmed that their representation within vmPFC had become more evident. Overall, this within-subjects longitudinal fMRI study extends our understanding of autobiographical memory representations by allowing us to narrow the window within which their consolidation is likely to occur. We conclude that after a memory is initially encoded, its representation within vmPFC has stablised by, at most, two years later.

Mindfulness-related differences in neural response to own infant negative versus positive emotion contexts

Mindfulness is thought to promote well-being by shaping the way people respond to challenging social-emotional situations. Current understanding of how this occurs at the neural level is based on studies of response to decontextualized emotion stimuli that may not adequately represent lived experiences. In this study, we tested relations between mothers' dispositional mindfulness and neural responses to their own infant in different emotion-eliciting contexts. Mothers (n = 25) engaged with their 3-month-old infants in videorecorded tasks designed to elicit negative (arm restraint) or positive (peekaboo) emotion. During a functional MRI session, mothers were presented with 15-s clips from these recordings, and dispositional mindfulness scores were used to predict their neural responses to arm restraint > peekaboo videos. Mothers higher in nonreactivity showed relatively lower activation to their infants’ arm restraint compared to peekaboo videos in hypothesized regions—insula and dorsal prefrontal cortex—as well as non-hypothesized regions. Other mindfulness dimensions were associated with more limited areas of lower (nonjudgment) and higher (describing) activation in this contrast. Mothers who were higher in mindfulness generally activated more to the positive emotion context and less to the negative emotion context in perceptual and emotion processing areas, a pattern that may help to explain mindfulness-related differences in well-being.

Memory: Looking back and looking forward

This review brings together past and present achievements in memory research, ranging from molecular to psychological discoveries. Despite some false starts, major advances include our growing understanding of learning-related neural plasticity and the characterisation of different classes of memory. One striking example is the ability to reactivate targeted neuronal ensembles so that an animal will seemingly re-experience a particular memory, with the further potential to modify such memories. Meanwhile, human functional imaging studies can distinguish individual episodic memories based on voxel activation patterns. While the hippocampus continues to provide a rich source of information, future progress requires broadening our research to involve other sites. Related challenges include the need to understand better the role of glial-neuron interactions and to look beyond the synapse as the sole site of experience-dependent plasticity. Unmet goals include translating our neuroscientific knowledge in order to optimise learning and memory, especially among disadvantaged populations.

Rethinking the Role of the Angular Gyrus in Remembering the Past and Imagining the Future: The Contextual Integration Model

Despite consistent activation on tasks of episodic memory, the precise contribution of the left angular gyrus (AG) to mnemonic functions remains vigorously debated. Mounting evidence suggests that AG activity scales with subjective ratings of vividness and confidence in recollection, with further evidence pointing to its involvement during construction of detailed and coherent future simulations. Lesion studies, however, indicate that damage to the AG does not render patients amnesic on standard source and associative memory paradigms. To reconcile these findings, we present the Contextual Integration Model as a unifying framework that couches the mnemonic role of the AG in terms of multimodal integration and representation of contextual information across temporal contexts. Irrespective of whether one is remembering the past or constructing future or hypothetical scenarios, the Contextual Integration Model holds that the core elements of an event (i.e., the who, what, when, where) are bound within the medial temporal lobes while the multimodal details, which give rise to perceptually rich recollection, are integrated and represented in the AG. Building on previous work, the Contextual Integration Model therefore provides a comprehensive exposition of the mnemonic and constructive functions of the AG across temporal contexts, offering a novel test-bed for future work.

Discovering Event Structure in Continuous Narrative Perception and Memory

During realistic, continuous perception, humans automatically segment experiences into discrete events. Using a novel model of cortical event dynamics, we investigate how cortical structures generate event representations during narrative perception and how these events are stored to and retrieved from memory. Our data-driven approach allows us to detect event boundaries as shifts between stable patterns of brain activity without relying on stimulus annotations and reveals a nested hierarchy from short events in sensory regions to long events in high-order areas (including angular gyrus and posterior medial cortex), which represent abstract, multimodal situation models. High-order event boundaries are coupled to increases in hippocampal activity, which predict pattern reinstatement during later free recall. These areas also show evidence of anticipatory reinstatement as subjects listen to a familiar narrative. Based on these results, we propose that brain activity is naturally structured into nested events, which form the basis of long-term memory representations.

Ventral lateral parietal cortex and episodic memory retrieval

With the advent of functional neuroimaging it quickly became apparent that successful episodic memory retrieval was consistently associated with enhanced activity in ventral lateral parietal cortex (VLPC), especially the left angular gyrus. Here, we selectively review recent neuropsychological and functional neuroimaging evidence relevant to the question of the functional significance of this activity. We argue that the balance of the evidence suggests that the angular gyrus supports the representation of retrieved episodic information, and that this likely reflects a more general role for the region in representing multi-modal and multi-domain information.

Are There Multiple Kinds of Episodic Memory? An fMRI Investigation Comparing Autobiographical and Recognition Memory Tasks

What brain regions underlie retrieval from episodic memory? The bulk of research addressing this question with fMRI has relied upon recognition memory for materials encoded within the laboratory. Another, less dominant tradition has used autobiographical methods, whereby people recall events from their lifetime, often after being cued with words or pictures. The current study addresses how the neural substrates of successful memory retrieval differed as a function of the targeted memory when the experimental parameters were held constant in the two conditions (except for instructions). Human participants studied a set of scenes and then took two types of memory test while undergoing fMRI scanning. In one condition (the picture memory test), participants reported for each scene (32 studied, 64 nonstudied) whether it was recollected from the prior study episode. In a second condition (the life memory test), participants reported for each scene (32 studied, 64 nonstudied) whether it reminded them of a specific event from their preexperimental lifetime. An examination of successful retrieval (yes responses) for recently studied scenes for the two test types revealed pronounced differences; that is, autobiographical retrieval instantiated with the life memory test preferentially activated the default mode network, whereas hits in the picture memory test preferentially engaged the parietal memory network as well as portions of the frontoparietal control network. When experimental cueing parameters are held constant, the neural underpinnings of successful memory retrieval differ when remembering life events and recently learned events.SIGNIFICANCE STATEMENT Episodic memory is often discussed as a solitary construct. However, experimental traditions examining episodic memory use very different approaches, and these are rarely compared to one another. When the neural correlates associated with each approach have been directly contrasted, results have varied considerably and at times contradicted each other. The present experiment was designed to match the two primary approaches to studying episodic memory in an unparalleled manner. Results suggest a clear separation of systems supporting memory as it is typically tested in the laboratory and memory as assessed under autobiographical retrieval conditions. These data provide neurobiological evidence that episodic memory is not a single construct, challenging the degree to which different experimental traditions are studying the same construct.

The role of personal goals in autonoetic experience when imagining future events

Although autonoetic experience-a sense of mental time travel-has been considered as the hallmark of episodic future thinking, what determines this subjective feeling is not yet fully understood. Here, we investigated the role of autobiographical knowledge by manipulating the relevance of imagined events for personal goals. Participants were asked to imagine three types of events (goal-related future events, experimenter-provided future events, and atemporal events) and to assess various characteristics of their mental representations. The results showed that the three types of events were represented with similar levels of detail and vividness. Importantly, however, goal-related future events were associated with a stronger autonoetic experience. Furthermore, autonoetic experience was significantly predicted by the importance of imagined events for personal goals. These findings suggest that the subjective feeling of pre-experiencing one's personal future in part depends on the extent to which imagined events can be placed in an autobiographical context.

The Functional and Structural Neuroanatomy of Systems Consolidation for Autobiographical and Semantic Memory

It is well established that patients with memory impairment have more difficulty retrieving memories from the recent past relative to the remote past and that damage to the medial temporal lobe (MTL) plays a key role in this pattern of impairment. The precise role of the MTL and how it may interact with other brain regions remains an area of active research. We investigated the role of structures in a memory network that supports remembering. Our chapter focuses on two types of memory: episodic memory and semantic memory. Findings from studies of patients with brain damage and neuroimaging studies in patients and healthy individuals were considered together to identify the functional and structural neuroanatomy of past remembrance.