Neurocognitive mechanisms of real‐world autobiographical memory retrieval: insights from studies using wearable camera technology

First-person and third-person lifelogging improves episodic memory

Lifelogging, the practice of recording daily activities through photographs or videos, enhances memory in healthy individuals and those with memory disorders by aiding both memory consolidation and retrieval processes. This study, involving 32 adults in controlled settings, investigated its effectiveness on episodic memory from first and third-person perspectives. Contrary to expectations, perspective did not influence memory performance. Results indicated that lifelogging significantly improves subjective memory and the recall of visual, but not non-visual, information compared to non-lifelogging conditions. These findings suggest that lifelogging, regardless of perspective, holds promise for supporting episodic memory, especially for visual content, advocating for its wider application.

Towards an ecologically valid naturalistic cognitive neuroscience of memory and event cognition

The landscape of human memory and event cognition research has witnessed a transformative journey toward the use of naturalistic contexts and tasks. In this review, we track this progression from abrupt, artificial stimuli used in extensively controlled laboratory experiments to more naturalistic tasks and stimuli that present a more faithful representation of the real world. We argue that in order to improve ecological validity, naturalistic study designs must consider the complexity of the cognitive phenomenon being studied. Then, we review the current state of "naturalistic" event segmentation studies and critically assess frequently employed movie stimuli. We evaluate recently developed tools like lifelogging and other extended reality technologies to help address the challenges we identified with existing naturalistic approaches. We conclude by offering some guidelines that can be used to design ecologically valid cognitive neuroscience studies of memory and event cognition.

The influence of event similarity on the detailed recall of autobiographical memories

Memories for life events are thought to be organised based on their relationships with one another, affecting the order in which events are recalled such that similar events tend to be recalled together. However, less is known about how detailed recall for a given event is affected by its associations to other events. Here, we used a cued autobiographical memory recall task where participants verbally recalled events corresponding to personal photographs. Importantly, we characterised the temporal, spatial, and semantic associations between each event to assess how similarity between adjacently cued events affected detailed recall. We found that participants provided more non-episodic details for cued events when the preceding event was both semantically similar and either temporally or spatially dissimilar. However, similarity along time, space, or semantics between adjacent events did not affect the episodic details recalled. We interpret this by considering organisation at the level of a life narrative, rather than individual events. When recalling a stream of personal events, we may feel obligated to justify seeming discrepancies between adjacent events that are semantically similar, yet simultaneously temporally or spatially dissimilar - to do so, we provide additional supplementary detail to help maintain global coherence across the events in our lives.

Accuracy and completeness of autobiographical memory: evidence from a wearable camera study

A small wearable camera, SenseCam, passively captured pictures from everyday experience that were later used to evaluate the accuracy and completeness of autobiographical memory. Nine undergraduates wore SenseCams that took pictures every 10 s for two days. After one week and one month, participants first recalled their experiences from specific time periods (timeslices), then reviewed the corresponding pictures to make corrections and report information omitted from initial recall. Results demonstrated the utility of wearable cameras as research tools, and illustrated several characteristics of everyday memory. Recall contents reflected the structure of undergraduate lives. Three different types of omissions were reported: neglected, reminded, and forgotten. Pictures stimulated memory, even for non-visual information (e.g., feelings, thoughts), increasing recall by 23%. The mean completeness of initial recall was 79% (upper bound), with at least 21% forgetting. Accuracy was self-scored by participants (M = 89%), and the mean error rate (11%) provided evidence against strong reconstructive and copy theories of memory. The characteristics of errors shed light on the cognitive processes underlying them. Ratings of recall (confidence, reliving, knowledge, and frequency) supported the episodic/semantic distinction, the dual-process theory of repetition, and reconstructive imagery. Metamemory measures showed a positive correlation between confidence and accuracy.

Episodic-semantic linkage for $1000: New semantic knowledge is more strongly coupled with episodic memory in trivia experts

Some people exhibit impressive memory for a wide array of semantic knowledge. What makes these trivia experts better able to learn and retain novel facts? We hypothesized that new semantic knowledge may be more strongly linked to its episodic context in trivia experts. We designed a novel online task in which 132 participants varying in trivia expertise encoded "exhibits" of naturalistic facts with related photos in one of two "museums." Afterward, participants were tested on cued recall of facts and recognition of the associated photo and museum. Greater trivia expertise predicted higher cued recall for novel facts. Critically, trivia experts but not non-experts showed superior fact recall when they remembered both features (photo and museum) of the encoding context. These findings illustrate enhanced links between episodic memory and new semantic learning in trivia experts, and show the value of studying trivia experts as a special population that can shed light on the mechanisms of memory.

The formation of episodic autobiographical memory is predicted by mental imagery, self-reference, and anticipated details

Introduction

Despite the ecological nature of episodic memory (EM) and the importance of consolidation in its functioning, studies tackling both subjects are still scarce. Therefore, the present study aims at establishing predictions of the future of newly encoded information in EM in an ecological paradigm.

Methods

Participants recorded two personal events per day with a SenseCam portable camera, for 10 days, and characterized the events with different subjective scales (emotional valence and intensity, self-concept and self-relevance, perspective and anticipated details at a month, mental images…). They then performed a surprise free recall at 5 days and 1 month after encoding. Machine learning algorithms were used to predict the future of events (episodic or forgotten) in memory at 1 month.

Results

The best algorithm showed an accuracy of 78%, suggesting that such a prediction is reliably possible. Variables that best differentiated between episodic and forgotten memories at 1 month were mental imagery, self-reference, and prospection (anticipated details) at encoding and the first free recall.

Discussion

These results may establish the basis for the development of episodic autobiographical memory during daily experiences.

Examining dependencies among different time scales in episodic memory - an experience sampling study

We re-examined whether different time scales such as week, day of week, and hour of day are independently used during memory retrieval as has been previously argued (i.e., independence of scales). To overcome the limitations of previous studies, we used experience sampling technology to obtain test stimuli that have higher ecological validity. We also used pointwise mutual information to directly calculate the degree of dependency between time scales in a formal way. Participants were provided with a smartphone and were asked to wear it around their neck for two weeks, which was equipped with an app that automatically collected time, images, GPS, audio and accelerometry. After a one-week retention interval, participants were presented with an image that was captured during their data collection phase, and were tested on their memory of when the event happened (i.e., week, day of week, and hour). We find that, in contrast to previous arguments, memories of different time scales were not retrieved independently. Moreover, through rendering recurrence plots of the images that the participants collected, we provide evidence the dependency may have originated from the repetitive events that the participants encountered in their daily life.

Mobile cognition: imaging the human brain in the 'real world'

Cognitive neuroscience studies in humans have enabled decades of impactful discoveries but have primarily been limited to recording the brain activity of immobile participants in a laboratory setting. In recent years, advances in neuroimaging technologies have enabled recordings of human brain activity to be obtained during freely moving behaviours in the real world. Here, we propose that these mobile neuroimaging methods can provide unique insights into the neural mechanisms of human cognition and contribute to the development of novel treatments for neurological and psychiatric disorders. We further discuss the challenges associated with studying naturalistic human behaviours in complex real-world settings as well as strategies for overcoming them. We conclude that mobile neuroimaging methods have the potential to bring about a new era of cognitive neuroscience in which neural mechanisms can be studied with increased ecological validity and with the ability to address questions about natural behaviour and cognitive processes in humans engaged in dynamic real-world experiences.

Automated wearable cameras for improving recall of diet and time use in Uganda: a cross-sectional feasibility study

BACKGROUND

Traditional recall approaches of data collection for assessing dietary intake and time use are prone to recall bias. Studies in high- and middle-income countries show that automated wearable cameras are a promising method for collecting objective health behavior data and may improve study participants' recall of foods consumed and daily activities performed. This study aimed to evaluate the feasibility of using automated wearable cameras in rural Eastern Ugandan to collect dietary and time use data.

METHODS

Mothers of young children (n = 211) wore an automated wearable camera on 2 non-consecutive days while continuing their usual activities. The day after wearing the camera, participants' dietary diversity and time use was assessed using an image-assisted recall. Their experiences of the method were assessed via a questionnaire.

RESULTS

Most study participants reported their experiences with the automated wearable camera and image-assisted recall to be good (36%) or very good (56%) and would participate in a similar study in the future (97%). None of the eight study withdrawals could be definitively attributed to the camera. Fifteen percent of data was lost due to device malfunction, and twelve percent of the images were "uncodable" due to insufficient lighting. Processing and analyzing the images were labor-intensive, time-consuming, and prone to human error. Half (53%) of participants had difficulty interpreting the images captured by the camera.

CONCLUSIONS

Using an automated wearable camera in rural Eastern Uganda was feasible, although improvements are needed to overcome the challenges common to rural, low-income country contexts and reduce the burdens posed on both participants and researchers. To improve the quality of data obtained, future automated wearable camera-based image assisted recall studies should use a structured data format to reduce image coding time; electronically code the data in the field, as an output of the image review process, to eliminate ex post facto data entry; and, ideally, use computer-assisted personal interviews software to ensure completion and reduce errors. In-depth formative work in partnership with key local stakeholders (e.g., researchers from low-income countries, representatives from government and/or other institutional review boards, and community representatives and local leaders) is also needed to identify practical approaches to ensuring that the ethical rights of automated wearable camera study participants in low-income countries are adequately protected.

Representational dynamics of memories for real-life events

The continuous flow of experience that characterizes real-life events is not recorded as such in episodic memory but is condensed as a succession of event segments separated by temporal discontinuities. To unravel the neural basis of this representational structure, we recorded real-life events using wearable camera technology and used fMRI to investigate brain activity during their temporal unfolding in memory. We found that, compared to the representation of static scenes in memory, dynamically unfolding memory representations were associated with greater activation of the posterior medial episodic network. Strikingly, by analyzing the autocorrelation of brain activity patterns at successive time points throughout the retrieval period, we found that this network showed higher temporal dynamics when recalling events that included a higher density of event segments. These results reveal the key role of the posterior medial network in representing the dynamic unfolding of the event segments that constitute real-world memories.

Validation of an Automated Wearable Camera-Based Image-Assisted Recall Method and the 24-h Recall Method for Assessing Women's Time Allocation in a Nutritionally Vulnerable Population: The Case of Rural Uganda

Accurate data are essential for investigating relationships between maternal time-use patterns and nutritional outcomes. The 24 h recall (24HR) has traditionally been used to collect time-use data, however, automated wearable cameras (AWCs) with an image-assisted recall (IAR) may reduce recall bias. This study aimed to evaluate their concurrent criterion validity for assessing women’s time use in rural Eastern Ugandan. Women’s (n = 211) time allocations estimated via the AWC-IAR and 24HR methods were compared with direct observation (criterion method) using the Bland–Altman limits of agreement (LOA) method of analysis and Cronbach’s coefficient alpha (time allocation) or Cohen’s κ (concurrent activities). Systematic bias varied from 1 min (domestic chores) to 226 min (caregiving) for 24HR and 1 min (own production) to 109 min (socializing) for AWC-IAR. The LOAs were within 2 h for employment, own production, and self-care for 24HR and AWC-IAR but exceeded 11 h (24HR) and 9 h (AWC-IAR) for caregiving and socializing. The LOAs were within four concurrent activities for 24HR (−1.1 to 3.7) and AWC-IAR (−3.2 to 3.2). Cronbach’s alpha for time allocation ranged from 0.1728 (socializing) to 0.8056 (own production) for 24HR and 0.2270 (socializing) to 0.7938 (own production) for AWC-IAR. For assessing women’s time allocations at the population level, the 24HR and AWC-IAR methods are accurate and reliable for employment, own production, and domestic chores but poor for caregiving and socializing. The results of this study suggest the need to revisit previously published research investigating the associations between women’s time allocations and nutrition outcomes.

Using Wearable Cameras to Investigate Health-Related Daily Life Experiences: A Literature Review of Precautions and Risks in Empirical Studies

Automated, wearable cameras can benefit health-related research by capturing accurate and objective information about individuals' daily experiences. However, wearable cameras present unique privacy- and confidentiality-related risks due to the possibility of the images capturing identifying or sensitive information from participants and third parties. Although best practice guidelines for ethical research with wearable cameras have been published, limited information exists on the risks of studies using wearable cameras. The aim of this literature review was to survey risks related to using wearable cameras, and precautions taken to reduce those risks, as reported in empirical research. Forty-five publications, comprising 36 independent studies, were reviewed, and findings revealed that participants' primary concerns with using wearable cameras included physical inconvenience and discomfort in certain situations (e.g., public settings). None of the studies reviewed reported any serious adverse events. Although it is possible that reported findings do not include all risks experienced by participants in research with wearable cameras, our findings suggest a low level of risk to participants. However, it is important that investigators adopt recommended precautions, which can promote autonomy and reduce risks, including participant discomfort.

Externalizing autobiographical memories in the digital age

People externalize their autobiographical memories by creating representations that exist outside of their minds. Externalizations often serve personal and social functions, consistent with theorized functions of autobiographical memory. With new digital technologies, people are documenting more memories than ever and are sharing them with larger audiences. However, these technologies do not change the core cognitive processes involved in autobiographical memory, but instead present novel situations that affect how these processes are deployed. Smartphones allow events to be recorded as they unfold, thus directing attention and sometimes impairing memory. Social media increase the frequency of reviewing and sharing records which reactivate memories, potentially strengthening or updating them. Overall, externalization in the digital age changes what people attend to and remember about their own experiences.

Memory for spatio-temporal contextual details during the retrieval of naturalistic episodes

Episodic memory entails the storage of events together with their spatio-temporal context and retrieval comprises the subjective experience of a link between the person who remembers and the episode itself. We used an encoding procedure with mobile-phones to generate experimentally-controlled episodes in the real world: object-images were sent to the participants' phone, with encoding durations up to 3 weeks. In other groups of participants, the same objects were encoded during the exploration of a virtual town (45 min) or using a standard laboratory paradigm, with pairs of object/place-images presented in a sequence of unrelated trials (15 min). At retrieval, we tested subjective memory for the objects (remember/familiar) and memory for the context (place and time). We found that accurate and confident context-memory increased the likelihood of "remember" responses, in all encoding contexts. We also tested the participants' ability to judge the temporal-order of the encoded episodes. Using a model of temporal similarity, we demonstrate scale-invariant properties of order-retrieval, but also highlight the contribution of non-chronological factors. We conclude that the mechanisms governing episodic memory retrieval can operate across a wide range of spatio-temporal contexts and that the multi-dimensional nature of the episodic traces contributes to the subjective experience of retrieval.

The Fallacy of an Airtight Alibi: Understanding Human Memory for "Where" Using Experience Sampling

A primary challenge for alibi-generation research is establishing the ground truth of real-world events of interest. In the current study, we used a smartphone app to record data on adult participants (N = 51) for a month prior to a memory test. The app captured accelerometry data, GPS locations, and audio environments every 10 min. After a week-long retention interval, we asked participants to identify where they were at a given time from among four alternatives. Participants were incorrect 36% of the time. Furthermore, our forced-choice procedure allowed us to conduct a conditional logit analysis to assess the different aspects of the events that the participants experienced and their relative importance to the decision process. We found strong evidence that participants confuse days across weeks. In addition, people often confused weeks in general and also hours across days. Similarity of location induced more errors than similarity of audio environments or movement types.

Behavioural and neurophysiological signatures in the retrieval of individual memories of recent and remote real-life routine episodic events

Autobiographical memory (AM) has been largely investigated as the ability to recollect specific events that belong to an individual's past. However, how we retrieve real-life routine episodes and how the retrieval of these episodes changes with the passage of time remain unclear. Here, we asked participants to use a wearable camera that automatically captured pictures to record instances during a week of their routine life and implemented a deep neural network-based algorithm to identify picture sequences that represented episodic events. We then asked each participant to return to the lab to retrieve AMs for single episodes cued by the selected pictures 1 week, 2 weeks and 6-14 months after encoding while scalp electroencephalographic (EEG) activity was recorded. We found that participants were more accurate in recognizing pictured scenes depicting their own past than pictured scenes encoded in the lab, and that memory recollection of personally experienced events rapidly decreased with the passing of time. We also found that the retrieval of real-life picture cues elicited a strong and positive 'ERP old/new effect' over frontal regions and that the magnitude of this ERP effect was similar throughout memory tests over time. However, we observed that recognition memory induced a frontal theta power decrease and that this effect was mostly seen when memories were tested after 1 and 2 weeks but not after 6-14 months from encoding. Altogether, we discuss the implications for neuroscientific accounts of episodic retrieval and the potential benefits of developing individual-based AM exploration strategies at the clinical level.

Using a wearable camera to support everyday memory following brain injury: a single-case study

Background:

Wearable cameras have been shown to improve memory in people with hippocampal amnesia and Alzheimer's disease. It is not known whether this benefit extends to people with amnesia of complex or uncertain origin.

Method:

This case study examined the effect of wearable camera use on memory and occupational performance in a patient with memory loss and complex mental health problems following a severe neurological incident. With the help of his occupational therapist (OT), Mr A used a wearable camera to record a series of eight personally significant events over a 6-week period. During visits from his OT, Mr A was asked to report what he could remember about the events, both before (baseline) and during the review of time-lapsed photographs captured automatically by the camera.

Results:

The results showed striking improvements in recall while reviewing the photographs, relative to baseline recall, but the additional details recalled during review did not appear to be maintained at later tests, after several days. Across the study period, there were moderate increases in occupational performance, measured using the Canadian Occupational Performance Measure. However, after the study period ended, Mr A ceased to use the wearable camera due to technological difficulty.

Conclusion:

There was a clear benefit of wearable camera use, but the real-world impact of the technology was limited by the complexity of the system. The results of the study are discussed alongside novel clinical insights and suggestions for developing wearable camera support systems that can be used independently by people with memory problems.

A behavioural and ERP investigation of the wearable camera photo review in autobiographical memory

Wearable camera photo review has successfully been used to enhance memory, yet very little is known about the underlying mechanisms. Here, the sequential presentation of wearable camera photos - a key feature of wearable camera photo review - is examined using behavioural and EEG measures. Twelve female participants were taken on a walking tour, stopping at a series of predefined targets, while wearing a camera that captured photographs automatically. A sequence of four photos leading to these targets was selected (∼ 200 trials) and together with control photos, these were used in a recognition task one week later. Participants' recognition performance improved with the sequence of photos (measured in hit rates, correct rejections, & sensitivity), revealing for the first time, a positive effect of sequence of photos in wearable camera photo review. This has important implications for understanding the sequential and cumulative effects of cues on episodic remembering. An old-new ERP effect was also observed over visual regions for hits vs. correct rejections, highlighting the importance of visual processing not only for perception but also for the location of activated memory representations.

Long-term memory of real-world episodes is independent of recency effects: magic tricks as ecological tasks

How episodic memories decay is an unresolved question in cognitive neuroscience. The role of short-term mechanisms regarding the decay of episodic memories is circumscribed to set the maximum recall from which a monotonic decay occurs. However, this sequential view from the short to the long-term is not compulsory, as short-term dependent memory gains (like recency effects when memorizing a list of elements; serial-position effects) may not be translated into long-term memory differences. Moreover, producing memorable events in the laboratory faces important challenges, such as recreating realistic conditions with elevated recall, or avoiding spontaneous retrievals during memory retention (sociocultural hooks). The current study proposes the use of magic to enhance the study of memory. We designed a sequence of magic tricks performed live on stage to evaluate the interaction between memory decay and serial-position effects of those tricks. The audience was asked to freely recall the tricks at four different timepoints: just after the show, 10 days, 1.5 months and 4.5 months. We discovered serial-position differences after the show that were no longer present later on, suggesting that short-term memory gains do not translate into the long-term. Illustrating the power of naturalistic stimuli to study long-term memory while interrogating the interaction between short-term and long-term mechanisms, this work is, to our knowledge, the first scientific study of the memorability of magic tricks.

Reminders activate the prefrontal-medial temporal cortex and attenuate forgetting of event memory

Replicas of an aspect of an experienced event can serve as effective reminders, yet little is known about the neural basis of such reminding effects. Here we examined the neural activity underlying the memory-enhancing effect of reminders 1 week after encoding of naturalistic film clip events. We used fMRI to determine differences in network activity associated with recently reactivated memories relative to comparably aged, non-reactivated memories. Reminders were effective in facilitating overall retrieval of memory for film clips, in an all-or-none fashion. Prefrontal cortex and hippocampus were activated during both reminders and retrieval. Peak activation in ventro-lateral prefrontal cortex (vPFC) preceded peak activation in the right hippocampus during the reminders. For film clips that were successfully retrieved after 7 days, pre-retrieval reminders did not enhance the quality of the retrieved memory or the number of details retrieved, nor did they more strongly engage regions of the recollection network than did successful retrieval of a non-reminded film clip. These results suggest that reminders prior to retrieval are an effective means of boosting retrieval of otherwise inaccessible episodic events, and that the inability to recall certain events after a delay of a week largely reflects a retrieval deficit, rather than a storage deficit for this information. The results extend other evidence that vPFC drives activation of the hippocampus to facilitate memory retrieval and scene construction, and show that this facilitation also occurs when reminder cues precede successful retrieval attempts. The time course of vPFC-hippocampal activity during the reminder suggests that reminders may first engage schematic information meditated by vPFC followed by a recollection process mediated by the hippocampus.

Mnemoscape: Supporting Older Adults' Event Memory Using Wearable Camera Photographs on an Immersive Interface

BACKGROUND

Wearable camera photographs have been shown to be an effective memory aid in people with and without memory impairment. Most studies using wearable cameras as a memory aid have presented photographs on a computer monitor and used a written diary or no review as a comparison. In this pioneering study, we took a new and innovative approach to wearable camera photograph review that embeds the photographs within a virtual landscape. This approach may enhance these benefits by reinstating the original environmental context to increase participants' sense of re-experiencing the event.

OBJECTIVE

We compare the traditional computer monitor presentation of wearable camera photographs and actively taken digital photographs with the presentation of wearable camera photographs in a new immersive interface that reinstates the spatiotemporal context.

METHODS

Healthy older adults wore wearable or took digital photographs during a staged event. The next day and 2 weeks later, they viewed wearable camera photographs on a computer monitor or in context on an immersive interface, or digital photographs.

RESULTS

Participants who viewed wearable camera photographs in either format recalled more details during photo viewing and subsequent free recall than participants who viewed digital photographs they had taken themselves.

CONCLUSION

Wearable camera photographs are an effective support for event memory, regardless of whether they are presented in context in an experience-near format.

The Effects of Exposure to Recent Autobiographical Events on Declarative Memory in Amnestic Mild Cognitive Impairment: A Preliminary Pilot Study

BACKGROUND

Individuals with amnestic Mild Cognitive Impairment (aMCI) are at heightened risk of developing Alzheimer's dementia. In recent years, much attention has been given to the search for new interventions to slow down the progression of cognitive decline of these patients. Wearable digital camera devices are one form of new technology that captures images of one's life events, so they constitute a promising method to be used as a means to stimulate recent autobiographical memory.

OBJECTIVE

This preliminary study investigates the ability of a new cognitive intervention based on exposure to recent autobiographical memory captured by wearable cameras to improve episodic memory in patients with aMCI.

METHODS

Seventeen subjects wore a wearable camera while they went about their daily activities. The images captured were converted into eight different 3-minute films containing the most relevant information of each event. The intervention involved eight individualized weekly sessions during which patients were exposed to a different autobiographical event each week. Besides, several specific questions were formulated within each session. Clinical questionnaires assessing cognitive reserve, premorbid intelligence, depression, and anxiety were administered at baseline. Measures of objective episodic memory were applied at baseline and at post-treatment.

RESULTS

Significant improvements were observed at post-treatment in memory measures, and significant associations were found between memory change scores and age and cognitive reserve. Anyway, these associations did not reach statistical significance after adjusting for multiple comparisons.

CONCLUSION

The present study provides preliminary evidence that aMCI patients may benefit from a cognitive intervention program based on re-experiencing recent autobiographical events. However, future studies incorporating a control group will be needed to confirm these preliminary findings.

Context-Dependent Coding of Temporal Distance Between Cinematic Events in the Human Precuneus

How temporal and contextual information interactively impact on behavior and brain activity during the retrieval of temporal order about naturalistic episodes remains incompletely understood. Here, we used fMRI to examine the effects of contextual signals derived from the content of the movie on the neural correlates underlying memory retrieval of temporal-order in human subjects of both sexes. By contrasting SAME versus DIFF storyline conditions during the retrieval of the temporal order of cinematic events, we found that the activation in the precuneus, as well as behavior, are significantly modulated according to storyline condition, supporting our prediction of contextual information contributing to temporal retrieval. We suggest that the precuneus engages in memory retrieval via reconstructive mechanisms, entailing search within a movie-specific, situational knowledge-structure. Furthermore, information-based analyses of multivoxel activity revealed that the precuneus also contains a context-independent linear representation of temporal distances, consistent with a chronological organization of memory traces. We thus put forward that the retrieval of the temporal-order of naturalistic events encoded in rich and dynamic contexts relies on the joint contribution of chronological and reconstructive mechanisms, both of which rely on the medioposterior parietal cortex in humans.SIGNIFICANCE STATEMENT Successful retrieval of episodic memory is dependent on both temporal and contextual signals. However, when contextual signals derived from multiple storylines or narratives are complex and intertwined, the behavioral and neural correlates underpinning the interplay between time and context is not completely understood. Here we characterized the activation level and multivoxel pattern of BOLD signals underlying the modulation of such contextual information during temporal order judgment in the precuneus. Our findings provide us with an elucidation of subprocesses implicating the medial parietal cortex in realizing temporal organization of episodic details.

Neural correlates of retrieval-based enhancement of autobiographical memory in older adults

Lifelog photo review is considered to enhance the recall of personal events. While a sizable body of research has explored the neural basis of autobiographical memory (AM), there is limited neural evidence on the retrieval-based enhancement effect on event memory among older adults in the real-world environment. This study examined the neural processes of AM as was modulated by retrieval practice through lifelog photo review in older adults. In the experiment, blood-oxygen-level dependent response during subjects’ recall of recent events was recorded, where events were cued by photos that may or may not have been exposed to a priori retrieval practice (training). Subjects remembered more episodic details under the trained relative to non-trained condition. Importantly, the neural correlates of AM was exhibited by (1) dissociable cortical areas related to recollection and familiarity, and (2) a positive correlation between the amount of recollected episodic details and cortical activation within several lateral temporal and parietal regions. Further analysis of the brain activation pattern at a few regions of interest within the core remember network showed a training_condition × event_detail interaction effect, suggesting that the boosting effect of retrieval practice depended on the level of recollected event details.

Differential Contributions of Default and Dorsal Attention Networks to Remembering Thoughts and External Stimuli From Real-Life Events

Episodic memories are typically composed of perceptual information derived from the external environment and representations of internal states (e.g., one's thoughts during prior episodes). To date, however, research has mostly focused on the remembrance of external stimuli, such that little is known about how internal mentation is represented within episodic memory. In the present fMRI study, we examined the neural correlates of these 2 components of episodic memories using a novel method of cuing memories from photographs taken during real-life events. We found that, compared with corresponding semantic memory tasks, memories for internal thoughts and external elements were associated with activity in brain areas supporting episodic recollection. Most importantly, however, the 2 kinds of memories also showed differential activation in large-scale brain networks: the remembrance of external elements was associated with greater activity in the dorsal attention network, whereas memories of internal thoughts mainly recruited default network areas. These findings shed new light on the representation of internal and external aspects of prior experience within episodic memory. The default network may contribute to the reinstatement of thoughts experienced during past events, whereas the dorsal attention network may support the allocation of attention to visuospatial features within episodic memory representations.

The dynamics of memory retrieval for internal mentation

Daily life situations often require people to remember internal mentation, such as their future plans or interpretations of events. Little is known, however, about the principles that govern memory for thoughts experienced during real-world events. In particular, it remains unknown whether factors that structure the retrieval of external stimuli also apply to thought recall, and whether some thought features affect their accessibility in memory. To examine these questions, we asked participants to undertake a walk on a university campus while wearing a lifelogging camera. They then received unexpected recall tasks about the thoughts they experienced during the walk, rated the phenomenological features of retrieved thoughts, and indicated the moment when they were experienced. Results showed that thought retrieval demonstrates primacy, recency, and temporal contiguity effects, and is also influenced by event boundaries. In addition, thoughts that involved planning and that were recurrent during the walk were more accessible in memory. Together, these results shed new light on the principles that govern memory for internal mentation and suggest that at least partially similar processes structure the retrieval of thoughts and stimuli from the external environment.

Minimal memory for details in real life events

The extent to which the details of past experiences are retained or forgotten remains controversial. Some studies suggest massive storage while others describe memories as fallible summary recreations of original events. The discrepancy can be ascribed to the content of memories and how memories are evaluated. Many studies have focused on recalling lists of words/pictures, which lack the critical ingredients of real world memories. Here we quantified the ability to remember details about one hour of real life. We recorded video and eye movements while subjects walked along specified routes and evaluated whether they could distinguish video clips from their own experience from foils. Subjects were minimally above chance in remembering the minutiae of their experiences. Recognition of specific events could be partly explained by a machine-learning model of video contents. These results quantify recognition memory for events in real life and show that the details of everyday experience are largely not retained in memory.

Enhancing the Ecological Validity of fMRI Memory Research Using Virtual Reality

Functional magnetic resonance imaging (fMRI) is a powerful research tool to understand the neural underpinnings of human memory. However, as memory is known to be context-dependent, differences in contexts between naturalistic settings and the MRI scanner environment may potentially confound neuroimaging findings. Virtual reality (VR) provides a unique opportunity to mitigate this issue by allowing memories to be formed and/or retrieved within immersive, navigable, visuospatial contexts. This can enhance the ecological validity of task paradigms, while still ensuring that researchers maintain experimental control over critical aspects of the learning and testing experience. This mini-review surveys the growing body of fMRI studies that have incorporated VR to address critical questions about human memory. These studies have adopted a variety of approaches, including presenting research participants with VR experiences in the scanner, asking participants to retrieve information that they had previously acquired in a VR environment, or identifying neural correlates of behavioral metrics obtained through VR-based tasks performed outside the scanner. Although most such studies to date have focused on spatial or navigational memory, we also discuss the promise of VR in aiding other areas of memory research and facilitating research into clinical disorders.

The time to remember: Temporal compression and duration judgements in memory for real-life events

Recent studies suggest that the continuous flow of information that constitutes daily life events is temporally compressed in episodic memory, yet the characteristics and determinants of this compression mechanism remain unclear. This study examined this question using an experimental paradigm incorporating wearable camera technology. Participants experienced a series of real-life events and were later asked to mentally replay various event sequences that were cued by pictures taken during the original events. Estimates of temporal compression (the ratio of the time needed to mentally re-experience an event to the actual event duration) showed that events were replayed, on average, about eight times faster than the original experiences. This compression mechanism seemed to operate by representing events as a succession of moments or slices of prior experience separated by temporal discontinuities. Importantly, however, rates of temporal compression were not constant and were lower for events involving goal-directed actions. The results also showed that the perceived duration of events increased with the density of recalled moments of prior experience. Taken together, these data extend our understanding of the mechanisms underlying the temporal compression and perceived duration of real-life events in episodic memory.

Differential Medial Temporal Lobe and Parietal Cortical Contributions to Real-world Autobiographical Episodic and Autobiographical Semantic Memory

Autobiographical remembering can depend on two forms of memory: episodic (event) memory and autobiographical semantic memory (remembering personally relevant semantic knowledge, independent of recalling a specific experience). There is debate about the degree to which the neural signals that support episodic recollection relate to or build upon autobiographical semantic remembering. Pooling data from two fMRI studies of memory for real-world personal events, we investigated whether medial temporal lobe (MTL) and parietal subregions contribute to autobiographical episodic and semantic remembering. During scanning, participants made memory judgments about photograph sequences depicting past events from their life or from others’ lives, and indicated whether memory was based on episodic or semantic knowledge. Results revealed several distinct functional patterns: activity in most MTL subregions was selectively associated with autobiographical episodic memory; the hippocampal tail, superior parietal lobule, and intraparietal sulcus were similarly engaged when memory was based on retrieval of an autobiographical episode or autobiographical semantic knowledge; and angular gyrus demonstrated a graded pattern, with activity declining from autobiographical recollection to autobiographical semantic remembering to correct rejections of novel events. Collectively, our data offer insights into MTL and parietal cortex functional organization, and elucidate circuitry that supports different forms of real-world autobiographical memory.

Temporal compression in episodic memory for real-life events

Remembering an event typically takes less time than experiencing it, suggesting that episodic memory represents past experience in a temporally compressed way. Little is known, however, about how the continuous flow of real-life events is summarised in memory. Here we investigated the nature and determinants of temporal compression by directly comparing memory contents with the objective timing of events as measured by a wearable camera. We found that episodic memories consist of a succession of moments of prior experience that represent events with varying compression rates, such that the density of retrieved information is modulated by goal processing and perceptual changes. Furthermore, the results showed that temporal compression rates remain relatively stable over one week and increase after a one-month delay, particularly for goal-related events. These data shed new light on temporal compression in episodic memory and suggest that compression rates are adaptively modulated to maintain current goal-relevant information.