Wearable Cameras Are Useful Tools to Investigate and Remediate Autobiographical Memory Impairment: A Systematic PRISMA Review

Improving autobiographical memory in schizophrenia using wearable cameras: A single-case experimental study

Autobiographical memory (AM) impairments influence both sense of identity and social functioning of patients with schizophrenia. However, cognitive remediation methods addressing these difficulties do not sufficiently consider the heterogeneity of this disorder and frequently face methodological limitations. The aim of the present study was to evaluate the efficacy of a method using a wearable camera (NarrativeClip®), through an alternating treatments design across two types of AM training. In parallel, repeated measures were used to appreciate the efficacy, specificity, and generalizability of the programme's benefits. Three patients were invited to wear the camera during 24 personal events. Ten of these events memories were trained by visual cueing (wearable camera condition), 10 others by verbal cueing (written diary condition) and 4 were not trained (control condition). Using pictures collected by the wearable camera seemed particularly relevant, since it promoted more detailed recalls than the diary method, from the first training session and until the end of a one-year follow-up. In addition, the repeated measures performed revealed (1) the efficacy (improvement in AM capacities after participating in the programme), (2) specificity (persistence of working memory deficits), and (3) generalizability (improvement in measures of episodic memory) of our cognitive remediation programme's effects.

Using Wearable Cameras to Investigate Health-Related Daily Life Experiences: A Literature Review of Precautions and Risks in Empirical Studies

Automated, wearable cameras can benefit health-related research by capturing accurate and objective information about individuals' daily experiences. However, wearable cameras present unique privacy- and confidentiality-related risks due to the possibility of the images capturing identifying or sensitive information from participants and third parties. Although best practice guidelines for ethical research with wearable cameras have been published, limited information exists on the risks of studies using wearable cameras. The aim of this literature review was to survey risks related to using wearable cameras, and precautions taken to reduce those risks, as reported in empirical research. Forty-five publications, comprising 36 independent studies, were reviewed, and findings revealed that participants' primary concerns with using wearable cameras included physical inconvenience and discomfort in certain situations (e.g., public settings). None of the studies reviewed reported any serious adverse events. Although it is possible that reported findings do not include all risks experienced by participants in research with wearable cameras, our findings suggest a low level of risk to participants. However, it is important that investigators adopt recommended precautions, which can promote autonomy and reduce risks, including participant discomfort.

Behavioural and neurophysiological signatures in the retrieval of individual memories of recent and remote real-life routine episodic events

Autobiographical memory (AM) has been largely investigated as the ability to recollect specific events that belong to an individual's past. However, how we retrieve real-life routine episodes and how the retrieval of these episodes changes with the passage of time remain unclear. Here, we asked participants to use a wearable camera that automatically captured pictures to record instances during a week of their routine life and implemented a deep neural network-based algorithm to identify picture sequences that represented episodic events. We then asked each participant to return to the lab to retrieve AMs for single episodes cued by the selected pictures 1 week, 2 weeks and 6-14 months after encoding while scalp electroencephalographic (EEG) activity was recorded. We found that participants were more accurate in recognizing pictured scenes depicting their own past than pictured scenes encoded in the lab, and that memory recollection of personally experienced events rapidly decreased with the passing of time. We also found that the retrieval of real-life picture cues elicited a strong and positive 'ERP old/new effect' over frontal regions and that the magnitude of this ERP effect was similar throughout memory tests over time. However, we observed that recognition memory induced a frontal theta power decrease and that this effect was mostly seen when memories were tested after 1 and 2 weeks but not after 6-14 months from encoding. Altogether, we discuss the implications for neuroscientific accounts of episodic retrieval and the potential benefits of developing individual-based AM exploration strategies at the clinical level.

Using a wearable camera to support everyday memory following brain injury: a single-case study

Background:

Wearable cameras have been shown to improve memory in people with hippocampal amnesia and Alzheimer's disease. It is not known whether this benefit extends to people with amnesia of complex or uncertain origin.

Method:

This case study examined the effect of wearable camera use on memory and occupational performance in a patient with memory loss and complex mental health problems following a severe neurological incident. With the help of his occupational therapist (OT), Mr A used a wearable camera to record a series of eight personally significant events over a 6-week period. During visits from his OT, Mr A was asked to report what he could remember about the events, both before (baseline) and during the review of time-lapsed photographs captured automatically by the camera.

Results:

The results showed striking improvements in recall while reviewing the photographs, relative to baseline recall, but the additional details recalled during review did not appear to be maintained at later tests, after several days. Across the study period, there were moderate increases in occupational performance, measured using the Canadian Occupational Performance Measure. However, after the study period ended, Mr A ceased to use the wearable camera due to technological difficulty.

Conclusion:

There was a clear benefit of wearable camera use, but the real-world impact of the technology was limited by the complexity of the system. The results of the study are discussed alongside novel clinical insights and suggestions for developing wearable camera support systems that can be used independently by people with memory problems.

Unraveling the role of retrieval deficits in autobiographical memory impairment in schizophrenia: A comparison of involuntary and voluntary autobiographical memories

Patients with schizophrenia show severe autobiographical memory impairment, thought to reflect retrieval deficits caused by executive dysfunction. However, prior research has focused exclusively on strategic (voluntary) retrieval, and ignored involuntary retrieval resulting from automatic and associative processes, involving minimal cognitive control. We report two studies with patients diagnosed with schizophrenia (Ns = 40 and 50 respectively) comparing their impairment in involuntary versus voluntary autobiographical memory. We use two different methodologies, not previously used in schizophrenia research: a naturalistic study involving real-life data and an experimental setup. Both studies consistently showed that involuntary and voluntary autobiographical memories were similarly impaired in schizophrenia. The absence of interaction effects between group and retrieval suggests that schizophrenic patients did not benefit from memory tasks involving little retrieval effort. These findings suggest that autobiographical memory impairment in schizophrenia are not caused by problems with self-initiated voluntary retrieval, but instead likely reflect encoding or binding deficits.

Cognitive Intervention Targeting Autobiographical Memory Impairment in Patients With Schizophrenia Using a Wearable Camera: A Proof-of-Concept Study

Autobiographical memory (AM) impairment in schizophrenia affects the richness of detail in personal memories and is one of the major predictors of patients' social functioning. Despite the empirical evidence attributing these difficulties to a defective encoding process, cognitive remediation interventions targeting AM in schizophrenia often focus on the remote past, making it difficult to address the consequences of poor encoding. Our study evaluated the efficacy of an innovative approach using a wearable camera (NarrativeClip®) in reinforcing the encoding of recent daily life events in patients with schizophrenia. Seventeen patients with schizophrenia and 15 control participants wore the camera during four consecutive days. Then, memories of events experienced during these days were reinforced using different types of retrospective, i.e. interventions designed to promote a re-encoding of the event. We evaluated two types of retrospective using the camera pictures: a simple visual retrospective and a visual retrospective associated with a specific event-cueing (VisR+EC). These two techniques were compared to a verbal retrospective and to the absence of retrospective. Our results showed that the VisR+EC allowed patients to retrieve as many details as the control group at a two-week interval. However, patients' memories remained impaired when a simple visual or a verbal retrospective was used. Our study provides encouraging results to foster the use of a wearable camera in individualized cognitive remediation programs for AM impairment in schizophrenia.

Mnemoscape: Supporting Older Adults' Event Memory Using Wearable Camera Photographs on an Immersive Interface

BACKGROUND

Wearable camera photographs have been shown to be an effective memory aid in people with and without memory impairment. Most studies using wearable cameras as a memory aid have presented photographs on a computer monitor and used a written diary or no review as a comparison. In this pioneering study, we took a new and innovative approach to wearable camera photograph review that embeds the photographs within a virtual landscape. This approach may enhance these benefits by reinstating the original environmental context to increase participants' sense of re-experiencing the event.

OBJECTIVE

We compare the traditional computer monitor presentation of wearable camera photographs and actively taken digital photographs with the presentation of wearable camera photographs in a new immersive interface that reinstates the spatiotemporal context.

METHODS

Healthy older adults wore wearable or took digital photographs during a staged event. The next day and 2 weeks later, they viewed wearable camera photographs on a computer monitor or in context on an immersive interface, or digital photographs.

RESULTS

Participants who viewed wearable camera photographs in either format recalled more details during photo viewing and subsequent free recall than participants who viewed digital photographs they had taken themselves.

CONCLUSION

Wearable camera photographs are an effective support for event memory, regardless of whether they are presented in context in an experience-near format.

The Effects of Exposure to Recent Autobiographical Events on Declarative Memory in Amnestic Mild Cognitive Impairment: A Preliminary Pilot Study

BACKGROUND

Individuals with amnestic Mild Cognitive Impairment (aMCI) are at heightened risk of developing Alzheimer's dementia. In recent years, much attention has been given to the search for new interventions to slow down the progression of cognitive decline of these patients. Wearable digital camera devices are one form of new technology that captures images of one's life events, so they constitute a promising method to be used as a means to stimulate recent autobiographical memory.

OBJECTIVE

This preliminary study investigates the ability of a new cognitive intervention based on exposure to recent autobiographical memory captured by wearable cameras to improve episodic memory in patients with aMCI.

METHODS

Seventeen subjects wore a wearable camera while they went about their daily activities. The images captured were converted into eight different 3-minute films containing the most relevant information of each event. The intervention involved eight individualized weekly sessions during which patients were exposed to a different autobiographical event each week. Besides, several specific questions were formulated within each session. Clinical questionnaires assessing cognitive reserve, premorbid intelligence, depression, and anxiety were administered at baseline. Measures of objective episodic memory were applied at baseline and at post-treatment.

RESULTS

Significant improvements were observed at post-treatment in memory measures, and significant associations were found between memory change scores and age and cognitive reserve. Anyway, these associations did not reach statistical significance after adjusting for multiple comparisons.

CONCLUSION

The present study provides preliminary evidence that aMCI patients may benefit from a cognitive intervention program based on re-experiencing recent autobiographical events. However, future studies incorporating a control group will be needed to confirm these preliminary findings.

Acceptability of a lifelogging wearable camera in older adults with mild cognitive impairment: a mixed-method study

BACKGROUND

The main objective of this research was to evaluate the acceptance of technology based on a wearable lifelogging camera in a sample of older adults diagnosed with mild cognitive impairment (MCI).

METHODS

A mixed-method design was used, consisting of a self-report questionnaire, numerous images taken by users, and a series of focus group discussions. The patients were involved in an individualized training programme.

RESULTS

Nine MCI patients and their caregiver relatives were included. They showed good acceptance of the camera and downloaded an appropriate number of images on a daily basis. Perceived severity and ease of use were the main factors associated with the intention to use the device.

CONCLUSIONS

Older adults with MCI can become competent users of lifelogging wearable cameras with a good level of acceptance. Privacy concerns are outweighed by the potential benefits for memory. Limitations, strengths and implications for future research are discussed.

From a Lived Event to Its Autobiographical Memory: An Ecological Study Using Wearable Camera in Schizophrenia

Cognitive disorders are considered as a core symptom of schizophrenia. Importantly, episodic autobiographical memory deficits are strongly related to patients' social dysfunction. Although the cognitive mechanisms underlying autobiographical memory deficit are highly important to open the door for specific cognitive remediation, they are yet to be understood. The present study focused on event segmentation to check to which extent possible impairments in temporal ordering and segmenting in patients hinder memories construction. Twenty-seven patients with schizophrenia and 27 matched controls took part in an outdoor circuit while wearing a wearable camera. A week later, their memory and the temporal organization of this event have been assessed. Results showed that patients, compared with control participants, reported a reduced amount of details, especially less actions with interaction related to the event. Contrary to our initial hypotheses, event segmentation abilities in patients were not affected. The relationship between event segmentation and memory is discussed.

Minimal memory for details in real life events

The extent to which the details of past experiences are retained or forgotten remains controversial. Some studies suggest massive storage while others describe memories as fallible summary recreations of original events. The discrepancy can be ascribed to the content of memories and how memories are evaluated. Many studies have focused on recalling lists of words/pictures, which lack the critical ingredients of real world memories. Here we quantified the ability to remember details about one hour of real life. We recorded video and eye movements while subjects walked along specified routes and evaluated whether they could distinguish video clips from their own experience from foils. Subjects were minimally above chance in remembering the minutiae of their experiences. Recognition of specific events could be partly explained by a machine-learning model of video contents. These results quantify recognition memory for events in real life and show that the details of everyday experience are largely not retained in memory.

Towards augmented human memory: Retrieval-induced forgetting and retrieval practice in an interactive, end-of-day review

The authors report 6 experiments that examined the contention that an end-of-day review could lead to augmentation in human memory. In Experiment 1, participants in the study phase were presented with a campus tour of different to-be-remembered objects in different university locations. Each to-be-remembered object was presented with an associated specific comment. Participants were then shown the location name and photographs of half of the objects from half of the locations, and they were asked to try to name the object and recall the associated comment specific to each item. Following a filled delay, participants were presented with the name of each campus location and were asked to free recall the to-be-remembered objects. Relative to the recall from the unpracticed location categories, participants recalled the names of significantly more objects that they practiced (retrieval practice) and significantly fewer unpracticed objects from the practiced locations (retrieval-induced forgetting, RIF). These findings were replicated in Experiment 2 using a campus scavenger hunt in which participants selected their own stimuli from experimenter’s categories. Following an examination of factors that maximized the effects of RIF and retrieval practice in the laboratory (Experiment 3), the authors applied these findings to the campus scavenger hunt task to create different retrieval practice schedules to maximize and minimize recall of items based on experimenter-selected (Experiment 4) and participant-selected items using both category-cued free recall (Experiment 5) and item-specific cues (Experiment 6). Their findings support the claim that an interactive, end-of-day review could lead to augmentation in human memory.

The time to remember: Temporal compression and duration judgements in memory for real-life events

Recent studies suggest that the continuous flow of information that constitutes daily life events is temporally compressed in episodic memory, yet the characteristics and determinants of this compression mechanism remain unclear. This study examined this question using an experimental paradigm incorporating wearable camera technology. Participants experienced a series of real-life events and were later asked to mentally replay various event sequences that were cued by pictures taken during the original events. Estimates of temporal compression (the ratio of the time needed to mentally re-experience an event to the actual event duration) showed that events were replayed, on average, about eight times faster than the original experiences. This compression mechanism seemed to operate by representing events as a succession of moments or slices of prior experience separated by temporal discontinuities. Importantly, however, rates of temporal compression were not constant and were lower for events involving goal-directed actions. The results also showed that the perceived duration of events increased with the density of recalled moments of prior experience. Taken together, these data extend our understanding of the mechanisms underlying the temporal compression and perceived duration of real-life events in episodic memory.

The Developing Infant Creates a Curriculum for Statistical Learning

New efforts are using head cameras and eye-trackers worn by infants to capture everyday visual environments from the point of view of the infant learner. From this vantage point, the training sets for statistical learning develop as the sensorimotor abilities of the infant develop, yielding a series of ordered datasets for visual learning that differ in content and structure between timepoints but are highly selective at each timepoint. These changing environments may constitute a developmentally ordered curriculum that optimizes learning across many domains. Future advances in computational models will be necessary to connect the developmentally changing content and statistics of infant experience to the internal machinery that does the learning.

Temporal compression in episodic memory for real-life events

Remembering an event typically takes less time than experiencing it, suggesting that episodic memory represents past experience in a temporally compressed way. Little is known, however, about how the continuous flow of real-life events is summarised in memory. Here we investigated the nature and determinants of temporal compression by directly comparing memory contents with the objective timing of events as measured by a wearable camera. We found that episodic memories consist of a succession of moments of prior experience that represent events with varying compression rates, such that the density of retrieved information is modulated by goal processing and perceptual changes. Furthermore, the results showed that temporal compression rates remain relatively stable over one week and increase after a one-month delay, particularly for goal-related events. These data shed new light on temporal compression in episodic memory and suggest that compression rates are adaptively modulated to maintain current goal-relevant information.