Eying the future: Eye movement in past and future thinking

Differential eye movements and greater pupil size during mental scene construction in autobiographical recall

There is growing evidence supporting a role for eye movements during autobiographical recall, but their potential functionality remains unclear. We hypothesise that the oculomotor system facilitates the process of mental scene construction, in which complex scenes associated with an autobiographical event are generated and maintained during recall. To explore this, we examined spontaneous eye movements during retrieval of cued autobiographical memories. Participants' verbal descriptions of each memory were recorded in synchronisation with their eye movements and pupil size during recall. For each memory participants described the place (details of the environment where the event took place) and the event (details of what happened). Narratives were analyzed using the Autobiographical Interview procedure, which separated internal spatial (place) and non-spatial (event, thoughts and emotion) details. Eye movements during recall of spatial details had significantly higher fixation duration and smaller saccade amplitude and peak velocity, and a higher number of consecutive unidirectional saccades, in comparison to recall of non-spatial details. Recurrence quantification analysis indicated longer sequences of refixations and more repetitions of the same fixation pattern when participants described spatial details. Recall of spatial details was also associated with significantly greater pupil area. Overall findings are consistent with the spontaneous production of more structured saccade patterns and greater cognitive load during the recall of internal spatial episodic scene details in comparison to episodic non-spatial details. These results are consistent with the oculomotor system facilitating the activation and correct positioning of elements of a complex scene relative to other imagined elements during autobiographical recall.

A systematic review of eye movements during autobiographical recall: Does the mind's eye look at pictures of personal memories?

Retrieving personal memories is usually accompanied by eye movements. Although the functional significance of eye movements during retrieval is relatively well established in the case of episodic memory, their role in autobiographical memory is not clearly delineated in the literature. This systematic review critically examines existing studies in the field to summarize the current understanding of eye movements during autobiographical recall, leading to three conclusions. First, eye movements can be taken to reflect the retrieval of mental visual images in autobiographical memory. Second, eye movements may serve a functional role and support recall by helping retrieve visual details of the memory. Third, eye movements appear to be modulated by various aspects of the retrieval process, suggesting that they could meaningfully reflect aspects of the cognitive processes at play. The discussion highlights the major limitations of current research and proposes suggestions for future studies that will allow developing a more robust theoretical framework.

Internal coupling: Eye behavior coupled to visual imagery

Our eyes do not only respond to visual perception but also to internal cognition involving visual imagery, which can be referred to as internal coupling. This review synthesizes evidence on internal coupling across diverse domains including episodic memory and simulation, visuospatial memory, numerical cognition, object movement, body movement, and brightness imagery. In each domain, eye movements consistently reflect distinct aspects of mental imagery typically akin to those seen in corresponding visual experiences. Several findings further suggest that internal coupling may not only coincide with but also supports internal cognition as evidenced by improved cognitive performance. Available theoretical accounts suggest that internal coupling may serve at least two functional roles in visual imagery: facilitating memory reconstruction and indicating shifts in internal attention. Moreover, recent insights into the neurobiology of internal coupling highlight substantially shared neural pathways in externally and internally directed cognition. The review concludes by identifying open questions and promising avenues for future research such as exploring moderating roles of context and individual differences in internal coupling.

In the Eyes of the Future: Eye Movement during Near and Distant Future Thinking

Research has suggested that near future events are typically viewed from a first-person (an own-eyes, also known as field) perspective while distant future events are typically viewed from a third-person (an observer) perspective. We investigated whether these distinct mental perspectives would be accompanied by distinct eye movement activities. We invited participants to imagine near and distant future events while their eye movements (i.e., scan path) were recorded by eye-tracking glasses. Analysis demonstrated fewer but longer fixations for near future thinking than for distant future thinking. Analysis also demonstrated more "field" mental visual perspective responses for near than for distant future thinking. The long fixations during near future thinking may mirror a mental visual exploration involving processing of a more complex visual representation compared with distant future thinking. By demonstrating how near future thinking triggers both "field" responses and long fixations, our study demonstrates how the temporality of future thinking triggers both distinct mental imagery and eye movement patterns.

Peering into the future: Eye movements predict neural repetition effects during episodic simulation

Imagining future scenarios involves recombining different elements of past experiences into a coherent event, a process broadly supported by the brain's default network. Prior work suggests that distinct brain regions may contribute to the inclusion of different simulation features. Here we examine how activity in these brain regions relates to the vividness of future simulations. Thirty-four healthy young adults imagined future events with familiar people and locations in a two-part study involving a repetition suppression paradigm. First, participants imagined events while their eyes were tracked during a behavioral session. Immediately after, participants imagined events during MRI scanning. The events to be imagined were manipulated such that some were identical to those imagined in the behavioral session while others involved new locations, new people, or both. In this way, we could examine how self-report ratings and eye movements predict brain activity during simulation along with specific simulation features. Vividness ratings were negatively correlated with eye movements, in contrast to an often-observed positive relationship with past recollection. Moreover, fewer eye movements predicted greater involvement of the hippocampus during simulation, an effect specific to location features. Our findings suggest that eye movements may facilitate scene construction for future thinking, lending support to frameworks that spatial information forms the foundation of episodic simulation.

When you look at your past: Eye movement during autobiographical retrieval

Until recently, little was known about whether or how autobiographical memory (i.e., memory of personal information) activates eye movement. This issue is now being addressed by several studies demonstrating not only how autobiographical memory activates eye movement, but also how eye movement influences the characteristics of autobiographical retrieval. This paper summarizes this research and presents a hypothesis according to which fixations and saccades during autobiographical retrieval mirror the construction of the visual image of the retrieved event. This hypothesis suggests that eye movements during autobiographical retrieval mirror the attempts of the visual system to generate and manipulate mental representations of autobiographical retrieval. It offers a theoretical framework for a burgeoning area of research that provides a rigorous behavioral evaluation of the phenomenological experience of memory.

Exploring age-related changes in saccades during cognitive tasks in healthy adults

Introduction

Although eye movements such as saccades are related to internal cognitive processes and are independent of visual processing, few studies have investigated whether non-visual cognitive tasks simultaneously affect horizontal and vertical saccades in younger and older adults.

Methods

We recruited 28 younger adults aged 20-29 years and 26 older adults aged >60 years through advertisements in community settings. All participants were free of major psychiatric, neurological, or ocular diseases. All participants performed the mental arithmetic task (MAT) and verbal fluency task (VFT). The primary measures were saccade parameters, including frequency, mean amplitude, and mean velocity.

Results

During MAT and VFT, the frequencies of horizontal and vertical saccades increased (p = 0.0005 for horizontal saccade in MAT; p < 0.0001 for horizontal saccade in VFT; p = 0.012 for vertical saccade in MAT; p = 0.001 for vertical saccade in VFT), but were comparable between MAT and VFT. The old group showed a slower vertical saccade than the young group during the tasks (p = 0.011 in the MAT phase; p = 0.006 in the VFT phase). The amplitude of the horizontal saccade decreased in both groups during MAT compared to the resting period (p = 0.013), but did not change significantly during VFT.

Discussion

Saccade parameters can change during non-visual cognitive tasks with differences between age groups and saccade directions. This study significantly contributes to our understanding of the distinct dynamics of horizontal and vertical saccades across various age group in cognitive aging, despite its restricted focus on specific saccade parameters and cognitive tasks, and inclusion solely of cognitively normal individuals. This study highlights the importance of saccade analysis in elucidating age-related cognitive changes. In conclusion, saccades should be examined in future studies as a potential non-invasive biomarker for early detection of cognitive decline and neurodegenerative diseases.

How Do Women and Men Look at the Past? Large Scanpath in Women during Autobiographical Retrieval—A Preliminary Study

While research has consistently demonstrated how autobiographical memory triggers visual exploration, prior studies did not investigate gender differences in this domain. We thus compared eye movement between women and men while performing an autobiographical retrieval task. We invited 35 women and 35 men to retrieve autobiographical memories while their gaze was monitored by an eye tracker. We further investigated gender differences in eye movement and autobiographical specificity, that is, the ability to retrieve detailed memories. The analysis demonstrated shorter fixations, larger duration and amplitude of saccades, and higher autobiographical specificity in women than in men. The significant gender differences in eye movement disappeared after controlling for autobiographical specificity. When retrieving autobiographical memory, female participants generated a large scan with short fixation and high saccade amplitude, while male participants increased their fixation duration and showed poorer gaze scan. The large saccades in women during autobiographical retrieval may constitute an exploratory gaze behavior enabling better autobiographical memory functioning, which is reflected by the larger number of autobiographical details retrieved compared to men.

Eyes don't lie: Eye movements differ during covert and overt autobiographical recall

In everyday life, autobiographical memories are revisited silently (i.e., covert recall) or shared with others (i.e., overt recall), yet most research regarding eye movements and autobiographical recall has focused on overt recall. With that in mind, the aim of the current study was to evaluate eye movements during the retrieval of autobiographical memories (with a focus on emotion), recollected during covert and overt recall. Forty-three participants recalled personal memories out loud and silently, while wearing eye-tracking glasses, and rated these memories in terms of mental imagery and emotional intensity. Analyses showed fewer and longer fixations, fewer and shorter saccades, and fewer blinks during covert recall compared with overt recall. Participants perceived more mental images and had a more intense emotional experience during covert recall. These results are discussed considering cognitive load theories and the various functions of autobiographical recall. We theorize that fewer and longer fixations during covert recall may be due to more intense mental imagery. This study enriches the field of research on eye movements and autobiographical memory by addressing how we retrieve memories silently, a common activity of everyday life. More broadly, our results contribute to building objective tools to measure autobiographical memory, alongside already existing subjective scales.

Seeing the future: Connectome strength and network efficiency in visual network predict individual ability of episodic future thinking

Episodic future thinking (EFT) refers to the critical ability that enables people to construct and pre-experience the vivid mental imagery about future events, which impacts on the decision-making for individuals and group. Although EFT is generally believed to have a visual nature by theorists, little neuroscience evidence has been provided to verify this assumption. Here, by employing the approach of connectome-based predictive modeling (CPM) and graph-theoretical analysis, we analyzed resting-state functional brain image from 191 participants to predict their variability of EFT ability (leave-one-out cross-validation), and validated the results by applying different parcellation schemas and feature selection thresholds. At the connectome strength level, CPM-based analysis revealed that EFT ability could be predicted by the connectome strength of visual network. Besides, at the network level, graph-theoretical analysis showed that EFT ability could be predicted by the network efficiency of visual network. Moreover, these findings were replicated using different parcellation schemas and feature selection thresholds. These results robustly and collectively supported that the visual network might be one of the neural substrates underlying EFT ability from a comprehensive perspective of resting-state functional connectivity strength and the neural network. This study provides indications on how the function of visual network supports EFT ability, and enhances our understanding of the EFT ability from a neural basis perspective.

"Look at the future": Maintained fixation impoverishes future thinking

We evaluated the relationship between eye movements and future thinking. More specifically, we evaluated whether maintained fixation could influence cognitive characteristics of future thinking. We invited participants to imagine future events in two conditions: while freely exploring a white wall and while fixating a cross on the wall. Results demonstrated fewer and longer fixations, as well as fewer and shorter saccades during maintained fixation condition than in the free gaze condition. Shorter total amplitude of saccades was also observed during the maintained fixation condition than during the free-gaze condition. Regarding the cognitive characteristics of future thinking, fewer spatiotemporal details and less visual imagery, slower retrieval time, and shorter descriptions were observed for future thinking during maintained fixation than during free-gaze condition. These results demonstrate that maintaining fixation results in an effortful construction of future scenarios. We suggest that maintained fixation limits the cognitive resources that are required for future thinking.

“Look at Me” – Eye Movements During Autobiographical Retrieval in Face-to-Face Interactions

Abstract. There has been a surge in social cognition and social neurosciences research comparing laboratory and real eye movements. Eye movements during the retrieval of autobiographical memories (i.e., personal memories) in laboratory situations are also receiving more attention. We compared eye movements during the retrieval of autobiographical memories using a strict laboratory design versus a design mimicking social interactions. In the first design, eye movements were recorded during autobiographical memory retrieval while participants were looking at a blank screen; in the second design, participants wore eye-tracking glasses and communicated autobiographical memories to the experimenter. Compared with the “screen” design, the “glasses” design yielded more fixations ( p < .05), shorter duration of fixations ( p < .001), more saccades ( p < .01), and longer duration of saccades ( p < .001). These findings demonstrate how eye movements during autobiographical memory retrieval differ between strict laboratory design and face-to-face interactions.

The distinct and overlapping brain networks supporting semantic and spatial constructive scene processing

Scene imagery features prominently when we recall autobiographical memories, imagine the future and navigate around in the world. Consequently, in this study we sought to better understand how scene representations are supported by the brain. Processing scenes involves a variety of cognitive processes that in the real world are highly interactive. Here, however, our goal was to separate semantic and spatial constructive scene processes in order to identify the brain areas that were distinct to each process, those they had in common, and the connectivity between regions. To this end, participants searched for either semantic or spatial constructive impossibilities in scenes during functional MRI. We focussed our analyses on only those scenes that were possible, thus removing any error detection that would evoke reactions such as surprise or novelty. Importantly, we also counterbalanced possible scenes across participants, enabling us to examine brain activity and connectivity for the same possible scene images under two different conditions. We found that participants adopted different cognitive strategies, which were reflected in distinct oculomotor behaviour, for each condition. These were in turn associated with increased engagement of lateral temporal and parietal cortices for semantic scene processing, the hippocampus for spatial constructive scene processing, and increased activation of the ventromedial prefrontal cortex (vmPFC) that was common to both. Connectivity analyses showed that the vmPFC switched between semantic and spatial constructive brain networks depending on the task at hand. These findings further highlight the well-known semantic functions of lateral temporal areas, while providing additional support for the previously-asserted contribution of the hippocampus to scene construction, and recent suggestions that the vmPFC may play a key role in orchestrating scene processing.

Web-Based Assessment of the Phenomenology of Autobiographical Memories in Young and Older Adults

Autobiographical memories (ABMs) produce rich phenomenological experiences. Although few standardized and comprehensive measures of the phenomenology of ABMs have been developed, a web-based assessment of the full range of phenomenological properties is still missing. In the present study, we aimed to fill this gap and tested the psychometric properties of a web-based version of the Assessment of the Phenomenology of Autobiographical Memory (APAM) in a group of young and older adults. Specifically, taking advantage of the flexibility of web-based assessment methodology, we tested the rating consistency of APAM items, asking participants to rate the phenomenology of their ABMs with respect to seven cues, administered in one per day in seven different days. In each session, we also collected ratings of mood and arousal. Using linear mixed modeling (LMM), we could examine whether the phenomenology ratings differed with respect to age group while controlling for sex, age of the memory, arousal, mood, and specificity of the memory. Results revealed an adequate level of consistency of ratings in both young and older adults. Moreover, LMMs revealed a more intense experience of recollection and reliving (i.e., sensory and emotional) and a higher confidence in memory accuracy in older compared to younger adults. The theoretical and practical usefulness of a web-based assessment of the phenomenology of ABMs are discussed.

Harnessing Visual Imagery and Oculomotor Behaviour to Understand Prospection

Much of the rich internal world constructed by humans is derived from, and experienced through, visual mental imagery. Despite growing appreciation of visual exploration in guiding episodic memory processes, extant theories of prospection have yet to accommodate the precise role of visual mental imagery in the service of future-oriented thinking. We propose that the construction of future events relies on the assimilation of perceptual details originally experienced, and subsequently reinstantiated, predominantly in the visual domain. Individual differences in the capacity to summon discrete aspects of visual imagery can therefore account for the diversity of content generated by humans during future simulation. Our integrative framework provides a novel testbed to query alterations in future thinking in health and disease.

Characterising the hippocampal response to perception, construction and complexity

The precise role played by the hippocampus in supporting cognitive functions such as episodic memory and future thinking is debated, but there is general agreement that it involves constructing representations comprised of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multi-element stimuli. However, questions remain about the specificity and nature of the hippocampal response to scenes. Here, we devised a paradigm in which we had participants search pairs of images for either colour or layout differences, thought to be associated with perceptual or spatial constructive processes respectively. Importantly, images depicted either naturalistic scenes or phase-scrambled versions of the same scenes, and were either simple or complex. Using this paradigm during functional MRI scanning, we addressed three questions: 1. Is the hippocampus recruited specifically during scene processing? 2. If the hippocampus is more active in response to scenes, does searching for colour or layout differences influence its activation? 3. Does the complexity of the scenes affect its response? We found that, compared to phase-scrambled versions of the scenes, the hippocampus was more responsive to scene stimuli. Moreover, a clear anatomical distinction was evident, with colour detection in scenes engaging the posterior hippocampus whereas layout detection in scenes recruited the anterior hippocampus. The complexity of the scenes did not influence hippocampal activity. These findings seem to align with perspectives that propose the hippocampus is especially attuned to scenes, and its involvement occurs irrespective of the cognitive process or the complexity of the scenes.

Eye movements of recent and remote autobiographical memories: fewer and longer lasting fixations during the retrieval of childhood memories

There is an increased interest in the study of eye movements during the retrieval of autobiographical memories. Following this trend, the aim of the current study was to evaluate eye movements during the retrieval of remote and recent autobiographical memories. We instructed 71 participants to retrieve memories of personal events from early childhood (6-10 years), late childhood/early adolescence (11-14 years), late adolescence (15-18 years), and the last month. During the retrieval of these memories, participants wore eye-tracking glasses. Analyses showed that early childhood memories triggered fewer fixations and fixations with longer durations than memories from the last month. However, no significant differences were observed for the number of saccades, saccade durations, or total amplitude of the saccades. The fewer and longer lasting fixations during the retrieval of early childhood memories can be attributed either to the visual system reconstructing remote memories from an observer perspective or to difficulties when reconstructing remote memories.

Pupil dilation as an indicator of future thinking

BACKGROUND

The pupil typically dilates in reaction to cognitive load. In this study, we, for the first time, investigated whether future thinking (i.e., the ability to generate hypothetical scenarios in the future) would result in pupil dilation.

METHODS

We recorded pupil dilation of participants during two conditions: past and future thinking. In past thinking, we invited participants to retrieve past personal events, while in future thinking, we invited them to imagine an event that may occur in the future.

RESULTS

Analysis demonstrated a larger pupil size during future than past thinking. Results also demonstrated longer retrieval time of future events compared with past ones, suggesting that future thinking perhaps requires more cognitive load than for past thinking. Interestingly, retrieval times during past and future thinking were positively correlated with pupil size.

DISCUSSION

The finding that future thinking activates pupil dilation could be due to the fact that while both past and future thinking require retrieving information from memory, future, but not past, thinking additionally requires the ability to recombine this information into novel scenarios.

Shaping our personal past: Assessing the phenomenology of autobiographical memory and its association with object and spatial imagery

A new instrument has been developed that allows a comprehensive assessment of the relevant dimensions of the phenomenology of autobiographical memories (Assessment of the Phenomenology of Autobiographical Memory, APAM), and their association with visual object and spatial imagery has been examined. An initial version of APAM consisting of 30 items (the first 28 measured on a seven-point Likert-type scale) was developed and administered to a sample of 138 undergraduates. To test whether each item consistently measured the same dimension across different memories, all questions were rated for 12 cues. Results showed that 25 Likert-type items possessed adequate levels of internal consistency and unidimensionality across cues. We also found that higher levels of visual object imagery were associated with more sensory details and recollective qualities of memory, and with stronger experience of sensory and emotional reliving. The theoretical and practical usefulness of APAM as well as the relevance of visual object imagery in the phenomenology of autobiographical memory are discussed.

False Memory in Alzheimer's Disease

Patients with Alzheimer's Disease (AD) not only are suffering from amnesia but also are prone to memory distortions, such as experiencing detailed and vivid recollections of episodic events that have never been encountered (i.e., false memories). To describe and explain these distortions, we offer a review to synthesize current knowledge on false memory in AD into a framework allowing for better understanding of the taxonomy and phenomenology of false memories and of the cognitive mechanisms that may underlie false memory formation in AD. According to this review, certain phenomenological characteristics of memories (e.g., high emotional load, high vividness, or high familiarity) result in misattributions in AD. More specifically, this review proposes that generalized decline in cognitive control and inhibition in AD may result in difficulties in suppressing irrelevant information during memory monitoring, especially when irrelevant (i.e., false) information is characterized by high emotion, vividness, or familiarity. This review also proposes that binding deficits in AD decrease the ability to retrieve relevant contextual details, leading to source monitoring errors and false memories. In short, this review depicts how phenomenological characteristics of memories and failures of monitoring during retrieval contribute to the occurrence of false memory in AD.

J. Janssen S, Gallouj K, Lenoble Q. Autobiographical Memory Increases Pupil Dilation

BACKGROUND

Pupil activity has been widely considered as a "summed index" of physiological activities during cognitive processing.

METHODOLOGY

We investigated pupil dilation during retrieval of autobiographical memory and compared pupil diameter with a control condition in which participants had to count aloud. We also measured pupil diameters retrieval of free (i.e., first memory that comes to mind), positive, and negative memories (memories associated, respectively, with the words "happy" and "sad").

RESULTS

Analyses demonstrated larger pupil diameters during the free, positive, and negative autobiographical memory retrieval than during the control task. Analyses also demonstrated no significant differences in pupil diameters across the three autobiographical memory conditions.

CONCLUSION

These outcomes demonstrate that, compared with counting, autobiographical retrieval results in a larger pupil size. However, the emotional valence of memories yields non-significant effect on pupil diameters. Our findings demonstrate how autobiographical memory retrieval yields pupil dilation.

Future Thinking in Korsakoff Syndrome

Aims

Prior research has been mainly concerned with the ability of patients with Korsakoff syndrome (KS) to project themselves into the past. Little is known about the patients’ ability to project themselves into the future. We therefore compared past and future thinking in patients with KS.

Methods

We invited patients with KS and control participants to retrieve past events and reconstruct future events. Participants were also invited to rate subjective characteristics (i.e. time travel, emotional feeling, and visual imagery) of the past and future events.

Results

Patients with KS demonstrated low specificity, time travel, and emotional experience during past and future thinking. However, while lower emotional experience was observed in patients with KS than in the control participants during future thinking, no significant differences were observed between the two populations during past thinking. Regarding within-group comparisons, patients with KS demonstrated no significant differences between past and future thinking in terms of specificity, time travel, and visual imagery; however, they demonstrated higher emotional experience during past than during future thinking. Regarding control participants, they demonstrated no significant differences between past and future thinking in terms of specificity, time travel, emotional experience, and visual imagery.

Conclusion

Our findings demonstrate a diminished ability to construct specific future scenarios as well as a diminished subjective experience during future thinking in KS.

Maintaining fixation does not increase demands on working memory relative to free viewing

The comparison of memory performance during free and fixed viewing conditions has been used to demonstrate the involvement of eye movements in memory encoding and retrieval, with stronger effects at encoding than retrieval. Relative to conditions of free viewing, participants generally show reduced memory performance following sustained fixation, suggesting that unrestricted eye movements benefit memory. However, the cognitive basis of the memory reduction during fixed viewing is uncertain, with possible mechanisms including disruption of visual-mnemonic and/or imagery processes with sustained fixation, or greater working memory demands required for fixed relative to free viewing. To investigate one possible mechanism for this reduction, we had participants perform a working memory task-an auditory n-back task-during free and fixed viewing, as well as a repetitive finger tapping condition, included to isolate the effects of motor interference independent of the oculomotor system. As expected, finger tapping significantly interfered with n-back performance relative to free viewing, as indexed by a decrease in accuracy and increase in response times. By contrast, there was no evidence that fixed viewing interfered with n-back performance relative to free viewing. Our findings failed to support a hypothesis of increased working memory load during fixation. They are consistent with the notion that fixation disrupts long-term memory performance through interference with visual processes.