Eye-movement replay supports episodic remembering

A systematic review of eye movements during autobiographical recall: Does the mind's eye look at pictures of personal memories?

Retrieving personal memories is usually accompanied by eye movements. Although the functional significance of eye movements during retrieval is relatively well established in the case of episodic memory, their role in autobiographical memory is not clearly delineated in the literature. This systematic review critically examines existing studies in the field to summarize the current understanding of eye movements during autobiographical recall, leading to three conclusions. First, eye movements can be taken to reflect the retrieval of mental visual images in autobiographical memory. Second, eye movements may serve a functional role and support recall by helping retrieve visual details of the memory. Third, eye movements appear to be modulated by various aspects of the retrieval process, suggesting that they could meaningfully reflect aspects of the cognitive processes at play. The discussion highlights the major limitations of current research and proposes suggestions for future studies that will allow developing a more robust theoretical framework.

Eye movements follow the dynamic shifts of attention through serial order in verbal working memory

How are arbitrary sequences of verbal information retained and manipulated in working memory? Increasing evidence suggests that serial order in verbal WM is spatially coded and that spatial attention is involved in access and retrieval. Based on the idea that brain areas controlling spatial attention are also involved in oculomotor control, we used eye tracking to reveal how the spatial structure of serial order information is accessed in verbal working memory. In two experiments, participants memorized a sequence of auditory words in the correct order. While their eye movements were being measured, they named the memorized items in a self-determined order in Experiment 1 and in a cued order in Experiment 2. We tested the hypothesis that serial order in verbal working memory interacts with the spatial attention system whereby gaze patterns in visual space closely follow attentional shifts in the internal space of working memory. In both experiments, we found that the gaze shifts in visual space correlated with the spatial shifts of attention along the left-to-right one-dimensional mapping of serial order positions in verbal WM. These findings suggest that spatial attention is employed for dynamically searching through verbal WM and that eye movements reflect the spontaneous association of order and space even in the absence of visuospatial input.

Refixation behavior in naturalistic viewing: Methods, mechanisms, and neural correlates

When freely viewing a scene, the eyes often return to previously visited locations. By tracking eye movements and coregistering eye movements and EEG, such refixations are shown to have multiple roles: repairing insufficient encoding from precursor fixations, supporting ongoing viewing by resampling relevant locations prioritized by precursor fixations, and aiding the construction of memory representations. All these functions of refixation behavior are understood to be underpinned by three oculomotor and cognitive systems and their associated brain structures. First, immediate saccade planning prior to refixations involves attentional selection of candidate locations to revisit. This process is likely supported by the dorsal attentional network. Second, visual working memory, involved in maintaining task-related information, is likely supported by the visual cortex. Third, higher-order relevance of scene locations, which depends on general knowledge and understanding of scene meaning, is likely supported by the hippocampal memory system. Working together, these structures bring about viewing behavior that balances exploring previously unvisited areas of a scene with exploiting visited areas through refixations.

Behavioral science labs: How to solve the multi-user problem

When lab resources are shared among multiple research projects, issues such as experimental integrity, replicability, and data safety become important. Different research projects often need different software and settings that may well conflict with one another, and data collected for one project may not be safeguarded from exposure to researchers from other projects. In this paper we provide an infrastructure design and an open-source tool, labManager, that render multi-user lab facilities in the behavioral sciences accessible to research projects with widely varying needs. The solutions proposed ensure ease of management while simultaneously offering maximum flexibility by providing research projects with fully separated bare metal environments. This solution also ensures that collected data is kept separate, and compliant with relevant ethical standards and regulations such as General Data Protection Regulation (GDPR) legislation. Furthermore, we discuss preconditions for running shared lab facilities and provide practical advice.

A short natural history of mental time travels: a journey still travelled?

Tulving's introduction of episodic memory and the metaphor of mental time travel has immensely enriched our understanding of human cognition. However, his focus on human psychology, with limited consideration of evolutionary perspectives, led to the entrenched notion that mental time travel is uniquely human. We contend that adopting a phylogenetic perspective offers a deeper insight into cognition, revealing it as a continuous evolutionary process. Adherence to the uniqueness of pre-defined psychological concepts obstructs a more complete understanding. We offer a concise natural history to elucidate how events that occurred hundreds of millions of years ago have been pivotal for our ability to mentally time travel. We discuss how the human brain, utilizing parts with ancient origins in a networked manner, enables mental time travel. This underscores that episodic memories and mental time travel are not isolated mental constructs but integral to our perception and representation of the world. We conclude by examining recent evidence of neuroanatomical correlates found only in great apes, which show great variability, indicating the ongoing evolution of mental time travel in humans.This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

How workload and availability of spatial reference shape eye movement coupling in visuospatial working memory

Eyes are active in memory recall and visual imagination, yet our grasp of the underlying qualities and factors of these internally coupled eye movements is limited. To explore this, we studied 50 participants, examining how workload, spatial reference availability, and imagined movement direction influence internal coupling of eye movements. We designed a visuospatial working memory task in which participants mentally moved a black patch along a path within a matrix and each trial involved one step along this path (presented via speakers: up, down, left, or right). We varied workload by adjusting matrix size (3 × 3 vs. 5 × 5), manipulated availability of a spatial frame of reference by presenting either a blank screen (requiring participants to rely solely on their mental representation of the matrix) or spatial reference in the form of an empty matrix, and contrasted active task performance to two control conditions involving only active or passive listening. Our findings show that eye movements consistently matched the imagined movement of the patch in the matrix, not driven solely by auditory or semantic cues. While workload influenced pupil diameter, perceived demand, and performance, it had no observable impact on internal coupling. The availability of spatial reference enhanced coupling of eye movements, leading more frequent, precise, and resilient saccades against noise and bias. The absence of workload effects on coupled saccades in our study, in combination with the relatively high degree of coupling observed even in the invisible matrix condition, indicates that eye movements align with shifts in attention across both visually and internally represented information. This suggests that coupled eye movements are not merely strategic efforts to reduce workload, but rather a natural response to where attention is directed.

Eye movements reinstate remembered locations during episodic simulation

Imagining the future, like recalling the past, relies on the ability to retrieve and imagine a spatial context. Research suggests that eye movements support this process by reactivating spatial contextual details from memory, a process termed gaze reinstatement. While gaze reinstatement has been linked to successful memory retrieval, it remains unclear whether it supports the related process of future simulation. In the present study, we recorded both eye movements and audio while participants described familiar locations from memory and subsequently imagined future events occurring in those locations while either freely moving their eyes or maintaining central fixation. Restricting viewing during simulation significantly reduced self-reported vividness ratings, supporting a critical role for eye movements in simulation. When viewing was unrestricted, participants spontaneously reinstated gaze patterns specific to the simulated location, replicating findings of gaze reinstatement during memory retrieval. Finally, gaze-based location reinstatement was predictive of simulation success, indexed by the number of internal (episodic) details produced, with both measures peaking early and co-varying over time. Together, these findings suggest that the same oculomotor processes that support episodic memory retrieval - that is, gaze-based reinstatement of spatial context - also support episodic simulation.

Looking at Mental Images: Eye-Tracking Mental Simulation During Retrospective Causal Judgment

How do people evaluate causal relationships? Do they just consider what actually happened, or do they also consider what could have counterfactually happened? Using eye tracking and Gaussian process modeling, we investigated how people mentally simulated past events to judge what caused the outcomes to occur. Participants played a virtual ball-shooting game and then-while looking at a blank screen-mentally simulated (a) what actually happened, (b) what counterfactually could have happened, or (c) what caused the outcome to happen. Our findings showed that participants moved their eyes in patterns consistent with the actual or counterfactual events that they mentally simulated. When simulating what caused the outcome to occur, participants moved their eyes consistent with simulations of counterfactual possibilities. These results favor counterfactual theories of causal reasoning, demonstrate how eye movements can reflect simulation during this reasoning and provide a novel approach for investigating retrospective causal reasoning and counterfactual thinking.

Attentional switch to memory: An early and critical phase of the cognitive cascade allowing autobiographical memory retrieval

Remembering and mentally reliving yesterday's lunch is a typical example of episodic autobiographical memory retrieval. In the present review, we reappraised the complex cascade of cognitive processes involved in memory retrieval, by highlighting one particular phase that has received little interest so far: attentional switch to memory (ASM). As attention cannot be simultaneously directed toward external stimuli and internal memories, there has to be an attentional switch from the external to the internal world in order to initiate memory retrieval. We formulated hypotheses and developed hypothetical models of both the cognitive and brain processes that accompany ASM. We suggest that gaze aversion could serve as an objective temporal marker of the point at which people switch their attention to memory, and highlight several fields (neuropsychology, neuroscience, social cognition, comparative psychology) in which ASM markers could be essential. Our review thus provides a new framework for understanding the early stages of autobiographical memory retrieval.