Oculomotor rehearsal in visuospatial working memory

Differential eye movements and greater pupil size during mental scene construction in autobiographical recall

There is growing evidence supporting a role for eye movements during autobiographical recall, but their potential functionality remains unclear. We hypothesise that the oculomotor system facilitates the process of mental scene construction, in which complex scenes associated with an autobiographical event are generated and maintained during recall. To explore this, we examined spontaneous eye movements during retrieval of cued autobiographical memories. Participants' verbal descriptions of each memory were recorded in synchronisation with their eye movements and pupil size during recall. For each memory participants described the place (details of the environment where the event took place) and the event (details of what happened). Narratives were analyzed using the Autobiographical Interview procedure, which separated internal spatial (place) and non-spatial (event, thoughts and emotion) details. Eye movements during recall of spatial details had significantly higher fixation duration and smaller saccade amplitude and peak velocity, and a higher number of consecutive unidirectional saccades, in comparison to recall of non-spatial details. Recurrence quantification analysis indicated longer sequences of refixations and more repetitions of the same fixation pattern when participants described spatial details. Recall of spatial details was also associated with significantly greater pupil area. Overall findings are consistent with the spontaneous production of more structured saccade patterns and greater cognitive load during the recall of internal spatial episodic scene details in comparison to episodic non-spatial details. These results are consistent with the oculomotor system facilitating the activation and correct positioning of elements of a complex scene relative to other imagined elements during autobiographical recall.

Internal coupling: Eye behavior coupled to visual imagery

Our eyes do not only respond to visual perception but also to internal cognition involving visual imagery, which can be referred to as internal coupling. This review synthesizes evidence on internal coupling across diverse domains including episodic memory and simulation, visuospatial memory, numerical cognition, object movement, body movement, and brightness imagery. In each domain, eye movements consistently reflect distinct aspects of mental imagery typically akin to those seen in corresponding visual experiences. Several findings further suggest that internal coupling may not only coincide with but also supports internal cognition as evidenced by improved cognitive performance. Available theoretical accounts suggest that internal coupling may serve at least two functional roles in visual imagery: facilitating memory reconstruction and indicating shifts in internal attention. Moreover, recent insights into the neurobiology of internal coupling highlight substantially shared neural pathways in externally and internally directed cognition. The review concludes by identifying open questions and promising avenues for future research such as exploring moderating roles of context and individual differences in internal coupling.

Inter-individual variability (but intra-individual stability) of overt versus covert rehearsal strategies in a digital Corsi task

The Corsi (block-tapping) paradigm is a classic and well-established visuospatial working memory task in humans involving internal computations (memorizing of item sequences, organizing and updating the memorandum, and recall processes), as well as both overt and covert shifts of attention to facilitate rehearsal, serving to maintain the Corsi sequences during the retention phase. Here, we introduce a novel digital version of a Corsi task in which i) the difficulty of the memorandum (using sequence lengths ranging from 3 to 8) was controlled, ii) the execution of overt and/or covert attention as well as the visuospatial working memory load during the retention phase was manipulated, and iii) shifts of attention were quantified in all experimental phases. With this, we present behavioral data that demonstrate, characterize, and classify the individual effects of overt and covert strategies used as a means of encoding and rehearsal. In a full within-subject design, we tested 28 participants who had to solve three different Corsi conditions. While in condition A neither of the two strategies were restricted, in condition B the overt and in condition C the overt as well as the covert strategies were suppressed. Analyzing Corsi span, (eye) exploration index, and pupil size (change), data clearly show a continuum between overt and covert strategies over all participants (indicating inter-individual variability). Further, all participants showed stable strategy choice (indicating intra-individual stability), meaning that the preferred strategy was maintained in all three conditions, phases, and sequence lengths of the experiment.

Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory

Besides controlling eye movements, the brain's oculomotor system has been implicated in the control of covert spatial attention and the rehearsal of spatial information in working memory. We investigated whether the oculomotor system also contributes to rehearsing visual objects in working memory when object location is never asked about. To address this, we tracked the incidental use of locations for mnemonic rehearsal via directional biases in microsaccades while participants maintained two visual objects (colored oriented gratings) in working memory. By varying the stimulus configuration (horizontal, diagonal, and vertical) at encoding, we could quantify whether microsaccades were more aligned with the configurational axis of the memory contents, as opposed to the orthogonal axis. Experiment 1 revealed that microsaccades continued to be biased along the axis of the memory content several seconds into the working memory delay. In Experiment 2, we confirmed that this directional microsaccade bias was specific to memory demands, ruling out lingering effects from passive and attentive encoding of the same visual objects in the same configurations. Thus, by studying microsaccade directions, we uncover oculomotor-driven rehearsal of visual objects in working memory through their associated locations.

Dynamic resource allocation in spatial working memory during full and partial report tasks

Serial position effects are well-documented in working memory literature. Studies of spatial short-term memory that rely on binary response; full report tasks tend to report stronger primacy than recency effects. In contrast, studies that utilize a continuous response, partial report task report stronger recency than primacy effects (Gorgoraptis, Catalao, Bays, & Husain, 2011; Zokaei, Gorgoraptis, Bahrami, Bays, & Husain, 2011). The current study explored the idea that probing spatial working memory using full and partial continuous response tasks would produce different distributions of visuospatial working memory resources across spatial sequences and, therefore, explain the conflicting results in the literature. Experiment 1 demonstrated that primacy effects were observed when memory was probed with a full report task. Experiment 2 confirmed this finding while controlling eye movements. Critically, Experiment 3 demonstrated that switching from a full to a partial report task abolished the primacy effect and produced a recency effect, consistent with the idea that the distribution of resources in visuospatial working memory depends on the type of recall required. It is argued that the primacy effect in the whole report task arose from the accumulation of noise caused by the execution of multiple spatially directed actions during recall, whereas the recency effect in the partial report task reflects the redistribution of preallocated resources when an anticipated item is not presented. These data show that it is possible to reconcile apparently contradictory findings within the resource theory of spatial working memory and the importance of considering how memory is probed when interpreting behavioral data through the lens of resource theories of spatial working memory.