Oculomotor preparation as a rehearsal mechanism in spatial working memory

The impact of spatial skills on problem-solving parsimony and solution quality in middle childhood

Spatial skills are essential cognitive abilities that develop during middle childhood and play a crucial role in solving STEM problems. In this relation, however, important aspects of problem-solving performance remain underexplored. Consequently, this study investigated whether spatial skills contribute to solution quality and parsimony in problem-solving. The sample comprised 478 six- to eight-year-olds (219 female) who completed mental rotation, visuospatial memory and gear-based problem-solving tasks. In both problem-solving tasks, spatial skills were associated with solution quality (β = .27** or .39**, respectively) and partially with the number of operations (β = -.06 or -.16*), indicating higher parsimony. Age was significantly linked to spatial skills and partially to parsimony but not to solution quality. These findings highlight the importance of spatial skills for different aspects of children's STEM-related problem-solving.

Differential eye movements and greater pupil size during mental scene construction in autobiographical recall

There is growing evidence supporting a role for eye movements during autobiographical recall, but their potential functionality remains unclear. We hypothesise that the oculomotor system facilitates the process of mental scene construction, in which complex scenes associated with an autobiographical event are generated and maintained during recall. To explore this, we examined spontaneous eye movements during retrieval of cued autobiographical memories. Participants' verbal descriptions of each memory were recorded in synchronisation with their eye movements and pupil size during recall. For each memory participants described the place (details of the environment where the event took place) and the event (details of what happened). Narratives were analyzed using the Autobiographical Interview procedure, which separated internal spatial (place) and non-spatial (event, thoughts and emotion) details. Eye movements during recall of spatial details had significantly higher fixation duration and smaller saccade amplitude and peak velocity, and a higher number of consecutive unidirectional saccades, in comparison to recall of non-spatial details. Recurrence quantification analysis indicated longer sequences of refixations and more repetitions of the same fixation pattern when participants described spatial details. Recall of spatial details was also associated with significantly greater pupil area. Overall findings are consistent with the spontaneous production of more structured saccade patterns and greater cognitive load during the recall of internal spatial episodic scene details in comparison to episodic non-spatial details. These results are consistent with the oculomotor system facilitating the activation and correct positioning of elements of a complex scene relative to other imagined elements during autobiographical recall.

Navigating the mind's eye: Understanding gaze shifts in visuospatial bootstrapping

Visuospatial bootstrapping refers to the well-replicated phenomena in which serial recall in a purely verbal task is boosted by presenting digits within the familiar spatial layout of a typical telephone keypad. The visuospatial bootstrapping phenomena indicates that additional support comes from long-term knowledge of a fixed spatial pattern, and prior experimentation supports the idea that access to this benefit depends on the availability of the visuospatial motor system. We investigate this by tracking participants' eye movements during encoding and retention of verbal lists to learn whether gaze patterns support verbal memory differently when verbal information is presented in the familiar visual layout. Participants' gaze was recorded during attempts to recall lists of seven digits in three formats: centre of the screen, typical telephone keypad, or a spatially identical layout with randomised number placement. Performance was better with the typical than with the novel layout. Our data show that eye movements differ when encoding and retaining verbal information that has a familiar layout compared with the same verbal information presented in a novel layout, suggesting recruitment of different spatial rehearsal strategies. However, no clear link between gaze pattern and recall accuracy was observed, which suggests that gazes play a limited role in retention, at best.

Internal coupling: Eye behavior coupled to visual imagery

Our eyes do not only respond to visual perception but also to internal cognition involving visual imagery, which can be referred to as internal coupling. This review synthesizes evidence on internal coupling across diverse domains including episodic memory and simulation, visuospatial memory, numerical cognition, object movement, body movement, and brightness imagery. In each domain, eye movements consistently reflect distinct aspects of mental imagery typically akin to those seen in corresponding visual experiences. Several findings further suggest that internal coupling may not only coincide with but also supports internal cognition as evidenced by improved cognitive performance. Available theoretical accounts suggest that internal coupling may serve at least two functional roles in visual imagery: facilitating memory reconstruction and indicating shifts in internal attention. Moreover, recent insights into the neurobiology of internal coupling highlight substantially shared neural pathways in externally and internally directed cognition. The review concludes by identifying open questions and promising avenues for future research such as exploring moderating roles of context and individual differences in internal coupling.

Inter-individual variability (but intra-individual stability) of overt versus covert rehearsal strategies in a digital Corsi task

The Corsi (block-tapping) paradigm is a classic and well-established visuospatial working memory task in humans involving internal computations (memorizing of item sequences, organizing and updating the memorandum, and recall processes), as well as both overt and covert shifts of attention to facilitate rehearsal, serving to maintain the Corsi sequences during the retention phase. Here, we introduce a novel digital version of a Corsi task in which i) the difficulty of the memorandum (using sequence lengths ranging from 3 to 8) was controlled, ii) the execution of overt and/or covert attention as well as the visuospatial working memory load during the retention phase was manipulated, and iii) shifts of attention were quantified in all experimental phases. With this, we present behavioral data that demonstrate, characterize, and classify the individual effects of overt and covert strategies used as a means of encoding and rehearsal. In a full within-subject design, we tested 28 participants who had to solve three different Corsi conditions. While in condition A neither of the two strategies were restricted, in condition B the overt and in condition C the overt as well as the covert strategies were suppressed. Analyzing Corsi span, (eye) exploration index, and pupil size (change), data clearly show a continuum between overt and covert strategies over all participants (indicating inter-individual variability). Further, all participants showed stable strategy choice (indicating intra-individual stability), meaning that the preferred strategy was maintained in all three conditions, phases, and sequence lengths of the experiment.

Social prioritisation in scene viewing and the effects of a spatial memory load

When free-viewing scenes, participants tend to preferentially fixate social elements (e.g., people). In the present study, we tested whether this bias would be disrupted by increasing the demands of a secondary dual-task: holding a set of (one or six) spatial locations in memory, presented either simultaneously or sequentially. Following a retention interval, participants judged whether a test location was present in the to-be-remembered stimuli. During the retention interval participants free-viewed scenes containing a social element (a person) and a non-social element (an object) that served as regions of interest. In order to assess the impact of physical salience, the non-social element was presented in both an unaltered baseline version, and in a version where its salience was artificially increased. The results showed that the preference to look at social elements decreased when the demands of the spatial memory task were increased from one to six locations, regardless of presentation mode (simultaneous or sequential). The high-load condition also resulted in more central fixations and reduced exploration of the scene. The results indicate that the social prioritisation effect, and scene viewing more generally, can be affected by a concurrent memory load.

Oculomotor inhibition markers of working memory load

Involuntary eye movements occur constantly even during fixation and were shown to convey information about cognitive processes. They are inhibited momentarily in response to external stimuli (oculomotor inhibition, OMI), with a time and magnitude that depend on stimulus saliency, attention, and expectations. It was recently shown that the working memory load for numbers modulates the microsaccade rate; however, the generality of the effect and its temporal properties remain unclear. Our goal was to investigate the relationship between OMI and the working memory load for simple colored shapes. Participants (N = 26) maintained their fixation while their eyes were tracked; they viewed briefly flashed colored shapes accompanied by small arrows indicating the shapes to be memorized (1/2/3). After a retention period, a probe shape appeared for matching. The microsaccade rate modulation and temporal properties were analyzed for the memory encoding, maintenance, and retrieval phases. Microsaccade inhibition was stronger when more shapes were memorized, and performance improved when microsaccades were suppressed during maintenance and retrieval. This occurred even though the physical stimuli were identical in number under all conditions. Thus, oculomotor inhibition may play a role in silencing the visual input while processing current stimuli and is generally related to processing time and load.

Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory

Besides controlling eye movements, the brain's oculomotor system has been implicated in the control of covert spatial attention and the rehearsal of spatial information in working memory. We investigated whether the oculomotor system also contributes to rehearsing visual objects in working memory when object location is never asked about. To address this, we tracked the incidental use of locations for mnemonic rehearsal via directional biases in microsaccades while participants maintained two visual objects (colored oriented gratings) in working memory. By varying the stimulus configuration (horizontal, diagonal, and vertical) at encoding, we could quantify whether microsaccades were more aligned with the configurational axis of the memory contents, as opposed to the orthogonal axis. Experiment 1 revealed that microsaccades continued to be biased along the axis of the memory content several seconds into the working memory delay. In Experiment 2, we confirmed that this directional microsaccade bias was specific to memory demands, ruling out lingering effects from passive and attentive encoding of the same visual objects in the same configurations. Thus, by studying microsaccade directions, we uncover oculomotor-driven rehearsal of visual objects in working memory through their associated locations.

Gaze Restriction and Reactivation of Place-bound Content Drive Eye Movements During Mental Imagery

When we imagine a picture, we move our eyes even though the picture is physically not present. These eye movements provide information about the ongoing process of mental imagery. Eye movements unfold over time, and previous research has shown that the temporal gaze dynamics of eye movements in mental imagery have unique properties, which are unrelated to those in perception. In mental imagery, refixations of previously fixated locations happen more often and in a more systematic manner than in perception. The origin of these unique properties remains unclear. We tested how the temporal structure of eye movements is influenced by the complexity of the mental image. Participants briefly saw and then maintained a pattern stimulus, consisting of one (easy condition) to four black segments (most difficult condition). When maintaining a simple pattern in imagery, participants restricted their gaze to a narrow area, and for more complex stimuli, eye movements were more spread out to distant areas. At the same time, fewer refixations were made in imagery when the stimuli were complex. The results show that refixations depend on the imagined content. While fixations of stimulus-related areas reflect the so-called 'looking at nothing' effect, gaze restriction emphasizes differences between mental imagery and perception.

A functional role for oculomotor preparation in mental arithmetic evidenced by the abducted eye paradigm

Solving subtraction and addition problems is accompanied by spontaneous leftward and rightward gaze shifts, respectively. These shifts have been related to attentional processes involved in mental arithmetic, but whether these processes induce overt attentional shifts mediated by the activation of the motor programs underlying lateral eye movements or covert shifts only is still unknown. Here, we used the abducted eye paradigm to selectively disrupt activation of the oculomotor system and prevent oculomotor preparation, which affects overt but not covert attentional shifts. Participants had to mentally solve addition and subtraction problems while fixating a screen positioned either in front of them or laterally to their left or right such that they were physically unable to programme and execute saccades further into their temporal field while they still could do so in their nasal field. In comparison to the frontal condition, rightward eye abduction impaired additions (with carrying), and leftward eye abduction impaired subtractions (with borrowing) showing that at least some arithmetic problems rely on processes dedicated to overt attentional shifts. We propose that when solving arithmetic problems requires procedures such as carrying and borrowing, oculomotor mechanisms operating on a mental space transiently built in working memory are recruited to represent one numerical magnitude in relation to another (e.g. the first operand and the result).

Oculomotor rehearsal in visuospatial working memory

The neural and cognitive mechanisms of spatial working memory are tightly coupled with the systems that control eye movements, but the precise nature of this coupling is not well understood. It has been argued that the oculomotor system is selectively involved in rehearsal of spatial but not visual material in visuospatial working memory. However, few studies have directly compared the effect of saccadic interference on visual and spatial memory, and there is little consensus on how the underlying working memory representation is affected by saccadic interference. In this study we aimed to examine how working memory for visual and spatial features is affected by overt and covert attentional interference across two experiments. Participants were shown a memory array, then asked to either maintain fixation or to overtly or covertly shift attention in a detection task during the delay period. Using the continuous report task we directly examined the precision of visual and spatial working memory representations and fit psychophysical functions to investigate the sources of recall error associated with different types of interference. These data were interpreted in terms of embodied theories of attention and memory and provide new insights into the nature of the interactions between cognitive and motor systems.

On the Effect of Bilateral Eye Movements on Memory Retrieval in Ageing and Dementia

It has been reported that performing bilateral eye movements for a short period can lead to an enhancement of memory retrieval and recall (termed the “saccade induced retrieval effect (SIRE)”). The source of this effect has been debated within the literature and the phenomenon has come under scrutiny as the robustness of the effect has recently been questioned. To date investigations of SIRE have largely been restricted to younger adult populations. Here, across two experiments, we assess the robustness and generalisability of the SIRE specifically in relation to disease and ageing. Experiment 1 employed a between subject’s design and presented younger and older participants with 36 words prior to completing one of three eye movement conditions (bilateral, antisaccade or a fixation eye movement). Participants then performed a word recognition task. Experiment 2 assessed the SIRE in individuals diagnosed with Alzheimer’s, Mild cognitive impairment and Parkinson’s by employing an online within subject’s design. Results showed no significant difference between groups in the number of words recognised based on eye movement condition. Neither experiment 1 or 2 replicated the SIRE effect therefore the findings from this study add to the growing number of studies that have failed to replicate the SIRE effect.

Neural Evidence for Different Types of Position Coding Strategies in Spatial Working Memory

Sustained neural activity during the delay phase of spatial working memory tasks is compelling evidence for the neural correlate of active storage and maintenance of spatial information, however, it does not provide insight into specific mechanisms of spatial coding. This activity may reflect a range of processes, such as maintenance of a stimulus position or a prepared motor response plan. The aim of our study was to examine neural evidence for the use of different coding strategies, depending on the characteristics and demands of a spatial working memory task. Thirty-one (20 women, 23 ± 5 years) and 44 (23 women, 21 ± 2 years) participants performed a spatial working memory task while we measured their brain activity using fMRI in two separate experiments. Participants were asked to remember the position of a briefly presented target stimulus and, after a delay period, to use a joystick to indicate either the position of the remembered target or an indicated non-matching location. The task was designed so that the predictability of the response could be manipulated independently of task difficulty and memory retrieval process. We were particularly interested in contrasting conditions in which participants (i) could use prospective coding of the motor response or (ii) had to rely on retrospective sensory information. Prospective motor coding was associated with activity in somatomotor, premotor, and motor cortices and increased integration of brain activity with and within the somatomotor network. In contrast, retrospective sensory coding was associated with increased activity in parietal regions and increased functional connectivity with and within secondary visual and dorsal attentional networks. The observed differences in activation levels, dynamics of differences over trial duration, and integration of information within and between brain networks provide compelling evidence for the use of complementary spatial working memory strategies optimized to meet task demands.

Shifting attention in visuospatial short-term memory does not require oculomotor planning: Insight from congenital gaze paralysis

Attention allows pieces of information stored in visuospatial short-term memory (VSSTM) to be selectively processed. Previous studies showed that shifts of attention in VSSTM in response to a retro-cue are accompanied by eye movements in the direction of the position of the memorized item although there is nothing left to look at. This finding raises the possibility that shifts of attention in VSSTM are underpinned by mechanisms originally involved in the planning and control of eye movements. To explore this possibility, we investigated the ability of an individual with congenital horizontal gaze paralysis (HGP2) to shift her attention horizontally or vertically toward a memorized item within VSSTM using a retro-cue paradigm. As efficient oculomotor programming is not innate but requires some trial and error learning and adaptation to develop, congenital paralysis prevents this development. Consequently, if shifts of attention in VSSTM rely on the same mechanisms as those supporting the programming of eye movements, then horizontal congenital gaze paralysis should necessarily prevent typical retro-cueing effect in the paralyzed axis. At odds with this prediction, HGP2 showed a typical retro-cueing effect in her paralyzed axis. This original finding indicates that selecting an item within VSSTM does not depend on the ability to program a saccade.

Cognitive Dimensions of Learning in Children With Problems in Attention, Learning, and Memory

A data-driven, transdiagnostic approach was used to identify the cognitive dimensions linked with learning in a mixed group of 805 children aged 5 to 18 years recognised as having problems in attention, learning and memory by a health or education practitioner. Assessments included phonological processing, information processing speed, short-term and working memory, and executive functions, and attainments in word reading, spelling, and maths. Data reduction methods identified three dimensions of phonological processing, processing speed and executive function for the sample as a whole. This model was comparable for children with and without ADHD. The severity of learning difficulties in literacy was linked with phonological processing skills, and in maths with executive control. Associations between cognition and learning were similar across younger and older children and individuals with and without ADHD, although stronger links between learning-related problems and both executive skills and processing speed were observed in children with ADHD. The results establish clear domain-specific cognitive pathways to learning that distinguish individuals in the heterogeneous population of children struggling to learn.

Spatial attention and spatial short term memory in PSP and Parkinson's disease

Progressive Supranuclear Palsy (PSP) is a neurodegenerative disorder characterised by deterioration in motor, oculomotor and cognitive function. A key clinical feature of PSP is the progressive paralysis of eye movements, most notably for vertical saccades. These oculomotor signs can be subtle, however, and PSP is often misdiagnosed as Parkinson's disease (PD), in its early stages. Although some of the clinical features of PD and PSP overlap, they are distinct disorders with differing underlying pathological processes, responses to treatment and prognoses. One key difference lies in the effects the diseases have on cognition. The oculomotor system is tightly linked to cognitive processes such as spatial attention and spatial short-term memory (sSTM), and previous studies have suggested that PSP and PD experience different deficits in these domains. We therefore hypothesised that people with PSP (N = 15) would experience problems with attention (assessed with feature and conjunction visual search tasks) and sSTM (assessed with the Corsi blocks task) compared to people with PD (N = 16) and Age Matched Controls (N = 15). As predicted, feature and conjunction search were sgnificantly slower in the PSP group compared to the other groups, and this deficit was significantly worse for feature compared to conjunction search. The PD group did not differ from AMC on feature search but were significantly impaired on the conjunction search. The PSP group also had a pronounced vertical sSTM impairment that was not present in PD or AMC groups. It is argued that PSP is associated with specific impairment of visuospatial cognition which is caused by degeneration of the oculomotor structures that support exogenous spatial attention, consistent with oculomotor theories of spatial attention and memory.

Charting the Diversity of Strategic Processes in Visuospatial Short-Term Memory

Despite the abundant literature on visuospatial short-term memory, researchers have devoted little attention to strategic processes: What procedures do subjects implement to memorize visuospatial material? Evidence for various strategies exists, but it is spread across a variety of fields. This integrative review of the literature brings together scattered evidence to provide an overview of strategic processes in visuospatial memory tasks. The diversity of strategies and their proposed operating mechanisms are reviewed and discussed. The evidence leads to proposing seven broad strategic processes used in visuospatial short-term memory, each with multiple variants. Strategies can vary across individuals, but the same subjects also appear to use multiple strategies depending on the perceptual features of to-be-remembered displays. These results point to a view of visuospatial strategies as a functional library of facilitatory processes on which subjects can draw to support visuospatial short-term memory performance. Implications are discussed for the difference between visual and spatial tasks, for the appropriate measurement of strategic behaviors, and for the interpretation of performance in visuospatial memory tasks.

On the link between attentional search and the oculomotor system: Is preattentive search restricted to the range of eye movements?

It has been proposed that covert visual search can be fast, efficient, and stimulus driven, particularly when the target is defined by a salient single feature, or slow, inefficient, and effortful when the target is defined by a nonsalient conjunction of features. This distinction between fast, stimulus-driven orienting and slow, effortful orienting can be related to the distinction between exogenous spatial attention and endogenous spatial attention. Several studies have shown that exogenous, covert orienting is limited to the range of saccadic eye movements, whereas covert endogenous orienting is independent of the range of saccadic eye movements. The current study examined whether covert visual search is affected in a similar way. Experiment 1 showed that covert visual search for feature singletons was impaired when stimuli were presented beyond the range of saccadic eye movements, whereas conjunction search was unaffected by array position. Experiment 2 replicated and extended this effect by measuring search times at 6 eccentricities. The impairment in covert feature search emerged only when stimuli crossed the effective oculomotor range and remained stable for locations further into the periphery, ruling out the possibility that the results of Experiment 1 were due to a failure to fully compensate for the effects of cortical magnification. The findings are interpreted in terms of biased competition and oculomotor theories of spatial attention. It is concluded that, as with covert exogenous orienting, biological constraints on overt orienting in the oculomotor system constrain covert, preattentive search.

Egocentric metric representations in peripersonal space: A bridge between motor resources and spatial memory

Research on visuospatial memory has shown that egocentric (subject-to-object) and allocentric (object-to-object) reference frames are connected to categorical (non-metric) and coordinate (metric) spatial relations, and that motor resources are recruited especially when processing spatial information in peripersonal (within arm reaching) than extrapersonal (outside arm reaching) space. In order to perform our daily-life activities, these spatial components cooperate along a continuum from recognition-related (e.g., recognizing stimuli) to action-related (e.g., reaching stimuli) purposes. Therefore, it is possible that some types of spatial representations rely more on action/motor processes than others. Here, we explored the role of motor resources in the combinations of these visuospatial memory components. A motor interference paradigm was adopted in which participants had their arms bent behind their back or free during a spatial memory task. This task consisted in memorizing triads of objects and then verbally judging what was the object: (1) closest to/farthest from the participant (egocentric coordinate); (2) to the right/left of the participant (egocentric categorical); (3) closest to/farthest from a target object (allocentric coordinate); and (4) on the right/left of a target object (allocentric categorical). The triads appeared in participants' peripersonal (Experiment 1) or extrapersonal (Experiment 2) space. The results of Experiment 1 showed that motor interference selectively damaged egocentric-coordinate judgements but not the other spatial combinations. The results of Experiment 2 showed that the interference effect disappeared when the objects were in the extrapersonal space. A third follow-up study using a within-subject design confirmed the overall pattern of results. Our findings provide evidence that motor resources play an important role in the combination of coordinate spatial relations and egocentric representations in peripersonal space.

The effects of transcranial direct current stimulation on within- and cross-paradigm transfer following multi-session backward recall training

•

Randomised controlled trial combining backward recall memory training and tDCS.

•

Systematic investigation into task features constraining training transfer.

•

Measurement of potential benefits of tDCS for training and for transfer across tasks with varying degrees of overlap with training task.

•

Training transfer is constrained by paradigm but not task materials.

•

tDCS over left DLPFC (1 mA, 10 min) does not enhance training or transfer.

Transcranial direct current stimulation (tDCS) has been shown to enhance the efficacy and generalisation of working memory (WM) training, but there has been little systematic investigation into how coupling task-specific WM training with stimulation impacts more specifically on transfer to untrained tasks. This randomised controlled trial investigated the boundary conditions to transfer by testing firstly whether the benefits of training on backward digit recall (BDR) extend to untrained backward recall tasks and n-back tasks with different materials, and secondly which, if any, form of transfer is enhanced by tDCS. Forty-eight participants were allocated to one of three conditions: BDR training with anodal (10 min, 1 mA) or sham tDCS, or visual search training with sham tDCS, applied over the left dorsolateral prefrontal cortex. Transfer was assessed on within- (backward recall with digits, letters, and spatial locations) and cross-paradigm (n-back with digits and letters) transfer tests following three sessions of training and stimulation. On-task training gains were found, with transfer to other backward span but not n-back tasks. There was little evidence that tDCS enhanced on-task training or transfer. These findings indicate that training enhances paradigm-specific processes within WM, but that tDCS does not enhance these gains.

Re-evaluating whether bilateral eye movements influence memory retrieval

Several recent studies have reported enhanced memory when retrieval is preceded by repetitive horizontal eye movements, relative to vertical or no eye movements. The reported memory boost has been referred to as the Saccade-Induced Retrieval Enhancement (SIRE) effect. Across two experiments, memory performance was compared following repetitive horizontal or vertical eye movements, as well as following a control condition of no eye movements. In Experiment 1, we conceptually replicated Christman and colleagues’ seminal study, finding a statistically significant SIRE effect, albeit with weak Bayesian evidence. We therefore sought to conduct another close extension. In Experiment 2, horizontal and vertical eye movement conditions were manipulated separately, and sample size was increased. No evidence of a SIRE effect was found: Bayesian statistical analyses demonstrated significant evidence for a null effect. Taken together, these experiments suggest that the SIRE effect is inconsistent. The current experiments call into question the generalizability of the SIRE effect and suggest that its presence is very sensitive to experimental design. Future work should further assess the robustness of the effect before exploring related theories or underlying mechanisms.

On-item fixations during serial encoding do not affect spatial working memory

Ample evidence suggests that there is overlap between the eye-movement system and spatial working memory. Such overlapping structures or capacities may result in interference on the one hand and beneficial support on the other. We investigated eye-movement control during encoding of verbal or spatial information, keeping the display the same between tasks. Saccades to to-be-encoded items were scarce during spatial encoding in comparison with verbal encoding. However, despite replicating this difference across different tasks (serial, free recall) and presentation modalities (simultaneous, sequential presentation), we found no relation between item fixations and memory performance-that is, no costs or benefits. Inducing a change from covert to overt encoding did not affect spatial memory performance as well. In contrast, regressive fixations on prior items, that were no longer on the screen, were associated with increased spatial memory performance. Regressions occurred mainly at the end of the encoding period and were targeted at the first presented item. Our results suggest a dissociation between two types of fixations that accompany serial spatial memory: On-item fixations are epiphenomenal; regressions indicate rehearsal or output preparation.

Updating spatial working memory in a dynamic visual environment

The present review describes recent developments regarding the role of the eye movement system in representing spatial information and keeping track of locations of relevant objects. First, we discuss the active vision perspective and why eye movements are considered crucial for perception and attention. The second part focuses on the question of how the oculomotor system is used to represent spatial attentional priority, and the role of the oculomotor system in maintenance of this spatial information. Lastly, we discuss recent findings demonstrating rapid updating of information across saccadic eye movements. We argue that the eye movement system plays a key role in maintaining and rapidly updating spatial information. Furthermore, we suggest that rapid updating emerges primarily to make sure actions are minimally affected by intervening eye movements, allowing us to efficiently interact with the world around us.

Associations and Dissociations between Oculomotor Readiness and Covert Attention

The idea that covert mental processes such as spatial attention are fundamentally dependent on systems that control overt movements of the eyes has had a profound influence on theoretical models of spatial attention. However, theories such as Klein’s Oculomotor Readiness Hypothesis (OMRH) and Rizzolatti’s Premotor Theory have not gone unchallenged. We previously argued that although OMRH/Premotor theory is inadequate to explain pre-saccadic attention and endogenous covert orienting, it may still be tenable as a theory of exogenous covert orienting. In this article we briefly reiterate the key lines of argument for and against OMRH/Premotor theory, then evaluate the Oculomotor Readiness account of Exogenous Orienting (OREO) with respect to more recent empirical data. These studies broadly confirm the importance of oculomotor preparation for covert, exogenous attention. We explain this relationship in terms of reciprocal links between parietal ‘priority maps’ and the midbrain oculomotor centres that translate priority-related activation into potential saccade endpoints. We conclude that the OMRH/Premotor theory hypothesis is false for covert, endogenous orienting but remains tenable as an explanation for covert, exogenous orienting.

Effects of reward on spatial working memory in schizophrenia

Reward processing and cognition are disrupted in schizophrenia (SCZ), yet how these processes interface is unknown. In SCZ, deficits in reward representation may affect motivated, goal-directed behaviors. To test this, we examined the effects of monetary reward on spatial working memory (WM) performance in patients with SCZ. To capture complimentary effects, we tested biophysically grounded computational models of neuropharmacologic manipulations onto a canonical fronto-parietal association cortical microcircuit capable of WM computations. Patients with SCZ (n = 33) and healthy control subjects (HCS; n = 32) performed a spatial WM task with 2 reward manipulations: reward cues presented prior to each trial, or contextually prior to a block of trials. WM performance was compared with cortical circuit models of WM subjected to feed-forward glutamatergic excitation, feed-forward GABAergic inhibition, or recurrent modulation strengthening local connections. Results demonstrated that both groups improved WM performance to reward cues presented prior to each trial (HCS d = -0.62; SCZ d = -1.0), with percent improvement correlating with baseline WM performance (r = .472, p < .001). However, rewards presented contextually before a block of trials did not improve WM performance in patients with SCZ (d = 0.01). Modeling simulations achieved improved WM precision through strengthened local connections via neuromodulation, or feed-forward inhibition. Taken together, this work demonstrates that patients with SCZ can improve WM performance to short-term, but not longer-term rewards-thus, motivated behaviors may be limited by strength of reward representation. A potential mechanism for transiently improved WM performance may be strengthening of local fronto-parietal microcircuit connections via neuromodulation or feed-forward inhibitory drive. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Eye Movements in the "Morris Maze" Spatial Working Memory Task Reveal Deficits in Strategic Planning

Analysis of eye movements can provide insights into processes underlying performance of cognitive tasks. We recorded eye movements in healthy participants and people with idiopathic Parkinson disease during a token foraging task based on the spatial working memory component of the widely used Cambridge Neuropsychological Test Automated Battery. Participants selected boxes (using a mouse click) to reveal hidden tokens. Tokens were never hidden under a box where one had been found before, such that memory had to be used to guide box selections. A key measure of performance in the task is between search errors (BSEs) in which a box where a token has been found is selected again. Eye movements were found to be most commonly directed toward the next box to be clicked on, but fixations also occurred at rates higher than expected by chance on boxes farther ahead or back along the search path. Looking ahead and looking back in this way was found to correlate negatively with BSEs and was significantly reduced in patients with Parkinson disease. Refixating boxes where tokens had already been found correlated with BSEs and the severity of Parkinson disease symptoms. It is concluded that eye movements can provide an index of cognitive planning in the task. Refixations on locations where a token has been found may also provide a sensitive indicator of visuospatial memory integrity. Eye movement measures derived from the spatial working memory task may prove useful in the assessment of executive functions as well as neurological and psychiatric diseases in the future.

Effects of environmental support on overt and covert visuospatial rehearsal

People can rehearse to-be-remembered locations either overtly, using eye movements, or covertly, using only shifts of spatial attention. The present study examined whether the effectiveness of these two strategies depends on environmental support for rehearsal. In Experiment 1, when environmental support (i.e., the array of possible locations) was present and participants could engage in overt rehearsal during retention intervals, longer intervals resulted in larger spans, whereas in Experiment 2, when support was present but participants could only engage in covert rehearsal, longer intervals resulted in smaller spans. When environmental support was absent, however, longer retention intervals resulted in smaller memory spans regardless of which rehearsal strategies were available. In Experiment 3, analyses of participants' eye movements revealed that the presence of support increased participants' fixations of to-be-remembered target locations more than fixations of non-targets, and that this was associated with better memory performance. Further, although the total time fixating targets increased, individual target fixations were actually briefer. Taken together, the present findings suggest that in the presence of environmental support, overt rehearsal is more effective than covert rehearsal at maintaining to-be-remembered locations in working memory, and that having more time for overt rehearsal can actually increase visuospatial memory spans.

The effect of offset cues on saccade programming and covert attention

Salient peripheral events trigger fast, “exogenous” covert orienting. The influential premotor theory of attention argues that covert orienting of attention depends upon planned but unexecuted eye-movements. One problem with this theory is that salient peripheral events, such as offsets, appear to summon attention when used to measure covert attention (e.g., the Posner cueing task) but appear not to elicit oculomotor preparation in tasks that require overt orienting (e.g., the remote distractor paradigm). Here, we examined the effects of peripheral offsets on covert attention and saccade preparation. Experiment 1 suggested that transient offsets summoned attention in a manual detection task without triggering motor preparation planning in a saccadic localisation task, although there were a high proportion of saccadic capture errors on “no-target” trials, where a cue was presented but no target appeared. In Experiment 2, “no-target” trials were removed. Here, transient offsets produced both attentional facilitation and faster saccadic responses on valid cue trials. A third experiment showed that the permanent disappearance of an object also elicited attentional facilitation and faster saccadic reaction times. These experiments demonstrate that offsets trigger both saccade programming and covert attentional orienting, consistent with the idea that exogenous, covert orienting is tightly coupled with oculomotor activation. The finding that no-go trials attenuates oculomotor priming effects offers a way to reconcile the current findings with previous claims of a dissociation between covert attention and oculomotor control in paradigms that utilise a high proportion of catch trials.

Working memory for self-initiated and provided spatial configurations

During a typical day, people temporarily memorise information provided to them. However, they memorise as often information they actively choose themselves. Although prevalent in everyday behaviour, this aspect of working memory (WM), we term self-initiated WM, has been largely unexplored. In this study, we used a modified spatial span task in which participants constructed the spatial sequences they maintained in memory. The results of three experiments demonstrated that participants planned and constructed structured spatial sequences by minimising the distances between successive locations and by selecting sequences with fewer path crossings. The sequences were initiated most often on the top left side. Memory accuracy was enhanced when participants memorised self-initiated spatial sequences, even when the self-initiated and provided sequences were matched for structure. When asked to construct spatial sequences for a hypothetical competitor in a memory contest, participants constructed complex sequences with longer paths and more path crossings, suggesting that these sequence parameters were under their control. The tendency to initiate the spatial sequences on the top left side remained. Overall, the results suggest that self-initiated WM can benefit from explicit metacognitive knowledge of the ideal structure of memory representations and also demonstrate that self-initiation benefits memory beyond structure.

The Role of the Oculomotor System in Updating Visual-Spatial Working Memory across Saccades

Visual-spatial working memory (VSWM) helps us to maintain and manipulate visual information in the absence of sensory input. It has been proposed that VSWM is an emergent property of the oculomotor system. In the present study we investigated the role of the oculomotor system in updating of spatial working memory representations across saccades. Participants had to maintain a location in memory while making a saccade to a different location. During the saccade the target was displaced, which went unnoticed by the participants. After executing the saccade, participants had to indicate the memorized location. If memory updating fully relies on cancellation driven by extraretinal oculomotor signals, the displacement should have no effect on the perceived location of the memorized stimulus. However, if postsaccadic retinal information about the location of the saccade target is used, the perceived location will be shifted according to the target displacement. As it has been suggested that maintenance of accurate spatial representations across saccades is especially important for action control, we used different ways of reporting the location held in memory; a match-to-sample task, a mouse click or by making another saccade. The results showed a small systematic target displacement bias in all response modalities. Parametric manipulation of the distance between the to-be-memorized stimulus and saccade target revealed that target displacement bias increased over time and changed its spatial profile from being initially centered on locations around the saccade target to becoming spatially global. Taken together results suggest that we neither rely exclusively on extraretinal nor on retinal information in updating working memory representations across saccades. The relative contribution of retinal signals is not fixed but depends on both the time available to integrate these signals as well as the distance between the saccade target and the remembered location.

Working memory training involves learning new skills

We present a new framework characterizing training-induced changes in WM as the acquisition of novel cognitive routines akin to learning a new skill. Predictions were tested in three studies analyzing the transfer between WM tasks following WM training. Study 1 reports a meta-analysis establishing substantial transfer when trained and untrained tasks shared either a serial recall, complex span or backward span paradigm. Transfer was weaker for serial recall of verbal than visuo-spatial material, suggesting that this paradigm is served by an existing verbal STM system and does not require a new routine. Re-analysis of published WM training data in Study 2 showed that transfer was restricted to tasks sharing properties proposed to require new routines. In a re-analysis of data from four studies, Study 3 demonstrated that transfer was greatest for children with higher fluid cognitive abilities. These findings suggest that development of new routines depends on general cognitive resources and that they can only be applied to other similarly-structured tasks.

Rewards modulate saccade latency but not exogenous spatial attention

The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.