On the role of extraretinal signals for saccade generation

Spatiotopic and retinotopic memory in the context of natural images

Neural responses throughout the visual cortex encode stimulus location in a retinotopic (i.e., eye-centered) reference frame, and memory for stimulus position is most precise in retinal coordinates. Yet visual perception is spatiotopic: objects are perceived as stationary, even though eye movements cause frequent displacement of their location on the retina. Previous studies found that, after a single saccade, memory of retinotopic locations is more accurate than memory of spatiotopic locations. However, it is not known whether various aspects of natural viewing affect the retinotopic reference frame advantage. We found that the retinotopic advantage may in part depend on a retinal afterimage, which can be effectively nullified through backwards masking. Moreover, in the presence of natural scenes, spatiotopic memory is more accurate than retinotopic memory, but only when subjects are provided sufficient time to process the scene before the eye movement. Our results demonstrate that retinotopic memory is not always more accurate than spatiotopic memory and that the fidelity of memory traces in both reference frames are sensitive to the presence of contextual cues.

Use of exocentric and egocentric representations in the concurrent planning of sequential saccades

The concurrent planning of sequential saccades offers a simple model to study the nature of visuomotor transformations since the second saccade vector needs to be remapped to foveate the second target following the first saccade. Remapping is thought to occur through egocentric mechanisms involving an efference copy of the first saccade that is available around the time of its onset. In contrast, an exocentric representation of the second target relative to the first target, if available, can be used to directly code the second saccade vector. While human volunteers performed a modified double-step task, we examined the role of exocentric encoding in concurrent saccade planning by shifting the first target location well before the efference copy could be used by the oculomotor system. The impact of the first target shift on concurrent processing was tested by examining the end-points of second saccades following a shift of the second target during the first saccade. The frequency of second saccades to the old versus new location of the second target, as well as the propagation of first saccade localization errors, both indices of concurrent processing, were found to be significantly reduced in trials with the first target shift compared to those without it. A similar decrease in concurrent processing was obtained when we shifted the first target but kept constant the second saccade vector. Overall, these results suggest that the brain can use relatively stable visual landmarks, independent of efference copy-based egocentric mechanisms, for concurrent planning of sequential saccades.

Optimal multimodal integration in spatial localization

Saccadic eye movements facilitate rapid and efficient exploration of visual scenes, but also pose serious challenges to establishing reliable spatial representations. This process presumably depends on extraretinal information about eye position, but it is still unclear whether afferent or efferent signals are implicated and how these signals are combined with the visual input. Using a novel gaze-contingent search paradigm with highly controlled retinal stimulation, we examined the performance of human observers in locating a previously fixated target after a variable number of saccades, a task that generates contrasting predictions for different updating mechanisms. We show that while localization accuracy is unaffected by saccades, localization precision deteriorates nonlinearly, revealing a statistically optimal combination of retinal and extraretinal signals. These results provide direct evidence for optimal multimodal integration in the updating of spatial representations and elucidate the contributions of corollary discharge signals and eye proprioception.

End-point variability is not noise in saccade adaptation

When each of many saccades is made to overshoot its target, amplitude gradually decreases in a form of motor learning called saccade adaptation. Overshoot is induced experimentally by a secondary, backwards intrasaccadic target step (ISS) triggered by the primary saccade. Surprisingly, however, no study has compared the effectiveness of different sizes of ISS in driving adaptation by systematically varying ISS amplitude across different sessions. Additionally, very few studies have examined the feasibility of adaptation with relatively small ISSs. In order to best understand saccade adaptation at a fundamental level, we addressed these two points in an experiment using a range of small, fixed ISS values (from 0° to 1° after a 10° primary target step). We found that significant adaptation occurred across subjects with an ISS as small as 0.25°. Interestingly, though only adaptation in response to 0.25° ISSs appeared to be complete (the magnitude of change in saccade amplitude was comparable to size of the ISS), further analysis revealed that a comparable proportion of the ISS was compensated for across conditions. Finally, we found that ISS size alone was sufficient to explain the magnitude of adaptation we observed; additional factors did not significantly improve explanatory power. Overall, our findings suggest that current assumptions regarding the computation of saccadic error may need to be revisited.

The relative importance of retinal error and prediction in saccadic adaptation

When saccades systematically miss their visual target, their amplitude adjusts, causing the position errors to be progressively reduced. Conventionally, this adaptation is viewed as driven by retinal error (the distance between primary saccade endpoint and visual target). Recent work suggests that the oculomotor system is informed about where the eye lands; thus not all "retinal error" is unexpected. The present study compared two error signals that may drive saccade adaptation: retinal error and prediction error (the difference between predicted and actual postsaccadic images). Subjects made saccades to a visual target in two successive sessions. In the first session, the target was extinguished during saccade execution if the amplitude was smaller (or, in other experiments, greater) than the running median, thereby modifying the average retinal error subjects experienced without moving the target during the saccade as in conventional adaptation paradigms. In the second session, targets were extinguished at the start of saccades and turned back on at a position that reproduced the trial-by-trial retinal error recorded in the first session. Despite the retinal error in the first and second sessions having been identical, adaptation was severalfold greater in the second session, when the predicted target position had been changed. These results argue that the eye knows where it lands and where it expects the target to be, and that deviations from this prediction drive saccade adaptation more strongly than retinal error alone.

Learning deferred imitation of long spatial sequences

Sequence learning has been the subject of research in various paradigms but has not been investigated for learning deferred imitation of long spatial sequences. In this task no guiding stimuli support the sequence reproduction and all sequence information has to be recalled from memory. We investigate this kind of imitation learning with a task in which a long sequence of spatial positions has to be reproduced without guiding stimuli, either by manual pointing or by ocular fixations. Sequences consisting of 20 positions were acquired after only 25 training trials. The persistence of learned sequences over several days showed that the sequence was retained in long-term memory. A transfer test revealed that the learned sequence was independent of the effector. A detailed analysis of the error distributions of pointing and ocular fixations was performed to characterize the guiding control signal. The independence of the variable position errors from the movement directions as well as the lack of error propagation between successive targets suggest that the reproduction in this learning task was guided by sequential positions rather than sequential displacements.

Eye movement sequence generation in humans: Motor or goal updating?

Saccadic eye movements are often grouped in pre-programmed sequences. The mechanism underlying the generation of each saccade in a sequence is currently poorly understood. Broadly speaking, two alternative schemes are possible: first, after each saccade the retinotopic location of the next target could be estimated, and an appropriate saccade could be generated. We call this the goal updating hypothesis. Alternatively, multiple motor plans could be pre-computed, and they could then be updated after each movement. We call this the motor updating hypothesis. We used McLaughlin's intra-saccadic step paradigm to artificially create a condition under which these two hypotheses make discriminable predictions. We found that in human subjects, when sequences of two saccades are planned, the motor updating hypothesis predicts the landing position of the second saccade in two-saccade sequences much better than the goal updating hypothesis. This finding suggests that the human saccadic system is capable of executing sequences of saccades to multiple targets by planning multiple motor commands, which are then updated by serial subtraction of ongoing motor output.

Amplitudes and directions of individual saccades can be adjusted by corollary discharge

There is strong evidence that the brain can use an internally generated copy of motor commands, a corollary discharge, to guide rapid sequential saccades. Much of this evidence comes from the double-step paradigm: after two briefly flashed visual targets have disappeared, the subject makes two sequential saccades to the targets. Recent studies on the monkey revealed that amplitude variations of the first saccade led to compensation by the second saccade, mediated by a corollary discharge. Here, we investigated whether such saccade-by-saccade compensation occurs in humans, and we made three new observations. First, we replicated previous findings from the monkey: following first saccade amplitude variations, the direction of the second saccade compensated for the error. Second, the change in direction of the second saccade followed variations in vertical as well as horizontal first saccades although the compensation following horizontal saccades was significantly more accurate. Third, by examining oblique saccades, we are able to show that first saccade variations are compensated by adjustment in saccade amplitude in addition to direction. Together, our results demonstrate that it is likely that a corollary discharge in humans can be used to adjust both saccade direction and amplitude following variations in individual saccades.

Optimal sensorimotor control in eye movement sequences

Fast and accurate motor behavior requires combining noisy and delayed sensory information with knowledge of self-generated body motion; much evidence indicates that humans do this in a near-optimal manner during arm movements. However, it is unclear whether this principle applies to eye movements. We measured the relative contributions of visual sensory feedback and the motor efference copy (and/or proprioceptive feedback) when humans perform two saccades in rapid succession, the first saccade to a visual target and the second to a memorized target. Unbeknownst to the subject, we introduced an artificial motor error by randomly "jumping" the visual target during the first saccade. The correction of the memory-guided saccade allowed us to measure the relative contributions of visual feedback and efferent copy (and/or proprioceptive feedback) to motor-plan updating. In a control experiment, we extinguished the target during the saccade rather than changing its location to measure the relative contribution of motor noise and target localization error to saccade variability without any visual feedback. The motor noise contribution increased with saccade amplitude, but remained <30% of the total variability. Subjects adjusted the gain of their visual feedback for different saccade amplitudes as a function of its reliability. Even during trials where subjects performed a corrective saccade to compensate for the target-jump, the correction by the visual feedback, while stronger, remained far below 100%. In all conditions, an optimal controller predicted the visual feedback gain well, suggesting that humans combine optimally their efferent copy and sensory feedback when performing eye movements.

Saccade sequences as markers for cerebral dysfunction following mild closed head injury

Diffuse axonal injury caused by mild closed head injury (CHI) is likely to affect the neural networks concerned with the planning and execution of sequences of memory-guided saccades. Thirty subjects with mild CHI and thirty controls were tested on 2- and 3-step sequences of memory-guided saccades. CHI subjects showed more directional errors, larger position errors, and hypermetria of primary saccades and final eye position. No deficits were seen in temporal accuracy (timing and rhythm). These results suggest that computerized tests of saccade sequences can provide sensitive markers of cerebral dysfunction after mild CHI.

Fixation errors and timing in sequences of memory-guided saccades

We analyzed the relation between position and amplitude errors during the performance of sequences of saccades to previously memorized target positions in complete darkness. Although a complete compensation (on the average) for fixation errors was observed, groups of successive saccades could be identified which showed propagation of position errors. These groups are characterized by a long fixation time prior to the first saccade and short fixations prior to the remaining saccades. These findings indicate that sequences of eye movements can be performed in two different modes: (1) extraretinal information about the actual eye position is used to correct fixation errors; (2) pre-programmed groups of saccades with limited length can be performed with fixed amplitudes neglecting the actual eye position. These groups tended to occur predominantly at the end of a sequence.

Memory-guided saccadic eye movements: effects of cerebellar disease

We compared the accuracy of oblique, memory-guided saccades if the eye is stationary or moves horizontally during the memory period. We studied 11 patients with cerebellar disease and 11 age-matched control subjects. Normal subjects showed similar accuracy of saccades for both conditions. In contrast, all patients showed greater errors if the eye moved horizontally during the memory period; however, errors of both vertical and horizontal components of memory-guided saccades were similar. Thus, inaccuracy of memory-guided saccades could not be simply attributed to failure to internally monitor change in horizontal gaze during the memory period. Instead, we propose that the greater saccadic errors which occurred when gaze changed during the memory period reflected a disruption of predictive mechanisms governing eye movements.