Object-mediated overwriting across saccades

Transsaccadic perception of changes in object regularity

The visual system compensates for differences between peripheral and foveal vision using different mechanisms. Although peripheral vision is characterized by higher spatial uncertainty and lower resolution than foveal vision, observers reported objects to be less distorted and less blurry in the periphery than the fovea in a visual matching task during fixation (Valsecchi et al., 2018). Here, we asked whether a similar overcompensation could be found across saccadic eye movements and whether it would bias the detection of transsaccadic changes in object regularity. The blur and distortion levels of simple geometric shapes were manipulated in the Eidolons algorithm (Koenderink et al., 2017). In an appearance discrimination task, participants had to judge the appearance of blur (experiment 1) and distortion (experiment 2) separately before and after a saccade. Objects appeared less blurry before a saccade (in the periphery) than after a saccade (in the fovea). No differences were found in the appearance of distortion. In a change discrimination task, participants had to judge if blur (experiment 1) and distortion (experiment 2) either increased or decreased during a saccade. Overall, they showed a tendency to report an increase in both blur and distortion across saccades. The precision of the responses was improved by a 200-ms postsaccadic blank. Results from the change discrimination task of both experiments suggest that a transsaccadic decrease in regularity is more visible, compared to an increase in regularity. In line with the previous study that reported a peripheral overcompensation in the visual matching task, we found a similar mechanism, exhibiting a phenomenological sharpening of blurry edges before a saccade. These results generalize peripheral-foveal differences observed during fixation to the here tested dynamic, transsaccadic conditions where they contribute to biases in transsaccadic change detection.

Trans-retinal predictive signals of visual features are precise, saccade-specific and operate over a wide range of spatial frequencies

Saccadic eye movements successively project the saccade target on two retinal locations: a peripheral one before the saccade, and the fovea after the saccade. Typically, performance in discriminating stimulus features changes between these two projections is very poor. However, a short (∼200 ms) blanking of the target upon saccade onset drastically improves performance, demonstrating that a precise signal of the peripheral projection is retained during the saccade. Although little is known about the nature of that transsaccadic signal, previous reports conjectured that it relies on information processed by the magnocellular system. Across two experiments, we investigated the feature blanking effect for a wide range of spatial frequencies (0.5-8 cycles per degree of visual angle, dva), stimulus sizes (1-4 dva), and eccentricities (6-10 dva). In each trial, participants executed a saccade to a high-contrast grating presented either left or right of fixation. During the saccade, the grating changed orientation (clockwise or counter-clockwise) either instantaneously or after a 200-ms blank, and participants reported the change's direction. We contrasted this saccade condition with a trans-retinal fixation condition mimicking the peripheral-then-foveal sequence of the target stimulus occurring across a saccade. Remarkably, blanking improved performance reliably for each spatial frequency, stimulus size, and eccentricity, but only in the saccade condition. Performance with blanking in saccade trials systematically exceeded performance in the fixation condition. Our results demonstrate a robust feature blanking effect across saccades, suggesting that transsaccadic processes involve low-level visual features beyond those processed in the magnocellular system.NEW & NOTEWORTHY Across a saccadic eye movement, the visual system is able to keep track of the signals carrying the visual features of a saccade target. We provide evidence that these signals are sensitive to a wide range of stimulus sizes, can use a wide range spatial frequencies channels and, operate at various saccade amplitudes. Our results suggest an underlying mechanism operating beyond the magnocellular pathway that is contingent to saccade execution.

A bias in transsaccadic perception of spatial frequency changes

Visual processing differs between the foveal and peripheral visual field. These differences can lead to different appearances of objects in the periphery and the fovea, posing a challenge to perception across saccades. Differences in the appearance of visual features between the peripheral and foveal visual field may bias change discrimination across saccades. Previously it has been reported that spatial frequency (SF) appears higher in the periphery compared to the fovea (Davis et al., 1987). In this study, we investigated the visual appearance of SF before and after a saccade and the discrimination of SF changes during saccades. In addition, we tested the contributions of pre- and postsaccadic information to change discrimination performance. In the first experiment, we found no differences in the appearance of SF before and after a saccade. However, participants showed a clear bias to report SF increases. Interestingly, a 200-ms postsaccadic blank improved the precision of the responses but did not affect the bias. In the second experiment, participants showed lower thresholds for SF increases than for decreases, suggesting that the bias in the first experiment was not just a response bias. Finally, we asked participants to discriminate the SF of stimuli presented before a saccade. Thresholds in the presaccadic discrimination task were lower than in the change discrimination task, suggesting that transsaccadic change discrimination is not merely limited by presaccadic discrimination in the periphery. The change direction bias might stem from more effective masking or overwriting of the presaccadic stimulus by the postsaccadic low SF stimulus.

The role of color in transsaccadic object correspondence

With each saccade, visual information is disrupted, and the visual system is tasked with establishing object correspondence between the presaccadic and postsaccadic representations of the saccade target. There is substantial evidence that the visual system consults spatiotemporal continuity when determining object correspondence across saccades. The evidence for surface feature continuity, however, is mixed. Surface features that are integral to the saccade target object's identity (e.g., shape and contrast polarity) are informative of object continuity, but features that may only imply the state of the object (e.g., orientation) are ignored. The present study tested whether color information is consulted to determine transsaccadic object continuity. We used two variations of the intrasaccadic target displacement task. In Experiments 1 and 2, participants reported the direction of the target displacement. In Experiments 3 and 4, they instead reported whether they detected any target movement. In all experiments, we manipulated the saccade target's continuity by removing it briefly (i.e., blanking) and by changing its color. We found that large color changes can disrupt stability and increase sensitivity to displacements for both direction and movement reports, although not as strongly as long blank durations (250 ms). Interestingly, even smaller color changes, but not blanking, reduced response biases. These results indicate that disrupting surface feature continuity may impact the process of transsaccadic object correspondence more strongly than spatiotemporal disruptions by both increasing the sensitivity and decreasing the response bias.

Familiar objects benefit more from transsaccadic feature predictions

The transsaccadic feature prediction mechanism associates peripheral and foveal information belonging to the same object to make predictions about how an object seen in the periphery would appear in the fovea or vice versa. It is unclear if such transsaccadic predictions require experience with the object such that only familiar objects benefit from this mechanism by virtue of having peripheral-foveal associations. In two experiments, we tested whether familiar objects have an advantage over novel objects in peripheral-foveal matching and transsaccadic change detection tasks. In both experiments, observers were unknowingly familiarized with a small set of stimuli by completing a sham orientation change detection task. In the first experiment, observers subsequently performed a peripheral-foveal matching task, where they needed to pick the foveal test object that matched a briefly presented peripheral target. In the second experiment, observers subsequently performed a transsaccadic object change detection task where a peripheral target was exchanged or not exchanged with another target after the saccade, either immediately or after a 300-ms blank period. We found an advantage of familiar objects over novel objects in both experiments. While foveal-peripheral associations explained the familiarity effect in the matching task of the first experiment, the second experiment provided evidence for the advantage of peripheral-foveal associations in transsaccadic object change detection. Introducing a postsaccadic blank improved change detection performance in general but more for familiar than for novel objects. We conclude that familiar objects benefit from additional object-specific predictions.

Post-saccadic changes disrupt attended pre-saccadic object memory

Trans-saccadic memory consists of keeping track of objects’ locations and features across saccades; pre-saccadic information is remembered and compared with post-saccadic information. It has been shown to have limited resources and involve attention with respect to the selection of objects and features. In support, a previous study showed that recognition of distinct post-saccadic objects in the visual scene is impaired when pre-saccadic objects are relevant and thus already encoded in memory (Poth, Herwig, Schneider, 2015). Here, we investigated the inverse (i.e. how the memory of pre-saccadic objects is affected by abrupt but irrelevant changes in the post-saccadic visual scene). We also modulated the amount of attention to the relevant pre-saccadic object by having participants either make a saccade to it or elsewhere and observed that pre-saccadic attentional facilitation affected how much post-saccadic changes disrupted trans-saccadic memory of pre-saccadic objects.

Participants identified a flashed symbol (d, b, p, or q, among distracters), at one of six placeholders (figures “8”) arranged in circle around fixation while planning a saccade to one of them. They reported the identity of the symbol after the saccade. We changed the post-saccadic scene in Experiment one by removing the entire scene, only the placeholder where the pre-saccadic symbol was presented, or all other placeholders except this one. We observed reduced identification performance when only the saccade-target placeholder disappeared after the saccade. In Experiment two, we changed one placeholder location (inward/outward shift or rotation re. saccade vector) after the saccade and observed that identification performance decreased with increased shift/rotation of the saccade-target placeholder. We conclude that pre-saccadic memory is disrupted by abrupt attention-capturing post-saccadic changes of visual scene, particularly when these changes involve the object prioritized by being the goal of a saccade. These findings support the notion that limited trans-saccadic memory resources are disrupted when object correspondence at saccadic goal is broken through removal or location change.