Intra-saccadic motion streaks as cues to linking object locations across saccades

Lawful kinematics link eye movements to the limits of high-speed perception

Perception requires active sampling of the environment. What part of the physical world can be perceived is limited by the sensory system's biophysical setup, but might be further constrained by the kinematic bounds of the motor actions used to acquire sensory information. Here, we tested this fundamental idea for humans' fastest and most frequent behavior-saccadic eye movements-which entail incidental sensory consequences (i.e., swift retinal motion) that rarely reach awareness in natural vision. Using high-speed video projection, we display rapidly moving stimuli that faithfully reproduce, or deviate from, saccades' lawful relation of velocity, duration, and amplitude. For each stimulus, observers perform perceptual tasks for which performance is contingent on consciously seeing the stimulus' motion trajectory. We uncover that visibility of the stimulus' movement is well predicted by the specific kinematics of saccades and their sensorimotor contingencies, reflecting even variability between individual observers. Computational modeling shows that spatiotemporal integration during early visual processing predicts this lawful relation in a tight range of biologically plausible parameters. These results suggest that the visual system takes into account motor kinematics when omitting an action's incidental sensory consequences, thereby preserving visual sensitivity to high-speed object motion.

Perisaccadic perceptual mislocalization strength depends on the visual appearance of saccade targets

We normally perceive a stable visual environment despite eye movements. To achieve such stability, visual processing integrates information across a given saccade, and laboratory hallmarks of such integration are robustly observed by presenting brief perisaccadic visual probes. In one classic phenomenon, probe locations are grossly mislocalized. This mislocalization is believed to depend, at least in part, on corollary discharge associated with saccade-related neuronal movement commands. However, we recently found that superior colliculus motor bursts, a known source of corollary discharge, can be different for different image appearances of the saccade target. Therefore, here we investigated whether perisaccadic mislocalization also depends on saccade target appearance. We asked human participants to generate saccades to either low (0.5 cycles/°) or high (5 cycles/°) spatial frequency gratings. We always placed a high-contrast target spot at grating center, to ensure matched saccades across image types. We presented a single, brief perisaccadic probe, which was high in contrast to avoid saccadic suppression, and the subjects pointed (via mouse cursor) at the seen probe location. We observed stronger perisaccadic mislocalization for low-spatial frequency saccade targets and for upper visual field probe locations. This was despite matched saccade metrics and kinematics across conditions, and it was also despite matched probe visibility for the different saccade target images (low vs. high spatial frequency). Assuming that perisaccadic visual mislocalization depends on corollary discharge, our results suggest that such discharge might relay more than just spatial saccade vectors to the visual system; saccade target visual features can also be transmitted.NEW & NOTEWORTHY Brief visual probes are grossly mislocalized when presented in the temporal vicinity of saccades. Although the mechanisms of such mislocalization are still under investigation, one component of them could derive from corollary discharge signals associated with saccade movement commands. Here, we were motivated by the observation that superior colliculus movement bursts, one source of corollary discharge, vary with saccade target image appearance. If so, then perisaccadic mislocalization should also do so, which we confirmed.

Dynamic saccade context triggers more stable object-location binding

Our visual systems rapidly perceive and integrate information about object identities and locations. There is long-standing debate about if and how we achieve world-centered (spatiotopic) object representations across eye movements, with many studies reporting persistent retinotopic (eye-centered) effects even for higher level object-location binding. But these studies are generally conducted in fairly static experimental contexts. Might spatiotopic object-location binding only emerge in more dynamic saccade contexts? In the present study, we investigated this using the spatial congruency bias paradigm in healthy adults. In the static (single-saccade) context, we found purely retinotopic binding, as before. However, robust spatiotopic binding emerged in the dynamic saccade context (multiple frequent saccades and saccades during stimulus presentation). We further isolated specific factors that modulate retinotopic and spatiotopic binding. Our results provide strong evidence that dynamic saccade context can trigger more stable object-location binding in ecologically relevant spatiotopic coordinates, perhaps via a more flexible brain state that accommodates improved visual stability in the dynamic world. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Peri-Saccadic Orientation Identification Performance and Visual Neural Sensitivity Are Higher in the Upper Visual Field

Visual neural processing is distributed among a multitude of sensory and sensory-motor brain areas exhibiting varying degrees of functional specializations and spatial representational anisotropies. Such diversity raises the question of how perceptual performance is determined, at any one moment in time, during natural active visual behavior. Here, exploiting a known dichotomy between the primary visual cortex (V1) and superior colliculus (SC) in representing either the upper or lower visual fields, we asked whether peri-saccadic orientation identification performance is dominated by one or the other spatial anisotropy. Humans (48 participants, 29 females) reported the orientation of peri-saccadic upper visual field stimuli significantly better than lower visual field stimuli, unlike their performance during steady-state gaze fixation, and contrary to expected perceptual superiority in the lower visual field in the absence of saccades. Consistent with this, peri-saccadic superior colliculus visual neural responses in two male rhesus macaque monkeys were also significantly stronger in the upper visual field than in the lower visual field. Thus, peri-saccadic orientation identification performance is more in line with oculomotor, rather than visual, map spatial anisotropies.SIGNIFICANCE STATEMENT Different brain areas respond to visual stimulation, but they differ in the degrees of functional specializations and spatial anisotropies that they exhibit. For example, the superior colliculus (SC) both responds to visual stimulation, like the primary visual cortex (V1), and controls oculomotor behavior. Compared with the primary visual cortex, the superior colliculus exhibits an opposite pattern of upper/lower visual field anisotropy, being more sensitive to the upper visual field. Here, we show that human peri-saccadic orientation identification performance is better in the upper compared with the lower visual field. Consistent with this, monkey superior colliculus visual neural responses to peri-saccadic stimuli follow a similar pattern. Our results indicate that peri-saccadic perceptual performance reflects oculomotor, rather than visual, map spatial anisotropies.

Gaze Control and Tactical Decision-Making Under Stress in Active-Duty Police Officers During a Live Use-of-Force Response

Police officers during dynamic and stressful encounters are required to make rapid decisions that rely on effective decision-making, experience, and intuition. Tactical decision-making is influenced by the officer's capability to recognize critical visual information and estimation of threat. The purpose of the current study is to investigate how visual search patterns using cluster analysis and factors that differentiate expertise (e.g., years of service, tactical training, related experiences) influence tactical decision-making in active-duty police officers (44 active-duty police officers) during high stress, high threat, realistic use of force scenario following a car accident and to examine the relationships between visual search patterns and physiological response (heart rate). A cluster analysis of visual search variables (fixation duration, fixation location difference score, and number of fixations) produced an Efficient Scan and an Inefficient Scan group. Specifically, the Efficient Scan group demonstrated longer total fixation duration and differences in area of interests (AOI) fixation duration compared to the Inefficient Scan group. Despite both groups exhibiting a rise in physiological stress response (HR) throughout the high-stress scenario, the Efficient Scan group had a history of tactical training, improved return fire performance, had higher sleep time total, and demonstrated increased processing efficiency and effective attentional control, due to having a background of increased tactical training.

Foveal vision anticipates defining features of eye movement targets

High-acuity foveal processing is vital for human vision. Nonetheless, little is known about how the preparation of large-scale rapid eye movements (saccades) affects visual sensitivity in the center of gaze. Based on findings from passive fixation tasks, we hypothesized that during saccade preparation, foveal processing anticipates soon-to-be fixated visual features. Using a dynamic large-field noise paradigm, we indeed demonstrate that defining features of an eye movement target are enhanced in the pre-saccadic center of gaze. Enhancement manifested as higher Hit Rates for foveal probes with target-congruent orientation and a sensitization to incidental, target-like orientation information in foveally presented noise. Enhancement was spatially confined to the center of gaze and its immediate vicinity, even after parafoveal task performance had been raised to a foveal level. Moreover, foveal enhancement during saccade preparation was more pronounced and developed faster than enhancement during passive fixation. Based on these findings, we suggest a crucial contribution of foveal processing to trans-saccadic visual continuity: Foveal processing of saccade targets commences before the movement is executed and thereby enables a seamless transition once the center of gaze reaches the target.

Saccade suppression of displacements, but not of contrast, depends on context

Saccades let the visual scene sweep with high speed across the retina, thus producing a massive motion stimulus. Yet, in natural vision, we never perceive motion that is produced by saccades. The absence of perisaccadic motion perception might be caused by a transient reduction of visual sensitivity at the time of saccade initiation, so-called saccadic suppression. Saccade suppression occurs for contrast, displacement, and motion stimuli. Saccade suppression of displacements has been shown to be context sensitive. After performing saccades in sessions without perisaccadic stimulation, saccade suppression magnitude is drastically decreased (Zimmermann, 2020). Here, we aimed to test whether saccade suppression of contrast is similarly modulated by context. To this end, we projected stimuli on a homogeneously white wall such that we could establish a ganzfeld-like environment that, depending on the experimental session, did or did not contain any visible contrast stimuli. We first successfully replicated the context sensitivity of saccade suppression of displacements. Then, we tested context sensitivity of contrast suppression by asking subjects to perform several saccades either across the uniform white wall or across a background consisting of a sinusoidal grating. In contrast to perisaccadic context sensitivity for displacement suppression, we did not find context sensitivity for suppression of contrast.

On the Spatiotemporal Nature of Vision, as Revealed by Covered Bridges and Puddles: A Dispatch from Vermont

Retinal painting, anorthoscopic perception and amodal completion are terms to describe visual phenomena that highlight the spatiotemporal integrative mechanisms that underlie primate vision. Although commonly studied using simplified lab-friendly stimuli presented on a computer screen, this is a report of observations made in a novel real-world context that highlight the rich contributions the mechanisms underlying these phenomena make to naturalistic vision.

Neural correlates of intra-saccadic motion perception

Retinal motion of the visual scene is not consciously perceived during ocular saccades in normal everyday conditions. It has been suggested that extra-retinal signals actively suppress intra-saccadic motion perception to preserve stable perception of the visual world. However, using stimuli optimized to preferentially activate the M-pathway, Castet and Masson (2000) demonstrated that motion can be perceived during a saccade. Based on this psychophysical paradigm, we used electroencephalography and eye-tracking recordings to investigate the neural correlates related to the conscious perception of intra-saccadic motion. We demonstrated the effective involvement during saccades of the cortical areas V1-V2 and MT-V5, which convey motion information along the M-pathway. We also showed that individual motion perception was related to retinal temporal frequency.

Moving fast and seeing slow? The visual consequences of vigorous movement

In active agents, sensory and motor processes form an inevitable bond. This wedding is particularly striking for saccadic eye movements - the prime target of Shadmehr and Ahmed's thesis - which impose frequent changes on the retinal image. Changes in movement vigor (latency and speed), therefore, will need to be accompanied by changes in visual and attentional processes. We argue that the mechanisms that control movement vigor may also enable vision to attune to changes in movement kinematics.

Fast and nonuniform dynamics of perisaccadic vision in the central fovea

Humans shift their gaze more frequently than their heart beats. These rapid eye movements (saccades) enable high visual acuity by redirecting the tiny high-resolution region of the retina (the foveola). But in doing so, they abruptly sweep the image across receptors, raising questions on how the visual system achieves stable percepts. It is well established that visual sensitivity is transiently attenuated during saccades. However, little is known about the time course of foveal vision despite its disproportionate importance, as technical challenges have so far prevented study of how saccades affect the foveola. Here we show that saccades modulate this region in a nonuniform manner, providing stronger and faster changes at its very center, a locus with higher sensitivity.

Humans use rapid eye movements (saccades) to inspect stimuli with the foveola, the region of the retina where receptors are most densely packed. It is well established that visual sensitivity is generally attenuated during these movements, a phenomenon known as saccadic suppression. This effect is commonly studied with large, often peripheral, stimuli presented during instructed saccades. However, little is known about how saccades modulate the foveola and how the resulting dynamics unfold during natural visual exploration. Here we measured the foveal dynamics of saccadic suppression in a naturalistic high-acuity task, a task designed after primates’ social grooming, which—like most explorations of fine patterns—primarily elicits minute saccades (microsaccades). Leveraging on recent advances in gaze-contingent display control, we were able to systematically map the perisaccadic time course of sensitivity across the foveola. We show that contrast sensitivity is not uniform across this region and that both the extent and dynamics of saccadic suppression vary within the foveola. Suppression is stronger and faster in the most central portion, where sensitivity is generally higher and selectively rebounds at the onset of a new fixation. These results shed light on the modulations experienced by foveal vision during the saccade-fixation cycle and explain some of the benefits of microsaccades.

A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception

Due to the close relationship between oculomotor behavior and visual processing, eye movements have been studied in many different areas of research over the last few decades. While these studies have brought interesting insights, specialization within each research area comes at the potential cost of a narrow and isolated view of the oculomotor system. In this review, we want to expand this perspective by looking at the interactions between the two most important types of voluntary eye movements: saccades and pursuit. Recent evidence indicates multiple interactions and shared signals at the behavioral and neurophysiological level for oculomotor control and for visual perception during pursuit and saccades. Oculomotor control seems to be based on shared position- and velocity-related information, which leads to multiple behavioral interactions and synergies. The distinction between position- and velocity-related information seems to be also present at the neurophysiological level. In addition, visual perception seems to be based on shared efferent signals about upcoming eye positions and velocities, which are to some degree independent of the actual oculomotor response. This review suggests an interactive perspective on the oculomotor system, based mainly on different types of sensory input, and less so on separate subsystems for saccadic or pursuit eye movements.

Intrasaccadic motion streaks jump-start gaze correction

Rapid eye movements (saccades) incessantly shift objects across the retina. To establish object correspondence, the visual system is thought to match surface features of objects across saccades. Here, we show that an object's intrasaccadic retinal trace-a signal previously considered unavailable to visual processing-facilitates this match making. Human observers made saccades to a cued target in a circular stimulus array. Using high-speed visual projection, we swiftly rotated this array during the eyes' flight, displaying continuous intrasaccadic target motion. Observers' saccades landed between the target and a distractor, prompting secondary saccades. Independently of the availability of object features, which we controlled tightly, target motion increased the rate and reduced the latency of gaze-correcting saccades to the initial presaccadic target, in particular when the target's stimulus features incidentally gave rise to efficient motion streaks. These results suggest that intrasaccadic visual information informs the establishment of object correspondence and jump-starts gaze correction.

Dependence of perceptual saccadic suppression on peri-saccadic image flow properties and luminance contrast polarity

Across saccades, perceptual detectability of brief visual stimuli is strongly diminished. We recently observed that this perceptual suppression phenomenon is jumpstarted in the retina, suggesting that the phenomenon might be significantly more visual in nature than normally acknowledged. Here, we explicitly compared saccadic suppression strength when saccades were made across a uniform image of constant luminance versus when saccades were made across image patches of different luminance, width, and trans-saccadic luminance polarity. We measured perceptual contrast thresholds of human subjects for brief peri-saccadic flashes of positive (luminance increments) or negative (luminance decrements) polarity. Thresholds were >6–7 times higher when saccades translated a luminance stripe or edge across the retina than when saccades were made over a completely uniform image patch. Critically, both background luminance and flash luminance polarity strongly modulated peri-saccadic contrast thresholds. In addition, all of these very same visual dependencies also occurred in the absence of any saccades, but with qualitatively similar rapid translations of image patches across the retina. This similarity of visual dependencies with and without saccades supports the notion that perceptual saccadic suppression may be fundamentally a visual phenomenon, which strongly motivates neurophysiological and theoretical investigations on the role of saccadic eye movement commands in modulating its properties.

Photophobia in migraine: A symptom cluster?

Photophobia is one of the most common symptoms in migraine, and the underlying mechanism is uncertain. The discovery of the intrinsically-photosensitive retinal ganglion cells which signal the intensity of light on the retina has led to discussion of their role in the pathogenesis of photophobia. In the current review, we discuss the relationship between pain and discomfort leading to light aversion (traditional photophobia) and discomfort from flicker, patterns, and colour that are also common in migraine and cannot be explained solely by the activity of intrinsically-photosensitive retinal ganglion cells. We argue that, at least in migraine, a cortical mechanism provides a parsimonious explanation for discomfort from all forms of visual stimulation, and that the traditional definition of photophobia as pain in response to light may be too restrictive. Future investigation that directly compares the retinal and cortical contributions to photophobia in migraine with that in other conditions may offer better specificity in identifying biomarkers and possible mechanisms to target for treatment.

Retinal error signals and fluctuations in eye velocity influence oculomotor behavior in subsequent trials

The oculomotor system makes use of an integration of previous stimulus velocities (the prior) and current sensory inputs to adjust initial eye speeds. The present study extended this research by investigating the roles of different retinal or extra-retinal signals for this process. To test for this, participants viewed movement sequences that all ended with the same test trial. Earlier in the sequence, the prior was manipulated by presenting targets that either had different velocities, different starting positions, or target movements designed to elicit differential oculomotor behavior (tracked with or without additional corrective saccades). Additionally, these prior targets could vary in terms of contrast to manipulate reliability. When the velocity of prior trials differed from test trials, the reliability-weighted integration of prior information was replicated. When the prior trials differed in starting position, significant effects on subsequent oculomotor behavior were only observed for the reliable target. Although there were also differences in eye velocity across the different manipulations, they could not explain the observed reliability-weighted integration. When comparing the same physical prior trials but tracked with additional corrective saccades, the eye velocity in the test trial also differed systematically (slower for forward saccades, and faster for backward saccades). The direction of the observed effect contradicts the expectations based on perceived speed and eye velocity, but can be predicted by a combination of retinal velocity and position error signals. Together, these results suggest that general fluctuations in eye velocity as well as retinal error signals are related to oculomotor behavior in subsequent trials.

Spatiotemporal Content of Saccade Transients

Humans use rapid gaze shifts, known as saccades, to explore visual scenes. These movements yield abrupt luminance changes on the retina, which elicit robust neural discharges at fixation onsets. Yet little is known about the spatial content of saccade transients. Here, we show that saccades redistribute spatial information within the temporal range of retinal sensitivity following two distinct regimes: saccade modulations counterbalance (whiten) the spectral density of natural scenes at low spatial frequencies and follow the external power distribution at higher frequencies. This redistribution is a consequence of saccade dynamics, particularly the speed/amplitude/duration relation known as the main sequence. It resembles the redistribution resulting from inter-saccadic eye drifts, revealing a continuum in the modulations given by different eye movements, with oculomotor transitions primarily acting by regulating the bandwidth of whitening. Our findings suggest important computational roles for saccade transients in the establishment of spatial representations and lead to testable predictions about their consequences for visual functions and encoding mechanisms.