1
|
Heeman J, White BJ, Van der Stigchel S, Theeuwes J, Itti L, Munoz DP. Saliency Response in Superior Colliculus at the Future Saccade Goal Predicts Fixation Duration during Free Viewing of Dynamic Scenes. J Neurosci 2025; 45:e0428242024. [PMID: 39572235 PMCID: PMC11735649 DOI: 10.1523/jneurosci.0428-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 08/09/2024] [Accepted: 10/29/2024] [Indexed: 01/18/2025] Open
Abstract
Eye movements in daily life occur in rapid succession and often without a predefined goal. Using a free viewing task, we examined how fixation duration prior to a saccade correlates to visual saliency and neuronal activity in the superior colliculus (SC) at the saccade goal. Rhesus monkeys (three male) watched videos of natural, dynamic, scenes while eye movements were tracked and, simultaneously, neurons were recorded in the superficial and intermediate layers of the superior colliculus (SCs and SCi, respectively), a midbrain structure closely associated with gaze, attention, and saliency coding. Saccades that were directed into the neuron's receptive field (RF) were extrapolated from the data. To interpret the complex visual input, saliency at the RF location was computed during the pre-saccadic fixation period using a computational saliency model. We analyzed if visual saliency and neural activity at the saccade goal predicted pre-saccadic fixation duration. We report three major findings: (1) Saliency at the saccade goal inversely correlated with fixation duration, with motion and edge information being the strongest predictors. (2) SC visual saliency responses in both SCs and SCi were inversely related to fixation duration. (3) SCs neurons, and not SCi neurons, showed higher activation for two consecutive short fixations, suggestive of concurrent saccade processing during free viewing. These results reveal a close correspondence between visual saliency, SC processing, and the timing of saccade initiation during free viewing and are discussed in relation to their implication for understanding saccade initiation during real-world gaze behavior.
Collapse
Affiliation(s)
- Jessica Heeman
- Faculty of Social and Behavioral Sciences, Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht 3584, the Netherlands
- Institute Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Brian J White
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario K7L 3N6, Canada
| | - Stefan Van der Stigchel
- Faculty of Social and Behavioral Sciences, Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht 3584, the Netherlands
| | - Jan Theeuwes
- Institute Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Laurent Itti
- Department of Computer Science, University of Southern California, Los Angeles, California 90089-2520
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario K7L 3N6, Canada
| |
Collapse
|
2
|
Vasudevan V, Murthy A, Padhi R. Modeling kinematic variability reveals displacement and velocity based dual control of saccadic eye movements. Exp Brain Res 2024; 242:2159-2176. [PMID: 38980340 DOI: 10.1007/s00221-024-06870-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 06/01/2024] [Indexed: 07/10/2024]
Abstract
Noise is a ubiquitous component of motor systems that leads to behavioral variability of all types of movements. Nonetheless, systems-based models investigating human movements are generally deterministic and explain only the central tendencies like mean trajectories. In this paper, a novel approach to modeling kinematic variability of movements is presented and tested on the oculomotor system. This approach reconciles the two prominent philosophies of saccade control: displacement-based control versus velocity-based control. This was achieved by quantifying the variability in saccadic eye movements and developing a stochastic model of its control. The proposed stochastic dual model generated significantly better fits of inter-trial variances of the saccade trajectories compared to existing models. These results suggest that the saccadic system can flexibly use the information of both desired displacement and velocity for its control. This study presents a potential framework for investigating computational principles of motor control in the presence of noise utilizing stochastic modeling of kinematic variability.
Collapse
Affiliation(s)
- Varsha Vasudevan
- Department of Bioengineering, Indian Institute of Science, Bangalore, 560012, India.
| | - Aditya Murthy
- Department of Bioengineering, Indian Institute of Science, Bangalore, 560012, India
- Centre for Neuroscience, Indian Institute of Science, Bangalore, 560012, India
| | - Radhakant Padhi
- Department of Bioengineering, Indian Institute of Science, Bangalore, 560012, India
- Department of Aerospace Engineering, Indian Institute of Science, Bangalore, 560012, India
| |
Collapse
|
3
|
Heeman J, Theeuwes J, Van der Stigchel S. The adaptive global effect: Luminance contrast modulates the global effect zone. Vision Res 2024; 222:108454. [PMID: 38986179 DOI: 10.1016/j.visres.2024.108454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 06/10/2024] [Accepted: 06/19/2024] [Indexed: 07/12/2024]
Abstract
When two peripheral objects are presented in close proximity, saccades towards one of these objects land at a weighted average location between the two objects. This phenomenon, known as the 'global effect' or 'saccade averaging', disappears when the distance between the objects increases. When objects are further apart, outside the averaging zone, saccades land on one of the objects with little or no saccade averaging. Although it is known that the strength of the global effect is dependent on the specific features of the two objects, it is unclear if the size of the zone in which averaging can occur (i.e., the averaging zone) is adaptive. The aim of the current study was to investigate whether the size of the averaging zone adapts to variations in object luminance contrast of the objects. In order to systematically assess changes in the averaging zone, in two experiments, observers made saccadic eye movements while the luminance of the target and the distractor varied. We report three major findings: 1) When a distractor was more luminant relative to the target, the averaging zone increased (Exp. 1). Notably, saccade averaging never entirely ceased to exist, even for remote distractors. 2) When target and distractor were equiluminant, the averaging zone did not change with absolute luminance (Exp. 2). 3) Higher (relative and absolute) luminance increased the averaging zone especially for shorter saccadic response times (SRT). We conclude that the averaging zone is adaptive and becomes larger with increasing relative luminance and especially when SRTs are short.
Collapse
Affiliation(s)
- Jessica Heeman
- Faculty of Social and Behavioral Sciences, Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands; Faculty of Behavioral and Movement Sciences, Department of Cognitive Psychology, Vrije Universiteit, Amsterdam, The Netherlands.
| | - Jan Theeuwes
- Faculty of Behavioral and Movement Sciences, Department of Cognitive Psychology, Vrije Universiteit, Amsterdam, The Netherlands
| | - Stefan Van der Stigchel
- Faculty of Social and Behavioral Sciences, Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
4
|
van Moorselaar D, Theeuwes J. Spatial transfer of object-based statistical learning. Atten Percept Psychophys 2024; 86:768-775. [PMID: 38316722 PMCID: PMC11063099 DOI: 10.3758/s13414-024-02852-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/23/2024] [Indexed: 02/07/2024]
Abstract
A large number of recent studies have demonstrated that efficient attentional selection depends to a large extent on the ability to extract regularities present in the environment. Through statistical learning, attentional selection is facilitated by directing attention to locations in space that were relevant in the past while suppressing locations that previously were distracting. The current study shows that we are not only able to learn to prioritize locations in space but also locations within objects independent of space. Participants learned that within a specific object, particular locations within the object were more likely to contain relevant information than other locations. The current results show that this learned prioritization was bound to the object as the learned bias to prioritize a specific location within the object stayed in place even when the object moved to a completely different location in space. We conclude that in addition to spatial attention prioritization of locations in space, it is also possible to learn to prioritize relevant locations within specific objects. The current findings have implications for the inferred spatial priority map of attentional weights as this map cannot be strictly retinotopically organized.
Collapse
Affiliation(s)
- Dirk van Moorselaar
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
- Institute of Brain and Behaviour Amsterdam (iBBA), Amsterdam, the Netherlands.
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
- Institute of Brain and Behaviour Amsterdam (iBBA), Amsterdam, the Netherlands
- William James Centre for Research, ISPA-Instituto Universitario, Lisbon, Portugal
| |
Collapse
|
5
|
Abstract
Research has recently shown that efficient selection relies on the implicit extraction of environmental regularities, known as statistical learning. Although this has been demonstrated for scenes, similar learning arguably also occurs for objects. To test this, we developed a paradigm that allowed us to track attentional priority at specific object locations irrespective of the object's orientation in three experiments with young adults (all Ns = 80). Experiments 1a and 1b established within-object statistical learning by demonstrating increased attentional priority at relevant object parts (e.g., hammerhead). Experiment 2 extended this finding by demonstrating that learned priority generalized to viewpoints in which learning never took place. Together, these findings demonstrate that as a function of statistical learning, the visual system not only is able to tune attention relative to specific locations in space but also can develop preferential biases for specific parts of an object independently of the viewpoint of that object.
Collapse
Affiliation(s)
- Dirk van Moorselaar
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam.,Institute of Brain and Behaviour Amsterdam (iBBA), The Netherlands
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam.,Institute of Brain and Behaviour Amsterdam (iBBA), The Netherlands.,William James Center for Research, ISPA-Instituto Universitario
| |
Collapse
|
6
|
Abstract
The present study used perceptual sensitivity (d′) to determine the spatial distribution of attention in displays in which participants have learned to suppress a location that is most likely to contain a distractor. Participants had to indicate whether a horizontal or a vertical line, which was shown only briefly before it was masked, was present within a target shape. Critically, the target shape could be accompanied by a singleton distractor color, which when present appeared with a high probability at one display location. The results show that perceptual sensitivity was reduced for locations likely to contain a distractor, as d′ was lower for this location than for all other locations in the display. We also found that the presence of an irrelevant color singleton reduced the gain for input at the target location, particularly when the irrelevant singleton was close to the target singleton. We conclude that, through the repeated encounter with a distractor at a particular location, the weights within the attentional priority map are changed such that the perceptual sensitivity for objects presented at that location is reduced relative to all other locations. This reduction of perceptual sensitivity signifies that this location competes less for attention than all other locations.
Collapse
Affiliation(s)
- Dirk van Moorselaar
- Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, the Netherlands.,Institute of Brain and Behaviour, Amsterdam, the Netherlands.,
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, the Netherlands.,Institute of Brain and Behaviour, Amsterdam, the Netherlands.,
| |
Collapse
|
7
|
Tokushige SI, Matsuda S, Inomata-Terada S, Hamada M, Ugawa Y, Tsuji S, Terao Y. Premature saccades: A detailed physiological analysis. Clin Neurophysiol 2020; 132:63-76. [PMID: 33254099 DOI: 10.1016/j.clinph.2020.09.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 08/04/2020] [Accepted: 09/07/2020] [Indexed: 10/23/2022]
Abstract
OBJECTIVE Premature saccades (PSs) are those made with latencies too short for the direction and amplitude to be specifically programmed. We sought to determine the minimum latency needed to establish accurate direction and amplitude, and observed what occurs when saccades are launched before this minimum latency. METHODS In Experiment 1, 249 normal subjects performed the gap saccade task with horizontal targets. In Experiment 2, 28 normal subjects performed the gap saccade task with the targets placed in eight directions. In Experiment 3, 38 normal subjects, 49 patients with Parkinson's disease (PD), and 10 patients with spinocerebellar degeneration (SCD) performed the gap saccade task with horizontal targets. RESULTS In Experiment 1, it took 100 ms to accurately establish saccade amplitudes and directions. In Experiment 2, however, the latencies needed for accurate amplitude and direction establishment were both approximately 150 ms. In Experiment 3, the frequencies of PSs in patients with PD and SCD were lower than those of normal subjects. CONCLUSIONS The saccade amplitudes and directions are determined simultaneously, 100-150 ms after target presentation. PSs may result from prediction of the oncoming target direction or latent saccade activities in the superior colliculus. SIGNIFICANCE Saccade direction and amplitude are determined simultaneously.
Collapse
Affiliation(s)
- Shin-Ichi Tokushige
- Department of Neurology, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan; Department of Neurology, School of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka, Tokyo 181-8611, Japan
| | - Shunichi Matsuda
- Department of Neurology, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan; Department of Neurology, NTT Medical Center Tokyo, 5-9-22, Higashigotanda, Shinagawa-ku, Tokyo 141-0022, Japan
| | - Satomi Inomata-Terada
- Department of Neurology, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan; Department of Medical Physiology, School of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka, Tokyo 181-8611, Japan
| | - Masashi Hamada
- Department of Neurology, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan
| | - Yoshikazu Ugawa
- Department of NeuroRegeneration, Fukushima Medical University, 1 Hikarigaoka, Fukushima 960-1295, Japan
| | - Shoji Tsuji
- Department of Molecular Neurology, The University of Tokyo and International University of Health and Welfare, 4-3, Kozunomori, Narita-shi, Chiba-ken 286-8686, Japan
| | - Yasuo Terao
- Department of Neurology, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan; Department of Medical Physiology, School of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka, Tokyo 181-8611, Japan.
| |
Collapse
|