1
|
Goktepe N, Schütz AC. Familiar objects benefit more from transsaccadic feature predictions. Atten Percept Psychophys 2023; 85:1949-1961. [PMID: 36720784 PMCID: PMC10545618 DOI: 10.3758/s13414-022-02651-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/20/2022] [Indexed: 02/02/2023]
Abstract
The transsaccadic feature prediction mechanism associates peripheral and foveal information belonging to the same object to make predictions about how an object seen in the periphery would appear in the fovea or vice versa. It is unclear if such transsaccadic predictions require experience with the object such that only familiar objects benefit from this mechanism by virtue of having peripheral-foveal associations. In two experiments, we tested whether familiar objects have an advantage over novel objects in peripheral-foveal matching and transsaccadic change detection tasks. In both experiments, observers were unknowingly familiarized with a small set of stimuli by completing a sham orientation change detection task. In the first experiment, observers subsequently performed a peripheral-foveal matching task, where they needed to pick the foveal test object that matched a briefly presented peripheral target. In the second experiment, observers subsequently performed a transsaccadic object change detection task where a peripheral target was exchanged or not exchanged with another target after the saccade, either immediately or after a 300-ms blank period. We found an advantage of familiar objects over novel objects in both experiments. While foveal-peripheral associations explained the familiarity effect in the matching task of the first experiment, the second experiment provided evidence for the advantage of peripheral-foveal associations in transsaccadic object change detection. Introducing a postsaccadic blank improved change detection performance in general but more for familiar than for novel objects. We conclude that familiar objects benefit from additional object-specific predictions.
Collapse
Affiliation(s)
- Nedim Goktepe
- AG Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.
| | - Alexander C Schütz
- AG Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany
- Center for Mind, Brain and Behavior, Philipps-Universität Marburg, Marburg, Germany
| |
Collapse
|
2
|
Osterbrink C, Herwig A. What determines location specificity or generalization of transsaccadic learning? J Vis 2023; 23:8. [PMID: 36648417 PMCID: PMC9851281 DOI: 10.1167/jov.23.1.8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023] Open
Abstract
Humans incorporate knowledge of transsaccadic associations into peripheral object perception. Several studies have shown that learning of new manipulated transsaccadic associations leads to a presaccadic perceptual bias. However, there was still disagreement whether this learning effect was location specific (Herwig, Weiß, & Schneider, 2018) or generalizes to new locations (Valsecchi & Gegenfurtner, 2016). The current study investigated under what conditions location generalization of transsaccadic learning occurs. In all experiments, there were acquisition phases in which the spatial frequency (Experiment 1) or the size (Experiment 2 and 3) of objects was changed transsaccadically. In the test phases, participants judged the respective feature of peripheral objects. These could appear either at the location where learning had taken place or at new locations. All experiments replicated the perceptual bias effect at the old learning locations. In two experiments, transsaccadic learning remained location specific even when learning occurred at multiple locations (Experiment 1) or with the feature of size (Experiment 2) for which a transfer had previously been shown. Only in Experiment 3 was a transfer of the learning effect to new locations observable. Here, learning only took place for one object and not for several objects that had to be discriminated. Therefore, one can conclude that, when specific associations are learned for multiple objects, transsaccadic learning stays location specific and when a transsaccadic association is learned for only one object it allows a generalization to other locations.
Collapse
Affiliation(s)
- Corinna Osterbrink
- Department of Psychology and Cluster of Excellence Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany.,
| | - Arvid Herwig
- Department of Psychology, Bielefeld University, Bielefeld, Germany.,
| |
Collapse
|
3
|
Bosco A, Sanz Diez P, Filippini M, Fattori P. The influence of action on perception spans different effectors. Front Syst Neurosci 2023; 17:1145643. [PMID: 37205054 PMCID: PMC10185787 DOI: 10.3389/fnsys.2023.1145643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Accepted: 04/10/2023] [Indexed: 05/21/2023] Open
Abstract
Perception and action are fundamental processes that characterize our life and our possibility to modify the world around us. Several pieces of evidence have shown an intimate and reciprocal interaction between perception and action, leading us to believe that these processes rely on a common set of representations. The present review focuses on one particular aspect of this interaction: the influence of action on perception from a motor effector perspective during two phases, action planning and the phase following execution of the action. The movements performed by eyes, hands, and legs have a different impact on object and space perception; studies that use different approaches and paradigms have formed an interesting general picture that demonstrates the existence of an action effect on perception, before as well as after its execution. Although the mechanisms of this effect are still being debated, different studies have demonstrated that most of the time this effect pragmatically shapes and primes perception of relevant features of the object or environment which calls for action; at other times it improves our perception through motor experience and learning. Finally, a future perspective is provided, in which we suggest that these mechanisms can be exploited to increase trust in artificial intelligence systems that are able to interact with humans.
Collapse
Affiliation(s)
- Annalisa Bosco
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
- Alma Mater Research Institute for Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Bologna, Italy
- *Correspondence: Annalisa Bosco
| | - Pablo Sanz Diez
- Carl Zeiss Vision International GmbH, Aalen, Germany
- Institute for Ophthalmic Research, Eberhard Karls University Tüebingen, Tüebingen, Germany
| | - Matteo Filippini
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Patrizia Fattori
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
- Alma Mater Research Institute for Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Bologna, Italy
| |
Collapse
|
4
|
Heins F, Lappe M. Mislocalization after inhibition of saccadic adaptation. J Vis 2022; 22:3. [PMID: 35834378 PMCID: PMC9290319 DOI: 10.1167/jov.22.8.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Saccadic eye movements are often imprecise and result in an error between expected and actual retinal target location after the saccade. Repeated experience of this error produces changes in saccade amplitude to reduce the error and concomitant changes in apparent visual location. We investigated the relationship between these two plastic processes in a series of experiments. Following a recent paradigm of inhibition of saccadic adaptation, in which participants are instructed to look at the initial target position and to continue to look at that position even if the target were to move again, our participants nevertheless perceived a visual probe presented near the saccade target to be shifted in direction of the target error. The location percept of the target gradually shifted and diverged over time from the executed saccade. Our findings indicate that changes in perceived location can be the same even when changes in saccade amplitude differ according to instruction and can develop even when the amplitude of the saccades executed during the adaptation procedure does not change. There are two possible explanations for this divergence between the adaptation states of saccade amplitude and perceived location. Either the intrasaccadic target step might trigger updating of the association between pre- and post-saccadic target positions, causing the localization shift, or the saccade motor command adjusts together with the perceived location at a common adaptation site, downstream from which voluntary control is exerted upon the executed eye movement only.
Collapse
Affiliation(s)
- Frauke Heins
- Institute for Psychology and Otto-Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Muenster, Germany.,
| | - Markus Lappe
- Institute for Psychology and Otto-Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Muenster, Germany.,
| |
Collapse
|
5
|
Hübner C, Schütz AC. A bias in saccadic suppression of shape change. Vision Res 2021; 186:112-123. [PMID: 34089922 PMCID: PMC7611036 DOI: 10.1016/j.visres.2021.05.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Revised: 04/21/2021] [Accepted: 05/10/2021] [Indexed: 11/27/2022]
Abstract
Processing of visual information in the central (foveal) and peripheral visual field is vastly different. To achieve a homogeneous representation of the visual world across eye movements, the visual system needs to compensate for these differences. By introducing subtle changes between peripheral and foveal inputs across saccades, one can test this compensation. We morphed shapes between a triangle and a circle and presented two different change directions (circularity decrease or increase) at varying magnitudes across a saccade. In a change-discrimination task, observers disproportionally often reported percepts of circularity increase. To test the relationship with visual-field differences, we measured perception when shapes were exclusively presented either in the periphery (before a saccade), or in the fovea (after a saccade). We found that overall shapes were perceived as more circular before than after a saccade and the more pronounced this difference was for a participant, the smaller was their circularity-increase bias in the change-discrimination task. We propose that visual-field differences have a direct and an indirect influence on transsaccadic perception of shape change. The direct influence is based on the distinct appearance of shape in the central and peripheral visual field in a trial, causing an increase of the perceptual magnitude of circularity-decrease changes. The indirect influence is based on long-term build-up of transsaccadic expectations; if a change is opposite (circularity increase) to the expectation (circularity decrease), it should elicit a strong error signal facilitating change detection. We discuss the concept of transsaccadic expectations and theoretical implications for transsaccadic perception of other feature changes.
Collapse
Affiliation(s)
- Carolin Hübner
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.
| | - Alexander C Schütz
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany; Center for Mind, Brain and Behaviour, Philipps-Universität Marburg, Marburg, Germany
| |
Collapse
|
6
|
Abstract
Visual processing varies dramatically across the visual field. These differences start in the retina and continue all the way to the visual cortex. Despite these differences in processing, the perceptual experience of humans is remarkably stable and continuous across the visual field. Research in the last decade has shown that processing in peripheral and foveal vision is not independent, but is more directly connected than previously thought. We address three core questions on how peripheral and foveal vision interact, and review recent findings on potentially related phenomena that could provide answers to these questions. First, how is the processing of peripheral and foveal signals related during fixation? Peripheral signals seem to be processed in foveal retinotopic areas to facilitate peripheral object recognition, and foveal information seems to be extrapolated toward the periphery to generate a homogeneous representation of the environment. Second, how are peripheral and foveal signals re-calibrated? Transsaccadic changes in object features lead to a reduction in the discrepancy between peripheral and foveal appearance. Third, how is peripheral and foveal information stitched together across saccades? Peripheral and foveal signals are integrated across saccadic eye movements to average percepts and to reduce uncertainty. Together, these findings illustrate that peripheral and foveal processing are closely connected, mastering the compromise between a large peripheral visual field and high resolution at the fovea.
Collapse
Affiliation(s)
- Emma E M Stewart
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,
| | - Matteo Valsecchi
- Dipartimento di Psicologia, Universitá di Bologna, Bologna, Italy.,
| | - Alexander C Schütz
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,Center for Mind, Brain and Behavior, Philipps-Universität Marburg, Marburg, Germany., https://www.uni-marburg.de/en/fb04/team-schuetz/team/alexander-schutz
| |
Collapse
|
7
|
Bosco A, Rifai K, Wahl S, Fattori P, Lappe M. Trans-saccadic adaptation of perceived size independent of saccadic adaptation. J Vis 2021; 20:19. [PMID: 32692824 PMCID: PMC7424105 DOI: 10.1167/jov.20.7.19] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Systematic shortening or lengthening of target objects during saccades modifies saccade amplitudes and perceived size of the objects. These two events are concomitant when size change during the saccade occurs asymmetrically, thereby shifting the center of mass of the object. In the present study, we asked whether or not the two are necessarily linked. We tested human participants in symmetrical systematic shortening and lengthening of a vertical bar during a horizontal saccade, aiming to not modify the saccade amplitude. Before and after a phase of trans-saccadic changes of the target bar, participants manually indicated the sizes of various vertically oriented bars by open-loop grip aperture. We evaluated the effect of trans-saccadic changes of bar length on manual perceptual reports and whether this change depended on saccade amplitude. As expected, we did not induce any change in horizontal or vertical components of saccade amplitude, but we found a significant difference in perceived size after the lengthening experiment compared to after the shortening experiment. Moreover, after the lengthening experiment, perceived size differed significantly from pre-lengthening baseline. These findings suggest that a change of size perception can be induced trans-saccadically, and its mechanism does not depend on saccadic amplitude change.
Collapse
|
8
|
Osterbrink C, Herwig A. Prediction of complex stimuli across saccades. J Vis 2021; 21:10. [PMID: 33620379 PMCID: PMC7910634 DOI: 10.1167/jov.21.2.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Accepted: 01/07/2021] [Indexed: 11/30/2022] Open
Abstract
The visual system can predict visual features across saccades based on learned transsaccadic associations between peripheral and foveal input. This has been shown for simple visual features such as shape, size, and spatial frequency. The present study investigated whether transsaccadic predictions are also made for more complex visual stimuli. In an acquisition phase, new transsaccadic associations were established. In the first experiment, pictures of real-world objects changed category during the saccade (fruits were changed into balls or vice versa). In the second experiment, the gender of faces was manipulated during the saccade (faces changed from male to female or vice versa). In the following test phase, the stimuli were briefly presented in the periphery, and participants had to indicate which object or face, respectively, they had perceived. In both experiments, peripheral perception was biased toward the acquired associated foveal input. These results demonstrate that transsaccadic predictions are not limited to a small set of simple visual features but can also be made for more complex and realistic stimuli. Multiple new associations can be learned within a short time frame, and the resulting predictions appear to be object specific.
Collapse
Affiliation(s)
- Corinna Osterbrink
- Department of Psychology and Cluster of Excellence Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| | - Arvid Herwig
- Department of Psychology, University of Bremen, Bremen, Germany
| |
Collapse
|
9
|
Valsecchi M, Cassanello C, Herwig A, Rolfs M, Gegenfurtner KR. A comparison of the temporal and spatial properties of trans-saccadic perceptual recalibration and saccadic adaptation. J Vis 2020; 20:2. [PMID: 32271892 PMCID: PMC7409593 DOI: 10.1167/jov.20.4.2] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
Repeated exposure to a consistent trans-saccadic step in the position of the saccadic target reliably produces a change of saccadic gain, a well-established trans-saccadic motor learning phenomenon known as saccadic adaptation. Trans-saccadic changes can also produce perceptual effects. Specifically, a systematic increase or decrease in the size of the object that is being foveated changes the perceptually equivalent size between fovea and periphery. Previous studies have shown that this recalibration of perceived size can be established within a few dozen trials, persists overnight, and generalizes across hemifields. In the current study, we use a novel adjustment paradigm to characterize both temporally and spatially the learning process that subtends this form of recalibration, and directly compare its properties to those of saccadic adaptation. We observed that sinusoidal oscillations in the amplitude of the trans-saccadic change produce sinusoidal oscillations in the reported peripheral size, with a lag of under 10 trials. This is qualitatively similar to what has been observed in the case of saccadic adaptation. We also tested whether learning is generalized to the mirror location on the opposite hemifield for both size recalibration and saccade adaptation. Here the results were markedly different, showing almost complete generalization for recalibration and no generalization for saccadic adaptation. We conclude that perceptual and visuomotor consequences of trans-saccadic changes rely on learning mechanisms that are distinct but develop on similar time scales.
Collapse
|
10
|
Herwig A, Weiß K, Schneider WX. Feature prediction across eye movements is location specific and based on retinotopic coordinates. J Vis 2019; 18:13. [PMID: 30372762 DOI: 10.1167/18.8.13] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
With each saccadic eye movement, internal object representations change their retinal position and spatial resolution. Recently, we suggested that the visual system deals with these saccade-induced changes by predicting visual features across saccades based on transsaccadic associations of peripheral and foveal input (Herwig & Schneider, 2014). Here we tested the specificity of feature prediction by asking (a) whether it is spatially restricted to the previous learning location or the saccade target location, and (b) whether it is based on retinotopic (eye-centered) or spatiotopic (world-centered) coordinates. In a preceding acquisition phase, objects systematically changed their spatial frequency during saccades. In the following test phases of two experiments, participants had to judge the frequency of briefly presented peripheral objects. These objects were presented either at the previous learning location or at new locations and were either the target of a saccadic eye movement or not (Experiment 1). Moreover, objects were presented either in the same or different retinotopic and spatiotopic coordinates (Experiment 2). Spatial frequency perception was biased toward previously associated foveal input indicating transsaccadic learning and feature prediction. Importantly, while this pattern was not bound to the saccade target location, it was seen only at the previous learning location in retinotopic coordinates, suggesting that feature prediction probably affects low- or mid-level perception.
Collapse
Affiliation(s)
- Arvid Herwig
- Department of Psychology, Bielefeld University, Bielefeld, Germany.,Cluster of Excellence, Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| | - Katharina Weiß
- Department of Psychology, Bielefeld University, Bielefeld, Germany.,Cluster of Excellence, Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| | - Werner X Schneider
- Department of Psychology, Bielefeld University, Bielefeld, Germany.,Cluster of Excellence, Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| |
Collapse
|