1
|
Chen Y, Xie XY. Opposing effects of prior information on relational representation and visual cues in dynamic social interaction perception. Iperception 2025; 16:20416695251340298. [PMID: 40356875 PMCID: PMC12066850 DOI: 10.1177/20416695251340298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2024] [Accepted: 04/19/2025] [Indexed: 05/15/2025] Open
Abstract
Social interaction, as a crucial component of relational representation, is essential for understanding human social cognition. While visual cues play a pivotal role in perceiving interactions, little is known about how individuals utilize past visual and interaction-related relational judgments when making decisions under uncertainty. This study investigated how past visual information and interpersonal relational judgments influence the current interaction perception. Participants continuously evaluated the interaction state of two avatars presented at varying distances and facing orientations. The findings revealed a dissociation where the perception of the current interaction state tends to be biased toward past interaction states rather than past distance cues, and this only occurs when the prior interaction information comes from the same sensory modality and is consciously attended to. For the distance cues that contribute to interaction representation, the current distance perception deviates from past distance, even when distance was not explicitly processed. This opposite influence of past information on visual cues and interaction relational representation reflects two independent processing mechanisms of prior information. When dynamically perceiving interpersonal interactions, individuals integrate the repulsive effect of visual cues with the attractive effect of past interaction relations to form stable interaction perception.
Collapse
Affiliation(s)
- Yun Chen
- East China Normal University, Shanghai, China
| | - Xin-Yu Xie
- East China Normal University, Shanghai, China
| |
Collapse
|
2
|
Luo M, Zhang H, Fang F, Luo H. Reactivation of previous decisions repulsively biases sensory encoding but attractively biases decision-making. PLoS Biol 2025; 23:e3003150. [PMID: 40267167 PMCID: PMC12052181 DOI: 10.1371/journal.pbio.3003150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2024] [Revised: 05/05/2025] [Accepted: 04/02/2025] [Indexed: 04/25/2025] Open
Abstract
Automatic shaping of perception by past experiences is common in many cognitive functions, reflecting the exploitation of temporal regularities in environments. A striking example is serial dependence, i.e., current perception is biased by previous trials. However, the neural implementation of its operational circle in human brains remains unclear. In two experiments with electroencephalography (EEG)/magnetoencephalography (MEG) recordings and delayed-response tasks, we demonstrate a two-stage 'repulsive-then-attractive' past-present interaction mechanism underlying serial dependence. First, past-trial reports, instead of past stimuli, serve as a prior to be reactivated during both encoding and decision-making. Crucially, past reactivation interacts with current information processing in a two-stage manner: repelling and attracting the present during encoding and decision-making, and arising in the sensory cortex and prefrontal cortex, respectively. Finally, while the early stage occurs automatically, the late stage is modulated by task and predicts bias behavior. These findings might also illustrate general mechanisms of past-present influences in neural operations.
Collapse
Affiliation(s)
- Minghao Luo
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China
| | - Huihui Zhang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, China
- Institute for Artificial Intelligence, Peking University, Beijing, China
| | - Fang Fang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, China
- Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, China
| | - Huan Luo
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China
- Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, China
| |
Collapse
|
3
|
Duyar A, Carrasco M. Eyes on the past: Gaze stability differs between temporal expectation and temporal attention. J Vis 2025; 25:11. [PMID: 40238139 PMCID: PMC12011131 DOI: 10.1167/jov.25.4.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2024] [Accepted: 03/15/2025] [Indexed: 04/18/2025] Open
Abstract
Does the timing of a preceding visual event affect when people deploy attention in the future? Temporal expectation and temporal attention are two distinct processes that interact at the behavioral and neural levels, improving performance and gaze stability. The preceding foreperiod-the interval between the preparatory signal and stimulus onset in the previous trial-modulates expectation at the behavioral and oculomotor levels. Here, we investigated whether the preceding foreperiod also modulates the effects of temporal attention and whether such effects interact with expectation. We found that, regardless of whether the stimulus occurred earlier than, later than, or at the expected moment in the preceding foreperiod, temporal attention improved performance and accelerated gaze stability onset and offset consistently by shifting microsaccade timing. However, overall, only with expected preceding foreperiods, attention inhibited microsaccade rates. Moreover, late preceding foreperiods weakened the expectation effects on microsaccade rates, but this weakening was overridden by attention. Altogether, these findings reveal that the oculomotor system's flexibility does not translate to performance, and suggest that, although selection history can be used as one of the sources of expectation in subsequent trials, it does not necessarily determine, strengthen, or guide attentional deployment.
Collapse
Affiliation(s)
- Aysun Duyar
- Department of Psychology, New York University, New York, NY, USA
- https://orcid.org/0000-0003-1039-8625
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
- https://orcid.org/0000-0002-1002-9056
| |
Collapse
|
4
|
Xie XY, Burr DC, Morrone MC. Recent, but not long-term, priors induce behavioral oscillations in peri-saccadic vision. COMMUNICATIONS PSYCHOLOGY 2025; 3:41. [PMID: 40097823 PMCID: PMC11913734 DOI: 10.1038/s44271-025-00224-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/11/2024] [Accepted: 03/04/2025] [Indexed: 03/19/2025]
Abstract
Perception of a continuous world relies on our ability to integrate discontinuous sensory signals when we make saccadic eye movements, which abruptly change the retinal image. Here we investigate the role of oscillations in integrating pre-saccadic information with the current sensory signals. We presented to participants (N = 24) a brief pre-saccadic Gabor stimulus (termed the inducer) before voluntary 16° saccades, followed by a test Gabor stimulus at various times before or after saccadic onset. Orientation judgments of the test stimulus were biased towards the orientation of both the inducer and previous (1-back) test stimulus, consistent with serial dependence. In addition to the average bias, judgments oscillated in synchrony with saccadic onset at alpha frequencies (~9.5 Hz) towards the orientation of the inducer or 1-back stimulus. There was also a strong bias towards the mean orientation (central tendency): however, that bias was constant over time, not associated with saccade-synched oscillations. Perceptual oscillations in serial dependence (but not central tendency) suggest that alpha rhythms may be instrumental in communicating short-term (but not long-term) perceptual memory across saccades, helping to preserve stability during saccades. The distinction between the modes of communicating short- and long-term memory suggests that the two phenomena are mediated by distinct neuronal circuitry.
Collapse
Affiliation(s)
- Xin-Yu Xie
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, China.
| | - David C Burr
- Department of Neuroscience, Psychology, Pharmacology, and Child Health, University of Florence, Florence, Italy
- School of Psychology, University of Sydney, Camperdown, NSW, Australia
| | - Maria Concetta Morrone
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| |
Collapse
|
5
|
Gekas N, Mamassian P. Attractive and repulsive visual aftereffects depend on stimulus contrast. J Vis 2025; 25:10. [PMID: 39786734 PMCID: PMC11725992 DOI: 10.1167/jov.25.1.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 12/03/2024] [Indexed: 01/12/2025] Open
Abstract
Visual perception has been described as a dynamic process where incoming visual information is combined with what has been seen before to form the current percept. Such a process can result in multiple visual aftereffects that can be attractive toward or repulsive away from past visual stimulation. A lot of research has been conducted on what functional role the mechanisms that produce these aftereffects may play. However, there is a lack of understanding of the role of stimulus uncertainty on these aftereffects. In this study, we investigate how the contrast of a stimulus affects the serial aftereffects it induces and how the stimulus itself is affected by these effects depending on its contrast. We presented human observers with a series of Gabor patches and monitored how the perceived orientation of stimuli changed over time with the systematic manipulation of orientation and contrast of presented stimuli. We hypothesized that repulsive serial effects would be stronger for the judgment of high-contrast than low-contrast stimuli, but the other way around for attractive serial effects. Our experimental findings confirm such a strong interaction between contrast and sign of aftereffects. We present a Bayesian model observer that can explain this interaction based on two principles, the dynamic changes of orientation-tuned channels in short timescales and the slow integration of prior information over long timescales. Our findings have strong implications for our understanding of orientation perception and can inspire further work on the identification of its neural mechanisms.
Collapse
Affiliation(s)
- Nikos Gekas
- Department of Psychology, Edinburgh Napier University, Edinburgh, UK
- School of Psychology, University of Nottingham, Nottingham, UK
| | - Pascal Mamassian
- Laboratoire des Systèmes Perceptifs, Département d'études cognitives, École normale supérieure, PSL University, France
| |
Collapse
|
6
|
Cicchini GM, D'Errico G, Burr DC. Color crowding considered as adaptive spatial integration. J Vis 2024; 24:9. [PMID: 39656167 PMCID: PMC11636666 DOI: 10.1167/jov.24.13.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 10/21/2024] [Indexed: 12/14/2024] Open
Abstract
Crowding is the inability to recognize an object in clutter, classically considered a fundamental low-level bottleneck to object recognition. Recently, however, it has been suggested that crowding, like predictive phenomena such as serial dependence, may result from optimizing strategies that exploit redundancies in natural scenes. This notion leads to several testable predictions, such as crowding being greater for nonsalient targets and, counterintuitively, that flanker interference should be associated with higher precision in judgements, leading to a lower overall error rate. Here we measured color discrimination for targets flanked by stimuli of variable color. The results verified both predictions, showing that although crowding can affect object recognition, it may be better understood not as a processing bottleneck, but rather as a consequence of mechanisms evolved to efficiently exploit the spatial redundancies of the natural world. Analyses of reaction times of judgments shows that the integration occurs at sensory rather than decisional levels.
Collapse
Affiliation(s)
| | | | - David Charles Burr
- Department of Neurosciences, Psychology, Drug Research and Child Health, University of Florence, Firenze, Italy
- School of Psychology, University of Sydney, Camperdown, NSW, Australia
| |
Collapse
|
7
|
Tyralla S, Zimmermann E. Serial dependencies in motor targeting as a function of target appearance. J Vis 2024; 24:6. [PMID: 39641949 PMCID: PMC11629911 DOI: 10.1167/jov.24.13.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Accepted: 11/02/2024] [Indexed: 12/07/2024] Open
Abstract
In order to bring stimuli of interest into our central field of vision, we perform saccadic eye movements. After every saccade, the error between the predicted and actual landing position is monitored. In the laboratory, artificial post-saccadic errors are created by displacing the target during saccade execution. Previous research found that even a single post-saccadic error induces immediate amplitude changes to minimize that error. The saccadic amplitude adjustment could result from a recalibration of the saccade target representation. We asked if recalibration follows an integration scheme in which the impact magnitude of the previous post-saccadic target location depends on the certainty of the current target. We asked subjects to perform saccades to Gaussian blobs as targets, the visuospatial certainty of which we manipulated by changing its spatial constant. In separate sessions, either the pre-saccadic or post-saccadic target was uncertain. Additionally, we manipulated the contrast to further decrease certainty, changing the spatial constant mid-saccade. We found saccade-by-saccade amplitude reductions only with a currently uncertain target, a previously certain one, and a constant target contrast. We conclude that the features of the pre-saccadic target (i.e., size and contrast) determine the extent to which post-saccadic error shapes upcoming saccade amplitudes.
Collapse
Affiliation(s)
- Sandra Tyralla
- Institute for Experimental Psychology, Heinrich Heine University, Düsseldorf, Germany
| | - Eckart Zimmermann
- Institute for Experimental Psychology, Heinrich Heine University, Düsseldorf, Germany
| |
Collapse
|
8
|
Hong B, Chen J, Huang W, Li L. Serial Dependence in Smooth Pursuit Eye Movements of Preadolescent Children and Adults. Invest Ophthalmol Vis Sci 2024; 65:37. [PMID: 39728694 DOI: 10.1167/iovs.65.14.37] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2024] Open
Abstract
Purpose Serial dependence refers to the attraction of current perceptual responses toward previously seen stimuli. Despite extensive research on serial dependence, fundamental questions, such as how serial dependence changes with development, whether it affects the perception of sensory input, and what qualifies as serial dependence, remain unresolved. The current study aims to address these questions. Methods We tested 81 children (8-9 years) and 77 adults (18-30 years) with an ocular tracking task in which participants used their eyes to track a target moving in a specific direction on each trial. This task examined both the open-loop (pursuit initiation) and closed-loop (steady-state tracking) smooth pursuit eye movements. Results We found an attractive bias in pursuit direction toward previously seen target motion direction during pursuit initiation but not sustained pursuit in both children and adults. Such a bias displayed both feature- and temporal-tuning characteristics of serial dependence, showed oblique-cardinal directional anisotropy, and was more pronounced in children than adults. The greater effect of serial dependence around oblique than cardinal directions and its increased magnitude in children compared to adults can be explained by the larger variability in pursuit direction around oblique directions and in children, as predicted by the Bayesian framework. Conclusions Serial dependence in smooth pursuit occurs early during pursuit initiation when the response is driven by the perception of sensory input. Age-related changes in serial dependence reflect the fine-tuning of general brain functions, enhancing precision in tracking a moving target and thus reducing serial dependence effects.
Collapse
Affiliation(s)
- Bao Hong
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at New York University Shanghai, Shanghai, China
| | - Jing Chen
- NYU-ECNU Institute of Brain and Cognitive Science at New York University Shanghai, Shanghai, China
- Faculty of Arts and Science, New York University Shanghai, Shanghai, China
- Institute of Brain and Education Innovation, East China Normal University, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai, China
| | - Wenjun Huang
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at New York University Shanghai, Shanghai, China
| | - Li Li
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at New York University Shanghai, Shanghai, China
- Faculty of Arts and Science, New York University Shanghai, Shanghai, China
- Institute of Brain and Education Innovation, East China Normal University, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai, China
| |
Collapse
|
9
|
Cheng S, Chen S, Yang X, Shi Z. The impact of task measurements on sequential dependence: a comparison between temporal reproduction and discrimination tasks. PSYCHOLOGICAL RESEARCH 2024; 88:2346-2359. [PMID: 39190157 PMCID: PMC11522143 DOI: 10.1007/s00426-024-02023-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 08/14/2024] [Indexed: 08/28/2024]
Abstract
Decisions about a current stimulus are influenced by previously encountered stimuli, leading to sequential bias. However, the specific processing levels at which serial dependence emerges remain unclear. Despite considerable evidence pointing to contributions from perceptual and post-perceptual processes, as well as response carryover effects impacting subsequent judgments, research into how different task measurements affect sequential dependencies is limited. To address this gap, the present study investigated the role of task type in shaping sequential effects in time perception, employing a random-dot kinematogram (RDK) in a post-cue paradigm. Participants had to remember both the duration and the direction of the RDK movement and perform the task based on a post-cue, which was equally likely to be direction or duration. To delineate the task type, we employed the temporal bisection task in Experiment 1 and the duration reproduction task in Experiment 2. Both experiments revealed a significant sequential bias: durations were perceived as longer following longer previous durations, and vice versa. Intriguingly, the sequential effect was enhanced in the reproduction task following the same reproduction task (Experiment 2), but did not show significant variation by the task type in the bisection task (Experiment 1). Moreover, comparable response carryover effects were observed across two experiments. We argue that the differential impacts of task types on sequential dependence lies in the involvement of memory reactivation process in the decision stage, while the post-decision response carryover effect may reflect the assimilation by subjective, rather than objective, durations, potentially linking to the sticky pacemaker rate and/or decisional inertia.
Collapse
Affiliation(s)
- Si Cheng
- General and Experimental Psychology, Department of Psychology, LMU Munich, 80802, Munich, Germany
| | - Siyi Chen
- General and Experimental Psychology, Department of Psychology, LMU Munich, 80802, Munich, Germany
| | - Xuefeng Yang
- Graduate School of Neural & Behavioural Science, International Max Planck Research School, Tübingen, Germany
| | - Zhuanghua Shi
- General and Experimental Psychology, Department of Psychology, LMU Munich, 80802, Munich, Germany.
| |
Collapse
|
10
|
Cheng S, Chen S, Shi Z. Opposing sequential biases in direction and time reproduction: Influences of task relevance and working memory. Br J Psychol 2024; 115:825-842. [PMID: 39133516 DOI: 10.1111/bjop.12728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 07/28/2024] [Indexed: 08/13/2024]
Abstract
Our current perception and decision-making are shaped by recent experiences, a phenomenon known as serial dependence. While serial dependence is well-documented in visual perception and has been recently explored in time perception, their functional similarities across non-temporal and temporal domains remain elusive, particularly in relation to task relevance and working memory load. To address this, we designed a unified experimental paradigm using coherent motion stimuli to test both direction and time reproduction. The direction and time tasks were randomly mixed across trials. Additionally, we introduced pre-cue versus post-cue settings in separate experiments to manipulate working memory load during the encoding phase. We found attractive biases in time reproduction but repulsive biases in direction estimation. Notably, the temporal attraction was more pronounced when the preceding task was also time-related. In contrast, the direction repulsion remained unaffected by the nature of the preceding task. Additionally, both attractive and repulsive biases were enhanced by the post-cue compared to the pre-cue. Our findings suggest that opposing sequential effects in non-temporal and temporal domains may originate from different processing stages linked to sensory adaptation and post-perceptual processes involving working memory.
Collapse
Affiliation(s)
- Si Cheng
- General and Experimental Psychology, Department of Psychology, LMU Munich, Munich, Germany
| | - Siyi Chen
- General and Experimental Psychology, Department of Psychology, LMU Munich, Munich, Germany
| | - Zhuanghua Shi
- General and Experimental Psychology, Department of Psychology, LMU Munich, Munich, Germany
| |
Collapse
|
11
|
Zhou L, Liu Y, Jiang Y, Wang W, Xu P, Zhou K. The distinct development of stimulus and response serial dependence. Psychon Bull Rev 2024; 31:2137-2147. [PMID: 38379075 PMCID: PMC11543724 DOI: 10.3758/s13423-024-02474-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/04/2024] [Indexed: 02/22/2024]
Abstract
Serial dependence (SD) is a phenomenon wherein current perceptions are biased by the previous stimulus and response. This helps to attenuate perceptual noise and variability in sensory input and facilitates stable ongoing perceptions of the environment. However, little is known about the developmental trajectory of SD. This study investigates how the stimulus and response biases of the SD effect develop across three age groups. Conventional analyses, in which previous stimulus and response biases were assessed separately, revealed significant changes in the biases over time. Previous stimulus bias shifted from repulsion to attraction, while previous response bias evolved from attraction to greater attraction. However, there was a strong correlation between stimulus and response orientations. Therefore, a generalized linear mixed-effects (GLME) analysis that simultaneously considered both previous stimulus and response, outperformed separate analyses. This revealed that previous stimulus and response resulted in two distinct biases with different developmental trajectories. The repulsion bias of previous stimulus remained relatively stable across all age groups, whereas the attraction bias of previous response was significantly stronger in adults than in children and adolescents. These findings demonstrate that the repulsion bias towards preceding stimuli is established early in the developing brain (at least by around 10 years old), while the attraction bias towards responses is not fully developed until adulthood. Our findings provide new insights into the development of the SD phenomenon and how humans integrate two opposing mechanisms into their perceptual responses to external input during development.
Collapse
Affiliation(s)
- Liqin Zhou
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Yujie Liu
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Brain and Cognitive Sciences, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
| | - Yuhan Jiang
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Wenbo Wang
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Pengfei Xu
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Ke Zhou
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China.
| |
Collapse
|
12
|
Ufer C, Blank H. Opposing serial effects of stimulus and choice in speech perception scale with context variability. iScience 2024; 27:110611. [PMID: 39252961 PMCID: PMC11382034 DOI: 10.1016/j.isci.2024.110611] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 06/05/2024] [Accepted: 07/26/2024] [Indexed: 09/11/2024] Open
Abstract
In this study, we investigated serial effects on the perception of auditory vowel stimuli across three experimental setups with different degrees of context variability. Aligning with recent findings in visual perception, our results confirm the existence of two distinct processes in serial dependence: a repulsive sensory effect coupled with an attractive decisional effect. Importantly, our study extends these observations to the auditory domain, demonstrating parallel serial effects in audition. Furthermore, we uncover context variability effects, revealing a linear pattern for the repulsive perceptual effect and a quadratic pattern for the attractive decisional effect. These findings support the presence of adaptive sensory mechanisms underlying the repulsive effects, while higher-level mechanisms appear to govern the attractive decisional effect. The study provides valuable insights into the interplay of attractive and repulsive serial effects in auditory perception and contributes to our understanding of the underlying mechanisms.
Collapse
Affiliation(s)
- Carina Ufer
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
- Hamburg Brain School, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
| | - Helen Blank
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
- Hamburg Brain School, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
| |
Collapse
|
13
|
Rhodes D, Bridgewater T, Ayache J, Riemer M. Rapid calibration to dynamic temporal contexts. Q J Exp Psychol (Hove) 2024; 77:1923-1935. [PMID: 38017605 PMCID: PMC11373159 DOI: 10.1177/17470218231219507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
The prediction of future events and the preparation of appropriate behavioural reactions rely on an accurate perception of temporal regularities. In dynamic environments, temporal regularities are subject to slow and sudden changes, and adaptation to these changes is an important requirement for efficient behaviour. Bayesian models have proven a useful tool to understand the processing of temporal regularities in humans; yet an open question pertains to the degree of flexibility of the prior that is required for optimal modelling of behaviour. Here we directly compare dynamic models (with continuously changing prior expectations) and static models (a stable prior for each experimental session) with their ability to describe regression effects in interval timing. Our results show that dynamic Bayesian models are superior when describing the responses to slow, continuous environmental changes, whereas static models are more suitable to describe responses to sudden changes. In time perception research, these results will be informative for the choice of adequate computational models and enhance our understanding of the neuronal computations underlying human timing behaviour.
Collapse
Affiliation(s)
| | - Tyler Bridgewater
- NTU Psychology, Nottingham Trent University, Nottingham, UK
- School of Psychology, Cardiff University, UK
| | - Julia Ayache
- NTU Psychology, Nottingham Trent University, Nottingham, UK
| | - Martin Riemer
- Biological Psychology and Neuroergonomics, Technical University Berlin, Berlin, Germany
| |
Collapse
|
14
|
Zhang Z, Lewis-Peacock JA. Integration of history information Drives Serial Dependence and Stabilizes Working Memory Representations. J Neurosci 2024; 44:e2399232024. [PMID: 38897722 PMCID: PMC11308318 DOI: 10.1523/jneurosci.2399-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 04/29/2024] [Accepted: 05/01/2024] [Indexed: 06/21/2024] Open
Abstract
Serial dependence has shown seemingly contradictory effects on visual perception and working memory. While serial dependence promotes perpetual and mnemonic stability, it biases behavioral reports toward prior information. The neural mechanisms that drive both biasing and adaptive stabilizing effects are not well understood. We proposed and tested a reactivation and integration mechanism that can account for these contradictory effects. We used multivariate pattern analyses of EEG data (26 human participants, 17 females, 9 males) to examine the reactivation of prior reported orientation during the delay period of a visual working memory task. The reactivation strength of prior reports, but not prior sensory items, was predictive of the magnitude of serial dependency biases. These reactivated representations integrated with the representation of the current memory item and improved the ability to decode the current contents of memory. Overall, our data provide convergent evidence suggesting that prior reports in a visual working memory task are reactivated on the subsequent trial and become integrated with current memory representations. This similarity-dependent reactivation mechanism drives both report biasing and stabilization effects attributed to serial dependence in working memory.
Collapse
Affiliation(s)
- Ziyao Zhang
- Department of Psychology, The University of Texas at Austin, Austin, Texas 78712
| | | |
Collapse
|
15
|
Duyar A, Carrasco M. Eyes on the past: Gaze stability differs between temporal expectation and temporal attention. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.07.598015. [PMID: 38895241 PMCID: PMC11185784 DOI: 10.1101/2024.06.07.598015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
Temporal expectation and temporal attention distinctly improve performance and gaze stability, and interact at the behavioral and neural levels. Foreperiod-the interval between the preparatory signal and stimulus onset-facilitates temporal expectation. Preceding foreperiod-the foreperiod in the previous trial-modulates expectation at behavioral and oculomotor levels. Here, we investigated whether preceding foreperiod guides temporal attention. Regardless of the preceding foreperiod, temporal attention improved performance, particularly at early moments,and consistently accelerated gaze stability onset and offset by shifting microsaccade timing. However, only with preceding expected foreperiods, attention inhibited microsaccade rates. Moreover, preceding late foreperiods weakened expectation effects on microsaccade rates, but such a weakening was overridden by attention. Altogether, these findings reveal that the oculomotor system's flexibility does not translate to performance, and suggest that although selection history can be utilized as one of the sources of expectation in subsequent trials, it does not necessarily determine, strengthen, or guide attentional deployment.
Collapse
Affiliation(s)
- Aysun Duyar
- Department of Psychology, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
16
|
Scheller M, Fang H, Sui J. Self as a prior: The malleability of Bayesian multisensory integration to social salience. Br J Psychol 2024; 115:185-205. [PMID: 37747452 DOI: 10.1111/bjop.12683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 08/26/2023] [Accepted: 09/11/2023] [Indexed: 09/26/2023]
Abstract
Our everyday perceptual experiences are grounded in the integration of information within and across our senses. Due to this direct behavioural relevance, cross-modal integration retains a certain degree of contextual flexibility, even to social relevance. However, how social relevance modulates cross-modal integration remains unclear. To investigate possible mechanisms, Experiment 1 tested the principles of audio-visual integration for numerosity estimation by deriving a Bayesian optimal observer model with perceptual prior from empirical data to explain perceptual biases. Such perceptual priors may shift towards locations of high salience in the stimulus space. Our results showed that the tendency to over- or underestimate numerosity, expressed in the frequency and strength of fission and fusion illusions, depended on the actual event numerosity. Experiment 2 replicated the effects of social relevance on multisensory integration from Scheller & Sui, 2022 JEP:HPP, using a lower number of events, thereby favouring the opposite illusion through enhanced influences of the prior. In line with the idea that the self acts like a prior, the more frequently observed illusion (more malleable to prior influences) was modulated by self-relevance. Our findings suggest that the self can influence perception by acting like a prior in cue integration, biasing perceptual estimates towards areas of high self-relevance.
Collapse
Affiliation(s)
- Meike Scheller
- Department of Psychology, University of Aberdeen, Aberdeen, UK
- Department of Psychology, Durham University, Durham, UK
| | - Huilin Fang
- Department of Psychology, University of Aberdeen, Aberdeen, UK
| | - Jie Sui
- Department of Psychology, University of Aberdeen, Aberdeen, UK
| |
Collapse
|
17
|
Hahn M, Wei XX. A unifying theory explains seemingly contradictory biases in perceptual estimation. Nat Neurosci 2024; 27:793-804. [PMID: 38360947 DOI: 10.1038/s41593-024-01574-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 01/08/2024] [Indexed: 02/17/2024]
Abstract
Perceptual biases are widely regarded as offering a window into the neural computations underlying perception. To understand these biases, previous work has proposed a number of conceptually different, and even seemingly contradictory, explanations, including attraction to a Bayesian prior, repulsion from the prior due to efficient coding and central tendency effects on a bounded range. We present a unifying Bayesian theory of biases in perceptual estimation derived from first principles. We demonstrate theoretically an additive decomposition of perceptual biases into attraction to a prior, repulsion away from regions with high encoding precision and regression away from the boundary. The results reveal a simple and universal rule for predicting the direction of perceptual biases. Our theory accounts for, and yields, new insights regarding biases in the perception of a variety of stimulus attributes, including orientation, color and magnitude. These results provide important constraints on the neural implementations of Bayesian computations.
Collapse
Affiliation(s)
| | - Xue-Xin Wei
- Department of Neuroscience, Department of Psychology, Center for Perceptual Systems, Center for Learning and Memory, Center for Theoretical and Computational Neuroscience, The University of Texas at Austin, Austin, TX, USA.
| |
Collapse
|
18
|
Albert L, Potheegadoo J, Herbelin B, Bernasconi F, Blanke O. Numerosity estimation of virtual humans as a digital-robotic marker for hallucinations in Parkinson's disease. Nat Commun 2024; 15:1905. [PMID: 38472203 DOI: 10.1038/s41467-024-45912-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 02/07/2024] [Indexed: 03/14/2024] Open
Abstract
Hallucinations are frequent non-motor symptoms in Parkinson's disease (PD) associated with dementia and higher mortality. Despite their high clinical relevance, current assessments of hallucinations are based on verbal self-reports and interviews that are limited by important biases. Here, we used virtual reality (VR), robotics, and digital online technology to quantify presence hallucination (vivid sensations that another person is nearby when no one is actually present and can neither be seen nor heard) in laboratory and home-based settings. We establish that elevated numerosity estimation of virtual human agents in VR is a digital marker for experimentally induced presence hallucinations in healthy participants, as confirmed across several control conditions and analyses. We translated the digital marker (numerosity estimation) to an online procedure that 170 PD patients carried out remotely at their homes, revealing that PD patients with disease-related presence hallucinations (but not control PD patients) showed higher numerosity estimation. Numerosity estimation enables quantitative monitoring of hallucinations, is an easy-to-use unobtrusive online method, reaching people far away from medical centers, translating neuroscientific findings using robotics and VR, to patients' homes without specific equipment or trained staff.
Collapse
Affiliation(s)
- Louis Albert
- Laboratory of Cognitive Neuroscience, Neuro-X Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland
| | - Jevita Potheegadoo
- Laboratory of Cognitive Neuroscience, Neuro-X Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland
| | - Bruno Herbelin
- Laboratory of Cognitive Neuroscience, Neuro-X Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland
| | - Fosco Bernasconi
- Laboratory of Cognitive Neuroscience, Neuro-X Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland
| | - Olaf Blanke
- Laboratory of Cognitive Neuroscience, Neuro-X Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland.
- Department of Clinical Neurosciences, Faculty of Medicine, University of Geneva, Geneva, Switzerland.
| |
Collapse
|
19
|
Sadil P, Cowell RA, Huber DE. The push-pull of serial dependence effects: Attraction to the prior response and repulsion from the prior stimulus. Psychon Bull Rev 2024; 31:259-273. [PMID: 37566217 PMCID: PMC11488665 DOI: 10.3758/s13423-023-02320-3] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/30/2023] [Indexed: 08/12/2023]
Abstract
In the "serial dependence" effect, responses to visual stimuli appear biased toward the last trial's stimulus. However, several kinds of serial dependence exist, with some reflecting prior stimuli and others reflecting prior responses. One-factor analyses consider the prior stimulus alone or the prior response alone and can consider both variables only via separate analyses. We demonstrate that one-factor analyses are potentially misleading and can reach conclusions that are opposite from the truth if both dependencies exist. To address this limitation, we developed two-factor analyses (model comparison with hierarchical Bayesian modeling and an empirical "quadrant analysis"), which consider trial-by-trial combinations of prior response and prior stimulus. Two-factor analyses can tease apart the two dependencies if applied to a sufficiently large dataset. We applied these analyses to a new study and to four previously published studies. When applying a model that included the possibility of both dependencies, there was no evidence of attraction to the prior stimulus in any dataset, but there was evidence of attraction to the prior response in all datasets. Two of the datasets contained sufficient constraint to determine that both dependencies were needed to explain the results. For these datasets, the dependency on the prior stimulus was repulsive rather than attractive. Our results are consistent with the claim that both dependencies exist in most serial dependence studies (the two-dependence model was not ruled out for any dataset) and, furthermore, that the two dependencies work against each other.
Collapse
Affiliation(s)
- Patrick Sadil
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
| | - Rosemary A Cowell
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA
- Department of Psychology and Neuroscience, University of Colorado Boulder, Boulder, CO, USA
| | - David E Huber
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA
| |
Collapse
|
20
|
Morimoto Y, Makioka S. Response boosts serial dependence in the numerosity estimation task. Sci Rep 2024; 14:2059. [PMID: 38267507 PMCID: PMC10808238 DOI: 10.1038/s41598-024-52470-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Accepted: 01/18/2024] [Indexed: 01/26/2024] Open
Abstract
Perceptions of current stimuli are sometimes biased toward or away from past perceptions. This phenomenon is called serial dependence. However, the strength of the effect of past responses on serial dependence has not been fully elucidated. We conducted experiments with a task in which participants estimated the number of dot arrays (numerosity estimation task) and directly compared whether the strength of serial dependence changed in the numerosity estimation task when participants responded or did not respond in the immediately preceding trial. We also examined whether the strength of serial dependence affected the accuracy of the numerosity estimation. We found that attractive serial dependence was stronger when participants responded in the immediately preceding trial than when they only saw the stimulus. The results suggest that the information from the previous stimulus must reach the higher-level processes associated with perceptual decisions to influence the estimation of the current stimulus. However, it is possible that the results of this study are specific to tasks in which participants respond with numeric symbols. The magnitude of the serial dependence effect was not observed to affect numerosity estimation performance, and no evidence was found that serial dependence enhances accuracy in the numerosity estimation task.
Collapse
Affiliation(s)
- Yukihiro Morimoto
- Department of Sustainable System Sciences, Osaka Prefecture University, 1-1, Gakuen-cho, Naka-ku, Sakai, Osaka, 599-8531, Japan.
| | - Shogo Makioka
- Department of Psychology, Osaka Metropolitan University, 1-1, Gakuen-cho, Naka-ku, Sakai, Osaka, 599-8531, Japan
| |
Collapse
|
21
|
Abstract
Much evidence has shown that perception is biased towards previously presented similar stimuli, an effect recently termed serial dependence. Serial dependence affects nearly every aspect of perception, often causing gross perceptual distortions, especially for weak and ambiguous stimuli. Despite unwanted side-effects, empirical evidence and Bayesian modeling show that serial dependence acts to improve efficiency and is generally beneficial to the system. Consistent with models of predictive coding, the Bayesian priors of serial dependence are generated at high levels of cortical analysis, incorporating much perceptual experience, but feed back to lower sensory areas. These feedback loops may drive oscillations in the alpha range, linked strongly with serial dependence. The discovery of top-down predictive perceptual processes is not new, but the new, more quantitative approach characterizing serial dependence promises to lead to a deeper understanding of predictive perceptual processes and their underlying neural mechanisms.
Collapse
Affiliation(s)
| | - Kyriaki Mikellidou
- Department of Management, University of Limassol, Nicosia, Cyprus;
- Department of Neurosciences, Psychology, Drug Research and Child Health, University of Florence, Florence, Italy;
- Department of Psychology, University of Cyprus, Nicosia, Cyprus
| | - David Charles Burr
- Department of Neurosciences, Psychology, Drug Research and Child Health, University of Florence, Florence, Italy;
- School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
22
|
Cheng S, Chen S, Glasauer S, Keeser D, Shi Z. Neural mechanisms of sequential dependence in time perception: the impact of prior task and memory processing. Cereb Cortex 2024; 34:bhad453. [PMID: 38037371 DOI: 10.1093/cercor/bhad453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 11/02/2023] [Accepted: 11/04/2023] [Indexed: 12/02/2023] Open
Abstract
Our perception and decision-making are susceptible to prior context. Such sequential dependence has been extensively studied in the visual domain, but less is known about its impact on time perception. Moreover, there are ongoing debates about whether these sequential biases occur at the perceptual stage or during subsequent post-perceptual processing. Using functional magnetic resonance imaging, we investigated neural mechanisms underlying temporal sequential dependence and the role of action in time judgments across trials. Participants performed a timing task where they had to remember the duration of green coherent motion and were cued to either actively reproduce its duration or simply view it passively. We found that sequential biases in time perception were only evident when the preceding task involved active duration reproduction. Merely encoding a prior duration without reproduction failed to induce such biases. Neurally, we observed activation in networks associated with timing, such as striato-thalamo-cortical circuits, and performance monitoring networks, particularly when a "Response" trial was anticipated. Importantly, the hippocampus showed sensitivity to these sequential biases, and its activation negatively correlated with the individual's sequential bias following active reproduction trials. These findings highlight the significant role of memory networks in shaping time-related sequential biases at the post-perceptual stages.
Collapse
Affiliation(s)
- Si Cheng
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Leopoldstraße 13, 80802, Munich, Germany
| | - Siyi Chen
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Leopoldstraße 13, 80802, Munich, Germany
| | - Stefan Glasauer
- Computational Neuroscience, Institute of Medical Technology, Brandenburg University of Technology Cottbus-Senftenberg, Lipezker Straße 47, 03048, Cottbus, Germany
| | - Daniel Keeser
- NeuroImaging Core Unit Munich (NICUM), Department of Psychiatry and Psychotherapy, Ludwig-Maximilians-Universität München, Nußbaumstraße 7, 80336, Munich, Germany
| | - Zhuanghua Shi
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Leopoldstraße 13, 80802, Munich, Germany
- NeuroImaging Core Unit Munich (NICUM), Department of Psychiatry and Psychotherapy, Ludwig-Maximilians-Universität München, Nußbaumstraße 7, 80336, Munich, Germany
| |
Collapse
|
23
|
Weilnhammer V, Stuke H, Standvoss K, Sterzer P. Sensory processing in humans and mice fluctuates between external and internal modes. PLoS Biol 2023; 21:e3002410. [PMID: 38064502 PMCID: PMC10732408 DOI: 10.1371/journal.pbio.3002410] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 12/20/2023] [Accepted: 10/30/2023] [Indexed: 12/21/2023] Open
Abstract
Perception is known to cycle through periods of enhanced and reduced sensitivity to external information. Here, we asked whether such slow fluctuations arise as a noise-related epiphenomenon of limited processing capacity or, alternatively, represent a structured mechanism of perceptual inference. Using 2 large-scale datasets, we found that humans and mice alternate between externally and internally oriented modes of sensory analysis. During external mode, perception aligns more closely with the external sensory information, whereas internal mode is characterized by enhanced biases toward perceptual history. Computational modeling indicated that dynamic changes in mode are enabled by 2 interlinked factors: (i) the integration of subsequent inputs over time and (ii) slow antiphase oscillations in the impact of external sensory information versus internal predictions that are provided by perceptual history. We propose that between-mode fluctuations generate unambiguous error signals that enable optimal inference in volatile environments.
Collapse
Affiliation(s)
- Veith Weilnhammer
- Department of Psychiatry, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
- Berlin Institute of Health, Charité-Universitätsmedizin Berlin and Max Delbrück Center, Berlin, Germany
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, United States of America
| | - Heiner Stuke
- Department of Psychiatry, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
- Berlin Institute of Health, Charité-Universitätsmedizin Berlin and Max Delbrück Center, Berlin, Germany
| | - Kai Standvoss
- Department of Psychiatry, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| | - Philipp Sterzer
- Department of Psychiatry (UPK), University of Basel, Basel, Switzerland
| |
Collapse
|
24
|
Burr DC, Morrone MC. The role of neural oscillations in visuo-motor communication at the time of saccades. Neuropsychologia 2023; 190:108682. [PMID: 37717722 DOI: 10.1016/j.neuropsychologia.2023.108682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 09/08/2023] [Accepted: 09/11/2023] [Indexed: 09/19/2023]
Abstract
Saccadic eye-movements are fundamental for active vision, allowing observers to purposefully scan the environment with the high-resolution fovea. In this brief perspective we outline a series of experiments from our laboratories investigating the role of eye-movements and their consequences to active perception. We show that saccades lead to suppression of visual sensitivity at saccadic onset, and that this suppression is accompanied by endogenous neural oscillations in the delta range. Similar oscillations are initiated by purposeful hand movements, which lead to measurable changes in responsivity in area V1, and in the connectivity with motor area M1. Saccades also lead to clear distortions in apparent position, but only for verbal reports, not when participants respond with rapid pointing, consistent with the action of two separate visual systems in neurotypical adults. At the time of saccades, serial dependence, the positive influence on perception of previous stimulus attributes (such as orientation) is particularly strong. Again, these processes are accompanied by neural oscillations, in the alpha and low beta range. In general, oscillations seem to be tightly linked to serial dependence in perception, both in auditory judgments (around 10 Hz), and for visual judgements of face gender (14 Hz for female, 17 Hz for male). Taken together, the studies show that neural oscillations play a fundamental role in dynamic, active vision.
Collapse
Affiliation(s)
- David C Burr
- Department of Neuroscience, Psychology, Pharmacology, and Child Health, University of Florence, 50135, Florence, Italy; School of Psychology, University of Sydney, Australia.
| | - Maria Concetta Morrone
- Department of Neuroscience, Psychology, Pharmacology, and Child Health, University of Florence, 50135, Florence, Italy; Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, via San Zeno 31, 56123, Pisa, Italy
| |
Collapse
|
25
|
Fulvio JM, Rokers B, Samaha J. Task feedback suggests a post-perceptual component to serial dependence. J Vis 2023; 23:6. [PMID: 37682557 PMCID: PMC10500366 DOI: 10.1167/jov.23.10.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 08/14/2023] [Indexed: 09/09/2023] Open
Abstract
Decisions across a range of perceptual tasks are biased toward past stimuli. Such serial dependence is thought to be an adaptive low-level mechanism that promotes perceptual stability across time. However, recent studies suggest post-perceptual mechanisms may also contribute to serially biased responses, calling into question a single locus of serial dependence and the nature of integration of past and present sensory inputs. We measured serial dependence in the context of a three-dimensional (3D) motion perception task where uncertainty in the sensory information varied substantially from trial to trial. We found that serial dependence varied with stimulus properties that impact sensory uncertainty on the current trial. Reduced stimulus contrast was associated with an increased bias toward the stimulus direction of the previous trial. Critically, performance feedback, which reduced sensory uncertainty, abolished serial dependence. These results provide clear evidence for a post-perceptual locus of serial dependence in 3D motion perception and support the role of serial dependence as a response strategy in the face of substantial sensory uncertainty.
Collapse
Affiliation(s)
| | - Bas Rokers
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| | - Jason Samaha
- Department of Psychology, University of California, Santa Cruz, Santa Cruz, CA, USA
| |
Collapse
|
26
|
Trübutschek D, Melloni L. Stable perceptual phenotype of the magnitude of history biases even in the face of global task complexity. J Vis 2023; 23:4. [PMID: 37531102 PMCID: PMC10405861 DOI: 10.1167/jov.23.8.4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 06/25/2023] [Indexed: 08/03/2023] Open
Abstract
According to a Bayesian framework, visual perception requires active interpretation of noisy sensory signals in light of prior information. One such mechanism, serial dependence, is thought to promote perceptual stability by assimilating current percepts with recent stimulus history. Combining a delayed orientation-adjustment paradigm with predictable (study 1) or unpredictable (study 2) task structure, we test two key predictions of this account in a novel context: first, that serial dependence should persist even in variable environments, and, second, that, within a given observer and context, this behavioral bias should be stable from one occasion to the next. Relying on data of 41 human volunteers and two separate experimental sessions, we confirm both hypotheses. Group-level, attractive serial dependence remained strong even in the face of volatile settings with multiple, unpredictable types of tasks, and, despite considerable interindividual variability, within-subject patterns of attractive and repulsive stimulus-history biases were highly stable from one experimental session to the next. In line with the hypothesized functional role of serial dependence, we propose that, together with previous work, our findings suggest the existence of a more general individual-specific fingerprint with which the past shapes current perception. Congruent with the Bayesian account, interindividual differences may then result from differential weighting of sensory evidence and prior information.
Collapse
Affiliation(s)
- Darinka Trübutschek
- Research Group Neural Circuits, Consciousness and Cognition, Max Planck Institute for Empirical Aesthetics, Frankfurt/Main, Germany
| | - Lucia Melloni
- Research Group Neural Circuits, Consciousness and Cognition, Max Planck Institute for Empirical Aesthetics, Frankfurt/Main, Germany
- Department of Neurology, NYU Grossman School of Medicine, New York, New York, USA
| |
Collapse
|
27
|
Manassi M, Murai Y, Whitney D. Serial dependence in visual perception: A meta-analysis and review. J Vis 2023; 23:18. [PMID: 37642639 PMCID: PMC10476445 DOI: 10.1167/jov.23.8.18] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 07/12/2023] [Indexed: 08/31/2023] Open
Abstract
Positive sequential dependencies are phenomena in which actions, perception, decisions, and memory of features or objects are systematically biased toward visual experiences from the recent past. Among many labels, serial dependencies have been referred to as priming, sequential dependencies, sequential effects, or serial effects. Despite extensive research on the topic, the field still lacks an operational definition of what counts as serial dependence. In this meta-analysis, we review the vast literature on serial dependence and quantitatively assess its key diagnostic characteristics across several different domains of visual perception. The meta-analyses fully characterize serial dependence in orientation, face, and numerosity perception. They show that serial dependence is defined by four main kinds of tuning: serial dependence decays with time (temporal-tuning), it depends on relative spatial location (spatial-tuning), it occurs only between similar features and objects (feature-tuning), and it is modulated by attention (attentional-tuning). We also review studies of serial dependence that report single observer data, highlighting the importance of individual differences in serial dependence. Finally, we discuss a range of outstanding questions and novel research avenues that are prompted by the meta-analyses. Together, the meta-analyses provide a full characterization of serial dependence as an operationally defined family of visual phenomena, and they outline several of the key diagnostic criteria for serial dependence that should serve as guideposts for future research.
Collapse
Affiliation(s)
- Mauro Manassi
- School of Psychology, University of Aberdeen, King's College, Aberdeen, UK
| | - Yuki Murai
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Osaka, Japan
| | - David Whitney
- Department of Psychology University of California, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
- Vision Science Group, University of California, Berkeley, CA, USA
| |
Collapse
|
28
|
Schlichting N, Fritz C, Zimmermann E. Motor variability modulates calibration of precisely timed movements. iScience 2023; 26:107204. [PMID: 37519900 PMCID: PMC10384242 DOI: 10.1016/j.isci.2023.107204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 02/23/2023] [Accepted: 06/21/2023] [Indexed: 08/01/2023] Open
Abstract
Interacting with the environment often requires precisely timed movements, challenging the brain to minimize the detrimental impact of neural noise. Recent research demonstrates that the brain exploits the variability of its temporal estimates and recalibrates perception accordingly. Time-critical movements, however, contain a sensory measurement and a motor stage. The brain must have knowledge of both in order to avoid maladapted behavior. By manipulating sensory and motor variability, we show that the sensorimotor system recalibrates sensory and motor uncertainty separately. Serial dependencies between observed interval durations in the previous and motor reproductions in the current trial were weighted by the variability of movements. These serial dependencies generalized across different effectors, but not to a visual discrimination task. Our results suggest that the brain has accurate knowledge about contributions of motor uncertainty to errors in temporal movements. This knowledge about motor uncertainty seems to be processed separately from knowledge about sensory uncertainty.
Collapse
Affiliation(s)
- Nadine Schlichting
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf 40225, Germany
| | - Clara Fritz
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf 40225, Germany
| | - Eckart Zimmermann
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf 40225, Germany
| |
Collapse
|
29
|
Maldonado Moscoso PA, Burr DC, Cicchini GM. Serial dependence improves performance and biases confidence-based decisions. J Vis 2023; 23:5. [PMID: 37410493 PMCID: PMC10337799 DOI: 10.1167/jov.23.7.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 06/06/2023] [Indexed: 07/07/2023] Open
Abstract
Perception depends on both the current sensory input and on the preceding stimuli history, a mechanism referred to as serial dependence (SD). One interesting, and somewhat controversial, question is whether serial dependence originates at the perceptual stage, which should lead to a sensory improvement, or at a subsequent decisional stage, causing solely a bias. Here, we studied the effects of SD in a novel manner by leveraging on the human capacity to spontaneously assess the quality of sensory information. Two noisy-oriented Gabor stimuli were simultaneously presented along with two bars of the same orientation as the Gabor stimuli. Participants were asked to choose which Gabor stimulus to judge and then make a forced-choice judgment of its orientation by selecting the appropriate response bar. On all trials, one of the Gabor stimuli had the same orientation as the Gabor in the same position on the previous trial. We explored whether continuity in orientation and position affected choice and accuracy. Results show that continuity of orientation leads to a persistent (up to four back) accuracy advantage and a higher preference in the selection of stimuli with the same orientation, and this advantage accumulates over trials. In contrast, analysis of the continuity of the selected position indicated that participants had a strong tendency to choose stimuli in the same position, but this behavior did not lead to an improvement in accuracy.
Collapse
Affiliation(s)
| | - David C Burr
- CIMEC - Center for Mind/Brain sciences, University of Trento, Italy
- Department of Neuroscience, Psychology, Pharmacology and Child Health, University of Florence, Firenze, Italy
| | | |
Collapse
|
30
|
Ren Z, Canas-Bajo T, Ghirardo C, Manassi M, Yu SX, Whitney D. Serial dependence in perception across naturalistic generative adversarial network-generated mammogram. J Med Imaging (Bellingham) 2023; 10:045501. [PMID: 37408983 PMCID: PMC10319294 DOI: 10.1117/1.jmi.10.4.045501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 05/12/2023] [Accepted: 06/20/2023] [Indexed: 07/07/2023] Open
Abstract
Purpose Human perception and decisions are biased toward previously seen stimuli. This phenomenon is known as serial dependence and has been extensively studied for the last decade. Recent evidence suggests that clinicians' judgments of mammograms might also be impacted by serial dependence. However, the stimuli used in previous psychophysical experiments on this question, consisting of artificial geometric shapes and healthy tissue backgrounds, were unrealistic. We utilized realistic and controlled generative adversarial network (GAN)-generated radiographs to mimic images that clinicians typically encounter. Approach Mammograms from the digital database for screening mammography (DDSM) were utilized to train a GAN. This pretrained GAN was then adopted to generate a large set of authentic-looking simulated mammograms: 20 circular morph continuums, each with 147 images, for a total of 2940 images. Using these stimuli in a standard serial dependence experiment, participants viewed a random GAN-generated mammogram on each trial and subsequently matched the GAN-generated mammogram encountered using a continuous report. The characteristics of serial dependence from each continuum were analyzed. Results We found that serial dependence affected the perception of all naturalistic GAN-generated mammogram morph continuums. In all cases, the perceptual judgments of GAN-generated mammograms were biased toward previously encountered GAN-generated mammograms. On average, perceptual decisions had 7% categorization errors that were pulled in the direction of serial dependence. Conclusions Serial dependence was found even in the perception of naturalistic GAN-generated mammograms created by a GAN. This supports the idea that serial dependence could, in principle, contribute to decision errors in medical image perception tasks.
Collapse
Affiliation(s)
- Zhihang Ren
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
| | - Teresa Canas-Bajo
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
| | - Cristina Ghirardo
- University of California, Berkeley, Department of Psychology, Berkeley, California, United States
| | - Mauro Manassi
- University of Aberdeen, King’s College, School of Psychology, Aberdeen, United Kingdom
| | - Stella X. Yu
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
- University of Michigan, Department of Electrical Engineering and Computer Science, Ann Arbor, Michigan, United States
| | - David Whitney
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
- University of California, Berkeley, Department of Psychology, Berkeley, California, United States
- University of California, Berkeley, Helen Wills Neuroscience Institute, Berkeley, California, United States
| |
Collapse
|
31
|
Luo J, Collins T. The Representational Similarity between Visual Perception and Recent Perceptual History. J Neurosci 2023; 43:3658-3665. [PMID: 36944487 PMCID: PMC10198448 DOI: 10.1523/jneurosci.2068-22.2023] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 01/19/2023] [Accepted: 02/18/2023] [Indexed: 03/23/2023] Open
Abstract
From moment to moment, the visual properties of objects in the world fluctuate because of external factors like ambient lighting, occlusion and eye movements, and internal (proximal) noise. Despite this variability in the incoming information, our perception is stable. Serial dependence, the behavioral attraction of current perceptual responses toward previously seen stimuli, may reveal a mechanism underlying stability: a spatiotemporally tuned operator that smooths over spurious fluctuations. The current study examined the neural underpinnings of serial dependence by recording the electroencephalographic (EEG) brain response of female and male human observers to prototypical objects (faces, cars, and houses) and morphs that mixed properties of two prototypes. Behavior was biased toward previously seen objects. Representational similarity analysis (RSA) revealed that responses evoked by visual objects contained information about the previous stimulus. The trace of previous representations in the response to the current object occurred immediately on object appearance, suggesting that serial dependence arises from a brain state or set that precedes processing of new input. However, the brain response to current visual objects was not representationally similar to the trace they leave on subsequent object representations. These results reveal that while past stimulus history influences current representations, this influence does not imply a shared neural code between the previous trial (memory) and the current trial (perception).SIGNIFICANCE STATEMENT The perception of visual objects is pulled toward instances of that object seen in the recent past. The neural underpinnings of this serial dependence remain to be fully investigated. The present study examined electroencephalographic (EEG) responses to faces, cars, and houses, and ambiguous between-category morphs. With representational similarity analysis (RSA), we showed (1) object-specific neural patterns that differentiate the three categories; (2) that the response to the current object contains information about the previous object, mirroring behavioral serial dependence; (3) that the object-specific neural pattern about the past was different from that in the current response, revealing that while past stimulus history influences current representations, this does not imply a shared neural code between the previous trial (memory) and the current trial (perception).
Collapse
Affiliation(s)
- Junlian Luo
- Integrative Neuroscience and Cognition Center, Université Paris Cité and Centre Nationale de la Recherche Scientifique, Paris 75006, France
| | - Thérèse Collins
- Integrative Neuroscience and Cognition Center, Université Paris Cité and Centre Nationale de la Recherche Scientifique, Paris 75006, France
| |
Collapse
|
32
|
Sury D, Rubinsten O. Implicit Processing of Numerical Order: Evidence from a Continuous Interocular Flash Suppression Study. J Intell 2023; 11:jintelligence11050096. [PMID: 37233345 DOI: 10.3390/jintelligence11050096] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Revised: 05/07/2023] [Accepted: 05/10/2023] [Indexed: 05/27/2023] Open
Abstract
Processing the ordered relationships between sequential items is a key element in many cognitive abilities that are important for survival. Specifically, order may play a crucial role in numerical processing. Here, we assessed the existence of a cognitive system designed to implicitly evaluate numerical order, by combining continuous flash suppression with a priming method in a numerical enumeration task. In two experiments and diverse statistical analysis, targets that required numerical enumeration were preceded by an invisibly ordered or non-ordered numerical prime sequence. The results of both experiments showed that enumeration for targets that appeared after an ordered prime was significantly faster, while the ratio of the prime sequences produced no significant effect. The findings suggest that numerical order is processed implicitly and affects a basic cognitive ability: enumeration of quantities.
Collapse
Affiliation(s)
- Dana Sury
- Department of Learning Disabilities, Faculty of Education, Beit Berl College, Kfar Saba 4490500, Israel
| | - Orly Rubinsten
- Edmond J. Safra Brain Research Center for the Study of Learning Disabilities, Department of Learning Disabilities, University of Haifa, Haifa 3498838, Israel
| |
Collapse
|
33
|
Wang T, Luo Y, Ivry RB, Tsay JS, Pöppel E, Bao Y. A unitary mechanism underlies adaptation to both local and global environmental statistics in time perception. PLoS Comput Biol 2023; 19:e1011116. [PMID: 37146089 PMCID: PMC10191274 DOI: 10.1371/journal.pcbi.1011116] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Revised: 05/17/2023] [Accepted: 04/19/2023] [Indexed: 05/07/2023] Open
Abstract
Our duration estimation flexibly adapts to the statistical properties of the temporal context. Humans and non-human species exhibit a perceptual bias towards the mean of durations previously observed as well as serial dependence, a perceptual bias towards the duration of recently processed events. Here we asked whether those two phenomena arise from a unitary mechanism or reflect the operation of two distinct systems that adapt separately to the global and local statistics of the environment. We employed a set of duration reproduction tasks in which the target duration was sampled from distributions with different variances and means. The central tendency and serial dependence biases were jointly modulated by the range and the variance of the prior, and these effects were well-captured by a unitary mechanism model in which temporal expectancies are updated after each trial based on perceptual observations. Alternative models that assume separate mechanisms for global and local contextual effects failed to capture the empirical results.
Collapse
Affiliation(s)
- Tianhe Wang
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Department of Psychology and Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, United States of America
| | - Yingrui Luo
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
| | - Richard B. Ivry
- Department of Psychology and Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, United States of America
| | - Jonathan S. Tsay
- Department of Psychology and Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, United States of America
| | - Ernst Pöppel
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Institute of Medical Psychology, Ludwig Maximilian University, Munich, Germany
| | - Yan Bao
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Institute of Medical Psychology, Ludwig Maximilian University, Munich, Germany
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| |
Collapse
|
34
|
Hajonides JE, van Ede F, Stokes MG, Nobre AC, Myers NE. Multiple and Dissociable Effects of Sensory History on Working-Memory Performance. J Neurosci 2023; 43:2730-2740. [PMID: 36868858 PMCID: PMC10089243 DOI: 10.1523/jneurosci.1200-22.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Revised: 11/30/2022] [Accepted: 01/19/2023] [Indexed: 03/05/2023] Open
Abstract
Behavioral reports of sensory information are biased by stimulus history. The nature and direction of such serial-dependence biases can differ between experimental settings; both attractive and repulsive biases toward previous stimuli have been observed. How and when these biases arise in the human brain remains largely unexplored. They could occur either via a change in sensory processing itself and/or during postperceptual processes such as maintenance or decision-making. To address this, we tested 20 participants (11 female) and analyzed behavioral and magnetoencephalographic (MEG) data from a working-memory task in which participants were sequentially presented with two randomly oriented gratings, one of which was cued for recall at the end of the trial. Behavioral responses showed evidence for two distinct biases: (1) a within-trial repulsive bias away from the previously encoded orientation on the same trial, and (2) a between-trial attractive bias toward the task-relevant orientation on the previous trial. Multivariate classification of stimulus orientation revealed that neural representations during stimulus encoding were biased away from the previous grating orientation, regardless of whether we considered the within-trial or between-trial prior orientation, despite opposite effects on behavior. These results suggest that repulsive biases occur at the level of sensory processing and can be overridden at postperceptual stages to result in attractive biases in behavior.SIGNIFICANCE STATEMENT Recent experience biases behavioral reports of sensory information, possibly capitalizing on the temporal regularity in our environment. It is still unclear at what stage of stimulus processing such serial biases arise. Here, we recorded behavior and neurophysiological [magnetoencephalographic (MEG)] data to test whether neural activity patterns during early sensory processing show the same biases seen in participants' reports. In a working-memory task that produced multiple biases in behavior, responses were biased toward previous targets, but away from more recent stimuli. Neural activity patterns were uniformly biased away from all previously relevant items. Our results contradict proposals that all serial biases arise at an early sensory processing stage. Instead, neural activity exhibited mostly adaptation-like responses to recent stimuli.
Collapse
Affiliation(s)
- Jasper E Hajonides
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, OX3 7JX, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford, OX2 6GG, United Kingdom
| | - Freek van Ede
- Department of Applied and Experimental Psychology, Vrije Universiteit Amsterdam, 1081 BT, Amsterdam, Netherlands
| | - Mark G Stokes
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, OX3 7JX, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford, OX2 6GG, United Kingdom
| | - Anna C Nobre
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, OX3 7JX, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford, OX2 6GG, United Kingdom
| | - Nicholas E Myers
- School of Psychology, University of Nottingham, Nottingham, NG7 2RD, United Kingdom
| |
Collapse
|
35
|
Bogotá JD, Djebbara Z. Time-consciousness in computational phenomenology: a temporal analysis of active inference. Neurosci Conscious 2023; 2023:niad004. [PMID: 36937108 PMCID: PMC10022603 DOI: 10.1093/nc/niad004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Revised: 01/13/2023] [Accepted: 02/23/2023] [Indexed: 03/19/2023] Open
Abstract
Time plays a significant role in science and everyday life. Despite being experienced as a continuous flow, computational models of consciousness are typically restricted to a sequential temporal structure. This difference poses a serious challenge for computational phenomenology-a novel field combining phenomenology and computational modelling. By analysing the temporal structure of the active inference framework, we show that an integrated continuity of time can be achieved by merging Husserlian temporality with a sequential order of time. We also show that a Markov blanket of the present moment integrates past and future moments of both subjective temporality and objective time in an asynchronous manner. By applying the integrated continuity, it is clear that active inference makes use of both subjective temporality and objective time in an integrated fashion. We conclude that active inference, on a temporal note, qualifies as a computational model for phenomenological investigations.
Collapse
Affiliation(s)
- Juan Diego Bogotá
- Department of Social and Political Sciences, Philosophy, and Anthropology, University of Exeter, Exeter, United Kingdom
- Grupo de investigación Filosofía y cognición, Universidad Nacional de Colombia, Bogotá, Colombia
| | - Zakaria Djebbara
- Department of Architecture, Design, Media, and Technology, Aalborg University, Rendsburggade 14, Aalborg 9000, Denmark
- Biological Psychology and Neuroergonomics, Technical University of Berlin, Fasanenstraße 1, Berlin 10623, Germany
| |
Collapse
|
36
|
Wiesing M, Zimmermann E. Serial dependencies between locomotion and visual space. Sci Rep 2023; 13:3302. [PMID: 36849556 PMCID: PMC9970965 DOI: 10.1038/s41598-023-30265-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Accepted: 02/20/2023] [Indexed: 03/01/2023] Open
Abstract
How do we know the spatial distance of objects around us? Only by physical interaction within an environment can we measure true physical distances. Here, we investigated the possibility that travel distances, measured during walking, could be used to calibrate visual spatial perception. The sensorimotor contingencies that arise during walking were carefully altered using virtual reality and motion tracking. Participants were asked to walk to a briefly highlighted location. During walking, we systematically changed the optic flow, i.e., the ratio between the visual and physical motion speed. Although participants remained unaware of this manipulation, they walked a shorter or longer distance as a function of the optic flow speed. Following walking, participants were required to estimate the perceived distance of visual objects. We found that visual estimates were serially dependent on the experience of the manipulated flow in the previous trial. Additional experiments confirmed that to affect visual perception, both visual and physical motion are required. We conclude that the brain constantly uses movements to measure space for both, actions, and perception.
Collapse
Affiliation(s)
- Michael Wiesing
- Institute for Experimental Psychology, Heinrich Heine University Duesseldorf, Düsseldorf, Germany.
| | - Eckart Zimmermann
- Institute for Experimental Psychology, Heinrich Heine University Duesseldorf, Düsseldorf, Germany
| |
Collapse
|
37
|
Abreo S, Gergen A, Gupta N, Samaha J. Effects of satisfying and violating expectations on serial dependence. J Vis 2023; 23:6. [PMID: 36753122 PMCID: PMC9919681 DOI: 10.1167/jov.23.2.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 01/05/2023] [Indexed: 02/09/2023] Open
Abstract
Serial dependence refers to the phenomenon that observers tend to report stimuli as being more similar to previous stimuli than they really are (attractive dependence) or, in some cases, as more different than they really are (repulsive dependence). Numerous experiments have demonstrated serial dependence for a range of modalities and stimulus features, highlighting the role of bottom-up sensory interactions. However, comparatively less research has focused on how higher-level cognitive factors, such as expectations, might influence serial dependence. Here, we manipulated expectations by having observers respond to target luminance gratings that occurred at the end of a sequence of non-target gratings. The sequence either rotated predictably (inducing an expectation), varied randomly (inducing no expectation), or rotated predictably but had a random target orientation (violating expectations). We found that observers produced less errors and indicated less uncertainty in their estimations of expected stimuli but their responses were biased away from the penultimate stimulus in the sequence (repulsive dependence). In contrast, following random sequences, responses showed an attractive bias to the penultimate stimulus in the sequence. Unexpected targets showed a mixture of both biases, such that when targets happened (by chance) to appear as expected, responses were repulsed, but responses to target orientations that more clearly violated expectations were attracted. These results indicate that, whereas attraction to previous stimuli may be a default strategy employed in response to random and unexpected events, certain expectations can reverse the default bias into a repulsive one.
Collapse
Affiliation(s)
- Stefan Abreo
- Molecular, Cell, Developmental Biology Department, University of California, Santa Cruz, CA, USA
| | - Antonia Gergen
- Psychology Department, University of California - Santa Cruz, Santa Cruz, CA, USA
| | - Nitu Gupta
- Psychology Department, University of California - Santa Cruz, Santa Cruz, CA, USA
| | - Jason Samaha
- Psychology Department, University of California - Santa Cruz, Santa Cruz, CA, USA
| |
Collapse
|
38
|
Pascucci D, Tanrikulu ÖD, Ozkirli A, Houborg C, Ceylan G, Zerr P, Rafiei M, Kristjánsson Á. Serial dependence in visual perception: A review. J Vis 2023; 23:9. [PMID: 36648418 PMCID: PMC9871508 DOI: 10.1167/jov.23.1.9] [Citation(s) in RCA: 62] [Impact Index Per Article: 31.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 11/18/2022] [Indexed: 01/18/2023] Open
Abstract
How does the visual system represent continuity in the constantly changing visual input? A recent proposal is that vision is serially dependent: Stimuli seen a moment ago influence what we perceive in the present. In line with this, recent frameworks suggest that the visual system anticipates whether an object seen at one moment is the same as the one seen a moment ago, binding visual representations across consecutive perceptual episodes. A growing body of work supports this view, revealing signatures of serial dependence in many diverse visual tasks. Yet, the variety of disparate findings and interpretations calls for a more general picture. Here, we survey the main paradigms and results over the past decade. We also focus on the challenge of finding a relationship between serial dependence and the concept of "object identity," taking centuries-long history of research into account. Among the seemingly contrasting findings on serial dependence, we highlight common patterns that may elucidate the nature of this phenomenon and attempt to identify questions that are unanswered.
Collapse
Affiliation(s)
- David Pascucci
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Ömer Daglar Tanrikulu
- Department of Psychology, University of New Hampshire, Durham, NH, USA
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Ayberk Ozkirli
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Christian Houborg
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Gizay Ceylan
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Paul Zerr
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Mohsen Rafiei
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Árni Kristjánsson
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| |
Collapse
|
39
|
Ranieri G, Benedetto A, Ho HT, Burr DC, Morrone MC. Evidence of Serial Dependence from Decoding of Visual Evoked Potentials. J Neurosci 2022; 42:8817-8825. [PMID: 36223998 PMCID: PMC9698666 DOI: 10.1523/jneurosci.1879-21.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 07/19/2022] [Accepted: 07/21/2022] [Indexed: 12/29/2022] Open
Abstract
It is well known that recent sensory experience influences perception, recently demonstrated by a phenomenon termed "serial dependence." However, its underlying neural mechanisms are poorly understood. We measured ERP responses to pairs of stimuli presented randomly to the left or right hemifield. Seventeen male and female adults judged whether the upper or lower half of the grating had higher spatial frequency, independent of the horizontal position of the grating. This design allowed us to trace the memory signal modulating task performance and also the implicit memory signal associated with hemispheric position. Using classification techniques, we decoded the position of the current and previous stimuli and the response from voltage scalp distributions of the current trial. Classification of previous responses reached full significance only 700 ms after presentation of the current stimulus, consistent with retrieval of an activity-silent memory trace. Cross-condition classification accuracy of past responses (trained on current responses) correlated with the strength of serial dependence effects of individual participants. Overall, our data provide evidence for a silent memory signal that can be decoded from the EEG potential, which interacts with the neural processing of the current stimulus. This silent memory signal could be the physiological substrate subserving at least one type of serial dependence.SIGNIFICANCE STATEMENT The neurophysiological underpinnings of how past perceptual experience affects current perception are poorly understood. Here, we show that recent experience is reactivated when a new stimulus is presented and that the strength of this reactivation correlates with serial biases in individual participants, suggesting that serial dependence is established on the basis of a silent memory signal.
Collapse
Affiliation(s)
- Giacomo Ranieri
- Department of Neuroscience, Psychology, Pharmacology, and Child Health, University of Florence, 50135 Florence, Italy
| | - Alessandro Benedetto
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, 56123 Pisa, Italy
| | - Hao Tam Ho
- Department of Neuroscience, Psychology, Pharmacology, and Child Health, University of Florence, 50135 Florence, Italy
| | - David C Burr
- Department of Neuroscience, Psychology, Pharmacology, and Child Health, University of Florence, 50135 Florence, Italy
| | - Maria Concetta Morrone
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, 56123 Pisa, Italy
| |
Collapse
|
40
|
Moon J, Kwon OS. Attractive and repulsive effects of sensory history concurrently shape visual perception. BMC Biol 2022; 20:247. [PMID: 36345010 PMCID: PMC9641899 DOI: 10.1186/s12915-022-01444-7] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Accepted: 10/19/2022] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Sequential effects of environmental stimuli are ubiquitous in most behavioral tasks involving magnitude estimation, memory, decision making, and emotion. The human visual system exploits continuity in the visual environment, which induces two contrasting perceptual phenomena shaping visual perception. Previous work reported that perceptual estimation of a stimulus may be influenced either by attractive serial dependencies or repulsive aftereffects, with a number of experimental variables suggested as factors determining the direction and magnitude of sequential effects. Recent studies have theorized that these two effects concurrently arise in perceptual processing, but empirical evidence that directly supports this hypothesis is lacking, and it remains unclear whether and how attractive and repulsive sequential effects interact in a trial. Here we show that the two effects concurrently modulate estimation behavior in a typical sequence of perceptual tasks. RESULTS We first demonstrate that observers' estimation error as a function of both the previous stimulus and response cannot be fully described by either attractive or repulsive bias but is instead well captured by a summation of repulsion from the previous stimulus and attraction toward the previous response. We then reveal that the repulsive bias is centered on the observer's sensory encoding of the previous stimulus, which is again repelled away from its own preceding trial, whereas the attractive bias is centered precisely on the previous response, which is the observer's best prediction about the incoming stimuli. CONCLUSIONS Our findings provide strong evidence that sensory encoding is shaped by dynamic tuning of the system to the past stimuli, inducing repulsive aftereffects, and followed by inference incorporating the prediction from the past estimation, leading to attractive serial dependence.
Collapse
Affiliation(s)
- Jongmin Moon
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan, 44919, South Korea
| | - Oh-Sang Kwon
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan, 44919, South Korea.
| |
Collapse
|
41
|
Haman M, Patro K. More linear than log? Non-symbolic number-line estimation in 3- to 5-year-old children. Front Psychol 2022; 13:1003696. [PMID: 36389566 PMCID: PMC9659870 DOI: 10.3389/fpsyg.2022.1003696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 10/03/2022] [Indexed: 11/04/2022] Open
Abstract
The number-line estimation task has become one of the most important methods in numerical cognition research. Originally applied as a direct measure of spatial number representation, it became also informative regarding various other aspects of number processing and associated strategies. However, most of this work and associated conclusions concerns processing numbers in a symbolic format, by school children and older subjects. Symbolic number system is formally taught and trained at school, and its basic mathematical properties (e.g., equidistance, ordinality) can easily be transferred into a spatial format of an oriented number line. This triggers the question on basic characteristics of number line estimation before children get fully familiar with the symbolic number system, i.e., when they mostly rely on approximate system for non-symbolic quantities. In our three studies, we examine therefore how preschool children (3–5-years old) estimate position of non-symbolic quantities on a line, and how this estimation is related to the developing symbolic number knowledge and cultural (left-to-right) directionality. The children were tested with the Give-a-number task, then they performed a computerized number-line task. In Experiment 1, lines bounded with sets of 1 and 20 elements going left-to-right or right-to-left were used. Even in the least numerically competent group, the linear model better fit the estimates than the logarithmic or cyclic power models. The line direction was irrelevant. In Experiment 2, a 1–9 left-to-right oriented line was used. Advantage of linear model was found at group level, and variance of estimates correlated with tested numerosities. In Experiment 3, a position-to-number procedure again revealed the advantage of the linear model, although the strategy of selecting an option more similar to the closer end of the line was prevalent. The precision of estimation increased with the mastery of counting principles in all three experiments. These results contradict the hypothesis of the log-to-linear shift in development of basic numerical representation, rather supporting the linear model with scalar variance. However, the important question remains whether the number-line task captures the nature of the basic numerical representation, or rather the strategies of mapping that representation to an external space.
Collapse
Affiliation(s)
- Maciej Haman
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
- *Correspondence: Maciej Haman,
| | - Katarzyna Patro
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Department of Psychology, University of Tuebingen, Tübingen, Germany
| |
Collapse
|
42
|
Cicchini GM, D'Errico G, Burr DC. Crowding results from optimal integration of visual targets with contextual information. Nat Commun 2022; 13:5741. [PMID: 36180497 PMCID: PMC9525686 DOI: 10.1038/s41467-022-33508-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Accepted: 09/16/2022] [Indexed: 11/22/2022] Open
Abstract
Crowding is the inability to recognize an object in clutter, usually considered a fundamental low-level bottleneck to object recognition. Here we advance and test an alternative idea, that crowding, like predictive phenomena such as serial dependence, results from optimizing strategies that exploit redundancies in natural scenes. This notion leads to several testable predictions: crowding should be greatest for unreliable targets and reliable flankers; crowding-induced biases should be maximal when target and flankers have similar orientations, falling off for differences around 20°; flanker interference should be associated with higher precision in orientation judgements, leading to lower overall error rate; effects should be maximal when the orientation of the target is near that of the average of the flankers, rather than to that of individual flankers. Each of these predictions were supported, and could be simulated with ideal-observer models that maximize performance. The results suggest that while crowding can affect object recognition, it may be better understood not as a processing bottleneck, but as a consequence of efficient exploitation of the spatial redundancies of the natural world.
Collapse
Affiliation(s)
| | | | - David Charles Burr
- Institute of Neuroscience, CNR, via Moruzzi, 1, 56124, Pisa, Italy.
- Department of Neurosciences, Psychology, Drug Research and Child Health, University of Florence, viale Pieraccini, 6, 50139, Firenze, Italy.
| |
Collapse
|
43
|
Abstract
Despite the fundamental importance of visual motion processing, our understanding of how the brain represents basic aspects of motion is incomplete. While it is generally believed that direction is the main representational feature of motion, motion processing is also influenced by nondirectional orientation signals that are present in most motion stimuli. Here, we aimed to test whether this nondirectional motion axis contributes motion perception even when orientation is completely absent from the stimulus. Using stimuli with and without orientation signals, we found that serial dependence in a simple motion direction estimation task was predominantly determined by the orientation of the previous motion stimulus. Moreover, the observed attraction profiles closely matched the characteristic pattern of serial attraction found in orientation perception. Evidently, the sequential integration of motion signals strongly depends on the orientation of motion, indicating a fundamental role of nondirectional orientation in the coding of visual motion direction.
Collapse
|
44
|
Abstract
Identifying the neural correlates of visual serial dependence has lagged behind the behavioral understanding. A new study in PLOS Biology provides a model of interpreting the complex relationship between physiology and behavior in studies of serial dependence.
Collapse
Affiliation(s)
- David Whitney
- Department of Psychology, University of California, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California, Berkeley, California, United States of America
- Vision Science Group, University of California, Berkeley, California, United States of America
- * E-mail:
| | - Mauro Manassi
- School of Psychology, University of Aberdeen, King’s College, Aberdeen, United Kingdom
| | - Yuki Murai
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan
| |
Collapse
|
45
|
Galluzzi F, Benedetto A, Cicchini GM, Burr DC. Visual priming and serial dependence are mediated by separate mechanisms. J Vis 2022; 22:1. [PMID: 36053134 PMCID: PMC9440610 DOI: 10.1167/jov.22.10.1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Perceptual history influences current perception, readily revealed by visual priming (the facilitation of responses on repeated presentations of similar stimuli) and by serial dependence (systematic biases toward the previous stimuli). We asked whether the two phenomena shared perceptual mechanisms. We modified the standard “priming of pop-out” paradigm to measure both priming and serial dependence concurrently. The stimulus comprised three grating patches, one or two red, and the other green. Participants identified the color singleton (either red or green), and reproduced its orientation. Trial sequences were designed to maximize serial dependence, and long runs of priming color and position. The results showed strong effects of priming, both on reaction times and accuracy, which accumulated steadily over time, as generally reported in the literature. The serial dependence effects were also strong, but did not depend on previous color, nor on the run length. Reaction times measured under various conditions of repetition or change of priming color or position were reliably correlated with imprecision in orientation reproduction, but reliably uncorrelated with magnitude of serial dependence. The results suggest that visual priming and serial dependence are mediated by different neural mechanisms. We propose that priming affects sensitivity, possibly via attention-like mechanisms, whereas serial dependence affects criteria, two orthogonal dimensions in the signal detection theory.
Collapse
Affiliation(s)
- Filippo Galluzzi
- Institute of Neuroscience, National Research Council, Pisa, Italy.,Centre for Synaptic Neuroscience and Technology, Italian Institute of Technology, Genova, Italy.,
| | - Alessandro Benedetto
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy.,Department of Brain and Cognitive Sciences, University of Rochester, Center for Visual Science, Rochester, NY, USA.,
| | | | - David C Burr
- Department of Neuroscience, Psychology, Pharmacology and Child Health, University of Florence, Florence, Italy.,Institute of Neuroscience, National Research Council, Pisa, Italy.,School of Psychology, University of Sydney, Sydney, Australia.,
| |
Collapse
|
46
|
Sheehan TC, Serences JT. Attractive serial dependence overcomes repulsive neuronal adaptation. PLoS Biol 2022; 20:e3001711. [PMID: 36067148 PMCID: PMC9447932 DOI: 10.1371/journal.pbio.3001711] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 06/14/2022] [Indexed: 01/12/2023] Open
Abstract
Sensory responses and behavior are strongly shaped by stimulus history. For example, perceptual reports are sometimes biased toward previously viewed stimuli (serial dependence). While behavioral studies have pointed to both perceptual and postperceptual origins of this phenomenon, neural data that could elucidate where these biases emerge is limited. We recorded functional magnetic resonance imaging (fMRI) responses while human participants (male and female) performed a delayed orientation discrimination task. While behavioral reports were attracted to the previous stimulus, response patterns in visual cortex were repelled. We reconciled these opposing neural and behavioral biases using a model where both sensory encoding and readout are shaped by stimulus history. First, neural adaptation reduces redundancy at encoding and leads to the repulsive biases that we observed in visual cortex. Second, our modeling work suggest that serial dependence is induced by readout mechanisms that account for adaptation in visual cortex. According to this account, the visual system can simultaneously improve efficiency via adaptation while still optimizing behavior based on the temporal structure of natural stimuli.
Collapse
Affiliation(s)
- Timothy C. Sheehan
- Neurosciences Graduate Program, University of California San Diego, La Jolla, California, United States of America
| | - John T. Serences
- Neurosciences Graduate Program, University of California San Diego, La Jolla, California, United States of America
- Department of Psychology, University of California San Diego, La Jolla, California, United States of America
- Kavli Institute for Brain and Mind, University of California San Diego, La Jolla, California, United States of America
| |
Collapse
|
47
|
Luo M, Zhang H, Luo H. Cartesian coordinates scaffold stable spatial perception over time. J Vis 2022; 22:13. [PMID: 35857298 PMCID: PMC9315070 DOI: 10.1167/jov.22.8.13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
Abstract
Visual systems exploit temporal continuity principles to achieve stable spatial perception, manifested as the serial dependence and central tendency effects. These effects are posited to reflect a smoothing process whereby past and present information integrates over time to decrease noise and stabilize perception. Meanwhile, the basic spatial coordinate—Cartesian versus polar—that scaffolds the integration process in two-dimensional continuous space remains unknown. The spatial coordinates are largely related to the allocentric and egocentric reference frames and presumably correspond with early and late processing stages in spatial perception. Here, four experiments consistently demonstrate that Cartesian outperforms polar coordinates in characterizing the serial bias—serial dependence and central tendency effect—in two-dimensional continuous spatial perception. The superiority of Cartesian coordinates is robust, independent of task environment (online and offline task), experimental length (short and long blocks), spatial context (shape of visual mask), and response modality (keyboard and mouse). Taken together, the visual system relies on the Cartesian coordinates for spatiotemporal integration to facilitate stable representation of external information, supporting the involvement of allocentric reference frame and top-down modulation in spatial perception over long time intervals.
Collapse
Affiliation(s)
- Minghao Luo
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China.,Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China.,
| | - Huihui Zhang
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China.,Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China.,
| | - Huan Luo
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China.,Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China.,
| |
Collapse
|
48
|
Dotan D, Dehaene S. Tracking priors and their replacement: Mental dynamics of decision making in the number-line task. Cognition 2022; 224:105069. [DOI: 10.1016/j.cognition.2022.105069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Revised: 01/02/2022] [Accepted: 02/16/2022] [Indexed: 01/29/2023]
|
49
|
The Dynamic Boundaries of the Self:Serial Dependence in the Sense of Agency. Cortex 2022; 152:109-121. [DOI: 10.1016/j.cortex.2022.03.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 01/17/2022] [Accepted: 03/19/2022] [Indexed: 11/23/2022]
|
50
|
Kondo A, Murai Y, Whitney D. The test-retest reliability and spatial tuning of serial dependence in orientation perception. J Vis 2022; 22:5. [PMID: 35293956 PMCID: PMC8944387 DOI: 10.1167/jov.22.4.5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 02/08/2022] [Indexed: 11/25/2022] Open
Abstract
Humans perceive objects and scenes consistently, even in situations where visual input is noisy and unstable. One of the mechanisms that underlies this perceptual stability is serial dependence, whereby the perception of objects or features at any given moment is pulled toward what was previously seen. Although recent findings from several studies have reported large individual differences in serial dependence, it is not clear how stable the serial dependence is within an individual. Here, we investigated the stability of serial dependence in orientation perception over two different days within the same observers. In addition, we also examined the visual field location specificity of perceptual serial dependence. On each trial, observers viewed a Gabor patch and then reported its apparent orientation by adjusting the orientation of a bar. For each observer, the Gabor was located in the foveal or peripheral (10° right or left eccentricity) visual field on both days or changed location from day to day. The results showed a very high degree of test-retest reliability in serial dependence measured across days within individual observers. Interestingly, this high within-subject consistency was only found when serial dependence was measured at the same visual field location. These results suggest that individual differences in serial dependence are stable across days, and that the spatiotemporal range in which the previous stimulus assimilates the perception of the current stimulus (the continuity field) may vary across different visual field locations in an observer-specific manner.
Collapse
Affiliation(s)
- Aki Kondo
- Waseda Institute for Advanced Study, Waseda University, Tokyo, Japan
| | - Yuki Murai
- University of California, Berkeley, Berkeley, CA, USA
- Osaka University, Osaka, Japan
- Japan Society for the Promotion of Science, Tokyo, Japan
| | - David Whitney
- University of California, Berkeley, Berkeley, CA, USA
| |
Collapse
|