Serial dependence in position occurs at the time of perception

Opposing serial effects of stimulus and choice in speech perception scale with context variability

In this study, we investigated serial effects on the perception of auditory vowel stimuli across three experimental setups with different degrees of context variability. Aligning with recent findings in visual perception, our results confirm the existence of two distinct processes in serial dependence: a repulsive sensory effect coupled with an attractive decisional effect. Importantly, our study extends these observations to the auditory domain, demonstrating parallel serial effects in audition. Furthermore, we uncover context variability effects, revealing a linear pattern for the repulsive perceptual effect and a quadratic pattern for the attractive decisional effect. These findings support the presence of adaptive sensory mechanisms underlying the repulsive effects, while higher-level mechanisms appear to govern the attractive decisional effect. The study provides valuable insights into the interplay of attractive and repulsive serial effects in auditory perception and contributes to our understanding of the underlying mechanisms.

A Bayesian inference model can predict the effects of attention on the serial dependence in heading estimation from optic flow

It has been demonstrated that observers can accurately estimate their self-motion direction (i.e., heading) from optic flow, which can be affected by attention. However, it remains unclear how attention affects the serial dependence in the estimation. In the current study, participants conducted two experiments. The results showed that the estimation accuracy decreased when attentional resources allocated to the heading estimation task were reduced. Additionally, the estimates of currently presented headings were biased toward the headings of previously seen headings, showing serial dependence. Especially, this effect decreased (increased) when the attentional resources allocated to the previously (currently) seen headings were reduced. Furthermore, importantly, we developed a Bayesian inference model, which incorporated attention-modulated likelihoods and qualitatively predicted changes in the estimation accuracy and serial dependence. In summary, the current study shows that attention affects the serial dependence in heading estimation from optic flow and reveals the Bayesian computational mechanism behind the heading estimation.

Working memory flips the direction of serial bias through memory-based decision

Reported perception of a new stimulus is either attracted toward or repelled away from task-irrelevant prior stimuli. While prevailing theories propose that the opposing serial biases may stem from distinct stages of information processing, the exact role of working memory (WM) in the serial bias remains unclear despite its consistent involvement in nearly all pertinent studies. Additionally, it is not well understood whether this bias is primarily driven by the biased representation itself or by the decision-making process for the new stimulus. In the present study, we used an orientation delayed estimation paradigm with an attention-demanding intervening task, designed to disrupt the maintenance of stimulus information to investigate the role of WM in serial bias. In the analysis, we scrutinized the trajectory of mouse reports and response time to investigate how the response unfolds over time. Our findings indicate that the serial bias went from repulsive to attractive when WM maintenance was interrupted by the intervening task, and that the associated response trajectories and response time exhibited patterns that cannot be explained by the biased representation alone. These results demonstrate that the task-irrelevant prior stimulus influences the decision for the new stimulus, with the direction of the bias being determined by attentional demand during WM maintenance, thereby placing significant constraints on existing theories on the serial bias effect.

The impact of task measurements on sequential dependence: a comparison between temporal reproduction and discrimination tasks

Decisions about a current stimulus are influenced by previously encountered stimuli, leading to sequential bias. However, the specific processing levels at which serial dependence emerges remain unclear. Despite considerable evidence pointing to contributions from perceptual and post-perceptual processes, as well as response carryover effects impacting subsequent judgments, research into how different task measurements affect sequential dependencies is limited. To address this gap, the present study investigated the role of task type in shaping sequential effects in time perception, employing a random-dot kinematogram (RDK) in a post-cue paradigm. Participants had to remember both the duration and the direction of the RDK movement and perform the task based on a post-cue, which was equally likely to be direction or duration. To delineate the task type, we employed the temporal bisection task in Experiment 1 and the duration reproduction task in Experiment 2. Both experiments revealed a significant sequential bias: durations were perceived as longer following longer previous durations, and vice versa. Intriguingly, the sequential effect was enhanced in the reproduction task following the same reproduction task (Experiment 2), but did not show significant variation by the task type in the bisection task (Experiment 1). Moreover, comparable response carryover effects were observed across two experiments. We argue that the differential impacts of task types on sequential dependence lies in the involvement of memory reactivation process in the decision stage, while the post-decision response carryover effect may reflect the assimilation by subjective, rather than objective, durations, potentially linking to the sticky pacemaker rate and/or decisional inertia.

Opposing sequential biases in direction and time reproduction: Influences of task relevance and working memory

Our current perception and decision-making are shaped by recent experiences, a phenomenon known as serial dependence. While serial dependence is well-documented in visual perception and has been recently explored in time perception, their functional similarities across non-temporal and temporal domains remain elusive, particularly in relation to task relevance and working memory load. To address this, we designed a unified experimental paradigm using coherent motion stimuli to test both direction and time reproduction. The direction and time tasks were randomly mixed across trials. Additionally, we introduced pre-cue versus post-cue settings in separate experiments to manipulate working memory load during the encoding phase. We found attractive biases in time reproduction but repulsive biases in direction estimation. Notably, the temporal attraction was more pronounced when the preceding task was also time-related. In contrast, the direction repulsion remained unaffected by the nature of the preceding task. Additionally, both attractive and repulsive biases were enhanced by the post-cue compared to the pre-cue. Our findings suggest that opposing sequential effects in non-temporal and temporal domains may originate from different processing stages linked to sensory adaptation and post-perceptual processes involving working memory.

Integration of history information Drives Serial Dependence and Stabilizes Working Memory Representations

Serial dependence has shown seemingly contradictory effects on visual perception and working memory. While serial dependence promotes perpetual and mnemonic stability, it biases behavioral reports toward prior information. The neural mechanisms that drive both biasing and adaptive stabilizing effects are not well understood. We proposed and tested a reactivation and integration mechanism that can account for these contradictory effects. We used multivariate pattern analyses of EEG data (26 human participants, 17 females, 9 males) to examine the reactivation of prior reported orientation during the delay period of a visual working memory task. The reactivation strength of prior reports, but not prior sensory items, was predictive of the magnitude of serial dependency biases. These reactivated representations integrated with the representation of the current memory item and improved the ability to decode the current contents of memory. Overall, our data provide convergent evidence suggesting that prior reports in a visual working memory task are reactivated on the subsequent trial and become integrated with current memory representations. This similarity-dependent reactivation mechanism drives both report biasing and stabilization effects attributed to serial dependence in working memory.

Visual continuum in non-human animals: serial dependence revealed in dogs

Serial dependence is a recently described phenomenon by which the perceptual evaluation of a stimulus is biased by a previously attended one. By integrating stimuli over time, serial dependence is believed to ensure a stable conscious experience. Despite increasing studies in humans, it is unknown if the process occurs also in other species. Here, we assessed whether serial dependence occurs in dogs. To this aim, dogs were trained on a quantity discrimination task before being presented with a discrimination where one of the discriminanda was preceded by a task-irrelevant stimulus. If dogs are susceptible to serial dependence, the task-irrelevant stimulus was hypothesized to influence the perception of the subsequently presented quantity. Our results revealed that dogs perceived the currently presented quantity to be closer to the one presented briefly before, in accordance with serial dependence. The direction and strength of the effect were comparable to those observed in humans. Data regarding dogs' attention during the task suggest that dogs used two different quantity estimation mechanisms, an indication of a higher cognitive mechanism involved in the process. The present results are the first empirical evidence that serial dependence extends beyond humans, suggesting that the mechanism is shared by phylogenetically distant mammals.

Super recognizers: Increased sensitivity or reduced biases? Insights from serial dependence

Super recognizers (SRs) are people that exhibit a naturally occurring superiority for processing facial identity. Despite the increase of SR research, the mechanisms underlying their exceptional abilities remain unclear. Here, we investigated whether the enhanced facial identity processing of SRs could be attributed to the lack of sequential effects, such as serial dependence. In serial dependence, perception of stimulus features is assimilated toward stimuli presented in previous trials. This constant error in visual perception has been proposed as a mechanism that promotes perceptual stability in everyday life. We hypothesized that an absence of this constant source of error in SRs could account for their superior processing-potentially in a domain-general fashion. We tested SRs (n = 17) identified via a recently proposed diagnostic framework (Ramon, 2021) and age-matched controls (n = 20) with two experiments probing serial dependence in the face and shape domains. In each experiment, observers were presented with randomly morphed face identities or shapes and were asked to adjust a face's identity or a shape to match the stimulus they saw. We found serial dependence in controls and SRs alike, with no difference in its magnitude across groups. Interestingly, we found that serial dependence impacted the performance of SRs more than that of controls. Taken together, our results show that enhanced face identity processing skills in SRs cannot be attributed to the lack of serial dependence. Rather, serial dependence, a beneficial nested error in our visual system, may in fact further stabilize the perception of SRs and thus enhance their visual processing proficiency.

Intact Serial Dependence in Schizophrenia: Evidence from an Orientation Adjustment Task

BACKGROUND AND HYPOTHESIS

For a long time, it was proposed that schizophrenia (SCZ) patients rely more on sensory input and less on prior information, potentially leading to reduced serial dependence-ie, a reduced influence of prior stimuli in perceptual tasks. However, existing evidence is constrained to a few paradigms, and whether reduced serial dependence reflects a general characteristic of the disease remains unclear.

STUDY DESIGN

We investigated serial dependence in 26 SCZ patients and 27 healthy controls (CNT) to evaluate the influence of prior stimuli in a classic visual orientation adjustment task, a paradigm not previously tested in this context.

STUDY RESULTS

As expected, the CNT group exhibited clear serial dependence, with systematic biases toward the orientation of stimuli shown in the preceding trials. Serial dependence in SCZ patients was largely comparable to that in the CNT group.

CONCLUSIONS

These findings challenge the prevailing notion of reduced serial dependence in SCZ, suggesting that observed differences between healthy CNT and patients may depend on aspects of perceptual or cognitive processing that are currently not understood.

Serial dependence requires visual awareness: Evidence from continuous flash suppression

The visual system often undergoes a relatively stable perception even in a noisy visual environment. This crucial function was reflected in a visual perception phenomenon-serial dependence, in which recent stimulus history systematically biases current visual decisions. Although serial dependence effects have been revealed in numerous studies, few studies examined whether serial dependence would require visual awareness. By using the continuous flash suppression (CFS) technique to render grating stimuli invisible, we investigated whether serial dependence effects could emerge at the unconscious levels. In an orientation adjustment task, subjects viewed a randomly oriented grating and reported their orientation perception via an adjustment response. Subjects performed a series of three type trial pairs. The first two trial pairs, in which subjects were instructed to make a response or no response toward the first trial of the pairs, respectively, were used to measure serial dependence at the conscious levels; the third trial pair, in which the grating stimulus in the first trial of the pair was masked by a CFS stimulus, was used to measure the serial dependence at the unconscious levels. One-back serial dependence effects for the second trial of the pairs were evaluated. We found significant serial dependence effects at the conscious levels, whether absence (Experiment 1) or presence (Experiment 2) of CFS stimuli, but failed to find the effects at the unconscious levels, corroborating the view that serial dependence requires visual awareness.

Unifying network model links recency and central tendency biases in working memory

The central tendency bias, or contraction bias, is a phenomenon where the judgment of the magnitude of items held in working memory appears to be biased toward the average of past observations. It is assumed to be an optimal strategy by the brain and commonly thought of as an expression of the brain's ability to learn the statistical structure of sensory input. On the other hand, recency biases such as serial dependence are also commonly observed and are thought to reflect the content of working memory. Recent results from an auditory delayed comparison task in rats suggest that both biases may be more related than previously thought: when the posterior parietal cortex (PPC) was silenced, both short-term and contraction biases were reduced. By proposing a model of the circuit that may be involved in generating the behavior, we show that a volatile working memory content susceptible to shifting to the past sensory experience - producing short-term sensory history biases - naturally leads to contraction bias. The errors, occurring at the level of individual trials, are sampled from the full distribution of the stimuli and are not due to a gradual shift of the memory toward the sensory distribution's mean. Our results are consistent with a broad set of behavioral findings and provide predictions of performance across different stimulus distributions and timings, delay intervals, as well as neuronal dynamics in putative working memory areas. Finally, we validate our model by performing a set of human psychophysics experiments of an auditory parametric working memory task.

Temporal integration of target features across and within trials in the attentional blink

Attentional blink research has typically investigated attentional limitations in multiple target processing. The current study investigated the temporal integration of target features in the attentional blink. Across two experiments, we demonstrated that the orientation estimations of individual target items in the attentional blink paradigm were systematically biased. Specifically, there was evidence for both within- and across-trial biases, revealing a general bias towards previously presented stimuli. Moreover, both biases were found to be more salient for targets suffering from the attentional blink. The current study is the first to demonstrate an across-trial bias in responses in the attentional blink paradigm. This set of findings is in line with the literature, suggesting that the human visual system can implicitly summarize information presented over time, which may lead to biases. By investigating temporal integration in the attentional blink, we have been able to address the modulatory role of attention on biases imposed by the implicit temporal effects in estimation tasks. Our findings may inform future research on attentional blink, serial dependence, and ensemble perception.

An efficient Bayesian observer model of attractive and repulsive temporal context effects when perceiving multistable dot lattices

In multistable dot lattices, the orientation we perceive is attracted toward the orientation we perceived in the immediately preceding stimulus and repelled from the orientation for which most evidence was present previously (Van Geert, Moors, Haaf, & Wagemans, 2022). Theoretically-inspired models have been proposed to explain the co-occurrence of attractive and repulsive context effects in multistable dot lattice tasks, but these models artificially induced an influence of the previous trial on the current one without detailing the process underlying such an influence (Gepshtein & Kubovy, 2005; Schwiedrzik et al., 2014). We conducted a simulation study to test whether the observed attractive and repulsive context effects could be explained with an efficient Bayesian observer model (Wei & Stocker, 2015). This model assumes variable encoding precision of orientations in line with their frequency of occurrence (i.e., efficient encoding) and takes the dissimilarity between stimulus space and sensory space into account. An efficient Bayesian observer model including both a stimulus and a perceptual level was needed to explain the co-occurrence of both attractive and repulsive temporal context effects. Furthermore, this model could reproduce the empirically observed strong positive correlation between individuals' attractive and repulsive effects (Van Geert et al., 2022), by assuming a positive correlation between temporal integration constants at the stimulus and the perceptual level. To conclude, the study brings evidence that efficient encoding and likelihood repulsion on the stimulus level can explain the repulsive context effect, whereas perceptual prior attraction can explain the attractive temporal context effect when perceiving multistable dot lattices.

The distinct development of stimulus and response serial dependence

Serial dependence (SD) is a phenomenon wherein current perceptions are biased by the previous stimulus and response. This helps to attenuate perceptual noise and variability in sensory input and facilitates stable ongoing perceptions of the environment. However, little is known about the developmental trajectory of SD. This study investigates how the stimulus and response biases of the SD effect develop across three age groups. Conventional analyses, in which previous stimulus and response biases were assessed separately, revealed significant changes in the biases over time. Previous stimulus bias shifted from repulsion to attraction, while previous response bias evolved from attraction to greater attraction. However, there was a strong correlation between stimulus and response orientations. Therefore, a generalized linear mixed-effects (GLME) analysis that simultaneously considered both previous stimulus and response, outperformed separate analyses. This revealed that previous stimulus and response resulted in two distinct biases with different developmental trajectories. The repulsion bias of previous stimulus remained relatively stable across all age groups, whereas the attraction bias of previous response was significantly stronger in adults than in children and adolescents. These findings demonstrate that the repulsion bias towards preceding stimuli is established early in the developing brain (at least by around 10 years old), while the attraction bias towards responses is not fully developed until adulthood. Our findings provide new insights into the development of the SD phenomenon and how humans integrate two opposing mechanisms into their perceptual responses to external input during development.

Frequency-specific contributions to auditory perceptual priors: Testing the predictive-coding hypothesis

Perceptual priors formed by recent stimuli bias our immediate percept. These priors, expressing our implicit expectations, affect both high- and low-level processing stages. Yet, the nature of the inter-level interaction is unknown. Do priors operate top-down and bias low-level features toward recently experienced objects (predictive-coding hypothesis), or are low-level biases bottom-up driven and formed by local memory circuits? To decipher between these options in auditory perception, we used the "missing fundamental illusion", enabling the dissociation of low-level components from the high-level pitch. Surprisingly, in contrast to predictive coding, when the fundamental frequency was missing, pitch contraction across timbre categories was not found to the previously perceived high-level pitch, but to the physically present frequency. This bottom-up contribution of low-level memory components to perceptual priors, operating independently of recent high-level percepts, may stabilize the perceptual organization and underlie continuity between similar low-level features belonging to different object categories in the auditory modality.

Memory reports are biased by all relevant contents of working memory

Sensory input is inherently noisy while the world is inherently predictable. When multiple observations of the same object are available, integration of the available information necessarily increases the reliability of a world estimate. Optimal integration of multiple instances of sensory evidence has already been demonstrated during multisensory perception but could benefit unimodal perception as well. In the present study 330 participants observed a sequence of four orientations and were cued to report one of them. Reports were biased by all simultaneously memorized items that were similar and relevant to the target item, weighted by their reliability (signal-to-noise ratio). Orientations presented before and presented after the target biased report, demonstrating that the bias emerges in memory and not (exclusively) during perception or encoding. Only attended, task-relevant items biased report. We suggest that these results reflect how the visual system integrates information that is sampled from the same object at consecutive timepoints to promote perceptual stability and behavioural effectiveness in a dynamic world. We suggest that similar response biases, such as serial dependence, might be instances of a more general mechanism of working memory averaging. Data is available at https://osf.io/embcf/ .

Serial Dependence in Perception

Much evidence has shown that perception is biased towards previously presented similar stimuli, an effect recently termed serial dependence. Serial dependence affects nearly every aspect of perception, often causing gross perceptual distortions, especially for weak and ambiguous stimuli. Despite unwanted side-effects, empirical evidence and Bayesian modeling show that serial dependence acts to improve efficiency and is generally beneficial to the system. Consistent with models of predictive coding, the Bayesian priors of serial dependence are generated at high levels of cortical analysis, incorporating much perceptual experience, but feed back to lower sensory areas. These feedback loops may drive oscillations in the alpha range, linked strongly with serial dependence. The discovery of top-down predictive perceptual processes is not new, but the new, more quantitative approach characterizing serial dependence promises to lead to a deeper understanding of predictive perceptual processes and their underlying neural mechanisms.

Serial dependence in timing at the perceptual level being modulated by working memory

Recent experiences bias the perception of following stimuli, as has been verified in various kinds of experiments in visual perception. This phenomenon, known as serial dependence, may reflect mechanisms to maintain perceptual stability. In the current study, we examined several key properties of serial dependence in temporal perception. Firstly, we examined the source of the serial dependence effect in temporal perception. We found that perception without motor reproduction is sufficient to induce the sequential effect; motor reproduction caused a stronger effect and is achieved by biasing the perception of the future target duration rather than directly influencing the subsequent movement. Secondly, we ask how working memory influences serial dependence in a temporal reproduction task. By varying the delay time between standard duration and the reproduction, we showed that the strength of serial dependence is enhanced as the delay increased. Those features of serial dependence are consistent with what has been observed in visual perceptual tasks, for example, orientation perception or location perception. The similarities between the visual and the timing tasks may suggest a similar neural coding mechanism of magnitude between the visual stimuli and the duration.

Serial dependence bias can predict the overall estimation error in visual perception

Although visual feature estimations are accurate and precise, overall estimation errors (i.e., the difference between estimates and actual values) tend to show systematic patterns. For example, estimates of orientations are systematically biased away from horizontal and vertical orientations, showing an oblique illusion. Additionally, many recent studies have demonstrated that estimations of current visual features are systematically biased toward previously seen features, showing a serial dependence. However, no study examined whether the overall estimation errors were correlated with the serial dependence bias. To address this question, we enrolled three groups of participants to estimate orientation, motion speed, and point-light-walker direction. The results showed that the serial dependence bias explained over 20% of overall estimation errors in the three tasks, indicating that we could use the serial dependence bias to predict the overall estimation errors. The current study first demonstrated that the serial dependence bias was not independent from the overall estimation errors. This finding could inspire researchers to investigate the neural bases underlying the visual feature estimation and serial dependence.

Tuning perception and decisions to temporal context

Recent work suggests that serial dependence, where perceptual decisions are biased toward previous stimuli, arises from the prior that sensory input is temporally correlated. However, existing studies have mostly used random stimulus sequences that do not involve such temporal consistencies. Here, we manipulated the temporal statistics of visual stimuli to examine the role of true temporal correlations in serial dependence. In two experiments, observers reproduced the orientation of the last stimulus in a sequence, while we varied temporal correlations in the stimulus features at two timescales: stimulus history within the trial and decision history across trials. We found a clear dissociation: increasing temporal correlation in the stimulus history led to adaptation-like repulsive biases, whereas increasing temporal correlation in the decision history reduced attractive biases. Thus, we suggest that temporal correlation enhances the discriminative ability of the visual system, revealing the fundamental role of the broader temporal context.

Serial dependence in facial identity perception and visual working memory

Serial dependence (SD) refers to the effect in which a person's current perceptual judgment is attracted toward recent stimulus history. Perceptual and memory processes, as well as response and decisional biases, are thought to contribute to SD effects. The current study examined the processing stages of SD facial identity effects in the context of task-related decision processes and how such effects may differ from visual working memory (VWM) interactions. In two experiments, participants were shown a series of two sequentially presented face images. In Experiment 1, the two faces were separated by an interstimulus interval (ISI) of 1, 3, 6, or 10 s, and participants were instructed to reproduce the second face after a varying response delay of 0, 1, 3, 6, or 10 s. Results showed that SD effects occurred most consistently at ISI of 1 s and response delays of 1 and 6 s consistent with early and late stages of processing. In Experiment 2, the ISI was held constant at 1 s, and to separate SD from VWM interactions participants were post-cued to reproduce either the first or the second face. When the second face was the target, SD effects again occurred at response delays of 1 and 6 s, but not when the first face was the target. Together, the results demonstrates that SD facial identity effects occur independently of task-related processes in a distinct temporal fashion and suggest that SD and VWM interactions may rely on separate underlying mechanisms.

Task feedback suggests a post-perceptual component to serial dependence

Decisions across a range of perceptual tasks are biased toward past stimuli. Such serial dependence is thought to be an adaptive low-level mechanism that promotes perceptual stability across time. However, recent studies suggest post-perceptual mechanisms may also contribute to serially biased responses, calling into question a single locus of serial dependence and the nature of integration of past and present sensory inputs. We measured serial dependence in the context of a three-dimensional (3D) motion perception task where uncertainty in the sensory information varied substantially from trial to trial. We found that serial dependence varied with stimulus properties that impact sensory uncertainty on the current trial. Reduced stimulus contrast was associated with an increased bias toward the stimulus direction of the previous trial. Critically, performance feedback, which reduced sensory uncertainty, abolished serial dependence. These results provide clear evidence for a post-perceptual locus of serial dependence in 3D motion perception and support the role of serial dependence as a response strategy in the face of substantial sensory uncertainty.

Stable perceptual phenotype of the magnitude of history biases even in the face of global task complexity

According to a Bayesian framework, visual perception requires active interpretation of noisy sensory signals in light of prior information. One such mechanism, serial dependence, is thought to promote perceptual stability by assimilating current percepts with recent stimulus history. Combining a delayed orientation-adjustment paradigm with predictable (study 1) or unpredictable (study 2) task structure, we test two key predictions of this account in a novel context: first, that serial dependence should persist even in variable environments, and, second, that, within a given observer and context, this behavioral bias should be stable from one occasion to the next. Relying on data of 41 human volunteers and two separate experimental sessions, we confirm both hypotheses. Group-level, attractive serial dependence remained strong even in the face of volatile settings with multiple, unpredictable types of tasks, and, despite considerable interindividual variability, within-subject patterns of attractive and repulsive stimulus-history biases were highly stable from one experimental session to the next. In line with the hypothesized functional role of serial dependence, we propose that, together with previous work, our findings suggest the existence of a more general individual-specific fingerprint with which the past shapes current perception. Congruent with the Bayesian account, interindividual differences may then result from differential weighting of sensory evidence and prior information.

Serial dependence in visual perception: A meta-analysis and review

Positive sequential dependencies are phenomena in which actions, perception, decisions, and memory of features or objects are systematically biased toward visual experiences from the recent past. Among many labels, serial dependencies have been referred to as priming, sequential dependencies, sequential effects, or serial effects. Despite extensive research on the topic, the field still lacks an operational definition of what counts as serial dependence. In this meta-analysis, we review the vast literature on serial dependence and quantitatively assess its key diagnostic characteristics across several different domains of visual perception. The meta-analyses fully characterize serial dependence in orientation, face, and numerosity perception. They show that serial dependence is defined by four main kinds of tuning: serial dependence decays with time (temporal-tuning), it depends on relative spatial location (spatial-tuning), it occurs only between similar features and objects (feature-tuning), and it is modulated by attention (attentional-tuning). We also review studies of serial dependence that report single observer data, highlighting the importance of individual differences in serial dependence. Finally, we discuss a range of outstanding questions and novel research avenues that are prompted by the meta-analyses. Together, the meta-analyses provide a full characterization of serial dependence as an operationally defined family of visual phenomena, and they outline several of the key diagnostic criteria for serial dependence that should serve as guideposts for future research.

Serial dependencies in visual stability during self-motion

Every time we move our head, the brain must decide whether the displacement of the visual scene is the result of external or self-produced motion. Gaze shifts generate the biggest and most frequent disturbance of vision. Visual stability during gaze shifts is necessary for both, dissociating self-produced from external motion and retaining bodily balance. Here, we asked participants to perform an eye-head gaze shift to a target that was briefly presented in a head-mounted display. We manipulated the velocity of the scene displacement across trials such that the background moved either too fast or too slow in relation to the head movement speed. Participants were required to report whether they perceived the gaze-contingent visual motion as faster or slower than what they would expect from their head movement velocity. We found that the point of visual stability was attracted to the velocity presented in the previous trial. Our data reveal that serial dependencies in visual stability calibrate the mapping between motor-related signals coding head movement velocity and visual motion velocity. This process is likely to aid in visual stability as the accuracy of this mapping is crucial to maintain visual stability during self-motion.NEW & NOTEWORTHY We report that visual stability during self-motion is maintained by serial dependencies between the current and the previous gaze-contingent visual velocity that was experienced during a head movement. The gaze-contingent scene displacement velocity that appears normal to us thus depends on what we have registered in the recent history of gaze shifts. Serial dependencies provide an efficient means to maintain visual stability during self-motion.

Motor variability modulates calibration of precisely timed movements

Interacting with the environment often requires precisely timed movements, challenging the brain to minimize the detrimental impact of neural noise. Recent research demonstrates that the brain exploits the variability of its temporal estimates and recalibrates perception accordingly. Time-critical movements, however, contain a sensory measurement and a motor stage. The brain must have knowledge of both in order to avoid maladapted behavior. By manipulating sensory and motor variability, we show that the sensorimotor system recalibrates sensory and motor uncertainty separately. Serial dependencies between observed interval durations in the previous and motor reproductions in the current trial were weighted by the variability of movements. These serial dependencies generalized across different effectors, but not to a visual discrimination task. Our results suggest that the brain has accurate knowledge about contributions of motor uncertainty to errors in temporal movements. This knowledge about motor uncertainty seems to be processed separately from knowledge about sensory uncertainty.

Stimulation along the anterior-posterior axis of lateral frontal cortex reduces visual serial dependence

Serial dependence is an attractive pull that recent perceptual history exerts on current judgments. Theory suggests that this bias is due to a form of short-term plasticity prevalent specifically in the frontal lobe. We sought to test the importance of the frontal lobe to serial dependence by disrupting neural activity along its lateral surface during two tasks with distinct perceptual and motor demands. In our first experiment, stimulation of the lateral prefrontal cortex (LPFC) during an oculomotor delayed response task decreased serial dependence only in the first saccade to the target, whereas stimulation posterior to the LPFC decreased serial dependence only in adjustments to eye position after the first saccade. In our second experiment, which used an orientation discrimination task, stimulation anterior to, in, and posterior to the LPFC all caused equivalent decreases in serial dependence. In this experiment, serial dependence occurred only between stimuli at the same location; an alternation bias was observed across hemifields. Frontal stimulation had no effect on the alternation bias. Transcranial magnetic stimulation to parietal cortex had no effect on serial dependence in either experiment. In summary, our experiments provide evidence for both functional differentiation (Experiment 1) and redundancy (Experiment 2) in frontal cortex with respect to serial dependence.

Serial dependence in perception across naturalistic generative adversarial network-generated mammogram

Purpose

Human perception and decisions are biased toward previously seen stimuli. This phenomenon is known as serial dependence and has been extensively studied for the last decade. Recent evidence suggests that clinicians' judgments of mammograms might also be impacted by serial dependence. However, the stimuli used in previous psychophysical experiments on this question, consisting of artificial geometric shapes and healthy tissue backgrounds, were unrealistic. We utilized realistic and controlled generative adversarial network (GAN)-generated radiographs to mimic images that clinicians typically encounter.

Approach

Mammograms from the digital database for screening mammography (DDSM) were utilized to train a GAN. This pretrained GAN was then adopted to generate a large set of authentic-looking simulated mammograms: 20 circular morph continuums, each with 147 images, for a total of 2940 images. Using these stimuli in a standard serial dependence experiment, participants viewed a random GAN-generated mammogram on each trial and subsequently matched the GAN-generated mammogram encountered using a continuous report. The characteristics of serial dependence from each continuum were analyzed.

Results

We found that serial dependence affected the perception of all naturalistic GAN-generated mammogram morph continuums. In all cases, the perceptual judgments of GAN-generated mammograms were biased toward previously encountered GAN-generated mammograms. On average, perceptual decisions had 7% categorization errors that were pulled in the direction of serial dependence.

Conclusions

Serial dependence was found even in the perception of naturalistic GAN-generated mammograms created by a GAN. This supports the idea that serial dependence could, in principle, contribute to decision errors in medical image perception tasks.

Attractive and repulsive serial dependence: The role of task relevance, the passage of time, and the number of stimuli

Visual decisions are attracted toward features of previous stimuli. This phenomenon, termed serial dependence, has been related to a mechanism that integrates present visual input with stimuli seen up to 10 to 15 s in the past. It is believed that this mechanism is "temporally tuned" and the effect of prior stimuli fades with time. Here, we investigated whether the temporal window of serial dependence is influenced by the number of stimuli shown. Observers performed an orientation adjustment task where the interval between the past and present stimulus and the number of intervening stimuli varied. First, we found that the direction-repulsive or attractive-and duration of the effect of a past stimulus depends on whether the past stimulus was relevant to behavior. Second, we show that the number of stimuli, and not only the passage of time, plays a role: The effect of a stimulus at a fixed interval depends on the number of other stimuli shown after. Our results demonstrate that neither a single mechanism nor a general tuning window can fully capture the complexity of serial dependence.

Independent short- and long-term dependencies in perception

Perception is biased by stimulus history. Both long-term effects such as the central-tendency bias (CTB) and short-term effects such as serial dependence (SD) have been described, but research into the two has remained largely separate. The sources of these effects, however, are highly correlated in stimulus statistics, which can result in a misinterpretation of experimental data. We compared CTB and SD in the perception of color and line length. Observers judged the relative hue or length of consecutive stimuli in a delayed-matching task. Two interstimulus intervals were used to investigate whether elapsed time or the number of stimulus occurrences was more important for SD. We estimated biases by fitting psychometric functions to the data split based on the history features, and we also fit generalized linear mixed models with either CTB, SD, or both included as regressors. We found biases to both recent stimulus history and the cumulative average of stimulus values for both color and line length judgments. The strength and pattern of each of the biases depended on whether all sources of bias were included in the analysis. Within the range of interstimulus intervals tested, the number of intervening stimuli was more important than elapsed time for SD. We conclude that both SD and CTB independently affect perceptual judgments, and that one effect is not an artifact caused by the other. Failing to consider both effects in data analysis can give an erroneous picture of the phenomenon under study.

A unitary mechanism underlies adaptation to both local and global environmental statistics in time perception

Our duration estimation flexibly adapts to the statistical properties of the temporal context. Humans and non-human species exhibit a perceptual bias towards the mean of durations previously observed as well as serial dependence, a perceptual bias towards the duration of recently processed events. Here we asked whether those two phenomena arise from a unitary mechanism or reflect the operation of two distinct systems that adapt separately to the global and local statistics of the environment. We employed a set of duration reproduction tasks in which the target duration was sampled from distributions with different variances and means. The central tendency and serial dependence biases were jointly modulated by the range and the variance of the prior, and these effects were well-captured by a unitary mechanism model in which temporal expectancies are updated after each trial based on perceptual observations. Alternative models that assume separate mechanisms for global and local contextual effects failed to capture the empirical results.

Heading perception from optic flow occurs at both perceptual representation and working memory stages with EEG evidence

Psychophysical studies have demonstrated that heading perception from optic flow occurs in perceptual and post-perceptual stages. The post-perception stage is a complex concept, containing working memory. The current study examined whether working memory was involved in heading perception from optic flow by asking participants to conduct a heading perception task and recording their scalp EEG. On each trial, an optic flow display was presented, followed by a blank display. Participants were then asked to report their perceived heading. We know that participants would tend to automatically forget previous headings when they learned that previously presented headings were unrelated to the current heading perception to save cognitive resources. As a result, we could not decode previous headings from the EEG data of current trials. More importantly, if we successfully decoded previous headings when the blank display (optic flow) was presented, then working memory (perceptual representation stage) was involved in heading perception. Our results showed that the decoding accuracy was significantly higher than the chance level when the optic flow and blank displays were presented. Therefore, the current study provided electrophysiological evidence that heading perception from optic flow occurred in the perceptual representation and working memory stages, against the previous perceptual claim.

Perceptual history biases in serial ensemble representation

Ensemble perception refers to the visual system's ability to efficiently represent groups of similar objects as a unified percept using their summary statistical information. Most studies focused on extraction of current trial averages, giving little attention to prior experience effects, although a few recent studies found that ensemble mean estimations contract toward previously presented stimuli, with most of these focusing on explicit perceptual averaging of simultaneously presented item ensembles. Yet, the time element is crucial in real dynamic environments, where we encounter ensemble items over time, aggregating information until reaching summary representations. Moreover, statistical information of objects and scenes is learned over time and often implicitly and then used for predictions that shape perception, promoting environmental stability. Therefore, we now focus on temporal aspects of ensemble statistics and test whether prior information, beyond the current trial, biases implicit perceptual decisions. We designed methods to separate current trial biases from those of previously seen trial ensembles. In each trial, six circles of different sizes were presented serially, followed by two test items. Participants were asked to choose which was present in the sequence. Participants unconsciously rely on ensemble statistics, choosing stimuli closer to the ensemble mean. To isolate the influence of earlier trials, the two test items were sometimes equidistant from the current trial mean. Results showed membership judgment biases toward current trial mean, when informative (largest effect). On equidistant trials, judgments were biased toward previously experienced stimulus statistics. Comparison of similar conditions with a shifted stimulus distribution ruled out a bias toward an earlier, presession, prototypical diameter. We conclude that ensemble perception, even for temporally experienced ensembles, is influenced not only by current trial mean but also by means of recently seen ensembles and that these influences are somewhat correlated on a participant-by-participant basis.

Serial dependence in visual perception: A review

How does the visual system represent continuity in the constantly changing visual input? A recent proposal is that vision is serially dependent: Stimuli seen a moment ago influence what we perceive in the present. In line with this, recent frameworks suggest that the visual system anticipates whether an object seen at one moment is the same as the one seen a moment ago, binding visual representations across consecutive perceptual episodes. A growing body of work supports this view, revealing signatures of serial dependence in many diverse visual tasks. Yet, the variety of disparate findings and interpretations calls for a more general picture. Here, we survey the main paradigms and results over the past decade. We also focus on the challenge of finding a relationship between serial dependence and the concept of "object identity," taking centuries-long history of research into account. Among the seemingly contrasting findings on serial dependence, we highlight common patterns that may elucidate the nature of this phenomenon and attempt to identify questions that are unanswered.

Attractive and repulsive effects of sensory history concurrently shape visual perception

BACKGROUND

Sequential effects of environmental stimuli are ubiquitous in most behavioral tasks involving magnitude estimation, memory, decision making, and emotion. The human visual system exploits continuity in the visual environment, which induces two contrasting perceptual phenomena shaping visual perception. Previous work reported that perceptual estimation of a stimulus may be influenced either by attractive serial dependencies or repulsive aftereffects, with a number of experimental variables suggested as factors determining the direction and magnitude of sequential effects. Recent studies have theorized that these two effects concurrently arise in perceptual processing, but empirical evidence that directly supports this hypothesis is lacking, and it remains unclear whether and how attractive and repulsive sequential effects interact in a trial. Here we show that the two effects concurrently modulate estimation behavior in a typical sequence of perceptual tasks.

RESULTS

We first demonstrate that observers' estimation error as a function of both the previous stimulus and response cannot be fully described by either attractive or repulsive bias but is instead well captured by a summation of repulsion from the previous stimulus and attraction toward the previous response. We then reveal that the repulsive bias is centered on the observer's sensory encoding of the previous stimulus, which is again repelled away from its own preceding trial, whereas the attractive bias is centered precisely on the previous response, which is the observer's best prediction about the incoming stimuli.

CONCLUSIONS

Our findings provide strong evidence that sensory encoding is shaped by dynamic tuning of the system to the past stimuli, inducing repulsive aftereffects, and followed by inference incorporating the prediction from the past estimation, leading to attractive serial dependence.

A key role of orientation in the coding of visual motion direction

Despite the fundamental importance of visual motion processing, our understanding of how the brain represents basic aspects of motion is incomplete. While it is generally believed that direction is the main representational feature of motion, motion processing is also influenced by nondirectional orientation signals that are present in most motion stimuli. Here, we aimed to test whether this nondirectional motion axis contributes motion perception even when orientation is completely absent from the stimulus. Using stimuli with and without orientation signals, we found that serial dependence in a simple motion direction estimation task was predominantly determined by the orientation of the previous motion stimulus. Moreover, the observed attraction profiles closely matched the characteristic pattern of serial attraction found in orientation perception. Evidently, the sequential integration of motion signals strongly depends on the orientation of motion, indicating a fundamental role of nondirectional orientation in the coding of visual motion direction.

Visual priming and serial dependence are mediated by separate mechanisms

Perceptual history influences current perception, readily revealed by visual priming (the facilitation of responses on repeated presentations of similar stimuli) and by serial dependence (systematic biases toward the previous stimuli). We asked whether the two phenomena shared perceptual mechanisms. We modified the standard “priming of pop-out” paradigm to measure both priming and serial dependence concurrently. The stimulus comprised three grating patches, one or two red, and the other green. Participants identified the color singleton (either red or green), and reproduced its orientation. Trial sequences were designed to maximize serial dependence, and long runs of priming color and position. The results showed strong effects of priming, both on reaction times and accuracy, which accumulated steadily over time, as generally reported in the literature. The serial dependence effects were also strong, but did not depend on previous color, nor on the run length. Reaction times measured under various conditions of repetition or change of priming color or position were reliably correlated with imprecision in orientation reproduction, but reliably uncorrelated with magnitude of serial dependence. The results suggest that visual priming and serial dependence are mediated by different neural mechanisms. We propose that priming affects sensitivity, possibly via attention-like mechanisms, whereas serial dependence affects criteria, two orthogonal dimensions in the signal detection theory.

Attractive serial dependence overcomes repulsive neuronal adaptation

Sensory responses and behavior are strongly shaped by stimulus history. For example, perceptual reports are sometimes biased toward previously viewed stimuli (serial dependence). While behavioral studies have pointed to both perceptual and postperceptual origins of this phenomenon, neural data that could elucidate where these biases emerge is limited. We recorded functional magnetic resonance imaging (fMRI) responses while human participants (male and female) performed a delayed orientation discrimination task. While behavioral reports were attracted to the previous stimulus, response patterns in visual cortex were repelled. We reconciled these opposing neural and behavioral biases using a model where both sensory encoding and readout are shaped by stimulus history. First, neural adaptation reduces redundancy at encoding and leads to the repulsive biases that we observed in visual cortex. Second, our modeling work suggest that serial dependence is induced by readout mechanisms that account for adaptation in visual cortex. According to this account, the visual system can simultaneously improve efficiency via adaptation while still optimizing behavior based on the temporal structure of natural stimuli.

Cartesian coordinates scaffold stable spatial perception over time

Visual systems exploit temporal continuity principles to achieve stable spatial perception, manifested as the serial dependence and central tendency effects. These effects are posited to reflect a smoothing process whereby past and present information integrates over time to decrease noise and stabilize perception. Meanwhile, the basic spatial coordinate—Cartesian versus polar—that scaffolds the integration process in two-dimensional continuous space remains unknown. The spatial coordinates are largely related to the allocentric and egocentric reference frames and presumably correspond with early and late processing stages in spatial perception. Here, four experiments consistently demonstrate that Cartesian outperforms polar coordinates in characterizing the serial bias—serial dependence and central tendency effect—in two-dimensional continuous spatial perception. The superiority of Cartesian coordinates is robust, independent of task environment (online and offline task), experimental length (short and long blocks), spatial context (shape of visual mask), and response modality (keyboard and mouse). Taken together, the visual system relies on the Cartesian coordinates for spatiotemporal integration to facilitate stable representation of external information, supporting the involvement of allocentric reference frame and top-down modulation in spatial perception over long time intervals.

Same stimulus, same temporal context, different percept? Individual differences in hysteresis and adaptation when perceiving multistable dot lattices

How we perceptually organize a visual stimulus depends not only on the stimulus itself, but also on the temporal and spatial context in which the stimulus is presented and on the individual processing the stimulus and context. Earlier research found both attractive and repulsive context effects in perception: tendencies to organize visual input similarly to preceding context stimuli (i.e., hysteresis, attraction) co-exist with tendencies that repel the current percept from the organization that is most dominant in these contextual stimuli (i.e., adaptation, repulsion). These processes have been studied mostly on a group level (e.g., Schwiedrzik et al., 2014). Using a Bayesian hierarchical model comparison approach, the present study (N = 75) investigated whether consistent individual differences exist in these attractive and repulsive temporal context effects, with multistable dot lattices as stimuli. In addition, the temporal stability of these individual differences in context effects was investigated, and it was studied how the strength of these effects related to the strength of individual biases for absolute orientations. The results demonstrate that large individual differences in the size of attractive and repulsive context effects exist. Furthermore, these individual differences are highly consistent across timepoints (one to two weeks apart). Although almost everyone showed both effects in the expected direction, not every single individual did. In sum, the study reveals differences in how individuals combine previous input and experience with current input in their perception, and more generally, this teaches us that different individuals can perceive identical stimuli differently, even within a similar context.

The effect of abstract representation and response feedback on serial dependence in numerosity perception

Serial dependence entails an attractive bias based on the recent history of stimulation, making the current stimulus appear more similar to the preceding one. Although serial dependence is ubiquitous in perception, its nature and mechanisms remain unclear. Here, in two independent experiments, we test the hypothesis that this bias originates from high-level processing stages at the level of abstract information processing (Exp. 1) or at the level of judgment (Exp. 2). In Experiment 1, serial dependence was induced by a task-irrelevant "inducer" stimulus in a numerosity discrimination task, similarly to previous studies. Importantly, in this experiment, the inducers were either arrays of dots similar to the task-relevant stimuli (e.g., 12 dots), or symbolic numbers (e.g., the numeral "12"). Both dots and symbol inducers successfully yielded attractive serial dependence biases, suggesting that abstract information about an image is sufficient to bias the perception of the current stimulus. In Experiment 2, participants received feedback about their responses in each trial of a numerosity estimation task, which was designed to assess whether providing external information about the accuracy of judgments would modulate serial dependence. Providing feedback significantly increased the attractive serial dependence effect, suggesting that external information at the level of judgment may modulate the weight of past perceptual information during the processing of the current image. Overall, our results support the idea that, although serial dependence may operate at a perceptual level, it originates from high-level processing stages at the level of abstract information processing and at the level of judgment.

The test-retest reliability and spatial tuning of serial dependence in orientation perception

Humans perceive objects and scenes consistently, even in situations where visual input is noisy and unstable. One of the mechanisms that underlies this perceptual stability is serial dependence, whereby the perception of objects or features at any given moment is pulled toward what was previously seen. Although recent findings from several studies have reported large individual differences in serial dependence, it is not clear how stable the serial dependence is within an individual. Here, we investigated the stability of serial dependence in orientation perception over two different days within the same observers. In addition, we also examined the visual field location specificity of perceptual serial dependence. On each trial, observers viewed a Gabor patch and then reported its apparent orientation by adjusting the orientation of a bar. For each observer, the Gabor was located in the foveal or peripheral (10° right or left eccentricity) visual field on both days or changed location from day to day. The results showed a very high degree of test-retest reliability in serial dependence measured across days within individual observers. Interestingly, this high within-subject consistency was only found when serial dependence was measured at the same visual field location. These results suggest that individual differences in serial dependence are stable across days, and that the spatiotemporal range in which the previous stimulus assimilates the perception of the current stimulus (the continuity field) may vary across different visual field locations in an observer-specific manner.

Illusion of visual stability through active perceptual serial dependence

Despite a noisy and ever-changing visual world, our perceptual experience seems remarkably stable over time. How does our visual system achieve this apparent stability? Here, we introduce a previously unknown visual illusion that shows direct evidence for an online mechanism continuously smoothing our percepts over time. As a result, a continuously seen physically changing object can be misperceived as unchanging. We find that online object appearance is captured by past visual experience up to 15 seconds ago. We propose that, because of an underlying active mechanism of serial dependence, the representation of the object is continuously merged over time, and the consequence is an illusory stability in which object appearance is biased toward the past. Our results provide a direct demonstration of the link between serial dependence in visual representations and perceived visual stability in everyday life.

Stimulus uncertainty predicts serial dependence in orientation judgements

How is what you see influenced by what you saw? The visual system may use recent perception to inform responses to current stimuli. This can cause the perception of current stimuli to be attracted toward previous observations, an effect termed serial dependence. This misperception might well be useful in a noisy visual environment, where minor image distortions over time may not actually represent meaningful change. Previous work has suggested that Bayesian perceptual inference may underlie serial dependence. For this to be true, the relative uncertainty associated with both prior and current sensory input should be taken into account. In an experiment manipulating the level of noise present in orientation stimuli, we found an effect of current stimulus uncertainty on serial dependence. We found no good evidence for an effect of previous stimulus uncertainty. Our results provide only partial evidence for the Bayesian interpretation of serial dependence. Non-Bayesian models may provide a better account of the phenomenon.

Disrupting Short-Term Memory Maintenance in Premotor Cortex Affects Serial Dependence in Visuomotor Integration

Human behavior is biased by past experience. For example, when intercepting a moving target, the speed of previous targets will bias responses in future trials. Neural mechanisms underlying this so-called serial dependence are still under debate. Here, we tested the hypothesis that the previous trial leaves a neural trace in brain regions associated with encoding task-relevant information in visual and/or motor regions. We reasoned that injecting noise by means of transcranial magnetic stimulation (TMS) over premotor and visual areas would degrade such memory traces and hence reduce serial dependence. To test this hypothesis, we applied bursts of TMS pulses to right visual motion processing region hV5/MT+ and to left dorsal premotor cortex (PMd) during intertrial intervals of a coincident timing task performed by twenty healthy human participants (15 female). Without TMS, participants presented a bias toward the speed of the previous trial when intercepting moving targets. TMS over PMd decreased serial dependence in comparison to the control Vertex stimulation, whereas TMS applied over hV5/MT+ did not. In addition, TMS seems to have specifically affected the memory trace that leads to serial dependence, as we found no evidence that participants' behavior worsened after applying TMS. These results provide causal evidence that an implicit short-term memory mechanism in premotor cortex keeps information from one trial to the next, and that this information is blended with current trial information so that it biases behavior in a visuomotor integration task with moving objects.SIGNIFICANCE STATEMENT Human perception and action are biased by the recent past. The origin of such serial bias is still not fully understood, but a few components seem to be fundamental for its emergence: the brain needs to keep previous trial information in short-term memory and blend it with incoming information. Here, we present evidence that a premotor area has a potential role in storing previous trial information in short-term memory in a visuomotor task and that this information is responsible for biasing ongoing behavior. These results corroborate the perspective that areas associated with processing information of a stimulus or task also participate in maintaining that information in short-term memory even when this information is no longer relevant for current behavior.

Serial dependence in the perceptual judgments of radiologists

In radiological screening, clinicians scan myriads of radiographs with the intent of recognizing and differentiating lesions. Even though they are trained experts, radiologists’ human search engines are not perfect: average daily error rates are estimated around 3–5%. A main underlying assumption in radiological screening is that visual search on a current radiograph occurs independently of previously seen radiographs. However, recent studies have shown that human perception is biased by previously seen stimuli; the bias in our visual system to misperceive current stimuli towards previous stimuli is called serial dependence. Here, we tested whether serial dependence impacts radiologists’ recognition of simulated lesions embedded in actual radiographs. We found that serial dependence affected radiologists’ recognition of simulated lesions; perception on an average trial was pulled 13% toward the 1-back stimulus. Simulated lesions were perceived as biased towards the those seen in the previous 1 or 2 radiographs. Similar results were found when testing lesion recognition in a group of untrained observers. Taken together, these results suggest that perceptual judgements of radiologists are affected by previous visual experience, and thus some of the diagnostic errors exhibited by radiologists may be caused by serial dependence from previously seen radiographs.