Individual difference in serial dependence results from opposite influences of perceptual choices and motor responses

Abstract choice representations during stable choice-response associations

An increasing body of evidence has demonstrated neural representations of choices independent of the motor actions used to report them - so-called abstract choices. However, it remains unclear whether such representations arise due to dynamic changes in choice-response associations or reflect a general property of decision-making. Here, we show that in the human brain, choices are represented abstractly even when choice-response associations remain stable over time. We recorded neural activity using magnetoencephalography while participants performed a motion discrimination task, with choice-response mappings held constant within blocks. We found neural information about participants' perceptual choices independent of both motor response and visual stimulus. Choice information increased during the stimulus and peaked after the response. Moreover, choice and response information showed distinct cortical distributions, with choice-related signals strongest in frontoparietal regions. Thus, abstract choice representations are not limited to dynamic or action-independent contexts and may be a general feature of decision-making.

Reactivation of previous decisions repulsively biases sensory encoding but attractively biases decision-making

Automatic shaping of perception by past experiences is common in many cognitive functions, reflecting the exploitation of temporal regularities in environments. A striking example is serial dependence, i.e., current perception is biased by previous trials. However, the neural implementation of its operational circle in human brains remains unclear. In two experiments with electroencephalography (EEG)/magnetoencephalography (MEG) recordings and delayed-response tasks, we demonstrate a two-stage 'repulsive-then-attractive' past-present interaction mechanism underlying serial dependence. First, past-trial reports, instead of past stimuli, serve as a prior to be reactivated during both encoding and decision-making. Crucially, past reactivation interacts with current information processing in a two-stage manner: repelling and attracting the present during encoding and decision-making, and arising in the sensory cortex and prefrontal cortex, respectively. Finally, while the early stage occurs automatically, the late stage is modulated by task and predicts bias behavior. These findings might also illustrate general mechanisms of past-present influences in neural operations.

Effects of perceptual and decisional uncertainty on serial dependence in orientation perception

Where assimilative serial dependence occurs in perception, responses to visual attributes such as orientation are typically biased towards the attributes of visual stimuli seen in the recent past. Serial dependence is thought to increase the signal-to-noise ratio of visual representations and is reliably increased by uncertainty in the target stimulus. However, the amount of uncertainty in the preceding inducer stimulus does not seem to modulate serial dependence. Here, we consider whether uncertainty in the decision made about the inducer stimulus modulates serial dependence instead by using stimuli with high positive evidence (high-contrast signal plus high-contrast noise) and low positive evidence (low-contrast signal and low-contrast noise). Such stimuli are matched in their signal-to-noise ratio but differ in overall contrast, and have been found to modulate response confidence but not response accuracy. Thirty-three participants viewed oriented Gabor patches presented under different levels of signal-to-noise ratio and positive evidence and reported their orientation, as well as their response confidence. We found that serial dependence was greatest for target stimuli that had low signal-to-noise ratio, low positive evidence, or were responded to with low subjective confidence. We find no modulation of serial dependence by uncertainty of any kind in the inducer trial. This finding suggests that serial dependence may not reflect a bias towards previous decisions, and has implications for wider theoretical accounts of serial dependence. The data and materials for this experiment are available via the Open Science Framework at https://osf.io/kvy4c/.

The effects of feedback and task accuracy in serial dependence to orientation

Assimilative serial dependence in perception occurs where responses about a stimulus (e.g., orientation) are biased towards previously seen perceptual information (e.g., the orientation of the stimulus shown on the previous trial). This bias may occur to perceptual information from the previous trial, or to the response or decision made on the previous trial. We asked whether providing response feedback could change the serial dependence effect on the following trial. Twenty-one participants completed a task in which they adjusted an on-screen pointer to reproduce the orientation of a briefly-presented Gabor stimulus. They received feedback about the accuracy of their response that either reflected their actual accuracy or was random. We found significant positive biases to the stimulus and response only when the participant had received positive ("correct!") feedback on that trial. When the inducer response had been incorrect, the effect was significant only to the response itself and not to the stimulus. Overall, we suggest that our participants demonstrated a bias towards the percept from the previous trial, which is better represented by the response than the stimulus for incorrect trials, and that this effect can be modulated post-perceptually by feedback.

Action similarity warps visual feature space in working memory

Visual working memory (VWM) retains representations of past visual information for future action. Yet to date, most studies have approached VWM as just serving perception beyond the immediate. Whether and how prospective actions shape information in VWM remains largely unknown, in part because typical experimental setups limit behavior to simple button presses. In two experiments (one preregistered), using a novel interactive VWM task, we show that the similarity of the actions that we intend to perform on memory items adaptively distorts their representation. Participants memorized the orientation of two bars, after which they were informed as to which manual actions they should reproduce these orientations with in a memory recall test. We observed that perceptually similar items were remembered as more distinct when paired with different action plans versus the same action plan. A control experiment showed that this action-induced effect reflects a true change in the visual representation rather than a motor bias. These findings demonstrate that VWM representations are flexibly adapted to guide specific overt actions and provide evidence that action plans can retrospectively warp sensory feature space in VWM.

Gravity support from a robotic exoskeleton increases spontaneous use of the nondominant upper extremity during a choice reaching task

The objective was to determine whether gravity support for the left arm of right-handed participants would increase left arm use during a three-dimensional (3-D) reaching task in virtual reality. Twelve healthy control participants each completed 630 reaching movements broken into six blocks. The majority of targets were placed close to the midsagittal plane at three heights, and participants were free to use either limb when reaching for targets. The hand had to stay in the target for a prescribed dwell time before the target disappeared. For all reaching tasks within a block, the left arm gravity support was set to either 0% or 75% of full arm support. The blocks also varied in the dwell time (2, 4, or 6 s). The order of blocks was balanced across participants in terms of gravity support level and dwell time. Electromyogram (EMG) level in the left medial deltoid decreased with increasing gravity support (P < 0.001) and was higher for higher targets compared to lower targets (P < 0.001). The odds of using the left arm were 1.95 times higher with gravity support compared to no support (P < 0.001). With gravity support, we expected greater shifts toward the left arm in tasks that were more energetically demanding. This was not the case, as the increased use was evenly distributed across all target heights, and use decreased or remained unchanged with increasing dwell time. Results are discussed relative to current models of limb choice and the potential use of robotic gravity support to overcome learned nonuse in stroke patients.NEW & NOTEWORTHY We have shown that gravity support from a robotic exoskeleton increases use of the left arm of right-handed healthy participants. Prior work has shown similar results when movements of one arm are amplified in a virtual environment. The advantage of this approach is the potential to apply the intervention during functional task practice outside of the VR environment or during performance of actual activities of daily living (ADL).

Spatial and directional tuning of serial dependence for tracking eye movements

An attractive influence of past sensory experience on current behavior has been observed in many domains ranging from perceptual decisions to motor responses. However, it is unclear what sort of information is integrated across trials, especially for oculomotor behavior. Here we provide a detailed investigation of the spatial and directional tuning of serial dependence for oculomotor tracking. Across multiple experiments, we measured oculomotor responses to sequences of movements: the first movement (prior) could move at different velocities (5 deg/s or 15 deg/s), and could vary in its spatial location or direction relative to the following movement. The second movement (probe) was constant across all experiments and moved at 10 deg/s. We observed that eye velocity for the probe was faster when following the fast prior compared to following the slow prior, replicating attractive serial dependence. Importantly, this effect stayed consistent for distances of up to 30 deg between prior and probe, indicating a retinotopic reference frame. When we manipulated the direction of the prior, we observed that the influence of the prior on eye velocity, as well as eye direction, was stronger for prior directions more similar to the probe direction, and the magnitude of the effect on eye velocity and eye direction was correlated. Across all experiments, we observed that even when the prior moved in the opposite direction, there was a residual attractive effect. This suggests that serial dependence for oculomotor tracking consists of two components, one retinotopic, direction-tuned component and one more general component that is not direction specific.

Individual differences reveal similarities in serial dependence effects across perceptual tasks, but not to oculomotor tasks

Serial dependence effects have been observed across a wide range of perceptual and oculomotor tasks. This opens up the question of whether these effects observed share underlying mechanisms. Here we measured serial dependence effects in a semipredictable environment for the same group of observers across four different tasks, two perceptual (color and orientation judgments) and two oculomotor (tracking moving targets and the pupil light reflex). By leveraging individual differences, we searched for links in the magnitude of serial dependence effects across the different tasks. On the group level, we observed significant attractive serial dependence effects for all tasks, except the pupil response. The rare absence of a serial dependence effect for the reflex-like pupil light response suggests that sequential effects require cortical processing or even higher-level cognition. For the tasks with significant serial dependence effects, there was substantial and reliable variance in the magnitude of the sequential effects. We observed a significant relationship in the strength of serial dependence for the two perceptual tasks, but no relation between the perceptual tasks and oculomotor tracking. This emphasizes differences in processing between perception and oculomotor control. The lack of a correlation across all tasks indicates that it is unlikely that the relation between the individual differences in the magnitude of serial dependence is driven by more general mechanisms related to for example working memory. It suggests that there are other shared perceptual or decisional mechanisms for serial dependence effects across different low-level perceptual tasks.

Characterizing serial dependence as an attraction to prior response

Serial dependence refers to a common misperception that can occur between subsequently observed stimuli. Observers misreport the current stimulus as being more similar to the previous stimulus than it objectively is. It has been proposed that this bias may reflect an attraction of the current percept to prior percept (Fischer & Whitney, 2014). Alternatively, serial dependence has also been proposed to be the result of an assimilative effect between observer decisions (Fritsche, Mostert, & de Lange, 2017; Pascucci, Mancuso, Santandrea, Libera, Plomp, & Chelazzi, 2019). Lying within this debate is the issue of how we quantify serial dependence. Should this be as a bias induced by prior stimuli or by prior responses? We investigated this by manipulating the orientation of the current stimuli such that they fell between previous stimulus and previous response. We observed an attraction to previous response and a concomitant repulsion from previous stimulus. This suggests that the attractive effect of serial dependence in orientation judgments is best quantified in relation to prior response.

Serial dependence: A matter of memory load

In serial dependence, perceptual decisions are biased towards stimuli encountered in the recent past. Here, we investigate whether and how serial dependence is affected by the availability of visual working memory (VWM) resources. In two experiments, participants reproduced the orientation of a series of stimuli. On alternating trials, we included an additional VWM task with randomly varying levels of load. Serial dependence was not only affected by the additional load task but also clearly modulated by the level of load: a high load in the previous trial reduced serial dependence while a high load in the present increased it. These results were independent of the effects of VWM load on the precision of reproduction responses. Our findings provide new insights into the mechanisms that may regulate serial dependence, revealing its intimate link with VWM resources.

Significance statement

Our perception, thoughts, and behavior are continuously influenced by recent events. For instance, the way we process and understand current visual information depends on what we have seen in the preceding seconds, a phenomenon known as serial dependence. The precise mechanisms and factors involved in serial dependence are still unclear. Here, we demonstrated that working memory resources are a crucial component. Specifically, when we are currently experiencing a heavy memory load, the influence of prior stimuli becomes stronger. Conversely, when prior stimuli were shown under a high memory load, their influence was reduced. These findings highlight the importance of working memory resources in shaping our interpretation of the present based on the recent past.

Tactile adaptation to orientation produces a robust tilt aftereffect and exhibits crossmodal transfer when tested in vision

Orientation processing is one of the most fundamental functions in both visual and somatosensory perception. Converging findings suggest that orientation processing in both modalities is closely linked: somatosensory neurons share a similar orientation organisation as visual neurons, and the visual cortex has been found to be heavily involved in tactile orientation perception. Hence, we hypothesized that somatosensation would exhibit a similar orientation adaptation effect, and this adaptation effect would be transferable between the two modalities, considering the above-mentioned connection. The tilt aftereffect (TAE) is a demonstration of orientation adaptation and is used widely in behavioural experiments to investigate orientation mechanisms in vision. By testing the classic TAE paradigm in both tactile and crossmodal orientation tasks between vision and touch, we were able to show that tactile perception of orientation shows a very robust TAE, similar to its visual counterpart. We further show that orientation adaptation in touch transfers to produce a TAE when tested in vision, but not vice versa. Additionally, when examining the test sequence following adaptation for serial effects, we observed another asymmetry between the two conditions where the visual test sequence displayed a repulsive intramodal serial dependence effect while the tactile test sequence exhibited an attractive serial dependence. These findings provide concrete evidence that vision and touch engage a similar orientation processing mechanism. However, the asymmetry in the crossmodal transfer of TAE and serial dependence points to a non-reciprocal connection between the two modalities, providing further insights into the underlying processing mechanism.

Opposing serial dependencies revealed for sequences of auditory emotional stimuli

Our percept of the world is not solely determined by what we perceive and process at a given moment in time, but also depends on what we processed recently. In the present study, we investigate whether the perceived emotion of a spoken sentence is contingent upon the emotion of an auditory stimulus on the preceding trial (i.e., serial dependence). Thereto, participants were exposed to spoken sentences that varied in emotional affect by changing the prosody that ranged from 'happy' to 'fearful'. Participants were instructed to rate the emotion. We found a positive serial dependence for emotion processing whereby the perceived emotion was biased towards the emotion on the preceding trial. When we introduced 'no-go' trials (i.e., no rating was required), we found a negative serial dependence when participants knew in advance to withhold their response on a given trial (Experiment 2) and a positive serial dependence when participants received the information to withhold their response after the stimulus presentation (Experiment 3). We therefore established a robust serial dependence for emotion processing in speech and introduce a methodology to disentangle perceptual from post-perceptual processes. This approach can be applied to the vast majority of studies investigating sequential dependencies to separate positive from negative serial dependence.

Tuning perception and decisions to temporal context

Recent work suggests that serial dependence, where perceptual decisions are biased toward previous stimuli, arises from the prior that sensory input is temporally correlated. However, existing studies have mostly used random stimulus sequences that do not involve such temporal consistencies. Here, we manipulated the temporal statistics of visual stimuli to examine the role of true temporal correlations in serial dependence. In two experiments, observers reproduced the orientation of the last stimulus in a sequence, while we varied temporal correlations in the stimulus features at two timescales: stimulus history within the trial and decision history across trials. We found a clear dissociation: increasing temporal correlation in the stimulus history led to adaptation-like repulsive biases, whereas increasing temporal correlation in the decision history reduced attractive biases. Thus, we suggest that temporal correlation enhances the discriminative ability of the visual system, revealing the fundamental role of the broader temporal context.

Stable perceptual phenotype of the magnitude of history biases even in the face of global task complexity

According to a Bayesian framework, visual perception requires active interpretation of noisy sensory signals in light of prior information. One such mechanism, serial dependence, is thought to promote perceptual stability by assimilating current percepts with recent stimulus history. Combining a delayed orientation-adjustment paradigm with predictable (study 1) or unpredictable (study 2) task structure, we test two key predictions of this account in a novel context: first, that serial dependence should persist even in variable environments, and, second, that, within a given observer and context, this behavioral bias should be stable from one occasion to the next. Relying on data of 41 human volunteers and two separate experimental sessions, we confirm both hypotheses. Group-level, attractive serial dependence remained strong even in the face of volatile settings with multiple, unpredictable types of tasks, and, despite considerable interindividual variability, within-subject patterns of attractive and repulsive stimulus-history biases were highly stable from one experimental session to the next. In line with the hypothesized functional role of serial dependence, we propose that, together with previous work, our findings suggest the existence of a more general individual-specific fingerprint with which the past shapes current perception. Congruent with the Bayesian account, interindividual differences may then result from differential weighting of sensory evidence and prior information.

Serial dependence in visual perception: A meta-analysis and review

Positive sequential dependencies are phenomena in which actions, perception, decisions, and memory of features or objects are systematically biased toward visual experiences from the recent past. Among many labels, serial dependencies have been referred to as priming, sequential dependencies, sequential effects, or serial effects. Despite extensive research on the topic, the field still lacks an operational definition of what counts as serial dependence. In this meta-analysis, we review the vast literature on serial dependence and quantitatively assess its key diagnostic characteristics across several different domains of visual perception. The meta-analyses fully characterize serial dependence in orientation, face, and numerosity perception. They show that serial dependence is defined by four main kinds of tuning: serial dependence decays with time (temporal-tuning), it depends on relative spatial location (spatial-tuning), it occurs only between similar features and objects (feature-tuning), and it is modulated by attention (attentional-tuning). We also review studies of serial dependence that report single observer data, highlighting the importance of individual differences in serial dependence. Finally, we discuss a range of outstanding questions and novel research avenues that are prompted by the meta-analyses. Together, the meta-analyses provide a full characterization of serial dependence as an operationally defined family of visual phenomena, and they outline several of the key diagnostic criteria for serial dependence that should serve as guideposts for future research.

Probabilistic integration of preceding responses explains response bias in perceptual decision making

Expectations of sensory information change not only how well but also what we perceive. Even in an unpredictable environment, the brain is by default constantly engaged in computing probabilities between sensory events. These estimates are used to generate predictions about future sensory events. Here, we investigated the predictability of behavioral responses using three different learning models in three different one-interval two-alternative forced choice experiments with either auditory, vestibular, or visual stimuli. Results indicate that recent decisions, instead of the sequence of generative stimuli, cause serial dependence. By bridging the gap between sequence learning and perceptual decision making, we provide a novel perspective on sequential choice effects. We propose that serial biases reflect the tracking of statistical regularities of the decision variable, offering a broader understanding of this phenomenon.

Serial dependence improves performance and biases confidence-based decisions

Perception depends on both the current sensory input and on the preceding stimuli history, a mechanism referred to as serial dependence (SD). One interesting, and somewhat controversial, question is whether serial dependence originates at the perceptual stage, which should lead to a sensory improvement, or at a subsequent decisional stage, causing solely a bias. Here, we studied the effects of SD in a novel manner by leveraging on the human capacity to spontaneously assess the quality of sensory information. Two noisy-oriented Gabor stimuli were simultaneously presented along with two bars of the same orientation as the Gabor stimuli. Participants were asked to choose which Gabor stimulus to judge and then make a forced-choice judgment of its orientation by selecting the appropriate response bar. On all trials, one of the Gabor stimuli had the same orientation as the Gabor in the same position on the previous trial. We explored whether continuity in orientation and position affected choice and accuracy. Results show that continuity of orientation leads to a persistent (up to four back) accuracy advantage and a higher preference in the selection of stimuli with the same orientation, and this advantage accumulates over trials. In contrast, analysis of the continuity of the selected position indicated that participants had a strong tendency to choose stimuli in the same position, but this behavior did not lead to an improvement in accuracy.

Neural Evidence for Boundary Updating as the Source of the Repulsive Bias in Classification

Binary classification, an act of sorting items into two classes by setting a boundary, is biased by recent history. One common form of such bias is repulsive bias, a tendency to sort an item into the class opposite to its preceding items. Sensory-adaptation and boundary-updating are considered as two contending sources of the repulsive bias, yet no neural support has been provided for either source. Here, we explored human brains of both men and women, using functional magnetic resonance imaging (fMRI), to find such support by relating the brain signals of sensory-adaptation and boundary-updating to human classification behavior. We found that the stimulus-encoding signal in the early visual cortex adapted to previous stimuli, yet its adaptation-related changes were dissociated from current choices. Contrastingly, the boundary-representing signals in the inferior-parietal and superior-temporal cortices shifted to previous stimuli and covaried with current choices. Our exploration points to boundary-updating, rather than sensory-adaptation, as the origin of the repulsive bias in binary classification.SIGNIFICANCE STATEMENT Many animal and human studies on perceptual decision-making have reported an intriguing history effect called "repulsive bias," a tendency to classify an item as the opposite class of its previous item. Regarding the origin of repulsive bias, two contending ideas have been proposed: "bias in stimulus representation because of sensory adaptation" versus "bias in class-boundary setting because of belief updating." By conducting model-based neuroimaging experiments, we verified their predictions about which brain signal should contribute to the trial-to-trial variability in choice behavior. We found that the brain signal of class boundary, but not stimulus representation, contributed to the choice variability associated with repulsive bias. Our study provides the first neural evidence supporting the boundary-based hypothesis of repulsive bias.

Attractive and repulsive serial dependence: The role of task relevance, the passage of time, and the number of stimuli

Visual decisions are attracted toward features of previous stimuli. This phenomenon, termed serial dependence, has been related to a mechanism that integrates present visual input with stimuli seen up to 10 to 15 s in the past. It is believed that this mechanism is "temporally tuned" and the effect of prior stimuli fades with time. Here, we investigated whether the temporal window of serial dependence is influenced by the number of stimuli shown. Observers performed an orientation adjustment task where the interval between the past and present stimulus and the number of intervening stimuli varied. First, we found that the direction-repulsive or attractive-and duration of the effect of a past stimulus depends on whether the past stimulus was relevant to behavior. Second, we show that the number of stimuli, and not only the passage of time, plays a role: The effect of a stimulus at a fixed interval depends on the number of other stimuli shown after. Our results demonstrate that neither a single mechanism nor a general tuning window can fully capture the complexity of serial dependence.

Independent short- and long-term dependencies in perception

Perception is biased by stimulus history. Both long-term effects such as the central-tendency bias (CTB) and short-term effects such as serial dependence (SD) have been described, but research into the two has remained largely separate. The sources of these effects, however, are highly correlated in stimulus statistics, which can result in a misinterpretation of experimental data. We compared CTB and SD in the perception of color and line length. Observers judged the relative hue or length of consecutive stimuli in a delayed-matching task. Two interstimulus intervals were used to investigate whether elapsed time or the number of stimulus occurrences was more important for SD. We estimated biases by fitting psychometric functions to the data split based on the history features, and we also fit generalized linear mixed models with either CTB, SD, or both included as regressors. We found biases to both recent stimulus history and the cumulative average of stimulus values for both color and line length judgments. The strength and pattern of each of the biases depended on whether all sources of bias were included in the analysis. Within the range of interstimulus intervals tested, the number of intervening stimuli was more important than elapsed time for SD. We conclude that both SD and CTB independently affect perceptual judgments, and that one effect is not an artifact caused by the other. Failing to consider both effects in data analysis can give an erroneous picture of the phenomenon under study.

Serial dependence in visual perception: A review

How does the visual system represent continuity in the constantly changing visual input? A recent proposal is that vision is serially dependent: Stimuli seen a moment ago influence what we perceive in the present. In line with this, recent frameworks suggest that the visual system anticipates whether an object seen at one moment is the same as the one seen a moment ago, binding visual representations across consecutive perceptual episodes. A growing body of work supports this view, revealing signatures of serial dependence in many diverse visual tasks. Yet, the variety of disparate findings and interpretations calls for a more general picture. Here, we survey the main paradigms and results over the past decade. We also focus on the challenge of finding a relationship between serial dependence and the concept of "object identity," taking centuries-long history of research into account. Among the seemingly contrasting findings on serial dependence, we highlight common patterns that may elucidate the nature of this phenomenon and attempt to identify questions that are unanswered.

Persistent activity in human parietal cortex mediates perceptual choice repetition bias

Humans and other animals tend to repeat or alternate their previous choices, even when judging sensory stimuli presented in a random sequence. It is unclear if and how sensory, associative, and motor cortical circuits produce these idiosyncratic behavioral biases. Here, we combined behavioral modeling of a visual perceptual decision with magnetoencephalographic (MEG) analyses of neural dynamics, across multiple regions of the human cerebral cortex. We identified distinct history-dependent neural signals in motor and posterior parietal cortex. Gamma-band activity in parietal cortex tracked previous choices in a sustained fashion, and biased evidence accumulation toward choice repetition; sustained beta-band activity in motor cortex inversely reflected the previous motor action, and biased the accumulation starting point toward alternation. The parietal, not motor, signal mediated the impact of previous on current choice and reflected individual differences in choice repetition. In sum, parietal cortical signals seem to play a key role in shaping choice sequences.

The effect of perceptual history on the interpretation of causality

The ability to interpret spatiotemporal contingencies in terms of causal relationships plays a key role in human understanding of the external world. Indeed, the detection of such simple properties enables us to attribute causal attributes to interactions between objects. Here, we investigated the degree to which this perception of causality depends on recent experience, as has been found for other low-level properties of visual stimuli. Participants were shown launching sequences of colliding circles with varying collision lags and were asked to report their impression of causality. We found short-term attractive and long-term repulsive and attractive effects of perceptual history on the interpretation of causality. Stimuli directly following a causal impression were more likely to be judged as causal and vice versa. However, prior judgments on less recent (>5) trials biased current perception with both positive/attractive and negative/repulsive influences. We interpret these results in terms of two potential mechanisms: adaptive temporal binding windows and updating of internal representations of causality. Overall, these results demonstrate the important role of prior experience even for causality, a fundamental building block of how we understand our world.

Cartesian coordinates scaffold stable spatial perception over time

Visual systems exploit temporal continuity principles to achieve stable spatial perception, manifested as the serial dependence and central tendency effects. These effects are posited to reflect a smoothing process whereby past and present information integrates over time to decrease noise and stabilize perception. Meanwhile, the basic spatial coordinate—Cartesian versus polar—that scaffolds the integration process in two-dimensional continuous space remains unknown. The spatial coordinates are largely related to the allocentric and egocentric reference frames and presumably correspond with early and late processing stages in spatial perception. Here, four experiments consistently demonstrate that Cartesian outperforms polar coordinates in characterizing the serial bias—serial dependence and central tendency effect—in two-dimensional continuous spatial perception. The superiority of Cartesian coordinates is robust, independent of task environment (online and offline task), experimental length (short and long blocks), spatial context (shape of visual mask), and response modality (keyboard and mouse). Taken together, the visual system relies on the Cartesian coordinates for spatiotemporal integration to facilitate stable representation of external information, supporting the involvement of allocentric reference frame and top-down modulation in spatial perception over long time intervals.

Same stimulus, same temporal context, different percept? Individual differences in hysteresis and adaptation when perceiving multistable dot lattices

How we perceptually organize a visual stimulus depends not only on the stimulus itself, but also on the temporal and spatial context in which the stimulus is presented and on the individual processing the stimulus and context. Earlier research found both attractive and repulsive context effects in perception: tendencies to organize visual input similarly to preceding context stimuli (i.e., hysteresis, attraction) co-exist with tendencies that repel the current percept from the organization that is most dominant in these contextual stimuli (i.e., adaptation, repulsion). These processes have been studied mostly on a group level (e.g., Schwiedrzik et al., 2014). Using a Bayesian hierarchical model comparison approach, the present study (N = 75) investigated whether consistent individual differences exist in these attractive and repulsive temporal context effects, with multistable dot lattices as stimuli. In addition, the temporal stability of these individual differences in context effects was investigated, and it was studied how the strength of these effects related to the strength of individual biases for absolute orientations. The results demonstrate that large individual differences in the size of attractive and repulsive context effects exist. Furthermore, these individual differences are highly consistent across timepoints (one to two weeks apart). Although almost everyone showed both effects in the expected direction, not every single individual did. In sum, the study reveals differences in how individuals combine previous input and experience with current input in their perception, and more generally, this teaches us that different individuals can perceive identical stimuli differently, even within a similar context.

The test-retest reliability and spatial tuning of serial dependence in orientation perception

Humans perceive objects and scenes consistently, even in situations where visual input is noisy and unstable. One of the mechanisms that underlies this perceptual stability is serial dependence, whereby the perception of objects or features at any given moment is pulled toward what was previously seen. Although recent findings from several studies have reported large individual differences in serial dependence, it is not clear how stable the serial dependence is within an individual. Here, we investigated the stability of serial dependence in orientation perception over two different days within the same observers. In addition, we also examined the visual field location specificity of perceptual serial dependence. On each trial, observers viewed a Gabor patch and then reported its apparent orientation by adjusting the orientation of a bar. For each observer, the Gabor was located in the foveal or peripheral (10° right or left eccentricity) visual field on both days or changed location from day to day. The results showed a very high degree of test-retest reliability in serial dependence measured across days within individual observers. Interestingly, this high within-subject consistency was only found when serial dependence was measured at the same visual field location. These results suggest that individual differences in serial dependence are stable across days, and that the spatiotemporal range in which the previous stimulus assimilates the perception of the current stimulus (the continuity field) may vary across different visual field locations in an observer-specific manner.

Individual differences in serial dependence manifest when sensory uncertainty is high

Perceptual experience in the recent past has been shown to alter subsequent perception. Recently, it has been suggested that this "serial dependence" effect is modulated by sensory uncertainty. In the current study, by overlaying three different levels of visual noise (i.e., no-, low-, or high-noise) on face stimuli, we investigated how serial dependence in face identity perception varies with sensory uncertainty. After learning two facial identities, the faces were combined at various morph levels and participants reported which identity was perceived while noise and noise-free presentations alternated over trials. Results showed that identity perception of noise-free faces was positively biased toward the past when the previous face was noise-free or highly noisy, but not when a low-noise was added. There were considerable individual differences in bias magnitude for trials preceded by high-noise stimuli which reflected individuals' general bias tendencies. When correlated with the other two conditions, a general bias tendency showed a significant relationship with low-noise trials, but not with no-noise trials. This indicates that the bias tendency of individuals manifests more strongly when the sensory information was uncertain. Therefore, the current findings suggest 1) that sensory uncertainty modulates serial dependence in face identity perception and 2) that an individual's general bias tendency interacts with sensory uncertainty to alter perception.

Perceptual History Acts in World-Centred Coordinates

Serial dependence effects have been observed using a variety of stimuli and tasks, revealing that the recent past can bias current percepts, leading to increased similarity between two. The aim of this study is to determine whether this temporal integration occurs in egocentric or allocentric coordinates. We asked participants to perform an orientation reproduction task using grating stimuli while the head was kept at a fixed position, or after a 40° yaw rotation between trials, from left (-20°) to right (+20°), putting the egocentric and allocentric cues in conflict. Under these conditions, allocentric cues prevailed.

Serial dependence revealed in history-dependent perceptual templates

In any given perceptual task, the visual system selectively weighs or filters incoming information. The particular set of weights or filters form a kind of template, which reveals the regions or types of information that are particularly useful for a given perceptual decision.1,2 Unfortunately, sensory input is noisy and ever changing. To compensate for these fluctuations, the visual system could adopt a strategy of biasing the templates such that they reflect a temporal smoothing of input, which would be a form of serial dependence.3-5 Here, we demonstrate that perceptual templates are, in fact, altered by serial dependence. Using a simple orientation detection task and classification-image technique, we found that perceptual templates are systematically biased toward previously seen, task-irrelevant orientations. The results of an orientation discrimination task suggest that this shift in perceptual template derives from a change in the perceptual appearance of orientation. Our study reveals how serial dependence biases internal templates of orientation and suggests that the sensitivity of classification-image techniques in general could be improved by taking into account history-dependent fluctuations in templates.

Auditory Rate Perception Displays a Positive Serial Dependence

We investigated perceived timing in auditory rate perception using a reproduction task. The study aimed to test (a) whether central tendency occurs in rate perception, as shown for interval timing, and (b) whether rate is perceived independently on each trial or shows a serial dependence, as shown for other perceptual attributes. Participants were well able to indicate perceived rate as reproduced and presented rates were linearly related with a slope that approached unity, although tapping significantly overestimated presented rates. While the slopes approached unity, they were significantly less than 1, indicating a central tendency in which reproduced rates tended towards the mean of the presented range. We tested for serial dependency by seeing if current trial rate reproductions depended on the preceding rate. In two conditions, a positive dependence was observed. A third condition in which participants withheld responses on every second trial produced a negative dependency. These results suggest separate components of serial dependence linked to stimulus and response: Withholding responses reveals a negative perceptual effect, whereas making responses adds a stronger positive effect that is postperceptual and makes the combined effect positive. Together, these data show that auditory rate perception exhibits both central tendency and serial dependence effects.