Opposite effects of choice history and evidence history resolve a paradox of sequential choice bias

An efficient Bayesian observer model of attractive and repulsive temporal context effects when perceiving multistable dot lattices

In multistable dot lattices, the orientation we perceive is attracted toward the orientation we perceived in the immediately preceding stimulus and repelled from the orientation for which most evidence was present previously (Van Geert, Moors, Haaf, & Wagemans, 2022). Theoretically-inspired models have been proposed to explain the co-occurrence of attractive and repulsive context effects in multistable dot lattice tasks, but these models artificially induced an influence of the previous trial on the current one without detailing the process underlying such an influence (Gepshtein & Kubovy, 2005; Schwiedrzik et al., 2014). We conducted a simulation study to test whether the observed attractive and repulsive context effects could be explained with an efficient Bayesian observer model (Wei & Stocker, 2015). This model assumes variable encoding precision of orientations in line with their frequency of occurrence (i.e., efficient encoding) and takes the dissimilarity between stimulus space and sensory space into account. An efficient Bayesian observer model including both a stimulus and a perceptual level was needed to explain the co-occurrence of both attractive and repulsive temporal context effects. Furthermore, this model could reproduce the empirically observed strong positive correlation between individuals' attractive and repulsive effects (Van Geert et al., 2022), by assuming a positive correlation between temporal integration constants at the stimulus and the perceptual level. To conclude, the study brings evidence that efficient encoding and likelihood repulsion on the stimulus level can explain the repulsive context effect, whereas perceptual prior attraction can explain the attractive temporal context effect when perceiving multistable dot lattices.

Prägnanz in visual perception

How do we perceptually and cognitively organize incoming stimulation? A century ago, Gestalt psychologists posited the law of Prägnanz: psychological organization will always be as 'good' as possible given the prevailing conditions. To make the Prägnanz law a useful statement, it needs to be specified further (a) what a 'good' psychological organization entails, (b) how the Prägnanz tendency can be realized, and (c) which conditions need to be taken into account. Although the Gestalt school did provide answers to these questions, modern-day mentions of Prägnanz or good Gestalt often lack these clarifications. The concept of Prägnanz has been (mis)understood in many different ways, and by looking back on the rich history of the concept, we will attempt to present a more fine-grained view and promote a renewed understanding of the central role of Prägnanz in visual perception and beyond. We review Gestalt psychology's answers to the questions listed above, and also discuss the four main uses of the Prägnanz concept in more detail: (a) a Prägnanz tendency in each organizational process, (b) Prägnanz as a property of a Gestalt, (c) Prägnanz steps as internal reference points, and (d) Prägnanz in relation to aesthetic appreciation. As a key takeaway, Prägnanz is a multifaceted Gestalt psychological concept indicating the "goodness" of an experienced organization. Both the removal of unnecessary details and the emphasis on characteristic features of the overall organization compared to a reference organization can contribute to the emergence of a 'better' Gestalt. The stimulus constellation is not the only factor in determining the goodness of an organization, also the stimulus' interaction with an individual in a specific spatial and temporal context plays a role. Taking the ideas on Prägnanz as a generative framework and keeping the original Gestalt psychological context in mind, future research on perceptual organization can improve our understanding of the principles underlying psychological organization by further specifying how different organizational principles interact in concrete situations. Public significance statement: This paper reviews what a 'good' psychological organization entails, and how the incoming stimulation is clarified in human perception to achieve the best possible psychological organization. The review debunks common misconceptions on the meaning of "goodness" and synthesizes the most important perspectives and developments on "goodness" from its conception until now.

Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Active reinforcement learning enables dynamic prediction and control, where one should not only maximize rewards but also minimize costs such as of inference, decisions, actions, and time. For an embodied agent such as a human, decisions are also shaped by physical aspects of actions. Beyond the effects of reward outcomes on learning processes, to what extent can modeling of behavior in a reinforcement-learning task be complicated by other sources of variance in sequential action choices? What of the effects of action bias (for actions per se) and action hysteresis determined by the history of actions chosen previously? The present study addressed these questions with incremental assembly of models for the sequential choice data from a task with hierarchical structure for additional complexity in learning. With systematic comparison and falsification of computational models, human choices were tested for signatures of parallel modules representing not only an enhanced form of generalized reinforcement learning but also action bias and hysteresis. We found evidence for substantial differences in bias and hysteresis across participants-even comparable in magnitude to the individual differences in learning. Individuals who did not learn well revealed the greatest biases, but those who did learn accurately were also significantly biased. The direction of hysteresis varied among individuals as repetition or, more commonly, alternation biases persisting from multiple previous actions. Considering that these actions were button presses with trivial motor demands, the idiosyncratic forces biasing sequences of action choices were robust enough to suggest ubiquity across individuals and across tasks requiring various actions. In light of how bias and hysteresis function as a heuristic for efficient control that adapts to uncertainty or low motivation by minimizing the cost of effort, these phenomena broaden the consilient theory of a mixture of experts to encompass a mixture of expert and nonexpert controllers of behavior.

Your Vestibular Thresholds May Be Lower Than You Think: Cognitive Biases in Vestibular Psychophysics

PURPOSE

Recently, there has been a surge of interest in measuring vestibular perceptual thresholds, which quantify the smallest motion that a subject can reliably perceive, to study physiology and pathophysiology. These thresholds are sensitive to age, pathology, and postural performance. Threshold tasks require decisions to be made in the presence of uncertainty. Since humans often rely on past information when making decisions in the presence of uncertainty, we hypothesized that (a) perceptual responses are affected by their preceding trial; (b) perceptual responses tend to be biased opposite of the "preceding response" because of cognitive biases but are not biased by the "preceding stimulus"; and (c) when fits do not account for this cognitive bias, thresholds are overestimated. To our knowledge, these hypotheses are unaddressed in vestibular and direction-recognition tasks.

CONCLUSIONS

Results in normal subjects supported each hypothesis. Subjects tended to respond opposite of their preceding response (not the preceding stimulus), indicating a cognitive bias, and this caused an overestimation of thresholds. Using an enhanced model (MATLAB code provided) that considered these effects, average thresholds were lower (5.5% for yaw, 7.1% for interaural). Since the results indicate that the magnitude of cognitive bias varies across subjects, this enhanced model can reduce measurement variability and potentially improve the efficiency of data collection.

Serial dependence in visual perception: A meta-analysis and review

Positive sequential dependencies are phenomena in which actions, perception, decisions, and memory of features or objects are systematically biased toward visual experiences from the recent past. Among many labels, serial dependencies have been referred to as priming, sequential dependencies, sequential effects, or serial effects. Despite extensive research on the topic, the field still lacks an operational definition of what counts as serial dependence. In this meta-analysis, we review the vast literature on serial dependence and quantitatively assess its key diagnostic characteristics across several different domains of visual perception. The meta-analyses fully characterize serial dependence in orientation, face, and numerosity perception. They show that serial dependence is defined by four main kinds of tuning: serial dependence decays with time (temporal-tuning), it depends on relative spatial location (spatial-tuning), it occurs only between similar features and objects (feature-tuning), and it is modulated by attention (attentional-tuning). We also review studies of serial dependence that report single observer data, highlighting the importance of individual differences in serial dependence. Finally, we discuss a range of outstanding questions and novel research avenues that are prompted by the meta-analyses. Together, the meta-analyses provide a full characterization of serial dependence as an operationally defined family of visual phenomena, and they outline several of the key diagnostic criteria for serial dependence that should serve as guideposts for future research.

Probabilistic integration of preceding responses explains response bias in perceptual decision making

Expectations of sensory information change not only how well but also what we perceive. Even in an unpredictable environment, the brain is by default constantly engaged in computing probabilities between sensory events. These estimates are used to generate predictions about future sensory events. Here, we investigated the predictability of behavioral responses using three different learning models in three different one-interval two-alternative forced choice experiments with either auditory, vestibular, or visual stimuli. Results indicate that recent decisions, instead of the sequence of generative stimuli, cause serial dependence. By bridging the gap between sequence learning and perceptual decision making, we provide a novel perspective on sequential choice effects. We propose that serial biases reflect the tracking of statistical regularities of the decision variable, offering a broader understanding of this phenomenon.

Neural Evidence for Boundary Updating as the Source of the Repulsive Bias in Classification

Binary classification, an act of sorting items into two classes by setting a boundary, is biased by recent history. One common form of such bias is repulsive bias, a tendency to sort an item into the class opposite to its preceding items. Sensory-adaptation and boundary-updating are considered as two contending sources of the repulsive bias, yet no neural support has been provided for either source. Here, we explored human brains of both men and women, using functional magnetic resonance imaging (fMRI), to find such support by relating the brain signals of sensory-adaptation and boundary-updating to human classification behavior. We found that the stimulus-encoding signal in the early visual cortex adapted to previous stimuli, yet its adaptation-related changes were dissociated from current choices. Contrastingly, the boundary-representing signals in the inferior-parietal and superior-temporal cortices shifted to previous stimuli and covaried with current choices. Our exploration points to boundary-updating, rather than sensory-adaptation, as the origin of the repulsive bias in binary classification.SIGNIFICANCE STATEMENT Many animal and human studies on perceptual decision-making have reported an intriguing history effect called "repulsive bias," a tendency to classify an item as the opposite class of its previous item. Regarding the origin of repulsive bias, two contending ideas have been proposed: "bias in stimulus representation because of sensory adaptation" versus "bias in class-boundary setting because of belief updating." By conducting model-based neuroimaging experiments, we verified their predictions about which brain signal should contribute to the trial-to-trial variability in choice behavior. We found that the brain signal of class boundary, but not stimulus representation, contributed to the choice variability associated with repulsive bias. Our study provides the first neural evidence supporting the boundary-based hypothesis of repulsive bias.

Independent short- and long-term dependencies in perception

Perception is biased by stimulus history. Both long-term effects such as the central-tendency bias (CTB) and short-term effects such as serial dependence (SD) have been described, but research into the two has remained largely separate. The sources of these effects, however, are highly correlated in stimulus statistics, which can result in a misinterpretation of experimental data. We compared CTB and SD in the perception of color and line length. Observers judged the relative hue or length of consecutive stimuli in a delayed-matching task. Two interstimulus intervals were used to investigate whether elapsed time or the number of stimulus occurrences was more important for SD. We estimated biases by fitting psychometric functions to the data split based on the history features, and we also fit generalized linear mixed models with either CTB, SD, or both included as regressors. We found biases to both recent stimulus history and the cumulative average of stimulus values for both color and line length judgments. The strength and pattern of each of the biases depended on whether all sources of bias were included in the analysis. Within the range of interstimulus intervals tested, the number of intervening stimuli was more important than elapsed time for SD. We conclude that both SD and CTB independently affect perceptual judgments, and that one effect is not an artifact caused by the other. Failing to consider both effects in data analysis can give an erroneous picture of the phenomenon under study.

Modality-specific sensory and decisional carryover effects in duration perception

BACKGROUND

The brain uses recent history when forming perceptual decisions. This results in carryover effects in perception. Although separate sensory and decisional carryover effects have been shown in many perceptual tasks, their existence and nature in temporal processing are unclear. Here, we investigated whether and how previous stimuli and previous choices affect subsequent duration perception, in vision and audition.

RESULTS

In a series of three experiments, participants were asked to classify visual or auditory stimuli into "shorter" or "longer" duration categories. In experiment 1, visual and auditory stimuli were presented in separate blocks. Results showed that current duration estimates were repelled away from the previous trial's stimulus duration, but attracted towards the previous choice, in both vision and audition. In experiment 2, visual and auditory stimuli were pseudorandomly presented in one block. We found that sensory and decisional carryover effects occurred only when previous and current stimuli were from the same modality. Experiment 3 further investigated the stimulus dependence of carryover effects within each modality. In this experiment, visual stimuli with different shape topologies (or auditory stimuli with different audio frequencies) were pseudorandomly presented in one visual (or auditory) block. Results demonstrated sensory carryover (within each modality) despite task-irrelevant differences in visual shape topology or audio frequency. By contrast, decisional carryover was reduced (but still present) across different visual topologies and completely absent across different audio frequencies.

CONCLUSIONS

These results suggest that serial dependence in duration perception is modality-specific. Moreover, repulsive sensory carryover effects generalize within each modality, whereas attractive decisional carryover effects are contingent on contextual details.

WildLab: A naturalistic free viewing experiment reveals previously unknown electroencephalography signatures of face processing

Neural mechanisms of face perception are predominantly studied in well-controlled experimental settings that involve random stimulus sequences and fixed eye positions. Although powerful, the employed paradigms are far from what constitutes natural vision. Here, we demonstrate the feasibility of ecologically more valid experimental paradigms using natural viewing behaviour, by combining a free viewing paradigm on natural scenes, free of photographer bias, with advanced data processing techniques that correct for overlap effects and co-varying non-linear dependencies of multiple eye movement parameters. We validate this approach by replicating classic N170 effects in neural responses, triggered by fixation onsets (fixation event-related potentials [fERPs]). Importantly, besides finding a strong correlation between both experiments, our more natural stimulus paradigm yielded smaller variability between subjects than the classic setup. Moving beyond classic temporal and spatial effect locations, our experiment furthermore revealed previously unknown signatures of face processing: This includes category-specific modulation of the event-related potential (ERP)'s amplitude even before fixation onset, as well as adaptation effects across subsequent fixations depending on their history.

Persistent activity in human parietal cortex mediates perceptual choice repetition bias

Humans and other animals tend to repeat or alternate their previous choices, even when judging sensory stimuli presented in a random sequence. It is unclear if and how sensory, associative, and motor cortical circuits produce these idiosyncratic behavioral biases. Here, we combined behavioral modeling of a visual perceptual decision with magnetoencephalographic (MEG) analyses of neural dynamics, across multiple regions of the human cerebral cortex. We identified distinct history-dependent neural signals in motor and posterior parietal cortex. Gamma-band activity in parietal cortex tracked previous choices in a sustained fashion, and biased evidence accumulation toward choice repetition; sustained beta-band activity in motor cortex inversely reflected the previous motor action, and biased the accumulation starting point toward alternation. The parietal, not motor, signal mediated the impact of previous on current choice and reflected individual differences in choice repetition. In sum, parietal cortical signals seem to play a key role in shaping choice sequences.

Superstitious learning of abstract order from random reinforcement

Humans and other animals often infer spurious associations among unrelated events. However, such superstitious learning is usually accounted for by conditioned associations, raising the question of whether an animal could develop more complex cognitive structures independent of reinforcement. Here, we tasked monkeys with discovering the serial order of two pictorial sets: a "learnable" set in which the stimuli were implicitly ordered and monkeys were rewarded for choosing the higher-rank stimulus and an "unlearnable" set in which stimuli were unordered and feedback was random regardless of the choice. We replicated prior results that monkeys reliably learned the implicit order of the learnable set. Surprisingly, the monkeys behaved as though some ordering also existed in the unlearnable set, showing consistent choice preference that transferred to novel untrained pairs in this set, even under a preference-discouraging reward schedule that gave rewards more frequently to the stimulus that was selected less often. In simulations, a model-free reinforcement learning algorithm (Q-learning) displayed a degree of consistent ordering among the unlearnable set but, unlike the monkeys, failed to do so under the preference-discouraging reward schedule. Our results suggest that monkeys infer abstract structures from objectively random events using heuristics that extend beyond stimulus-outcome conditional learning to more cognitive model-based learning mechanisms.

Same stimulus, same temporal context, different percept? Individual differences in hysteresis and adaptation when perceiving multistable dot lattices

How we perceptually organize a visual stimulus depends not only on the stimulus itself, but also on the temporal and spatial context in which the stimulus is presented and on the individual processing the stimulus and context. Earlier research found both attractive and repulsive context effects in perception: tendencies to organize visual input similarly to preceding context stimuli (i.e., hysteresis, attraction) co-exist with tendencies that repel the current percept from the organization that is most dominant in these contextual stimuli (i.e., adaptation, repulsion). These processes have been studied mostly on a group level (e.g., Schwiedrzik et al., 2014). Using a Bayesian hierarchical model comparison approach, the present study (N = 75) investigated whether consistent individual differences exist in these attractive and repulsive temporal context effects, with multistable dot lattices as stimuli. In addition, the temporal stability of these individual differences in context effects was investigated, and it was studied how the strength of these effects related to the strength of individual biases for absolute orientations. The results demonstrate that large individual differences in the size of attractive and repulsive context effects exist. Furthermore, these individual differences are highly consistent across timepoints (one to two weeks apart). Although almost everyone showed both effects in the expected direction, not every single individual did. In sum, the study reveals differences in how individuals combine previous input and experience with current input in their perception, and more generally, this teaches us that different individuals can perceive identical stimuli differently, even within a similar context.

Adaptation and serial choice bias for low-level visual features are unaltered in autistic adolescents

Autism spectrum disorder (ASD), or autism, is characterized by social and non-social symptoms, including sensory hyper- and hyposensitivities. A suggestion has been put forward that some of these symptoms could be explained by differences in how sensory information is integrated with its context, including a lower tendency to leverage the past in the processing of new perceptual input. At least two history-dependent effects of opposite directions have been described in the visual perception literature: a repulsive adaptation effect, where perception of a stimulus is biased away from an adaptor stimulus, and an attractive serial choice bias, where perceptual choices are biased toward the previous choice. In this study, we investigated whether autistic participants differed in either bias from typically developing controls (TDs). Sixty-four adolescent participants (31 with ASD, 33 TDs) were asked to categorize oriented line stimuli in two tasks that were designed so that we would induce either adaptation or serial choice bias. Although our tasks successfully induced both biases, in comparing the two groups we found no differences in the magnitude of adaptation nor in the modulation of perceptual choices by the previous choice. In conclusion, we find no evidence of a decreased integration of the past in visual perception of low-level stimulus features in autistic adolescents.

Stimulus uncertainty predicts serial dependence in orientation judgements

How is what you see influenced by what you saw? The visual system may use recent perception to inform responses to current stimuli. This can cause the perception of current stimuli to be attracted toward previous observations, an effect termed serial dependence. This misperception might well be useful in a noisy visual environment, where minor image distortions over time may not actually represent meaningful change. Previous work has suggested that Bayesian perceptual inference may underlie serial dependence. For this to be true, the relative uncertainty associated with both prior and current sensory input should be taken into account. In an experiment manipulating the level of noise present in orientation stimuli, we found an effect of current stimulus uncertainty on serial dependence. We found no good evidence for an effect of previous stimulus uncertainty. Our results provide only partial evidence for the Bayesian interpretation of serial dependence. Non-Bayesian models may provide a better account of the phenomenon.

Dynamics of history-dependent perceptual judgment

Identical physical inputs do not always evoke identical percepts. To investigate the role of stimulus history in tactile perception, we designed a task in which rats had to judge each vibrissal vibration, in a long series, as strong or weak depending on its mean speed. After a low-speed stimulus (trial n - 1), rats were more likely to report the next stimulus (trial n) as strong, and after a high-speed stimulus, they were more likely to report the next stimulus as weak, a repulsive effect that did not depend on choice or reward on trial n - 1. This effect could be tracked over several preceding trials (i.e., n - 2 and earlier) and was characterized by an exponential decay function, reflecting a trial-by-trial incorporation of sensory history. Surprisingly, the influence of trial n - 1 strengthened as the time interval between n - 1 and n grew. Human subjects receiving fingertip vibrations showed these same key findings. We are able to account for the repulsive stimulus history effect, and its detailed time scale, through a single-parameter model, wherein each new stimulus gradually updates the subject's decision criterion. This model points to mechanisms underlying how the past affects the ongoing subjective experience.

Increased influence of prior choices on perceptual decisions in autism

Autism spectrum disorder (ASD) manifests sensory and perceptual atypicalities. Recent theories suggest that these may reflect a reduced influence of prior information in ASD. Some studies have found reduced adaptation to recent sensory stimuli in ASD. However, the effects of prior stimuli and prior perceptual choices can counteract one-another. Here, we investigated this using two different tasks (in two different cohorts): (i) visual location discrimination and (ii) multisensory (visual-vestibular) heading discrimination. We fit the data using a logistic regression model to dissociate the specific effects of prior stimuli and prior choices. In both tasks, perceptual decisions were biased toward recent choices. Notably, the 'attractive' effect of prior choices was significantly larger in ASD (in both tasks and cohorts), while there was no difference in the influence of prior stimuli. These results challenge theories of reduced priors in ASD, and rather suggest an increased consistency bias for perceptual decisions in ASD.

Concurrent visual working memory bias in sequential integration of approximate number

Previous work has shown bidirectional crosstalk between Working Memory (WM) and perception such that the contents of WM can alter concurrent percepts and vice versa. Here, we examine WM-perception interactions in a new task setting. Participants judged the proportion of colored dots in a stream of visual displays while concurrently holding location- and color information in memory. Spatiotemporally resolved psychometrics disclosed a modulation of perceptual sensitivity consistent with a bias of visual spatial attention towards the memorized location. However, this effect was short-lived, suggesting that the visuospatial WM information was rapidly deprioritized during processing of new perceptual information. Independently, we observed robust bidirectional biases of categorical color judgments, in that perceptual decisions and mnemonic reports were attracted to each other. These biases occurred without reductions in overall perceptual sensitivity compared to control conditions without a concurrent WM load. The results conceptually replicate and extend previous findings in visual search and suggest that crosstalk between WM and perception can arise at multiple levels, from sensory-perceptual to decisional processing.

Perceptual history propagates down to early levels of sensory analysis

One function of perceptual systems is to construct and maintain a reliable representation of the environment. A useful strategy intrinsic to modern “Bayesian” theories of perception1, 2, 3, 4, 5, 6 is to take advantage of the relative stability of the input and use perceptual history (priors) to predict current perception. This strategy is efficient1, 2, 3, 4, 5, 6, 7 but can lead to stimuli being biased toward perceptual history, clearly revealed in a phenomenon known as serial dependence.8, 9, 10, 11, 12, 13, 14 However, it is still unclear whether serial dependence biases sensory encoding or only perceptual decisions.^15,16 We leveraged on the “surround tilt illusion”—where tilted flanking stimuli strongly bias perceived orientation—to measure its influence on the pattern of serial dependence, which is typically maximal for similar orientations of past and present stimuli.^7,10 Maximal serial dependence for a neutral stimulus preceded by an illusory one occurred when the perceived, not the physical, orientations of the two stimuli matched, suggesting that the priors biasing current perception incorporate the effect of the illusion. However, maximal serial dependence of illusory stimuli induced by neutral stimuli occurred when their physical (not perceived) orientations were matched, suggesting that priors interact with incoming sensory signals before they are biased by flanking stimuli. The evidence suggests that priors are high-level constructs incorporating contextual information, which interact directly with early sensory signals, not with highly processed perceptual representations.

•

Perception is heavily biased by perceptual history and expectations

•

Perceptual history includes illusory effects driven by spatial context

•

This representation propagates back to sensory areas preceding context effects

•

The results point to a neural architecture consistent with predictive coding