1
|
Ramotowska S, Haaf J, Van Maanen L, Szymanik J. Most quantifiers have many meanings. Psychon Bull Rev 2024; 31:2692-2703. [PMID: 38717681 PMCID: PMC11680628 DOI: 10.3758/s13423-024-02502-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/18/2024] [Indexed: 12/29/2024]
Abstract
In this paper, we investigate, by means of a computational model, how individuals map quantifiers onto numbers and how they order quantifiers on a mental line. We selected five English quantifiers (few, fewer than half, many, more than half, and most) which differ in truth conditions and vagueness. We collected binary truth value judgment data in an online quantifier verification experiment. Using a Bayesian three-parameter logistic regression model, we separated three sources of individual differences: truth condition, vagueness, and response error. Clustering on one of the model's parameter that corresponds to truth conditions revealed four subgroups of participants with different quantifier-to-number mappings and different ranges of the mental line of quantifiers. Our findings suggest multiple sources of individual differences in semantic representations of quantifiers and support a conceptual distinction between different types of imprecision in quantifier meanings. We discuss the consequence of our findings for the main theoretical approaches to quantifiers: the bivalent truth-conditional approach and the fuzzy logic approach. We argue that the former approach neither can explain inter-individual differences nor intra-individual differences in truth conditions of vague quantifiers. The latter approach requires further specification to fully account for individual differences demonstrated in this study.
Collapse
Affiliation(s)
- Sonia Ramotowska
- Institute for Logic, Language and Computation, University of Amsterdam, Science Park 107, 1098 XG, Amsterdam, The Netherlands.
| | - Julia Haaf
- Department of Psychology, University of Potsdam, Karl-Liebknecht-Str. 24/25, 14476, Potsdam, Germany
| | - Leendert Van Maanen
- Department of Experimental Psychology & Helmholtz Institute, Utrecht University, Heidelberglaan 1, 3584 CS, Utrecht, The Netherlands
| | - Jakub Szymanik
- Center for Mind/Brain Sciences Department of Computer Science, University of Trento, Corso Bettini 31, 38068, Rovereto (TN), Italy
| |
Collapse
|
2
|
Dendauw E, Evans NJ, Logan GD, Haffen E, Bennabi D, Gajdos T, Servant M. The gated cascade diffusion model: An integrated theory of decision making, motor preparation, and motor execution. Psychol Rev 2024; 131:825-857. [PMID: 38386394 PMCID: PMC7616365 DOI: 10.1037/rev0000464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2024]
Abstract
This article introduces an integrated and biologically inspired theory of decision making, motor preparation, and motor execution. The theory is formalized as an extension of the diffusion model, in which diffusive accumulated evidence from the decision-making process is continuously conveyed to motor areas of the brain that prepare the response, where it is smoothed by a mechanism that approximates a Kalman-Bucy filter. The resulting motor preparation variable is gated prior to reaching agonist muscles until it exceeds a particular level of activation. We tested this gated cascade diffusion model by continuously probing the electrical activity of the response agonists through electromyography in four choice tasks that span a variety of domains in cognitive sciences, namely motion perception, numerical cognition, recognition memory, and lexical knowledge. The model provided a good quantitative account of behavioral and electromyographic data and systematically outperformed previous models. This work represents an advance in the integration of processes involved in simple decisions and sheds new light on the interplay between decision and motor systems. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
Affiliation(s)
- Edouard Dendauw
- Laboratoire de Recherches Integratives en Neurosciences et Psychologie Cognitive, Institut National de la Sante et de la Recherche Medicale, Universite de Franche-Comte
| | - Nathan J Evans
- Department of Psychology, Ludwig Maximilian University of Munich
| | - Gordon D Logan
- Department of Psychological Sciences, Vanderbilt University
| | - Emmanuel Haffen
- Laboratoire de Recherches Integratives en Neurosciences et Psychologie Cognitive, Institut National de la Sante et de la Recherche Medicale, Universite de Franche-Comte
| | - Djamila Bennabi
- Laboratoire de Recherches Integratives en Neurosciences et Psychologie Cognitive, Institut National de la Sante et de la Recherche Medicale, Universite de Franche-Comte
| | - Thibault Gajdos
- Centre de Recherche en Psychologie et Neuroscience, Centre National de la Recherche Scientifique, Aix-Marseille Universite
| | - Mathieu Servant
- Laboratoire de Recherches Integratives en Neurosciences et Psychologie Cognitive, Institut National de la Sante et de la Recherche Medicale, Universite de Franche-Comte
| |
Collapse
|
3
|
Zhang T, Irons JL, Hansen HA, Leber AB. Joint contributions of preview and task instructions on visual search strategy selection. Atten Percept Psychophys 2024; 86:1163-1175. [PMID: 38658517 PMCID: PMC11093844 DOI: 10.3758/s13414-024-02870-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/17/2024] [Indexed: 04/26/2024]
Abstract
People tend to employ suboptimal attention control strategies during visual search. Here we question why people are suboptimal, specifically investigating how knowledge of the optimal strategies and the time available to apply such strategies affect strategy use. We used the Adaptive Choice Visual Search (ACVS), a task designed to assess attentional control optimality. We used explicit strategy instructions to manipulate explicit strategy knowledge, and we used display previews to manipulate time to apply the strategies. In the first two experiments, the strategy instructions increased optimality. However, the preview manipulation did not significantly boost optimality for participants who did not receive strategy instruction. Finally, in Experiments 3A and 3B, we jointly manipulated preview and instruction with a larger sample size. Preview and instruction both produced significant main effects; furthermore, they interacted significantly, such that the beneficial effect of instructions emerged with greater preview time. Taken together, these results have important implications for understanding the strategic use of attentional control. Individuals with explicit knowledge of the optimal strategy are more likely to exploit relevant information in their visual environment, but only to the extent that they have the time to do so.
Collapse
Affiliation(s)
- Tianyu Zhang
- Department of Psychology, The Ohio State University, 225 Psychology Building, 1835 Neil Avenue, Columbus, OH, 43210, USA.
| | | | - Heather A Hansen
- Department of Psychology, The Ohio State University, 225 Psychology Building, 1835 Neil Avenue, Columbus, OH, 43210, USA
| | - Andrew B Leber
- Department of Psychology, The Ohio State University, 225 Psychology Building, 1835 Neil Avenue, Columbus, OH, 43210, USA
| |
Collapse
|
4
|
Berlinghieri R, Krajbich I, Maccheroni F, Marinacci M, Pirazzini M. Measuring utility with diffusion models. SCIENCE ADVANCES 2023; 9:eadf1665. [PMID: 37611107 PMCID: PMC10446488 DOI: 10.1126/sciadv.adf1665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Accepted: 07/20/2023] [Indexed: 08/25/2023]
Abstract
The drift diffusion model (DDM) is a prominent account of how people make decisions. Many of these decisions involve comparing two alternatives based on differences of perceived stimulus magnitudes, such as economic values. Here, we propose a consistent estimator for the parameters of a DDM in such cases. This estimator allows us to derive decision thresholds, drift rates, and subjective percepts (i.e., utilities in economic choice) directly from the experimental data. This eliminates the need to measure these values separately or to assume specific functional forms for them. Our method also allows one to predict drift rates for comparisons that did not occur in the dataset. We apply the method to two datasets, one comparing probabilities of earning a fixed reward and one comparing objects of variable reward value. Our analysis indicates that both datasets conform well to the DDM. We find that utilities are linear in probability and slightly convex in reward.
Collapse
Affiliation(s)
- Renato Berlinghieri
- Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Ian Krajbich
- Department of Psychology, The Ohio State University, Columbus, OH, USA
- Department of Economics, The Ohio State University, Columbus, OH, USA
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Fabio Maccheroni
- Department of Decision Sciences, Bocconi University, Milan, Italy
| | | | - Marco Pirazzini
- Department of Computer Science, Yale University, New Haven, CT, USA
| |
Collapse
|
5
|
Ramotowska S, Steinert-Threlkeld S, van Maanen L, Szymanik J. Uncovering the Structure of Semantic Representations Using a Computational Model of Decision-Making. Cogn Sci 2023; 47:e13234. [PMID: 36640435 DOI: 10.1111/cogs.13234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Revised: 10/29/2022] [Accepted: 12/13/2022] [Indexed: 01/15/2023]
Abstract
According to logical theories of meaning, a meaning of an expression can be formalized and encoded in truth conditions. Vagueness of the language and individual differences between people are a challenge to incorporate into the meaning representations. In this paper, we propose a new approach to study truth-conditional representations of vague concepts. For a case study, we selected two natural language quantifiers most and more than half. We conducted two online experiments, each with 90 native English speakers. In the first experiment, we tested between-subjects variability in meaning representations. In the second experiment, we tested the stability of meaning representations over time by testing the same group of participants in two experimental sessions. In both experiments, participants performed the verification task. They verified a sentence with a quantifier (e.g., "Most of the gleerbs are feezda.") based on the numerical information provided in the second sentence, (e.g., "60% of the gleerbs are feezda"). To investigate between-subject and within-subject differences in meaning representations, we proposed an extended version of the Diffusion Decision Model with two parameters capturing truth conditions and vagueness. We fit the model to responses and reaction times data. In the first experiment, we found substantial between-subject differences in representations of most as reflected by the variability in the truth conditions. Moreover, we found that the verification of most is proportion-dependent as reflected in the reaction time effect and model parameter. In the second experiment, we showed that quantifier representations are stable over time as reflected in stable model parameters across two experimental sessions. These findings challenge semantic theories that assume the truth-conditional equivalence of most and more than half and contribute to the representational theory of vague concepts. The current study presents a promising approach to study semantic representations, which can have a wide application in experimental linguistics.
Collapse
Affiliation(s)
| | | | | | - Jakub Szymanik
- Center for Mind/Brain Sciences and Department of Information Engineering and Computer Science, University of Trento
| |
Collapse
|
6
|
Do Q, Li Y, Kane GA, McGuire JT, Scott BB. Assessing evidence accumulation and rule learning in humans with an online game. J Neurophysiol 2023; 129:131-143. [PMID: 36475830 DOI: 10.1152/jn.00124.2022] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
Evidence accumulation, an essential component of perception and decision making, is frequently studied with psychophysical tasks involving noisy or ambiguous stimuli. In these tasks, participants typically receive verbal or written instructions that describe the strategy that should be used to guide decisions. Although convenient and effective, explicit instructions can influence learning and decision making strategies and can limit comparisons with animal models, in which behaviors are reinforced through feedback. Here, we developed an online video game and nonverbal training pipeline, inspired by pulse-based tasks for rodents, as an alternative to traditional psychophysical tasks used to study evidence accumulation. Using this game, we collected behavioral data from hundreds of participants trained with an explicit description of the decision rule or with experiential feedback. Participants trained with feedback alone learned the game rules rapidly and used strategies and displayed biases similar to those who received explicit instructions. Finally, by leveraging data across hundreds of participants, we show that perceptual judgments were well described by an accumulation process in which noise scaled nonlinearly with evidence, consistent with previous animal studies but inconsistent with diffusion models widely used to describe perceptual decisions in humans. These results challenge the conventional description of the accumulation process and suggest that online games provide a valuable platform to examine perceptual decision making and learning in humans. In addition, the feedback-based training pipeline developed for this game may be useful for evaluating perceptual decision making in human populations with difficulty following verbal instructions.NEW & NOTEWORTHY Perceptual uncertainty sets critical constraints on our ability to accumulate evidence and make decisions; however, its sources remain unclear. We developed a video game, and feedback-based training pipeline, to study uncertainty during decision making. Leveraging choices from hundreds of subjects, we demonstrate that human choices are inconsistent with popular diffusion models of human decision making and instead are best fit by models in which perceptual uncertainty scales nonlinearly with the strength of sensory evidence.
Collapse
Affiliation(s)
- Quan Do
- Department of Psychological and Brain Sciences and Center for Systems Neuroscience, Boston University, Boston, Massachusetts
| | - Yutong Li
- Department of Psychological and Brain Sciences and Center for Systems Neuroscience, Boston University, Boston, Massachusetts
| | - Gary A Kane
- Department of Psychological and Brain Sciences and Center for Systems Neuroscience, Boston University, Boston, Massachusetts
| | - Joseph T McGuire
- Department of Psychological and Brain Sciences and Center for Systems Neuroscience, Boston University, Boston, Massachusetts
| | - Benjamin B Scott
- Department of Psychological and Brain Sciences and Center for Systems Neuroscience, Boston University, Boston, Massachusetts
| |
Collapse
|
7
|
Ratcliff R. Integrated diffusion models for distance effects in number memory. Cogn Psychol 2022; 138:101516. [PMID: 36115086 PMCID: PMC9732934 DOI: 10.1016/j.cogpsych.2022.101516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Revised: 08/26/2022] [Accepted: 08/30/2022] [Indexed: 12/13/2022]
Abstract
I evaluated three models for the representation of numbers in memory. These were integrated with the diffusion decision model to explain accuracy and response time (RT) data from a recognition memory experiment in which the stimuli were two-digit numbers. The integrated models accounted for distance/confusability effects: when a test number was numerically close to a studied number, accuracy was lower and RTs were longer than when a test number was numerically far from a studied number. For two of the models, the representations of numbers are distributed over number (with Gaussian or exponential distributions) and the overlap between the distributions of a studied number and a test number provides the evidence (drift rate) on which a decision is made. For the third, the exponential gradient model, drift rate is an exponential function of the numerical distance between studied and test numbers. The exponential gradient model fit the data slightly better than the two overlap models. Monte Carlo simulations showed that the variability in the important parameter estimates from fitting data collected over 30-40 min is smaller than the variability among individuals, allowing differences among individuals to be studied. A second experiment compared number memory and number discrimination tasks and results showed different distance effects. Number memory had an exponential-like distance-effect and number discrimination had a linear function which shows radically different representations drive the two tasks.
Collapse
|
8
|
How much time does it take to discriminate two sets by their numbers of elements? Atten Percept Psychophys 2022; 84:1726-1733. [PMID: 35484444 DOI: 10.3758/s13414-022-02474-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2022] [Indexed: 11/08/2022]
Abstract
The ability to evaluate the number of elements in a set-numerosity-without symbolic representation is a form of primitive perceptual intelligence. A simple binomial model was proposed to explain how observers discriminate the numerical proportion between two sets of elements distinct in color or orientation (Raidvee et al., 2017, Attention Perception & Psychophysics, 79[1], 267-282). The binomial model's only parameter β is the probability with which each visual element can be noticed and registered by the perceptual system. Here we analyzed the response times (RT) which were ignored in the previous report since there were no instructions concerning response speed. The relationship between the mean RT and the absolute difference |ΔN| between numbers of elements in two sets was described by a linear regression, the slope of which became flatter as the total number of elements N increased. Because the coefficients of regression between the mean RT and |ΔN| were more directly related to the binomial probability β rather than to the standard deviation of the best fitting cumulative normal distribution, it was regarded as evidence that the binomial model with a single parameter - probability β - is a viable alternative to the customary Thurstonian-Gaussian model.
Collapse
|
9
|
Kang I, De Boeck P, Ratcliff R. Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model. PSYCHOMETRIKA 2022; 87:725-748. [PMID: 34988775 PMCID: PMC9677523 DOI: 10.1007/s11336-021-09819-5] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 09/05/2021] [Indexed: 05/26/2023]
Abstract
In this paper, we propose a model-based method to study conditional dependence between response accuracy and response time (RT) with the diffusion IRT model (Tuerlinckx and De Boeck in Psychometrika 70(4):629-650, 2005, https://doi.org/10.1007/s11336-000-0810-3 ; van der Maas et al. in Psychol Rev 118(2):339-356, 2011, https://doi.org/10.1080/20445911.2011.454498 ). We extend the earlier diffusion IRT model by introducing variability across persons and items in cognitive capacity (drift rate in the evidence accumulation process) and variability in the starting point of the decision processes. We show that the extended model can explain the behavioral patterns of conditional dependency found in the previous studies in psychometrics. Variability in cognitive capacity can predict positive and negative conditional dependency and their interaction with the item difficulty. Variability in starting point can account for the early changes in the response accuracy as a function of RT given the person and item effects. By the combination of the two variability components, the extended model can produce the curvilinear conditional accuracy functions that have been observed in psychometric data. We also provide a simulation study to validate the parameter recovery of the proposed model and present two empirical applications to show how to implement the model to study conditional dependency underlying data response accuracy and RTs.
Collapse
Affiliation(s)
- Inhan Kang
- The Ohio State University, 291 Psychology Building, 1835 Neil Avenue, Columbus, OH, 43210, USA.
| | - Paul De Boeck
- The Ohio State University, 291 Psychology Building, 1835 Neil Avenue, Columbus, OH, 43210, USA
| | - Roger Ratcliff
- The Ohio State University, 291 Psychology Building, 1835 Neil Avenue, Columbus, OH, 43210, USA
| |
Collapse
|
10
|
Shevlin BRK, Smith SM, Hausfeld J, Krajbich I. High-value decisions are fast and accurate, inconsistent with diminishing value sensitivity. Proc Natl Acad Sci U S A 2022; 119:e2101508119. [PMID: 35105801 PMCID: PMC8832986 DOI: 10.1073/pnas.2101508119] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2021] [Accepted: 12/20/2021] [Indexed: 11/22/2022] Open
Abstract
It is a widely held belief that people's choices are less sensitive to changes in value as value increases. For example, the subjective difference between $11 and $12 is believed to be smaller than between $1 and $2. This idea is consistent with applications of the Weber-Fechner Law and divisive normalization to value-based choice and with psychological interpretations of diminishing marginal utility. According to random utility theory in economics, smaller subjective differences predict less accurate choices. Meanwhile, in the context of sequential sampling models in psychology, smaller subjective differences also predict longer response times. Based on these models, we would predict decisions between high-value options to be slower and less accurate. In contrast, some have argued on normative grounds that choices between high-value options should be made with less caution, leading to faster and less accurate choices. Here, we model the dynamics of the choice process across three different choice domains, accounting for both discriminability and response caution. Contrary to predictions, we mostly observe faster and more accurate decisions (i.e., higher drift rates) between high-value options. We also observe that when participants are alerted about incoming high-value decisions, they exert more caution and not less. We rule out several explanations for these results, using tasks with both subjective and objective values. These results cast doubt on the notion that increasing value reduces discriminability.
Collapse
Affiliation(s)
- Blair R K Shevlin
- Department of Psychology, The Ohio State University, Columbus, OH 43210
| | - Stephanie M Smith
- Department of Psychology, The Ohio State University, Columbus, OH 43210
- Anderson School of Management, University of California, Los Angeles, CA 90095
| | - Jan Hausfeld
- CREED, Amsterdam School of Economics, University of Amsterdam, 1018 WB Amsterdam, The Netherlands
- Thurgau Institute of Economics, University of Konstanz, 78457 Konstanz, Germany
- Department of Social Neuroscience and Social Psychology, University of Bern, 3012 Bern, Switzerland
| | - Ian Krajbich
- Department of Psychology, The Ohio State University, Columbus, OH 43210;
- Department of Economics, The Ohio State University, Columbus, OH 43210
| |
Collapse
|
11
|
Turner W, Feuerriegel D, Hester R, Bode S. An initial 'snapshot' of sensory information biases the likelihood and speed of subsequent changes of mind. PLoS Comput Biol 2022; 18:e1009738. [PMID: 35025889 PMCID: PMC8757993 DOI: 10.1371/journal.pcbi.1009738] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Accepted: 12/09/2021] [Indexed: 01/30/2023] Open
Abstract
We often need to rapidly change our mind about perceptual decisions in order to account for new information and correct mistakes. One fundamental, unresolved question is whether information processed prior to a decision being made ('pre-decisional information') has any influence on the likelihood and speed with which that decision is reversed. We investigated this using a luminance discrimination task in which participants indicated which of two flickering greyscale squares was brightest. Following an initial decision, the stimuli briefly remained on screen, and participants could change their response. Using psychophysical reverse correlation, we examined how moment-to-moment fluctuations in stimulus luminance affected participants' decisions. This revealed that the strength of even the very earliest (pre-decisional) evidence was associated with the likelihood and speed of later changes of mind. To account for this effect, we propose an extended diffusion model in which an initial 'snapshot' of sensory information biases ongoing evidence accumulation.
Collapse
Affiliation(s)
- William Turner
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Robert Hester
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Stefan Bode
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| |
Collapse
|
12
|
Pirrone A, Reina A, Stafford T, Marshall JAR, Gobet F. Magnitude-sensitivity: rethinking decision-making. Trends Cogn Sci 2021; 26:66-80. [PMID: 34750080 DOI: 10.1016/j.tics.2021.10.006] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Revised: 10/05/2021] [Accepted: 10/05/2021] [Indexed: 11/25/2022]
Abstract
Magnitude-sensitivity refers to the result that performance in decision-making, across domains and organisms, is affected by the total value of the possible alternatives. This simple result offers a window into fundamental issues in decision-making and has led to a reconsideration of ecological decision-making, prominent computational models of decision-making, and optimal decision-making. Moreover, magnitude-sensitivity has inspired the design of new robotic systems that exploit natural solutions and apply optimal decision-making policies. In this article, we review the key theoretical and empirical results about magnitude-sensitivity and highlight the importance that this phenomenon has for the understanding of decision-making. Furthermore, we discuss open questions and ideas for future research.
Collapse
Affiliation(s)
- Angelo Pirrone
- Centre for Philosophy of Natural and Social Science, London School of Economics and Political Science, London, UK.
| | - Andreagiovanni Reina
- Institute for Interdisciplinary Studies on Artificial Intelligence (IRIDIA), Université Libre de Bruxelles, Brussels, Belgium
| | - Tom Stafford
- Department of Psychology, University of Sheffield, Sheffield, UK
| | | | - Fernand Gobet
- Centre for Philosophy of Natural and Social Science, London School of Economics and Political Science, London, UK
| |
Collapse
|
13
|
Response bias in numerosity perception at early judgments and systematic underestimation. Atten Percept Psychophys 2021; 84:188-204. [PMID: 34518971 DOI: 10.3758/s13414-021-02365-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/26/2021] [Indexed: 01/29/2023]
Abstract
Mental number representation relies on mapping numerosity based on nonsymbolic stimuli to symbolic magnitudes. It is known that mental number representation builds on a logarithmic scale, and thus numerosity decisions result in underestimation. In the current study, we investigated the temporal dynamics of numerosity perception in four experiments by employing the response-deadline SAT procedure. We presented random number of dots and required participants to make a numerosity judgment by comparing the perceived number of dots to 50. Using temporal dynamics in numerosity perception allowed us to observe a response bias at early decisions and a systematic underestimation at late decisions. In all three experiments, providing feedback diminished the magnitude of underestimation, whereas in Experiment 3 the absence of feedback resulted in greater underestimation errors. These results were in accordance with the findings that suggested feedback is necessary for the calibration of the mental number representation.
Collapse
|
14
|
Abstract
This paper theoretically and empirically investigates the role of noisy cognition in perceptual judgment, focusing on the central tendency effect: the well-known empirical regularity that perceptual judgments are biased towards the center of the stimulus distribution. Based on a formal Bayesian framework, we generate predictions about the relationships between subjective confidence, central tendency, and response variability. Specifically, our model clarifies that lower subjective confidence as a measure of posterior uncertainty about a judgment should predict (i) a lower sensitivity of magnitude estimates to objective stimuli; (ii) a higher sensitivity to the mean of the stimulus distribution; (iii) a stronger central tendency effect at higher stimulus magnitudes; and (iv) higher response variability. To test these predictions, we collect a large-scale experimental data set and additionally re-analyze perceptual judgment data from several previous experiments. Across data sets, subjective confidence is strongly predictive of the central tendency effect and response variability, both correlationally and when we exogenously manipulate the magnitude of sensory noise. Our results are consistent with (but not necessarily uniquely explained by) Bayesian models of confidence and the central tendency.
Collapse
|
15
|
Do data from mechanical Turk subjects replicate accuracy, response time, and diffusion modeling results? Behav Res Methods 2021; 53:2302-2325. [PMID: 33825128 DOI: 10.3758/s13428-021-01573-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/27/2021] [Indexed: 01/01/2023]
Abstract
Online data collection is being used more and more, especially in the face of the COVID crisis. To examine the quality of such data, we chose to replicate lexical decision and item recognition paradigms from Ratcliff et al. (Cognitive Psychology, 60, 127-157, 2010) and numerosity discrimination paradigms from Ratcliff and McKoon (Psychological Review, 125, 183-217, 2018) with subjects recruited from Amazon Mechanical Turk (AMT). Along with these tasks, we collected data from either an IQ test or a math computation test. Subjects in the lexical decision and item recognition tasks were relatively well-behaved, with only a few giving a significant number of responses with response times (RTs) under 300 ms at chance accuracy, i.e., fast guesses, and a few with unstable RTs across a session. But in the numerosity discrimination tasks, almost half of the subjects gave a significant number of fast guesses and/or unstable RTs across the session. Diffusion model parameters were largely consistent with the earlier studies as were correlations across tasks and correlations with IQ and age. One surprising result was that eliminating fast outliers from subjects with highly variable RTs (those eliminated from the main analyses) produced diffusion model analyses that showed patterns of correlations similar to the subjects with stable performance. Methods for displaying data to examine stability, eliminating subjects, and implementing RT data collection on AMT including checks on timing are also discussed.
Collapse
|
16
|
Ratcliff R, McKoon G. Examining aging and numerosity using an integrated diffusion model. J Exp Psychol Learn Mem Cogn 2020; 46:2128-2152. [PMID: 32730057 PMCID: PMC8054446 DOI: 10.1037/xlm0000937] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Two experiments are presented that use tasks common in research in numerical cognition with young adults and older adults as subjects. In these tasks, one or two arrays of dots are displayed, and subjects decide whether there are more or fewer dots of one kind than another. Results show that older adults, relative to young adults, tend to rely more on the perceptual feature, area, in making numerosity judgments when area is correlated with numerosity. Also, convex hull unexpectedly shows different effects depending on the task (being either correlated with numerosity or anticorrelated). Accuracy and response time (RT) data are interpreted with the integration of the diffusion decision model with models for the representation of numerosity. One model assumes that the representation of the difference depends on the difference between the numerosities and that standard deviations (SDs) increase linearly with numerosity, and the other model assumes a log representation with constant SDs. The representational models have coefficients that are applied to differences between two numerosities to produce drift rates and SDs in drift rates in the decision process. The two tasks produce qualitatively different patterns of RTs: One model fits results from one task, but the results are mixed for the other task. The effects of age on model parameters show a modest decrease in evidence driving the decision process, an increase in the duration of processes outside the decision process (nondecision time), and an increase in the amount of evidence needed to make a decision (boundary separation). (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
17
|
Kang I, Ratcliff R, Voskuilen C. A Note on Decomposition of Sources of Variability in Perceptual Decision-making. JOURNAL OF MATHEMATICAL PSYCHOLOGY 2020; 98:102431. [PMID: 32831400 PMCID: PMC7434084 DOI: 10.1016/j.jmp.2020.102431] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
Information processing underlying human perceptual decision-making is inherently noisy and identifying sources of this noise is important to understand processing. Ratcliff, Voskuilen, and McKoon (2018) examined results from five experiments using a double-pass procedure in which stimuli were repeated typically a hundred trials later. Greater than chance agreement between repeated tests provided evidence for trial-to-trial variability from external sources of noise. They applied the diffusion model to estimate the quality of evidence driving the decision process (drift rate) and the variability (standard deviation) in drift rate across trials. This variability can be decomposed into random (internal) and systematic (external) components by comparing the double-pass accuracy and agreement with the model predictions. In this note, we provide an additional analysis of the double-pass experiments using the linear ballistic accumulator (LBA) model. The LBA model does not have within-trial variability and thus it captures all variability in processing with its across-trial variability parameters. The LBA analysis of the double-pass data provides model-based evidence of external variability in a decision process, which is consistent with Ratcliff et al.'s result. This demonstrates that across-trial variability is required to model perceptual decision-making. The LBA model provides measures of systematic and random variability as the diffusion model did. But due to the lack of within-trial variability, the LBA model estimated the random component as a larger proportion of across-trial total variability than did the diffusion model.
Collapse
|
18
|
Tang N. False paratactic constructions and symbolic discreteness in the activation diffusion model. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2020. [DOI: 10.3233/jifs-179823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Ning Tang
- Based on the Teaching, Henan Polytechnic, Zhengzhou, China
| |
Collapse
|
19
|
Kang I, Ratcliff R. Modeling the interaction of numerosity and perceptual variables with the diffusion model. Cogn Psychol 2020; 120:101288. [PMID: 32325289 DOI: 10.1016/j.cogpsych.2020.101288] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Accepted: 02/25/2020] [Indexed: 10/24/2022]
Abstract
Ratcliff and McKoon (2018) proposed integrated diffusion models for numerosity judgments in which a numerosity representation provides evidence used to drive the decision process. We extend this modeling framework to examine the interaction of non-numeric perceptual variables with numerosity by assuming that drift rate and non-decision time are functions of those variables. Four experiments were conducted with two different types of stimuli: a single array of intermingled blue and yellow dots in which both numerosity and dot area vary over trials and two side-by-side arrays of dots in which numerosity, dot area, and convex hull vary over trials. The tasks were to decide whether there were more blue or yellow dots (two experiments), more dots on which side, or which dots have a larger total area. Development of models started from the principled models in Ratcliff and McKoon (2018) and became somewhat ad hoc as we attempted to capture unexpected patterns induced by the conflict between numerosity and perceptual variables. In the three tasks involving numerosity judgments, the effects of the non-numeric variables were moderated by the number of dots. Under a high conflict, judgments were dominated by perceptual variables and produced an unexpected shift in the leading edge of the reaction time (RT) distributions. Although the resulting models were able to predict most of the accuracy and RT patterns, the models were not able to completely capture this shift in the RT distributions. However, when subjects judged area, numerosity affected perceptual judgments but there was no leading edge effect. Based on the results, it appears that the integrated diffusion models provide an effective framework to study the role of numerical and perceptual variables in numerosity tasks and their context-dependency.
Collapse
Affiliation(s)
- Inhan Kang
- The Ohio State University, 291 Psychology Building, 1835 Neil Avenue, Columbus, OH 43210, United States.
| | - Roger Ratcliff
- The Ohio State University, 291 Psychology Building, 1835 Neil Avenue, Columbus, OH 43210, United States.
| |
Collapse
|
20
|
Ratcliff R, McKoon G. Decision making in numeracy tasks with spatially continuous scales. Cogn Psychol 2020; 116:101259. [PMID: 31838271 PMCID: PMC6953628 DOI: 10.1016/j.cogpsych.2019.101259] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Revised: 11/26/2019] [Accepted: 11/26/2019] [Indexed: 10/25/2022]
Abstract
A diffusion model of decision making on continuous response scales is applied to three numeracy tasks. The goal is to explain the distributions of responses on the continuous response scale and the time taken to make decisions. In the model, information from a stimulus is spatially continuously distributed, the response is made by accumulating information to a criterion, which is a 1D line, and the noise in the accumulation process is continuous Gaussian process noise over spatial position. The model is fit to the data from three experiments. In one experiment, a one or two digit number is displayed and the task is to point to its location on a number line ranging from 1 to 100. This task is used extensively in research in education but there has been no model for it that accounts for both decision times and decision choices. In the second task, an array of dots is displayed and the task is to point to the position of the number of dots on an arc ranging from 11 to 90. In a third task, an array of dots is displayed and the task is to speak aloud the number of dots. The model we propose accounts for both accuracy and response time variables, including the full distributions of response times. It also provides estimates of the acuity of decisions (standard deviations in the evidence distributions) and it shows how representations of numeracy information are task-dependent. We discuss how our model relates to research on numeracy and the neuroscience of numeracy, and how it can produce more comprehensive measures of individual differences in numeracy skills in tasks with continuous response scales than have hitherto been available.
Collapse
|
21
|
Cipora K, Soltanlou M, Smaczny S, Göbel SM, Nuerk HC. Automatic place-value activation in magnitude-irrelevant parity judgement. PSYCHOLOGICAL RESEARCH 2019; 85:777-792. [PMID: 31734821 DOI: 10.1007/s00426-019-01268-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2019] [Accepted: 11/05/2019] [Indexed: 11/24/2022]
Abstract
Research on multi-digit number processing suggests that, in Arabic numerals, their place-value magnitude is automatically activated, whenever a magnitude-relevant task was employed. However, so far, it is unknown, whether place-value is also activated when the target task is magnitude-irrelevant. The current study examines this question using the parity congruency effect in two-digit numbers: It describes that responding to decade-digit parity congruent numbers (e.g., 35, 46; same parity of decades and units) is faster than to decade-digit parity incongruent numbers (e.g., 25; 36; different parities of decades and units). Here we investigate the (a-) symmetry of the parity congruency effect; i.e. whether it makes a difference whether participants are assessing the parity of the unit digit or the decade digit. We elaborate, how and why such an asymmetry is related to place-value processing, because the parity of the unit digit only interferes with the parity of the decade digit, while the parity of the decade digit interferes with both the parity of the unit digit and the integrated parity of the whole two-digit number. We observed a significantly larger parity congruency effect in the decade parity decision than in the unit parity decision. This suggests that automatic place-value processing also takes place in a typical parity judgment task, in which magnitude is irrelevant. Finally, because of the cross-lingual design of the study, we can show that these results and their implications were language-independent.
Collapse
Affiliation(s)
- Krzysztof Cipora
- Department of Psychology, University of Tuebingen, Schleichstrasse 4, 72076, Tuebingen, Germany.
- LEAD Graduate School & Research Network, University of Tuebingen, Tuebingen, Germany.
| | - Mojtaba Soltanlou
- Department of Psychology, University of Tuebingen, Schleichstrasse 4, 72076, Tuebingen, Germany
- LEAD Graduate School & Research Network, University of Tuebingen, Tuebingen, Germany
| | - Stefan Smaczny
- Department of Psychology, University of Tuebingen, Schleichstrasse 4, 72076, Tuebingen, Germany
| | - Silke M Göbel
- Department of Psychology, University of York, York, UK
- Department of Special Needs Education, University of Oslo, Oslo, Norway
| | - Hans-Christoph Nuerk
- Department of Psychology, University of Tuebingen, Schleichstrasse 4, 72076, Tuebingen, Germany
- LEAD Graduate School & Research Network, University of Tuebingen, Tuebingen, Germany
- Leibnitz-Institut für Wissenmedien, Tuebingen, Germany
| |
Collapse
|
22
|
Abstract
Following the classical work of Moyer and Landauer (1967), experimental studies investigating the way in which humans process and compare symbolic numerical information regularly used one of two experimental designs. In selection tasks, two numbers are presented, and the task of the participant is to select (for example) the larger one. In classification tasks, a single number is presented, and the participant decides if it is smaller or larger than a predefined standard. Many findings obtained with these paradigms fit in well with the notion of a mental analog representation, or an Approximate Number System (ANS; e.g., Piazza 2010). The ANS is often conceptualized metaphorically as a mental number line, and data from both paradigms are well accounted for by diffusion models based on the stochastic accumulation of noisy partial numerical information over time. The present study investigated a categorization paradigm in which participants decided if a number presented falls into a numerically defined central category. We show that number categorization yields a highly regular, yet considerably more complex pattern of decision times and error rates as compared to the simple monotone relations obtained in traditional selection and classification tasks. We also show that (and how) standard diffusion models of number comparison can be adapted so as to account for mean and standard deviations of all RTs and for error rates in considerable quantitative detail. We conclude that just as traditional number comparison, the more complex process of categorizing numbers conforms well with basic notions of the ANS.
Collapse
|
23
|
Abstract
A new diffusion model of decision making in continuous space is presented and tested. The model is a sequential sampling model in which both spatially continuously distributed evidence and noise are accumulated up to a decision criterion (a 1 dimensional [1D] line or a 2 dimensional [2D] plane). There are two major advances represented in this research. The first is to use spatially continuously distributed Gaussian noise in the decision process (Gaussian process or Gaussian random field noise) which allows the model to represent truly spatially continuous processes. The second is a series of experiments that collect data from a variety of tasks and response modes to provide the basis for testing the model. The model accounts for the distributions of responses over position and response time distributions for the choices. The model applies to tasks in which the stimulus and the response coincide (moving eyes or fingers to brightened areas in a field of pixels) and ones in which they do not (color, motion, and direction identification). The model also applies to tasks in which the response is made with eye movements, finger movements, or mouse movements. This modeling offers a wide potential scope of applications including application to any device or scale in which responses are made on a 1D continuous scale or in a 2D spatial field. (PsycINFO Database Record (c) 2018 APA, all rights reserved).
Collapse
Affiliation(s)
- Roger Ratcliff
- The Ohio State University, Department of Psychology, Columbus, OH, 43210 USA, (614) 937-1362
| |
Collapse
|
24
|
Modeling 2-alternative forced-choice tasks: Accounting for both magnitude and difference effects. Cogn Psychol 2018; 103:1-22. [PMID: 29501775 DOI: 10.1016/j.cogpsych.2018.02.002] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2018] [Accepted: 02/11/2018] [Indexed: 11/23/2022]
Abstract
We present a model-based analysis of two-alternative forced-choice tasks in which two stimuli are presented side by side and subjects must make a comparative judgment (e.g., which stimulus is brighter). Stimuli can vary on two dimensions, the difference in strength of the two stimuli and the magnitude of each stimulus. Differences between the two stimuli produce typical RT and accuracy effects (i.e., subjects respond more quickly and more accurately when there is a larger difference between the two). However, the overall magnitude of the pair of stimuli also affects RT and accuracy. In the more common two-choice task, a single stimulus is presented and the stimulus varies on only one dimension. In this two-stimulus task, if the standard diffusion decision model is fit to the data with only drift rate (evidence accumulation rate) differing among conditions, the model cannot fit the data. However, if either of one of two variability parameters is allowed to change with stimulus magnitude, the model can fit the data. This results in two models that are extremely constrained with about one tenth of the number of parameters than there are data points while at the same time the models account for accuracy and correct and error RT distributions. While both of these versions of the diffusion model can account for the observed data, the model that allows across-trial variability in drift to vary might be preferred for theoretical reasons. The diffusion model fits are compared to the leaky competing accumulator model which did not perform as well.
Collapse
|