1
|
Rafiei F, Shekhar M, Rahnev D. The neural network RTNet exhibits the signatures of human perceptual decision-making. Nat Hum Behav 2024; 8:1752-1770. [PMID: 38997452 DOI: 10.1038/s41562-024-01914-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 05/13/2024] [Indexed: 07/14/2024]
Abstract
Convolutional neural networks show promise as models of biological vision. However, their decision behaviour, including the facts that they are deterministic and use equal numbers of computations for easy and difficult stimuli, differs markedly from human decision-making, thus limiting their applicability as models of human perceptual behaviour. Here we develop a new neural network, RTNet, that generates stochastic decisions and human-like response time (RT) distributions. We further performed comprehensive tests that showed RTNet reproduces all foundational features of human accuracy, RT and confidence and does so better than all current alternatives. To test RTNet's ability to predict human behaviour on novel images, we collected accuracy, RT and confidence data from 60 human participants performing a digit discrimination task. We found that the accuracy, RT and confidence produced by RTNet for individual novel images correlated with the same quantities produced by human participants. Critically, human participants who were more similar to the average human performance were also found to be closer to RTNet's predictions, suggesting that RTNet successfully captured average human behaviour. Overall, RTNet is a promising model of human RTs that exhibits the critical signatures of perceptual decision-making.
Collapse
Affiliation(s)
- Farshad Rafiei
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA.
| | - Medha Shekhar
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Dobromir Rahnev
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| |
Collapse
|
2
|
Le Denmat P, Verguts T, Desender K. A low-dimensional approximation of optimal confidence. PLoS Comput Biol 2024; 20:e1012273. [PMID: 39047032 PMCID: PMC11299811 DOI: 10.1371/journal.pcbi.1012273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 08/05/2024] [Accepted: 06/24/2024] [Indexed: 07/27/2024] Open
Abstract
Human decision making is accompanied by a sense of confidence. According to Bayesian decision theory, confidence reflects the learned probability of making a correct response, given available data (e.g., accumulated stimulus evidence and response time). Although optimal, independently learning these probabilities for all possible data combinations is computationally intractable. Here, we describe a novel model of confidence implementing a low-dimensional approximation of this optimal yet intractable solution. This model allows efficient estimation of confidence, while at the same time accounting for idiosyncrasies, different kinds of biases and deviation from the optimal probability correct. Our model dissociates confidence biases resulting from the estimate of the reliability of evidence by individuals (captured by parameter α), from confidence biases resulting from general stimulus independent under and overconfidence (captured by parameter β). We provide empirical evidence that this model accurately fits both choice data (accuracy, response time) and trial-by-trial confidence ratings simultaneously. Finally, we test and empirically validate two novel predictions of the model, namely that 1) changes in confidence can be independent of performance and 2) selectively manipulating each parameter of our model leads to distinct patterns of confidence judgments. As a tractable and flexible account of the computation of confidence, our model offers a clear framework to interpret and further resolve different forms of confidence biases.
Collapse
Affiliation(s)
| | - Tom Verguts
- Department of Experimental Psychology, Ghent University, Ghent Belgium
| | | |
Collapse
|
3
|
Balsdon T, Verdonck S, Loossens T, Philiastides MG. Secondary motor integration as a final arbiter in sensorimotor decision-making. PLoS Biol 2023; 21:e3002200. [PMID: 37459392 PMCID: PMC10393169 DOI: 10.1371/journal.pbio.3002200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 08/01/2023] [Accepted: 06/15/2023] [Indexed: 08/02/2023] Open
Abstract
Sensorimotor decision-making is believed to involve a process of accumulating sensory evidence over time. While current theories posit a single accumulation process prior to planning an overt motor response, here, we propose an active role of motor processes in decision formation via a secondary leaky motor accumulation stage. The motor leak adapts the "memory" with which this secondary accumulator reintegrates the primary accumulated sensory evidence, thus adjusting the temporal smoothing in the motor evidence and, correspondingly, the lag between the primary and motor accumulators. We compare this framework against different single accumulator variants using formal model comparison, fitting choice, and response times in a task where human observers made categorical decisions about a noisy sequence of images, under different speed-accuracy trade-off instructions. We show that, rather than boundary adjustments (controlling the amount of evidence accumulated for decision commitment), adjustment of the leak in the secondary motor accumulator provides the better description of behavior across conditions. Importantly, we derive neural correlates of these 2 integration processes from electroencephalography data recorded during the same task and show that these neural correlates adhere to the neural response profiles predicted by the model. This framework thus provides a neurobiologically plausible description of sensorimotor decision-making that captures emerging evidence of the active role of motor processes in choice behavior.
Collapse
Affiliation(s)
- Tarryn Balsdon
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, United Kingdom
| | - Stijn Verdonck
- Faculty of Psychology and Educational Sciences, KU Leuven, Leuven, Belgium
| | - Tim Loossens
- Faculty of Psychology and Educational Sciences, KU Leuven, Leuven, Belgium
| | - Marios G Philiastides
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, United Kingdom
| |
Collapse
|
4
|
Computational analysis of speed-accuracy tradeoff. Sci Rep 2022; 12:21995. [PMID: 36539428 PMCID: PMC9768160 DOI: 10.1038/s41598-022-26120-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 12/09/2022] [Indexed: 12/24/2022] Open
Abstract
Speed-accuracy tradeoff (SAT) in the decision making of humans and animals is a well-documented phenomenon, but its underlying neuronal mechanism remains unclear. Modeling approaches have conceptualized SAT through the threshold hypothesis as adjustments to the decision threshold. However, the leading neurophysiological view is the gain modulation hypothesis. This hypothesis postulates that the SAT mechanism is implemented through changes in the dynamics of the choice circuit, which increase the baseline firing rate and the speed of neuronal integration. In this paper, I investigated alternative computational mechanisms of SAT and showed that the threshold hypothesis was qualitatively consistent with the behavioral data, but the gain modulation hypothesis was not. In order to reconcile the threshold hypothesis with the neurophysiological evidence, I considered the interference of alpha oscillations with the decision process and showed that alpha oscillations could increase the discriminatory power of the decision system, although they slowed down the decision process. This suggests that the magnitude of alpha waves suppression during the event related desynchronization (ERD) of alpha oscillations depends on a SAT condition and the amplitude of alpha oscillations is lower in the speed condition. I also showed that the lower amplitude of alpha oscillations resulted in an increase in the baseline firing rate and the speed of neuronal intergration. Thus, the interference of the event related desynchronization of alpha oscillations with a SAT condition explains why an increase in the baseline firing rate and the speed of neuronal integration accompany the speed condition.
Collapse
|
5
|
Motivation by reward jointly improves speed and accuracy, whereas task-relevance and meaningful images do not. Atten Percept Psychophys 2022; 85:930-948. [PMID: 36289140 PMCID: PMC10066132 DOI: 10.3758/s13414-022-02587-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/23/2022] [Indexed: 11/08/2022]
Abstract
AbstractVisual selection is characterized by a trade-off between speed and accuracy. Speed or accuracy of the selection process can be affected by higher level factors—for example, expecting a reward, obtaining task-relevant information, or seeing an intrinsically relevant target. Recently, motivation by reward has been shown to simultaneously increase speed and accuracy, thus going beyond the speed–accuracy-trade-off. Here, we compared the motivating abilities of monetary reward, task-relevance, and image content to simultaneously increase speed and accuracy. We used a saccadic distraction task that required suppressing a distractor and selecting a target. Across different blocks successful target selection was followed either by (i) a monetary reward, (ii) obtaining task-relevant information, or (iii) seeing the face of a famous person. Each block additionally contained the same number of irrelevant trials lacking these consequences, and participants were informed about the upcoming trial type. We found that postsaccadic vision of a face affected neither speed nor accuracy, suggesting that image content does not affect visual selection via motivational mechanisms. Task relevance increased speed but decreased selection accuracy, an observation compatible with a classical speed–accuracy trade-off. Motivation by reward, however, simultaneously increased response speed and accuracy. Saccades in all conditions deviated away from the distractor, suggesting that the distractor was suppressed, and this deviation was strongest in the reward block. Drift-diffusion modelling revealed that task-relevance affected behavior by affecting decision thresholds, whereas motivation by reward additionally increased the rate of information uptake. The present findings thus show that the three consequences differ in their motivational abilities.
Collapse
|
6
|
Soghoyan G, Aksiotis V, Rusinova A, Myachykov A, Tumyalis A. An adaptive paradigm for detecting the individual duration of the preparatory period in the choice reaction time task. PLoS One 2022; 17:e0273234. [PMID: 36083888 PMCID: PMC9462575 DOI: 10.1371/journal.pone.0273234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 08/04/2022] [Indexed: 12/05/2022] Open
Abstract
According to the sequential stage model, the selection and the execution of a motor response are two distinct independent processes. Here, we propose a new adaptive paradigm for identifying the individual duration of the response preparatory period based on the motor reaction time (RT) data. The results are compared using the paradigm with constant values of the preparatory period. Two groups of participants performed on either an easy (Group 1) or a hard (Group 2) response selection task with two types of stimuli based on the preparatory period parameters: (1) stimuli with a constant preparatory period duration of 0 or 1200 ms and (2) stimuli with adaptive preparatory period durations. Our analysis showed an increase in the duration of the response selection process as a function of increasing task complexity when using both paradigms with constant and adaptive values of the preparatory period duration. We conclude that the adaptive paradigm proposed in the current paper has several important advantages over the constant paradigm in terms of measuring the response accuracy while being equally efficiently in capturing other critical response parameters.
Collapse
Affiliation(s)
- Gurgen Soghoyan
- Center for Bioelectric Interfaces, Institute for Cognitive Neuroscience, Higher School of Economics University, Moscow, Russian Federation
| | - Vladislav Aksiotis
- Center for Bioelectric Interfaces, Institute for Cognitive Neuroscience, Higher School of Economics University, Moscow, Russian Federation
| | - Anna Rusinova
- Center for Bioelectric Interfaces, Institute for Cognitive Neuroscience, Higher School of Economics University, Moscow, Russian Federation
| | - Andriy Myachykov
- Department of Psychology, Northumbria University, Newcastle-upon-Tyne, United Kingdom
- Center for Cognition and Decision Making, Institute for Cognitive Neuroscience, Higher School of Economics University, Moscow, Russian Federation
| | - Alexey Tumyalis
- Center for Bioelectric Interfaces, Institute for Cognitive Neuroscience, Higher School of Economics University, Moscow, Russian Federation
- * E-mail:
| |
Collapse
|
7
|
Desender K, Vermeylen L, Verguts T. Dynamic influences on static measures of metacognition. Nat Commun 2022; 13:4208. [PMID: 35864100 PMCID: PMC9301893 DOI: 10.1038/s41467-022-31727-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 06/29/2022] [Indexed: 11/08/2022] Open
Abstract
Humans differ in their capability to judge choice accuracy via confidence judgments. Popular signal detection theoretic measures of metacognition, such as M-ratio, do not consider the dynamics of decision making. This can be problematic if response caution is shifted to alter the tradeoff between speed and accuracy. Such shifts could induce unaccounted-for sources of variation in the assessment of metacognition. Instead, evidence accumulation frameworks consider decision making, including the computation of confidence, as a dynamic process unfolding over time. Using simulations, we show a relation between response caution and M-ratio. We then show the same pattern in human participants explicitly instructed to focus on speed or accuracy. Finally, this association between M-ratio and response caution is also present across four datasets without any reference towards speed. In contrast, when data are analyzed with a dynamic measure of metacognition, v-ratio, there is no effect of speed-accuracy tradeoff.
Collapse
Affiliation(s)
- Kobe Desender
- Brain and Cognition, KU Leuven, Belgium.
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
- Department of Experimental Psychology, Ghent University, Ghent, Belgium.
| | - Luc Vermeylen
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Tom Verguts
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| |
Collapse
|
8
|
Patterns of Movement Performance and Consistency From Childhood to Old Age. Motor Control 2022; 27:258-274. [PMID: 36351427 DOI: 10.1123/mc.2022-0006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 09/01/2022] [Accepted: 09/07/2022] [Indexed: 11/11/2022]
Abstract
It is widely accepted that the general process of aging can be reflected by changes in motor function. Typically, optimal performance of a given motor task is observed for healthy young adults with declines being observed for individuals at either end of the lifespan. This study was designed to examine differences in the average and variability (i.e., intraindividual variability) of chewing, simple reaction time, postural control, and walking responses. For this study, 15 healthy children, 15 young adults, and 15 older adults participated. Our results indicated the movement performance for the reaction time and postural sway followed a U shape with young adults having faster reaction times and decreased postural sway compared to the children and older adults. However, this pattern was not preserved across all motor tasks with no age differences emerging for (normalized) gait speed, while chewing rates followed a U-shaped curve with older adults and children chewing at faster rates. Taken together, these findings would indicate that the descriptive changes in motor function with aging are heavily influenced by the nature of the task being performed and are unlikely to follow a singular pattern.
Collapse
|
9
|
Desender K, Ridderinkhof KR, Murphy PR. Understanding neural signals of post-decisional performance monitoring: An integrative review. eLife 2021; 10:e67556. [PMID: 34414883 PMCID: PMC8378845 DOI: 10.7554/elife.67556] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2021] [Accepted: 08/08/2021] [Indexed: 12/22/2022] Open
Abstract
Performance monitoring is a key cognitive function, allowing to detect mistakes and adapt future behavior. Post-decisional neural signals have been identified that are sensitive to decision accuracy, decision confidence and subsequent adaptation. Here, we review recent work that supports an understanding of late error/confidence signals in terms of the computational process of post-decisional evidence accumulation. We argue that the error positivity, a positive-going centro-parietal potential measured through scalp electrophysiology, reflects the post-decisional evidence accumulation process itself, which follows a boundary crossing event corresponding to initial decision commitment. This proposal provides a powerful explanation for both the morphological characteristics of the signal and its relation to various expressions of performance monitoring. Moreover, it suggests that the error positivity -a signal with thus far unique properties in cognitive neuroscience - can be leveraged to furnish key new insights into the inputs to, adaptation, and consequences of the post-decisional accumulation process.
Collapse
Affiliation(s)
- Kobe Desender
- Brain and Cognition, KU LeuvenLeuvenBelgium
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-EppendorfHamburgGermany
| | - K Richard Ridderinkhof
- Department of Psychology, University of AmsterdamAmsterdamNetherlands
- Amsterdam center for Brain and Cognition (ABC), University of AmsterdamAmsterdamNetherlands
| | - Peter R Murphy
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-EppendorfHamburgGermany
- Trinity College Institute of Neuroscience, Trinity College DublinDublinIreland
| |
Collapse
|
10
|
Ratcliff R, Kang I. Qualitative speed-accuracy tradeoff effects can be explained by a diffusion/fast-guess mixture model. Sci Rep 2021; 11:15169. [PMID: 34312438 PMCID: PMC8313539 DOI: 10.1038/s41598-021-94451-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 07/05/2021] [Indexed: 11/19/2022] Open
Abstract
Rafiei and Rahnev (2021) presented an analysis of an experiment in which they manipulated speed-accuracy stress and stimulus contrast in an orientation discrimination task. They argued that the standard diffusion model could not account for the patterns of data their experiment produced. However, their experiment encouraged and produced fast guesses in the higher speed-stress conditions. These fast guesses are responses with chance accuracy and response times (RTs) less than 300 ms. We developed a simple mixture model in which fast guesses were represented by a simple normal distribution with fixed mean and standard deviation and other responses by the standard diffusion process. The model fit the whole pattern of accuracy and RTs as a function of speed/accuracy stress and stimulus contrast, including the sometimes bimodal shapes of RT distributions. In the model, speed-accuracy stress affected some model parameters while stimulus contrast affected a different one showing selective influence. Rafiei and Rahnev's failure to fit the diffusion model was the result of driving subjects to fast guess in their experiment.
Collapse
Affiliation(s)
- Roger Ratcliff
- The Ohio State University, 1835 Neil Avenue, Columbus, OH, 43210, USA.
| | - Inhan Kang
- The Ohio State University, 1835 Neil Avenue, Columbus, OH, 43210, USA
| |
Collapse
|