1
|
Duffy JS, Bellgrove MA, Murphy PR, O'Connell RG. Disentangling sources of variability in decision-making. Nat Rev Neurosci 2025; 26:247-262. [PMID: 40114010 DOI: 10.1038/s41583-025-00916-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/26/2025] [Indexed: 03/22/2025]
Abstract
Even the most highly-trained observers presented with identical choice-relevant stimuli will reliably exhibit substantial trial-to-trial variability in the timing and accuracy of their choices. Despite being a pervasive feature of choice behaviour and a prominent phenotype for numerous clinical disorders, the capability to disentangle the sources of such intra-individual variability (IIV) remains limited. In principle, computational models of decision-making offer a means of parsing and estimating these sources, but methodological limitations have prevented this potential from being fully realized in practice. In this Review, we first discuss current limitations of algorithmic models for understanding variability in decision-making behaviour. We then highlight recent advances in behavioural paradigm design, novel analyses of cross-trial behavioural and neural dynamics, and the development of neurally grounded computational models that are now making it possible to link distinct components of IIV to well-defined neural processes. Taken together, we demonstrate how these methods are opening up new avenues for systematically analysing the neural origins of IIV, paving the way for a more refined, holistic understanding of decision-making in health and disease.
Collapse
Affiliation(s)
- Jade S Duffy
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin, Ireland
| | - Mark A Bellgrove
- School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria, Australia
| | - Peter R Murphy
- Department of Psychology, Maynooth University, Kildare, Ireland
| | - Redmond G O'Connell
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin, Ireland.
| |
Collapse
|
2
|
Poth CH. Readiness for Perception and Action: Towards a More Mechanistic Understanding of Phasic Alertness. J Cogn 2025; 8:19. [PMID: 39867585 PMCID: PMC11759528 DOI: 10.5334/joc.426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2017] [Accepted: 11/03/2017] [Indexed: 01/28/2025] Open
Abstract
Human survival requires prompt perception and action to address relevant events in the environment. For this, the brain has evolved a system that uses warning stimuli to elicit phasic alertness, a state readying the brain for upcoming perception and action. Although a wealth of empirical evidence revealed how phasic alertness improves a wide range of perceptual and cognitive processing, it is still unclear by what cognitive mechanisms this is achieved. Here, we identify key problems that have to be solved for this to be possible and delineate concrete ways to achieve this. Specifically, we discover I) how to establish phasic alertness as a cognitive state of readiness for perception and action, II) how it can affect cognition online or offline, III) how it could be triggered internally without a warning, and IV) to what degrees it relied on bottom-up processing, or top-down temporal or stimulus expectations and the current task. As a result, the discussion provides us with a research program yielding the theoretical and empirical basis for mechanistic and computational models of phasic alertness and its neurophysiological underpinnings.
Collapse
Affiliation(s)
- Christian H. Poth
- Neuro-Cognitive Psychology, Department of Psychology, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
3
|
Luo T, Xu M, Zheng Z, Okazawa G. Limitation of switching sensory information flow in flexible perceptual decision making. Nat Commun 2025; 16:172. [PMID: 39747100 PMCID: PMC11696174 DOI: 10.1038/s41467-024-55686-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 12/19/2024] [Indexed: 01/04/2025] Open
Abstract
Humans can flexibly change rules to categorize sensory stimuli, but their performance degrades immediately after a task switch. This switch cost is believed to reflect a limitation in cognitive control, although the bottlenecks remain controversial. Here, we show that humans exhibit a brief reduction in the efficiency of using sensory inputs to form a decision after a rule change. Participants classified face stimuli based on one of two rules, switching every few trials. Psychophysical reverse correlation and computational modeling reveal a reduction in sensory weighting, which recovers within a few hundred milliseconds after stimulus presentation. This reduction depends on the sensory features being switched, suggesting a constraint in routing the sensory information flow. We propose that decision-making circuits cannot fully adjust their sensory readout based on a context cue alone, but require the presence of an actual stimulus to tune it, leading to a limitation in flexible perceptual decision making.
Collapse
Affiliation(s)
- Tianlin Luo
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-Inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Mengya Xu
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-Inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Zhihao Zheng
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-Inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Gouki Okazawa
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-Inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China.
- University of Chinese Academy of Sciences, Beijing, 100049, China.
| |
Collapse
|
4
|
Hebisch J, Ghassemieh AC, Zhecheva E, Brouwer M, van Gaal S, Schwabe L, Donner TH, de Gee JW. Task-irrelevant stimuli reliably boost phasic pupil-linked arousal but do not affect decision formation. Sci Rep 2024; 14:28380. [PMID: 39551856 PMCID: PMC11570621 DOI: 10.1038/s41598-024-78791-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2024] [Accepted: 11/04/2024] [Indexed: 11/19/2024] Open
Abstract
The arousal systems of the brainstem, specifically the locus coeruleus-noradrenaline system, respond "phasically" during decisions. These central arousal transients are accompanied by dilations of the pupil. Mechanistic attempts to understand the impact of phasic arousal on cognition would benefit from temporally precise experimental manipulations. Here, we evaluated a non-invasive candidate approach to manipulate arousal in humans: presenting task-irrelevant auditory stimuli at different latencies during the execution of a challenging task. Task-irrelevant auditory stimuli drive responses of brainstem nuclei involved in the control of pupil size, but it is unknown whether such sound-evoked responses mimic the central arousal transients evoked during cognitive computations. A large body of evidence has implicated central arousal transients in reducing bias during challenging perceptual decisions. We thus used challenging visual decisions as a testbed, combining them with task-irrelevant sounds of varying onset latency or duration. Across three experiments, the sounds consistently elicited well-controlled pupil responses that superimposed onto task-evoked responses. While we replicated a negative correlation between task-evoked pupil responses and bias, the task-irrelevant sounds had no behavioral effect. This dissociation suggests that cognitive task engagement and task-irrelevant sounds may recruit distinct neural systems contributing to the control of pupil size.
Collapse
Affiliation(s)
- J Hebisch
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| | - A-C Ghassemieh
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - E Zhecheva
- Cognitive and Systems Neuroscience, Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, The Netherlands
| | - M Brouwer
- Cognitive and Systems Neuroscience, Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, The Netherlands
| | - S van Gaal
- Brain and Cognition, Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Brain & Cognition, University of Amsterdam, Amsterdam, The Netherlands
| | - L Schwabe
- Department of Cognitive Psychology, Institute of Psychology, Universität Hamburg, Hamburg, Germany
| | - T H Donner
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
- Bernstein Center for Computational Neuroscience, Charité Universitätsmedizin, Berlin, Germany.
| | - J W de Gee
- Cognitive and Systems Neuroscience, Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, The Netherlands.
- Amsterdam Brain & Cognition, University of Amsterdam, Amsterdam, The Netherlands.
| |
Collapse
|
5
|
Calder-Travis J, Charles L, Bogacz R, Yeung N. Bayesian confidence in optimal decisions. Psychol Rev 2024; 131:1114-1160. [PMID: 39023934 PMCID: PMC7617410 DOI: 10.1037/rev0000472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/20/2024]
Abstract
The optimal way to make decisions in many circumstances is to track the difference in evidence collected in favor of the options. The drift diffusion model (DDM) implements this approach and provides an excellent account of decisions and response times. However, existing DDM-based models of confidence exhibit certain deficits, and many theories of confidence have used alternative, nonoptimal models of decisions. Motivated by the historical success of the DDM, we ask whether simple extensions to this framework might allow it to better account for confidence. Motivated by the idea that the brain will not duplicate representations of evidence, in all model variants decisions and confidence are based on the same evidence accumulation process. We compare the models to benchmark results, and successfully apply four qualitative tests concerning the relationships between confidence, evidence, and time, in a new preregistered study. Using computationally cheap expressions to model confidence on a trial-by-trial basis, we find that a subset of model variants also provide a very good to excellent account of precise quantitative effects observed in confidence data. Specifically, our results favor the hypothesis that confidence reflects the strength of accumulated evidence penalized by the time taken to reach the decision (Bayesian readout), with the penalty applied not perfectly calibrated to the specific task context. These results suggest there is no need to abandon the DDM or single accumulator models to successfully account for confidence reports. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
Affiliation(s)
- Joshua Calder-Travis
- Department of Experimental Psychology, University of Oxford
- Institute of Neurophysiology and Pathophysiology, Universitätsklinikum Hamburg-Eppendorf
| | - Lucie Charles
- Institute of Cognitive Neuroscience, University College London
| | - Rafal Bogacz
- Nuffield Department of Clinical Neurosciences, Medical Research Council Brain Network Dynamics Unit, University of Oxford
| | - Nick Yeung
- Department of Experimental Psychology, University of Oxford
| |
Collapse
|
6
|
Murphy PR, Krkovic K, Monov G, Kudlek N, Lincoln T, Donner TH. Individual differences in belief updating and phasic arousal are related to psychosis proneness. COMMUNICATIONS PSYCHOLOGY 2024; 2:88. [PMID: 39313542 PMCID: PMC11420346 DOI: 10.1038/s44271-024-00140-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 09/12/2024] [Indexed: 09/25/2024]
Abstract
Many decisions entail the updating of beliefs about the state of the environment by accumulating noisy sensory evidence. This form of probabilistic reasoning may go awry in psychosis. Computational theory shows that optimal belief updating in environments subject to hidden changes in their state requires a dynamic modulation of the evidence accumulation process. Recent empirical findings implicate transient responses of pupil-linked central arousal systems to individual evidence samples in this modulation. Here, we analyzed behavior and pupil responses during evidence accumulation in a changing environment in a community sample of human participants. We also assessed their subclinical psychotic experiences (psychosis proneness). Participants most prone to psychosis showed overall less flexible belief updating profiles, with diminished behavioral impact of evidence samples occurring late during decision formation. These same individuals also exhibited overall smaller pupil responses and less reliable pupil encoding of computational variables governing the dynamic belief updating. Our findings provide insights into the cognitive and physiological bases of psychosis proneness and open paths to unraveling the pathophysiology of psychotic disorders.
Collapse
Affiliation(s)
- Peter R Murphy
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
- Department of Psychology, Maynooth University, Co. Kildare, Ireland.
| | - Katarina Krkovic
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, University of Hamburg, Hamburg, Germany
| | - Gina Monov
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Natalia Kudlek
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Tania Lincoln
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, University of Hamburg, Hamburg, Germany
| | - Tobias H Donner
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
- Bernstein Center for Computational Neuroscience, Charité Universitätsmedizin, Berlin, Germany.
| |
Collapse
|
7
|
Ogasa K, Yokoi A, Okazawa G, Nishigaki M, Hirashima M, Hagura N. Decision uncertainty as a context for motor memory. Nat Hum Behav 2024; 8:1738-1751. [PMID: 38862814 PMCID: PMC11420082 DOI: 10.1038/s41562-024-01911-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 05/13/2024] [Indexed: 06/13/2024]
Abstract
The current view of perceptual decision-making suggests that once a decision is made, only a single motor programme associated with the decision is carried out, irrespective of the uncertainty involved in decision making. In contrast, we show that multiple motor programmes can be acquired on the basis of the preceding uncertainty of the decision, indicating that decision uncertainty functions as a contextual cue for motor memory. The actions learned after making certain (uncertain) decisions are only partially transferred to uncertain (certain) decisions. Participants were able to form distinct motor memories for the same movement on the basis of the preceding decision uncertainty. Crucially, this contextual effect generalizes to novel stimuli with matched uncertainty levels, demonstrating that decision uncertainty is itself a contextual cue. These findings broaden the understanding of contextual inference in motor memory, emphasizing that it extends beyond direct motor control cues to encompass the decision-making process.
Collapse
Affiliation(s)
- Kisho Ogasa
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka, Japan
| | - Atsushi Yokoi
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka, Japan
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
| | - Gouki Okazawa
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | | | - Masaya Hirashima
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka, Japan
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
| | - Nobuhiro Hagura
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka, Japan.
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan.
| |
Collapse
|
8
|
Luo TZ, Kim TD, Gupta D, Bondy AG, Kopec CD, Elliot VA, DePasquale B, Brody CD. Transitions in dynamical regime and neural mode underlie perceptual decision-making. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.10.15.562427. [PMID: 37904994 PMCID: PMC10614809 DOI: 10.1101/2023.10.15.562427] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
Perceptual decision-making is the process by which an animal uses sensory stimuli to choose an action or mental proposition. This process is thought to be mediated by neurons organized as attractor networks 1,2 . However, whether attractor dynamics underlie decision behavior and the complex neuronal responses remains unclear. Here we use an unsupervised, deep learning-based method to discover decision-related dynamics from the simultaneous activity of neurons in frontal cortex and striatum of rats while they accumulate pulsatile auditory evidence. We found that trajectories evolved along two sequential regimes, the first dominated by sensory inputs, and the second dominated by the autonomous dynamics, with flow in a direction (i.e., "neural mode") largely orthogonal to that in the first regime. We propose that the second regime corresponds to decision commitment. We developed a simplified model that approximates the coupled transition in dynamics and neural mode and allows precise inference, from each trial's neural activity, of a putative internal decision commitment time in that trial. The simplified model captures diverse and complex single-neuron temporal profiles, such as ramping and stepping 3-5 . It also captures trial-averaged curved trajectories 6-8 , and reveals distinctions between brain regions. The putative neurally-inferred commitment times ("nTc") occurred at times broadly distributed across trials, and not time-locked to stimulus onset, offset, or response onset. Nevertheless, when trials were aligned to nTc, behavioral analysis showed that, as predicted by a decision commitment time, sensory evidence before nTc affected the subjects' decision, but evidence after nTc did not. Our results show that the formation of a perceptual choice involves a rapid, coordinated transition in both the dynamical regime and the neural mode of the decision process, and suggest the moment of commitment to be a useful entry point for dissecting mechanisms underlying rapid changes in internal state.
Collapse
|
9
|
Cone JJ, Mitchell AO, Parker RK, Maunsell JHR. Stimulus-dependent differences in cortical versus subcortical contributions to visual detection in mice. Curr Biol 2024; 34:1940-1952.e5. [PMID: 38640924 PMCID: PMC11080572 DOI: 10.1016/j.cub.2024.03.061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 02/08/2024] [Accepted: 03/27/2024] [Indexed: 04/21/2024]
Abstract
The primary visual cortex (V1) and the superior colliculus (SC) both occupy stations early in the processing of visual information. They have long been thought to perform distinct functions, with the V1 supporting the perception of visual features and the SC regulating orienting to visual inputs. However, growing evidence suggests that the SC supports the perception of many of the same visual features traditionally associated with the V1. To distinguish V1 and SC contributions to visual processing, it is critical to determine whether both areas causally contribute to the detection of specific visual stimuli. Here, mice reported changes in visual contrast or luminance near their perceptual threshold while white noise patterns of optogenetic stimulation were delivered to V1 or SC inhibitory neurons. We then performed a reverse correlation analysis on the optogenetic stimuli to estimate a neuronal-behavioral kernel (NBK), a moment-to-moment estimate of the impact of V1 or SC inhibition on stimulus detection. We show that the earliest moments of stimulus-evoked activity in the SC are critical for the detection of both luminance and contrast changes. Strikingly, there was a robust stimulus-aligned modulation in the V1 contrast-detection NBK but no sign of a comparable modulation for luminance detection. The data suggest that behavioral detection of visual contrast depends on both V1 and SC spiking, whereas mice preferentially use SC activity to detect changes in luminance. Electrophysiological recordings showed that neurons in both the SC and V1 responded strongly to both visual stimulus types, while the reverse correlation analysis reveals when these neuronal signals actually contribute to visually guided behaviors.
Collapse
Affiliation(s)
- Jackson J Cone
- Department of Neurobiology and Neuroscience Institute, University of Chicago, 5812 S. Ellis Ave. MC 0912, Suite P-400, Chicago, IL 60637, USA.
| | - Autumn O Mitchell
- Department of Neurobiology and Neuroscience Institute, University of Chicago, 5812 S. Ellis Ave. MC 0912, Suite P-400, Chicago, IL 60637, USA
| | - Rachel K Parker
- Department of Neurobiology and Neuroscience Institute, University of Chicago, 5812 S. Ellis Ave. MC 0912, Suite P-400, Chicago, IL 60637, USA
| | - John H R Maunsell
- Department of Neurobiology and Neuroscience Institute, University of Chicago, 5812 S. Ellis Ave. MC 0912, Suite P-400, Chicago, IL 60637, USA
| |
Collapse
|
10
|
Li C, Yang Y, Zhu J, Han Y, He J, Wang J, Feng Y, Yuan J, Huang X, Liu R, Zhang H, Ruan X, Hou F. Visual Tracking in Amblyopia: A Continuous Psychophysical Approach. Invest Ophthalmol Vis Sci 2024; 65:7. [PMID: 38700875 PMCID: PMC11078166 DOI: 10.1167/iovs.65.5.7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 04/10/2024] [Indexed: 05/12/2024] Open
Abstract
Purpose This study aimed to explore the underlying mechanisms of the observed visuomotor deficit in amblyopia. Methods Twenty-four amblyopic (25.8 ± 3.8 years; 15 males) and 22 normal participants (25.8 ± 2.1 years; 8 males) took part in the study. The participants were instructed to continuously track a randomly moving Gaussian target on a computer screen using a mouse. In experiment 1, the participants performed the tracking task at six different target sizes. In experiments 2 and 3, they were asked to track a target with the contrast adjusted to individual's threshold. The tracking performance was represented by the kernel function calculated as the cross-correlation between the target and mouse displacements. The peak, latency, and width of the kernel were extracted and compared between the two groups. Results In experiment 1, target size had a significant effect on the kernel peak (F(1.649, 46.170) = 200.958, P = 4.420 × 10-22). At the smallest target size, the peak in the amblyopic group was significantly lower than that in the normal group (0.089 ± 0.023 vs. 0.107 ± 0.020, t(28) = -2.390, P = 0.024) and correlated with the contrast sensitivity function (r = 0.739, P = 0.002) in the amblyopic eyes. In experiments 2 and 3, with equally visible stimuli, there were still differences in the kernel between the two groups (all Ps < 0.05). Conclusions When stimulus visibility was compensated, amblyopic participants still showed significantly poorer tracking performance.
Collapse
Affiliation(s)
- Cheng Li
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Yan Yang
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
- Civil Aviation General Hospital, Beijing, China
| | - Jinli Zhu
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Yijin Han
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Jia He
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Jun Wang
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Yufan Feng
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Junli Yuan
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Xiaolin Huang
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Renjie Liu
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Hanyi Zhang
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Xiaowei Ruan
- National Engineering Research Center of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
- State Key Laboratory of Ophthalmology, Optometry and Vision Science, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Fang Hou
- National Engineering Research Center of Ophthalmology and Optometry, Eye Hospital, Wenzhou Medical University, Wenzhou, China
- State Key Laboratory of Ophthalmology, Optometry and Vision Science, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| |
Collapse
|
11
|
Roop BW, Parrell B, Lammert AC. A compressive sensing approach for inferring cognitive representations with reverse correlation. Behav Res Methods 2024; 56:3606-3618. [PMID: 38049576 PMCID: PMC11133035 DOI: 10.3758/s13428-023-02281-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/25/2023] [Indexed: 12/06/2023]
Abstract
Uncovering cognitive representations is an elusive goal that is increasingly pursued using the reverse correlation method, wherein human subjects make judgments about ambiguous stimuli. Employing reverse correlation often entails collecting thousands of stimulus-response pairs, which severely limits the breadth of studies that are feasible using the method. Current techniques to improve efficiency bias the outcome. Here we show that this methodological barrier can be diminished using compressive sensing, an advanced signal processing technique designed to improve sampling efficiency. Simulations are performed to demonstrate that compressive sensing can improve the accuracy of reconstructed cognitive representations and dramatically reduce the required number of stimulus-response pairs. Additionally, compressive sensing is used on human subject data from a previous reverse correlation study, demonstrating a dramatic improvement in reconstruction quality. This work concludes by outlining the potential of compressive sensing to improve representation reconstruction throughout the fields of psychology, neuroscience, and beyond.
Collapse
Affiliation(s)
- Benjamin W Roop
- Program of Neuroscience, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Benjamin Parrell
- Department of Communication Sciences and Disorders, University of Wisconsin-Madison, Madison, WI, USA
| | - Adam C Lammert
- Program of Neuroscience, Worcester Polytechnic Institute, Worcester, MA, USA.
- Biomedical Engineering Department, Worcester Polytechnic Institute, 100 Institute Rd, Worcester, MA, 01609, USA.
| |
Collapse
|
12
|
Fink L, Simola J, Tavano A, Lange E, Wallot S, Laeng B. From pre-processing to advanced dynamic modeling of pupil data. Behav Res Methods 2024; 56:1376-1412. [PMID: 37351785 PMCID: PMC10991010 DOI: 10.3758/s13428-023-02098-1] [Citation(s) in RCA: 22] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2023] [Indexed: 06/24/2023]
Abstract
The pupil of the eye provides a rich source of information for cognitive scientists, as it can index a variety of bodily states (e.g., arousal, fatigue) and cognitive processes (e.g., attention, decision-making). As pupillometry becomes a more accessible and popular methodology, researchers have proposed a variety of techniques for analyzing pupil data. Here, we focus on time series-based, signal-to-signal approaches that enable one to relate dynamic changes in pupil size over time with dynamic changes in a stimulus time series, continuous behavioral outcome measures, or other participants' pupil traces. We first introduce pupillometry, its neural underpinnings, and the relation between pupil measurements and other oculomotor behaviors (e.g., blinks, saccades), to stress the importance of understanding what is being measured and what can be inferred from changes in pupillary activity. Next, we discuss possible pre-processing steps, and the contexts in which they may be necessary. Finally, we turn to signal-to-signal analytic techniques, including regression-based approaches, dynamic time-warping, phase clustering, detrended fluctuation analysis, and recurrence quantification analysis. Assumptions of these techniques, and examples of the scientific questions each can address, are outlined, with references to key papers and software packages. Additionally, we provide a detailed code tutorial that steps through the key examples and figures in this paper. Ultimately, we contend that the insights gained from pupillometry are constrained by the analysis techniques used, and that signal-to-signal approaches offer a means to generate novel scientific insights by taking into account understudied spectro-temporal relationships between the pupil signal and other signals of interest.
Collapse
Affiliation(s)
- Lauren Fink
- Department of Music, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt am Main, Germany.
- Department of Psychology, Neuroscience & Behavior, McMaster University, 1280 Main St. West, Hamilton, Ontario, L8S 4L8, Canada.
| | - Jaana Simola
- Helsinki Collegium for Advanced Studies, University of Helsinki, Helsinki, Finland
- Department of Education, University of Helsinki, Helsinki, Finland
| | - Alessandro Tavano
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Elke Lange
- Department of Music, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt am Main, Germany
| | - Sebastian Wallot
- Department of Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Institute for Sustainability Education and Psychologyy, Leuphana University, Lüneburg, Germany
| | - Bruno Laeng
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary studies in Rhythm, Time, and Motion, University of Oslo, Oslo, Norway
| |
Collapse
|
13
|
Lehnert J, Cha K, Halperin J, Yang K, Zheng DF, Khadra A, Cook EP, Krishnaswamy A. Visual attention to features and space in mice using reverse correlation. Curr Biol 2023; 33:3690-3701.e4. [PMID: 37611588 DOI: 10.1016/j.cub.2023.07.060] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2022] [Revised: 05/17/2023] [Accepted: 07/27/2023] [Indexed: 08/25/2023]
Abstract
Visual attention allows the brain to evoke behaviors based on the most important visual features. Mouse models offer immense potential to gain a circuit-level understanding of this phenomenon, yet how mice distribute attention across features and locations is not well understood. Here, we describe a new approach to address this limitation by training mice to detect weak vertical bars in a background of dynamic noise while spatial cues manipulate their attention. By adapting a reverse-correlation method from human studies, we linked behavioral decisions to stimulus features and locations. We show that mice deployed attention to a small rostral region of the visual field. Within this region, mice attended to multiple features (orientation, spatial frequency, contrast) that indicated the presence of weak vertical bars. This attentional tuning grew with training, multiplicatively scaled behavioral sensitivity, approached that of an ideal observer, and resembled the effects of attention in humans. Taken together, we demonstrate that mice can simultaneously attend to multiple features and locations of a visual stimulus.
Collapse
Affiliation(s)
- Jonas Lehnert
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada
| | - Kuwook Cha
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Jamie Halperin
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Kerry Yang
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Daniel F Zheng
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Anmar Khadra
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada; Centre for Applied Mathematics in Bioscience and Medicine, McGill University, Montreal, QC H3G 0B1, Canada
| | - Erik P Cook
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada; Centre for Applied Mathematics in Bioscience and Medicine, McGill University, Montreal, QC H3G 0B1, Canada.
| | - Arjun Krishnaswamy
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada.
| |
Collapse
|
14
|
Cone JJ, Mitchell AO, Parker RK, Maunsell JHR. Temporal weighting of cortical and subcortical spikes reveals stimulus dependent differences in their contributions to behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.23.554473. [PMID: 37662213 PMCID: PMC10473714 DOI: 10.1101/2023.08.23.554473] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
The primary visual cortex (V1) and the superior colliculus (SC) both occupy stations early in the processing of visual information. They have long been thought to perform distinct functions, with V1 supporting perception of visual features and the SC regulating orienting to visual inputs. However, growing evidence suggests that the SC supports perception of many of the same visual features traditionally associated with V1. To distinguish V1 and SC contributions to visual processing, it is critical to determine whether both areas causally contribute to perception of specific visual stimuli. Here, mice reported changes in visual contrast or luminance near perceptual threshold while we presented white noise patterns of optogenetic stimulation to V1 or SC inhibitory neurons. We then performed a reverse correlation analysis on the optogenetic stimuli to estimate a neuronal-behavioral kernel (NBK), a moment-to-moment estimate of the impact of V1 or SC inhibition on stimulus detection. We show that the earliest moments of stimulus-evoked activity in SC are critical for detection of both luminance or contrast changes. Strikingly, there was a robust stimulus-aligned modulation in the V1 contrast-detection NBK, but no sign of a comparable modulation for luminance detection. The data suggest that perception of visual contrast depends on both V1 and SC spiking, whereas mice preferentially use SC activity to detect changes in luminance. Electrophysiological recordings showed that neurons in both SC and V1 responded strongly to both visual stimulus types, while the reverse correlation analysis reveals when these neuronal signals actually contribute to visually-guided behaviors.
Collapse
|
15
|
Levi AJ, Zhao Y, Park IM, Huk AC. Sensory and Choice Responses in MT Distinct from Motion Encoding. J Neurosci 2023; 43:2090-2103. [PMID: 36781221 PMCID: PMC10042117 DOI: 10.1523/jneurosci.0267-22.2023] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2022] [Revised: 01/16/2023] [Accepted: 01/19/2023] [Indexed: 02/15/2023] Open
Abstract
The macaque middle temporal (MT) area is well known for its visual motion selectivity and relevance to motion perception, but the possibility of it also reflecting higher-level cognitive functions has largely been ignored. We tested for effects of task performance distinct from sensory encoding by manipulating subjects' temporal evidence-weighting strategy during a direction discrimination task while performing electrophysiological recordings from groups of MT neurons in rhesus macaques (one male, one female). This revealed multiple components of MT responses that were, surprisingly, not interpretable as behaviorally relevant modulations of motion encoding, or as bottom-up consequences of the readout of motion direction from MT. The time-varying motion-driven responses of MT were strongly affected by our strategic manipulation-but with time courses opposite the subjects' temporal weighting strategies. Furthermore, large choice-correlated signals were represented in population activity distinct from its motion responses, with multiple phases that lagged psychophysical readout and even continued after the stimulus (but which preceded motor responses). In summary, a novel experimental manipulation of strategy allowed us to control the time course of readout to challenge the correlation between sensory responses and choices, and population-level analyses of simultaneously recorded ensembles allowed us to identify strong signals that were so distinct from direction encoding that conventional, single-neuron-centric analyses could not have revealed or properly characterized them. Together, these approaches revealed multiple cognitive contributions to MT responses that are task related but not functionally relevant to encoding or decoding of motion for psychophysical direction discrimination, providing a new perspective on the assumed status of MT as a simple sensory area.SIGNIFICANCE STATEMENT This study extends understanding of the middle temporal (MT) area beyond its representation of visual motion. Combining multineuron recordings, population-level analyses, and controlled manipulation of task strategy, we exposed signals that depended on changes in temporal weighting strategy, but did not manifest as feedforward effects on behavior. This was demonstrated by (1) an inverse relationship between temporal dynamics of behavioral readout and sensory encoding, (2) a choice-correlated signal that always lagged the stimulus time points most correlated with decisions, and (3) a distinct choice-correlated signal after the stimulus. These findings invite re-evaluation of MT for functions outside of its established sensory role and highlight the power of experimenter-controlled changes in temporal strategy, coupled with recording and analysis approaches that transcend the single-neuron perspective.
Collapse
Affiliation(s)
- Aaron J Levi
- Center for Perceptual Systems, Departments of Neuroscience and Psychology, The University of Texas at Austin, Austin, Texas 78705
| | - Yuan Zhao
- Department of Neurobiology and Behavior, Stony Brook University, Stony Brook, New York 11794
| | - Il Memming Park
- Department of Neurobiology and Behavior, Stony Brook University, Stony Brook, New York 11794
| | - Alexander C Huk
- Center for Perceptual Systems, Departments of Neuroscience and Psychology, The University of Texas at Austin, Austin, Texas 78705
- Fuster Laboratory, University of California Los Angeles, Los Angeles CA 90095
| |
Collapse
|
16
|
Movement characteristics impact decision-making and vice versa. Sci Rep 2023; 13:3281. [PMID: 36841847 PMCID: PMC9968293 DOI: 10.1038/s41598-023-30325-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 02/21/2023] [Indexed: 02/26/2023] Open
Abstract
Previous studies suggest that humans are capable of coregulating the speed of decisions and movements if promoted by task incentives. It is unclear however whether such behavior is inherent to the process of translating decisional information into movements, beyond posing a valid strategy in some task contexts. Therefore, in a behavioral online study we imposed time constraints to either decision- or movement phases of a sensorimotor task, ensuring that coregulating decisions and movements was not promoted by task incentives. We found that participants indeed moved faster when fast decisions were promoted and decided faster when subsequent finger tapping movements had to be executed swiftly. These results were further supported by drift diffusion modelling and inspection of psychophysical kernels: Sensorimotor delays related to initiating the finger tapping sequence were shorter in fast-decision as compared to slow-decision blocks. Likewise, the decisional speed-accuracy tradeoff shifted in favor of faster decisions in fast-tapping as compared to slow-tapping blocks. These findings suggest that decisions not only impact movement characteristics, but that properties of movement impact the time taken to decide. We interpret these behavioral results in the context of embodied decision-making, whereby shared neural mechanisms may modulate decisions and movements in a joint fashion.
Collapse
|
17
|
Abstract
Neural mechanisms of perceptual decision making have been extensively studied in experimental settings that mimic stable environments with repeating stimuli, fixed rules, and payoffs. In contrast, we live in an ever-changing environment and have varying goals and behavioral demands. To accommodate variability, our brain flexibly adjusts decision-making processes depending on context. Here, we review a growing body of research that explores the neural mechanisms underlying this flexibility. We highlight diverse forms of context dependency in decision making implemented through a variety of neural computations. Context-dependent neural activity is observed in a distributed network of brain structures, including posterior parietal, sensory, motor, and subcortical regions, as well as the prefrontal areas classically implicated in cognitive control. We propose that investigating the distributed network underlying flexible decisions is key to advancing our understanding and discuss a path forward for experimental and theoretical investigations.
Collapse
Affiliation(s)
- Gouki Okazawa
- Center for Neural Science, New York University, New York, NY, USA;
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Roozbeh Kiani
- Center for Neural Science, New York University, New York, NY, USA;
- Department of Psychology, New York University, New York, NY, USA
| |
Collapse
|
18
|
Sano H, Ueno N, Maruyama H, Motoyoshi I. Spatial attention in perceptual decision making as revealed by response-locked classification image analysis. Sci Rep 2022; 12:20992. [PMID: 36470899 PMCID: PMC9722780 DOI: 10.1038/s41598-022-24606-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 11/17/2022] [Indexed: 12/12/2022] Open
Abstract
In many situations, humans serially sample information from many locations in an image to make an appropriate decision about a visual target. Spatial attention and eye movements play a crucial role in this serial vision process. To investigate the effect of spatial attention in such dynamic decision making, we applied a classification image (CI) analysis locked to the observer's reaction time (RT). We asked human observers to detect as rapidly as possible a target whose contrast gradually increased on the left or right side of dynamic noise, with the presentation of a spatial cue. The analysis revealed a spatiotemporally biphasic profile of the CI which peaked at ~ 350 ms before the observer's response. We found that a valid cue presented at the target location shortened the RT and increased the overall amplitude of the CI, especially when the cue appeared 500-1250 ms before the observer's response. The results were quantitatively accounted for by a simple perceptual decision mechanism that accumulates the outputs of the spatiotemporal contrast detector, whose gain is increased by sustained attention to the cued location.
Collapse
Affiliation(s)
- Hironobu Sano
- grid.26999.3d0000 0001 2151 536XDepartment of Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Natsuki Ueno
- grid.26999.3d0000 0001 2151 536XDepartment of Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Hironori Maruyama
- grid.26999.3d0000 0001 2151 536XDepartment of Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Isamu Motoyoshi
- grid.26999.3d0000 0001 2151 536XDepartment of Life Sciences, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
19
|
Zhu J, Ruan X, Li C, Yuan J, Yang Y, Zhang W, Zhang H, Zhuo Z, Yan FF, Huang CB, Hou F. Psychophysical Reverse Correlation Revealed Broader Orientation Tuning and Prolonged Reaction Time in Amblyopia. Invest Ophthalmol Vis Sci 2022; 63:3. [PMID: 35503229 PMCID: PMC9078079 DOI: 10.1167/iovs.63.5.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
Purpose Neural selectivity of orientation is a fundamental property of visual system. We aim to investigate whether and how the orientation selectivity changes in amblyopia. Methods Seventeen patients with amblyopia (27.1 ± 7.1 years) and 18 healthy participants (25.1 ± 2.7 years) took part in this study. They were asked to continuously detect vertical gratings embedded in a stream of randomly oriented gratings. Using a technique of subspace reverse correlation, the orientation-time perceptive field (PF) for the atypical grating detection task was derived for each participant. Detailed comparisons were made between the PFs measured with the amblyopic and healthy eyes. Results The PF of the amblyopic eyes showed significant differences in orientation and time domain compared with that of the normal eyes (cluster-based permutation test, ps < 0.05), with broader bandwidth of orientation tuning (31.41 ± 10.59 degrees [mean ± SD] vs. 24.76 ± 6.85 degrees, P = 0.039) and delayed temporal dynamics (483 ± 68 ms vs. 425 ± 58 ms, P = 0.015). None of the altered PF properties correlated with the contrast sensitivity at 1 cycle per degree (c/deg) in amblyopia. No difference in PFs between the dominant and non-dominant eyes in the healthy group was found. Conclusions The altered orientation-time PF to the low spatial frequency and high contrast stimuli suggests amblyopes had coarser orientation selectivity and prolonged reaction time. The broader orientation tuning probably reflects the abnormal lateral interaction in the primary visual cortex, whereas the temporal delay might indicate a high level deficit.
Collapse
Affiliation(s)
- Jinli Zhu
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Xiaowei Ruan
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Cheng Li
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Junli Yuan
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Yan Yang
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Wenhua Zhang
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Hanyi Zhang
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Zuopao Zhuo
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Fang-Fang Yan
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Chaoyang District, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Shijingshan District, Beijing, China
| | - Chang-Bing Huang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Chaoyang District, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Shijingshan District, Beijing, China
| | - Fang Hou
- School of Ophthalmology & Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, China
| |
Collapse
|
20
|
Day-Cooney J, Cone JJ, Maunsell JHR. Perceptual Weighting of V1 Spikes Revealed by Optogenetic White Noise Stimulation. J Neurosci 2022; 42:3122-3132. [PMID: 35232760 PMCID: PMC8994541 DOI: 10.1523/jneurosci.1736-21.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 01/17/2022] [Accepted: 01/19/2022] [Indexed: 11/21/2022] Open
Abstract
During visually guided behaviors, mere hundreds of milliseconds can elapse between a sensory input and its associated behavioral response. How spikes occurring at different times are integrated to drive perception and action remains poorly understood. We delivered random trains of optogenetic stimulation (white noise) to excite inhibitory interneurons in V1 of mice of both sexes while they performed a visual detection task. We then performed a reverse correlation analysis on the optogenetic stimuli to generate a neuronal-behavioral kernel, an unbiased, temporally precise estimate of how suppression of V1 spiking at different moments around the onset of a visual stimulus affects detection of that stimulus. Electrophysiological recordings enabled us to capture the effects of optogenetic stimuli on V1 responsivity and revealed that the earliest stimulus-evoked spikes are preferentially weighted for guiding behavior. These data demonstrate that white noise optogenetic stimulation is a powerful tool for understanding how patterns of spiking in neuronal populations are decoded in generating perception and action.SIGNIFICANCE STATEMENT During visually guided actions, continuous chains of neurons connect our retinas to our motoneurons. To unravel circuit contributions to behavior, it is crucial to establish the relative functional position(s) that different neural structures occupy in processing and relaying the signals that support rapid, precise responses. To address this question, we randomly inhibited activity in mouse V1 throughout the stimulus-response cycle while the animals did many repetitions of a visual task. The period that led to impaired performance corresponded to the earliest stimulus-driven response in V1, with no effect of inhibition immediately before or during late stages of the stimulus-driven response. This approach offers experimenters a powerful method for uncovering the temporal weighting of spikes from stimulus to response.
Collapse
Affiliation(s)
- Julian Day-Cooney
- Department of Neurobiology and Neuroscience Institute, University of Chicago, Chicago, Illinois 60637
| | - Jackson J Cone
- Department of Neurobiology and Neuroscience Institute, University of Chicago, Chicago, Illinois 60637
| | - John H R Maunsell
- Department of Neurobiology and Neuroscience Institute, University of Chicago, Chicago, Illinois 60637
| |
Collapse
|
21
|
Sosa R, Alcalá E. The nervous system as a solution for implementing closed negative feedback control loops. J Exp Anal Behav 2022; 117:279-300. [PMID: 35119112 DOI: 10.1002/jeab.736] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 01/02/2022] [Accepted: 01/05/2022] [Indexed: 01/15/2023]
Abstract
Behavior can be regarded as the output of a system (action), as a function linking stimulus to response (reaction), or as an abstraction of the bidirectional relationship between the environment and the organism (interaction). When considering the latter possibility, a relevant question arises concerning how an organism can materially and continuously implement such a relationship during its lifetime in order to perpetuate itself. The feedback control approach has taken up the task of answering just that question. During the last several decades, said approach has been progressing and has started to be recognized as a paradigm shift, superseding certain canonical notions in mainstream behavior analysis, cognitive psychology, and even neuroscience. In this paper, we describe the main features of feedback control theory and its associated techniques, concentrating on its critiques of behavior analysis, as well as the commonalities they share. While some of feedback control theory's major critiques of behavior analysis arise from the fact that they focus on different levels of organization, we believe that some are legitimate and meaningful. Moreover, feedback control theory seems to blend with neurobiology more smoothly as compared to canonical behavior analysis, which only subsists in a scattered handful of fields. If this paradigm shift truly takes place, behavior analysts-whether they accept or reject this new currency-should be mindful of the basics of the feedback control approach.
Collapse
Affiliation(s)
| | - Emmanuel Alcalá
- Instituto Tecnológico de Estudios Superiores de Occidente, Guadalajara, México
| |
Collapse
|
22
|
Turner W, Feuerriegel D, Hester R, Bode S. An initial 'snapshot' of sensory information biases the likelihood and speed of subsequent changes of mind. PLoS Comput Biol 2022; 18:e1009738. [PMID: 35025889 PMCID: PMC8757993 DOI: 10.1371/journal.pcbi.1009738] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Accepted: 12/09/2021] [Indexed: 01/30/2023] Open
Abstract
We often need to rapidly change our mind about perceptual decisions in order to account for new information and correct mistakes. One fundamental, unresolved question is whether information processed prior to a decision being made ('pre-decisional information') has any influence on the likelihood and speed with which that decision is reversed. We investigated this using a luminance discrimination task in which participants indicated which of two flickering greyscale squares was brightest. Following an initial decision, the stimuli briefly remained on screen, and participants could change their response. Using psychophysical reverse correlation, we examined how moment-to-moment fluctuations in stimulus luminance affected participants' decisions. This revealed that the strength of even the very earliest (pre-decisional) evidence was associated with the likelihood and speed of later changes of mind. To account for this effect, we propose an extended diffusion model in which an initial 'snapshot' of sensory information biases ongoing evidence accumulation.
Collapse
Affiliation(s)
- William Turner
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Robert Hester
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Stefan Bode
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| |
Collapse
|
23
|
Zylberberg A. Decision prioritization and causal reasoning in decision hierarchies. PLoS Comput Biol 2021; 17:e1009688. [PMID: 34971552 PMCID: PMC8719712 DOI: 10.1371/journal.pcbi.1009688] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Accepted: 11/28/2021] [Indexed: 12/02/2022] Open
Abstract
From cooking a meal to finding a route to a destination, many real life decisions can be decomposed into a hierarchy of sub-decisions. In a hierarchy, choosing which decision to think about requires planning over a potentially vast space of possible decision sequences. To gain insight into how people decide what to decide on, we studied a novel task that combines perceptual decision making, active sensing and hierarchical and counterfactual reasoning. Human participants had to find a target hidden at the lowest level of a decision tree. They could solicit information from the different nodes of the decision tree to gather noisy evidence about the target's location. Feedback was given only after errors at the leaf nodes and provided ambiguous evidence about the cause of the error. Despite the complexity of task (with 107 latent states) participants were able to plan efficiently in the task. A computational model of this process identified a small number of heuristics of low computational complexity that accounted for human behavior. These heuristics include making categorical decisions at the branching points of the decision tree rather than carrying forward entire probability distributions, discarding sensory evidence deemed unreliable to make a choice, and using choice confidence to infer the cause of the error after an initial plan failed. Plans based on probabilistic inference or myopic sampling norms could not capture participants' behavior. Our results show that it is possible to identify hallmarks of heuristic planning with sensing in human behavior and that the use of tasks of intermediate complexity helps identify the rules underlying human ability to reason over decision hierarchies.
Collapse
Affiliation(s)
- Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York, United States of America
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, New York, United States of America
| |
Collapse
|
24
|
Maruyama H, Ueno N, Motoyoshi I. Response-locked classification image analysis of perceptual decision making in contrast detection. Sci Rep 2021; 11:23096. [PMID: 34845237 PMCID: PMC8630041 DOI: 10.1038/s41598-021-02189-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 10/19/2021] [Indexed: 11/24/2022] Open
Abstract
In many situations, humans make decisions based on serially sampled information through the observation of visual stimuli. To quantify the critical information used by the observer in such dynamic decision making, we here applied a classification image (CI) analysis locked to the observer's reaction time (RT) in a simple detection task for a luminance target that gradually appeared in dynamic noise. We found that the response-locked CI shows a spatiotemporally biphasic weighting profile that peaked about 300 ms before the response, but this profile substantially varied depending on RT; positive weights dominated at short RTs and negative weights at long RTs. We show that these diverse results are explained by a simple perceptual decision mechanism that accumulates the output of the perceptual process as modelled by a spatiotemporal contrast detector. We discuss possible applications and the limitations of the response-locked CI analysis.
Collapse
Affiliation(s)
- Hironori Maruyama
- grid.26999.3d0000 0001 2151 536XDepartment of Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Natsuki Ueno
- grid.26999.3d0000 0001 2151 536XDepartment of Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Isamu Motoyoshi
- Department of Life Sciences, The University of Tokyo, Tokyo, Japan.
| |
Collapse
|
25
|
Zheng Q, Zhou L, Gu Y. Temporal synchrony effects of optic flow and vestibular inputs on multisensory heading perception. Cell Rep 2021; 37:109999. [PMID: 34788608 DOI: 10.1016/j.celrep.2021.109999] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 08/21/2021] [Accepted: 10/21/2021] [Indexed: 11/25/2022] Open
Abstract
Precise heading perception requires integration of optic flow and vestibular cues, yet the two cues often carry distinct temporal dynamics that may confound cue integration benefit. Here, we varied temporal offset between the two sensory inputs while macaques discriminated headings around straight ahead. We find the best heading performance does not occur under natural condition of synchronous inputs with zero offset but rather when visual stimuli are artificially adjusted to lead vestibular by a few hundreds of milliseconds. This amount exactly matches the lag between the vestibular acceleration and visual speed signals as measured from single-unit-activity in frontal and posterior parietal cortices. Manually aligning cues in these areas best facilitates integration with some nonlinear gain modulation effects. These findings are consistent with predictions from a model by which the brain integrates optic flow speed with a faster vestibular acceleration signal for sensing instantaneous heading direction during self-motion in the environment.
Collapse
Affiliation(s)
- Qihao Zheng
- CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Neuroscience, Chinese Academy of Sciences, 200031 Shanghai, China; University of Chinese Academy of Sciences, 100049 Beijing, China
| | - Luxin Zhou
- CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Neuroscience, Chinese Academy of Sciences, 200031 Shanghai, China; University of Chinese Academy of Sciences, 100049 Beijing, China
| | - Yong Gu
- CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Neuroscience, Chinese Academy of Sciences, 200031 Shanghai, China; University of Chinese Academy of Sciences, 100049 Beijing, China; Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, 201210 Shanghai, China.
| |
Collapse
|
26
|
Khalvati K, Kiani R, Rao RPN. Bayesian inference with incomplete knowledge explains perceptual confidence and its deviations from accuracy. Nat Commun 2021; 12:5704. [PMID: 34588440 PMCID: PMC8481237 DOI: 10.1038/s41467-021-25419-4] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Accepted: 08/04/2021] [Indexed: 11/08/2022] Open
Abstract
In perceptual decisions, subjects infer hidden states of the environment based on noisy sensory information. Here we show that both choice and its associated confidence are explained by a Bayesian framework based on partially observable Markov decision processes (POMDPs). We test our model on monkeys performing a direction-discrimination task with post-decision wagering, demonstrating that the model explains objective accuracy and predicts subjective confidence. Further, we show that the model replicates well-known discrepancies of confidence and accuracy, including the hard-easy effect, opposing effects of stimulus variability on confidence and accuracy, dependence of confidence ratings on simultaneous or sequential reports of choice and confidence, apparent difference between choice and confidence sensitivity, and seemingly disproportionate influence of choice-congruent evidence on confidence. These effects may not be signatures of sub-optimal inference or discrepant computational processes for choice and confidence. Rather, they arise in Bayesian inference with incomplete knowledge of the environment.
Collapse
Affiliation(s)
- Koosha Khalvati
- Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA
| | - Roozbeh Kiani
- Center for Neural Science, New York University, New York, NY, USA
- Department of Psychology, New York University, New York, NY, USA
- Neuroscience Institute, NYU Langone Medical Center, New York, NY, USA
| | - Rajesh P N Rao
- Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA.
- Center for Neurotechnology, University of Washington, Seattle, WA, USA.
| |
Collapse
|
27
|
Linear Integration of Sensory Evidence over Space and Time Underlies Face Categorization. J Neurosci 2021; 41:7876-7893. [PMID: 34326145 DOI: 10.1523/jneurosci.3055-20.2021] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2020] [Revised: 07/08/2021] [Accepted: 07/21/2021] [Indexed: 11/21/2022] Open
Abstract
Visual object recognition relies on elaborate sensory processes that transform retinal inputs to object representations, but it also requires decision-making processes that read out object representations and function over prolonged time scales. The computational properties of these decision-making processes remain underexplored for object recognition. Here, we study these computations by developing a stochastic multifeature face categorization task. Using quantitative models and tight control of spatiotemporal visual information, we demonstrate that human subjects (five males, eight females) categorize faces through an integration process that first linearly adds the evidence conferred by task-relevant features over space to create aggregated momentary evidence and then linearly integrates it over time with minimum information loss. Discrimination of stimuli along different category boundaries (e.g., identity or expression of a face) is implemented by adjusting feature weights of spatial integration. This linear but flexible integration process over space and time bridges past studies on simple perceptual decisions to complex object recognition behavior.SIGNIFICANCE STATEMENT Although simple perceptual decision-making such as discrimination of random dot motion has been successfully explained as accumulation of sensory evidence, we lack rigorous experimental paradigms to study the mechanisms underlying complex perceptual decision-making such as discrimination of naturalistic faces. We develop a stochastic multifeature face categorization task as a systematic approach to quantify the properties and potential limitations of the decision-making processes during object recognition. We show that human face categorization could be modeled as a linear integration of sensory evidence over space and time. Our framework to study object recognition as a spatiotemporal integration process is broadly applicable to other object categories and bridges past studies of object recognition and perceptual decision-making.
Collapse
|
28
|
Cloherty SL, Yates JL, Graf D, DeAngelis GC, Mitchell JF. Motion Perception in the Common Marmoset. Cereb Cortex 2021; 30:2658-2672. [PMID: 31828299 DOI: 10.1093/cercor/bhz267] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2019] [Revised: 08/23/2019] [Accepted: 09/17/2019] [Indexed: 11/13/2022] Open
Abstract
Visual motion processing is a well-established model system for studying neural population codes in primates. The common marmoset, a small new world primate, offers unparalleled opportunities to probe these population codes in key motion processing areas, such as cortical areas MT and MST, because these areas are accessible for imaging and recording at the cortical surface. However, little is currently known about the perceptual abilities of the marmoset. Here, we introduce a paradigm for studying motion perception in the marmoset and compare their psychophysical performance with human observers. We trained two marmosets to perform a motion estimation task in which they provided an analog report of their perceived direction of motion with an eye movement to a ring that surrounded the motion stimulus. Marmosets and humans exhibited similar trade-offs in speed versus accuracy: errors were larger and reaction times were longer as the strength of the motion signal was reduced. Reverse correlation on the temporal fluctuations in motion direction revealed that both species exhibited short integration windows; however, marmosets had substantially less nondecision time than humans. Our results provide the first quantification of motion perception in the marmoset and demonstrate several advantages to using analog estimation tasks.
Collapse
Affiliation(s)
- Shaun L Cloherty
- Department of Brain and Cognitive Sciences, University of Rochester, New York, NY 14627, USA.,Department of Physiology, Monash University, Melbourne, VIC 3800, Australia
| | - Jacob L Yates
- Department of Brain and Cognitive Sciences, University of Rochester, New York, NY 14627, USA
| | - Dina Graf
- Department of Brain and Cognitive Sciences, University of Rochester, New York, NY 14627, USA
| | - Gregory C DeAngelis
- Department of Brain and Cognitive Sciences, University of Rochester, New York, NY 14627, USA
| | - Jude F Mitchell
- Department of Brain and Cognitive Sciences, University of Rochester, New York, NY 14627, USA
| |
Collapse
|
29
|
Murai Y, Whitney D. Serial dependence revealed in history-dependent perceptual templates. Curr Biol 2021; 31:3185-3191.e3. [PMID: 34087105 PMCID: PMC8319107 DOI: 10.1016/j.cub.2021.05.006] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Revised: 04/05/2021] [Accepted: 05/04/2021] [Indexed: 12/16/2022]
Abstract
In any given perceptual task, the visual system selectively weighs or filters incoming information. The particular set of weights or filters form a kind of template, which reveals the regions or types of information that are particularly useful for a given perceptual decision.1,2 Unfortunately, sensory input is noisy and ever changing. To compensate for these fluctuations, the visual system could adopt a strategy of biasing the templates such that they reflect a temporal smoothing of input, which would be a form of serial dependence.3-5 Here, we demonstrate that perceptual templates are, in fact, altered by serial dependence. Using a simple orientation detection task and classification-image technique, we found that perceptual templates are systematically biased toward previously seen, task-irrelevant orientations. The results of an orientation discrimination task suggest that this shift in perceptual template derives from a change in the perceptual appearance of orientation. Our study reveals how serial dependence biases internal templates of orientation and suggests that the sensitivity of classification-image techniques in general could be improved by taking into account history-dependent fluctuations in templates.
Collapse
Affiliation(s)
- Yuki Murai
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan; Japan Society for the Promotion of Science.
| | - David Whitney
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Vision Science Program, University of California, Berkeley, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| |
Collapse
|
30
|
Okazawa G, Hatch CE, Mancoo A, Machens CK, Kiani R. Representational geometry of perceptual decisions in the monkey parietal cortex. Cell 2021; 184:3748-3761.e18. [PMID: 34171308 PMCID: PMC8273140 DOI: 10.1016/j.cell.2021.05.022] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Revised: 12/23/2020] [Accepted: 05/17/2021] [Indexed: 11/22/2022]
Abstract
Lateral intraparietal (LIP) neurons represent formation of perceptual decisions involving eye movements. In circuit models for these decisions, neural ensembles that encode actions compete to form decisions. Consequently, representation and readout of the decision variables (DVs) are implemented similarly for decisions with identical competing actions, irrespective of input and task context differences. Further, DVs are encoded as partially potentiated action plans through balance of activity of action-selective ensembles. Here, we test those core principles. We show that in a novel face-discrimination task, LIP firing rates decrease with supporting evidence, contrary to conventional motion-discrimination tasks. These opposite response patterns arise from similar mechanisms in which decisions form along curved population-response manifolds misaligned with action representations. These manifolds rotate in state space based on context, indicating distinct optimal readouts for different tasks. We show similar manifolds in lateral and medial prefrontal cortices, suggesting similar representational geometry across decision-making circuits.
Collapse
Affiliation(s)
- Gouki Okazawa
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Christina E Hatch
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Allan Mancoo
- Champalimaud Research, Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal
| | - Christian K Machens
- Champalimaud Research, Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal
| | - Roozbeh Kiani
- Center for Neural Science, New York University, New York, NY 10003, USA; Neuroscience Institute, NYU Langone Medical Center, New York, NY 10016, USA; Department of Psychology, New York University, New York, NY 10003, USA.
| |
Collapse
|
31
|
Booras A, Stevenson T, McCormack CN, Rhoads ME, Hanks TD. Change point detection with multiple alternatives reveals parallel evaluation of the same stream of evidence along distinct timescales. Sci Rep 2021; 11:13098. [PMID: 34162943 PMCID: PMC8222317 DOI: 10.1038/s41598-021-92470-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 06/08/2021] [Indexed: 11/09/2022] Open
Abstract
In order to behave appropriately in a rapidly changing world, individuals must be able to detect when changes occur in that environment. However, at any given moment, there are a multitude of potential changes of behavioral significance that could occur. Here we investigate how knowledge about the space of possible changes affects human change point detection. We used a stochastic auditory change point detection task that allowed model-free and model-based characterization of the decision process people employ. We found that subjects can simultaneously apply distinct timescales of evidence evaluation to the same stream of evidence when there are multiple types of changes possible. Informative cues that specified the nature of the change led to improved accuracy for change point detection through mechanisms involving both the timescales of evidence evaluation and adjustments of decision bounds. These results establish three important capacities of information processing for decision making that any proposed neural mechanism of evidence evaluation must be able to support: the ability to simultaneously employ multiple timescales of evidence evaluation, the ability to rapidly adjust those timescales, and the ability to modify the amount of information required to make a decision in the context of flexible timescales.
Collapse
Affiliation(s)
- Alexa Booras
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA
| | - Tanner Stevenson
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA
| | - Connor N. McCormack
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA
| | - Marie E. Rhoads
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA ,grid.19006.3e0000 0000 9632 6718Department of Neuroscience, University of California Los Angeles, Los Angeles, CA USA
| | - Timothy D. Hanks
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA ,grid.27860.3b0000 0004 1936 9684Department of Neurology, University of California Davis, Sacramento, CA USA
| |
Collapse
|
32
|
Orsolic I, Rio M, Mrsic-Flogel TD, Znamenskiy P. Mesoscale cortical dynamics reflect the interaction of sensory evidence and temporal expectation during perceptual decision-making. Neuron 2021; 109:1861-1875.e10. [PMID: 33861941 PMCID: PMC8186564 DOI: 10.1016/j.neuron.2021.03.031] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2019] [Revised: 01/17/2021] [Accepted: 03/25/2021] [Indexed: 01/01/2023]
Abstract
How sensory evidence is transformed across multiple brain regions to influence behavior remains poorly understood. We trained mice in a visual change detection task designed to separate the covert antecedents of choices from activity associated with their execution. Wide-field calcium imaging across the dorsal cortex revealed fundamentally different dynamics of activity underlying these processes. Although signals related to execution of choice were widespread, fluctuations in sensory evidence in the absence of overt motor responses triggered a confined activity cascade, beginning with transient modulation of visual cortex and followed by sustained recruitment of the secondary and primary motor cortex. Activation of the motor cortex by sensory evidence was modulated by animals' expectation of when the stimulus was likely to change. These results reveal distinct activation timescales of specific cortical areas by sensory evidence during decision-making and show that recruitment of the motor cortex depends on the interaction of sensory evidence and temporal expectation.
Collapse
Affiliation(s)
- Ivana Orsolic
- Sainsbury Wellcome Centre, University College London, 25 Howland Street, London W1T 4JG, UK; Biozentrum, University of Basel, Klingelbergstrasse 70, 4056 Basel, Switzerland
| | - Maxime Rio
- Sainsbury Wellcome Centre, University College London, 25 Howland Street, London W1T 4JG, UK; Biozentrum, University of Basel, Klingelbergstrasse 70, 4056 Basel, Switzerland; The National Institute of Water and Atmospheric Research, 301 Evans Bay Parade, Hataitai, Wellington 6021, New Zealand
| | - Thomas D Mrsic-Flogel
- Sainsbury Wellcome Centre, University College London, 25 Howland Street, London W1T 4JG, UK; Biozentrum, University of Basel, Klingelbergstrasse 70, 4056 Basel, Switzerland.
| | - Petr Znamenskiy
- Sainsbury Wellcome Centre, University College London, 25 Howland Street, London W1T 4JG, UK; Biozentrum, University of Basel, Klingelbergstrasse 70, 4056 Basel, Switzerland; The Francis Crick Institute, 1 Midland Road, London NW1 1AT, UK.
| |
Collapse
|
33
|
Talluri BC, Urai AE, Bronfman ZZ, Brezis N, Tsetsos K, Usher M, Donner TH. Choices change the temporal weighting of decision evidence. J Neurophysiol 2021; 125:1468-1481. [PMID: 33689508 PMCID: PMC8285578 DOI: 10.1152/jn.00462.2020] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2020] [Revised: 02/16/2021] [Accepted: 03/04/2021] [Indexed: 12/02/2022] Open
Abstract
Many decisions result from the accumulation of decision-relevant information (evidence) over time. Even when maximizing decision accuracy requires weighting all the evidence equally, decision-makers often give stronger weight to evidence occurring early or late in the evidence stream. Here, we show changes in such temporal biases within participants as a function of intermittent judgments about parts of the evidence stream. Human participants performed a decision task that required a continuous estimation of the mean evidence at the end of the stream. The evidence was either perceptual (noisy random dot motion) or symbolic (variable sequences of numbers). Participants also reported a categorical judgment of the preceding evidence half-way through the stream in one condition or executed an evidence-independent motor response in another condition. The relative impact of early versus late evidence on the final estimation flipped between these two conditions. In particular, participants' sensitivity to late evidence after the intermittent judgment, but not the simple motor response, was decreased. Both the intermittent response as well as the final estimation reports were accompanied by nonluminance-mediated increases of pupil diameter. These pupil dilations were bigger during intermittent judgments than simple motor responses and bigger during estimation when the late evidence was consistent than inconsistent with the initial judgment. In sum, decisions activate pupil-linked arousal systems and alter the temporal weighting of decision evidence. Our results are consistent with the idea that categorical choices in the face of uncertainty induce a change in the state of the neural circuits underlying decision-making.NEW & NOTEWORTHY The psychology and neuroscience of decision-making have extensively studied the accumulation of decision-relevant information toward a categorical choice. Much fewer studies have assessed the impact of a choice on the processing of subsequent information. Here, we show that intermittent choices during a protracted stream of input reduce the sensitivity to subsequent decision information and transiently boost arousal. Choices might trigger a state change in the neural machinery for decision-making.
Collapse
Affiliation(s)
- Bharath Chandra Talluri
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Anne E Urai
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
| | | | - Noam Brezis
- School of Psychology, Tel-Aviv University, Tel-Aviv, Israel
| | - Konstantinos Tsetsos
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Marius Usher
- School of Psychology, Tel-Aviv University, Tel-Aviv, Israel
- Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
| | - Tobias H Donner
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Brain and Cognition Center, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
34
|
Kang YH, Löffler A, Jeurissen D, Zylberberg A, Wolpert DM, Shadlen MN. Multiple decisions about one object involve parallel sensory acquisition but time-multiplexed evidence incorporation. eLife 2021; 10:63721. [PMID: 33688829 PMCID: PMC8112870 DOI: 10.7554/elife.63721] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2020] [Accepted: 03/06/2021] [Indexed: 01/31/2023] Open
Abstract
The brain is capable of processing several streams of information that bear on different aspects of the same problem. Here, we address the problem of making two decisions about one object, by studying difficult perceptual decisions about the color and motion of a dynamic random dot display. We find that the accuracy of one decision is unaffected by the difficulty of the other decision. However, the response times reveal that the two decisions do not form simultaneously. We show that both stimulus dimensions are acquired in parallel for the initial ∼0.1 s but are then incorporated serially in time-multiplexed bouts. Thus, there is a bottleneck that precludes updating more than one decision at a time, and a buffer that stores samples of evidence while access to the decision is blocked. We suggest that this bottleneck is responsible for the long timescales of many cognitive operations framed as decisions.
Collapse
Affiliation(s)
- Yul Hr Kang
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Anne Löffler
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Kavli Institute for Brain Science, Columbia University, New York, United States
| | - Danique Jeurissen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, United States
| | - Daniel M Wolpert
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Kavli Institute for Brain Science, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| |
Collapse
|
35
|
Delta/Theta band EEG activity shapes the rhythmic perceptual sampling of auditory scenes. Sci Rep 2021; 11:2370. [PMID: 33504860 PMCID: PMC7840678 DOI: 10.1038/s41598-021-82008-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Accepted: 01/13/2021] [Indexed: 11/08/2022] Open
Abstract
Many studies speak in favor of a rhythmic mode of listening, by which the encoding of acoustic information is structured by rhythmic neural processes at the time scale of about 1 to 4 Hz. Indeed, psychophysical data suggest that humans sample acoustic information in extended soundscapes not uniformly, but weigh the evidence at different moments for their perceptual decision at the time scale of about 2 Hz. We here test the critical prediction that such rhythmic perceptual sampling is directly related to the state of ongoing brain activity prior to the stimulus. Human participants judged the direction of frequency sweeps in 1.2 s long soundscapes while their EEG was recorded. We computed the perceptual weights attributed to different epochs within these soundscapes contingent on the phase or power of pre-stimulus EEG activity. This revealed a direct link between 4 Hz EEG phase and power prior to the stimulus and the phase of the rhythmic component of these perceptual weights. Hence, the temporal pattern by which the acoustic information is sampled over time for behavior is directly related to pre-stimulus brain activity in the delta/theta band. These results close a gap in the mechanistic picture linking ongoing delta band activity with their role in shaping the segmentation and perceptual influence of subsequent acoustic information.
Collapse
|
36
|
Wilming N, Murphy PR, Meyniel F, Donner TH. Large-scale dynamics of perceptual decision information across human cortex. Nat Commun 2020; 11:5109. [PMID: 33037209 PMCID: PMC7547662 DOI: 10.1038/s41467-020-18826-6] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2020] [Accepted: 09/02/2020] [Indexed: 11/09/2022] Open
Abstract
Perceptual decisions entail the accumulation of sensory evidence for a particular choice towards an action plan. An influential framework holds that sensory cortical areas encode the instantaneous sensory evidence and downstream, action-related regions accumulate this evidence. The large-scale distribution of this computation across the cerebral cortex has remained largely elusive. Here, we develop a regionally-specific magnetoencephalography decoding approach to exhaustively map the dynamics of stimulus- and choice-specific signals across the human cortical surface during a visual decision. Comparison with the evidence accumulation dynamics inferred from behavior disentangles stimulus-dependent and endogenous components of choice-predictive activity across the visual cortical hierarchy. We find such an endogenous component in early visual cortex (including V1), which is expressed in a low (<20 Hz) frequency band and tracks, with delay, the build-up of choice-predictive activity in (pre-) motor regions. Our results are consistent with choice- and frequency-specific cortical feedback signaling during decision formation.
Collapse
Affiliation(s)
- Niklas Wilming
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Martinistrasse 52, Hamburg, 20251, Germany.
| | - Peter R Murphy
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Martinistrasse 52, Hamburg, 20251, Germany
| | - Florent Meyniel
- University Paris-Saclay, Inserm, CEA, NeuroSpin, Cognitive Neuroimaging Unit, 91191, Gif-sur-Yvette, France
| | - Tobias H Donner
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Martinistrasse 52, Hamburg, 20251, Germany.
- Bernstein Center for Computational Neuroscience, Charité Universitätsmedizin, Haus 6, Philippstraße 13, 10115, Berlin, Germany.
- Department of Psychology, University of Amsterdam, Weesperplein 4, 1018 XA, Amsterdam, The Netherlands.
- Amsterdam Brain and Cognition, University of Amsterdam, Nieuwe Achtergracht 129, 1018 WS, Amsterdam, The Netherlands.
| |
Collapse
|
37
|
Harun R, Jun E, Park HH, Ganupuru P, Goldring AB, Hanks TD. Timescales of Evidence Evaluation for Decision Making and Associated Confidence Judgments Are Adapted to Task Demands. Front Neurosci 2020; 14:826. [PMID: 32903672 PMCID: PMC7438826 DOI: 10.3389/fnins.2020.00826] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2020] [Accepted: 07/15/2020] [Indexed: 01/29/2023] Open
Abstract
Decision making often involves choosing actions based on relevant evidence. This can benefit from focussing evidence evaluation on the timescale of greatest relevance based on the situation. Here, we use an auditory change detection task to determine how people adjust their timescale of evidence evaluation depending on task demands for detecting changes in their environment and assessing their internal confidence in those decisions. We confirm previous results that people adopt shorter timescales of evidence evaluation for detecting changes in contexts with shorter signal durations, while bolstering those results with model-free analyses not previously used and extending the results to the auditory domain. We also extend these results to show that in contexts with shorter signal durations, people also adopt correspondingly shorter timescales of evidence evaluation for assessing confidence in their decision about detecting a change. These results provide important insights into adaptability and flexible control of evidence evaluation for decision making.
Collapse
Affiliation(s)
- Rashed Harun
- Department of Neurology and Center for Neuroscience, University of California, Davis, Davis, CA, United States
| | - Elizabeth Jun
- Department of Neurology and Center for Neuroscience, University of California, Davis, Davis, CA, United States
| | - Heui Hye Park
- Department of Neurology and Center for Neuroscience, University of California, Davis, Davis, CA, United States
| | - Preetham Ganupuru
- Department of Neurology and Center for Neuroscience, University of California, Davis, Davis, CA, United States
| | - Adam B Goldring
- Department of Neurology and Center for Neuroscience, University of California, Davis, Davis, CA, United States
| | - Timothy D Hanks
- Department of Neurology and Center for Neuroscience, University of California, Davis, Davis, CA, United States
| |
Collapse
|
38
|
Levi AJ, Huk AC. Interpreting temporal dynamics during sensory decision-making. CURRENT OPINION IN PHYSIOLOGY 2020; 16:27-32. [DOI: 10.1016/j.cophys.2020.04.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
39
|
Stine GM, Zylberberg A, Ditterich J, Shadlen MN. Differentiating between integration and non-integration strategies in perceptual decision making. eLife 2020; 9:55365. [PMID: 32338595 PMCID: PMC7217695 DOI: 10.7554/elife.55365] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Accepted: 04/24/2020] [Indexed: 01/26/2023] Open
Abstract
Many tasks used to study decision-making encourage subjects to integrate evidence over time. Such tasks are useful to understand how the brain operates on multiple samples of information over prolonged timescales, but only if subjects actually integrate evidence to form their decisions. We explored the behavioral observations that corroborate evidence-integration in a number of task-designs. Several commonly accepted signs of integration were also predicted by non-integration strategies. Furthermore, an integration model could fit data generated by non-integration models. We identified the features of non-integration models that allowed them to mimic integration and used these insights to design a motion discrimination task that disentangled the models. In human subjects performing the task, we falsified a non-integration strategy in each and confirmed prolonged integration in all but one subject. The findings illustrate the difficulty of identifying a decision-maker’s strategy and support solutions to achieve this goal.
Collapse
Affiliation(s)
- Gabriel M Stine
- Department of Neuroscience, Columbia University, New York, United States
| | - Ariel Zylberberg
- Mortimer B. Zuckerman Mind Brain Behavior Institute and The Kavli Institute for Brain Science, Columbia University, New York, United States.,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, United States
| | - Jochen Ditterich
- Center for Neuroscience and Department of Neurobiology, Physiology & Behavior, University of California, Davis, United States
| | - Michael N Shadlen
- Department of Neuroscience, Columbia University, New York, United States.,Mortimer B. Zuckerman Mind Brain Behavior Institute and The Kavli Institute for Brain Science, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| |
Collapse
|
40
|
Abstract
Orienting covert spatial attention to a target location enhances visual sensitivity and benefits performance in many visual tasks. How these attention-related improvements in performance affect the underlying visual representation of low-level visual features is not fully understood. Here we focus on characterizing how exogenous spatial attention affects the feature representations of orientation and spatial frequency. We asked observers to detect a vertical grating embedded in noise and performed psychophysical reverse correlation. Doing so allowed us to make comparisons with previous studies that utilized the same task and analysis to assess how endogenous attention and presaccadic modulations affect visual representations. We found that exogenous spatial attention improved performance and enhanced the gain of the target orientation without affecting orientation tuning width. Moreover, we found no change in spatial frequency tuning. We conclude that covert exogenous spatial attention alters performance by strictly boosting gain of orientation-selective filters, much like covert endogenous spatial attention.
Collapse
Affiliation(s)
| | - Hsin-Hung Li
- Department of Psychology, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology & Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
41
|
Nakajima M, Schmitt LI. Understanding the circuit basis of cognitive functions using mouse models. Neurosci Res 2019; 152:44-58. [PMID: 31857115 DOI: 10.1016/j.neures.2019.12.009] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2019] [Revised: 12/01/2019] [Accepted: 12/09/2019] [Indexed: 01/13/2023]
Abstract
Understanding how cognitive functions arise from computations occurring in the brain requires the ability to measure and perturb neural activity while the relevant circuits are engaged for specific cognitive processes. Rapid technical advances have led to the development of new approaches to transiently activate and suppress neuronal activity as well as to record simultaneously from hundreds to thousands of neurons across multiple brain regions during behavior. To realize the full potential of these approaches for understanding cognition, however, it is critical that behavioral conditions and stimuli are effectively designed to engage the relevant brain networks. Here, we highlight recent innovations that enable this combined approach. In particular, we focus on how to design behavioral experiments that leverage the ever-growing arsenal of technologies for controlling and measuring neural activity in order to understand cognitive functions.
Collapse
Affiliation(s)
- Miho Nakajima
- McGovern Institute for Brain Research and the Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - L Ian Schmitt
- McGovern Institute for Brain Research and the Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA, United States; Center for Brain Science, RIKEN, Wako, Saitama, Japan.
| |
Collapse
|
42
|
Waskom ML, Okazawa G, Kiani R. Designing and Interpreting Psychophysical Investigations of Cognition. Neuron 2019; 104:100-112. [PMID: 31600507 PMCID: PMC6855836 DOI: 10.1016/j.neuron.2019.09.016] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2019] [Revised: 09/03/2019] [Accepted: 09/12/2019] [Indexed: 11/24/2022]
Abstract
Scientific experimentation depends on the artificial control of natural phenomena. The inaccessibility of cognitive processes to direct manipulation can make such control difficult to realize. Here, we discuss approaches for overcoming this challenge. We advocate the incorporation of experimental techniques from sensory psychophysics into the study of cognitive processes such as decision making and executive control. These techniques include the use of simple parameterized stimuli to precisely manipulate available information and computational models to jointly quantify behavior and neural responses. We illustrate the potential for such techniques to drive theoretical development, and we examine important practical details of how to conduct controlled experiments when using them. Finally, we highlight principles guiding the use of computational models in studying the neural basis of cognition.
Collapse
Affiliation(s)
- Michael L Waskom
- Center for Neural Science, New York University, 4 Washington Place, New York, NY 10003, USA
| | - Gouki Okazawa
- Center for Neural Science, New York University, 4 Washington Place, New York, NY 10003, USA
| | - Roozbeh Kiani
- Center for Neural Science, New York University, 4 Washington Place, New York, NY 10003, USA; Neuroscience Institute, NYU Langone Medical Center, 550 First Avenue, New York, NY 10016, USA; Department of Psychology, New York University, 4 Washington Place, New York, NY 10003, USA.
| |
Collapse
|
43
|
Kayser C. Evidence for the Rhythmic Perceptual Sampling of Auditory Scenes. Front Hum Neurosci 2019; 13:249. [PMID: 31396064 PMCID: PMC6663999 DOI: 10.3389/fnhum.2019.00249] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Accepted: 07/04/2019] [Indexed: 12/15/2022] Open
Abstract
Converging results suggest that perception is controlled by rhythmic processes in the brain. In the auditory domain, neuroimaging studies show that the perception of sounds is shaped by rhythmic activity prior to the stimulus, and electrophysiological recordings have linked delta and theta band activity to the functioning of individual neurons. These results have promoted theories of rhythmic modes of listening and generally suggest that the perceptually relevant encoding of acoustic information is structured by rhythmic processes along auditory pathways. A prediction from this perspective-which so far has not been tested-is that such rhythmic processes also shape how acoustic information is combined over time to judge extended soundscapes. The present study was designed to directly test this prediction. Human participants judged the overall change in perceived frequency content in temporally extended (1.2-1.8 s) soundscapes, while the perceptual use of the available sensory evidence was quantified using psychophysical reverse correlation. Model-based analysis of individual participant's perceptual weights revealed a rich temporal structure, including linear trends, a U-shaped profile tied to the overall stimulus duration, and importantly, rhythmic components at the time scale of 1-2 Hz. The collective evidence found here across four versions of the experiment supports the notion that rhythmic processes operating on the delta time scale structure how perception samples temporally extended acoustic scenes.
Collapse
Affiliation(s)
- Christoph Kayser
- Department for Cognitive Neuroscience & Cognitive Interaction Technology, Center of Excellence, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
44
|
Ganupuru P, Goldring AB, Harun R, Hanks TD. Flexibility of Timescales of Evidence Evaluation for Decision Making. Curr Biol 2019; 29:2091-2097.e4. [PMID: 31178325 DOI: 10.1016/j.cub.2019.05.037] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2018] [Revised: 04/05/2019] [Accepted: 05/15/2019] [Indexed: 12/13/2022]
Abstract
To understand the neural mechanisms that support decision making, it is critical to characterize the timescale of evidence evaluation. Recent work has shown that subjects can adaptively adjust the timescale of evidence evaluation across blocks of trials depending on context [1]. However, it's currently unknown if adjustments to evidence evaluation occur online during deliberations based on a single stream of evidence. To examine this question, we employed a change-detection task in which subjects report their level of confidence in judging whether there has been a change in a stochastic auditory stimulus. Using a combination of psychophysical reverse correlation analyses and single-trial behavioral modeling, we compared the time period over which sensory information has leverage on detection report choices versus confidence. We demonstrate that the length of this period differs on separate sets of trials based on what's being reported. Surprisingly, confidence judgments on trials with no detection report are influenced by evidence occurring earlier than the time period of influence for detection reports. Our findings call into question models of decision formation involving static parameters that yield a singular timescale of evidence evaluation and instead suggest that the brain represents and utilizes multiple timescales of evidence evaluation during deliberation.
Collapse
Affiliation(s)
- Preetham Ganupuru
- Department of Neurology and Center for Neuroscience, University of California Davis, 1544 Newton Ct., Davis, CA 95618, USA
| | - Adam B Goldring
- Department of Neurology and Center for Neuroscience, University of California Davis, 1544 Newton Ct., Davis, CA 95618, USA
| | - Rashed Harun
- Department of Neurology and Center for Neuroscience, University of California Davis, 1544 Newton Ct., Davis, CA 95618, USA
| | - Timothy D Hanks
- Department of Neurology and Center for Neuroscience, University of California Davis, 1544 Newton Ct., Davis, CA 95618, USA.
| |
Collapse
|
45
|
Waskom ML, Kiani R. Decision Making through Integration of Sensory Evidence at Prolonged Timescales. Curr Biol 2018; 28:3850-3856.e9. [PMID: 30471996 DOI: 10.1016/j.cub.2018.10.021] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2018] [Revised: 09/19/2018] [Accepted: 10/08/2018] [Indexed: 10/27/2022]
Abstract
When multiple pieces of information bear on a decision, the best approach is to combine the evidence provided by each one. Evidence integration models formalize the computations underlying this process [1-3], explain human perceptual discrimination behavior [4-9], and correspond to neuronal responses elicited by discrimination tasks [10-14]. These findings suggest that evidence integration is key to understanding the neural basis of decision making [15-18]. But while evidence integration has most often been studied with simple tasks that limit deliberation to relatively brief periods, many natural decisions unfold over much longer durations. Neural network models imply acute limitations on the timescale of evidence integration [19-23], and it is currently unknown whether existing computational insights can generalize beyond rapid judgments. Here, we introduce a new psychophysical task and report model-based analyses of human behavior that demonstrate evidence integration at long timescales. Our task requires probabilistic inference using brief samples of visual evidence that are separated in time by long and unpredictable gaps. We show through several quantitative assays how decision making can approximate a normative integration process that extends over tens of seconds without accruing significant memory leak or noise. These results support the generalization of evidence integration models to a broader class of behaviors while posing new challenges for models of how these computations are implemented in biological networks.
Collapse
Affiliation(s)
- Michael L Waskom
- Center for Neural Science, New York University, 4 Washington Pl, New York, NY 10003, USA.
| | - Roozbeh Kiani
- Center for Neural Science, New York University, 4 Washington Pl, New York, NY 10003, USA; Neuroscience Institute, NYU Langone Medical Center, 550 First Avenue, New York, NY 10016, USA; Department of Psychology, New York University, 4 Washington Pl, New York, NY 10003, USA.
| |
Collapse
|
46
|
Strategic and Dynamic Temporal Weighting for Perceptual Decisions in Humans and Macaques. eNeuro 2018; 5:eN-NWR-0169-18. [PMID: 30406190 PMCID: PMC6220584 DOI: 10.1523/eneuro.0169-18.2018] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2018] [Revised: 08/08/2018] [Accepted: 09/01/2018] [Indexed: 12/14/2022] Open
Abstract
Perceptual decision-making is often modeled as the accumulation of sensory evidence over time. Recent studies using psychophysical reverse correlation have shown that even though the sensory evidence is stationary over time, subjects may exhibit a time-varying weighting strategy, weighting some stimulus epochs more heavily than others. While previous work has explained time-varying weighting as a consequence of static decision mechanisms (e.g., decision bound or leak), here we show that time-varying weighting can reflect strategic adaptation to stimulus statistics, and thus can readily take a number of forms. We characterized the temporal weighting strategies of humans and macaques performing a motion discrimination task in which the amount of information carried by the motion stimulus was manipulated over time. Both species could adapt their temporal weighting strategy to match the time-varying statistics of the sensory stimulus. When early stimulus epochs had higher mean motion strength than late, subjects adopted a pronounced early weighting strategy, where early information was weighted more heavily in guiding perceptual decisions. When the mean motion strength was greater in later stimulus epochs, in contrast, subjects shifted to a marked late weighting strategy. These results demonstrate that perceptual decisions involve a temporally flexible weighting process in both humans and monkeys, and introduce a paradigm with which to manipulate sensory weighting in decision-making tasks.
Collapse
|
47
|
Visual Evidence Accumulation Guides Decision-Making in Unrestrained Mice. J Neurosci 2018; 38:10143-10155. [PMID: 30322902 DOI: 10.1523/jneurosci.3478-17.2018] [Citation(s) in RCA: 51] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Revised: 09/18/2018] [Accepted: 09/22/2018] [Indexed: 12/13/2022] Open
Abstract
The ability to manipulate neural activity with precision is an asset in uncovering neural circuits for decision-making. Diverse tools for manipulating neurons are available for mice, but their feasibility remains unclear, especially when decisions require accumulating visual evidence. For example, whether mice' decisions reflect leaky accumulation is unknown, as are the relevant/irrelevant factors that influence decisions. Further, causal circuits for visual evidence accumulation are poorly understood. To address this, we measured decisions in mice judging the fluctuating rate of a flash sequence. An initial analysis (>500,000 trials, 29 male and female mice) demonstrated that information throughout the 1000 ms trial influenced choice, with early information most influential. This suggests that information persists in neural circuits for ∼1000 ms with minimal accumulation leak. Next, in a subset of animals, we probed strategy more extensively and found that although animals were influenced by stimulus rate, they were unable to entirely suppress the influence of stimulus brightness. Finally, we identified anteromedial (AM) visual area via retinotopic mapping and optogenetically inhibited it using JAWS. Light activation biased choices in both injected and uninjected animals, demonstrating that light alone influences behavior. By varying stimulus-response contingency while holding stimulated hemisphere constant, we surmounted this obstacle to demonstrate that AM suppression biases decisions. By leveraging a large dataset to quantitatively characterize decision-making behavior, we establish mice as suitable for neural circuit manipulation studies. Further, by demonstrating that mice accumulate visual evidence, we demonstrate that this strategy for reducing uncertainty in decision-making is used by animals with diverse visual systems.SIGNIFICANCE STATEMENT To connect behaviors to their underlying neural mechanism, a deep understanding of behavioral strategy is needed. This understanding is incomplete for mice. To surmount this, we measured the outcome of >500,000 decisions made by 29 mice trained to judge visual stimuli and performed behavioral/optogenetic manipulations in smaller subsets. Our analyses offer new insights into mice' decision-making strategies and compares them with those of other species. We then disrupted neural activity in a candidate neural structure and examined the effect on decisions. Our findings establish mice as suitable for visual accumulation of evidence decisions. Further, the results highlight similarities in decision-making strategies across very different species.
Collapse
|
48
|
Matsumori K, Koike Y, Matsumoto K. A Biased Bayesian Inference for Decision-Making and Cognitive Control. Front Neurosci 2018; 12:734. [PMID: 30369867 PMCID: PMC6195105 DOI: 10.3389/fnins.2018.00734] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 09/24/2018] [Indexed: 11/25/2022] Open
Abstract
Although classical decision-making studies have assumed that subjects behave in a Bayes-optimal way, the sub-optimality that causes biases in decision-making is currently under debate. Here, we propose a synthesis based on exponentially-biased Bayesian inference, including various decision-making and probability judgments with different bias levels. We arrange three major parameter estimation methods in a two-dimensional bias parameter space (prior and likelihood), of the biased Bayesian inference. Then, we discuss a neural implementation of the biased Bayesian inference on the basis of changes in weights in neural connections, which we regarded as a combination of leaky/unstable neural integrator and probabilistic population coding. Finally, we discuss mechanisms of cognitive control which may regulate the bias levels.
Collapse
Affiliation(s)
- Kaosu Matsumori
- Tamagawa University Brain Science Institute, Machida, Tokyo, Japan.,Department of Information Processing, Tokyo Institute of Technology, Yokohama, Kanagawa, Japan
| | - Yasuharu Koike
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Kanagawa, Japan
| | - Kenji Matsumoto
- Tamagawa University Brain Science Institute, Machida, Tokyo, Japan
| |
Collapse
|