1
|
Sahoo B, Snyder AC. Neural Dynamics in Extrastriate Cortex Underlying False Alarms. J Neurosci 2025; 45:e1733242025. [PMID: 40164510 PMCID: PMC12079754 DOI: 10.1523/jneurosci.1733-24.2025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2024] [Revised: 01/14/2025] [Accepted: 03/15/2025] [Indexed: 04/02/2025] Open
Abstract
The unfolding of neural population activity can be described as a dynamical system. Stability in the latent dynamics that characterize neural population activity has been linked with consistency in animal behavior, such as motor control or value-based decision-making. However, whether such characteristics of neural dynamics can explain visual perceptual behavior is not well understood. To study this, we recorded V4 populations in two male monkeys engaged in a non-match-to-sample visual change-detection task that required sustained engagement. We measured how the stability in the latent dynamics in V4 might affect monkeys' perceptual behavior. Specifically, we reasoned that unstable sensory neural activity around dynamic attractor boundaries may make animals susceptible to taking incorrect actions when withholding action would have been correct ("false alarms"). We made three key discoveries: (1) greater stability was associated with longer trial sequences; (2) false alarm rate decreased (and response times slowed) when neural dynamics were more stable; and (3) low stability predicted false alarms on a single-trial level, and this relationship depended on the position of the neural activity within the state space, consistent with the latent neural state approaching an attractor boundary. Our results suggest the same outward false alarm behavior can be attributed to two different potential strategies that can be disambiguated by examining neural stability: (1) premeditated false alarms that might lead to greater stability in population dynamics and faster response time and (2) false alarms due to unstable sensory activity consistent with misperception.
Collapse
Affiliation(s)
- Bikash Sahoo
- Brain & Cognitive Sciences, University of Rochester, Rochester, NY 14627
| | | |
Collapse
|
2
|
Anbuhl KL, Diez Castro M, Lee NA, Lee VS, Sanes DH. The cingulate cortex facilitates auditory perception under challenging listening conditions. Proc Natl Acad Sci U S A 2025; 122:e2412453122. [PMID: 40168120 PMCID: PMC12002281 DOI: 10.1073/pnas.2412453122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2024] [Accepted: 02/23/2025] [Indexed: 04/03/2025] Open
Abstract
We often exert greater cognitive resources (i.e., listening effort) to understand speech under challenging acoustic conditions. This mechanism can be overwhelmed in those with hearing loss, resulting in cognitive fatigue in adults and potentially impeding language acquisition in children. However, the neural mechanisms that support listening effort are uncertain. Evidence from human studies suggests that the cingulate cortex is engaged under difficult listening conditions and may exert top-down modulation of the auditory cortex (AC). Here, we asked whether the gerbil cingulate cortex (Cg) sends anatomical projections to the AC that facilitate perceptual performance. To model challenging listening conditions, we used a sound discrimination task in which stimulus parameters were presented in either "Easy" or "Hard" blocks (i.e., long or short stimulus duration, respectively). Gerbils achieved statistically identical psychometric performance in Easy and Hard blocks. Anatomical tracing experiments revealed a strong, descending projection from layer 2/3 of the Cg1 subregion of the cingulate cortex to superficial and deep layers of the primary and dorsal AC. To determine whether Cg improves task performance under challenging conditions, we bilaterally infused muscimol to inactivate Cg1 and found that psychometric thresholds were degraded for only Hard blocks. To test whether the Cg-to-AC projection facilitates task performance, we chemogenetically inactivated these inputs and found that performance was only degraded during Hard blocks. Taken together, the results reveal a descending cortical pathway that facilitates perceptual performance during challenging listening conditions.
Collapse
Affiliation(s)
- Kelsey L. Anbuhl
- Center for Neural Science, New York University, New York, NY10003
- Department of Biomedical Sciences, Creighton University School of Medicine, Omaha, NE68178
| | | | - Nikki A. Lee
- Center for Neural Science, New York University, New York, NY10003
| | - Vivian S. Lee
- Center for Neural Science, New York University, New York, NY10003
| | - Dan H. Sanes
- Center for Neural Science, New York University, New York, NY10003
- Department of Psychology, New York University, New York, NY10003
- Department of Biology, New York University, New York, NY10003
- Neuroscience Institute, New York University School of Medicine, New York, NY10016
| |
Collapse
|
3
|
Zhang A, Geisler WS. Optimal visual search with highly heuristic decision rules. J Vis 2025; 25:5. [PMID: 40232706 PMCID: PMC12007678 DOI: 10.1167/jov.25.4.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Accepted: 02/20/2025] [Indexed: 04/16/2025] Open
Abstract
Visual search is a fundamental natural task for humans and other animals. We investigated the decision processes that humans use in covert (single fixation) search with briefly presented displays having well-separated potential target locations. Performance was compared with the Bayesian-optimal decision process under the assumption that the information from the different potential target locations is statistically independent. Surprisingly, humans performed slightly better than optimal, despite humans' substantial loss of sensitivity in the fovea ("foveal neglect") and the implausibility of the human brain replicating the optimal computations. We show that three factors can quantitatively explain these seemingly paradoxical results. Most importantly, simple and fixed heuristic decision rules reach near optimal search performance. Second, foveal neglect primarily affects only the central potential target location. Finally, spatially correlated neural noise can cause search performance to exceed that predicted for independent noise. These findings have broad implications for understanding visual search tasks and other identification tasks in humans and other animals.
Collapse
Affiliation(s)
- Anqi Zhang
- Center for Perceptual Systems, University of Texas at Austin, Austin, TX, USA
- Department of Physics, University of Texas at Austin, Austin, TX, USA
- https://orcid.org/0000-0002-3565-0906
| | - Wilson S Geisler
- Center for Perceptual Systems, University of Texas at Austin, Austin, TX, USA
- Department of Psychology, University of Texas at Austin, Austin, TX, USA
- https://orcid.org/0000-0003-4630-6614
| |
Collapse
|
4
|
Kunigk NG, Schone HR, Gontier C, Hockeimer W, Tortolani AF, Hatsopoulos NG, Downey JE, Chase SM, Boninger ML, Dekleva BD, Collinger JL. Motor somatotopy impacts imagery strategy success in human intracortical brain-computer interfaces. J Neural Eng 2025; 22:026004. [PMID: 39993333 DOI: 10.1088/1741-2552/adb995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2024] [Accepted: 02/24/2025] [Indexed: 02/26/2025]
Abstract
Objective:The notion of a somatotopically organized motor cortex, with movements of different body parts being controlled by spatially distinct areas of cortex, is well known. However, recent studies have challenged this notion and suggested a more distributed representation of movement control. This shift in perspective has significant implications, particularly when considering the implantation location of electrode arrays for intracortical brain-computer interfaces (iBCIs). We sought to evaluate whether the location of neural recordings from the precentral gyrus, and thus the underlying somatotopy, has any impact on the imagery strategies that can enable successful iBCI control.Approach:Three individuals with a spinal cord injury were enrolled in an ongoing clinical trial of an iBCI. Participants had two intracortical microelectrode arrays implanted in the arm and/or hand areas of the precentral gyrus based on presurgical functional imaging. Neural data were recorded while participants attempted to perform movements of the hand, wrist, elbow, and shoulder.Main results:We found that electrode arrays that were located more medially recorded significantly more activity during attempted proximal arm movements (elbow, shoulder) than did lateral arrays, which captured more activity related to attempted distal arm movements (hand, wrist). We also evaluated the relative contribution from the two arrays implanted in each participant to decoding accuracy during calibration of an iBCI decoder for translation and grasping tasks. For both task types, imagery strategy (e.g. reaching vs wrist movements) had a significant impact on the relative contributions of each array to decoding. Overall, we found some evidence of broad tuning to arm and hand movements; however, there was a clear bias in the amount of information accessible about each movement type in spatially distinct areas of cortex.Significance:These results demonstrate that classical concepts of somatotopy can have real consequences for iBCI use, and highlight the importance of considering somatotopy when planning iBCI implantation.
Collapse
Affiliation(s)
- N G Kunigk
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
- Center for the Neural Basis of Cognition, Pittsburgh, PA, United States of America
| | - H R Schone
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - C Gontier
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - W Hockeimer
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - A F Tortolani
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, United States of America
| | - N G Hatsopoulos
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, United States of America
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, United States of America
- Neuroscience Institute, University of Chicago, Chicago, IL, United States of America
| | - J E Downey
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, United States of America
| | - S M Chase
- Center for the Neural Basis of Cognition, Pittsburgh, PA, United States of America
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, United States of America
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, United States of America
| | - M L Boninger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - B D Dekleva
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, United States of America
- Center for the Neural Basis of Cognition, Pittsburgh, PA, United States of America
| | - J L Collinger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, United States of America
- Center for the Neural Basis of Cognition, Pittsburgh, PA, United States of America
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, United States of America
| |
Collapse
|
5
|
Giesbrecht B, Bullock T, Garrett J. Physically activated modes of attentional control. Trends Cogn Sci 2025; 29:295-307. [PMID: 39690081 DOI: 10.1016/j.tics.2024.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Revised: 11/14/2024] [Accepted: 11/18/2024] [Indexed: 12/19/2024]
Abstract
As we navigate through the day, our attentional control processes are constantly challenged by changing sensory information, goals, expectations, and motivations. At the same time, our bodies and brains are impacted by changes in global physiological state that can influence attentional processes. Based on converging lines of evidence from brain recordings in physically active humans and nonhumans, we propose a new framework incorporating at least two physically activated modes of attentional control in humans: altered gain control and differential neuromodulation of control networks. We discuss the implications of this framework for understanding a broader range of states and cognitive functions studied both in the laboratory and in the wild.
Collapse
Affiliation(s)
- Barry Giesbrecht
- Psychological and Brain Sciences, University of California, Santa Barbara, CA 93106, USA; Institute for Collaborative Biotechnologies, University of California, Santa Barbara, CA 93106, USA.
| | - Tom Bullock
- Psychological and Brain Sciences, University of California, Santa Barbara, CA 93106, USA; Institute for Collaborative Biotechnologies, University of California, Santa Barbara, CA 93106, USA
| | - Jordan Garrett
- Psychological and Brain Sciences, University of California, Santa Barbara, CA 93106, USA; Institute for Collaborative Biotechnologies, University of California, Santa Barbara, CA 93106, USA
| |
Collapse
|
6
|
Zhang A, Geisler WS. Optimal Visual Search with Highly Heuristic Decision Rules. ARXIV 2025:arXiv:2409.12124v3. [PMID: 39398220 PMCID: PMC11468152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 10/15/2024]
Abstract
Visual search is a fundamental natural task for humans and other animals. We investigated the decision processes humans use in covert (single fixation) search with briefly presented displays having well-separated potential target locations. Performance was compared with the Bayesian-optimal decision process under the assumption that the information from the different potential target locations is statistically independent. Surprisingly, humans performed slightly better than optimal, despite humans' substantial loss of sensitivity in the fovea ("foveal neglect"), and the implausibility of the human brain replicating the optimal computations. We show that three factors can quantitatively explain these seemingly paradoxical results. Most importantly, simple and fixed heuristic decision rules reach near optimal search performance. Secondly, foveal neglect primarily affects only the central potential target location. Finally, spatially correlated neural noise can cause search performance to exceed that predicted for independent noise. These findings have broad implications for understanding visual search tasks and other identification tasks in humans and other animals.
Collapse
|
7
|
Kang I, Talluri BC, Yates JL, Niell CM, Nienborg H. Is the impact of spontaneous movements on early visual cortex species specific? Trends Neurosci 2025; 48:7-21. [PMID: 39701910 PMCID: PMC11741931 DOI: 10.1016/j.tins.2024.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2024] [Revised: 10/22/2024] [Accepted: 11/20/2024] [Indexed: 12/21/2024]
Abstract
Recent studies in non-human primates do not find pronounced signals related to the animal's own body movements in the responses of neurons in the visual cortex. This is notable because such pronounced signals have been widely observed in the visual cortex of mice. Here, we discuss factors that may contribute to the differences observed between species, such as state, slow neural drift, eccentricity, and changes in retinal input. The interpretation of movement-related signals in the visual cortex also exemplifies the challenge of identifying the sources of correlated variables. Dissecting these sources is central for understanding the functional roles of movement-related signals. We suggest a functional classification of the possible sources, aimed at facilitating cross-species comparative approaches to studying the neural mechanisms of vision during natural behavior.
Collapse
Affiliation(s)
- Incheol Kang
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA
| | - Bharath Chandra Talluri
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA
| | - Jacob L Yates
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA
| | - Cristopher M Niell
- Department of Biology and Institute of Neuroscience, University of Oregon, Eugene, OR, USA
| | - Hendrikje Nienborg
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|
8
|
Willbrand EH, Maboudian SA, Elliott MV, Kellerman GM, Johnson SL, Weiner KS. Variable Presence of an Evolutionarily New Brain Structure Is Related to Trait Impulsivity. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2024:S2451-9022(24)00352-5. [PMID: 39613159 DOI: 10.1016/j.bpsc.2024.11.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/16/2024] [Revised: 10/21/2024] [Accepted: 11/19/2024] [Indexed: 12/01/2024]
Abstract
BACKGROUND Impulsivity is a multidimensional construct reflecting poor constraint over one's behaviors. Clinical psychology research has identified separable impulsivity dimensions that are each unique transdiagnostic indicators for psychopathology. However, despite this apparent clinical importance, the shared and unique neuroanatomical correlates of these factors remain largely unknown. Concomitantly, neuroimaging research has identified variably present human brain structures implicated in cognition and disorder: the folds (sulci) of the cerebral cortex located in the latest-developing and most evolutionarily expanded hominoid-specific association cortices. METHODS We tethered these 2 fields to test whether variability in one such structure in the anterior cingulate cortex (ACC)-the paracingulate sulcus (PCGS)-was related to individual differences in trait impulsivity. A total of 120 adult participants with internalizing or externalizing psychopathology completed a magnetic resonance imaging scan and the Three-Factor Impulsivity Index. Using precision imaging techniques, we manually identified the PCGS, when present, and acquired quantitative folding metrics (PCGS length and ACC local gyrification index). RESULTS Neuroanatomical-behavioral analyses revealed that participants with leftward or symmetrical PCGS patterns had greater severity of Lack of Follow Through (LFT)-which captures inattention and lack of perseverance-than those with rightward asymmetry. Neuroanatomical-functional analyses identified that the PCGS colocalized with a focal locus found in a neuroimaging meta-analysis on a feature underlying LFT. Neither quantitative folding metric related to any impulsivity dimension. CONCLUSIONS This study advances understanding of the neuroanatomical correlates of impulsivity and establishes the notion that the topographical organization of distinct, hominoid-specific cortical expanses underlies separable impulsivity dimensions with robust, transdiagnostic implications for psychopathology.
Collapse
Affiliation(s)
- Ethan H Willbrand
- Medical Scientist Training Program, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin
| | - Samira A Maboudian
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California; Department of Neuroscience, University of California, Berkeley, Berkeley, California
| | - Matthew V Elliott
- Department of Psychology, University of California, Berkeley, Berkeley, California
| | - Gabby M Kellerman
- Department of Psychology, University of California, Berkeley, Berkeley, California
| | - Sheri L Johnson
- Department of Psychology, University of California, Berkeley, Berkeley, California
| | - Kevin S Weiner
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California; Department of Neuroscience, University of California, Berkeley, Berkeley, California; Department of Psychology, University of California, Berkeley, Berkeley, California.
| |
Collapse
|
9
|
Willbrand EH, Maboudian SA, Elliott MV, Kellerman GM, Johnson SL, Weiner KS. Variable Presence of an Evolutionarily New Brain Structure is Related to Trait Impulsivity. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.10.23.619912. [PMID: 39484399 PMCID: PMC11527008 DOI: 10.1101/2024.10.23.619912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/03/2024]
Abstract
Background Impulsivity is a multidimensional construct reflecting poor constraint over one's behaviors. Clinical psychology research identifies separable impulsivity dimensions that are each unique transdiagnostic indicators for psychopathology. Yet, despite this apparent clinical importance, the shared and unique neuroanatomical correlates of these factors remain largely unknown. Concomitantly, neuroimaging research identifies variably present human brain structures implicated in cognition and disorder: the folds (sulci) of the cerebral cortex located in the latest developing and most evolutionarily expanded hominoid-specific association cortices. Methods We tethered these two fields to test whether variability in one such structure in anterior cingulate cortex (ACC)-the paracingulate sulcus (PCGS)-was related to individual differences in trait impulsivity. 120 adult participants with internalizing or externalizing psychopathology completed a magnetic resonance imaging scan and the Three-Factor Impulsivity Index. Using precision imaging techniques, we manually identified the PCGS, when present, and acquired quantitative folding metrics (PCGS length and ACC local gyrification index). Results Neuroanatomical-behavioral analyses revealed that participants with leftward or symmetrical PCGS patterns had greater severity of Lack of Follow Through (LFT)-which captures inattention and lack of perseverance-than those with rightward asymmetry. Neuroanatomical-functional analyses identified that the PCGS co-localized with a focal locus found in a neuroimaging meta-analysis on a feature underlying LFT. Both quantitative folding metrics did not relate to any impulsivity dimension. Conclusions This study advances understanding of the neuroanatomical correlates of impulsivity and establishes the notion that the topographical organization of distinct, hominoid-specific cortical expanses underlie separable impulsivity dimensions with robust, transdiagnostic implications for psychopathology.
Collapse
Affiliation(s)
- Ethan H. Willbrand
- Medical Scientist Training Program, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI USA
| | - Samira A. Maboudian
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
- Department of Neuroscience, University of California, Berkeley, Berkeley, CA, USA
| | - Matthew V. Elliott
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| | - Gabby M. Kellerman
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| | - Sheri L. Johnson
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| | - Kevin S. Weiner
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
- Department of Neuroscience, University of California, Berkeley, Berkeley, CA, USA
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| |
Collapse
|
10
|
Stan PL, Smith MA. Recent Visual Experience Reshapes V4 Neuronal Activity and Improves Perceptual Performance. J Neurosci 2024; 44:e1764232024. [PMID: 39187380 PMCID: PMC11466072 DOI: 10.1523/jneurosci.1764-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 07/10/2024] [Accepted: 08/13/2024] [Indexed: 08/28/2024] Open
Abstract
Recent visual experience heavily influences our visual perception, but how neuronal activity is reshaped to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while two male rhesus macaque monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in the mid-level visual cortex.
Collapse
Affiliation(s)
- Patricia L Stan
- Center for Neuroscience, University of Pittsburgh, Pittsburgh, Pennsylvania 15260
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213
- Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, Pennsylvania 15213
| | - Matthew A Smith
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213
- Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, Pennsylvania 15213
| |
Collapse
|
11
|
Vloeberghs R, Urai AE, Desender K, Linderman SW. A Bayesian Hierarchical Model of Trial-To-Trial Fluctuations in Decision Criterion. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.30.605869. [PMID: 39211219 PMCID: PMC11361103 DOI: 10.1101/2024.07.30.605869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Abstract
Classical decision models assume that the parameters giving rise to choice behavior are stable, yet emerging research suggests these parameters may fluctuate over time. Such fluctuations, observed in neural activity and behavioral strategies, have significant implications for understanding decision-making processes. However, empirical studies on fluctuating human decision-making strategies have been limited due to the extensive data requirements for estimating these fluctuations. Here, we introduce hMFC (Hierarchical Model for Fluctuations in Criterion), a Bayesian framework designed to estimate slow fluctuations in the decision criterion from limited data. We first showcase the importance of considering fluctuations in decision criterion: incorrectly assuming a stable criterion gives rise to apparent history effects and underestimates perceptual sensitivity. We then present a hierarchical estimation procedure capable of reliably recovering the underlying state of the fluctuating decision criterion with as few as 500 trials per participant, offering a robust tool for researchers with typical human datasets. Critically, hMFC does not only accurately recover the state of the underlying decision criterion, it also effectively deals with the confounds caused by criterion fluctuations. Lastly, we provide code and a comprehensive demo at www.github.com/robinvloeberghs/hMFC to enable widespread application of hMFC in decision-making research.
Collapse
Affiliation(s)
| | - Anne E. Urai
- Cognitive Psychology, Leiden University, The Netherlands
| | | | - Scott W. Linderman
- Department of Statistics and Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| |
Collapse
|
12
|
Monk T, Dennler N, Ralph N, Rastogi S, Afshar S, Urbizagastegui P, Jarvis R, van Schaik A, Adamatzky A. Electrical Signaling Beyond Neurons. Neural Comput 2024; 36:1939-2029. [PMID: 39141803 DOI: 10.1162/neco_a_01696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 05/21/2024] [Indexed: 08/16/2024]
Abstract
Neural action potentials (APs) are difficult to interpret as signal encoders and/or computational primitives. Their relationships with stimuli and behaviors are obscured by the staggering complexity of nervous systems themselves. We can reduce this complexity by observing that "simpler" neuron-less organisms also transduce stimuli into transient electrical pulses that affect their behaviors. Without a complicated nervous system, APs are often easier to understand as signal/response mechanisms. We review examples of nonneural stimulus transductions in domains of life largely neglected by theoretical neuroscience: bacteria, protozoans, plants, fungi, and neuron-less animals. We report properties of those electrical signals-for example, amplitudes, durations, ionic bases, refractory periods, and particularly their ecological purposes. We compare those properties with those of neurons to infer the tasks and selection pressures that neurons satisfy. Throughout the tree of life, nonneural stimulus transductions time behavioral responses to environmental changes. Nonneural organisms represent the presence or absence of a stimulus with the presence or absence of an electrical signal. Their transductions usually exhibit high sensitivity and specificity to a stimulus, but are often slow compared to neurons. Neurons appear to be sacrificing the specificity of their stimulus transductions for sensitivity and speed. We interpret cellular stimulus transductions as a cell's assertion that it detected something important at that moment in time. In particular, we consider neural APs as fast but noisy detection assertions. We infer that a principal goal of nervous systems is to detect extremely weak signals from noisy sensory spikes under enormous time pressure. We discuss neural computation proposals that address this goal by casting neurons as devices that implement online, analog, probabilistic computations with their membrane potentials. Those proposals imply a measurable relationship between afferent neural spiking statistics and efferent neural membrane electrophysiology.
Collapse
Affiliation(s)
- Travis Monk
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
| | - Nik Dennler
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
- Biocomputation Group, University of Hertfordshire, Hatfield, Hertfordshire AL10 9AB, U.K.
| | - Nicholas Ralph
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
| | - Shavika Rastogi
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
- Biocomputation Group, University of Hertfordshire, Hatfield, Hertfordshire AL10 9AB, U.K.
| | - Saeed Afshar
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
| | - Pablo Urbizagastegui
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
| | - Russell Jarvis
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
| | - André van Schaik
- International Centre for Neuromorphic Systems, MARCS Institute, Western Sydney University, Sydney, NSW 2747, Australia
| | - Andrew Adamatzky
- Unconventional Computing Laboratory, University of the West of England, Bristol BS16 1QY, U.K.
| |
Collapse
|
13
|
Tian GJ, Zhu O, Shirhatti V, Greenspon CM, Downey JE, Freedman DJ, Doiron B. Neuronal firing rate diversity lowers the dimension of population covariability. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.08.30.610535. [PMID: 39257801 PMCID: PMC11383671 DOI: 10.1101/2024.08.30.610535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2024]
Abstract
Populations of neurons produce activity with two central features. First, neuronal responses are very diverse - specific stimuli or behaviors prompt some neurons to emit many action potentials, while other neurons remain relatively silent. Second, the trial-to-trial fluctuations of neuronal response occupy a low dimensional space, owing to significant correlations between the activity of neurons. These two features define the quality of neuronal representation. We link these two aspects of population response using a recurrent circuit model and derive the following relation: the more diverse the firing rates of neurons in a population, the lower the effective dimension of population trial-to-trial covariability. This surprising prediction is tested and validated using simultaneously recorded neuronal populations from numerous brain areas in mice, non-human primates, and in the motor cortex of human participants. Using our relation we present a theory where a more diverse neuronal code leads to better fine discrimination performance from population activity. In line with this theory, we show that neuronal populations across the brain exhibit both more diverse mean responses and lower-dimensional fluctuations when the brain is in more heightened states of information processing. In sum, we present a key organizational principle of neuronal population response that is widely observed across the nervous system and acts to synergistically improve population representation.
Collapse
|
14
|
Heller CR, Hamersky GR, David SV. Task-specific invariant representation in auditory cortex. eLife 2024; 12:RP89936. [PMID: 39172655 PMCID: PMC11341091 DOI: 10.7554/elife.89936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/24/2024] Open
Abstract
Categorical sensory representations are critical for many behaviors, including speech perception. In the auditory system, categorical information is thought to arise hierarchically, becoming increasingly prominent in higher-order cortical regions. The neural mechanisms that support this robust and flexible computation remain poorly understood. Here, we studied sound representations in the ferret primary and non-primary auditory cortex while animals engaged in a challenging sound discrimination task. Population-level decoding of simultaneously recorded single neurons revealed that task engagement caused categorical sound representations to emerge in non-primary auditory cortex. In primary auditory cortex, task engagement caused a general enhancement of sound decoding that was not specific to task-relevant categories. These findings are consistent with mixed selectivity models of neural disentanglement, in which early sensory regions build an overcomplete representation of the world and allow neurons in downstream brain regions to flexibly and selectively read out behaviorally relevant, categorical information.
Collapse
Affiliation(s)
- Charles R Heller
- Neuroscience Graduate Program, Oregon Health and Science UniversityPortlandUnited States
| | - Gregory R Hamersky
- Neuroscience Graduate Program, Oregon Health and Science UniversityPortlandUnited States
| | - Stephen V David
- Otolaryngology, Oregon Health & Science UniversityPortlandUnited States
| |
Collapse
|
15
|
Stan PL, Smith MA. Recent visual experience reshapes V4 neuronal activity and improves perceptual performance. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.27.555026. [PMID: 37693510 PMCID: PMC10491105 DOI: 10.1101/2023.08.27.555026] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2023]
Abstract
Recent visual experience heavily influences our visual perception, but how this is mediated by the reshaping of neuronal activity to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in mid-level visual cortex.
Collapse
|
16
|
Wirt RA, Soluoku TK, Ricci RM, Seamans JK, Hyman JM. Temporal information in the anterior cingulate cortex relates to accumulated experiences. Curr Biol 2024; 34:2921-2931.e3. [PMID: 38908372 DOI: 10.1016/j.cub.2024.05.045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Revised: 04/02/2024] [Accepted: 05/23/2024] [Indexed: 06/24/2024]
Abstract
Anterior cingulate cortex (ACC) activity is important for operations that require the ability to integrate multiple experiences over time, such as rule learning, cognitive flexibility, working memory, and long-term memory recall. To shed light on this, we analyzed neuronal activity while rats repeated the same behaviors during hour-long sessions to investigate how activity changed over time. We recorded neuronal ensembles as rats performed a decision-free operant task with varying reward likelihoods at three different response ports (n = 5). Neuronal state space analysis revealed that each repetition of a behavior was distinct, with more recent behaviors more similar than those further apart in time. ACC activity was dominated by a slow, gradual change in low-dimensional representations of neural state space aligning with the pace of behavior. Temporal progression, or drift, was apparent on the top principal component for every session and was driven by the accumulation of experiences and not an internal clock. Notably, these signals were consistent across subjects, allowing us to accurately predict trial numbers based on a model trained on data from a different animal. We observed that non-continuous ramping firing rates over extended durations (tens of minutes) drove the low-dimensional ensemble representations. 40% of ACC neurons' firing ramped over a range of trial lengths and combinations of shorter duration ramping neurons created ensembles that tracked longer durations. These findings provide valuable insights into how the ACC, at an ensemble level, conveys temporal information by reflecting the accumulation of experiences over extended periods.
Collapse
Affiliation(s)
- Ryan A Wirt
- University of Nevada, Las Vegas, Interdisciplinary Program in Neuroscience, Las Vegas, NV 89154-1003, USA
| | - Talha K Soluoku
- University of Nevada, Las Vegas, Interdisciplinary Program in Neuroscience, Las Vegas, NV 89154-1003, USA
| | - Ryan M Ricci
- University of Nevada, Las Vegas, College of Medical Sciences, Las Vegas, NV 89154-1003, USA
| | - Jeremy K Seamans
- University of British Columbia, Department of Psychiatry, 2255 Wesbrook Mall, Vancouver, BC V6T 2A1, Canada
| | - James M Hyman
- University of Nevada, Las Vegas, Interdisciplinary Program in Neuroscience, Las Vegas, NV 89154-1003, USA; University of Nevada, Las Vegas, Department of Psychology, Las Vegas, NV 89154-1003, USA.
| |
Collapse
|
17
|
Lindsay AJ, Gallello I, Caracheo BF, Seamans JK. Reconfiguration of Behavioral Signals in the Anterior Cingulate Cortex Based on Emotional State. J Neurosci 2024; 44:e1670232024. [PMID: 38637155 PMCID: PMC11154859 DOI: 10.1523/jneurosci.1670-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 03/28/2024] [Accepted: 04/03/2024] [Indexed: 04/20/2024] Open
Abstract
Behaviors and their execution depend on the context and emotional state in which they are performed. The contextual modulation of behavior likely relies on regions such as the anterior cingulate cortex (ACC) that multiplex information about emotional/autonomic states and behaviors. The objective of the present study was to understand how the representations of behaviors by ACC neurons become modified when performed in different emotional states. A pipeline of machine learning techniques was developed to categorize and classify complex, spontaneous behaviors in male rats from the video. This pipeline, termed Hierarchical Unsupervised Behavioural Discovery Tool (HUB-DT), discovered a range of statistically separable behaviors during a task in which motivationally significant outcomes were delivered in blocks of trials that created three unique "emotional contexts." HUB-DT was capable of detecting behaviors specific to each emotional context and was able to identify and segregate the portions of a neural signal related to a behavior and to emotional context. Overall, ∼10× as many neurons responded to behaviors in a contextually dependent versus a fixed manner, highlighting the extreme impact of emotional state on representations of behaviors that were precisely defined based on detailed analyses of limb kinematics. This type of modulation may be a key mechanism that allows the ACC to modify the behavioral output based on emotional states and contextual demands.
Collapse
Affiliation(s)
- Adrian J Lindsay
- Department of Psychiatry, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T2B5, Canada
| | - Isabella Gallello
- Department of Psychiatry, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T2B5, Canada
| | - Barak F Caracheo
- Department of Psychiatry, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T2B5, Canada
| | - Jeremy K Seamans
- Department of Psychiatry, Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T2B5, Canada
| |
Collapse
|
18
|
Johnston R, Smith MA. Brain-wide arousal signals are segregated from movement planning in the superior colliculus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.26.591284. [PMID: 38746466 PMCID: PMC11092505 DOI: 10.1101/2024.04.26.591284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
The superior colliculus (SC) is traditionally considered a brain region that functions as an interface between processing visual inputs and generating eye movement outputs. Although its role as a primary reflex center is thought to be conserved across vertebrate species, evidence suggests that the SC has evolved to support higher-order cognitive functions including spatial attention. When it comes to oculomotor areas such as the SC, it is critical that high precision fixation and eye movements are maintained even in the presence of signals related to ongoing changes in cognition and brain state, both of which have the potential to interfere with eye position encoding and movement generation. In this study, we recorded spiking responses of neuronal populations in the SC while monkeys performed a memory-guided saccade task and found that the activity of some of the neurons fluctuated over tens of minutes. By leveraging the statistical power afforded by high-dimensional neuronal recordings, we were able to identify a low-dimensional pattern of activity that was correlated with the subjects' arousal levels. Importantly, we found that the spiking responses of deep-layer SC neurons were less correlated with this brain-wide arousal signal, and that neural activity associated with changes in pupil size and saccade tuning did not overlap in population activity space with movement initiation signals. Taken together, these findings provide a framework for understanding how signals related to cognition and arousal can be embedded in the population activity of oculomotor structures without compromising the fidelity of the motor output.
Collapse
Affiliation(s)
- Richard Johnston
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, USA
| | - Matthew A. Smith
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, USA
| |
Collapse
|
19
|
Losey DM, Hennig JA, Oby ER, Golub MD, Sadtler PT, Quick KM, Ryu SI, Tyler-Kabara EC, Batista AP, Yu BM, Chase SM. Learning leaves a memory trace in motor cortex. Curr Biol 2024; 34:1519-1531.e4. [PMID: 38531360 PMCID: PMC11097210 DOI: 10.1016/j.cub.2024.03.003] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Revised: 12/06/2023] [Accepted: 03/04/2024] [Indexed: 03/28/2024]
Abstract
How are we able to learn new behaviors without disrupting previously learned ones? To understand how the brain achieves this, we used a brain-computer interface (BCI) learning paradigm, which enables us to detect the presence of a memory of one behavior while performing another. We found that learning to use a new BCI map altered the neural activity that monkeys produced when they returned to using a familiar BCI map in a way that was specific to the learning experience. That is, learning left a "memory trace" in the primary motor cortex. This memory trace coexisted with proficient performance under the familiar map, primarily by altering neural activity in dimensions that did not impact behavior. Forming memory traces might be how the brain is able to provide for the joint learning of multiple behaviors without interference.
Collapse
Affiliation(s)
- Darby M Losey
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA; Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Jay A Hennig
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA; Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Emily R Oby
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Matthew D Golub
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA; Department of Electrical Engineering, Stanford University, Stanford, CA 94305, USA; Paul G. Allen School of Computer Science & Engineering, University of Washington, Seattle, WA 98195, USA
| | - Patrick T Sadtler
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Kristin M Quick
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Stephen I Ryu
- Department of Electrical Engineering, Stanford University, Stanford, CA 94305, USA; Department of Neurosurgery, Palo Alto Medical Foundation, Palo Alto, CA 94301, USA
| | - Elizabeth C Tyler-Kabara
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA 15213, USA; Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, PA 15213, USA; Department of Neurosurgery, Dell Medical School, University of Texas at Austin, Austin, TX 78712, USA
| | - Aaron P Batista
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| | - Byron M Yu
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA; Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA; Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
| | - Steven M Chase
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA; Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA; Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
| |
Collapse
|
20
|
Wang Q, Chen G, Wang X, Yang R, Luo L, Ding H, Teng P, Wang J, He L, Ren J, Zhao M, Luan G, Fang F. Prestimulation neuronal activity predicts visual awareness of phosphene elicited by intracranial electrical stimulation. Brain Stimul 2024; 17:335-338. [PMID: 38447772 DOI: 10.1016/j.brs.2024.03.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 03/03/2024] [Indexed: 03/08/2024] Open
Affiliation(s)
- Qian Wang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China; IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China; National Key Laboratory of General Artificial Intelligence, Peking University, Beijing 100871, China.
| | - Guanpeng Chen
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China; IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China; Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China
| | - Xiongfei Wang
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China; Beijing Key Laboratory of Epilepsy, Epilepsy Center, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Ruolin Yang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China; IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China; Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China
| | - Lu Luo
- School of Psychology, Beijing Sport University, Beijing 100084, China
| | - Haoran Ding
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China; Beijing Key Laboratory of Epilepsy, Epilepsy Center, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Pengfei Teng
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Jing Wang
- Epilepsy Center, Kunming Sanbo Brain Hospital, Kunming 650100 China
| | - Leijie He
- Department of Neurology, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Jie Ren
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China; Department of Neurology, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Meng Zhao
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Guoming Luan
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China; Beijing Key Laboratory of Epilepsy, Epilepsy Center, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Fang Fang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China; IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China; Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China.
| |
Collapse
|
21
|
Breault MS, Sacré P, Fitzgerald ZB, Gale JT, Cullen KE, González-Martínez JA, Sarma SV. Internal states as a source of subject-dependent movement variability are represented by large-scale brain networks. Nat Commun 2023; 14:7837. [PMID: 38030611 PMCID: PMC10687170 DOI: 10.1038/s41467-023-43257-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 11/03/2023] [Indexed: 12/01/2023] Open
Abstract
Humans' ability to adapt and learn relies on reflecting on past performance. These experiences form latent representations called internal states that induce movement variability that improves how we interact with our environment. Our study uncovered temporal dynamics and neural substrates of two states from ten subjects implanted with intracranial depth electrodes while they performed a goal-directed motor task with physical perturbations. We identified two internal states using state-space models: one tracking past errors and the other past perturbations. These states influenced reaction times and speed errors, revealing how subjects strategize from trial history. Using local field potentials from over 100 brain regions, we found large-scale brain networks such as the dorsal attention and default mode network modulate visuospatial attention based on recent performance and environmental feedback. Notably, these networks were more prominent in higher-performing subjects, emphasizing their role in improving motor performance by regulating movement variability through internal states.
Collapse
Affiliation(s)
- Macauley Smith Breault
- Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| | - Pierre Sacré
- Department of Electrical Engineering and Computer Science, School of Engineering, University of Liège, Liège, Belgium
| | - Zachary B Fitzgerald
- Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | | | - Kathleen E Cullen
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
| | | | - Sridevi V Sarma
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
22
|
Cowley BR, Stan PL, Pillow JW, Smith MA. Compact deep neural network models of visual cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.22.568315. [PMID: 38045255 PMCID: PMC10690296 DOI: 10.1101/2023.11.22.568315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2023]
Abstract
A powerful approach to understanding the computations carried out in visual cortex is to develop models that predict neural responses to arbitrary images. Deep neural network (DNN) models have worked remarkably well at predicting neural responses [1, 2, 3], yet their underlying computations remain buried in millions of parameters. Have we simply replaced one complicated system in vivo with another in silico? Here, we train a data-driven deep ensemble model that predicts macaque V4 responses ~50% more accurately than currently-used task-driven DNN models. We then compress this deep ensemble to identify compact models that have 5,000x fewer parameters yet equivalent accuracy as the deep ensemble. We verified that the stimulus preferences of the compact models matched those of the real V4 neurons by measuring V4 responses to both 'maximizing' and adversarial images generated using compact models. We then analyzed the inner workings of the compact models and discovered a common circuit motif: Compact models share a similar set of filters in early stages of processing but then specialize by heavily consolidating this shared representation with a precise readout. This suggests that a V4 neuron's stimulus preference is determined entirely by its consolidation step. To demonstrate this, we investigated the compression step of a dot-detecting compact model and found a set of simple computations that may be carried out by dot-selective V4 neurons. Overall, our work demonstrates that the DNN models currently used in computational neuroscience are needlessly large; our approach provides a new way forward for obtaining explainable, high-accuracy models of visual cortical neurons.
Collapse
Affiliation(s)
- Benjamin R. Cowley
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Patricia L. Stan
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
| | - Jonathan W. Pillow
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Matthew A. Smith
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
| |
Collapse
|
23
|
Safaie M, Chang JC, Park J, Miller LE, Dudman JT, Perich MG, Gallego JA. Preserved neural dynamics across animals performing similar behaviour. Nature 2023; 623:765-771. [PMID: 37938772 PMCID: PMC10665198 DOI: 10.1038/s41586-023-06714-0] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 10/04/2023] [Indexed: 11/09/2023]
Abstract
Animals of the same species exhibit similar behaviours that are advantageously adapted to their body and environment. These behaviours are shaped at the species level by selection pressures over evolutionary timescales. Yet, it remains unclear how these common behavioural adaptations emerge from the idiosyncratic neural circuitry of each individual. The overall organization of neural circuits is preserved across individuals1 because of their common evolutionarily specified developmental programme2-4. Such organization at the circuit level may constrain neural activity5-8, leading to low-dimensional latent dynamics across the neural population9-11. Accordingly, here we suggested that the shared circuit-level constraints within a species would lead to suitably preserved latent dynamics across individuals. We analysed recordings of neural populations from monkey and mouse motor cortex to demonstrate that neural dynamics in individuals from the same species are surprisingly preserved when they perform similar behaviour. Neural population dynamics were also preserved when animals consciously planned future movements without overt behaviour12 and enabled the decoding of planned and ongoing movement across different individuals. Furthermore, we found that preserved neural dynamics extend beyond cortical regions to the dorsal striatum, an evolutionarily older structure13,14. Finally, we used neural network models to demonstrate that behavioural similarity is necessary but not sufficient for this preservation. We posit that these emergent dynamics result from evolutionary constraints on brain development and thus reflect fundamental properties of the neural basis of behaviour.
Collapse
Affiliation(s)
- Mostafa Safaie
- Department of Bioengineering, Imperial College London, London, UK
| | - Joanna C Chang
- Department of Bioengineering, Imperial College London, London, UK
| | - Junchol Park
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, TX, USA
| | - Lee E Miller
- Departments of Physiology, Biomedical Engineering and Physical Medicine and Rehabilitation, Northwestern University and Shirley Ryan Ability Lab, Chicago, IL, USA
| | - Joshua T Dudman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, TX, USA
| | - Matthew G Perich
- Département de Neurosciences, Faculté de Médecine, Université de Montréal, Montreal, Quebec, Canada.
- Mila, Quebec Artificial Intelligence Institute, Montreal, Quebec, Canada.
| | - Juan A Gallego
- Department of Bioengineering, Imperial College London, London, UK.
| |
Collapse
|
24
|
Talluri BC, Kang I, Lazere A, Quinn KR, Kaliss N, Yates JL, Butts DA, Nienborg H. Activity in primate visual cortex is minimally driven by spontaneous movements. Nat Neurosci 2023; 26:1953-1959. [PMID: 37828227 PMCID: PMC10620084 DOI: 10.1038/s41593-023-01459-5] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 09/08/2023] [Indexed: 10/14/2023]
Abstract
Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (Macaca mulatta), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals' own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies.
Collapse
Affiliation(s)
- Bharath Chandra Talluri
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA
| | - Incheol Kang
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA
| | - Adam Lazere
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA
| | - Katrina R Quinn
- Center for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
| | - Nicholas Kaliss
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA
| | - Jacob L Yates
- Herbert Wertheim School of Optometry & Vision Science, University of California, Berkeley, Berkeley, CA, USA
- Department of Biology and Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD, USA
| | - Daniel A Butts
- Department of Biology and Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD, USA
| | - Hendrikje Nienborg
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|
25
|
Li S, Rosen MC, Chang S, David S, Freedman DJ. Alterations of neural activity in the prefrontal cortex associated with deficits in working memory performance. Front Behav Neurosci 2023; 17:1213435. [PMID: 37915531 PMCID: PMC10616307 DOI: 10.3389/fnbeh.2023.1213435] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 08/31/2023] [Indexed: 11/03/2023] Open
Abstract
Working memory (WM), a core cognitive function, enables the temporary holding and manipulation of information in mind to support ongoing behavior. Neurophysiological recordings conducted in nonhuman primates have revealed neural correlates of this process in a network of higher-order cortical regions, particularly the prefrontal cortex (PFC). Here, we review the circuit mechanisms and functional importance of WM-related activity in these areas. Recent neurophysiological data indicates that the absence of these neural correlates at different stages of WM is accompanied by distinct behavioral deficits, which are characteristic of various disease states/normal aging and which we review here. Finally, we discuss emerging evidence of electrical stimulation ameliorating these WM deficits in both humans and non-human primates. These results are important for a basic understanding of the neural mechanisms supporting WM, as well as for translational efforts to developing therapies capable of enhancing healthy WM ability or restoring WM from dysfunction.
Collapse
Affiliation(s)
- Sihai Li
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - Matthew C. Rosen
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - Suha Chang
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - Samuel David
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - David J. Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
- Neuroscience Institute, The University of Chicago, Chicago, IL, United States
| |
Collapse
|
26
|
Jiang Y, He S, Zhang J. Different roles of response covariability and its attentional modulation in the sensory cortex and posterior parietal cortex. Proc Natl Acad Sci U S A 2023; 120:e2216942120. [PMID: 37812698 PMCID: PMC10589615 DOI: 10.1073/pnas.2216942120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 08/16/2023] [Indexed: 10/11/2023] Open
Abstract
The covariability of neural responses in the neuron population is highly relevant to the information encoding. Cognitive processes, such as attention, are found to modulate the covariability in the visual cortex to improve information encoding, suggesting the computational advantage of covariability modulation in the neural system. However, is the covariability modulation a general mechanism for enhanced information encoding throughout the information processing pathway, or only adopted in certain processing stages, depending on the property of neural representation? Here, with ultrahigh-field MRI, we examined the covariability, which was estimated by noise correlation, in different attention states in the early visual cortex and posterior parietal cortex (PPC) of the human brain, and its relationship to the quality of information encoding. Our results showed that while attention decreased the covariability to improve the stimulus encoding in the early visual cortex, covariability modulation was not observed in the PPC, where covariability had little impact on information encoding. Further, attention promoted the information flow between the early visual cortex and PPC, with an apparent emphasis on a flow from high- to low-dimensional representations, suggesting the existence of a reduction in the dimensionality of neural representation from the early visual cortex to PPC. Finally, the neural response patterns in the PPC could predict the amplitudes of covariability change in the early visual cortex, indicating a top-down control from the PPC to early visual cortex. Our findings reveal the specific roles of the sensory cortex and PPC during attentional modulation of covariability, determined by the complexity and fidelity of the neural representation in each cortical region.
Collapse
Affiliation(s)
- Yong Jiang
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing100101, China
| | - Sheng He
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing100101, China
- Institute of AI, Hefei Comprehensive National Science Center, Hefei230088, China
- University of Chinese Academy of Sciences, Beijing100049, China
| | - Jiedong Zhang
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing100101, China
- University of Chinese Academy of Sciences, Beijing100049, China
| |
Collapse
|
27
|
Boucher PO, Wang T, Carceroni L, Kane G, Shenoy KV, Chandrasekaran C. Initial conditions combine with sensory evidence to induce decision-related dynamics in premotor cortex. Nat Commun 2023; 14:6510. [PMID: 37845221 PMCID: PMC10579235 DOI: 10.1038/s41467-023-41752-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Accepted: 09/18/2023] [Indexed: 10/18/2023] Open
Abstract
We used a dynamical systems perspective to understand decision-related neural activity, a fundamentally unresolved problem. This perspective posits that time-varying neural activity is described by a state equation with an initial condition and evolves in time by combining at each time step, recurrent activity and inputs. We hypothesized various dynamical mechanisms of decisions, simulated them in models to derive predictions, and evaluated these predictions by examining firing rates of neurons in the dorsal premotor cortex (PMd) of monkeys performing a perceptual decision-making task. Prestimulus neural activity (i.e., the initial condition) predicted poststimulus neural trajectories, covaried with RT and the outcome of the previous trial, but not with choice. Poststimulus dynamics depended on both the sensory evidence and initial condition, with easier stimuli and fast initial conditions leading to the fastest choice-related dynamics. Together, these results suggest that initial conditions combine with sensory evidence to induce decision-related dynamics in PMd.
Collapse
Affiliation(s)
- Pierre O Boucher
- Department of Biomedical Engineering, Boston University, Boston, 02115, MA, USA
| | - Tian Wang
- Department of Biomedical Engineering, Boston University, Boston, 02115, MA, USA
| | - Laura Carceroni
- Undergraduate Program in Neuroscience, Boston University, Boston, 02115, MA, USA
| | - Gary Kane
- Department of Psychological and Brain Sciences, Boston University, Boston, 02115, MA, USA
| | - Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, 94305, CA, USA
- Department of Neurobiology, Stanford University, Stanford, 94305, CA, USA
- Howard Hughes Medical Institute, HHMI, Chevy Chase, 20815-6789, MD, USA
- Department of Bioengineering, Stanford University, Stanford, 94305, CA, USA
- Stanford Neurosciences Institute, Stanford University, Stanford, 94305, CA, USA
- Bio-X Program, Stanford University, Stanford, 94305, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, 94305, CA, USA
| | - Chandramouli Chandrasekaran
- Department of Biomedical Engineering, Boston University, Boston, 02115, MA, USA.
- Department of Psychological and Brain Sciences, Boston University, Boston, 02115, MA, USA.
- Center for Systems Neuroscience, Boston University, Boston, 02115, MA, USA.
- Department of Anatomy & Neurobiology, Boston University, Boston, 02118, MA, USA.
| |
Collapse
|
28
|
Roland PE. How far neuroscience is from understanding brains. Front Syst Neurosci 2023; 17:1147896. [PMID: 37867627 PMCID: PMC10585277 DOI: 10.3389/fnsys.2023.1147896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Accepted: 07/31/2023] [Indexed: 10/24/2023] Open
Abstract
The cellular biology of brains is relatively well-understood, but neuroscientists have not yet generated a theory explaining how brains work. Explanations of how neurons collectively operate to produce what brains can do are tentative and incomplete. Without prior assumptions about the brain mechanisms, I attempt here to identify major obstacles to progress in neuroscientific understanding of brains and central nervous systems. Most of the obstacles to our understanding are conceptual. Neuroscience lacks concepts and models rooted in experimental results explaining how neurons interact at all scales. The cerebral cortex is thought to control awake activities, which contrasts with recent experimental results. There is ambiguity distinguishing task-related brain activities from spontaneous activities and organized intrinsic activities. Brains are regarded as driven by external and internal stimuli in contrast to their considerable autonomy. Experimental results are explained by sensory inputs, behavior, and psychological concepts. Time and space are regarded as mutually independent variables for spiking, post-synaptic events, and other measured variables, in contrast to experimental results. Dynamical systems theory and models describing evolution of variables with time as the independent variable are insufficient to account for central nervous system activities. Spatial dynamics may be a practical solution. The general hypothesis that measurements of changes in fundamental brain variables, action potentials, transmitter releases, post-synaptic transmembrane currents, etc., propagating in central nervous systems reveal how they work, carries no additional assumptions. Combinations of current techniques could reveal many aspects of spatial dynamics of spiking, post-synaptic processing, and plasticity in insects and rodents to start with. But problems defining baseline and reference conditions hinder interpretations of the results. Furthermore, the facts that pooling and averaging of data destroy their underlying dynamics imply that single-trial designs and statistics are necessary.
Collapse
Affiliation(s)
- Per E. Roland
- Department of Neuroscience, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
29
|
Tian LY, Warren TL, Mehaffey WH, Brainard MS. Dynamic top-down biasing implements rapid adaptive changes to individual movements. eLife 2023; 12:e83223. [PMID: 37733005 PMCID: PMC10513479 DOI: 10.7554/elife.83223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2022] [Accepted: 09/11/2023] [Indexed: 09/22/2023] Open
Abstract
Complex behaviors depend on the coordinated activity of neural ensembles in interconnected brain areas. The behavioral function of such coordination, often measured as co-fluctuations in neural activity across areas, is poorly understood. One hypothesis is that rapidly varying co-fluctuations may be a signature of moment-by-moment task-relevant influences of one area on another. We tested this possibility for error-corrective adaptation of birdsong, a form of motor learning which has been hypothesized to depend on the top-down influence of a higher-order area, LMAN (lateral magnocellular nucleus of the anterior nidopallium), in shaping moment-by-moment output from a primary motor area, RA (robust nucleus of the arcopallium). In paired recordings of LMAN and RA in singing birds, we discovered a neural signature of a top-down influence of LMAN on RA, quantified as an LMAN-leading co-fluctuation in activity between these areas. During learning, this co-fluctuation strengthened in a premotor temporal window linked to the specific movement, sequential context, and acoustic modification associated with learning. Moreover, transient perturbation of LMAN activity specifically within this premotor window caused rapid occlusion of pitch modifications, consistent with LMAN conveying a temporally localized motor-biasing signal. Combined, our results reveal a dynamic top-down influence of LMAN on RA that varies on the rapid timescale of individual movements and is flexibly linked to contexts associated with learning. This finding indicates that inter-area co-fluctuations can be a signature of dynamic top-down influences that support complex behavior and its adaptation.
Collapse
Affiliation(s)
- Lucas Y Tian
- Center for Integrative Neuroscience and Howard Hughes Medical Institute, University of California, San FranciscoSan FranciscoUnited States
| | - Timothy L Warren
- Center for Integrative Neuroscience and Howard Hughes Medical Institute, University of California, San FranciscoSan FranciscoUnited States
| | - William H Mehaffey
- Center for Integrative Neuroscience and Howard Hughes Medical Institute, University of California, San FranciscoSan FranciscoUnited States
| | - Michael S Brainard
- Center for Integrative Neuroscience and Howard Hughes Medical Institute, University of California, San FranciscoSan FranciscoUnited States
| |
Collapse
|
30
|
Kane GA, Senne RA, Scott BB. Rat movements reflect internal decision dynamics in an evidence accumulation task. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.11.556575. [PMID: 37745309 PMCID: PMC10515875 DOI: 10.1101/2023.09.11.556575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
Perceptual decision-making involves multiple cognitive processes, including accumulation of sensory evidence, planning, and executing a motor action. How these processes are intertwined is unclear; some models assume that decision-related processes precede motor execution, whereas others propose that movements reflecting on-going decision processes occur before commitment to a choice. Here we develop and apply two complementary methods to study the relationship between decision processes and the movements leading up to a choice. The first is a free response pulse-based evidence accumulation task, in which stimuli continue until choice is reported. The second is a motion-based drift diffusion model (mDDM), in which movement variables from video pose estimation constrain decision parameters on a trial-by-trial basis. We find the mDDM provides a better model fit to rats' decisions in the free response accumulation task than traditional DDM models. Interestingly, on each trial we observed a period of time, prior to choice, that was characterized by head immobility. The length of this period was positively correlated with the rats' decision bounds and stimuli presented during this period had the greatest impact on choice. Together these results support a model in which internal decision dynamics are reflected in movements and demonstrate that inclusion of movement parameters improves the performance of diffusion-to-bound decision models.
Collapse
Affiliation(s)
- Gary A. Kane
- Department of Psychological and Brain Sciences and Center for Systems Neuroscience, Boston University, Boston MA
| | - Ryan A. Senne
- Graduate Program in Neuroscience, Boston University, Boston MA
| | - Benjamin B. Scott
- Department of Psychological and Brain Sciences and Center for Systems Neuroscience, Boston University, Boston MA
| |
Collapse
|
31
|
Maes A, Barahona M, Clopath C. Long- and short-term history effects in a spiking network model of statistical learning. Sci Rep 2023; 13:12939. [PMID: 37558704 PMCID: PMC10412617 DOI: 10.1038/s41598-023-39108-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Accepted: 07/20/2023] [Indexed: 08/11/2023] Open
Abstract
The statistical structure of the environment is often important when making decisions. There are multiple theories of how the brain represents statistical structure. One such theory states that neural activity spontaneously samples from probability distributions. In other words, the network spends more time in states which encode high-probability stimuli. Starting from the neural assembly, increasingly thought of to be the building block for computation in the brain, we focus on how arbitrary prior knowledge about the external world can both be learned and spontaneously recollected. We present a model based upon learning the inverse of the cumulative distribution function. Learning is entirely unsupervised using biophysical neurons and biologically plausible learning rules. We show how this prior knowledge can then be accessed to compute expectations and signal surprise in downstream networks. Sensory history effects emerge from the model as a consequence of ongoing learning.
Collapse
Affiliation(s)
- Amadeus Maes
- Department of Neuroscience, Feinberg School of Medicine, Northwestern University, Chicago, USA.
- Department of Bioengineering, Imperial College London, London, UK.
| | | | - Claudia Clopath
- Department of Bioengineering, Imperial College London, London, UK
| |
Collapse
|
32
|
Low IIC, Giocomo LM, Williams AH. Remapping in a recurrent neural network model of navigation and context inference. eLife 2023; 12:RP86943. [PMID: 37410093 PMCID: PMC10328512 DOI: 10.7554/elife.86943] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/07/2023] Open
Abstract
Neurons in navigational brain regions provide information about position, orientation, and speed relative to environmental landmarks. These cells also change their firing patterns ('remap') in response to changing contextual factors such as environmental cues, task conditions, and behavioral states, which influence neural activity throughout the brain. How can navigational circuits preserve their local computations while responding to global context changes? To investigate this question, we trained recurrent neural network models to track position in simple environments while at the same time reporting transiently-cued context changes. We show that these combined task constraints (navigation and context inference) produce activity patterns that are qualitatively similar to population-wide remapping in the entorhinal cortex, a navigational brain region. Furthermore, the models identify a solution that generalizes to more complex navigation and inference tasks. We thus provide a simple, general, and experimentally-grounded model of remapping as one neural circuit performing both navigation and context inference.
Collapse
Affiliation(s)
- Isabel IC Low
- Zuckerman Mind Brain Behavior Institute, Columbia UniversityNew YorkUnited States
| | - Lisa M Giocomo
- Department of Neurobiology, Stanford UniversityStanfordUnited States
| | - Alex H Williams
- Center for Computational Neuroscience, Flatiron InstituteNew YorkUnited States
- Center for Neural Science, New York UniversityNew YorkUnited States
| |
Collapse
|
33
|
Kay K, Bonnen K, Denison RN, Arcaro MJ, Barack DL. Tasks and their role in visual neuroscience. Neuron 2023; 111:1697-1713. [PMID: 37040765 DOI: 10.1016/j.neuron.2023.03.022] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/13/2023] [Accepted: 03/15/2023] [Indexed: 04/13/2023]
Abstract
Vision is widely used as a model system to gain insights into how sensory inputs are processed and interpreted by the brain. Historically, careful quantification and control of visual stimuli have served as the backbone of visual neuroscience. There has been less emphasis, however, on how an observer's task influences the processing of sensory inputs. Motivated by diverse observations of task-dependent activity in the visual system, we propose a framework for thinking about tasks, their role in sensory processing, and how we might formally incorporate tasks into our models of vision.
Collapse
Affiliation(s)
- Kendrick Kay
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN 55455, USA.
| | - Kathryn Bonnen
- School of Optometry, Indiana University, Bloomington, IN 47405, USA
| | - Rachel N Denison
- Department of Psychological and Brain Sciences, Boston University, Boston, MA 02215, USA
| | - Mike J Arcaro
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19146, USA
| | - David L Barack
- Departments of Neuroscience and Philosophy, University of Pennsylvania, Philadelphia, PA 19146, USA
| |
Collapse
|
34
|
Low II, Giocomo LM, Williams AH. Remapping in a recurrent neural network model of navigation and context inference. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.25.525596. [PMID: 36747825 PMCID: PMC9900889 DOI: 10.1101/2023.01.25.525596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
Neurons in navigational brain regions provide information about position, orientation, and speed relative to environmental landmarks. These cells also change their firing patterns ("remap") in response to changing contextual factors such as environmental cues, task conditions, and behavioral state, which influence neural activity throughout the brain. How can navigational circuits preserve their local computations while responding to global context changes? To investigate this question, we trained recurrent neural network models to track position in simple environments while at the same time reporting transiently-cued context changes. We show that these combined task constraints (navigation and context inference) produce activity patterns that are qualitatively similar to population-wide remapping in the entorhinal cortex, a navigational brain region. Furthermore, the models identify a solution that generalizes to more complex navigation and inference tasks. We thus provide a simple, general, and experimentally-grounded model of remapping as one neural circuit performing both navigation and context inference.
Collapse
Affiliation(s)
- Isabel I.C. Low
- Zuckerman Mind Brain Behavior Institute, Columbia University
| | | | - Alex H. Williams
- Center for Computational Neuroscience, Flatiron Institute
- Center for Neural Science, New York University
| |
Collapse
|
35
|
Khoury CF, Fala NG, Runyan CA. Arousal and Locomotion Differently Modulate Activity of Somatostatin Neurons across Cortex. eNeuro 2023; 10:ENEURO.0136-23.2023. [PMID: 37169583 PMCID: PMC10216262 DOI: 10.1523/eneuro.0136-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 04/28/2023] [Accepted: 05/03/2023] [Indexed: 05/13/2023] Open
Abstract
Arousal powerfully influences cortical activity, in part by modulating local inhibitory circuits. Somatostatin (SOM)-expressing inhibitory interneurons are particularly well situated to shape local population activity in response to shifts in arousal, yet the relationship between arousal state and SOM activity has not been characterized outside of sensory cortex. To determine whether SOM activity is similarly modulated by behavioral state across different levels of the cortical processing hierarchy, we compared the behavioral modulation of SOM-expressing neurons in auditory cortex (AC), a primary sensory region, and posterior parietal cortex (PPC), an association-level region of cortex, in mice. Behavioral state modulated activity differently in AC and PPC. In PPC, transitions to high arousal were accompanied by large increases in activity across the full PPC neural population, especially in SOM neurons. In AC, arousal transitions led to more subtle changes in overall activity, as individual SOM and Non-SOM neurons could be either positively or negatively modulated during transitions to high arousal states. The coding of sensory information in population activity was enhanced during periods of high arousal in AC, but not in PPC. Our findings suggest unique relationships between activity in local circuits and arousal across cortex, which may be tailored to the roles of specific cortical regions in sensory processing or the control of behavior.
Collapse
Affiliation(s)
- Christine F Khoury
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, Pennsylvania 15213
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, Pennsylvania 15260
| | - Noelle G Fala
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, Pennsylvania 15260
| | - Caroline A Runyan
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, Pennsylvania 15213
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, Pennsylvania 15260
| |
Collapse
|
36
|
Zhu RJB, Wei XX. Unsupervised approach to decomposing neural tuning variability. Nat Commun 2023; 14:2298. [PMID: 37085524 PMCID: PMC10121715 DOI: 10.1038/s41467-023-37982-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Accepted: 04/07/2023] [Indexed: 04/23/2023] Open
Abstract
Neural representation is often described by the tuning curves of individual neurons with respect to certain stimulus variables. Despite this tradition, it has become increasingly clear that neural tuning can vary substantially in accordance with a collection of internal and external factors. A challenge we are facing is the lack of appropriate methods to accurately capture the moment-to-moment tuning variability directly from the noisy neural responses. Here we introduce an unsupervised statistical approach, Poisson functional principal component analysis (Pf-PCA), which identifies different sources of systematic tuning fluctuations, moreover encompassing several current models (e.g.,multiplicative gain models) as special cases. Applying this method to neural data recorded from macaque primary visual cortex- a paradigmatic case for which the tuning curve approach has been scientifically essential- we discovered a simple relationship governing the variability of orientation tuning, which unifies different types of gain changes proposed previously. By decomposing the neural tuning variability into interpretable components, our method enables discovery of unexpected structure of the neural code, capturing the influence of the external stimulus drive and internal states simultaneously.
Collapse
Affiliation(s)
- Rong J B Zhu
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
- MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, and MOE Frontiers Center for Brain Science, Shanghai, China.
| | - Xue-Xin Wei
- Department of Neuroscience, The University of Texas at Austin, Austin, USA.
- Department of Psychology, The University of Texas at Austin, Austin, USA.
- Center for Perceptual Systems, The University of Texas at Austin, Austin, USA.
- Center for Theoretical and Computational Neuroscience, The University of Texas at Austin, Austin, USA.
| |
Collapse
|
37
|
Sachse EM, Snyder AC. Dynamic attention signalling in V4: Relation to fast-spiking/non-fast-spiking cell class and population coupling. Eur J Neurosci 2023; 57:918-939. [PMID: 36732934 PMCID: PMC11521100 DOI: 10.1111/ejn.15928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Revised: 01/09/2023] [Accepted: 01/24/2023] [Indexed: 02/04/2023]
Abstract
The computational role of a neuron during attention depends on its firing properties, neurotransmitter expression and functional connectivity. Neurons in the visual cortical area V4 are reliably engaged by selective attention but exhibit diversity in the effect of attention on firing rates and correlated variability. It remains unclear what specific neuronal properties shape these attention effects. In this study, we quantitatively characterised the distribution of attention modulation of firing rates across populations of V4 neurons. Neurons exhibited a continuum of time-varying attention effects. At one end of the continuum, neurons' spontaneous firing rates were slightly depressed with attention (compared to when unattended), whereas their stimulus responses were enhanced with attention. The other end of the continuum showed the converse pattern: attention depressed stimulus responses but increased spontaneous activity. We tested whether the particular pattern of time-varying attention effects that a neuron exhibited was related to the shape of their actions potentials (so-called 'fast-spiking' [FS] neurons have been linked to inhibition) and the strength of their coupling to the overall population. We found an interdependence among neural attention effects, neuron type and population coupling. In particular, we found neurons for which attention enhanced spontaneous activity but suppressed stimulus responses were less likely to be fast-spiking (more likely to be non-fast-spiking) and tended to have stronger population coupling, compared to neurons with other types of attention effects. These results add important information to our understanding of visual attention circuits at the cellular level.
Collapse
Affiliation(s)
| | - Adam C. Snyder
- Brain and Cognitive Sciences, University of Rochester, Neuroscience, University of Rochester; Center for Visual Sciences, University of Rochester
| |
Collapse
|
38
|
Gu Z, Jamison K, Sabuncu M, Kuceyeski A. Personalized visual encoding model construction with small data. Commun Biol 2022; 5:1382. [PMID: 36528715 PMCID: PMC9759560 DOI: 10.1038/s42003-022-04347-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Accepted: 12/05/2022] [Indexed: 12/23/2022] Open
Abstract
Quantifying population heterogeneity in brain stimuli-response mapping may allow insight into variability in bottom-up neural systems that can in turn be related to individual's behavior or pathological state. Encoding models that predict brain responses to stimuli are one way to capture this relationship. However, they generally need a large amount of fMRI data to achieve optimal accuracy. Here, we propose an ensemble approach to create encoding models for novel individuals with relatively little data by modeling each subject's predicted response vector as a linear combination of the other subjects' predicted response vectors. We show that these ensemble encoding models trained with hundreds of image-response pairs, achieve accuracy not different from models trained on 20,000 image-response pairs. Importantly, the ensemble encoding models preserve patterns of inter-individual differences in the image-response relationship. We also show the proposed approach is robust against domain shift by validating on data with a different scanner and experimental setup. Additionally, we show that the ensemble encoding models are able to discover the inter-individual differences in various face areas' responses to images of animal vs human faces using a recently developed NeuroGen framework. Our approach shows the potential to use existing densely-sampled data, i.e. large amounts of data collected from a single individual, to efficiently create accurate, personalized encoding models and, subsequently, personalized optimal synthetic images for new individuals scanned under different experimental conditions.
Collapse
Affiliation(s)
- Zijin Gu
- School of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
| | - Keith Jamison
- Department of Radiology, Weill Cornell Medicine, New York, NY, USA
| | - Mert Sabuncu
- School of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
- Department of Radiology, Weill Cornell Medicine, New York, NY, USA
| | - Amy Kuceyeski
- Department of Radiology, Weill Cornell Medicine, New York, NY, USA.
| |
Collapse
|
39
|
Chen Y, Yao Z, Wang N, Wu J, Xin Y. Adaption and validation of the Perceived Control of Internal States Scale (PCOISS) in Chinese adults: a cross-sectional study. BMC Psychol 2022; 10:290. [PMID: 36471411 PMCID: PMC9724291 DOI: 10.1186/s40359-022-01004-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Accepted: 11/28/2022] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Perceived control of internal states is important for disease prevention, stress buffering and life adaptability. However, there is no psychometric scale to measure control beliefs over internal states in China. This study aimed to adapt and validate the Perceived Control of Internal States Scale (PCOISS) in a large sample of Chinese adults. METHODS Data was collected through a big project, in which a cross-sectional online survey was conducted nationwide in China using a powerful Chinese online survey platform named WenJuanXing ( https://www.wjx.cn/ ). We translated the PCOISS into Chinese (C-PCOISS) with the forward-backward translation procedure. For the first time of the survey, a sample of 2709 participants (Sample 1) was valid for final analysis. Sample 1 was split into two datasets for principal component analysis (PCA) (nA = 1355) and confirmatory factor analyses (CFA) (nB = 1354) to determine potential factor structure. The scale's validity (i.e., discriminant validity, convergent validity, criterion validity) and internal consistency reliability were evaluated. Among the 1354 respondents (nB), 761 (nC = 761) participated in the follow-up second wave of the survey to assess a cross-sectional test-retest reliability. RESULTS The C-PCOISS retained 14 items. PCA yielded a three-factor model which was supported with the best fit indices in CFA. The C-PCOISS had satisfactory internal consistency with Cronbach's alpha coefficients of 0.86, 0.78 and 0.72 for three subscales, respectively. The scale also showed adequate test-retest reliability (Pearson correlations coefficient of 0.64, 0.62 and 0.54 with p < 0.001 for three subscales, respectively). Three factors of the C-PCOISS were positively associated with positive affect, and negatively associated with negative affect, depression, compulsion-anxiety and perceived stress. CONCLUSIONS The C-PCOISS is reliable and valid for measuring control beliefs over internal states in Chinese adults.
Collapse
Affiliation(s)
- Yantao Chen
- grid.263488.30000 0001 0472 9649School of Psychology, Shenzhen University, Shenzhen, China
| | - Zhuxi Yao
- grid.263488.30000 0001 0472 9649School of Psychology, Shenzhen University, Shenzhen, China
| | - Naiyi Wang
- grid.20513.350000 0004 1789 9964Lab for Educational Neuroscience, Center for Educational Science and Technology, Faculty of Education, Beijing Normal University, Beijing, China ,grid.20513.350000 0004 1789 9964Institute of Educational Psychology and School Counseling, Faculty of Education, Beijing Normal University, Beijing, China
| | - Jianhui Wu
- grid.263488.30000 0001 0472 9649School of Psychology, Shenzhen University, Shenzhen, China
| | - Yuanyuan Xin
- grid.20513.350000 0004 1789 9964Center for Educational Science and Technology, Institute of Advanced Studies in Humanities and Social Sciences, Beijing Normal University, Zhuhai, China
| |
Collapse
|
40
|
Small, correlated changes in synaptic connectivity may facilitate rapid motor learning. Nat Commun 2022; 13:5163. [PMID: 36056006 PMCID: PMC9440011 DOI: 10.1038/s41467-022-32646-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 08/08/2022] [Indexed: 11/08/2022] Open
Abstract
Animals rapidly adapt their movements to external perturbations, a process paralleled by changes in neural activity in the motor cortex. Experimental studies suggest that these changes originate from altered inputs (Hinput) rather than from changes in local connectivity (Hlocal), as neural covariance is largely preserved during adaptation. Since measuring synaptic changes in vivo remains very challenging, we used a modular recurrent neural network to qualitatively test this interpretation. As expected, Hinput resulted in small activity changes and largely preserved covariance. Surprisingly given the presumed dependence of stable covariance on preserved circuit connectivity, Hlocal led to only slightly larger changes in activity and covariance, still within the range of experimental recordings. This similarity is due to Hlocal only requiring small, correlated connectivity changes for successful adaptation. Simulations of tasks that impose increasingly larger behavioural changes revealed a growing difference between Hinput and Hlocal, which could be exploited when designing future experiments.
Collapse
|
41
|
Sadeh S, Clopath C. Contribution of behavioural variability to representational drift. eLife 2022; 11:e77907. [PMID: 36040010 PMCID: PMC9481246 DOI: 10.7554/elife.77907] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 08/24/2022] [Indexed: 11/25/2022] Open
Abstract
Neuronal responses to similar stimuli change dynamically over time, raising the question of how internal representations can provide a stable substrate for neural coding. Recent work has suggested a large degree of drift in neural representations even in sensory cortices, which are believed to store stable representations of the external world. While the drift of these representations is mostly characterized in relation to external stimuli, the behavioural state of the animal (for instance, the level of arousal) is also known to strongly modulate the neural activity. We therefore asked how the variability of such modulatory mechanisms can contribute to representational changes. We analysed large-scale recording of neural activity from the Allen Brain Observatory, which was used before to document representational drift in the mouse visual cortex. We found that, within these datasets, behavioural variability significantly contributes to representational changes. This effect was broadcasted across various cortical areas in the mouse, including the primary visual cortex, higher order visual areas, and even regions not primarily linked to vision like hippocampus. Our computational modelling suggests that these results are consistent with independent modulation of neural activity by behaviour over slower timescales. Importantly, our analysis suggests that reliable but variable modulation of neural representations by behaviour can be misinterpreted as representational drift if neuronal representations are only characterized in the stimulus space and marginalized over behavioural parameters.
Collapse
Affiliation(s)
- Sadra Sadeh
- Department of Bioengineering, Imperial College LondonLondonUnited Kingdom
| | - Claudia Clopath
- Department of Bioengineering, Imperial College LondonLondonUnited Kingdom
| |
Collapse
|
42
|
Distractibility and impulsivity neural states are distinct from selective attention and modulate the implementation of spatial attention. Nat Commun 2022; 13:4796. [PMID: 35970856 PMCID: PMC9378734 DOI: 10.1038/s41467-022-32385-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Accepted: 07/27/2022] [Indexed: 12/02/2022] Open
Abstract
In the context of visual attention, it has been classically assumed that missing the response to a target or erroneously selecting a distractor occurs as a consequence of the (miss)allocation of attention in space. In the present paper, we challenge this view and provide evidence that, in addition to encoding spatial attention, prefrontal neurons also encode a distractibility-to-impulsivity state. Using supervised dimensionality reduction techniques in prefrontal neuronal recordings in monkeys, we identify two partially overlapping neuronal subpopulations associated either with the focus of attention or overt behaviour. The degree of overlap accounts for the behavioral gain associated with the good allocation of attention. We further describe the neural variability accounting for distractibility-to-impulsivity behaviour by a two dimensional state associated with optimality in task and responsiveness. Overall, we thus show that behavioral performance arises from the integration of task-specific neuronal processes and pre-existing neuronal states describing task-independent behavioral states. Failing to detect relevant information has been assumed to be a consequence of misallocation of attention. Here, the authors present findings showing that optimal behavioral performance results from the absence of interference between internal neural states and attention control.
Collapse
|
43
|
Gokcen E, Jasper AI, Semedo JD, Zandvakili A, Kohn A, Machens CK, Yu BM. Disentangling the flow of signals between populations of neurons. NATURE COMPUTATIONAL SCIENCE 2022; 2:512-525. [PMID: 38177794 PMCID: PMC11442031 DOI: 10.1038/s43588-022-00282-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/16/2021] [Accepted: 06/21/2022] [Indexed: 01/06/2024]
Abstract
Technological advances now allow us to record from large populations of neurons across multiple brain areas. These recordings may illuminate how communication between areas contributes to brain function, yet a substantial barrier remains: how do we disentangle the concurrent, bidirectional flow of signals between populations of neurons? We propose here a dimensionality reduction framework, delayed latents across groups (DLAG), that disentangles signals relayed in each direction, identifies how these signals are represented by each population and characterizes how they evolve within and across trials. We demonstrate that DLAG performs well on synthetic datasets similar in scale to current neurophysiological recordings. Then we study simultaneously recorded populations in primate visual areas V1 and V2, where DLAG reveals signatures of bidirectional yet selective communication. Our framework lays a foundation for dissecting the intricate flow of signals across populations of neurons, and how this signalling contributes to cortical computation.
Collapse
Affiliation(s)
- Evren Gokcen
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Anna I Jasper
- Dominick Purpura Department of Neuroscience, Albert Einstein College of Medicine, New York, NY, USA
| | - João D Semedo
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Amin Zandvakili
- Dominick Purpura Department of Neuroscience, Albert Einstein College of Medicine, New York, NY, USA
| | - Adam Kohn
- Dominick Purpura Department of Neuroscience, Albert Einstein College of Medicine, New York, NY, USA
- Department of Ophthalmology and Visual Sciences, Albert Einstein College of Medicine, New York, NY, USA
- Department of Systems and Computational Biology, Albert Einstein College of Medicine, New York, NY, USA
| | - Christian K Machens
- Champalimaud Neuroscience Programme, Champalimaud Foundation, Lisbon, Portugal
| | - Byron M Yu
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA.
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
44
|
Heller CR, David SV. Targeted dimensionality reduction enables reliable estimation of neural population coding accuracy from trial-limited data. PLoS One 2022; 17:e0271136. [PMID: 35862300 PMCID: PMC9302847 DOI: 10.1371/journal.pone.0271136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2022] [Accepted: 06/23/2022] [Indexed: 11/30/2022] Open
Abstract
Rapidly developing technology for large scale neural recordings has allowed researchers to measure the activity of hundreds to thousands of neurons at single cell resolution in vivo. Neural decoding analyses are a widely used tool used for investigating what information is represented in this complex, high-dimensional neural population activity. Most population decoding methods assume that correlated activity between neurons has been estimated accurately. In practice, this requires large amounts of data, both across observations and across neurons. Unfortunately, most experiments are fundamentally constrained by practical variables that limit the number of times the neural population can be observed under a single stimulus and/or behavior condition. Therefore, new analytical tools are required to study neural population coding while taking into account these limitations. Here, we present a simple and interpretable method for dimensionality reduction that allows neural decoding metrics to be calculated reliably, even when experimental trial numbers are limited. We illustrate the method using simulations and compare its performance to standard approaches for dimensionality reduction and decoding by applying it to single-unit electrophysiological data collected from auditory cortex.
Collapse
Affiliation(s)
- Charles R. Heller
- Neuroscience Graduate Program, Oregon Health and Science University, Portland, Oregon, United States of America
- Oregon Hearing Research Center, Oregon Health and Science University, Portland, Oregon, United States of America
| | - Stephen V. David
- Oregon Hearing Research Center, Oregon Health and Science University, Portland, Oregon, United States of America
- * E-mail:
| |
Collapse
|
45
|
Johnston R, Snyder AC, Khanna SB, Issar D, Smith MA. The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons. Cereb Cortex 2022; 32:3331-3346. [PMID: 34963140 PMCID: PMC9340396 DOI: 10.1093/cercor/bhab418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 10/19/2021] [Accepted: 10/20/2021] [Indexed: 01/01/2023] Open
Abstract
Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.
Collapse
Affiliation(s)
- Richard Johnston
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Adam C Snyder
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA
- Department of Neuroscience, University of Rochester, Rochester, NY, 14642, USA
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA
| | - Sanjeev B Khanna
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Deepa Issar
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Matthew A Smith
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| |
Collapse
|
46
|
Miller CT, Gire D, Hoke K, Huk AC, Kelley D, Leopold DA, Smear MC, Theunissen F, Yartsev M, Niell CM. Natural behavior is the language of the brain. Curr Biol 2022; 32:R482-R493. [PMID: 35609550 PMCID: PMC10082559 DOI: 10.1016/j.cub.2022.03.031] [Citation(s) in RCA: 77] [Impact Index Per Article: 25.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
The breadth and complexity of natural behaviors inspires awe. Understanding how our perceptions, actions, and internal thoughts arise from evolved circuits in the brain has motivated neuroscientists for generations. Researchers have traditionally approached this question by focusing on stereotyped behaviors, either natural or trained, in a limited number of model species. This approach has allowed for the isolation and systematic study of specific brain operations, which has greatly advanced our understanding of the circuits involved. At the same time, the emphasis on experimental reductionism has left most aspects of the natural behaviors that have shaped the evolution of the brain largely unexplored. However, emerging technologies and analytical tools make it possible to comprehensively link natural behaviors to neural activity across a broad range of ethological contexts and timescales, heralding new modes of neuroscience focused on natural behaviors. Here we describe a three-part roadmap that aims to leverage the wealth of behaviors in their naturally occurring distributions, linking their variance with that of underlying neural processes to understand how the brain is able to successfully navigate the everyday challenges of animals' social and ecological landscapes. To achieve this aim, experimenters must harness one challenge faced by all neurobiological systems, namely variability, in order to gain new insights into the language of the brain.
Collapse
Affiliation(s)
- Cory T Miller
- Cortical Systems and Behavior Laboratory, University of California San Diego, 9500 Gilman Drive, La Jolla, CA 92039, USA.
| | - David Gire
- Department of Psychology, University of Washington, Guthrie Hall, Seattle, WA 98105, USA
| | - Kim Hoke
- Department of Biology, Colorado State University, 1878 Campus Delivery, Fort Collins, CO 80523, USA
| | - Alexander C Huk
- Center for Perceptual Systems, Departments of Neuroscience and Psychology, University of Texas at Austin, 116 Inner Campus Drive, Austin, TX 78712, USA
| | - Darcy Kelley
- Department of Biological Sciences, Columbia University, 1212 Amsterdam Avenue, New York, NY 10027, USA
| | - David A Leopold
- Section of Cognitive Neurophysiology and Imaging, National Institute of Mental Health, 49 Convent Drive, Bethesda, MD 20892, USA
| | - Matthew C Smear
- Department of Psychology and Institute of Neuroscience, University of Oregon, 1227 University Street, Eugene, OR 97403, USA
| | - Frederic Theunissen
- Department of Psychology, University of California Berkeley, 2121 Berkeley Way, Berkeley, CA 94720, USA
| | - Michael Yartsev
- Department of Bioengineering, University of California Berkeley, 306 Stanley Hall, Berkeley, CA 94720, USA
| | - Cristopher M Niell
- Department of Biology and Institute of Neuroscience, University of Oregon, 222 Huestis Hall, Eugene, OR 97403, USA.
| |
Collapse
|
47
|
Johnston R, Snyder AC, Schibler RS, Smith MA. EEG Signals Index a Global Signature of Arousal Embedded in Neuronal Population Recordings. eNeuro 2022; 9:ENEURO.0012-22.2022. [PMID: 35606150 PMCID: PMC9186107 DOI: 10.1523/eneuro.0012-22.2022] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 05/04/2022] [Accepted: 05/05/2022] [Indexed: 01/01/2023] Open
Abstract
Electroencephalography (EEG) has long been used to index brain states, from early studies describing activity in the presence and absence of visual stimulation to modern work employing complex perceptual tasks. These studies have shed light on brain-wide signals but often lack explanatory power at the single neuron level. Similarly, single neuron recordings can suffer from an inability to measure brain-wide signals accessible using EEG. Here, we combined these techniques while monkeys performed a change detection task and discovered a novel link between spontaneous EEG activity and a neural signal embedded in the spiking responses of neuronal populations. This "slow drift" was associated with fluctuations in the subjects' arousal levels over time: decreases in prestimulus α power were accompanied by increases in pupil size and decreases in microsaccade rate. These results show that brain-wide EEG signals can be used to index modes of activity present in single neuron recordings, that in turn reflect global changes in brain state that influence perception and behavior.
Collapse
Affiliation(s)
- Richard Johnston
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA 15213
| | - Adam C Snyder
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, PA 14627
- Department of Neuroscience, University of Rochester, Rochester, NY 14642
- Center for Visual Science, University of Rochester, Rochester, NY 14627
| | | | - Matthew A Smith
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA 15213
| |
Collapse
|
48
|
Sörensen LKA, Bohté SM, Slagter HA, Scholte HS. Arousal state affects perceptual decision-making by modulating hierarchical sensory processing in a large-scale visual system model. PLoS Comput Biol 2022; 18:e1009976. [PMID: 35377876 PMCID: PMC9009767 DOI: 10.1371/journal.pcbi.1009976] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 04/14/2022] [Accepted: 02/26/2022] [Indexed: 11/18/2022] Open
Abstract
Arousal levels strongly affect task performance. Yet, what arousal level is optimal for a task depends on its difficulty. Easy task performance peaks at higher arousal levels, whereas performance on difficult tasks displays an inverted U-shape relationship with arousal, peaking at medium arousal levels, an observation first made by Yerkes and Dodson in 1908. It is commonly proposed that the noradrenergic locus coeruleus system regulates these effects on performance through a widespread release of noradrenaline resulting in changes of cortical gain. This account, however, does not explain why performance decays with high arousal levels only in difficult, but not in simple tasks. Here, we present a mechanistic model that revisits the Yerkes-Dodson effect from a sensory perspective: a deep convolutional neural network augmented with a global gain mechanism reproduced the same interaction between arousal state and task difficulty in its performance. Investigating this model revealed that global gain states differentially modulated sensory information encoding across the processing hierarchy, which explained their differential effects on performance on simple versus difficult tasks. These findings offer a novel hierarchical sensory processing account of how, and why, arousal state affects task performance.
Collapse
Affiliation(s)
- Lynn K. A. Sörensen
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands
- Amsterdam Brain & Cognition (ABC), University of Amsterdam, Amsterdam, Netherlands
- * E-mail: (LKAS); (HSS)
| | - Sander M. Bohté
- Machine Learning Group, Centrum Wiskunde & Informatica, Amsterdam, Netherlands
- Swammerdam Institute of Life Sciences (SILS), University of Amsterdam, Amsterdam, Netherlands
- Bernoulli Institute, Rijksuniversiteit Groningen, Groningen, Netherlands
| | - Heleen A. Slagter
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- Institute of Brain and Behaviour Amsterdam, Vrije Universiteit Amsterdam, Netherlands
| | - H. Steven Scholte
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands
- Amsterdam Brain & Cognition (ABC), University of Amsterdam, Amsterdam, Netherlands
- * E-mail: (LKAS); (HSS)
| |
Collapse
|
49
|
Liu Y, Levy S, Mau W, Geva N, Rubin A, Ziv Y, Hasselmo M, Howard M. Consistent population activity on the scale of minutes in the mouse hippocampus. Hippocampus 2022; 32:359-372. [PMID: 35225408 PMCID: PMC10085730 DOI: 10.1002/hipo.23409] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 01/05/2022] [Accepted: 01/31/2022] [Indexed: 11/09/2022]
Abstract
Neurons in the hippocampus fire in consistent sequence over the timescale of seconds during the delay period of some memory experiments. For longer timescales, the firing of hippocampal neurons also changes slowly over minutes within experimental sessions. It was thought that these slow dynamics are caused by stochastic drift or a continuous change in the representation of the episode, rather than consistent sequences unfolding over minutes. This paper studies the consistency of contextual drift in three chronic calcium imaging recordings from the hippocampus CA1 region in mice. Computational measures of consistency show reliable sequences within experimental trials at the scale of seconds as one would expect from time cells or place cells during the trial, as well as across experimental trials on the scale of minutes within a recording session. Consistent sequences in the hippocampus are observed over a wide range of time scales, from seconds to minutes. The hippocampal activity could reflect a scale-invariant spatiotemporal context as suggested by theories of memory from cognitive psychology.
Collapse
Affiliation(s)
- Yue Liu
- Department of Physics, Boston University, Boston, Massachusetts, USA.,Center for Systems Neuroscience, Boston University, Boston, Massachusetts, USA.,Center for Memory and Brain, Boston University, Boston, Massachusetts, USA
| | - Samuel Levy
- Center for Systems Neuroscience, Boston University, Boston, Massachusetts, USA.,Center for Memory and Brain, Boston University, Boston, Massachusetts, USA.,Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - William Mau
- Center for Systems Neuroscience, Boston University, Boston, Massachusetts, USA.,Center for Memory and Brain, Boston University, Boston, Massachusetts, USA.,Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Nitzan Geva
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | - Alon Rubin
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | - Yaniv Ziv
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | - Michael Hasselmo
- Center for Systems Neuroscience, Boston University, Boston, Massachusetts, USA.,Center for Memory and Brain, Boston University, Boston, Massachusetts, USA.,Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| | - Marc Howard
- Department of Physics, Boston University, Boston, Massachusetts, USA.,Center for Systems Neuroscience, Boston University, Boston, Massachusetts, USA.,Center for Memory and Brain, Boston University, Boston, Massachusetts, USA.,Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, USA
| |
Collapse
|
50
|
Sihn D, Kim SP. Differential modulation of behavior by infraslow activities of different brain regions. PeerJ 2022; 10:e12875. [PMID: 35178304 PMCID: PMC8815366 DOI: 10.7717/peerj.12875] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 01/11/2022] [Indexed: 01/11/2023] Open
Abstract
The oscillation phase of electroencephalograms (EEGs) is associated with behavioral performance. Several studies have demonstrated this association for relatively fast oscillations (>1 Hz); a similar finding has also been reported for slower oscillations, showing that behavioral performance is correlated with the phase of infraslow activity (ISA, 0.01-0.1 Hz) of electroencephalography (EEG). However, the previous study only investigated ISA in a local brain region using a relatively simple task (somatosensory discrimination task), leaving it difficult to determine how the EEG ISA for various brain regions is associated with behavioral performance. In addition, it is not known whether the EEG ISA phase modulates more complex behavioral task performance. In the present study, we analyzed the ISA of whole-brain EEG of participants performing various behaviors while playing video games. We found that behavior was associated with the specific oscillation phase of EEG ISA when that behavior was independent of other behaviors. In addition, we found that the EEG ISA oscillation phases modulating the different behaviors varied across brain regions. Our results suggest that the EEG ISA for different brain regions modulates behavioral performance in different ways and such modulation of EEG ISA can be generalized to diverse behaviors. This study may deepen the understanding of how EEG ISA modulates behavior and increases the applicability of EEG ISA.
Collapse
Affiliation(s)
- Duho Sihn
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, Ulsan, Republic of Korea
| | - Sung-Phil Kim
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, Ulsan, Republic of Korea
| |
Collapse
|