1
|
Li M, Chen S, Zhang X, Wang Y. Neural Correlation Integrated Adaptive Point Process Filtering on Population Spike Trains. IEEE Trans Neural Syst Rehabil Eng 2025; 33:1014-1025. [PMID: 40031623 DOI: 10.1109/tnsre.2025.3545206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Brain encodes information through neural spiking activities that modulate external environmental stimuli and underlying internal states. Population of neurons coordinate through functional connectivity to plan movement trajectories and accurately activate neuromuscular activities. Motor Brain-machine interface (BMI) is a platform to study the relationship between behaviors and neural ensemble activities. In BMI, point process filters model directly on spike timings to extract underlying states such as motion intents from observed multi-neuron spike trains. However, these methods assume the encoded information from individual neurons is conditionally independent, which leads to less precise estimation. It is necessary to incorporate functional neural connectivity into a point process filter to improve the state estimation. In this paper, we propose a neural correlation integrated adaptive point process filter (CIPPF) that can incorporate the information from functional neural connectivity from population spike trains in a recursive Bayesian framework. Functional neural connectivity information is approximated by an artificial neural network to provide extra updating information for the posterior estimation. Gaussian approximation is applied on the probability distribution to obtain a closed-form solution. Our proposed method is validated on both simulation and real data collected from the rat two-lever discrimination task. Due to the simultaneous modeling of functional neural connectivity and single neuronal tuning properties, the proposed method shows better decoding performance. This suggests the possibility to improve BMI performance by processing the coordinated neural population activities.
Collapse
|
2
|
Weiss O, Coen-Cagli R. Measuring Stimulus Information Transfer Between Neural Populations through the Communication Subspace. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.11.06.622283. [PMID: 39574567 PMCID: PMC11580955 DOI: 10.1101/2024.11.06.622283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 03/26/2025]
Abstract
Sensory processing arises from the communication between neural populations across multiple brain areas. While the widespread presence of neural response variability shared throughout a neural population limits the amount of stimulus-related information those populations can accurately represent, how this variability affects the interareal communication of sensory information is unknown. We propose a mathematical framework to understand the impact of neural population response variability on sensory information transmission. We combine linear Fisher information, a metric connecting stimulus representation and variability, with the framework of communication subspaces, which suggests that functional mappings between cortical populations are low-dimensional relative to the space of population activity patterns. From this, we partition Fisher information depending on the alignment between the population covariance and the mean tuning direction projected onto the communication subspace or its orthogonal complement. We provide mathematical and numerical analyses of our proposed decomposition of Fisher information and examine theoretical scenarios that demonstrate how to leverage communication subspaces for flexible routing and gating of stimulus information. This work will provide researchers investigating interareal communication with a theoretical lens through which to understand sensory information transmission and guide experimental design.
Collapse
Affiliation(s)
- Oren Weiss
- Department of Systems and Computational Biology, Albert Einstein College of Medicine, Bronx, NY 10461, USA
- Dominick P. Purpura Department of Neuroscience, Albert Einstein College of Medicine, Bronx, NY 10461, USA
| | - Ruben Coen-Cagli
- Department of Systems and Computational Biology, Albert Einstein College of Medicine, Bronx, NY 10461, USA
- Dominick P. Purpura Department of Neuroscience, Albert Einstein College of Medicine, Bronx, NY 10461, USA
- Department of Ophthalmology and Visual Sciences, Albert Einstein College of Medicine, Bronx, NY 10461, USA
| |
Collapse
|
3
|
Codol O, Michaels JA, Kashefi M, Pruszynski JA, Gribble PL. MotorNet, a Python toolbox for controlling differentiable biomechanical effectors with artificial neural networks. eLife 2024; 12:RP88591. [PMID: 39078880 PMCID: PMC11288629 DOI: 10.7554/elife.88591] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/02/2024] Open
Abstract
Artificial neural networks (ANNs) are a powerful class of computational models for unravelling neural mechanisms of brain function. However, for neural control of movement, they currently must be integrated with software simulating biomechanical effectors, leading to limiting impracticalities: (1) researchers must rely on two different platforms and (2) biomechanical effectors are not generally differentiable, constraining researchers to reinforcement learning algorithms despite the existence and potential biological relevance of faster training methods. To address these limitations, we developed MotorNet, an open-source Python toolbox for creating arbitrarily complex, differentiable, and biomechanically realistic effectors that can be trained on user-defined motor tasks using ANNs. MotorNet is designed to meet several goals: ease of installation, ease of use, a high-level user-friendly application programming interface, and a modular architecture to allow for flexibility in model building. MotorNet requires no dependencies outside Python, making it easy to get started with. For instance, it allows training ANNs on typically used motor control models such as a two joint, six muscle, planar arm within minutes on a typical desktop computer. MotorNet is built on PyTorch and therefore can implement any network architecture that is possible using the PyTorch framework. Consequently, it will immediately benefit from advances in artificial intelligence through PyTorch updates. Finally, it is open source, enabling users to create and share their own improvements, such as new effector and network architectures or custom task designs. MotorNet's focus on higher-order model and task design will alleviate overhead cost to initiate computational projects for new researchers by providing a standalone, ready-to-go framework, and speed up efforts of established computational teams by enabling a focus on concepts and ideas over implementation.
Collapse
Affiliation(s)
- Olivier Codol
- Western Institute for Neuroscience, University of Western OntarioOntarioCanada
- Department of Psychology, University of Western OntarioOntarioCanada
| | - Jonathan A Michaels
- Western Institute for Neuroscience, University of Western OntarioOntarioCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Robarts Research Institute, University of Western OntarioOntarioCanada
| | - Mehrdad Kashefi
- Western Institute for Neuroscience, University of Western OntarioOntarioCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Robarts Research Institute, University of Western OntarioOntarioCanada
| | - J Andrew Pruszynski
- Western Institute for Neuroscience, University of Western OntarioOntarioCanada
- Department of Psychology, University of Western OntarioOntarioCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Robarts Research Institute, University of Western OntarioOntarioCanada
| | - Paul L Gribble
- Western Institute for Neuroscience, University of Western OntarioOntarioCanada
- Department of Psychology, University of Western OntarioOntarioCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
| |
Collapse
|
4
|
Dubey A, Markowitz DA, Pesaran B. Top-down control of exogenous attentional selection is mediated by beta coherence in prefrontal cortex. Neuron 2023; 111:3321-3334.e5. [PMID: 37499660 PMCID: PMC10935562 DOI: 10.1016/j.neuron.2023.06.025] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 11/30/2022] [Accepted: 06/26/2023] [Indexed: 07/29/2023]
Abstract
Salience-driven exogenous and goal-driven endogenous attentional selection are two distinct forms of attention that guide selection of task-irrelevant and task-relevant targets in primates. Top-down attentional control mechanisms enable selection of the task-relevant target by limiting the influence of sensory information. Although the lateral prefrontal cortex (LPFC) is known to mediate top-down control, the neuronal mechanisms of top-down control of attentional selection are poorly understood. Here, we trained two rhesus monkeys on a two-target, free-choice luminance-reward selection task. We demonstrate that visual-movement (VM) neurons and nonvisual neurons or movement neurons encode exogenous and endogenous selection. We then show that coherent beta activity selectively modulates mechanisms of exogenous selection specifically during conflict and consequently may support top-down control. These results reveal the VM-neuron-specific network mechanisms of attentional selection and suggest a functional role for beta-frequency coherent neural dynamics in the modulation of sensory communication channels for the top-down control of attentional selection.
Collapse
Affiliation(s)
- Agrita Dubey
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - David A Markowitz
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Bijan Pesaran
- Center for Neural Science, New York University, New York, NY 10003, USA; Departments of Neurosurgery, Neuroscience, and Bioengineering, University of Pennsylvania, Philadelphia, PA 19104, USA.
| |
Collapse
|
5
|
Matsumiya K, Furukawa S. Perceptual decisions interfere more with eye movements than with reach movements. Commun Biol 2023; 6:882. [PMID: 37648896 PMCID: PMC10468498 DOI: 10.1038/s42003-023-05249-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 08/16/2023] [Indexed: 09/01/2023] Open
Abstract
Perceptual judgements are formed through invisible cognitive processes. Reading out these judgements is essential for advancing our understanding of decision making and requires inferring covert cognitive states based on overt motor actions. Although intuition suggests that these actions must be related to the formation of decisions about where to move body parts, actions have been reported to be influenced by perceptual judgements even when the action is irrelevant to the perceptual judgement. However, despite performing multiple actions in our daily lives, how perceptual judgements influence multiple judgement-irrelevant actions is unknown. Here we show that perceptual judgements affect only saccadic eye movements when simultaneous judgement-irrelevant saccades and reaches are made, demonstrating that perceptual judgement-related signals continuously flow into the oculomotor system alone when multiple judgement-irrelevant actions are performed. This suggests that saccades are useful for making inferences about covert perceptual decisions, even when the actions are not tied to decision making.
Collapse
Affiliation(s)
| | - Shota Furukawa
- Graduate School of Information Sciences, Tohoku University, Sendai, Japan
| |
Collapse
|
6
|
Dubey A, Markowitz DA, Pesaran B. Top-down control of exogenous attentional selection is mediated by beta coherence in prefrontal cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.11.523664. [PMID: 36711697 PMCID: PMC9882082 DOI: 10.1101/2023.01.11.523664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
Salience-driven exogenous and goal-driven endogenous attentional selection are two distinct forms of attention that guide selection of task-irrelevant and task-relevant targets in primates. During conflict i.e, when salience and goal each favor the selection of different targets, endogenous selection of the task-relevant target relies on top-down control. Top-down attentional control mechanisms enable selection of the task-relevant target by limiting the influence of sensory information. Although the lateral prefrontal cortex (LPFC) is known to mediate top-down control, the neuronal mechanisms of top-down control of attentional selection are poorly understood. Here, using a two-target free-choice luminance-reward selection task, we demonstrate that visual-movement neurons and not visual neurons or movement neurons encode exogenous and endogenous selection. We then show that coherent-beta activity selectively modulates mechanisms of exogenous selection specifically during conflict and consequently may support top-down control. These results reveal the VM-neuron-specific network mechanisms of attentional selection and suggest a functional role for beta-frequency coherent neural dynamics in the modulation of sensory communication channels for the top-down control of attentional selection.
Collapse
Affiliation(s)
- Agrita Dubey
- Center for Neural Science, New York University, New York 10003
- Department of Neurosurgery, University of Pennsylvania, Philadelphia 19104
| | | | - Bijan Pesaran
- Center for Neural Science, New York University, New York 10003
- Department of Neurosurgery, University of Pennsylvania, Philadelphia 19104
- Department of Neuroscience, University of Pennsylvania, Philadelphia 19104
- Department of Bioengineering, University of Pennsylvania, Philadelphia 19104
| |
Collapse
|
7
|
Csorba BA, Krause MR, Zanos TP, Pack CC. Long-range cortical synchronization supports abrupt visual learning. Curr Biol 2022; 32:2467-2479.e4. [PMID: 35523181 DOI: 10.1016/j.cub.2022.04.029] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 03/08/2022] [Accepted: 04/12/2022] [Indexed: 11/29/2022]
Abstract
Visual plasticity declines sharply after the critical period, yet we easily learn to recognize new faces and places, even as adults. Such learning is often characterized by a "moment of insight," an abrupt and dramatic improvement in recognition. The mechanisms that support abrupt learning are unknown, but one hypothesis is that they involve changes in synchronization between brain regions. To test this hypothesis, we used a behavioral task in which non-human primates rapidly learned to recognize novel images and to associate them with specific responses. Simultaneous recordings from inferotemporal and prefrontal cortices revealed a transient synchronization of neural activity between these areas that peaked around the moment of insight. Synchronization was strongest between inferotemporal sites that encoded images and reward-sensitive prefrontal sites. Moreover, its magnitude intensified gradually over image exposures, suggesting that abrupt learning is the culmination of a search for informative signals within a circuit linking sensory information to task demands.
Collapse
Affiliation(s)
- Bennett A Csorba
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.
| | - Matthew R Krause
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
| | | | - Christopher C Pack
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
| |
Collapse
|
8
|
Hagan MA, Pesaran B. Modulation of inhibitory communication coordinates looking and reaching. Nature 2022; 604:708-713. [PMID: 35444285 PMCID: PMC9124440 DOI: 10.1038/s41586-022-04631-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Accepted: 03/11/2022] [Indexed: 11/09/2022]
Abstract
Looking and reaching are controlled by different brain regions and are coordinated during natural behaviour1. Understanding how flexible, natural behaviours such as coordinated looking and reaching are controlled depends on understanding how neurons in different regions of the brain communicate2. Neural coherence in a gamma-frequency (40-90 Hz) band has been implicated in excitatory multiregional communication3. Inhibitory control mechanisms are also required to flexibly control behaviour4, but little is known about how neurons in one region transiently suppress individual neurons in another to support behaviour. How neuronal firing in a sender region transiently suppresses firing in a receiver region remains poorly understood. Here we study inhibitory communication during a flexible, natural behaviour, termed gaze anchoring, in which saccades are transiently inhibited by coordinated reaches. During gaze anchoring, we found that neurons in the reach region of the posterior parietal cortex can inhibit neuronal firing in the parietal saccade region to suppress eye movements and improve reach accuracy. Suppression is transient, only present around the coordinated reach, and greatest when reach neurons fire spikes with respect to beta-frequency (15-25 Hz) activity, not gamma-frequency activity. Our work provides evidence in the activity of single neurons for a novel mechanism of inhibitory communication in which beta-frequency neural coherence transiently inhibits multiregional communication to flexibly coordinate natural behaviour.
Collapse
Affiliation(s)
- Maureen A Hagan
- Department of Physiology and Neuroscience Program, Biomedicine Discovery Institute, Monash University, Clayton, VIC, Australia
- Center for Neural Science, New York University, New York, NY, USA
| | - Bijan Pesaran
- Center for Neural Science, New York University, New York, NY, USA.
| |
Collapse
|