1
|
Roshan SS, Sadeghnejad N, Sharifizadeh F, Ebrahimpour R. A neurocomputational model of decision and confidence in object recognition task. Neural Netw 2024; 175:106318. [PMID: 38643618 DOI: 10.1016/j.neunet.2024.106318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2023] [Revised: 03/16/2024] [Accepted: 04/11/2024] [Indexed: 04/23/2024]
Abstract
How does the brain process natural visual stimuli to make a decision? Imagine driving through fog. An object looms ahead. What do you do? This decision requires not only identifying the object but also choosing an action based on your decision confidence. In this circumstance, confidence is making a bridge between seeing and believing. Our study unveils how the brain processes visual information to make such decisions with an assessment of confidence, using a model inspired by the visual cortex. To computationally model the process, this study uses a spiking neural network inspired by the hierarchy of the visual cortex in mammals to investigate the dynamics of feedforward object recognition and decision-making in the brain. The model consists of two modules: a temporal dynamic object representation module and an attractor neural network-based decision-making module. Unlike traditional models, ours captures the evolution of evidence within the visual cortex, mimicking how confidence forms in the brain. This offers a more biologically plausible approach to decision-making when encountering real-world stimuli. We conducted experiments using natural stimuli and measured accuracy, reaction time, and confidence. The model's estimated confidence aligns remarkably well with human-reported confidence. Furthermore, the model can simulate the human change-of-mind phenomenon, reflecting the ongoing evaluation of evidence in the brain. Also, this finding offers decision-making and confidence encoding share the same neural circuit.
Collapse
Affiliation(s)
- Setareh Sadat Roshan
- Department of Computer Engineering, Shahid Rajaee Teacher Training University, Tehran, Iran; School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran 1956836484, Iran
| | - Naser Sadeghnejad
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran 1956836484, Iran
| | - Fatemeh Sharifizadeh
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran 1956836484, Iran
| | - Reza Ebrahimpour
- Center for Cognitive Science, Institute for Convergence Science & Technology, Sharif University of Technology, Tehran 14588-89694, Iran.
| |
Collapse
|
2
|
Chang JC, Perich MG, Miller LE, Gallego JA, Clopath C. De novo motor learning creates structure in neural activity that shapes adaptation. Nat Commun 2024; 15:4084. [PMID: 38744847 PMCID: PMC11094149 DOI: 10.1038/s41467-024-48008-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 04/18/2024] [Indexed: 05/16/2024] Open
Abstract
Animals can quickly adapt learned movements to external perturbations, and their existing motor repertoire likely influences their ease of adaptation. Long-term learning causes lasting changes in neural connectivity, which shapes the activity patterns that can be produced during adaptation. Here, we examined how a neural population's existing activity patterns, acquired through de novo learning, affect subsequent adaptation by modeling motor cortical neural population dynamics with recurrent neural networks. We trained networks on different motor repertoires comprising varying numbers of movements, which they acquired following various learning experiences. Networks with multiple movements had more constrained and robust dynamics, which were associated with more defined neural 'structure'-organization in the available population activity patterns. This structure facilitated adaptation, but only when the changes imposed by the perturbation were congruent with the organization of the inputs and the structure in neural activity acquired during de novo learning. These results highlight trade-offs in skill acquisition and demonstrate how different learning experiences can shape the geometrical properties of neural population activity and subsequent adaptation.
Collapse
Affiliation(s)
- Joanna C Chang
- Department of Bioengineering, Imperial College London, London, UK
| | - Matthew G Perich
- Département de Neurosciences, Faculté de Médecine, Université de Montréal, Montréal, QC, Canada
- Mila, Québec Artificial Intelligence Institute, Montréal, QC, Canada
| | - Lee E Miller
- Departments of Physiology, Biomedical Engineering and Physical Medicine and Rehabilitation, Northwestern University and Shirley Ryan Ability Lab, Chicago, IL, USA
| | - Juan A Gallego
- Department of Bioengineering, Imperial College London, London, UK.
| | - Claudia Clopath
- Department of Bioengineering, Imperial College London, London, UK.
| |
Collapse
|
3
|
Diao H, Ma J, Jia Y, Jia H, Wei K. Abnormalities in motor adaptation to different types of perturbations in schizophreniaperturbations in schizophrenia. Schizophr Res 2024; 267:291-300. [PMID: 38599141 DOI: 10.1016/j.schres.2024.03.051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 03/20/2024] [Accepted: 03/31/2024] [Indexed: 04/12/2024]
Abstract
Schizophrenia is a mental health disorder that often includes psychomotor disturbances, impacting how individuals adjust their motor output based on the cause of motor errors. While previous motor adaptation studies on individuals with schizophrenia have largely focused on large and consistent perturbations induced by abrupt experimental manipulations, such as donning prism goggles, the adaptation process to random perturbations, either caused by intrinsic motor noise or external disturbances, has not been examined - despite its ecological relevance. Here, we used a unified behavioral task paradigm to examine motor adaptation to perturbations of three causal structures among individuals in the remission stage of schizophrenia, youth with ultra-high risk of psychosis, adults with active symptoms, and age-matched controls. Results showed that individuals with schizophrenia had reduced trial-by-trial adaptation and large error variance when adapting to their own motor noise. When adapting to random but salient perturbations, they showed intact adaptation and normal causal inference of errors. This contrasted with reduced adaptation to large yet consistent perturbations, which could reflect difficulties in forming cognitive strategies rather than the often-assumed impairments in procedural learning or sense of agency. Furthermore, the observed adaptation effects were correlated with the severity of positive symptoms across the diagnosis groups. Our findings suggest that individuals with schizophrenia face challenges in accommodating intrinsic perturbations when motor errors are ambiguous but adapt with intact causal attribution when errors are salient.
Collapse
Affiliation(s)
- Henan Diao
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China
| | - Jiajun Ma
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China
| | - Yuan Jia
- The National Clinical Research Center for Mental Disorders, Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing 100088, China; Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing 100088, China
| | - Hongxiao Jia
- The National Clinical Research Center for Mental Disorders, Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing 100088, China; Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing 100088, China.
| | - Kunlin Wei
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China.
| |
Collapse
|
4
|
Churchland MM, Shenoy KV. Preparatory activity and the expansive null-space. Nat Rev Neurosci 2024; 25:213-236. [PMID: 38443626 DOI: 10.1038/s41583-024-00796-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/26/2024] [Indexed: 03/07/2024]
Abstract
The study of the cortical control of movement experienced a conceptual shift over recent decades, as the basic currency of understanding shifted from single-neuron tuning towards population-level factors and their dynamics. This transition was informed by a maturing understanding of recurrent networks, where mechanism is often characterized in terms of population-level factors. By estimating factors from data, experimenters could test network-inspired hypotheses. Central to such hypotheses are 'output-null' factors that do not directly drive motor outputs yet are essential to the overall computation. In this Review, we highlight how the hypothesis of output-null factors was motivated by the venerable observation that motor-cortex neurons are active during movement preparation, well before movement begins. We discuss how output-null factors then became similarly central to understanding neural activity during movement. We discuss how this conceptual framework provided key analysis tools, making it possible for experimenters to address long-standing questions regarding motor control. We highlight an intriguing trend: as experimental and theoretical discoveries accumulate, the range of computational roles hypothesized to be subserved by output-null factors continues to expand.
Collapse
Affiliation(s)
- Mark M Churchland
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Grossman Center for the Statistics of Mind, Columbia University, New York, NY, USA.
- Kavli Institute for Brain Science, Columbia University, New York, NY, USA.
| | - Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
- Department of Neurobiology, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Bio-X Institute, Stanford University, Stanford, CA, USA
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA
| |
Collapse
|
5
|
Chang YJ, Chen YI, Yeh HC, Santacruz SR. Neurobiologically realistic neural network enables cross-scale modeling of neural dynamics. Sci Rep 2024; 14:5145. [PMID: 38429297 PMCID: PMC10907713 DOI: 10.1038/s41598-024-54593-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 02/14/2024] [Indexed: 03/03/2024] Open
Abstract
Fundamental principles underlying computation in multi-scale brain networks illustrate how multiple brain areas and their coordinated activity give rise to complex cognitive functions. Whereas brain activity has been studied at the micro- to meso-scale to reveal the connections between the dynamical patterns and the behaviors, investigations of neural population dynamics are mainly limited to single-scale analysis. Our goal is to develop a cross-scale dynamical model for the collective activity of neuronal populations. Here we introduce a bio-inspired deep learning approach, termed NeuroBondGraph Network (NBGNet), to capture cross-scale dynamics that can infer and map the neural data from multiple scales. Our model not only exhibits more than an 11-fold improvement in reconstruction accuracy, but also predicts synchronous neural activity and preserves correlated low-dimensional latent dynamics. We also show that the NBGNet robustly predicts held-out data across a long time scale (2 weeks) without retraining. We further validate the effective connectivity defined from our model by demonstrating that neural connectivity during motor behaviour agrees with the established neuroanatomical hierarchy of motor control in the literature. The NBGNet approach opens the door to revealing a comprehensive understanding of brain computation, where network mechanisms of multi-scale activity are critical.
Collapse
Affiliation(s)
- Yin-Jui Chang
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA
| | - Yuan-I Chen
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA
| | - Hsin-Chih Yeh
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA
- Texas Materials Institute, The University of Texas at Austin, Austin, TX, USA
| | - Samantha R Santacruz
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA.
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX, USA.
- Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, USA.
| |
Collapse
|
6
|
Algermissen J, Swart JC, Scheeringa R, Cools R, den Ouden HEM. Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases. Nat Commun 2024; 15:19. [PMID: 38168089 PMCID: PMC10762147 DOI: 10.1038/s41467-023-44632-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 12/22/2023] [Indexed: 01/05/2024] Open
Abstract
Actions are biased by the outcomes they can produce: Humans are more likely to show action under reward prospect, but hold back under punishment prospect. Such motivational biases derive not only from biased response selection, but also from biased learning: humans tend to attribute rewards to their own actions, but are reluctant to attribute punishments to having held back. The neural origin of these biases is unclear. Specifically, it remains open whether motivational biases arise primarily from the architecture of subcortical regions or also reflect cortical influences, the latter being typically associated with increased behavioral flexibility and control beyond stereotyped behaviors. Simultaneous EEG-fMRI allowed us to track which regions encoded biased prediction errors in which order. Biased prediction errors occurred in cortical regions (dorsal anterior and posterior cingulate cortices) before subcortical regions (striatum). These results highlight that biased learning is not a mere feature of the basal ganglia, but arises through prefrontal cortical contributions, revealing motivational biases to be a potentially flexible, sophisticated mechanism.
Collapse
Affiliation(s)
- Johannes Algermissen
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands.
| | - Jennifer C Swart
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - René Scheeringa
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
- Erwin L. Hahn Institute for Magnetic Resonance Imaging, University of Duisburg-Essen, Essen, Germany
| | - Roshan Cools
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
- Department of Psychiatry, Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Hanneke E M den Ouden
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands.
| |
Collapse
|
7
|
Verhein JR, Vyas S, Shenoy KV. Methylphenidate modulates motor cortical dynamics and behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.15.562405. [PMID: 37905157 PMCID: PMC10614820 DOI: 10.1101/2023.10.15.562405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
Methylphenidate (MPH, brand: Ritalin) is a common stimulant used both medically and non-medically. Though typically prescribed for its cognitive effects, MPH also affects movement. While it is known that MPH noncompetitively blocks the reuptake of catecholamines through inhibition of dopamine and norepinephrine transporters, a critical step in exploring how it affects behavior is to understand how MPH directly affects neural activity. This would establish an electrophysiological mechanism of action for MPH. Since we now have biologically-grounded network-level hypotheses regarding how populations of motor cortical neurons plan and execute movements, there is a unique opportunity to make testable predictions regarding how systemic MPH administration - a pharmacological perturbation - might affect neural activity in motor cortex. To that end, we administered clinically-relevant doses of MPH to Rhesus monkeys as they performed an instructed-delay reaching task. Concomitantly, we measured neural activity from dorsal premotor and primary motor cortex. Consistent with our predictions, we found dose-dependent and significant effects on reaction time, trial-by-trial variability, and movement speed. We confirmed our hypotheses that changes in reaction time and variability were accompanied by previously established population-level changes in motor cortical preparatory activity and the condition-independent signal that precedes movements. We expected changes in speed to be a result of changes in the amplitude of motor cortical dynamics and/or a translation of those dynamics in activity space. Instead, our data are consistent with a mechanism whereby the neuromodulatory effect of MPH is to increase the gain and/or the signal-to-noise of motor cortical dynamics during reaching. Continued work in this domain to better understand the brain-wide electrophysiological mechanism of action of MPH and other psychoactive drugs could facilitate more targeted treatments for a host of cognitive-motor disorders.
Collapse
Affiliation(s)
- Jessica R Verhein
- Medical Scientist Training Program, Stanford School of Medicine, Stanford University, Stanford, CA
- Neurosciences Graduate Program, Stanford School of Medicine, Stanford University, Stanford, CA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA
- Current affiliations: Psychiatry Research Residency Training Program, University of California, San Francisco, San Francisco, CA
| | - Saurabh Vyas
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA
- Department of Bioengineering, Stanford University, Stanford, CA
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY
| | - Krishna V Shenoy
- Neurosciences Graduate Program, Stanford School of Medicine, Stanford University, Stanford, CA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA
- Department of Bioengineering, Stanford University, Stanford, CA
- Department of Electrical Engineering, Stanford University, Stanford, CA
- Howard Hughes Medical Institute at Stanford University, Stanford, CA
- Department of Neurobiology, Stanford University, Stanford, CA
- Bio-X Program, Stanford University, Stanford, CA
| |
Collapse
|
8
|
Boucher PO, Wang T, Carceroni L, Kane G, Shenoy KV, Chandrasekaran C. Initial conditions combine with sensory evidence to induce decision-related dynamics in premotor cortex. Nat Commun 2023; 14:6510. [PMID: 37845221 PMCID: PMC10579235 DOI: 10.1038/s41467-023-41752-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Accepted: 09/18/2023] [Indexed: 10/18/2023] Open
Abstract
We used a dynamical systems perspective to understand decision-related neural activity, a fundamentally unresolved problem. This perspective posits that time-varying neural activity is described by a state equation with an initial condition and evolves in time by combining at each time step, recurrent activity and inputs. We hypothesized various dynamical mechanisms of decisions, simulated them in models to derive predictions, and evaluated these predictions by examining firing rates of neurons in the dorsal premotor cortex (PMd) of monkeys performing a perceptual decision-making task. Prestimulus neural activity (i.e., the initial condition) predicted poststimulus neural trajectories, covaried with RT and the outcome of the previous trial, but not with choice. Poststimulus dynamics depended on both the sensory evidence and initial condition, with easier stimuli and fast initial conditions leading to the fastest choice-related dynamics. Together, these results suggest that initial conditions combine with sensory evidence to induce decision-related dynamics in PMd.
Collapse
Affiliation(s)
- Pierre O Boucher
- Department of Biomedical Engineering, Boston University, Boston, 02115, MA, USA
| | - Tian Wang
- Department of Biomedical Engineering, Boston University, Boston, 02115, MA, USA
| | - Laura Carceroni
- Undergraduate Program in Neuroscience, Boston University, Boston, 02115, MA, USA
| | - Gary Kane
- Department of Psychological and Brain Sciences, Boston University, Boston, 02115, MA, USA
| | - Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, 94305, CA, USA
- Department of Neurobiology, Stanford University, Stanford, 94305, CA, USA
- Howard Hughes Medical Institute, HHMI, Chevy Chase, 20815-6789, MD, USA
- Department of Bioengineering, Stanford University, Stanford, 94305, CA, USA
- Stanford Neurosciences Institute, Stanford University, Stanford, 94305, CA, USA
- Bio-X Program, Stanford University, Stanford, 94305, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, 94305, CA, USA
| | - Chandramouli Chandrasekaran
- Department of Biomedical Engineering, Boston University, Boston, 02115, MA, USA.
- Department of Psychological and Brain Sciences, Boston University, Boston, 02115, MA, USA.
- Center for Systems Neuroscience, Boston University, Boston, 02115, MA, USA.
- Department of Anatomy & Neurobiology, Boston University, Boston, 02118, MA, USA.
| |
Collapse
|
9
|
Iwane F, Dash D, Salamanca-Giron RF, Hayward W, Bönstrup M, Buch ER, Cohen LG. Combined low-frequency brain oscillatory activity and behavior predict future errors in human motor skill. Curr Biol 2023; 33:3145-3154.e5. [PMID: 37442139 DOI: 10.1016/j.cub.2023.06.040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 03/24/2023] [Accepted: 06/13/2023] [Indexed: 07/15/2023]
Abstract
Human skills are composed of sequences of individual actions performed with utmost precision. When occasional errors occur, they may have serious consequences, for example, when pilots are manually landing a plane. In such cases, the ability to predict an error before it occurs would clearly be advantageous. Here, we asked whether it is possible to predict future errors in a keyboard procedural human motor skill. We report that prolonged keypress transition times (KTTs), reflecting slower speed, and anomalous delta-band oscillatory activity in cingulate-entorhinal-precuneus brain regions precede upcoming errors in skill. Combined anomalous low-frequency activity and prolonged KTTs predicted up to 70% of future errors. Decoding strength (posterior probability of error) increased progressively approaching the errors. We conclude that it is possible to predict future individual errors in skill sequential performance.
Collapse
Affiliation(s)
- Fumiaki Iwane
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Debadatta Dash
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | | | - William Hayward
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Marlene Bönstrup
- Department of Neurology, University of Leipzig Medical Center, 04103 Leipzig, Germany
| | - Ethan R Buch
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Leonardo G Cohen
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA.
| |
Collapse
|
10
|
Markanday A, Hong S, Inoue J, De Schutter E, Thier P. Multidimensional cerebellar computations for flexible kinematic control of movements. Nat Commun 2023; 14:2548. [PMID: 37137897 PMCID: PMC10156706 DOI: 10.1038/s41467-023-37981-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 04/07/2023] [Indexed: 05/05/2023] Open
Abstract
Both the environment and our body keep changing dynamically. Hence, ensuring movement precision requires adaptation to multiple demands occurring simultaneously. Here we show that the cerebellum performs the necessary multi-dimensional computations for the flexible control of different movement parameters depending on the prevailing context. This conclusion is based on the identification of a manifold-like activity in both mossy fibers (MFs, network input) and Purkinje cells (PCs, output), recorded from monkeys performing a saccade task. Unlike MFs, the PC manifolds developed selective representations of individual movement parameters. Error feedback-driven climbing fiber input modulated the PC manifolds to predict specific, error type-dependent changes in subsequent actions. Furthermore, a feed-forward network model that simulated MF-to-PC transformations revealed that amplification and restructuring of the lesser variability in the MF activity is a pivotal circuit mechanism. Therefore, the flexible control of movements by the cerebellum crucially depends on its capacity for multi-dimensional computations.
Collapse
Affiliation(s)
- Akshay Markanday
- Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Sungho Hong
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
| | - Junya Inoue
- Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Erik De Schutter
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
| | - Peter Thier
- Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Tübingen, Germany.
| |
Collapse
|
11
|
Marciniak Dg Agra K, Dg Agra P. F = ma. Is the macaque brain Newtonian? Cogn Neuropsychol 2023; 39:376-408. [PMID: 37045793 DOI: 10.1080/02643294.2023.2191843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/14/2023]
Abstract
Intuitive Physics, the ability to anticipate how the physical events involving mass objects unfold in time and space, is a central component of intelligent systems. Intuitive physics is a promising tool for gaining insight into mechanisms that generalize across species because both humans and non-human primates are subject to the same physical constraints when engaging with the environment. Physical reasoning abilities are widely present within the animal kingdom, but monkeys, with acute 3D vision and a high level of dexterity, appreciate and manipulate the physical world in much the same way humans do.
Collapse
Affiliation(s)
- Karolina Marciniak Dg Agra
- The Rockefeller University, Laboratory of Neural Circuits, New York, NY, USA
- Center for Brain, Minds and Machines, Cambridge, MA, USA
| | - Pedro Dg Agra
- The Rockefeller University, Laboratory of Neural Circuits, New York, NY, USA
- Center for Brain, Minds and Machines, Cambridge, MA, USA
| |
Collapse
|
12
|
Meirhaeghe N, Riehle A, Brochier T. Parallel movement planning is achieved via an optimal preparatory state in motor cortex. Cell Rep 2023; 42:112136. [PMID: 36807145 DOI: 10.1016/j.celrep.2023.112136] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 12/16/2022] [Accepted: 02/01/2023] [Indexed: 02/22/2023] Open
Abstract
How do patterns of neural activity in the motor cortex contribute to the planning of a movement? A recent theory developed for single movements proposes that the motor cortex acts as a dynamical system whose initial state is optimized during the preparatory phase of the movement. This theory makes important yet untested predictions about preparatory dynamics in more complex behavioral settings. Here, we analyze preparatory activity in non-human primates planning not one but two movements simultaneously. As predicted by the theory, we find that parallel planning is achieved by adjusting preparatory activity within an optimal subspace to an intermediate state reflecting a trade-off between the two movements. The theory quantitatively accounts for the relationship between this intermediate state and fluctuations in the animals' behavior down at the trial level. These results uncover a simple mechanism for planning multiple movements in parallel and further point to motor planning as a controlled dynamical process.
Collapse
Affiliation(s)
- Nicolas Meirhaeghe
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, 13005 Marseille, France.
| | - Alexa Riehle
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, 13005 Marseille, France; Institute of Neuroscience and Medicine (INM-6), Jülich Research Centre, 52428 Jülich, Germany
| | - Thomas Brochier
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, 13005 Marseille, France
| |
Collapse
|
13
|
Codol O, Kashefi M, Forgaard CJ, Galea JM, Pruszynski JA, Gribble PL. Sensorimotor feedback loops are selectively sensitive to reward. eLife 2023; 12:81325. [PMID: 36637162 PMCID: PMC9910828 DOI: 10.7554/elife.81325] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 12/29/2022] [Indexed: 01/14/2023] Open
Abstract
Although it is well established that motivational factors such as earning more money for performing well improve motor performance, how the motor system implements this improvement remains unclear. For instance, feedback-based control, which uses sensory feedback from the body to correct for errors in movement, improves with greater reward. But feedback control encompasses many feedback loops with diverse characteristics such as the brain regions involved and their response time. Which specific loops drive these performance improvements with reward is unknown, even though their diversity makes it unlikely that they are contributing uniformly. We systematically tested the effect of reward on the latency (how long for a corrective response to arise?) and gain (how large is the corrective response?) of seven distinct sensorimotor feedback loops in humans. Only the fastest feedback loops were insensitive to reward, and the earliest reward-driven changes were consistently an increase in feedback gains, not a reduction in latency. Rather, a reduction of response latencies only tended to occur in slower feedback loops. These observations were similar across sensory modalities (vision and proprioception). Our results may have implications regarding feedback control performance in athletic coaching. For instance, coaching methodologies that rely on reinforcement or 'reward shaping' may need to specifically target aspects of movement that rely on reward-sensitive feedback responses.
Collapse
Affiliation(s)
- Olivier Codol
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- School of Psychology, University of BirminghamBirminghamUnited Kingdom
| | - Mehrdad Kashefi
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Robarts Research Institute, University of Western OntarioLondonCanada
| | - Christopher J Forgaard
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
| | - Joseph M Galea
- School of Psychology, University of BirminghamBirminghamUnited Kingdom
| | - J Andrew Pruszynski
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Robarts Research Institute, University of Western OntarioLondonCanada
| | - Paul L Gribble
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Haskins LaboratoriesNew HavenUnited States
| |
Collapse
|
14
|
Zhu F, Grier HA, Tandon R, Cai C, Agarwal A, Giovannucci A, Kaufman MT, Pandarinath C. A deep learning framework for inference of single-trial neural population dynamics from calcium imaging with subframe temporal resolution. Nat Neurosci 2022; 25:1724-1734. [PMID: 36424431 PMCID: PMC9825112 DOI: 10.1038/s41593-022-01189-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Accepted: 09/23/2022] [Indexed: 11/26/2022]
Abstract
In many areas of the brain, neural populations act as a coordinated network whose state is tied to behavior on a millisecond timescale. Two-photon (2p) calcium imaging is a powerful tool to probe such network-scale phenomena. However, estimating the network state and dynamics from 2p measurements has proven challenging because of noise, inherent nonlinearities and limitations on temporal resolution. Here we describe Recurrent Autoencoder for Discovering Imaged Calcium Latents (RADICaL), a deep learning method to overcome these limitations at the population level. RADICaL extends methods that exploit dynamics in spiking activity for application to deconvolved calcium signals, whose statistics and temporal dynamics are quite distinct from electrophysiologically recorded spikes. It incorporates a new network training strategy that capitalizes on the timing of 2p sampling to recover network dynamics with high temporal precision. In synthetic tests, RADICaL infers the network state more accurately than previous methods, particularly for high-frequency components. In 2p recordings from sensorimotor areas in mice performing a forelimb reach task, RADICaL infers network state with close correspondence to single-trial variations in behavior and maintains high-quality inference even when neuronal populations are substantially reduced.
Collapse
Affiliation(s)
- Feng Zhu
- Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
- Neuroscience Graduate Program, Graduate Division of Biological and Biomedical Sciences, Emory University, Atlanta, GA, USA
| | - Harrison A Grier
- Committee on Computational Neuroscience, The University of Chicago, Chicago, IL, USA
| | - Raghav Tandon
- Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
| | - Changjia Cai
- Joint Biomedical Engineering Department, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA
| | | | - Andrea Giovannucci
- Joint Biomedical Engineering Department, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA.
- Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
- Closed-Loop Engineering for Advanced Rehabilitation (CLEAR), North Carolina State University, Raleigh, NC, USA.
| | - Matthew T Kaufman
- Department of Organismal Biology and Anatomy, The University of Chicago, Chicago, IL, USA.
- Neuroscience Institute, The University of Chicago, Chicago, IL, USA.
| | - Chethan Pandarinath
- Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA.
- Department of Neurosurgery, Emory University, Atlanta, GA, USA.
- Center for Machine Learning, Georgia Institute of Technology, Atlanta, GA, USA.
| |
Collapse
|
15
|
Transcranial magnetic stimulation on the dorsal premotor cortex facilitates human visuomotor adaptation. Neuroreport 2022; 33:723-727. [PMID: 36165034 PMCID: PMC9521582 DOI: 10.1097/wnr.0000000000001838] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
Abstract
The premotor cortex is traditionally known to be involved in motor preparation and execution. More recently, evidence from neuroscience research shows that the dorsal premotor cortex (PMd) is also involved in sensory error-based motor adaptation and that invasive brain stimulation on PMd can attenuate adaptation in monkeys. The present study examines if adaptation can be modulated noninvasively in humans. Twenty-five healthy volunteers participated in a motor task in which rapid arm-reaching movements were made to hit a target, whereas the online cursor feedback about the hand position was visually rotated, inducing sensory error that drove motor adaptation. Transcranial magnetic stimulation (TMS) was delivered to PMd just before experiencing a sensory error, as in the previous study on monkeys. The degree of motor adaptation was measured as the change in the hand direction in response to the experienced error. TMS was found to increase adaptation compared with control conditions. Interestingly, the direction of modulation was opposite to the previous study on monkeys, which might originate from different methods and parameters of stimulation. The effect was also location-specific and was not a mere artifact of applying TMS because the facilitatory modulation occurred when stimulating PMd but not when stimulating the ventral premotor cortex, which was known for different roles and networks from PMd. Since noninvasive neuromodulation is a promising tool for research and clinical practice, the present study demonstrates that PMd is a feasible target region of neuromodulation to understand human motor adaptation and improve motor rehabilitation.
Collapse
|
16
|
Zippi EL, You AK, Ganguly K, Carmena JM. Selective modulation of cortical population dynamics during neuroprosthetic skill learning. Sci Rep 2022; 12:15948. [PMID: 36153356 PMCID: PMC9509316 DOI: 10.1038/s41598-022-20218-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 09/09/2022] [Indexed: 01/23/2023] Open
Abstract
Brain-machine interfaces (BMIs) provide a framework for studying how cortical population dynamics evolve over learning in a task in which the mapping between neural activity and behavior is precisely defined. Learning to control a BMI is associated with the emergence of coordinated neural dynamics in populations of neurons whose activity serves as direct input to the BMI decoder (direct subpopulation). While previous work shows differential modification of firing rate modulation in this population relative to a population whose activity was not directly input to the BMI decoder (indirect subpopulation), little is known about how learning-related changes in cortical population dynamics within these groups compare.To investigate this, we monitored both direct and indirect subpopulations as two macaque monkeys learned to control a BMI. We found that while the combined population increased coordinated neural dynamics, this increase in coordination was primarily driven by changes in the direct subpopulation. These findings suggest that motor cortex refines cortical dynamics by increasing neural variance throughout the entire population during learning, with a more pronounced coordination of firing activity in subpopulations that are causally linked to behavior.
Collapse
Affiliation(s)
- Ellen L. Zippi
- grid.47840.3f0000 0001 2181 7878Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA 94720 USA
| | - Albert K. You
- grid.47840.3f0000 0001 2181 7878Department of Electrical Engineering and Computer Sciences, University of California Berkeley, Berkeley, CA 94720 USA
| | - Karunesh Ganguly
- grid.410372.30000 0004 0419 2775Neurology and Rehabilitation Service, San Francisco VA Medical Center, San Francisco, CA 94121 USA ,grid.266102.10000 0001 2297 6811Department of Neurology, University of California, San Francisco, CA 94143 USA
| | - Jose M. Carmena
- grid.47840.3f0000 0001 2181 7878Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA 94720 USA ,grid.47840.3f0000 0001 2181 7878Department of Electrical Engineering and Computer Sciences, University of California Berkeley, Berkeley, CA 94720 USA
| |
Collapse
|
17
|
Abekawa N, Ito S, Gomi H. Gaze-specific motor memories for hand-reaching. Curr Biol 2022; 32:2747-2753.e6. [DOI: 10.1016/j.cub.2022.04.065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 03/23/2022] [Accepted: 04/22/2022] [Indexed: 10/18/2022]
|
18
|
Toor B, van den Berg NH, Fang Z, Pozzobon A, Ray LB, Fogel SM. Age-related differences in problem-solving skills: Reduced benefit of sleep for memory trace consolidation. Neurobiol Aging 2022; 116:55-66. [DOI: 10.1016/j.neurobiolaging.2022.04.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Revised: 04/05/2022] [Accepted: 04/17/2022] [Indexed: 10/18/2022]
|
19
|
Weightman M, Brittain JS, Miall RC, Jenkinson N. Residual errors in visuomotor adaptation persist despite extended motor preparation periods. J Neurophysiol 2022; 127:519-528. [PMID: 35044854 PMCID: PMC8836731 DOI: 10.1152/jn.00301.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
A consistent finding in sensorimotor adaptation is a persistent undershoot of full compensation, such that performance asymptotes with residual errors greater than seen at baseline. This behavior has been attributed to limiting factors within the implicit adaptation system, which reaches a suboptimal equilibrium between trial-by-trial learning and forgetting. However, recent research has suggested that allowing longer motor planning periods prior to movement eliminates these residual errors. The additional planning time allows required cognitive processes to be completed before movement onset, thus increasing accuracy. Here, we looked to extend these findings by investigating the relationship between increased motor preparation time and the size of imposed visuomotor rotation (30°, 45°, or 60°), with regard to the final asymptotic level of adaptation. We found that restricting preparation time to 0.35 s impaired adaptation for moderate and larger rotations, resulting in larger residual errors compared to groups with additional preparation time. However, we found that even extended preparation time failed to eliminate persistent errors, regardless of magnitude of cursor rotation. Thus, the asymptote of adaptation was significantly less than the degree of imposed rotation, for all experimental groups. In addition, there was a positive relationship between asymptotic error and implicit retention. These data suggest that a prolonged motor preparation period is insufficient to reliably achieve complete adaptation, and therefore, our results suggest that factors beyond that of planning time contribute to asymptotic adaptation levels.NEW & NOTEWORTHY Residual errors in sensorimotor adaptation are commonly attributed to an equilibrium between trial-by-trial learning and forgetting. Recent research suggested that allowing sufficient time for mental rotation eliminates these errors. In a number of experimental conditions, we show that although restricted motor preparation time does limit adaptation-consistent with mental rotation-extending preparation time fails to eliminate the residual errors in motor adaptation.
Collapse
Affiliation(s)
- Matthew Weightman
- 1School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham, United Kingdom,3MRC-Versus Arthritis Centre for Musculoskeletal Ageing Research, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| | - John-Stuart Brittain
- 2School of Psychology, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| | - R. Chris Miall
- 2School of Psychology, University of Birmingham, Birmingham, United Kingdom,3MRC-Versus Arthritis Centre for Musculoskeletal Ageing Research, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| | - Ned Jenkinson
- 1School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham, United Kingdom,3MRC-Versus Arthritis Centre for Musculoskeletal Ageing Research, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| |
Collapse
|
20
|
Sun X, O'Shea DJ, Golub MD, Trautmann EM, Vyas S, Ryu SI, Shenoy KV. Cortical preparatory activity indexes learned motor memories. Nature 2022; 602:274-279. [PMID: 35082444 PMCID: PMC9851374 DOI: 10.1038/s41586-021-04329-x] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2020] [Accepted: 12/09/2021] [Indexed: 01/21/2023]
Abstract
The brain's remarkable ability to learn and execute various motor behaviours harnesses the capacity of neural populations to generate a variety of activity patterns. Here we explore systematic changes in preparatory activity in motor cortex that accompany motor learning. We trained rhesus monkeys to learn an arm-reaching task1 in a curl force field that elicited new muscle forces for some, but not all, movement directions2,3. We found that in a neural subspace predictive of hand forces, changes in preparatory activity tracked the learned behavioural modifications and reassociated4 existing activity patterns with updated movements. Along a neural population dimension orthogonal to the force-predictive subspace, we discovered that preparatory activity shifted uniformly for all movement directions, including those unaltered by learning. During a washout period when the curl field was removed, preparatory activity gradually reverted in the force-predictive subspace, but the uniform shift persisted. These persistent preparatory activity patterns may retain a motor memory of the learned field5,6 and support accelerated relearning of the same curl field. When a set of distinct curl fields was learned in sequence, we observed a corresponding set of field-specific uniform shifts which separated the associated motor memories in the neural state space7-9. The precise geometry of these uniform shifts in preparatory activity could serve to index motor memories, facilitating the acquisition, retention and retrieval of a broad motor repertoire.
Collapse
Affiliation(s)
- Xulu Sun
- Department of Biology, Stanford University, Stanford, CA, USA.
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA.
| | - Daniel J O'Shea
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Matthew D Golub
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Eric M Trautmann
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Saurabh Vyas
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
| | - Stephen I Ryu
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Palo Alto Medical Foundation, Palo Alto, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Krishna V Shenoy
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA.
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA.
- Department of Bioengineering, Stanford University, Stanford, CA, USA.
- Department of Neurosurgery, Stanford University, Stanford, CA, USA.
- Department of Neurobiology, Stanford University, Stanford, CA, USA.
- Howard Hughes Medical Institute, Stanford University, Stanford, CA, USA.
| |
Collapse
|
21
|
Forano M, Schween R, Taylor JA, Hegele M, Franklin DW. Direct and indirect cues can enable dual adaptation, but through different learning processes. J Neurophysiol 2021; 126:1490-1506. [PMID: 34550024 DOI: 10.1152/jn.00166.2021] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Switching between motor tasks requires accurate adjustments for changes in dynamics (grasping a cup) or sensorimotor transformations (moving a computer mouse). Dual-adaptation studies have investigated how learning of context-dependent dynamics or transformations is enabled by sensory cues. However, certain cues, such as color, have shown mixed results. We propose that these mixed results may arise from two major classes of cues: "direct" cues, which are part of the dynamic state and "indirect" cues, which are not. We hypothesized that explicit strategies would primarily account for the adaptation of an indirect color cue but would be limited to simple tasks, whereas a direct visual separation cue would allow implicit adaptation regardless of task complexity. To test this idea, we investigated the relative contribution of implicit and explicit learning in relation to contextual cue type (colored or visually shifted workspace) and task complexity (1 or 8 targets) in a dual-adaptation task. We found that the visual workspace location cue enabled adaptation across conditions primarily through implicit adaptation. In contrast, we found that the color cue was largely ineffective for dual adaptation, except in a small subset of participants who appeared to use explicit strategies. Our study suggests that the previously inconclusive role of color cues in dual adaptation may be explained by differential contribution of explicit strategies across conditions.NEW & NOTEWORTHY We present evidence that learning of context-dependent dynamics proceeds via different processes depending on the type of sensory cue used to signal the context. Visual workspace location enabled learning different dynamics implicitly, presumably because it directly enters the dynamic state estimate. In contrast, a color cue was only successful where learners were apparently able to leverage explicit strategies to account for changed dynamics. This suggests a unification for the previously inconclusive role of color cues.
Collapse
Affiliation(s)
- Marion Forano
- Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany
| | - Raphael Schween
- Department of Psychology and Sport Science, Justus Liebig University, Giessen, Germany.,Department of Psychology, Philipps-University, Marburg, Germany
| | - Jordan A Taylor
- Department of Psychology, Princeton University, Princeton, New Jersey
| | - Mathias Hegele
- Department of Psychology and Sport Science, Justus Liebig University, Giessen, Germany.,Center for Mind, Brain and Behavior, Universities of Marburg and Giessen, Marburg and Giessen, Germany
| | - David W Franklin
- Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany.,Munich Institute of Robotics and Machine Intelligence, Technical University of Munich, Munich, Germany.,Munich Data Science Institute, Technical University of Munich, Munich, Germany
| |
Collapse
|
22
|
Hill CM, Waddell DE, Del Arco A. Cortical preparatory activity during motor learning reflects visuomotor retention deficits after punishment feedback. Exp Brain Res 2021; 239:3243-3254. [PMID: 34453554 DOI: 10.1007/s00221-021-06200-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2021] [Accepted: 08/17/2021] [Indexed: 10/20/2022]
Abstract
Previous studies have shown that reinforcement-based motor learning requires the brain to process feedback-related information after movement execution. However, whether reinforcement feedback changes how the brain processes motor preparation before movement execution is unclear. By using electroencephalography (EEG), this study investigates whether reinforcement feedback changes cortical preparatory activity to modulate motor learning and memory. Human subjects were divided in three groups [reward, punishment, control] to perform a visuomotor rotation task under different conditions that assess adaptation (learning) and retention (memory) during the task. Reinforcement feedback was provided in the form of points after each trial that signaled monetary gains (reward) or losses (punishment). EEG was utilized to evaluate the amplitude of movement readiness potentials (MRPs) at the beginning of each trial for each group during the adaptation and retention conditions of the task. The results show that punishment feedback significantly decreased MRPs amplitude during both task conditions compared to Reward and Control groups. Moreover, the punishment-related decrease in MRPs amplitude paralleled decreases in motor performance during the retention but not the adaptation condition. No changes in MRPs or motor performance were observed in the Reward group. These results support the idea that reinforcement feedback modulates motor preparation and suggest that changes in cortical preparatory activity contribute to the visuomotor retention deficits observed after punishment feedback.
Collapse
Affiliation(s)
- Christopher M Hill
- Kinesiology and Physical Education, Northern Illinois University, 228 Anderson Hall, DeKalb, IL, 60115, USA.
| | - Dwight E Waddell
- Biomedical Engineering, University of Mississippi, Oxford, MS, USA
| | - Alberto Del Arco
- Health, Exercise Science, and Recreation Management, University of Mississippi, Oxford, MS, USA.,Neurobiology and Anatomical Sciences, University of Mississippi Medical Center, Jackson, MS, USA
| |
Collapse
|
23
|
Abstract
Significant experimental, computational, and theoretical work has identified rich structure within the coordinated activity of interconnected neural populations. An emerging challenge now is to uncover the nature of the associated computations, how they are implemented, and what role they play in driving behavior. We term this computation through neural population dynamics. If successful, this framework will reveal general motifs of neural population activity and quantitatively describe how neural population dynamics implement computations necessary for driving goal-directed behavior. Here, we start with a mathematical primer on dynamical systems theory and analytical tools necessary to apply this perspective to experimental data. Next, we highlight some recent discoveries resulting from successful application of dynamical systems. We focus on studies spanning motor control, timing, decision-making, and working memory. Finally, we briefly discuss promising recent lines of investigation and future directions for the computation through neural population dynamics framework.
Collapse
Affiliation(s)
- Saurabh Vyas
- Department of Bioengineering, Stanford University, Stanford, California 94305, USA; .,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA
| | - Matthew D Golub
- Department of Electrical Engineering, Stanford University, Stanford, California 94305, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA
| | - David Sussillo
- Department of Electrical Engineering, Stanford University, Stanford, California 94305, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA.,Google AI, Google Inc., Mountain View, California 94305, USA
| | - Krishna V Shenoy
- Department of Bioengineering, Stanford University, Stanford, California 94305, USA; .,Department of Electrical Engineering, Stanford University, Stanford, California 94305, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA.,Department of Neurobiology, Bio-X Institute, Neurosciences Program, and Howard Hughes Medical Institute, Stanford University, Stanford, California 94305, USA
| |
Collapse
|
24
|
Measurement, manipulation and modeling of brain-wide neural population dynamics. Nat Commun 2021; 12:633. [PMID: 33504773 PMCID: PMC7840924 DOI: 10.1038/s41467-020-20371-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2020] [Accepted: 11/24/2020] [Indexed: 12/12/2022] Open
Abstract
Neural recording technologies increasingly enable simultaneous measurement of neural activity from multiple brain areas. To gain insight into distributed neural computations, a commensurate advance in experimental and analytical methods is necessary. We discuss two opportunities towards this end: the manipulation and modeling of neural population dynamics.
Collapse
|
25
|
Prolonged response time helps eliminate residual errors in visuomotor adaptation. Psychon Bull Rev 2021; 28:834-844. [PMID: 33483935 PMCID: PMC8219572 DOI: 10.3758/s13423-020-01865-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/11/2020] [Indexed: 12/18/2022]
Abstract
One persistent curiosity in visuomotor adaptation tasks is that participants often do not reach maximal performance. This incomplete asymptote has been explained as a consequence of obligatory computations within the implicit adaptation system, such as an equilibrium between learning and forgetting. A body of recent work has shown that in standard adaptation tasks, cognitive strategies operate alongside implicit learning. We reasoned that incomplete learning in adaptation tasks may primarily reflect a speed-accuracy tradeoff on time-consuming motor planning. Across three experiments, we find evidence supporting this hypothesis, showing that hastened motor planning may primarily lead to under-compensation. When an obligatory waiting period was administered before movement start, participants were able to fully counteract imposed perturbations (Experiment 1). Inserting the same delay between trials – rather than during movement planning – did not induce full compensation, suggesting that the motor planning interval influences the learning asymptote (Experiment 2). In the last experiment (Experiment 3), we asked participants to continuously report their movement intent. We show that emphasizing explicit re-aiming strategies (and concomitantly increasing planning time) also lead to complete asymptotic learning. Findings from all experiments support the hypothesis that incomplete adaptation is, in part, the result of an intrinsic speed-accuracy tradeoff, perhaps related to cognitive strategies that require parametric attentional reorienting from the visual target to the goal.
Collapse
|
26
|
Al Borno M, Vyas S, Shenoy KV, Delp SL. High-fidelity musculoskeletal modeling reveals that motor planning variability contributes to the speed-accuracy tradeoff. eLife 2020; 9:57021. [PMID: 33325369 PMCID: PMC7787661 DOI: 10.7554/elife.57021] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Accepted: 12/15/2020] [Indexed: 11/16/2022] Open
Abstract
A long-standing challenge in motor neuroscience is to understand the relationship between movement speed and accuracy, known as the speed-accuracy tradeoff. Here, we introduce a biomechanically realistic computational model of three-dimensional upper extremity movements that reproduces well-known features of reaching movements. This model revealed that the speed-accuracy tradeoff, as described by Fitts’ law, emerges even without the presence of motor noise, which is commonly believed to underlie the speed-accuracy tradeoff. Next, we analyzed motor cortical neural activity from monkeys reaching to targets of different sizes. We found that the contribution of preparatory neural activity to movement duration (MD) variability is greater for smaller targets than larger targets, and that movements to smaller targets exhibit less variability in population-level preparatory activity, but greater MD variability. These results propose a new theory underlying the speed-accuracy tradeoff: Fitts’ law emerges from greater task demands constraining the optimization landscape in a fashion that reduces the number of ‘good’ control solutions (i.e., faster reaches). Thus, contrary to current beliefs, the speed-accuracy tradeoff could be a consequence of motor planning variability and not exclusively signal-dependent noise.
Collapse
Affiliation(s)
- Mazen Al Borno
- Department of Bioengineering, Stanford University, Stanford, United States.,Department of Computer Science and Engineering, University of Colorado Denver, Denver, United States
| | - Saurabh Vyas
- Department of Bioengineering, Stanford University, Stanford, United States
| | - Krishna V Shenoy
- Department of Bioengineering, Stanford University, Stanford, United States.,Neurosciences Program, Stanford University, Stanford, United States.,Department of Electrical Engineering, Stanford University, Stanford, United States.,Wu Tsai Neuroscience Institute, Stanford University, Stanford, United States.,Department of Neurobiology, Stanford University, Stanford, United States.,Howard Hughes Medical Institute, Stanford University, Stanford, United States
| | - Scott L Delp
- Department of Bioengineering, Stanford University, Stanford, United States.,Department of Mechanical Engineering, Stanford University, Stanford, United States
| |
Collapse
|
27
|
Li N, Mrsic-Flogel TD. Cortico-cerebellar interactions during goal-directed behavior. Curr Opin Neurobiol 2020; 65:27-37. [PMID: 32979846 PMCID: PMC7770085 DOI: 10.1016/j.conb.2020.08.010] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2020] [Revised: 08/17/2020] [Accepted: 08/21/2020] [Indexed: 12/14/2022]
Abstract
Preparatory activity is observed across multiple interconnected brain regions before goal-directed movement. Preparatory activity reflects discrete activity states representing specific future actions. It is unclear how this activity is mediated by multi-regional interactions. Recent evidence suggests that the cerebellum, classically associated with fine motor control, contributes to preparatory activity in the neocortex. We review recent advances and offer perspective on the function of cortico-cerebellar interactions during goal-directed behavior. We propose that the cerebellum learns to facilitate transitions between neocortical activity states. Transitions between activity states enable flexible and appropriately timed behavioral responses.
Collapse
Affiliation(s)
- Nuo Li
- Department of Neuroscience, Baylor College of Medicine, United States.
| | - Thomas D Mrsic-Flogel
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, United Kingdom.
| |
Collapse
|
28
|
Vassiliadis P, Derosiere G, Grandjean J, Duque J. Motor training strengthens corticospinal suppression during movement preparation. J Neurophysiol 2020; 124:1656-1666. [DOI: 10.1152/jn.00378.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023] Open
Abstract
Movement preparation involves a broad suppression in the excitability of the corticospinal pathway, a phenomenon called preparatory suppression. Here, we show that motor training strengthens preparatory suppression and that this strengthening is associated with faster reaction times. Our findings highlight a key role of preparatory suppression in training-driven behavioral improvements.
Collapse
Affiliation(s)
- Pierre Vassiliadis
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
- Center for Neuroprosthetics and Brain Mind Institute, Swiss Federal Institute of Technology (EPFL), Campus Biotech, Geneva, Switzerland
| | - Gerard Derosiere
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
| | - Julien Grandjean
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
| | - Julie Duque
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
| |
Collapse
|
29
|
Nguyen AT, Jacobs LA, Tresilian JR, Lipp OV, Marinovic W. Preparatory suppression and facilitation of voluntary and involuntary responses to loud acoustic stimuli in an anticipatory timing task. Psychophysiology 2020; 58:e13730. [PMID: 33244760 DOI: 10.1111/psyp.13730] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 10/29/2020] [Accepted: 10/30/2020] [Indexed: 01/09/2023]
Abstract
In this study, we sought to characterize the effects of intense sensory stimulation on voluntary and involuntary behaviors at different stages of preparation for an anticipated action. We presented unexpected loud acoustic stimuli (LAS) at-rest and at three critical times during active movement preparation (-1,192, -392, and 0 ms relative to expected voluntary movement onset) to probe the state of the nervous system, and measured their effect on voluntary and involuntary motor actions (finger-press and eye-blink startle reflex, respectively). Voluntary responses were facilitated by LAS presented during active preparation, leading to earlier and more forceful responses compared to control and LAS at-rest. Notably, voluntary responses were significantly facilitated on trials where the LAS was presented early during preparation (-1,192 ms). Eye-blink reflexes to the LAS at -392 ms were significantly reduced and delayed compared to blinks elicited at other time-points, indicating suppression of sub-cortical excitability. However, voluntary responses on these trials were still facilitated by the LAS. The results provide insight into the mechanisms involved in preparing anticipatory actions. Induced activation can persist in the nervous system and can modulate subsequent actions for a longer time-period than previously thought, highlighting that movement preparation is a continuously evolving process that is susceptible to external influence throughout the preparation period. Suppression of sub-cortical excitability shortly before movement onset is consistent with previous work showing corticospinal suppression which may be a necessary step before the execution of any voluntary response.
Collapse
Affiliation(s)
- An T Nguyen
- School of Psychology, Curtin University, Perth, WA, Australia
| | - Le-Anne Jacobs
- School of Psychology, Curtin University, Perth, WA, Australia
| | | | - Ottmar V Lipp
- School of Psychology, Curtin University, Perth, WA, Australia
| | | |
Collapse
|
30
|
Maeda RS, Kersten R, Pruszynski JA. Shared internal models for feedforward and feedback control of arm dynamics in non-human primates. Eur J Neurosci 2020; 53:1605-1620. [PMID: 33222285 DOI: 10.1111/ejn.15056] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Revised: 11/12/2020] [Accepted: 11/13/2020] [Indexed: 11/30/2022]
Abstract
Previous work has shown that humans account for and learn novel properties or the arm's dynamics, and that such learning causes changes in both the predictive (i.e., feedforward) control of reaching and reflex (i.e., feedback) responses to mechanical perturbations. Here we show that similar observations hold in old-world monkeys (Macaca fascicularis). Two monkeys were trained to use an exoskeleton to perform a single-joint elbow reaching and to respond to mechanical perturbations that created pure elbow motion. Both of these tasks engaged robust shoulder muscle activity as required to account for the torques that typically arise at the shoulder when the forearm rotates around the elbow joint (i.e., intersegmental dynamics). We altered these intersegmental arm dynamics by having the monkeys generate the same elbow movements with the shoulder joint either free to rotate, as normal, or fixed by the robotic manipulandum, which eliminates the shoulder torques caused by forearm rotation. After fixing the shoulder joint, we found a systematic reduction in shoulder muscle activity. In addition, after releasing the shoulder joint again, we found evidence of kinematic aftereffects (i.e., reach errors) in the direction predicted if failing to compensate for normal arm dynamics. We also tested whether such learning transfers to feedback responses evoked by mechanical perturbations and found a reduction in shoulder feedback responses, as appropriate for these altered arm intersegmental dynamics. Demonstrating this learning and transfer in non-human primates will allow the investigation of the neural mechanisms involved in feedforward and feedback control of the arm's dynamics.
Collapse
Affiliation(s)
- Rodrigo S Maeda
- Brain and Mind Institute, Western University, London, ON, Canada.,Robarts Research Institute, Western University, London, ON, Canada.,Department of Psychology, Western University, London, ON, Canada
| | - Rhonda Kersten
- Robarts Research Institute, Western University, London, ON, Canada.,Department of Physiology and Pharmacology, Western University, London, ON, Canada
| | - J Andrew Pruszynski
- Brain and Mind Institute, Western University, London, ON, Canada.,Robarts Research Institute, Western University, London, ON, Canada.,Department of Psychology, Western University, London, ON, Canada.,Department of Physiology and Pharmacology, Western University, London, ON, Canada
| |
Collapse
|