1
|
Li M, Qi E, Xu G, Jin J, Zhao Q, Guo M, Liao W. A delayed matching task-based study on action sequence of motor imagery. Cogn Neurodyn 2024; 18:1593-1607. [PMID: 39104677 PMCID: PMC11297855 DOI: 10.1007/s11571-023-10030-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 09/28/2023] [Accepted: 10/23/2023] [Indexed: 08/07/2024] Open
Abstract
The way people imagine greatly affects performance of brain-computer interface (BCI) based on motion imagery (MI). Action sequence is a basic unit of imitation, learning, and memory for motor behavior. Whether it influences the MI-BCI is unknown, and how to manifest this influence is difficult since the MI is a spontaneous brain activity. To investigate the influence of the action sequence, this study proposes a novel paradigm named action sequences observing and delayed matching task to use images and videos to guide people to observe, match and reinforce the memory of sequence. Seven subjects' ERPs and MI performance are analyzed under four different levels of complexities or orders of the sequence. Results demonstrated that the action sequence in terms of complexity and sequence order significantly affects the MI. The complex action in positive order obtains stronger ERD/ERS and more pronounced MI feature distributions, and yields an MI classification accuracy that is 12.3% higher than complex action in negative order (p < 0.05). In addition, the ERP amplitudes derived from the supplementary motor area show a positive correlation to the MI. This study demonstrates a new perspective of improving imagery in the MI-BCI by considering the complexity and order of the action sequences, and provides a novel index for manifesting the MI performance by ERP.
Collapse
Affiliation(s)
- Mengfan Li
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Enming Qi
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Guizhi Xu
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Jing Jin
- Key Laboratory of Advanced Control and Optimization for Chemical Processes, East China, University of Science and Technology, Shanghai, 518063 China
- Shenzhen Research Institute of East China, University of Science and Technology, Shenzhen, 518063 China
| | - Qi Zhao
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Miaomiao Guo
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Wenzhe Liao
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, 300132 China
| |
Collapse
|
2
|
Beck DW, Heaton CN, Davila LD, Rakocevic LI, Drammis SM, Tyulmankov D, Vara P, Giri A, Umashankar Beck S, Zhang Q, Pokojovy M, Negishi K, Batson SA, Salcido AA, Reyes NF, Macias AY, Ibanez-Alcala RJ, Hossain SB, Waller GL, O'Dell LE, Moschak TM, Goosens KA, Friedman A. Model of a striatal circuit exploring biological mechanisms underlying decision-making during normal and disordered states. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.29.605535. [PMID: 39211231 PMCID: PMC11361035 DOI: 10.1101/2024.07.29.605535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Abstract
Decision-making requires continuous adaptation to internal and external contexts. Changes in decision-making are reliable transdiagnostic symptoms of neuropsychiatric disorders. We created a computational model demonstrating how the striosome compartment of the striatum constructs a mathematical space for decision-making computations depending on context, and how the matrix compartment defines action value depending on the space. The model explains multiple experimental results and unifies other theories like reward prediction error, roles of the direct versus indirect pathways, and roles of the striosome versus matrix, under one framework. We also found, through new analyses, that striosome and matrix neurons increase their synchrony during difficult tasks, caused by a necessary increase in dimensionality of the space. The model makes testable predictions about individual differences in disorder susceptibility, decision-making symptoms shared among neuropsychiatric disorders, and differences in neuropsychiatric disorder symptom presentation. The model reframes the role of the striosomal circuit in neuroeconomic and disorder-affected decision-making. Highlights Striosomes prioritize decision-related data used by matrix to set action values. Striosomes and matrix have different roles in the direct and indirect pathways. Abnormal information organization/valuation alters disorder presentation. Variance in data prioritization may explain individual differences in disorders. eTOC Beck et al. developed a computational model of how a striatal circuit functions during decision-making. The model unifies and extends theories about the direct versus indirect pathways. It further suggests how aberrant circuit function underlies decision-making phenomena observed in neuropsychiatric disorders.
Collapse
|
3
|
Buckley M, McGregor A, Ihssen N, Austen J, Thurlbeck S, Smith SP, Heinecke A, Lew AR. The well-worn route revisited: Striatal and hippocampal system contributions to familiar route navigation. Hippocampus 2024; 34:310-326. [PMID: 38721743 DOI: 10.1002/hipo.23607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 02/20/2024] [Accepted: 04/17/2024] [Indexed: 06/21/2024]
Abstract
Classic research has shown a division in the neuroanatomical structures that support flexible (e.g., short-cutting) and habitual (e.g., familiar route following) navigational behavior, with hippocampal-caudate systems associated with the former and putamen systems with the latter. There is, however, disagreement about whether the neural structures involved in navigation process particular forms of spatial information, such as associations between constellations of cues forming a cognitive map, versus single landmark-action associations, or alternatively, perform particular reinforcement learning algorithms that allow the use of different spatial strategies, so-called model-based (flexible) or model-free (habitual) forms of learning. We sought to test these theories by asking participants (N = 24) to navigate within a virtual environment through a previously learned, 9-junction route with distinctive landmarks at each junction while undergoing functional magnetic resonance imaging (fMRI). In a series of probe trials, we distinguished knowledge of individual landmark-action associations along the route versus knowledge of the correct sequence of landmark-action associations, either by having absent landmarks, or "out-of-sequence" landmarks. Under a map-based perspective, sequence knowledge would not require hippocampal systems, because there are no constellations of cues available for cognitive map formation. Within a learning-based model, however, responding based on knowledge of sequence would require hippocampal systems because prior context has to be utilized. We found that hippocampal-caudate systems were more active in probes requiring sequence knowledge, supporting the learning-based model. However, we also found greater putamen activation in probes where navigation based purely on sequence memory could be planned, supporting models of putamen function that emphasize its role in action sequencing.
Collapse
Affiliation(s)
| | | | - Niklas Ihssen
- Department of Psychology, Durham University, Durham, UK
| | - Joseph Austen
- Department of Psychology, Durham University, Durham, UK
| | | | - Shamus P Smith
- School of Information and Physical Sciences, University of Newcastle Australia, Callaghan, New South Wales, Australia
| | | | - Adina R Lew
- Department of Psychology, Lancaster University, Lancaster, UK
| |
Collapse
|
4
|
Song MR, Lee SW. Rethinking dopamine-guided action sequence learning. Eur J Neurosci 2024; 60:3447-3465. [PMID: 38798086 DOI: 10.1111/ejn.16426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 04/21/2024] [Accepted: 05/08/2024] [Indexed: 05/29/2024]
Abstract
As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.
Collapse
Affiliation(s)
- Minryung R Song
- Department of Brain and Cognitive Sciences, KAIST, Daejeon, South Korea
| | - Sang Wan Lee
- Department of Brain and Cognitive Sciences, KAIST, Daejeon, South Korea
- Kim Jaechul Graduate School of AI, KAIST, Daejeon, South Korea
- KI for Health Science and Technology, KAIST, Daejeon, South Korea
- Center for Neuroscience-inspired AI, KAIST, Daejeon, South Korea
| |
Collapse
|
5
|
Tariciotti L, Mattioli L, Viganò L, Gallo M, Gambaretti M, Sciortino T, Gay L, Conti Nibali M, Gallotti A, Cerri G, Bello L, Rossi M. Object-oriented hand dexterity and grasping abilities, from the animal quarters to the neurosurgical OR: a systematic review of the underlying neural correlates in non-human, human primate and recent findings in awake brain surgery. Front Integr Neurosci 2024; 18:1324581. [PMID: 38425673 PMCID: PMC10902498 DOI: 10.3389/fnint.2024.1324581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 01/17/2024] [Indexed: 03/02/2024] Open
Abstract
Introduction The sensorimotor integrations subserving object-oriented manipulative actions have been extensively investigated in non-human primates via direct approaches, as intracortical micro-stimulation (ICMS), cytoarchitectonic analysis and anatomical tracers. However, the understanding of the mechanisms underlying complex motor behaviors is yet to be fully integrated in brain mapping paradigms and the consistency of these findings with intraoperative data obtained during awake neurosurgical procedures for brain tumor removal is still largely unexplored. Accordingly, there is a paucity of systematic studies reviewing the cross-species analogies in neural activities during object-oriented hand motor tasks in primates and investigating the concordance with intraoperative findings during brain mapping. The current systematic review was designed to summarize the cortical and subcortical neural correlates of object-oriented fine hand actions, as revealed by fMRI and PET studies, in non-human and human primates and how those were translated into neurosurgical studies testing dexterous hand-movements during intraoperative brain mapping. Methods A systematic literature review was conducted following the PRISMA guidelines. PubMed, EMBASE and Web of Science databases were searched. Original articles were included if they: (1) investigated cortical activation sites on fMRI and/or PET during grasping task; (2) included humans or non-human primates. A second query was designed on the databases above to collect studies reporting motor, hand manipulation and dexterity tasks for intraoperative brain mapping in patients undergoing awake brain surgery for any condition. Due to the heterogeneity in neurosurgical applications, a qualitative synthesis was deemed more appropriate. Results We provided an updated overview of the current state of the art in translational neuroscience about the extended frontoparietal grasping-praxis network with a specific focus on the comparative functioning in non-human primates, healthy humans and how the latter knowledge has been implemented in the neurosurgical operating room during brain tumor resection. Discussion The anatomical and functional correlates we reviewed confirmed the evolutionary continuum from monkeys to humans, allowing a cautious but practical adoption of such evidence in intraoperative brain mapping protocols. Integrating the previous results in the surgical practice helps preserve complex motor abilities, prevent long-term disability and poor quality of life and allow the maximal safe resection of intrinsic brain tumors.
Collapse
Affiliation(s)
- Leonardo Tariciotti
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Luca Mattioli
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Luca Viganò
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Matteo Gallo
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Matteo Gambaretti
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Tommaso Sciortino
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Lorenzo Gay
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Marco Conti Nibali
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Alberto Gallotti
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Gabriella Cerri
- MoCA Laboratory, Department of Medical Biotechnology and Translational Medicine, Università degli Studi di Milano, Milan, Italy
| | - Lorenzo Bello
- Neurosurgical Oncology Unit, Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Marco Rossi
- Neurosurgical Oncology Unit, Department of Medical Biotechnology and Translational Medicine, Università degli Studi di Milano, Milan, Italy
| |
Collapse
|
6
|
Szalisznyó K, Silverstein DN. Computational insights on asymmetrical D1 and D2 receptor-mediated chunking: implications for OCD and Schizophrenia. Cogn Neurodyn 2024; 18:217-232. [PMID: 38406202 PMCID: PMC10881457 DOI: 10.1007/s11571-022-09865-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2021] [Revised: 07/06/2022] [Accepted: 07/21/2022] [Indexed: 01/15/2023] Open
Abstract
Repetitive thoughts and motor programs including perseveration are bridge symptoms characteristic of obsessive compulsive disorder (OCD), schizophrenia and in the co-morbid overlap of these conditions. The above pathologies are sensitive to altered activation and kinetics of dopamine D 1 and D 2 receptors that differently influence sequence learning and recall. Recognizing start and stop elements of motor and cognitive behaviors has crucial importance. During chunking, frequent components of temporal strings are concatenated into single units. We extended a published computational model (Asabuki et al. 2018), where two populations of neurons are connected and simulated in a reservoir computing framework. These neural pools were adopted to represent D1 and D2 striatal neuronal populations. We investigated how specific neural and striatal circuit parameters can influence start/stop signaling and found that asymmetric intra-network connection probabilities, synaptic weights and differential time constants may contribute to signaling of start/stop elements within learned sequences. Asymmetric coupling between the striatal D 1 and D 2 neural populations was also demonstrated to be beneficial. Our modeling results predict that dynamical differences between the two dopaminergic striatal populations and the interaction between them may play complementary roles in chunk boundary signaling. Start and stop dichotomies can arise from the larger circuit dynamics as well, since neural and intra-striatal connections only partially support a clear division of labor.
Collapse
Affiliation(s)
- Krisztina Szalisznyó
- Department of Medical Sciences, Psychiatry, Uppsala University Hospital, Uppsala University, 751 85 Uppsala, Sweden
- Theoretical Neuroscience and Complex Systems Research Group, Wigner Research Centre for Physics, Budapest, Hungary
| | | |
Collapse
|
7
|
Gigi I, Senatore R, Marcelli A. The onset of motor learning impairments in Parkinson's disease: a computational investigation. Brain Inform 2024; 11:4. [PMID: 38286886 PMCID: PMC11333672 DOI: 10.1186/s40708-023-00215-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 12/11/2023] [Indexed: 01/31/2024] Open
Abstract
The basal ganglia (BG) is part of a basic feedback circuit regulating cortical function, such as voluntary movements control, via their influence on thalamocortical projections. BG disorders, namely Parkinson's disease (PD), characterized by the loss of neurons in the substantia nigra, involve the progressive loss of motor functions. At the present, PD is incurable. Converging evidences suggest the onset of PD-specific pathology prior to the appearance of classical motor signs. This latent phase of neurodegeneration in PD is of particular relevance in developing more effective therapies by intervening at the earliest stages of the disease. Therefore, a key challenge in PD research is to identify and validate markers for the preclinical and prodromal stages of the illness. We propose a mechanistic neurocomputational model of the BG at a mesoscopic scale to investigate the behavior of the simulated neural system after several degrees of lesion of the substantia nigra, with the aim of possibly evaluating which is the smallest lesion compromising motor learning. In other words, we developed a working framework for the analysis of theoretical early-stage PD. While simulations in healthy conditions confirm the key role of dopamine in learning, in pathological conditions the network predicts that there may exist abnormalities of the motor learning process, for physiological alterations in the BG, that do not yet involve the presence of symptoms typical of the clinical diagnosis.
Collapse
Affiliation(s)
- Ilaria Gigi
- Institute of Cognitive Sciences and Technologies (ISTC), National Research Council of Italy (CNR), Via Beato Pellegrino 28, Padova, 35137, Veneto, Italy.
| | - Rosa Senatore
- Natural Intelligent Technologies Ltd, Piazza Vittorio Emanuele 10, Fisciano, 84084, Campania, Italy
| | - Angelo Marcelli
- Department of Information Engineering, Electrical Engineering, and Applied Mathematics (DIEM), University of Salerno, Via Giovanni Paolo II 132, Fisciano, 84084, Campania, Italy
| |
Collapse
|
8
|
Fraser KM, Chen BJ, Janak PH. Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance. Eur J Neurosci 2024; 59:220-237. [PMID: 38093522 PMCID: PMC10841748 DOI: 10.1111/ejn.16210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Revised: 11/09/2023] [Accepted: 11/15/2023] [Indexed: 01/23/2024]
Abstract
Separable striatal circuits have unique functions in Pavlovian and instrumental behaviors but how these roles relate to performance of sequences of actions with and without associated cues are less clear. Here, we tested whether dopamine transmission and neural activity more generally in three striatal subdomains are necessary for performance of an action chain leading to reward delivery. Male and female Long-Evans rats were trained to press a series of three spatially distinct levers to receive reward. We assessed the contribution of neural activity or dopamine transmission within each striatal subdomain when progression through the action sequence was explicitly cued and in the absence of cues. Behavior in both task variations was substantially impacted following microinfusion of the dopamine antagonist, flupenthixol, into nucleus accumbens core (NAc) or dorsomedial striatum (DMS), with impairments in sequence timing and numbers of rewards earned after NAc flupenthixol. In contrast, after pharmacological inactivation to suppress overall activity, there was minimal impact on total rewards earned. Instead, inactivation of both NAc and DMS impaired sequence timing and led to sequence errors in the uncued, but not cued task. There was no impact of dopamine antagonism or reversible inactivation of dorsolateral striatum on either cued or uncued action sequence completion. These results highlight an essential contribution of NAc and DMS dopamine systems in motivational and performance aspects of chains of actions, whether cued or internally generated, as well as the impact of intact NAc and DMS function for correct sequence performance.
Collapse
Affiliation(s)
- Kurt M. Fraser
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218
| | - Bridget J. Chen
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218
| | - Patricia H. Janak
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218
- Solomon H. Snyder Department of Neuroscience, School of Medicine, Johns Hopkins University, Baltimore, MD, 21205
- Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD 21218
| |
Collapse
|
9
|
Kiani MM, Heidari Beni MH, Aghajan H. Aberrations in temporal dynamics of cognitive processing induced by Parkinson's disease and Levodopa. Sci Rep 2023; 13:20195. [PMID: 37980451 PMCID: PMC10657430 DOI: 10.1038/s41598-023-47410-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 11/10/2023] [Indexed: 11/20/2023] Open
Abstract
The motor symptoms of Parkinson's disease (PD) have been shown to significantly improve by Levodopa. However, despite the widespread adoption of Levodopa as a standard pharmaceutical drug for the treatment of PD, cognitive impairments linked to PD do not show visible improvement with Levodopa treatment. Furthermore, the neuronal and network mechanisms behind the PD-induced cognitive impairments are not clearly understood. In this work, we aim to explain these cognitive impairments, as well as the ones exacerbated by Levodopa, through examining the differential dynamic patterns of the phase-amplitude coupling (PAC) during cognitive functions. EEG data recorded in an auditory oddball task performed by a cohort consisting of controls and a group of PD patients during both on and off periods of Levodopa treatment were analyzed to derive the temporal dynamics of the PAC across the brain. We observed distinguishing patterns in the PAC dynamics, as an indicator of information binding, which can explain the slower cognitive processing associated with PD in the form of a latency in the PAC peak time. Thus, considering the high-level connections between the hippocampus, the posterior and prefrontal cortices established through the dorsal and ventral striatum acting as a modulatory system, we posit that the primary issue with cognitive impairments of PD, as well as Levodopa's cognitive deficit side effects, can be attributed to the changes in temporal dynamics of dopamine release influencing the modulatory function of the striatum.
Collapse
Affiliation(s)
- Mohammad Mahdi Kiani
- Department of Electrical Engineering, Sharif University of Technology, Tehran, Iran
| | | | - Hamid Aghajan
- Department of Electrical Engineering, Sharif University of Technology, Tehran, Iran.
| |
Collapse
|
10
|
Ohno-Shosaku T, Yoneda M, Maejima T, Wang M, Kikuchi Y, Onodera K, Kanazawa Y, Takayama C, Mieda M. Action Sequence Learning Is Impaired in Genetically Modified Mice with the Suppressed GABAergic Transmission from the Thalamic Reticular Nucleus to the Thalamus. Neuroscience 2023; 532:87-102. [PMID: 37778689 DOI: 10.1016/j.neuroscience.2023.09.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 09/21/2023] [Accepted: 09/25/2023] [Indexed: 10/03/2023]
Abstract
The thalamic reticular nucleus (TRN) is a thin sheet of GABAergic neurons surrounding the thalamus, and it regulates the activity of thalamic relay neurons. The TRN has been reported to be involved in sensory gating, attentional regulation, and some other functions. However, little is known about the contribution of the TRN to sequence learning. In the present study, we examined whether the TRN is involved in reward-based learning of action sequence with no eliciting stimuli (operant conditioning), by analyzing the performance of male and female Avp-Vgat-/- mice (Vgatflox/flox mice crossed to an Avp-Cre driver line) on tasks conducted in an operant box having three levers. Our histological and electrophysiological data demonstrated that in adult Avp-Vgat-/- mice, vesicular GABA transporter (VGAT) was absent in most TRN neurons and the GABAergic transmission from the TRN to the thalamus was largely suppressed. The performance on a task in which mice needed to press an active lever for food reward showed that simple operant learning of lever pressing and learning of win-stay and lose-shift strategies are not affected in Avp-Vgat-/- mice. In contrast, the performance on a task in which mice needed to press three levers in a correct order for food reward showed that learning of the order of lever pressing (action sequence learning) was impaired in Avp-Vgat-/- mice. These results suggest that the TRN plays an important role in action sequence learning.
Collapse
Affiliation(s)
- Takako Ohno-Shosaku
- Faculty of Health Sciences, Institute of Medical, Pharmaceutical and Health Sciences, Kanazawa University, Kanazawa 920-0942, Japan; Department of Integrative Neurophysiology, Graduate School of Medical Sciences, Kanazawa University, Kanazawa 920-8640, Japan; Faculty of Health and Medical Sciences, Hokuriku University, Kanazawa 920-1180, Japan.
| | - Mitsugu Yoneda
- Faculty of Health Sciences, Institute of Medical, Pharmaceutical and Health Sciences, Kanazawa University, Kanazawa 920-0942, Japan
| | - Takashi Maejima
- Department of Integrative Neurophysiology, Graduate School of Medical Sciences, Kanazawa University, Kanazawa 920-8640, Japan
| | - Mohan Wang
- Department of Integrative Neurophysiology, Graduate School of Medical Sciences, Kanazawa University, Kanazawa 920-8640, Japan
| | - Yui Kikuchi
- Faculty of Health Sciences, Institute of Medical, Pharmaceutical and Health Sciences, Kanazawa University, Kanazawa 920-0942, Japan
| | - Kaito Onodera
- Department of Integrative Neurophysiology, Graduate School of Medical Sciences, Kanazawa University, Kanazawa 920-8640, Japan
| | - Yuji Kanazawa
- Faculty of Health and Medical Sciences, Hokuriku University, Kanazawa 920-1180, Japan
| | - Chitoshi Takayama
- Department of Molecular Anatomy, School of Medicine, University of the Ryukyus, Uehara 207, Nishihara, Okinawa 903-0215, Japan
| | - Michihiro Mieda
- Department of Integrative Neurophysiology, Graduate School of Medical Sciences, Kanazawa University, Kanazawa 920-8640, Japan
| |
Collapse
|
11
|
Janssen M, LeWarne C, Burk D, Averbeck BB. Hierarchical Reinforcement Learning, Sequential Behavior, and the Dorsal Frontostriatal System. J Cogn Neurosci 2022; 34:1307-1325. [PMID: 35579977 PMCID: PMC9274316 DOI: 10.1162/jocn_a_01869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
To effectively behave within ever-changing environments, biological agents must learn and act at varying hierarchical levels such that a complex task may be broken down into more tractable subtasks. Hierarchical reinforcement learning (HRL) is a computational framework that provides an understanding of this process by combining sequential actions into one temporally extended unit called an option. However, there are still open questions within the HRL framework, including how options are formed and how HRL mechanisms might be realized within the brain. In this review, we propose that the existing human motor sequence literature can aid in understanding both of these questions. We give specific emphasis to visuomotor sequence learning tasks such as the discrete sequence production task and the M × N (M steps × N sets) task to understand how hierarchical learning and behavior manifest across sequential action tasks as well as how the dorsal cortical-subcortical circuitry could support this kind of behavior. This review highlights how motor chunks within a motor sequence can function as HRL options. Furthermore, we aim to merge findings from motor sequence literature with reinforcement learning perspectives to inform experimental design in each respective subfield.
Collapse
Affiliation(s)
| | | | - Diana Burk
- National Institute of Mental Health, Bethesda, MD
| | | |
Collapse
|
12
|
Tian W, Chen S. Neurotransmitters, Cell Types, and Circuit Mechanisms of Motor Skill Learning and Clinical Applications. Front Neurol 2021; 12:616820. [PMID: 33716924 PMCID: PMC7947691 DOI: 10.3389/fneur.2021.616820] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 01/18/2021] [Indexed: 02/02/2023] Open
Abstract
Animals acquire motor skills to better survive and adapt to a changing environment. The ability to learn novel motor actions without disturbing learned ones is essential to maintaining a broad motor repertoire. During motor learning, the brain makes a series of adjustments to build novel sensory–motor relationships that are stored within specific circuits for long-term retention. The neural mechanism of learning novel motor actions and transforming them into long-term memory still remains unclear. Here we review the latest findings with regard to the contributions of various brain subregions, cell types, and neurotransmitters to motor learning. Aiming to seek therapeutic strategies to restore the motor memory in relative neurodegenerative disorders, we also briefly describe the common experimental tests and manipulations for motor memory in rodents.
Collapse
Affiliation(s)
- Wotu Tian
- Department of Neurology and Institute of Neurology, Ruijin Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shengdi Chen
- Department of Neurology and Institute of Neurology, Ruijin Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
13
|
Aeed F, Cermak N, Schiller J, Schiller Y. Intrinsic Disruption of the M1 Cortical Network in a Mouse Model of Parkinson's Disease. Mov Disord 2021; 36:1565-1577. [PMID: 33606292 DOI: 10.1002/mds.28538] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Revised: 12/14/2020] [Accepted: 01/15/2021] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Parkinson's disease (PD) disrupts motor performance by affecting the basal ganglia system. Yet, despite the critical position of the primary motor cortex in linking basal ganglia computations with motor performance, its contribution to motor disability in PD is largely unknown. The objective of this study was to characterize the role of the primary motor cortex in PD-related motor disability. METHODS Two-photon calcium imaging and optogenetic stimulation of primary motor cortex neurons was done during performance of a dexterous reach-to-grasp motor task in control and 6-hydroxydopamine-induced PD mice. RESULTS Experimental PD disrupted performance of the reach-to-grasp motor task and especially initiation of the task, which was partially restored by optogenetic activation of the primary motor cortex. Two-photon calcium imaging during task performance revealed experimental-PD affected the primary motor cortex in a cell-type-specific manner. It suppressed activation of output layer 5 pyramidal tract neurons, with greater effects on freeze versus nonfreeze trials. In contrast, it did not attenuate the initial movement-related activation response of layer 2/3 pyramidal neurons while diminishing the late inhibitory phase of their response. At the network level, experimental PD disrupted movement-related population dynamics of the layer 5 pyramidal tract network while almost not affecting the dynamics of the layer 2/3 neuronal population. It also disrupted short- and long-term robustness and stability of the pyramidal tract subnetwork, with reduced intertrial temporal accuracy and diminished reproducibility of motor parameter encoding and temporal recruitment of the output pyramidal tract neurons over repeated daily sessions. CONCLUSIONS Experimental PD disrupts both external driving and intrinsic properties of the primary motor cortex. Motor disability in experimental PD results primarily from the inability to generate robust and stable output motor sequences in the parkinsonian primary motor cortex output layer 5 pyramidal tract subnetwork. © 2021 International Parkinson and Movement Disorder Society.
Collapse
Affiliation(s)
- Fadi Aeed
- The Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel
| | - Nathan Cermak
- The Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel
| | - Jackie Schiller
- The Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel
| | - Yitzhak Schiller
- The Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel.,Department of Neurology, Rambam Medical Center, Haifa, Israel
| |
Collapse
|
14
|
Errante A, Ziccarelli S, Mingolla G, Fogassi L. Grasping and Manipulation: Neural Bases and Anatomical Circuitry in Humans. Neuroscience 2021; 458:203-212. [PMID: 33516776 DOI: 10.1016/j.neuroscience.2021.01.028] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 01/14/2021] [Accepted: 01/20/2021] [Indexed: 02/09/2023]
Abstract
Neurophysiological and neuroimaging evidence suggests a significant contribution of several brain areas, including subdivisions of the parietal and the premotor cortex, during the processing of different components of hand and arm movements. Many investigations improved our knowledge about the neural processes underlying the execution of reaching and grasping actions, while few studies have directly investigated object manipulation. Most studies on the latter topic concern the use of tools to achieve specific goals. Yet, there are very few studies on pure manipulation performed in order to explore and recognize objects, as well as on manipulation performed with a high level of manual dexterity. Another dimension that is quite neglected by the available studies on grasping and manipulation is, on the one hand, the contribution of the subcortical nodes, first of all the basal ganglia and cerebellum, to these functions, and, on the other hand, recurrent connections of these structures with cortical areas. In the first part, we have reviewed the parieto-premotor and subcortical circuits underlying reaching and grasping in humans, with a focus on functional neuroimaging data. Then, we have described the main structures recruited during object manipulation. We have also reported the contribution of recent structural connectivity techniques whereby the cortico-cortical and cortico-subcortical connections of grasping-related and manipulation-related areas in the human brain can be determined. Based on our review, we have concluded that studies on cortical and subcortical circuits involved in grasping and manipulation might be promising to provide new insights about motor learning and brain plasticity in patients with motor disorders.
Collapse
Affiliation(s)
- Antonino Errante
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125 Parma, Italy
| | - Settimio Ziccarelli
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125 Parma, Italy
| | - Gloria Mingolla
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125 Parma, Italy
| | - Leonardo Fogassi
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125 Parma, Italy.
| |
Collapse
|
15
|
Florio TM. Stereotyped, automatized and habitual behaviours: are they similar constructs under the control of the same cerebral areas? AIMS Neurosci 2020; 7:136-152. [PMID: 32607417 PMCID: PMC7321770 DOI: 10.3934/neuroscience.2020010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Accepted: 05/18/2020] [Indexed: 11/19/2022] Open
Abstract
Comprehensive knowledge about higher executive functions of motor control has been covered in the last decades. Critical goals have been targeted through many different technological approaches. An abundant flow of new results greatly progressed our ability to respond at better-posited answers to look more than ever at the challenging neural system functioning. Behaviour is the observable result of the invisible, as complex cerebral functioning. Many pathological states are approached after symptomatology categorisation of behavioural impairments is achieved. Motor, non-motor and psychiatric signs are greatly shared by many neurological/psychiatric disorders. Together with the cerebral cortex, the basal ganglia contribute to the expression of behaviour promoting the correct action schemas and the selection of appropriate sub-goals based on the evaluation of action outcomes. The present review focus on the basic classification of higher motor control functioning, taking into account the recent advances in basal ganglia structural knowledge and the computational model of basal ganglia functioning. We discuss about the basal ganglia capability in executing ordered motor patterns in which any single movement is linked to each other into an action, and many actions are ordered into each other, giving them a syntactic value to the final behaviour. The stereotypic, automatized and habitual behaviour's constructs and controls are the expression of successive stages of rule internalization and categorisation aimed in producing the perfect spatial-temporal control of motor command.
Collapse
Affiliation(s)
- Tiziana M Florio
- Department of Life, Health and Environmental Sciences, University of L'Aquila, Italy
| |
Collapse
|
16
|
Impaired Motor Recycling during Action Selection in Parkinson's Disease. eNeuro 2020; 7:ENEURO.0492-19.2020. [PMID: 32299805 PMCID: PMC7218010 DOI: 10.1523/eneuro.0492-19.2020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2019] [Revised: 03/19/2020] [Accepted: 03/22/2020] [Indexed: 11/21/2022] Open
Abstract
Behavioral studies have shown that the human motor system recycles motor parameters of previous actions, such as movement amplitude, when programming new actions. Shifting motor plans toward a new action forms a particularly severe problem for patients with Parkinson’s disease (PD), a disorder that, in its early stage, is dominated by basal ganglia dysfunction. Here, we test whether this action selection deficit in Parkinson’s patients arises from an impaired ability to recycle motor parameters shared across subsequent actions. Parkinson’s patients off dopaminergic medication (n = 16) and matched healthy controls (n = 16) performed a task that involved moving a handheld dowel over an obstacle in the context of a sequence of aiming movements. Consistent with previous research, healthy participants continued making unnecessarily large hand movements after clearing the obstacle (defined as “hand path priming effect”), even after switching movements between hands. In contrast, Parkinson’s patients showed a reduced hand path priming effect, i.e., they performed biomechanically more efficient movements than controls, but only when switching movements between hands. This effect correlated with disease severity, such that patients with more severe motor symptoms had a smaller hand path priming effect. We propose that the basal ganglia mediate recycling of movement parameters across subsequent actions.
Collapse
|
17
|
Garr E, Delamater AR. Chemogenetic inhibition in the dorsal striatum reveals regional specificity of direct and indirect pathway control of action sequencing. Neurobiol Learn Mem 2020; 169:107169. [PMID: 31972244 DOI: 10.1016/j.nlm.2020.107169] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Revised: 01/07/2020] [Accepted: 01/18/2020] [Indexed: 11/17/2022]
Abstract
Animals engage in intricate action sequences that are constructed during instrumental learning. There is broad consensus that the basal ganglia play a crucial role in the formation and fluid performance of action sequences. To investigate the role of the basal ganglia direct and indirect pathways in action sequencing, we virally expressed Cre-dependent Gi-DREADDs in either the dorsomedial (DMS) or dorsolateral (DLS) striatum during and/or after action sequence learning in D1 and D2 Cre rats. Action sequence performance in D1 Cre rats was slowed down early in training when DREADDs were activated in the DMS, but sped up when activated in the DLS. Acquisition of the reinforced sequence was hindered when DREADDs were activated in the DLS of D2 Cre rats. Outcome devaluation tests conducted after training revealed that the goal-directed control of action sequence rates was immune to chemogenetic inhibition-rats suppressed the rate of sequence performance when rewards were devalued. Sequence initiation latencies were generally sensitive to outcome devaluation, except in the case where DREADD activation was removed in D2 Cre rats that previously experienced DREADD activation in the DMS during training. Sequence completion latencies were generally not sensitive to outcome devaluation, except in the case where D1 Cre rats experienced DREADD activation in the DMS during training and test. Collectively, these results suggest that the indirect pathway originating from the DLS is part of a circuit involved in the effective reinforcement of action sequences, while the direct and indirect pathways originating from the DMS contribute to the goal-directed control of sequence completion and initiation, respectively.
Collapse
Affiliation(s)
- Eric Garr
- Graduate Center, City University of New York, United States; Brooklyn College, City University of New York, United States.
| | - Andrew R Delamater
- Graduate Center, City University of New York, United States; Brooklyn College, City University of New York, United States
| |
Collapse
|