1
|
Okuyama S, Kuki T, Mushiake H. Recruitment of the premotor cortex during arithmetic operations by the monkey. Sci Rep 2024; 14:6450. [PMID: 38548764 PMCID: PMC10978941 DOI: 10.1038/s41598-024-56755-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 03/11/2024] [Indexed: 04/01/2024] Open
Abstract
Arithmetic operations are complex mental processes rooted in the abstract concept of numerosity. Despite the significance, the neural architecture responsible for these operations has remained largely uncharted. In this study, we explored the presence of specific neuronal activity in the dorsal premotor cortex of the monkey dedicated to numerical addition and subtraction. Our findings reveal that many of these neural activities undergo a transformation, shifting their coding from arithmetic to motor representations. These motor representations include information about which hand to use and the number of steps involved in the action. We consistently observed that cells related to the right-hand encoded addition, while those linked to the left-hand encoded subtraction, suggesting that arithmetic operations and motor commands are intertwining with each other. Furthermore, we used a multivariate decoding technique to predict the monkey's behaviour based on the activity of these arithmetic-related cells. The classifier trained to discern arithmetic operations, including addition and subtraction, not only predicted the arithmetic decisions but also the subsequent motor actions of the right and left-hand. These findings imply a cognitive extension of the motor cortex's function, where inherent neural systems are repurposed to facilitate arithmetic operations.
Collapse
Affiliation(s)
- Sumito Okuyama
- Department of Physiology, Tohoku University School of Medicine, Sendai, 980-8575, Japan
- Department of Neurosurgery, Southern Tohoku General Hospital, Miyagi, 989-2483, Japan
| | - Toshinobu Kuki
- Department of Physiology, Tohoku University School of Medicine, Sendai, 980-8575, Japan
| | - Hajime Mushiake
- Department of Physiology, Tohoku University School of Medicine, Sendai, 980-8575, Japan.
| |
Collapse
|
2
|
Nieder A. Convergent Circuit Computation for Categorization in the Brains of Primates and Songbirds. Cold Spring Harb Perspect Biol 2023; 15:a041526. [PMID: 38040453 PMCID: PMC10691494 DOI: 10.1101/cshperspect.a041526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2023]
Abstract
Categorization is crucial for behavioral flexibility because it enables animals to group stimuli into meaningful classes that can easily be generalized to new circumstances. A most abstract quantitative category is set size, the number of elements in a set. This review explores how categorical number representations are realized by the operations of excitatory and inhibitory neurons in associative telencephalic microcircuits in primates and songbirds. Despite the independent evolution of the primate prefrontal cortex and the avian nidopallium caudolaterale, the neuronal computations of these associative pallial circuits show surprising correspondence. Comparing cellular functions in distantly related taxa can inform about the evolutionary principles of circuit computations for cognition in distinctly but convergently realized brain structures.
Collapse
Affiliation(s)
- Andreas Nieder
- Animal Physiology Unit, Institute of Neurobiology, University of Tübingen, 72076 Tübingen, Germany
| |
Collapse
|
3
|
Kutter EF, Dehnen G, Borger V, Surges R, Mormann F, Nieder A. Distinct neuronal representation of small and large numbers in the human medial temporal lobe. Nat Hum Behav 2023; 7:1998-2007. [PMID: 37783890 DOI: 10.1038/s41562-023-01709-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2023] [Accepted: 08/31/2023] [Indexed: 10/04/2023]
Abstract
Whether small numerical quantities are represented by a special subitizing system that is distinct from a large-number estimation system has been debated for over a century. Here we show that two separate neural mechanisms underlie the representation of small and large numbers. We performed single neuron recordings in the medial temporal lobe of neurosurgical patients judging numbers. We found a boundary in neuronal coding around number 4 that correlates with the behavioural transition from subitizing to estimation. In the subitizing range, neurons showed superior tuning selectivity accompanied by suppression effects suggestive of surround inhibition as a selectivity-increasing mechanism. In contrast, tuning selectivity decreased with increasing numbers beyond 4, characterizing a ratio-dependent number estimation system. The two systems with the coding boundary separating them were also indicated using decoding and clustering analyses. The identified small-number subitizing system could be linked to attention and working memory that show comparable capacity limitations.
Collapse
Affiliation(s)
- Esther F Kutter
- Department of Epileptology, University of Bonn Medical Center, Bonn, Germany
- Animal Physiology, Institute of Neurobiology, University of Tübingen, Tübingen, Germany
| | - Gert Dehnen
- Department of Epileptology, University of Bonn Medical Center, Bonn, Germany
| | - Valeri Borger
- Department of Neurosurgery, University of Bonn Medical Center, Bonn, Germany
| | - Rainer Surges
- Department of Epileptology, University of Bonn Medical Center, Bonn, Germany
| | - Florian Mormann
- Department of Epileptology, University of Bonn Medical Center, Bonn, Germany.
| | - Andreas Nieder
- Animal Physiology, Institute of Neurobiology, University of Tübingen, Tübingen, Germany.
| |
Collapse
|
4
|
Kobylkov D, Zanon M, Perrino M, Vallortigara G. Neural coding of numerousness. Biosystems 2023; 232:104999. [PMID: 37574182 DOI: 10.1016/j.biosystems.2023.104999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 08/08/2023] [Accepted: 08/10/2023] [Indexed: 08/15/2023]
Abstract
Perception of numerousness, i.e. number of items in a set, is an important cognitive ability, which is present in several animal taxa. In spite of obvious differences in neuroanatomy, insects, fishes, reptiles, birds, and mammals all possess a "number sense". Furthermore, information regarding numbers can belong to different sensory modalities: animals can estimate a number of visual items, a number of tones, or a number of their own movements. Given both the heterogeneity of stimuli and of the brains processing these stimuli, it is hard to imagine that number cognition can be traced back to the same evolutionary conserved neural pathway. However, neurons that selectively respond to the number of stimuli have been described in higher-order integration brain centres both in primates and in birds, two evolutionary distant groups. Although most probably not of the same evolutionary origin, these number neurons share remarkable similarities in their response properties. Instead of homology, this similarity might result from computational advantages of the underlying coding mechanism. This means that one might expect numerousness information to undergo similar steps of neural processing even in evolutionary distant neural pathways. Following this logic, in this review we summarize our current knowledge of how numerousness is processed in the brain from sensory input to coding of abstract information in the higher-order integration centres. We also propose a list of key open questions that might promote future research on number cognition.
Collapse
Affiliation(s)
- Dmitry Kobylkov
- Centre for Mind/Brain Science, CIMeC, University of Trento, Rovereto, Italy
| | - Mirko Zanon
- Centre for Mind/Brain Science, CIMeC, University of Trento, Rovereto, Italy
| | - Matilde Perrino
- Centre for Mind/Brain Science, CIMeC, University of Trento, Rovereto, Italy
| | | |
Collapse
|
5
|
Nakai T, Nishimoto S. Artificial neural network modelling of the neural population code underlying mathematical operations. Neuroimage 2023; 270:119980. [PMID: 36848969 DOI: 10.1016/j.neuroimage.2023.119980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 02/10/2023] [Accepted: 02/23/2023] [Indexed: 02/28/2023] Open
Abstract
Mathematical operations have long been regarded as a sparse, symbolic process in neuroimaging studies. In contrast, advances in artificial neural networks (ANN) have enabled extracting distributed representations of mathematical operations. Recent neuroimaging studies have compared distributed representations of the visual, auditory and language domains in ANNs and biological neural networks (BNNs). However, such a relationship has not yet been examined in mathematics. Here we hypothesise that ANN-based distributed representations can explain brain activity patterns of symbolic mathematical operations. We used the fMRI data of a series of mathematical problems with nine different combinations of operators to construct voxel-wise encoding/decoding models using both sparse operator and latent ANN features. Representational similarity analysis demonstrated shared representations between ANN and BNN, an effect particularly evident in the intraparietal sulcus. Feature-brain similarity (FBS) analysis served to reconstruct a sparse representation of mathematical operations based on distributed ANN features in each cortical voxel. Such reconstruction was more efficient when using features from deeper ANN layers. Moreover, latent ANN features allowed the decoding of novel operators not used during model training from brain activity. The current study provides novel insights into the neural code underlying mathematical thought.
Collapse
Affiliation(s)
- Tomoya Nakai
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita, Japan; Lyon Neuroscience Research Center (CRNL), INSERM U1028 - CNRS UMR5292, University of Lyon, Bron, France.
| | - Shinji Nishimoto
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita, Japan; Graduate School of Frontier Biosciences, Osaka University, Suita, Japan; Graduate School of Medicine, Osaka University, Suita, Japan
| |
Collapse
|
6
|
Barak O, Tsodyks M. Mathematical models of learning and what can be learned from them. Curr Opin Neurobiol 2023; 80:102721. [PMID: 37043892 DOI: 10.1016/j.conb.2023.102721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2022] [Revised: 02/28/2023] [Accepted: 03/03/2023] [Indexed: 04/14/2023]
Abstract
Learning is a multi-faceted phenomenon of critical importance and hence attracted a great deal of research, both experimental and theoretical. In this review, we will consider some of the paradigmatic examples of learning and discuss the common themes in theoretical learning research, such as levels of modeling and their corresponding relation to experimental observations and mathematical ideas common to different types of learning.
Collapse
Affiliation(s)
- Omri Barak
- Rappaport Faculty of Medicine and Network Biology Research Laboratories, Technion - Israeli Institute of Technology, Haifa, Israel
| | - Misha Tsodyks
- School of Natural Sciences, Institute for Advanced Study, Princeton, USA; Department of Brain Sciences, Weizmann Institute of Studies, Rehovot, Israel.
| |
Collapse
|
7
|
Nakai T, Nishimoto S. Quantitative modelling demonstrates format-invariant representations of mathematical problems in the brain. Eur J Neurosci 2023; 57:1003-1017. [PMID: 36710081 DOI: 10.1111/ejn.15925] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Revised: 01/19/2023] [Accepted: 01/23/2023] [Indexed: 01/31/2023]
Abstract
Mathematical problems can be described in either symbolic form or natural language. Previous studies have reported that activation overlaps exist for these two types of mathematical problems, but it is unclear whether they are based on similar brain representations. Furthermore, quantitative modelling of mathematical problem solving has yet to be attempted. In the present study, subjects underwent 3 h of functional magnetic resonance experiments involving math word and math expression problems, and a read word condition without any calculations was used as a control. To evaluate the brain representations of mathematical problems quantitatively, we constructed voxel-wise encoding models. Both intra- and cross-format encoding modelling significantly predicted brain activity predominantly in the left intraparietal sulcus (IPS), even after subtraction of the control condition. Representational similarity analysis and principal component analysis revealed that mathematical problems with different formats had similar cortical organization in the IPS. These findings support the idea that mathematical problems are represented in the brain in a format-invariant manner.
Collapse
Affiliation(s)
- Tomoya Nakai
- Lyon Neuroscience Research Center (CRNL), INSERM U1028-CNRS UMR5292, University of Lyon, Bron, France.,Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita, Japan
| | - Shinji Nishimoto
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita, Japan.,Graduate School of Frontier Biosciences, Osaka University, Suita, Japan.,Graduate School of Medicine, Osaka University, Suita, Japan
| |
Collapse
|
8
|
Kirschhock ME, Nieder A. Number selective sensorimotor neurons in the crow translate perceived numerosity into number of actions. Nat Commun 2022; 13:6913. [PMID: 36376297 PMCID: PMC9663431 DOI: 10.1038/s41467-022-34457-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 10/25/2022] [Indexed: 11/16/2022] Open
Abstract
Translating a perceived number into a matching number of self-generated actions is a hallmark of numerical reasoning in humans and animals alike. To explore this sensorimotor transformation, we trained crows to judge numerical values in displays and to flexibly plan and perform a matching number of pecks. We report number selective sensorimotor neurons in the crow telencephalon that signaled the impending number of self-generated actions. Neuronal population activity during the sensorimotor transformation period predicted whether the crows mistakenly planned fewer or more pecks than instructed. During sensorimotor transformation, both a static neuronal code characterized by persistently number-selective neurons and a dynamic code originating from neurons carrying rapidly changing numerical information emerged. The findings indicate there are distinct functions of abstract neuronal codes supporting the sensorimotor number system.
Collapse
Affiliation(s)
- Maximilian E. Kirschhock
- grid.10392.390000 0001 2190 1447Animal Physiology Unit, Institute of Neurobiology, University of Tübingen, Auf der Morgenstelle 28, 72076 Tübingen, Germany
| | - Andreas Nieder
- grid.10392.390000 0001 2190 1447Animal Physiology Unit, Institute of Neurobiology, University of Tübingen, Auf der Morgenstelle 28, 72076 Tübingen, Germany
| |
Collapse
|
9
|
Boran E, Hilfiker P, Stieglitz L, Sarnthein J, Klaver P. Persistent neuronal firing in the medial temporal lobe supports performance and workload of visual working memory in humans. Neuroimage 2022; 254:119123. [PMID: 35321857 DOI: 10.1016/j.neuroimage.2022.119123] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Revised: 03/18/2022] [Accepted: 03/19/2022] [Indexed: 11/25/2022] Open
Abstract
The involvement of the medial temporal lobe (MTL) in working memory is controversially discussed. Recent findings suggest that persistent neural firing in the hippocampus during maintenance in verbal working memory is associated with workload. Here, we recorded single neuron firing in 13 epilepsy patients (7 male) while they performed a visual working memory task. The number of coloured squares in the stimulus set determined the workload of the trial. Performance was almost perfect for low workload (1 and 2 squares) and dropped at high workload (4 and 6 squares), suggesting that high workload exceeded working memory capacity. We identified maintenance neurons in MTL neurons that showed persistent firing during the maintenance period. More maintenance neurons were found in the hippocampus for trials with correct compared to incorrect performance. Maintenance neurons increased and decreased firing in the hippocampus and increased firing in the entorhinal cortex for high compared to low workload. Population firing predicted workload particularly during the maintenance period. Prediction accuracy of workload based on single-trial activity during maintenance was strongest for neurons in the entorhinal cortex and hippocampus. The data suggest that persistent neural firing in the MTL reflects a domain-general process of maintenance supporting performance and workload of multiple items in working memory below and beyond working memory capacity. Persistent neural firing during maintenance in the entorhinal cortex may be associated with its preference to process visual-spatial arrays.
Collapse
Affiliation(s)
- Ece Boran
- Department of Neurosurgery, University Hospital Zurich (USZ), University of Zurich, 8091 Zurich, Switzerland
| | | | - Lennart Stieglitz
- Department of Neurosurgery, University Hospital Zurich (USZ), University of Zurich, 8091 Zurich, Switzerland
| | - Johannes Sarnthein
- Department of Neurosurgery, University Hospital Zurich (USZ), University of Zurich, 8091 Zurich, Switzerland; Neuroscience Center Zurich, ETH Zurich, 8057 Zurich, Switzerland.
| | - Peter Klaver
- University of Teacher Education in Special Needs, 8050 Zurich, Switzerland; Institute of Psychology, University of Zurich, 8050 Zurich, Switzerland; School of Psychology, University of Surrey, GU2 7XH Guildford, UK.
| |
Collapse
|