1
|
Guidali G, Picardi M, Gramegna C, Bolognini N. Modulating motor resonance with paired associativestimulation: Neurophysiological and behavioral outcomes. Cortex 2023; 163:139-153. [PMID: 37104888 DOI: 10.1016/j.cortex.2023.03.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 02/16/2023] [Accepted: 03/14/2023] [Indexed: 04/29/2023]
Abstract
In the human brain, paired associative stimulation (PAS), a non-invasive brain stimulation technique based on Hebbian learning principles, can be used to model motor resonance, the inner activation of an observer's motor system by action observation. Indeed, the newly developed mirror PAS (m-PAS) protocol, through the repeatedly pairing of transcranial magnetic stimulation (TMS) pulses over the primary motor cortex (M1) and visual stimuli depicting index-finger movements, allows the emergence of a new, atypical pattern of cortico-spinal excitability. In the present study, we performed two experiments to explore (a) the debated hemispheric lateralization of the action-observation network and (b) the behavioral after-effects of m-PAS, particularly concerning a core function of the MNS: automatic imitation. In Experiment 1, healthy participants underwent two sessions of m-PAS, delivered over the right and left M1. Before and after each m-PAS session, motor resonance was assessed by recording motor-evoked potentials induced by single-pulse TMS applied to the right M1 while observing contralateral (left) and ipsilateral (right) index-finger movements or static hands. In Experiment 2, participants performed an imitative compatibility task before and after the m-PAS targeting the right M1. Results showed that only m-PAS targeting the right hemisphere, non-dominant in right-handed people, induced the emergence of motor resonance for the conditioned movement, absent before the stimulation. This effect is not present when m-PAS target the M1 of the left hemisphere. Importantly, the protocol also affects behavior, modulating automatic imitation in a strictly somatotopic fashion (i.e., influencing the imitation of the conditioned finger movement). Overall, this evidence shows that the m-PAS can be used to drive new associations between the perception of actions and their corresponding motor programs, measurable both at a neurophysiological and behavioral level. At least for simple, not goal-directed, movements, the induction of motor resonance and automatic imitation effects are governed by mototopic and somatotopic rules.
Collapse
Affiliation(s)
- Giacomo Guidali
- Department of Psychology & NeuroMI - Milan Centre for Neuroscience, University of Milano-Bicocca, Milan, Italy.
| | - Michela Picardi
- Department of Neurorehabilitation Sciences, Casa di Cura Igea, Milan, Italy; PhD Program in Neuroscience, School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
| | - Chiara Gramegna
- Department of Psychology & NeuroMI - Milan Centre for Neuroscience, University of Milano-Bicocca, Milan, Italy; PhD Program in Neuroscience, School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
| | - Nadia Bolognini
- Department of Psychology & NeuroMI - Milan Centre for Neuroscience, University of Milano-Bicocca, Milan, Italy; Laboratory of Neuropsychology/Dept. Neurorehabilitation Sciences, IRCCS Istituto Auxologico Italiano, Milan, Italy.
| |
Collapse
|
2
|
Guidali G, Roncoroni C, Bolognini N. Paired associative stimulations: Novel tools for interacting with sensory and motor cortical plasticity. Behav Brain Res 2021; 414:113484. [PMID: 34302877 DOI: 10.1016/j.bbr.2021.113484] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Revised: 06/10/2021] [Accepted: 07/19/2021] [Indexed: 12/26/2022]
Abstract
In the early 2000s, a novel non-invasive brain stimulation protocol, the paired associative stimulation (PAS), was introduced, allowing to induce and investigate Hebbian associative plasticity within the humans' motor system, with patterns resembling spike-timing-dependent plasticity properties found in cellular models. Since this evidence, PAS efficacy has been proved in healthy, and to a lesser extent, in clinical populations. Recently, novel 'modified' protocols targeting sensorimotor and crossmodal networks appeared in the literature. In the present work, we have reviewed recent advances using these 'modified' PAS protocols targeting sensory and motor cortical networks. To better categorize them, we propose a novel classification according to the nature of the peripheral and cortical stimulations (i.e., within-system, cross-systems, and cortico-cortical PAS). For each protocol of the categories mentioned above, we describe and discuss their main features, how they have been used to study and promote brain plasticity, and their advantages and disadvantages. Overall, current evidence suggests that these novel non-invasive brain stimulation protocols represent very promising tools to study the plastic properties of humans' sensorimotor and crossmodal networks, both in the healthy and in the damaged central nervous system.
Collapse
Affiliation(s)
- Giacomo Guidali
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy; Department of Psychology & NeuroMI - Milan Center for Neuroscience, University of Milano-Bicocca, Milan, Italy.
| | - Camilla Roncoroni
- Department of Psychology & NeuroMI - Milan Center for Neuroscience, University of Milano-Bicocca, Milan, Italy
| | - Nadia Bolognini
- Department of Psychology & NeuroMI - Milan Center for Neuroscience, University of Milano-Bicocca, Milan, Italy; Laboratory of Neuropsychology, IRCCS Istituto Auxologico Italiano, Milan, Italy
| |
Collapse
|
3
|
Naudin L, Corson N, Aziz-Alaoui MA, Jiménez Laredo JL, Démare T. On the Modeling of the Three Types of Non-spiking Neurons of the Caenorhabditis elegans. Int J Neural Syst 2020; 31:2050063. [PMID: 33269660 DOI: 10.1142/s012906572050063x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The nematode Caenorhabditis elegans (C. elegans) is a well-known model organism in neuroscience. The relative simplicity of its nervous system, made up of few hundred neurons, shares some essential features with more sophisticated nervous systems, including the human one. If we are able to fully characterize the nervous system of this organism, we will be one step closer to understanding the mechanisms underlying the behavior of living things. Following a recently conducted electrophysiological survey on different C. elegans neurons, this paper aims at modeling the three non-spiking RIM, AIY and AFD neurons (arbitrarily named with three upper case letters by convention). To date, they represent the three possible forms of non-spiking neuronal responses of the C. elegans. To achieve this objective, we propose a conductance-based neuron model adapted to the electrophysiological features of each neuron. These features are based on current biological research and a series of in-silico experiments which use differential evolution to fit the model to experimental data. From the obtained results, we formulate a series of biological hypotheses regarding currents involved in the neuron dynamics. These models reproduce experimental data with a high degree of accuracy while being biologically consistent with state-of-the-art research.
Collapse
Affiliation(s)
- Loïs Naudin
- Normandie Univ, UNIHAVRE, LMAH, FR-CNRS-3335, ISCN, Le Havre 76600, France
| | - Nathalie Corson
- Normandie Univ, UNIHAVRE, LMAH, FR-CNRS-3335, ISCN, Le Havre 76600, France
| | - M A Aziz-Alaoui
- Normandie Univ, UNIHAVRE, LMAH, FR-CNRS-3335, ISCN, Le Havre 76600, France
| | | | - Thibaut Démare
- Normandie Univ, UNIHAVRE, LITIS, FR-CNRS-3638, ISCN, Le Havre 76600, France
| |
Collapse
|
4
|
Zhang G, Rong H, Paul P, He Y, Neri F, Pérez-Jiménez MJ. A Complete Arithmetic Calculator Constructed from Spiking Neural P Systems and its Application to Information Fusion. Int J Neural Syst 2020; 31:2050055. [PMID: 32938262 DOI: 10.1142/s0129065720500550] [Citation(s) in RCA: 43] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Several variants of spiking neural P systems (SNPS) have been presented in the literature to perform arithmetic operations. However, each of these variants was designed only for one specific arithmetic operation. In this paper, a complete arithmetic calculator implemented by SNPS is proposed. An application of the proposed calculator to information fusion is also proposed. The information fusion is implemented by integrating the following three elements: (1) an addition and subtraction SNPS already reported in the literature; (2) a modified multiplication and division SNPS; (3) a novel storage SNPS, i.e. a method based on SNPS is introduced to calculate basic probability assignment of an event. This is the first attempt to apply arithmetic operation SNPS to fuse multiple information. The effectiveness of the presented general arithmetic SNPS calculator is verified by means of several examples.
Collapse
Affiliation(s)
- Gexiang Zhang
- Research Center for Artificial Intelligence, Chengdu University of Technology, Chengdu 610059, P. R. China
| | - Haina Rong
- School of Electrical Engineering, Southwest Jiaotong University, Chengdu 610031, P. R. China
| | - Prithwineel Paul
- School of Electrical Engineering, Southwest Jiaotong University, Chengdu 610031, P. R. China
| | - Yangyang He
- School of Electrical Engineering, Southwest Jiaotong University, Chengdu 610031, P. R. China
| | - Ferrante Neri
- COL Laboratory, School of Computer Science, University of Nottingham, Nottingham, UK
| | - Mario J Pérez-Jiménez
- Department of Computer Science and Artificial Intelligence, University of Sevilla, Avda. Reina Mercedes s/n 41012, Spain
| |
Collapse
|
5
|
Nogay HS, Adeli H. Machine learning (ML) for the diagnosis of autism spectrum disorder (ASD) using brain imaging. Rev Neurosci 2020; 31:/j/revneuro.ahead-of-print/revneuro-2020-0043/revneuro-2020-0043.xml. [PMID: 32866134 DOI: 10.1515/revneuro-2020-0043] [Citation(s) in RCA: 66] [Impact Index Per Article: 13.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 07/25/2020] [Indexed: 02/24/2024]
Abstract
Autism spectrum disorder (ASD) is a neurodevelopmental incurable disorder with a long diagnostic period encountered in the early years of life. If diagnosed early, the negative effects of this disease can be reduced by starting special education early. Machine learning (ML), an increasingly ubiquitous technology, can be applied for the early diagnosis of ASD. The aim of this study is to examine and provide a comprehensive state-of-the-art review of ML research for the diagnosis of ASD based on (a) structural magnetic resonance image (MRI), (b) functional MRI and (c) hybrid imaging techniques over the past decade. The accuracy of the studies with a large number of participants is in general lower than those with fewer participants leading to the conclusion that further large-scale studies are needed. An examination of the age of the participants shows that the accuracy of the automated diagnosis of ASD is higher at a younger age range. ML technology is expected to contribute significantly to the early and rapid diagnosis of ASD in the coming years and become available to clinicians in the near future. This review is aimed to facilitate that.
Collapse
Affiliation(s)
- Hidir Selcuk Nogay
- Department of Electrical and Energy, Kayseri University, Kayseri, Turkey
- The Ohio State University, Mathematical Bioscience Institute, Columbus, OH, USA
| | - Hojjat Adeli
- Departments of Biomedical Informatics and Neuroscience, The Ohio State University, Columbus, US
| |
Collapse
|
6
|
González-Redondo Á, Naveros F, Ros E, Garrido JA. A Basal Ganglia Computational Model to Explain the Paradoxical Sensorial Improvement in the Presence of Huntington's Disease. Int J Neural Syst 2020; 30:2050057. [PMID: 32840409 DOI: 10.1142/s0129065720500574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The basal ganglia (BG) represent a critical center of the nervous system for sensorial discrimination. Although it is known that Huntington's disease (HD) affects this brain area, it still remains unclear how HD patients achieve paradoxical improvement in sensorial discrimination tasks. This paper presents a computational model of the BG including the main nuclei and the typical firing properties of their neurons. The BG model has been embedded within an auditory signal detection task. We have emulated the effect that the altered levels of dopamine and the degree of HD affectation have in information processing at different layers of the BG, and how these aspects shape transient and steady states differently throughout the selection task. By extracting the independent components of the BG activity at different populations, it is evidenced that early and medium stages of HD affectation may enhance transient activity in the striatum and the substantia nigra pars reticulata. These results represent a possible explanation for the paradoxical improvement that HD patients present in discrimination task performance. Thus, this paper provides a novel understanding on how the fast dynamics of the BG network at different layers interact and enable transient states to emerge throughout the successive neuron populations.
Collapse
Affiliation(s)
| | - Francisco Naveros
- Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| | - Eduardo Ros
- Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| | - Jesús A Garrido
- Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| |
Collapse
|
7
|
Song X, Valencia-Cabrera L, Peng H, Wang J, Pérez-Jiménez MJ. Spiking Neural P Systems with Delay on Synapses. Int J Neural Syst 2020; 31:2050042. [PMID: 32701003 DOI: 10.1142/s0129065720500422] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Based on the feature and communication of neurons in animal neural systems, spiking neural P systems (SN P systems) were proposed as a kind of powerful computing model. Considering the length of axons and the information transmission speed on synapses, SN P systems with delay on synapses (SNP-DS systems) are proposed in this work. Unlike the traditional SN P systems, where all the postsynaptic neurons receive spikes at the same instant from their presynaptic neuron, the postsynaptic neurons in SNP-DS systems would receive spikes at different instants, depending on the delay time on the synapses connecting them. It is proved that the SNP-DS systems are universal as number generators. Two small universal SNP-DS systems, with standard or extended rules, are constructed to compute functions, using 56 and 36 neurons, respectively. Moreover, a simulator has been provided, in order to check the correctness of these two SNP-DS systems, thus providing an experimental validation of the universality of the systems designed.
Collapse
Affiliation(s)
- Xiaoxiao Song
- School of Electrical Engineering and Electronic Information and Key Laboratory of Fluid and Power Machinery, Ministry of Education, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Luis Valencia-Cabrera
- Research Group on Natural Computing, Department of Computer Science and Artificial Intelligence, University of Sevilla, Sevilla, Andalucía 41004, Spain
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information and Key Laboratory of Fluid and Power Machinery, Ministry of Education, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Mario J Pérez-Jiménez
- Research Group on Natural Computing, Department of Computer Science and Artificial Intelligence, University of Sevilla, Sevilla, Andalucía 41004, Spain
| |
Collapse
|
8
|
Caligiore D, Mirino P. How the Cerebellum and Prefrontal Cortex Cooperate During Trace Eyeblinking Conditioning. Int J Neural Syst 2020; 30:2050041. [PMID: 32618205 DOI: 10.1142/s0129065720500410] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Several data have demonstrated that during the widely used experimental paradigm for studying associative learning, trace eye blinking conditioning (TEBC), there is a strong interaction between cerebellum and medial prefrontal cortex (mPFC). Despite this evidence, the neural mechanisms underlying this interaction are still not clear. Here, we propose a neurophysiologically plausible computational model to address this issue. The model is constrained on the basis of two critical anatomo-physiological features: (i) the cerebello-cortical organization through two circuits, respectively, targeting M1 and mPFC; (ii) the different timing in the plasticity mechanisms of these parallel circuits produced by the granule cells time sensitivity according to which different subpopulations are active at different moments during conditioned stimuli. The computer simulations run with the model suggest that these features are critical to understand how the cooperation between cerebellum and mPFC supports motor areas during TEBC. In particular, a greater trace interval produces greater plasticity changes at the slow path synapses involving mPFC with respect to plasticity changes at the fast path involving M1. As a consequence, the greater is the trace interval, the stronger is the mPFC involvement. The model has been validated by reproducing data collected through recent real mice experiments.
Collapse
Affiliation(s)
- Daniele Caligiore
- Computational and Translational Neuroscience Laboratory (CTNLab), Institute of Cognitive Sciences and Technologies, National Research Council, Via San Martino della Battaglia 44, Rome, 00185, Italy
| | - Pierandrea Mirino
- Department of Psychology, Sapienza University of Rome, Via dei Marsi 78, Rome, 00185, Italy
| |
Collapse
|
9
|
Kheradpisheh SR, Masquelier T. Temporal Backpropagation for Spiking Neural Networks with One Spike per Neuron. Int J Neural Syst 2020; 30:2050027. [DOI: 10.1142/s0129065720500276] [Citation(s) in RCA: 57] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
We propose a new supervised learning rule for multilayer spiking neural networks (SNNs) that use a form of temporal coding known as rank-order-coding. With this coding scheme, all neurons fire exactly one spike per stimulus, but the firing order carries information. In particular, in the readout layer, the first neuron to fire determines the class of the stimulus. We derive a new learning rule for this sort of network, named S4NN, akin to traditional error backpropagation, yet based on latencies. We show how approximated error gradients can be computed backward in a feedforward network with any number of layers. This approach reaches state-of-the-art performance with supervised multi-fully connected layer SNNs: test accuracy of 97.4% for the MNIST dataset, and 99.2% for the Caltech Face/Motorbike dataset. Yet, the neuron model that we use, nonleaky integrate-and-fire, is much simpler than the one used in all previous works. The source codes of the proposed S4NN are publicly available at https://github.com/SRKH/S4NN .
Collapse
Affiliation(s)
- Saeed Reza Kheradpisheh
- Department of Computer and Data Sciences, Faculty of Mathematical Sciences, Shahid Beheshti University, Tehran, Iran
| | | |
Collapse
|
10
|
Guidali G, Carneiro MI, Bolognini N. Paired Associative Stimulation drives the emergence of motor resonance. Brain Stimul 2020; 13:627-636. [DOI: 10.1016/j.brs.2020.01.017] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2019] [Revised: 12/11/2019] [Accepted: 01/30/2020] [Indexed: 11/25/2022] Open
|
11
|
Peng H, Lv Z, Li B, Luo X, Wang J, Song X, Wang T, Pérez-Jiménez MJ, Riscos-Núñez A. Nonlinear Spiking Neural P Systems. Int J Neural Syst 2020; 30:2050008. [DOI: 10.1142/s0129065720500082] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
This paper proposes a new variant of spiking neural P systems (in short, SNP systems), nonlinear spiking neural P systems (in short, NSNP systems). In NSNP systems, the state of each neuron is denoted by a real number, and a real configuration vector is used to characterize the state of the whole system. A new type of spiking rules, nonlinear spiking rules, is introduced to handle the neuron’s firing, where the consumed and generated amounts of spikes are often expressed by the nonlinear functions of the state of the neuron. NSNP systems are a class of distributed parallel and nondeterministic computing systems. The computational power of NSNP systems is discussed. Specifically, it is proved that NSNP systems as number-generating/accepting devices are Turing-universal. Moreover, we establish two small universal NSNP systems for function computing and number generator, containing 117 neurons and 164 neurons, respectively.
Collapse
Affiliation(s)
- Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Zeqiong Lv
- School of Computer and Software Engineering, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Bo Li
- School of Computer and Software Engineering, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Xiaohui Luo
- School of Computer and Software Engineering, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Xiaoxiao Song
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Tao Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu, Sichuan 610039, P. R. China
| | - Mario J. Pérez-Jiménez
- Research Group of Natural Computing, Department of Computer Sciences and Artificial Intelligence, School of Computer Engineering, University of Seville, 41012, C. P. Sevilla, Spain
| | - Agustín Riscos-Núñez
- Research Group of Natural Computing, Department of Computer Sciences and Artificial Intelligence, School of Computer Engineering, University of Seville, 41012, C. P. Sevilla, Spain
| |
Collapse
|
12
|
Xia LY, Wang QY, Cao Z, Liang Y. Descriptor Selection Improvements for Quantitative Structure-Activity Relationships. Int J Neural Syst 2019; 29:1950016. [PMID: 31390912 DOI: 10.1142/s0129065719500163] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Molecular descriptor selection is an essential procedure to improve a predictive quantitative structure–activity relationship (QSAR) model. However, within the QSAR model, there are a number of redundant, noisy and irrelevant descriptors. In this study, we propose a novel descriptor selection framework using self-paced learning (SPL) via sparse logistic regression (LR) with Logsum penalty (SPL-Logsum), which can simultaneously adaptively identify the simple and complex samples and avoid over-fitting. SPL is inspired by the learning process of humans or animals gradually learned from simple and complex samples to train models, and the Logsum penalized LR helps to select a small subset of significant molecular descriptors for improving the QSAR models. Experimental results on some simulations and three public QSAR datasets show that our proposed SPL-Logsum framework outperforms other existing sparse methods regarding the area under the curve, sensitivity, specificity, accuracy, and [Formula: see text]-values.
Collapse
Affiliation(s)
- Liang-Yong Xia
- Faculty of Information Technology, Macau University of Science and Technology, Macau, P. R. China
| | - Qing-Yong Wang
- Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha, P. R. China
| | - Zehong Cao
- Discipline of ICT, School of Technology, Environments and Design, College of Sciences and Engineering, University of Tasmania, TAS, Australia
| | - Yong Liang
- University of Science and Technology, Macau, P. R. China
| |
Collapse
|
13
|
Todo Y, Tang Z, Todo H, Ji J, Yamashita K. Neurons with Multiplicative Interactions of Nonlinear Synapses. Int J Neural Syst 2019; 29:1950012. [DOI: 10.1142/s0129065719500126] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Neurons are the fundamental units of the brain and nervous system. Developing a good modeling of human neurons is very important not only to neurobiology but also to computer science and many other fields. The McCulloch and Pitts neuron model is the most widely used neuron model, but has long been criticized as being oversimplified in view of properties of real neuron and the computations they perform. On the other hand, it has become widely accepted that dendrites play a key role in the overall computation performed by a neuron. However, the modeling of the dendritic computations and the assignment of the right synapses to the right dendrite remain open problems in the field. Here, we propose a novel dendritic neural model (DNM) that mimics the essence of known nonlinear interaction among inputs to the dendrites. In the model, each input is connected to branches through a distance-dependent nonlinear synapse, and each branch performs a simple multiplication on the inputs. The soma then sums the weighted products from all branches and produces the neuron’s output signal. We show that the rich nonlinear dendritic response and the powerful nonlinear neural computational capability, as well as many known neurobiological phenomena of neurons and dendrites, may be understood and explained by the DNM. Furthermore, we show that the model is capable of learning and developing an internal structure, such as the location of synapses in the dendritic branch and the type of synapses, that is appropriate for a particular task — for example, the linearly nonseparable problem, a real-world benchmark problem — Glass classification and the directional selectivity problem.
Collapse
Affiliation(s)
- Yuki Todo
- Faculty of Electrical and Computer Engineering, Kanazawa University, Kakuma-Machi, Kanazawa 920-1192, Japan
| | - Zheng Tang
- Department of Intelligence Information Systems, University of Toyama, 3190, Gofuku, Toyama 930-8555, Japan
| | - Hiroyoshi Todo
- Department of Pharmaceutical Technology, University of Toyama, 2630, Sugitani, Toyama 930-0194, Japan
| | - Junkai Ji
- Department of Intelligence Information Systems, University of Toyama, 3190, Gofuku, Toyama 930-8555, Japan
| | - Kazuya Yamashita
- Information Technology Center, University of Toyama, 3190, Gofuku, Toyama 930-8555, Japan
| |
Collapse
|
14
|
Bernert M, Yvert B. An Attention-Based Spiking Neural Network for Unsupervised Spike-Sorting. Int J Neural Syst 2019; 29:1850059. [DOI: 10.1142/s0129065718500594] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Bio-inspired computing using artificial spiking neural networks promises performances outperforming currently available computational approaches. Yet, the number of applications of such networks remains limited due to the absence of generic training procedures for complex pattern recognition, which require the design of dedicated architectures for each situation. We developed a spike-timing-dependent plasticity (STDP) spiking neural network (SSN) to address spike-sorting, a central pattern recognition problem in neuroscience. This network is designed to process an extracellular neural signal in an online and unsupervised fashion. The signal stream is continuously fed to the network and processed through several layers to output spike trains matching the truth after a short learning period requiring only few data. The network features an attention mechanism to handle the scarcity of action potential occurrences in the signal, and a threshold adaptation mechanism to handle patterns with different sizes. This method outperforms two existing spike-sorting algorithms at low signal-to-noise ratio (SNR) and can be adapted to process several channels simultaneously in the case of tetrode recordings. Such attention-based STDP network applied to spike-sorting opens perspectives to embed neuromorphic processing of neural data in future brain implants.
Collapse
Affiliation(s)
- Marie Bernert
- BrainTech Laboratory U1205, INSERM, 2280 Rue de la Piscine, 38400 Saint-Martin-d’Hères, France
- BrainTech Laboratory U1205, Université Grenoble Alpes, 2280 rue de la piscine, 38400 Saint-Martin-d’Hères, France
- LETI, CEA Grenoble, 17 Rue des Martyrs, 38000 Grenoble, France
| | - Blaise Yvert
- BrainTech Laboratory U1205, INSERM, 2280 Rue de la Piscine, 38400 Saint-Martin-d’Hères, France
- BrainTech Laboratory U1205, Université Grenoble Alpes, 2280 rue de la piscine, 38400 Saint-Martin-d’Hères, France
| |
Collapse
|
15
|
Galán-Prado F, Morán A, Font J, Roca M, Rosselló JL. Compact Hardware Synthesis of Stochastic Spiking Neural Networks. Int J Neural Syst 2019; 29:1950004. [DOI: 10.1142/s0129065719500047] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Spiking neural networks (SNN) are able to emulate real neural behavior with high confidence due to their bio-inspired nature. Many designs have been proposed for the implementation of SNN in hardware, although the realization of high-density and biologically-inspired SNN is currently a complex challenge of high scientific and technical interest. In this work, we propose a compact digital design for the implementation of high-volume SNN that considers the intrinsic stochastic processes present in biological neurons and enables high-density hardware implementation. The proposed stochastic SNN model (SSNN) is compared with previous SSNN models, achieving a higher processing speed. We also show how the proposed model can be scaled to high-volume neural networks trained by using back propagation and applied to a pattern classification task. The proposed model achieves better results compared with other recently-published SNN models configured with unsupervised STDP learning.
Collapse
Affiliation(s)
- Fabio Galán-Prado
- Electronics Engineering Group, Physics Department, Universitat de les Illes Balears, Mateu Orfila Building, Ctra. Valldemossa km. 7.5, Palma de Mallorca, Balears 07122, Spain
| | - Alejandro Morán
- Electronics Engineering Group, Physics Department, Universitat de les Illes Balears, Mateu Orfila Building, Ctra. Valldemossa km. 7.5, Palma de Mallorca, Balears 07122, Spain
| | - Joan Font
- Electronics Engineering Group, Physics Department, Universitat de les Illes Balears, Mateu Orfila Building, Ctra. Valldemossa km. 7.5, Palma de Mallorca, Balears 07122, Spain
| | - Miquel Roca
- Electronics Engineering Group, Physics Department, Universitat de les Illes Balears, Mateu Orfila Building, Ctra. Valldemossa km. 7.5, Palma de Mallorca, Balears 07122, Spain
| | - Josep L. Rosselló
- Electronics Engineering Group, Physics Department, Universitat de les Illes Balears, Mateu Orfila Building, Ctra. Valldemossa km. 7.5, Palma de Mallorca, Balears 07122, Spain
| |
Collapse
|
16
|
Guo X, Yu H, Kodama NX, Wang J, Galán RF. Fluctuation Scaling of Neuronal Firing and Bursting in Spontaneously Active Brain Circuits. Int J Neural Syst 2019; 30:1950017. [PMID: 31390911 DOI: 10.1142/s0129065719500175] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
We employed high-density microelectrode arrays to investigate spontaneous firing patterns of neurons in brain circuits of the primary somatosensory cortex (S1) in mice. We recorded from over 150 neurons for 10min in each of eight different experiments, identified their location in S1, sorted their action potentials (spikes), and computed their power spectra and inter-spike interval (ISI) statistics. Of all persistently active neurons, 92% fired with a single dominant frequency - regularly firing neurons (RNs) - from 1 to 8Hz while 8% fired in burst with two dominant frequencies - bursting neurons (BNs) - corresponding to the inter-burst (2-6Hz) and intra-burst intervals (20-160Hz). RNs were predominantly located in layers 2/3 and 5/6 while BNs localized to layers 4 and 5. Across neurons, the standard deviation of ISI was a power law of its mean, a property known as fluctuation scaling, with a power law exponent of 1 for RNs and 1.25 for BNs. The power law implies that firing and bursting patterns are scale invariant: the firing pattern of a given RN or BN resembles that of another RN or BN, respectively, after a time contraction or dilation. An explanation for this scale invariance is discussed in the context of previous computational studies as well as its potential role in information processing.
Collapse
Affiliation(s)
- Xinmeng Guo
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, P. R. China
| | - Haitao Yu
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, P. R. China
| | - Nathan X Kodama
- Department of Electrical Engineering and Computer Science, School of Engineering, Case Western Reserve University, Cleveland, Ohio 44106, USA
| | - Jiang Wang
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, P. R. China
| | - Roberto F Galán
- Department of Electrical Engineering and Computer Science, School of Engineering, Case Western Reserve University, Cleveland, Ohio 44106, USA
| |
Collapse
|
17
|
A novel methodology for automated differential diagnosis of mild cognitive impairment and the Alzheimer’s disease using EEG signals. J Neurosci Methods 2019; 322:88-95. [DOI: 10.1016/j.jneumeth.2019.04.013] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2019] [Revised: 04/27/2019] [Accepted: 04/27/2019] [Indexed: 11/20/2022]
|
18
|
Guang H, Ji L. Proprioceptive Recognition with Artificial Neural Networks Based on Organizations of Spinocerebellar Tract and Cerebellum. Int J Neural Syst 2019; 29:1850056. [PMID: 30776987 DOI: 10.1142/s0129065718500569] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Muscle kinematics and kinetics are nonlinearly encoded by proprioceptors, and the changes in muscle length and velocity are integrated into Ia afferent. Besides, proprioceptive signals from multiple muscles are probably mixed in afferent pathways, which all lead to difficulties in proprioceptive recognition for the cerebellum. In this study, the artificial neural networks, whose organizations are biologically based on the spinocerebellar tract and cerebellum, are utilized to decode the proprioceptive signals. Consistent with the controversy of the proprioceptive division in the dorsal spinocerebellar tract, the spinocerebellar tract networks incorporated two distinct inferences, (1) the centralized networks, which mixed Ia, II, and Ib and processed them together; (2) the decentralized networks, which processed Ia, II, and Ib afferents separately. The cerebellar networks were based on the Marr-Albus model to recognize the kinematic states. The networks were trained by a specific movement, and the trained networks were subsequently required to predict kinematic states of six movements. The results demonstrated that the centralized networks, which were more consistent with the physiological findings in recent years, had better recognition accuracy than the decentralized networks, and the networks were still effective even when proprioceptive afferents from multiple muscles were integrated.
Collapse
Affiliation(s)
- Hui Guang
- 1Department of Mechanical Engineering, Tsinghua University, Beijing 100084, P. R. China
| | - Linhong Ji
- 1Department of Mechanical Engineering, Tsinghua University, Beijing 100084, P. R. China
| |
Collapse
|
19
|
Pregowska A, Kaplan E, Szczepanski J. How Far can Neural Correlations Reduce Uncertainty? Comparison of Information Transmission Rates for Markov and Bernoulli Processes. Int J Neural Syst 2019; 29:1950003. [PMID: 30841769 DOI: 10.1142/s0129065719500035] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The nature of neural codes is central to neuroscience. Do neurons encode information through relatively slow changes in the firing rates of individual spikes (rate code) or by the precise timing of every spike (temporal code)? Here we compare the loss of information due to correlations for these two possible neural codes. The essence of Shannon's definition of information is to combine information with uncertainty: the higher the uncertainty of a given event, the more information is conveyed by that event. Correlations can reduce uncertainty or the amount of information, but by how much? In this paper we address this question by a direct comparison of the information per symbol conveyed by the words coming from a binary Markov source (temporal code) with the information per symbol coming from the corresponding Bernoulli source (uncorrelated, rate code). In a previous paper we found that a crucial role in the relation between information transmission rates (ITRs) and firing rates is played by a parameter s, which is the sum of transition probabilities from the no-spike state to the spike state and vice versa. We found that in this case too a crucial role is played by the same parameter s. We calculated the maximal and minimal bounds of the quotient of ITRs for these sources. Next, making use of the entropy grouping axiom, we determined the loss of information in a Markov source compared with the information in the corresponding Bernoulli source for a given word length. Our results show that in the case of correlated signals the loss of information is relatively small, and thus temporal codes, which are more energetically efficient, can replace rate codes effectively. These results were confirmed by experiments.
Collapse
Affiliation(s)
- Agnieszka Pregowska
- Institute of Fundamental Technological Research, Polish Academy of Sciences, ul. Pawinskiego 5B, 02-106 Warsaw, Poland
| | - Ehud Kaplan
- Icahn School of Medicine at Mount Sinai, One Gustave Levy Place, New York, NY 10029, USA.,Department of Philosophy and History of Science, Faculty of Science, Charles University, Albertov 6, 128 43 Praha 2, Czech Republic.,The National Institute of Mental Health, Topolová 748, 250 67 Klecany, Czech Republic
| | - Janusz Szczepanski
- Institute of Fundamental Technological Research, Polish Academy of Sciences, ul. Pawinskiego 5B, 02-106 Warsaw, Poland
| |
Collapse
|