1
|
Agnes EJ, Vogels TP. Co-dependent excitatory and inhibitory plasticity accounts for quick, stable and long-lasting memories in biological networks. Nat Neurosci 2024; 27:964-974. [PMID: 38509348 PMCID: PMC11089004 DOI: 10.1038/s41593-024-01597-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 02/08/2024] [Indexed: 03/22/2024]
Abstract
The brain's functionality is developed and maintained through synaptic plasticity. As synapses undergo plasticity, they also affect each other. The nature of such 'co-dependency' is difficult to disentangle experimentally, because multiple synapses must be monitored simultaneously. To help understand the experimentally observed phenomena, we introduce a framework that formalizes synaptic co-dependency between different connection types. The resulting model explains how inhibition can gate excitatory plasticity while neighboring excitatory-excitatory interactions determine the strength of long-term potentiation. Furthermore, we show how the interplay between excitatory and inhibitory synapses can account for the quick rise and long-term stability of a variety of synaptic weight profiles, such as orientation tuning and dendritic clustering of co-active synapses. In recurrent neuronal networks, co-dependent plasticity produces rich and stable motor cortex-like dynamics with high input sensitivity. Our results suggest an essential role for the neighborly synaptic interaction during learning, connecting micro-level physiology with network-wide phenomena.
Collapse
Affiliation(s)
- Everton J Agnes
- Centre for Neural Circuits and Behaviour, University of Oxford, Oxford, UK.
- Biozentrum, University of Basel, Basel, Switzerland.
| | - Tim P Vogels
- Centre for Neural Circuits and Behaviour, University of Oxford, Oxford, UK
- Institute of Science and Technology Austria, Klosterneuburg, Austria
| |
Collapse
|
2
|
Petousakis KE, Apostolopoulou AA, Poirazi P. The impact of Hodgkin-Huxley models on dendritic research. J Physiol 2023; 601:3091-3102. [PMID: 36218068 PMCID: PMC10600871 DOI: 10.1113/jp282756] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2022] [Accepted: 09/16/2022] [Indexed: 11/08/2022] Open
Abstract
For the past seven decades, the Hodgkin-Huxley (HH) formalism has been an invaluable tool in the arsenal of neuroscientists, allowing for robust and reproducible modelling of ionic conductances and the electrophysiological phenomena they underlie. Despite its apparent age, its role as a cornerstone of computational neuroscience has not waned. The discovery of dendritic regenerative events mediated by ionic and synaptic conductances has solidified the importance of HH-based models further, yielding new predictions concerning dendritic integration, synaptic plasticity and neuronal computation. These predictions are often validated through in vivo and in vitro experiments, advancing our understanding of the neuron as a biological system and emphasizing the importance of HH-based detailed computational models as an instrument of dendritic research. In this article, we discuss recent studies in which the HH formalism is used to shed new light on dendritic function and its role in neuronal phenomena.
Collapse
Affiliation(s)
- Konstantinos-Evangelos Petousakis
- Institute of Molecular Biology and Biotechnology (IMBB), Foundation for Research and Technology-Hellas (FORTH), Heraklion, Crete, Greece
- Department of Biology, University of Crete, Heraklion, Crete, Greece
| | - Anthi A Apostolopoulou
- Institute of Molecular Biology and Biotechnology (IMBB), Foundation for Research and Technology-Hellas (FORTH), Heraklion, Crete, Greece
| | - Panayiota Poirazi
- Institute of Molecular Biology and Biotechnology (IMBB), Foundation for Research and Technology-Hellas (FORTH), Heraklion, Crete, Greece
| |
Collapse
|
3
|
Kastellakis G, Tasciotti S, Pandi I, Poirazi P. The dendritic engram. Front Behav Neurosci 2023; 17:1212139. [PMID: 37576932 PMCID: PMC10412934 DOI: 10.3389/fnbeh.2023.1212139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Accepted: 07/11/2023] [Indexed: 08/15/2023] Open
Abstract
Accumulating evidence from a wide range of studies, including behavioral, cellular, molecular and computational findings, support a key role of dendrites in the encoding and recall of new memories. Dendrites can integrate synaptic inputs in non-linear ways, provide the substrate for local protein synthesis and facilitate the orchestration of signaling pathways that regulate local synaptic plasticity. These capabilities allow them to act as a second layer of computation within the neuron and serve as the fundamental unit of plasticity. As such, dendrites are integral parts of the memory engram, namely the physical representation of memories in the brain and are increasingly studied during learning tasks. Here, we review experimental and computational studies that support a novel, dendritic view of the memory engram that is centered on non-linear dendritic branches as elementary memory units. We highlight the potential implications of dendritic engrams for the learning and memory field and discuss future research directions.
Collapse
Affiliation(s)
- George Kastellakis
- Institute of Molecular Biology and Biotechnology, Foundation for Research and Technology, Heraklion, Greece
| | - Simone Tasciotti
- Institute of Molecular Biology and Biotechnology, Foundation for Research and Technology, Heraklion, Greece
- Department of Biology, University of Crete, Heraklion, Greece
| | - Ioanna Pandi
- Institute of Molecular Biology and Biotechnology, Foundation for Research and Technology, Heraklion, Greece
- Department of Biology, University of Crete, Heraklion, Greece
| | - Panayiota Poirazi
- Institute of Molecular Biology and Biotechnology, Foundation for Research and Technology, Heraklion, Greece
| |
Collapse
|
4
|
Wilmes KA, Clopath C. Dendrites help mitigate the plasticity-stability dilemma. Sci Rep 2023; 13:6543. [PMID: 37085642 PMCID: PMC10121616 DOI: 10.1038/s41598-023-32410-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 03/27/2023] [Indexed: 04/23/2023] Open
Abstract
With Hebbian learning 'who fires together wires together', well-known problems arise. Hebbian plasticity can cause unstable network dynamics and overwrite stored memories. Because the known homeostatic plasticity mechanisms tend to be too slow to combat unstable dynamics, it has been proposed that plasticity must be highly gated and synaptic strengths limited. While solving the issue of stability, gating and limiting plasticity does not solve the stability-plasticity dilemma. We propose that dendrites enable both stable network dynamics and considerable synaptic changes, as they allow the gating of plasticity in a compartment-specific manner. We investigate how gating plasticity influences network stability in plastic balanced spiking networks of neurons with dendrites. We compare how different ways to gate plasticity, namely via modulating excitability, learning rate, and inhibition increase stability. We investigate how dendritic versus perisomatic gating allows for different amounts of weight changes in stable networks. We suggest that the compartmentalisation of pyramidal cells enables dendritic synaptic changes while maintaining stability. We show that the coupling between dendrite and soma is critical for the plasticity-stability trade-off. Finally, we show that spatially restricted plasticity additionally improves stability.
Collapse
Affiliation(s)
- Katharina A Wilmes
- Imperial College London, London, United Kingdom.
- University of Bern, Bern, Switzerland.
| | | |
Collapse
|
5
|
Bilash OM, Chavlis S, Johnson CD, Poirazi P, Basu J. Lateral entorhinal cortex inputs modulate hippocampal dendritic excitability by recruiting a local disinhibitory microcircuit. Cell Rep 2023; 42:111962. [PMID: 36640337 DOI: 10.1016/j.celrep.2022.111962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 10/31/2022] [Accepted: 12/20/2022] [Indexed: 01/06/2023] Open
Abstract
The lateral entorhinal cortex (LEC) provides multisensory information to the hippocampus, directly to the distal dendrites of CA1 pyramidal neurons. LEC neurons perform important functions for episodic memory processing, coding for contextually salient elements of an environment or experience. However, we know little about the functional circuit interactions between the LEC and the hippocampus. We combine functional circuit mapping and computational modeling to examine how long-range glutamatergic LEC projections modulate compartment-specific excitation-inhibition dynamics in hippocampal area CA1. We demonstrate that glutamatergic LEC inputs can drive local dendritic spikes in CA1 pyramidal neurons, aided by the recruitment of a disinhibitory VIP interneuron microcircuit. Our circuit mapping and modeling further reveal that LEC inputs also recruit CCK interneurons that may act as strong suppressors of dendritic spikes. These results highlight a cortically driven GABAergic microcircuit mechanism that gates nonlinear dendritic computations, which may support compartment-specific coding of multisensory contextual features within the hippocampus.
Collapse
Affiliation(s)
- Olesia M Bilash
- Neuroscience Institute, Department of Neuroscience and Physiology, New York University Grossman School of Medicine, NYU Langone Health, New York, NY 10016, USA
| | - Spyridon Chavlis
- Institute of Molecular Biology and Biotechnology (IMBB), Foundation for Research and Technology-Hellas (FORTH), Heraklion, Crete 70013, Greece
| | - Cara D Johnson
- Neuroscience Institute, Department of Neuroscience and Physiology, New York University Grossman School of Medicine, NYU Langone Health, New York, NY 10016, USA
| | - Panayiota Poirazi
- Institute of Molecular Biology and Biotechnology (IMBB), Foundation for Research and Technology-Hellas (FORTH), Heraklion, Crete 70013, Greece.
| | - Jayeeta Basu
- Neuroscience Institute, Department of Neuroscience and Physiology, New York University Grossman School of Medicine, NYU Langone Health, New York, NY 10016, USA; Center for Neural Science, New York University, New York, NY 10003, USA; Department of Psychiatry, New York University Grossman School of Medicine, NYU Langone Health, New York, NY 10016, USA.
| |
Collapse
|
6
|
Wu YK, Miehl C, Gjorgjieva J. Regulation of circuit organization and function through inhibitory synaptic plasticity. Trends Neurosci 2022; 45:884-898. [PMID: 36404455 DOI: 10.1016/j.tins.2022.10.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 10/02/2022] [Accepted: 10/04/2022] [Indexed: 11/15/2022]
Abstract
Diverse inhibitory neurons in the mammalian brain shape circuit connectivity and dynamics through mechanisms of synaptic plasticity. Inhibitory plasticity can establish excitation/inhibition (E/I) balance, control neuronal firing, and affect local calcium concentration, hence regulating neuronal activity at the network, single neuron, and dendritic level. Computational models can synthesize multiple experimental results and provide insight into how inhibitory plasticity controls circuit dynamics and sculpts connectivity by identifying phenomenological learning rules amenable to mathematical analysis. We highlight recent studies on the role of inhibitory plasticity in modulating excitatory plasticity, forming structured networks underlying memory formation and recall, and implementing adaptive phenomena and novelty detection. We conclude with experimental and modeling progress on the role of interneuron-specific plasticity in circuit computation and context-dependent learning.
Collapse
Affiliation(s)
- Yue Kris Wu
- School of Life Sciences, Technical University of Munich, Freising, Germany; Max Planck Institute for Brain Research, Frankfurt, Germany
| | - Christoph Miehl
- School of Life Sciences, Technical University of Munich, Freising, Germany; Max Planck Institute for Brain Research, Frankfurt, Germany
| | - Julijana Gjorgjieva
- School of Life Sciences, Technical University of Munich, Freising, Germany; Max Planck Institute for Brain Research, Frankfurt, Germany.
| |
Collapse
|
7
|
Kim SH, Woo J, Choi K, Choi M, Han K. Neural Information Processing and Computations of Two-Input Synapses. Neural Comput 2022; 34:2102-2131. [PMID: 36027799 DOI: 10.1162/neco_a_01534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Accepted: 06/02/2022] [Indexed: 11/04/2022]
Abstract
Information processing in artificial neural networks is largely dependent on the nature of neuron models. While commonly used models are designed for linear integration of synaptic inputs, accumulating experimental evidence suggests that biological neurons are capable of nonlinear computations for many converging synaptic inputs via homo- and heterosynaptic mechanisms. This nonlinear neuronal computation may play an important role in complex information processing at the neural circuit level. Here we characterize the dynamics and coding properties of neuron models on synaptic transmissions delivered from two hidden states. The neuronal information processing is influenced by the cooperative and competitive interactions among synapses and the coherence of the hidden states. Furthermore, we demonstrate that neuronal information processing under two-input synaptic transmission can be mapped to linearly nonseparable XOR as well as basic AND/OR operations. In particular, the mixtures of linear and nonlinear neuron models outperform the fashion-MNIST test compared to the neural networks consisting of only one type. This study provides a computational framework for assessing information processing of neuron and synapse models that may be beneficial for the design of brain-inspired artificial intelligence algorithms and neuromorphic systems.
Collapse
Affiliation(s)
- Soon Ho Kim
- Laboratory of Computational Neurophysics, Convergence Research Center for Brain Science, Brain Science Institute, Korea Institute of Science and Technology, Seoul 02792, South Korea
| | - Junhyuk Woo
- Laboratory of Computational Neurophysics, Convergence Research Center for Brain Science, Brain Science Institute, Korea Institute of Science and Technology, Seoul 02792, South Korea
| | - Kiri Choi
- School of Computational Sciences, Korea Institute for Advanced Study, Seoul 02455, South Korea
| | - MooYoung Choi
- Department of Physics and Astronomy and Center for Theoretical Physics, Seoul National University, Seoul 08826, South Korea
| | - Kyungreem Han
- Laboratory of Computational Neurophysics, Convergence Research Center for Brain Science, Brain Science Institute, Korea Institute of Science and Technology, Seoul 02792, South Korea
| |
Collapse
|
8
|
Abstract
Experience-dependent changes in behavior are mediated by long-term functional modifications in brain circuits. Activity-dependent plasticity of synaptic input is a major underlying cellular process. Although we have a detailed understanding of synaptic and dendritic plasticity in vitro, little is known about the functional and plastic properties of active dendrites in behaving animals. Using deep brain two-photon Ca2+ imaging, we investigated how sensory responses in amygdala principal neurons develop upon classical fear conditioning, a form of associative learning. Fear conditioning induced differential plasticity in dendrites and somas regulated by compartment-specific inhibition. Our results indicate that learning-induced plasticity can be uncoupled between soma and dendrites, reflecting distinct synaptic and microcircuit-level mechanisms that increase the computational capacity of amygdala circuits.
Collapse
Affiliation(s)
- Simon d'Aquin
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland.,University of Basel, Basel, Switzerland
| | - Andras Szonyi
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland.,Laboratory of Cellular Neurophysiology, Institute of Experimental Medicine, Budapest, Hungary
| | - Mathias Mahn
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland
| | - Sabine Krabbe
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland
| | - Jan Gründemann
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland.,Department of Biomedicine, University of Basel, Basel, Switzerland
| | - Andreas Lüthi
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland.,University of Basel, Basel, Switzerland
| |
Collapse
|
9
|
Feldhoff F, Toepfer H, Harczos T, Klefenz F. Periodicity Pitch Perception Part III: Sensibility and Pachinko Volatility. Front Neurosci 2022; 16:736642. [PMID: 35356050 PMCID: PMC8959216 DOI: 10.3389/fnins.2022.736642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Accepted: 02/07/2022] [Indexed: 11/29/2022] Open
Abstract
Neuromorphic computer models are used to explain sensory perceptions. Auditory models generate cochleagrams, which resemble the spike distributions in the auditory nerve. Neuron ensembles along the auditory pathway transform sensory inputs step by step and at the end pitch is represented in auditory categorical spaces. In two previous articles in the series on periodicity pitch perception an extended auditory model had been successfully used for explaining periodicity pitch proved for various musical instrument generated tones and sung vowels. In this third part in the series the focus is on octopus cells as they are central sensitivity elements in auditory cognition processes. A powerful numerical model had been devised, in which auditory nerve fibers (ANFs) spike events are the inputs, triggering the impulse responses of the octopus cells. Efficient algorithms are developed and demonstrated to explain the behavior of octopus cells with a focus on a simple event-based hardware implementation of a layer of octopus neurons. The main finding is, that an octopus' cell model in a local receptive field fine-tunes to a specific trajectory by a spike-timing-dependent plasticity (STDP) learning rule with synaptic pre-activation and the dendritic back-propagating signal as post condition. Successful learning explains away the teacher and there is thus no need for a temporally precise control of plasticity that distinguishes between learning and retrieval phases. Pitch learning is cascaded: At first octopus cells respond individually by self-adjustment to specific trajectories in their local receptive fields, then unions of octopus cells are collectively learned for pitch discrimination. Pitch estimation by inter-spike intervals is shown exemplary using two input scenarios: a simple sinus tone and a sung vowel. The model evaluation indicates an improvement in pitch estimation on a fixed time-scale.
Collapse
Affiliation(s)
- Frank Feldhoff
- Advanced Electromagnetics Group, Technische Universität Ilmenau, Ilmenau, Germany
| | - Hannes Toepfer
- Advanced Electromagnetics Group, Technische Universität Ilmenau, Ilmenau, Germany
| | - Tamas Harczos
- Fraunhofer-Institut für Digitale Medientechnologie, Ilmenau, Germany
- Auditory Neuroscience and Optogenetics Laboratory, German Primate Center, Göttingen, Germany
- audifon GmbH & Co. KG, Kölleda, Germany
| | - Frank Klefenz
- Fraunhofer-Institut für Digitale Medientechnologie, Ilmenau, Germany
| |
Collapse
|
10
|
Prince LY, Bacon T, Humphries R, Tsaneva-Atanasova K, Clopath C, Mellor JR. Separable actions of acetylcholine and noradrenaline on neuronal ensemble formation in hippocampal CA3 circuits. PLoS Comput Biol 2021; 17:e1009435. [PMID: 34597293 PMCID: PMC8513881 DOI: 10.1371/journal.pcbi.1009435] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Revised: 10/13/2021] [Accepted: 09/08/2021] [Indexed: 11/19/2022] Open
Abstract
In the hippocampus, episodic memories are thought to be encoded by the formation of ensembles of synaptically coupled CA3 pyramidal cells driven by sparse but powerful mossy fiber inputs from dentate gyrus granule cells. The neuromodulators acetylcholine and noradrenaline are separately proposed as saliency signals that dictate memory encoding but it is not known if they represent distinct signals with separate mechanisms. Here, we show experimentally that acetylcholine, and to a lesser extent noradrenaline, suppress feed-forward inhibition and enhance Excitatory-Inhibitory ratio in the mossy fiber pathway but CA3 recurrent network properties are only altered by acetylcholine. We explore the implications of these findings on CA3 ensemble formation using a hierarchy of models. In reconstructions of CA3 pyramidal cells, mossy fiber pathway disinhibition facilitates postsynaptic dendritic depolarization known to be required for synaptic plasticity at CA3-CA3 recurrent synapses. We further show in a spiking neural network model of CA3 how acetylcholine-specific network alterations can drive rapid overlapping ensemble formation. Thus, through these distinct sets of mechanisms, acetylcholine and noradrenaline facilitate the formation of neuronal ensembles in CA3 that encode salient episodic memories in the hippocampus but acetylcholine selectively enhances the density of memory storage.
Collapse
Affiliation(s)
- Luke Y. Prince
- Centre for Synaptic Plasticity, School of Physiology Pharmacology, and Neuroscience, University of Bristol, Bristol, United Kingdom
- Mila, Montreal, Quebec, Canada
- School of Computer Science, McGill University, Montreal, Quebec, Canada
| | - Travis Bacon
- Centre for Synaptic Plasticity, School of Physiology Pharmacology, and Neuroscience, University of Bristol, Bristol, United Kingdom
| | - Rachel Humphries
- Centre for Synaptic Plasticity, School of Physiology Pharmacology, and Neuroscience, University of Bristol, Bristol, United Kingdom
| | - Krasimira Tsaneva-Atanasova
- Department of Mathematics and Living Systems Institute, University of Exeter, Exeter, United Kingdom
- EPRSC Centre for Predictive Modelling in Healthcare, University of Exeter, Exeter, United Kingdom
| | - Claudia Clopath
- Bioengineering Department, Imperial College London, London, United Kingdom
| | - Jack R. Mellor
- Centre for Synaptic Plasticity, School of Physiology Pharmacology, and Neuroscience, University of Bristol, Bristol, United Kingdom
- * E-mail:
| |
Collapse
|
11
|
Dora S, Bohte SM, Pennartz CMA. Deep Gated Hebbian Predictive Coding Accounts for Emergence of Complex Neural Response Properties Along the Visual Cortical Hierarchy. Front Comput Neurosci 2021; 15:666131. [PMID: 34393744 PMCID: PMC8355371 DOI: 10.3389/fncom.2021.666131] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 06/28/2021] [Indexed: 11/13/2022] Open
Abstract
Predictive coding provides a computational paradigm for modeling perceptual processing as the construction of representations accounting for causes of sensory inputs. Here, we developed a scalable, deep network architecture for predictive coding that is trained using a gated Hebbian learning rule and mimics the feedforward and feedback connectivity of the cortex. After training on image datasets, the models formed latent representations in higher areas that allowed reconstruction of the original images. We analyzed low- and high-level properties such as orientation selectivity, object selectivity and sparseness of neuronal populations in the model. As reported experimentally, image selectivity increased systematically across ascending areas in the model hierarchy. Depending on the strength of regularization factors, sparseness also increased from lower to higher areas. The results suggest a rationale as to why experimental results on sparseness across the cortical hierarchy have been inconsistent. Finally, representations for different object classes became more distinguishable from lower to higher areas. Thus, deep neural networks trained using a gated Hebbian formulation of predictive coding can reproduce several properties associated with neuronal responses along the visual cortical hierarchy.
Collapse
Affiliation(s)
- Shirin Dora
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, Netherlands.,Intelligent Systems Research Centre, Ulster University, Londonderry, United Kingdom
| | - Sander M Bohte
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, Netherlands.,Machine Learning Group, Centre of Mathematics and Computer Science, Amsterdam, Netherlands
| | - Cyriel M A Pennartz
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
12
|
Yang S, Gao T, Wang J, Deng B, Lansdell B, Linares-Barranco B. Efficient Spike-Driven Learning With Dendritic Event-Based Processing. Front Neurosci 2021; 15:601109. [PMID: 33679295 PMCID: PMC7933681 DOI: 10.3389/fnins.2021.601109] [Citation(s) in RCA: 60] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Accepted: 01/21/2021] [Indexed: 11/22/2022] Open
Abstract
A critical challenge in neuromorphic computing is to present computationally efficient algorithms of learning. When implementing gradient-based learning, error information must be routed through the network, such that each neuron knows its contribution to output, and thus how to adjust its weight. This is known as the credit assignment problem. Exactly implementing a solution like backpropagation involves weight sharing, which requires additional bandwidth and computations in a neuromorphic system. Instead, models of learning from neuroscience can provide inspiration for how to communicate error information efficiently, without weight sharing. Here we present a novel dendritic event-based processing (DEP) algorithm, using a two-compartment leaky integrate-and-fire neuron with partially segregated dendrites that effectively solves the credit assignment problem. In order to optimize the proposed algorithm, a dynamic fixed-point representation method and piecewise linear approximation approach are presented, while the synaptic events are binarized during learning. The presented optimization makes the proposed DEP algorithm very suitable for implementation in digital or mixed-signal neuromorphic hardware. The experimental results show that spiking representations can rapidly learn, achieving high performance by using the proposed DEP algorithm. We find the learning capability is affected by the degree of dendritic segregation, and the form of synaptic feedback connections. This study provides a bridge between the biological learning and neuromorphic learning, and is meaningful for the real-time applications in the field of artificial intelligence.
Collapse
Affiliation(s)
- Shuangming Yang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Tian Gao
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Jiang Wang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Bin Deng
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Benjamin Lansdell
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, United States
| | | |
Collapse
|
13
|
Lisek M, Zylinska L, Boczek T. Ketamine and Calcium Signaling-A Crosstalk for Neuronal Physiology and Pathology. Int J Mol Sci 2020; 21:ijms21218410. [PMID: 33182497 PMCID: PMC7665128 DOI: 10.3390/ijms21218410] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 10/31/2020] [Accepted: 11/05/2020] [Indexed: 12/12/2022] Open
Abstract
Ketamine is a non-competitive antagonist of NMDA (N-methyl-D-aspartate) receptor, which has been in clinical practice for over a half century. Despite recent data suggesting its harmful side effects, such as neuronal loss, synapse dysfunction or disturbed neural network formation, the drug is still applied in veterinary medicine and specialist anesthesia. Several lines of evidence indicate that structural and functional abnormalities in the nervous system caused by ketamine are crosslinked with the imbalanced activity of multiple Ca2+-regulated signaling pathways. Due to its ubiquitous nature, Ca2+ is also frequently located in the center of ketamine action, although the precise mechanisms underlying drug’s negative or therapeutic properties remain mysterious for the large part. This review seeks to delineate the relationship between ketamine-triggered imbalance in Ca2+ homeostasis and functional consequences for downstream processes regulating key aspects of neuronal function.
Collapse
|
14
|
Drix D, Hafner VV, Schmuker M. Sparse coding with a somato-dendritic rule. Neural Netw 2020; 131:37-49. [PMID: 32750603 DOI: 10.1016/j.neunet.2020.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Revised: 04/30/2020] [Accepted: 06/04/2020] [Indexed: 10/24/2022]
Abstract
Cortical neurons are silent most of the time: sparse activity enables low-energy computation in the brain, and promises to do the same in neuromorphic hardware. Beyond power efficiency, sparse codes have favourable properties for associative learning, as they can store more information than local codes but are easier to read out than dense codes. Auto-encoders with a sparse constraint can learn sparse codes, and so can single-layer networks that combine recurrent inhibition with unsupervised Hebbian learning. But the latter usually require fast homeostatic plasticity, which could lead to catastrophic forgetting in embodied agents that learn continuously. Here we set out to explore whether plasticity at recurrent inhibitory synapses could take up that role instead, regulating both the population sparseness and the firing rates of individual neurons. We put the idea to the test in a network that employs compartmentalised inputs to solve the task: rate-based dendritic compartments integrate the feedforward input, while spiking integrate-and-fire somas compete through recurrent inhibition. A somato-dendritic learning rule allows somatic inhibition to modulate nonlinear Hebbian learning in the dendrites. Trained on MNIST digits and natural images, the network discovers independent components that form a sparse encoding of the input and support linear decoding. These findings confirm that intrinsic homeostatic plasticity is not strictly required for regulating sparseness: inhibitory synaptic plasticity can have the same effect. Our work illustrates the usefulness of compartmentalised inputs, and makes the case for moving beyond point neuron models in artificial spiking neural networks.
Collapse
Affiliation(s)
- Damien Drix
- Biocomputation group, Department of Computer Science, University of Hertfordshire, Hatfield, United Kingdom; Adaptive Systems laboratory, Institut für Informatik, Humboldt-Universität zu Berlin, Berlin, Germany; Bernstein Center for Computational Neuroscience, Berlin, Germany.
| | - Verena V Hafner
- Adaptive Systems laboratory, Institut für Informatik, Humboldt-Universität zu Berlin, Berlin, Germany; Bernstein Center for Computational Neuroscience, Berlin, Germany
| | - Michael Schmuker
- Biocomputation group, Department of Computer Science, University of Hertfordshire, Hatfield, United Kingdom; Bernstein Center for Computational Neuroscience, Berlin, Germany
| |
Collapse
|
15
|
Abstract
Dendrites have always fascinated researchers: from the artistic drawings by Ramon y Cajal to the beautiful recordings of today, neuroscientists have been striving to unravel the mysteries of these structures. Theoretical work in the 1960s predicted important dendritic effects on neuronal processing, establishing computational modelling as a powerful technique for their investigation. Since then, modelling of dendrites has been instrumental in driving neuroscience research in a targeted manner, providing experimentally testable predictions that range from the subcellular level to the systems level, and their relevance extends to fields beyond neuroscience, such as machine learning and artificial intelligence. Validation of modelling predictions often requires - and drives - new technological advances, thus closing the loop with theory-driven experimentation that moves the field forward. This Review features the most important, to our understanding, contributions of modelling of dendritic computations, including those pending experimental verification, and highlights studies of successful interactions between the modelling and experimental neuroscience communities.
Collapse
Affiliation(s)
- Panayiota Poirazi
- Institute of Molecular Biology & Biotechnology, Foundation for Research & Technology - Hellas, Heraklion, Crete, Greece.
| | - Athanasia Papoutsi
- Institute of Molecular Biology & Biotechnology, Foundation for Research & Technology - Hellas, Heraklion, Crete, Greece
| |
Collapse
|
16
|
Muller SZ, Zadina AN, Abbott LF, Sawtell NB. Continual Learning in a Multi-Layer Network of an Electric Fish. Cell 2019; 179:1382-1392.e10. [PMID: 31735497 DOI: 10.1016/j.cell.2019.10.020] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2019] [Revised: 09/30/2019] [Accepted: 10/21/2019] [Indexed: 11/15/2022]
Abstract
Distributing learning across multiple layers has proven extremely powerful in artificial neural networks. However, little is known about how multi-layer learning is implemented in the brain. Here, we provide an account of learning across multiple processing layers in the electrosensory lobe (ELL) of mormyrid fish and report how it solves problems well known from machine learning. Because the ELL operates and learns continuously, it must reconcile learning and signaling functions without switching its mode of operation. We show that this is accomplished through a functional compartmentalization within intermediate layer neurons in which inputs driving learning differentially affect dendritic and axonal spikes. We also find that connectivity based on learning rather than sensory response selectivity assures that plasticity at synapses onto intermediate-layer neurons is matched to the requirements of output neurons. The mechanisms we uncover have relevance to learning in the cerebellum, hippocampus, and cerebral cortex, as well as in artificial systems.
Collapse
Affiliation(s)
- Salomon Z Muller
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA; Department of Biological Sciences, Columbia University, New York, NY 10027, USA
| | - Abigail N Zadina
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA
| | - L F Abbott
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA; Department of Physiology and Cellular Biophysics, Columbia University, New York, NY 10027, USA
| | - Nathaniel B Sawtell
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA.
| |
Collapse
|
17
|
Voloh B, Womelsdorf T. Cell-Type Specific Burst Firing Interacts with Theta and Beta Activity in Prefrontal Cortex During Attention States. Cereb Cortex 2019; 28:4348-4364. [PMID: 29136106 DOI: 10.1093/cercor/bhx287] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2017] [Indexed: 12/25/2022] Open
Abstract
Population-level theta and beta band activity in anterior cingulate and prefrontal cortices (ACC/PFC) are prominent signatures of self-controlled, adaptive behaviors. But how these rhythmic activities are linked to cell-type specific activity has remained unclear. Here, we suggest such a cell-to-systems level linkage. We found that the rate of burst spiking events is enhanced particularly during attention states and that attention-specific burst spikes have a unique temporal relationship to local theta and beta band population-level activities. For the 5-10 Hz theta frequency range, bursts coincided with transient increases of local theta power relative to nonbursts, particularly for bursts of putative interneurons. For the 16-30 Hz beta frequency, bursts of putative interneurons phase synchronized stronger than nonbursts, and were associated with larger beta power modulation. In contrast, burst of putative pyramidal cells showed similar beta power modulation as nonbursts, but were accompanied by stronger beta power only when they occurred early in the beta cycle. These findings suggest that in the ACC/PFC during attention states, mechanisms underlying burst firing are intimately linked to narrow band population-level activities, providing a cell-type specific window into rhythmic inhibitory gating and the emergence of rhythmically coherent network states during goal directed behavior.
Collapse
Affiliation(s)
- B Voloh
- Department of Biology, Centre for Vision Research, York University, Toronto, Ontario, Canada.,Department of Psychology, Vanderbilt University, PMB 407817, 2301 Vanderbilt Place, Nashville, TN, USA
| | - T Womelsdorf
- Department of Biology, Centre for Vision Research, York University, Toronto, Ontario, Canada.,Department of Psychology, Vanderbilt University, PMB 407817, 2301 Vanderbilt Place, Nashville, TN, USA
| |
Collapse
|
18
|
Abstract
Dendrites are much more than passive neuronal components. Mounting experimental evidence and decades of computational work have decisively shown that dendrites leverage a host of nonlinear biophysical phenomena and actively participate in sophisticated computations, at the level of the single neuron and at the level of the network. However, a coherent view of their processing power is still lacking and dendrites are largely neglected in neural network models. Here, we describe four classes of dendritic information processing and delineate their implications at the algorithmic level. We propose that beyond the well-known spatiotemporal filtering of their inputs, dendrites are capable of selecting, routing and multiplexing information. By separating dendritic processing from axonal outputs, neuron networks gain a degree of freedom with implications for perception and learning.
Collapse
Affiliation(s)
- Alexandre Payeur
- Ottawa Brain and Mind Institute, Centre for Neural Dynamics, Department of Cellular and Molecular Neuroscience, University of Ottawa, Canada
| | - Jean-Claude Béïque
- Ottawa Brain and Mind Institute, Centre for Neural Dynamics, Department of Cellular and Molecular Neuroscience, University of Ottawa, Canada
| | - Richard Naud
- Ottawa Brain and Mind Institute, Centre for Neural Dynamics, Department of Cellular and Molecular Neuroscience, University of Ottawa, Canada; Department of Physics, University of Ottawa, 150 Louis Pasteur Pet, Ottawa, ON, K1N 6N5, Canada.
| |
Collapse
|
19
|
Hertäg L, Sprekeler H. Amplifying the redistribution of somato-dendritic inhibition by the interplay of three interneuron types. PLoS Comput Biol 2019; 15:e1006999. [PMID: 31095556 PMCID: PMC6541306 DOI: 10.1371/journal.pcbi.1006999] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2018] [Revised: 05/29/2019] [Accepted: 04/01/2019] [Indexed: 01/24/2023] Open
Abstract
GABAergic interneurons play an important role in shaping the activity of excitatory pyramidal cells (PCs). How the various inhibitory cell types contribute to neuronal information processing, however, is not resolved. Here, we propose a functional role for a widespread network motif consisting of parvalbumin- (PV), somatostatin- (SOM) and vasoactive intestinal peptide (VIP)-expressing interneurons. Following the idea that PV and SOM interneurons control the distribution of somatic and dendritic inhibition onto PCs, we suggest that mutual inhibition between VIP and SOM cells translates weak inputs to VIP interneurons into large changes of somato-dendritic inhibition of PCs. Using a computational model, we show that the neuronal and synaptic properties of the circuit support this hypothesis. Moreover, we demonstrate that the SOM-VIP motif allows transient inputs to persistently switch the circuit between two processing modes, in which top-down inputs onto apical dendrites of PCs are either integrated or cancelled. Neurons in the brain can be classified as excitatory or inhibitory based on whether they activate or deactivate the cells to whom they send signals. Compared to their excitatory counterpart, inhibitory neurons present themselves as a wild diversity of cell classes. It is broadly believed that these classes serve different purposes, but as of now, those are poorly understood. In this article, we suggest how an intricate interplay of three inhibitory cell classes can control whether internal signals—such as predictions, memory signals or motor commands—are taken into account when sensory signals are interpreted. Using a mathematical model and computer simulations, we show that such internal signals can be shut down by regulating which inhibitory cell types are active, and that the interaction of different cell classes allows weak control signals to do so.
Collapse
Affiliation(s)
- Loreen Hertäg
- Modelling of Cognitive Processes, Berlin Institute of Technology, Berlin, Germany.,Bernstein Center for Computational Neuroscience, Berlin, Germany
| | - Henning Sprekeler
- Modelling of Cognitive Processes, Berlin Institute of Technology, Berlin, Germany.,Bernstein Center for Computational Neuroscience, Berlin, Germany
| |
Collapse
|
20
|
Richards BA, Lillicrap TP. Dendritic solutions to the credit assignment problem. Curr Opin Neurobiol 2018; 54:28-36. [PMID: 30205266 DOI: 10.1016/j.conb.2018.08.003] [Citation(s) in RCA: 50] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2018] [Revised: 07/19/2018] [Accepted: 08/07/2018] [Indexed: 11/27/2022]
Abstract
Guaranteeing that synaptic plasticity leads to effective learning requires a means for assigning credit to each neuron for its contribution to behavior. The 'credit assignment problem' refers to the fact that credit assignment is non-trivial in hierarchical networks with multiple stages of processing. One difficulty is that if credit signals are integrated with other inputs, then it is hard for synaptic plasticity rules to distinguish credit-related activity from non-credit-related activity. A potential solution is to use the spatial layout and non-linear properties of dendrites to distinguish credit signals from other inputs. In cortical pyramidal neurons, evidence hints that top-down feedback signals are integrated in the distal apical dendrites and have a distinct impact on spike-firing and synaptic plasticity. This suggests that the distal apical dendrites of pyramidal neurons help the brain to solve the credit assignment problem.
Collapse
Affiliation(s)
- Blake A Richards
- Department of Biological Sciences, University of Toronto Scarborough, Toronto, ON, Canada; Department of Cell and Systems Biology, University of Toronto, Toronto, ON, Canada; Learning in Machines and Brains Program, Canadian Institute for Advanced Research, Toronto, ON, Canada
| | | |
Collapse
|
21
|
Doron M, Chindemi G, Muller E, Markram H, Segev I. Timed Synaptic Inhibition Shapes NMDA Spikes, Influencing Local Dendritic Processing and Global I/O Properties of Cortical Neurons. Cell Rep 2018; 21:1550-1561. [PMID: 29117560 DOI: 10.1016/j.celrep.2017.10.035] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2017] [Revised: 08/17/2017] [Accepted: 10/08/2017] [Indexed: 10/18/2022] Open
Abstract
The NMDA spike is a long-lasting nonlinear phenomenon initiated locally in the dendritic branches of a variety of cortical neurons. It plays a key role in synaptic plasticity and in single-neuron computations. Combining dynamic system theory and computational approaches, we now explore how the timing of synaptic inhibition affects the NMDA spike and its associated membrane current. When impinging on its early phase, individual inhibitory synapses strongly, but transiently, dampen the NMDA spike; later inhibition prematurely terminates it. A single inhibitory synapse reduces the NMDA-mediated Ca2+ current, a key player in plasticity, by up to 45%. NMDA spikes in distal dendritic branches/spines are longer-lasting and more resilient to inhibition, enhancing synaptic plasticity at these branches. We conclude that NMDA spikes are highly sensitive to dendritic inhibition; sparse weak inhibition can finely tune synaptic plasticity both locally at the dendritic branch level and globally at the level of the neuron's output.
Collapse
Affiliation(s)
- Michael Doron
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University of Jerusalem, Jerusalem 91904, Israel.
| | - Giuseppe Chindemi
- Blue Brain Project, École polytechnique fédérale de Lausanne (EPFL), Biotech Campus, 1202 Geneva, Switzerland
| | - Eilif Muller
- Blue Brain Project, École polytechnique fédérale de Lausanne (EPFL), Biotech Campus, 1202 Geneva, Switzerland
| | - Henry Markram
- Blue Brain Project, École polytechnique fédérale de Lausanne (EPFL), Biotech Campus, 1202 Geneva, Switzerland
| | - Idan Segev
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University of Jerusalem, Jerusalem 91904, Israel; Department of Neurobiology, the Hebrew University of Jerusalem, Jerusalem 91904, Israel
| |
Collapse
|
22
|
Abstract
GABAergic inhibition plays a critical role in the regulation of neuronal activity. In the neocortex, inhibitory interneurons that target the dendrites of pyramidal cells influence both electrical and biochemical postsynaptic signaling. Voltage-gated ion channels strongly shape dendritic excitability and the integration of excitatory inputs, but their contribution to GABAergic signaling is less well understood. By combining 2-photon calcium imaging and focal GABA uncaging, we show that voltage-gated potassium channels normally suppress the GABAergic inhibition of calcium signals evoked by back-propagating action potentials in dendritic spines and shafts of cortical pyramidal neurons. Moreover, the voltage-dependent inactivation of these channels leads to enhancement of dendritic calcium inhibition following somatic spiking. Computational modeling reveals that the enhancement of calcium inhibition involves an increase in action potential depolarization coupled with the nonlinear relationship between membrane voltage and calcium channel activation. Overall, our findings highlight the interaction between intrinsic and synaptic properties and reveal a novel mechanism for the activity-dependent regulation of GABAergic inhibition.
Collapse
Affiliation(s)
- Jeremy T. Chang
- Department of NeuroscienceProgram in Cellular Neuroscience, Neurodegeneration and RepairKavli InstituteYale School of MedicineNew HavenConnecticut
| | - Michael J. Higley
- Department of NeuroscienceProgram in Cellular Neuroscience, Neurodegeneration and RepairKavli InstituteYale School of MedicineNew HavenConnecticut
| |
Collapse
|
23
|
Weissenberger F, Meier F, Lengler J, Einarsson H, Steger A. Long Synfire Chains Emerge by Spike-Timing Dependent Plasticity Modulated by Population Activity. Int J Neural Syst 2017; 27:1750044. [DOI: 10.1142/s0129065717500447] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Sequences of precisely timed neuronal activity are observed in many brain areas in various species. Synfire chains are a well-established model that can explain such sequences. However, it is unknown under which conditions synfire chains can develop in initially unstructured networks by self-organization. This work shows that with spike-timing dependent plasticity (STDP), modulated by global population activity, long synfire chains emerge in sparse random networks. The learning rule fosters neurons to participate multiple times in the chain or in multiple chains. Such reuse of neurons has been experimentally observed and is necessary for high capacity. Sparse networks prevent the chains from being short and cyclic and show that the formation of specific synapses is not essential for chain formation. Analysis of the learning rule in a simple network of binary threshold neurons reveals the asymptotically optimal length of the emerging chains. The theoretical results generalize to simulated networks of conductance-based leaky integrate-and-fire (LIF) neurons. As an application of the emerged chain, we propose a one-shot memory for sequences of precisely timed neuronal activity.
Collapse
Affiliation(s)
- Felix Weissenberger
- Department of Computer Science, ETH Zürich, Universitätsstrasse 6, 8092, Zürich, Switzerland
| | - Florian Meier
- Department of Computer Science, ETH Zürich, Universitätsstrasse 6, 8092, Zürich, Switzerland
| | - Johannes Lengler
- Department of Computer Science, ETH Zürich, Universitätsstrasse 6, 8092, Zürich, Switzerland
| | - Hafsteinn Einarsson
- Department of Computer Science, ETH Zürich, Universitätsstrasse 6, 8092, Zürich, Switzerland
| | - Angelika Steger
- Department of Computer Science, ETH Zürich, Universitätsstrasse 6, 8092, Zürich, Switzerland
| |
Collapse
|
24
|
Hiratani N, Fukai T. Detailed Dendritic Excitatory/Inhibitory Balance through Heterosynaptic Spike-Timing-Dependent Plasticity. J Neurosci 2017; 37:12106-22. [PMID: 29089443 DOI: 10.1523/JNEUROSCI.0027-17.2017] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2017] [Revised: 10/10/2017] [Accepted: 10/17/2017] [Indexed: 11/21/2022] Open
Abstract
The balance between excitatory and inhibitory inputs is a key feature of cortical dynamics. Such a balance is arguably preserved in dendritic branches, yet its underlying mechanism and functional roles remain unknown. In this study, we developed computational models of heterosynaptic spike-timing-dependent plasticity (STDP) to show that the excitatory/inhibitory balance in dendritic branches is robustly achieved through heterosynaptic interactions between excitatory and inhibitory synapses. The model reproduces key features of experimental heterosynaptic STDP well, and provides analytical insights. Furthermore, heterosynaptic STDP explains how the maturation of inhibitory neurons modulates the selectivity of excitatory neurons for binocular matching in the critical period plasticity. The model also provides an alternative explanation for the potential mechanism underlying the somatic detailed balance that is commonly associated with inhibitory STDP. Our results propose heterosynaptic STDP as a critical factor in synaptic organization and the resultant dendritic computation.SIGNIFICANCE STATEMENT Recent experimental studies reveal that relative differences in spike timings experienced among neighboring glutamatergic and GABAergic synapses on a dendritic branch significantly influences changes in the efficiency of these synapses. This heterosynaptic form of spike-timing-dependent plasticity (STDP) is potentially important for shaping the synaptic organization and computation of neurons, but its functional role remains elusive. Through computational modeling at the parameter regime where previous experimental results are well reproduced, we show that heterosynaptic plasticity serves to finely balance excitatory and inhibitory inputs on the dendrite. Our results suggest a principle of GABA-driven neural circuit formation.
Collapse
|
25
|
Bono J, Clopath C. Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level. Nat Commun 2017; 8:706. [PMID: 28951585 DOI: 10.1038/s41467-017-00740-z] [Citation(s) in RCA: 58] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2016] [Accepted: 07/25/2017] [Indexed: 12/11/2022] Open
Abstract
Synaptic plasticity is thought to be the principal neuronal mechanism underlying learning. Models of plastic networks typically combine point neurons with spike-timing-dependent plasticity (STDP) as the learning rule. However, a point neuron does not capture the local non-linear processing of synaptic inputs allowed for by dendrites. Furthermore, experimental evidence suggests that STDP is not the only learning rule available to neurons. By implementing biophysically realistic neuron models, we study how dendrites enable multiple synaptic plasticity mechanisms to coexist in a single cell. In these models, we compare the conditions for STDP and for synaptic strengthening by local dendritic spikes. We also explore how the connectivity between two cells is affected by these plasticity rules and by different synaptic distributions. Finally, we show that how memory retention during associative learning can be prolonged in networks of neurons by including dendrites. Synaptic plasticity is the neuronal mechanism underlying learning. Here the authors construct biophysical models of pyramidal neurons that reproduce observed plasticity gradients along the dendrite and show that dendritic spike dependent LTP which is predominant in distal sections can prolong memory retention.
Collapse
|
26
|
Bono J, Wilmes KA, Clopath C. Modelling plasticity in dendrites: from single cells to networks. Curr Opin Neurobiol 2017; 46:136-141. [PMID: 28888857 DOI: 10.1016/j.conb.2017.08.013] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2017] [Accepted: 08/23/2017] [Indexed: 02/06/2023]
Abstract
One of the key questions in neuroscience is how our brain self-organises to efficiently process information. To answer this question, we need to understand the underlying mechanisms of plasticity and their role in shaping synaptic connectivity. Theoretical neuroscience typically investigates plasticity on the level of neural networks. Neural network models often consist of point neurons, completely neglecting neuronal morphology for reasons of simplicity. However, during the past decades it became increasingly clear that inputs are locally processed in the dendrites before they reach the cell body. Dendritic properties enable local interactions between synapses and location-dependent modulations of inputs, rendering the position of synapses on dendrites highly important. These insights changed our view of neurons, such that we now think of them as small networks of nearly independent subunits instead of a simple point. Here, we propose that understanding how the brain processes information strongly requires that we consider the following properties: which plasticity mechanisms are present in the dendrites and how do they enable the self-organisation of synapses across the dendritic tree for efficient information processing? Ultimately, dendritic plasticity mechanisms can be studied in networks of neurons with dendrites, possibly uncovering unknown mechanisms that shape the connectivity in our brains.
Collapse
Affiliation(s)
- Jacopo Bono
- Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, UK
| | - Katharina A Wilmes
- Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, UK
| | - Claudia Clopath
- Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, UK.
| |
Collapse
|
27
|
Affiliation(s)
- Guillaume Hennequin
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge CB2 3EJ, United Kingdom
| | - Everton J. Agnes
- Centre for Neural Circuits and Behaviour, Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford OX1 3SR, United Kingdom
| | - Tim P. Vogels
- Centre for Neural Circuits and Behaviour, Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford OX1 3SR, United Kingdom
| |
Collapse
|
28
|
Zenke F, Gerstner W, Ganguli S. The temporal paradox of Hebbian learning and homeostatic plasticity. Curr Opin Neurobiol 2017; 43:166-176. [DOI: 10.1016/j.conb.2017.03.015] [Citation(s) in RCA: 104] [Impact Index Per Article: 14.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2016] [Revised: 03/07/2017] [Accepted: 03/22/2017] [Indexed: 11/16/2022]
|
29
|
Michalikova M, Remme MWH, Kempter R. Spikelets in Pyramidal Neurons: Action Potentials Initiated in the Axon Initial Segment That Do Not Activate the Soma. PLoS Comput Biol 2017; 13:e1005237. [PMID: 28068338 PMCID: PMC5221759 DOI: 10.1371/journal.pcbi.1005237] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2016] [Accepted: 11/01/2016] [Indexed: 11/18/2022] Open
Abstract
Spikelets are small spike-like depolarizations that can be measured in somatic intracellular recordings. Their origin in pyramidal neurons remains controversial. To explain spikelet generation, we propose a novel single-cell mechanism: somato-dendritic input generates action potentials at the axon initial segment that may fail to activate the soma and manifest as somatic spikelets. Using mathematical analysis and numerical simulations of compartmental neuron models, we identified four key factors controlling spikelet generation: (1) difference in firing threshold, (2) impedance mismatch, and (3) electrotonic separation between the soma and the axon initial segment, as well as (4) input amplitude. Because spikelets involve forward propagation of action potentials along the axon while they avoid full depolarization of the somato-dendritic compartments, we conjecture that this mode of operation saves energy and regulates dendritic plasticity while still allowing for a read-out of results of neuronal computations. Action potentials (APs) are digital, all-or-none signals by which neurons communicate with each other. Therefore, APs are the basis of neural function, yet some of their fundamental features are still not well understood. Here we focus on pyramidal cells, which are the principal neurons in neocortex and hippocampus. According to textbook knowledge, an AP in pyramidal neurons is initiated at the axon initial segment and propagates along the axon to the next cell. Concurrently, the AP also propagates back to the soma and into the dendrites where it might trigger synaptic plasticity, which is the basis of learning and memory. However, besides APs, pyramidal cells sometimes also show somatic spikelets—small depolarizations with an AP-like shape—whose origin remains unclear. Here, we propose that spikelets occur when an AP initiated at the axon initial segment only propagates down the axon, but fails to activate sodium currents in the soma and dendrites. As a result, spikelet firing saves energy, and moreover, might be a means to control synaptic plasticity and thereby control learning and memory.
Collapse
Affiliation(s)
- Martina Michalikova
- Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Michiel W. H. Remme
- Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Richard Kempter
- Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Berlin, Germany
- * E-mail:
| |
Collapse
|
30
|
Wilmes KA, Schleimer JH, Schreiber S. Spike-timing dependent inhibitory plasticity to learn a selective gating of backpropagating action potentials. Eur J Neurosci 2016; 45:1032-1043. [DOI: 10.1111/ejn.13326] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2016] [Revised: 06/07/2016] [Accepted: 06/27/2016] [Indexed: 11/26/2022]
Affiliation(s)
- Katharina Anna Wilmes
- Institute for Theoretical Biology; Department of Biology; Humboldt-Universität zu Berlin; Philippstr. 13 10115 Berlin Germany
- Bernstein Center for Computational Neuroscience; Berlin Germany
| | - Jan-Hendrik Schleimer
- Institute for Theoretical Biology; Department of Biology; Humboldt-Universität zu Berlin; Philippstr. 13 10115 Berlin Germany
- Bernstein Center for Computational Neuroscience; Berlin Germany
| | - Susanne Schreiber
- Institute for Theoretical Biology; Department of Biology; Humboldt-Universität zu Berlin; Philippstr. 13 10115 Berlin Germany
- Bernstein Center for Computational Neuroscience; Berlin Germany
| |
Collapse
|