1
|
Nobukawa S, Nishimura H, Wagatsuma N, Ando S, Yamanishi T. Long-Tailed Characteristic of Spiking Pattern Alternation Induced by Log-Normal Excitatory Synaptic Distribution. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:3525-3537. [PMID: 32822305 DOI: 10.1109/tnnls.2020.3015208] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Studies of structural connectivity at the synaptic level show that in synaptic connections of the cerebral cortex, the excitatory postsynaptic potential (EPSP) in most synapses exhibits sub-mV values, while a small number of synapses exhibit large EPSPs ( >~1.0 [mV]). This means that the distribution of EPSP fits a log-normal distribution. While not restricting structural connectivity, skewed and long-tailed distributions have been widely observed in neural activities, such as the occurrences of spiking rates and the size of a synchronously spiking population. Many studies have been modeled this long-tailed EPSP neural activity distribution; however, its causal factors remain controversial. This study focused on the long-tailed EPSP distributions and interlateral synaptic connections primarily observed in the cortical network structures, thereby having constructed a spiking neural network consistent with these features. Especially, we constructed two coupled modules of spiking neural networks with excitatory and inhibitory neural populations with a log-normal EPSP distribution. We evaluated the spiking activities for different input frequencies and with/without strong synaptic connections. These coupled modules exhibited intermittent intermodule-alternative behavior, given moderate input frequency and the existence of strong synaptic and intermodule connections. Moreover, the power analysis, multiscale entropy analysis, and surrogate data analysis revealed that the long-tailed EPSP distribution and intermodule connections enhanced the complexity of spiking activity at large temporal scales and induced nonlinear dynamics and neural activity that followed the long-tailed distribution.
Collapse
|
2
|
Pietras B, Devalle F, Roxin A, Daffertshofer A, Montbrió E. Exact firing rate model reveals the differential effects of chemical versus electrical synapses in spiking networks. Phys Rev E 2020; 100:042412. [PMID: 31771022 DOI: 10.1103/physreve.100.042412] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Indexed: 01/09/2023]
Abstract
Chemical and electrical synapses shape the dynamics of neuronal networks. Numerous theoretical studies have investigated how each of these types of synapses contributes to the generation of neuronal oscillations, but their combined effect is less understood. This limitation is further magnified by the impossibility of traditional neuronal mean-field models-also known as firing rate models or firing rate equations-to account for electrical synapses. Here, we introduce a firing rate model that exactly describes the mean-field dynamics of heterogeneous populations of quadratic integrate-and-fire (QIF) neurons with both chemical and electrical synapses. The mathematical analysis of the firing rate model reveals a well-established bifurcation scenario for networks with chemical synapses, characterized by a codimension-2 cusp point and persistent states for strong recurrent excitatory coupling. The inclusion of electrical coupling generally implies neuronal synchrony by virtue of a supercritical Hopf bifurcation. This transforms the cusp scenario into a bifurcation scenario characterized by three codimension-2 points (cusp, Takens-Bogdanov, and saddle-node separatrix loop), which greatly reduces the possibility for persistent states. This is generic for heterogeneous QIF networks with both chemical and electrical couplings. Our results agree with several numerical studies on the dynamics of large networks of heterogeneous spiking neurons with electrical and chemical couplings.
Collapse
Affiliation(s)
- Bastian Pietras
- Faculty of Behavioural and Movement Sciences, Amsterdam Movement Sciences & Institute of Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, van der Boechorststraat 9, Amsterdam 1081 BT, The Netherlands.,Department of Physics, Lancaster University, Lancaster LA1 4YB, United Kingdom.,Institute of Mathematics, Technical University Berlin, 10623 Berlin, Germany.,Bernstein Center for Computational Neuroscience Berlin, 10115 Berlin, Germany
| | - Federico Devalle
- Department of Physics, Lancaster University, Lancaster LA1 4YB, United Kingdom.,Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08003 Barcelona, Spain
| | - Alex Roxin
- Centre de Recerca Matemàtica, Campus de Bellaterra, Edifici C, 08193 Bellaterra (Barcelona), Spain.,Barcelona Graduate School of Mathematics, 08193 Barcelona, Spain
| | - Andreas Daffertshofer
- Faculty of Behavioural and Movement Sciences, Amsterdam Movement Sciences & Institute of Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, van der Boechorststraat 9, Amsterdam 1081 BT, The Netherlands
| | - Ernest Montbrió
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08003 Barcelona, Spain
| |
Collapse
|
3
|
Luke TB, Barreto E, So P. Complete classification of the macroscopic behavior of a heterogeneous network of theta neurons. Neural Comput 2013; 25:3207-34. [PMID: 24047318 DOI: 10.1162/neco_a_00525] [Citation(s) in RCA: 89] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
We design and analyze the dynamics of a large network of theta neurons, which are idealized type I neurons. The network is heterogeneous in that it includes both inherently spiking and excitable neurons. The coupling is global, via pulselike synapses of adjustable sharpness. Using recently developed analytical methods, we identify all possible asymptotic states that can be exhibited by a mean field variable that captures the network's macroscopic state. These consist of two equilibrium states that reflect partial synchronization in the network and a limit cycle state in which the degree of network synchronization oscillates in time. Our approach also permits a complete bifurcation analysis, which we carry out with respect to parameters that capture the degree of excitability of the neurons, the heterogeneity in the population, and the coupling strength (which can be excitatory or inhibitory). We find that the network typically tends toward the two macroscopic equilibrium states when the neuron's intrinsic dynamics and the network interactions reinforce one another. In contrast, the limit cycle state, bifurcations, and multistability tend to occur when there is competition among these network features. Finally, we show that our results are exhibited by finite network realizations of reasonable size.
Collapse
Affiliation(s)
- Tanushree B Luke
- School of Physics, Astronomy, and Computational Sciences, and The Krasnow Institute for Advanced Study, George Mason University, Fairfax, VA 22030, U.S.A.
| | | | | |
Collapse
|
4
|
Deformation of attractor landscape via cholinergic presynaptic modulations: a computational study using a phase neuron model. PLoS One 2013; 8:e53854. [PMID: 23326520 PMCID: PMC3543278 DOI: 10.1371/journal.pone.0053854] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2012] [Accepted: 12/04/2012] [Indexed: 11/19/2022] Open
Abstract
Corticopetal acetylcholine (ACh) is released transiently from the nucleus basalis of Meynert (NBM) into the cortical layers and is associated with top-down attention. Recent experimental data suggest that this release of ACh disinhibits layer 2/3 pyramidal neurons (PYRs) via muscarinic presynaptic effects on inhibitory synapses. Together with other possible presynaptic cholinergic effects on excitatory synapses, this may result in dynamic and temporal modifications of synapses associated with top-down attention. However, the system-level consequences and cognitive relevance of such disinhibitions are poorly understood. Herein, we propose a theoretical possibility that such transient modifications of connectivity associated with ACh release, in addition to top-down glutamatergic input, may provide a neural mechanism for the temporal reactivation of attractors as neural correlates of memories. With baseline levels of ACh, the brain returns to quasi-attractor states, exhibiting transitive dynamics between several intrinsic internal states. This suggests that top-down attention may cause the attention-induced deformations between two types of attractor landscapes: the quasi-attractor landscape (Q-landscape, present under low-ACh, non-attentional conditions) and the attractor landscape (A-landscape, present under high-ACh, top-down attentional conditions). We present a conceptual computational model based on experimental knowledge of the structure of PYRs and interneurons (INs) in cortical layers 1 and 2/3 and discuss the possible physiological implications of our results.
Collapse
|
5
|
Kawamura Y, Nakao H, Kuramoto Y. Collective phase description of globally coupled excitable elements. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2011; 84:046211. [PMID: 22181249 DOI: 10.1103/physreve.84.046211] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2011] [Indexed: 05/31/2023]
Abstract
We develop a theory of collective phase description for globally coupled noisy excitable elements exhibiting macroscopic oscillations. Collective phase equations describing macroscopic rhythms of the system are derived from Langevin-type equations of globally coupled active rotators via a nonlinear Fokker-Planck equation. The theory is an extension of the conventional phase reduction method for ordinary limit cycles to limit-cycle solutions in infinite-dimensional dynamical systems, such as the time-periodic solutions to nonlinear Fokker-Planck equations representing macroscopic rhythms. We demonstrate that the type of the collective phase sensitivity function near the onset of collective oscillations crucially depends on the type of the bifurcation, namely, it is type I for the saddle-node bifurcation and type II for the Hopf bifurcation.
Collapse
Affiliation(s)
- Yoji Kawamura
- Institute for Research on Earth Evolution, Japan Agency for Marine-Earth Science and Technology, Yokohama 236-0001, Japan.
| | | | | |
Collapse
|
6
|
Kanamaru T, Aihara K. Roles of inhibitory neurons in rewiring-induced synchronization in pulse-coupled neural networks. Neural Comput 2010; 22:1383-98. [PMID: 20100075 DOI: 10.1162/neco.2010.04-09-997] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The roles of inhibitory neurons in synchronous firing are examined in a network of excitatory and inhibitory neurons with Watts and Strogatz's rewiring. By examining the persistence of the synchronous firing that exists in the random network, it was found that there is a probability of rewiring at which a transition between the synchronous state and the asynchronous state takes place, and the dynamics of the inhibitory neurons play an important role in determining this probability.
Collapse
Affiliation(s)
- Takashi Kanamaru
- Department of Innovative Mechanical Engineering, Faculty of Global Engineering, Kogakuin University, Tokyo, Japan.
| | | |
Collapse
|
7
|
Asakawa N, Hotta Y, Kanki T, Kawai T, Tabata H. Noise-driven attractor switching device. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2009; 79:021902. [PMID: 19391773 DOI: 10.1103/physreve.79.021902] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2008] [Revised: 11/04/2008] [Indexed: 05/27/2023]
Abstract
Problems with artificial neural networks originate from their deterministic nature and inevitable prior learnings, resulting in inadequate adaptability against unpredictable, abrupt environmental change. Here we show that a stochastically excitable threshold unit can be utilized by these systems to partially overcome the environmental change. Using an excitable threshold system, attractors were created that represent quasiequilibrium states into which a system settles until disrupted by environmental change. Furthermore, noise-driven attractor stabilization and switching were embodied by inhibitory connections. Noise works as a power source to stabilize and switch attractors, and endows the system with hysteresis behavior that resembles that of stereopsis and binocular rivalry in the human visual cortex. A canonical model of the ring network with inhibitory connections composed of class 1 neurons also shows properties that are similar to the simple threshold system.
Collapse
Affiliation(s)
- Naoki Asakawa
- Institute of Scientific and Industrial Research, Osaka University, Mihogaoka, Ibaraki, Osaka, Japan.
| | | | | | | | | |
Collapse
|
8
|
Ermentrout B. Gap junctions destroy persistent states in excitatory networks. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2006; 74:031918. [PMID: 17025678 DOI: 10.1103/physreve.74.031918] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2006] [Indexed: 05/12/2023]
Abstract
Gap junctions between excitatory neurons are shown to disrupt the persistent state. The asynchronous state of the network loses stability via a Hopf bifurcation and then the active state is destroyed via a homoclinic bifurcation with a stationary state. A partial differential equation (PDE) is developed to analyze the Hopf and the homoclinic bifurcations. The simplified dynamics are compared to a biophysical model where similar behavior is observed. In the low noise case, the dynamics of the PDE is shown to be very complicated and includes possible chaotic behavior. The onset of synchrony is studied by the application of averaging to obtain a simple criterion for destabilization of the asynchronous persistent state.
Collapse
Affiliation(s)
- Bard Ermentrout
- Department of Mathematics, University of Pittsburgh, Pittsburgh, Pennsylvania 15260, USA
| |
Collapse
|
9
|
Câteau H, Reyes AD. Relation between single neuron and population spiking statistics and effects on network activity. PHYSICAL REVIEW LETTERS 2006; 96:058101. [PMID: 16486995 DOI: 10.1103/physrevlett.96.058101] [Citation(s) in RCA: 37] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2005] [Indexed: 05/06/2023]
Abstract
To simplify theoretical analyses of neural networks, individual neurons are often modeled as Poisson processes. An implicit assumption is that even if the spiking activity of each neuron is non-Poissonian, the composite activity obtained by summing many spike trains limits to a Poisson process. Here, we show analytically and through simulations that this assumption is invalid. Moreover, we show with Fokker-Planck equations that the behavior of feedforward networks is reproduced accurately only if the tendency of neurons to fire periodically is incorporated by using colored noise whose autocorrelation has a negative component.
Collapse
Affiliation(s)
- Hideyuki Câteau
- Center for Neural Science, New York University, 4 Washington Place, New York, New York 10003, USA
| | | |
Collapse
|
10
|
Kanamaru T, Sekine M. Synchronized firings in the networks of class 1 excitable neurons with excitatory and inhibitory connections and their dependences on the forms of interactions. Neural Comput 2005; 17:1315-38. [PMID: 15901400 DOI: 10.1162/0899766053630387] [Citation(s) in RCA: 18] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Synchronized firings in the networks of class 1 excitable neurons with excitatory and inhibitory connections are investigated, and their dependences on the forms of interactions are analyzed. As the forms of interactions, we treat the double exponential coupling and the interactions derived from it: pulse coupling, exponential coupling, and alpha coupling. It is found that the bifurcation structure of the networks depends mainly on the decay time of the synaptic interaction and the effect of the rise time is smaller than that of the decay time.
Collapse
Affiliation(s)
- Takashi Kanamaru
- Department of Electrical and Electronic Engineering, Faculty of Technology, Tokyo University of Agriculture and Technology, Tokyo 184-8588, Japan.
| | | |
Collapse
|
11
|
Kanamaru T, Sekine M. Detecting chaotic structures in noisy pulse trains based on interspike interval reconstruction. BIOLOGICAL CYBERNETICS 2005; 92:333-338. [PMID: 15868126 DOI: 10.1007/s00422-005-0557-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2003] [Accepted: 02/28/2005] [Indexed: 05/24/2023]
Abstract
The nonlinear prediction method based on the interspike interval (ISI) reconstruction is applied to the ISI sequence of noisy pulse trains and the detection of the deterministic structure is performed. It is found that this method cannot discriminate between the noisy periodic pulse train and the noisy chaotic one when noise-induced pulses exist. When the noise-induced pulses are eliminated by the grouping of ISI sequence with the genetic algorithm, the chaotic structure of the chaotic firings becomes clear, and the noisy chaotic pulse train could be discriminated from the periodic one.
Collapse
Affiliation(s)
- Takashi Kanamaru
- Department of Basic Engineering in Global Environment, Faculty of Engineering, Kogakuin University, 2665-1 Nakano, Hachioji, Tokyo 192-0015, Japan.
| | | |
Collapse
|
12
|
Kanamaru T, Sekine M. An analysis of globally connected active rotators with excitatory and inhibitory connections having different time constants using the nonlinear Fokker-Planck equations. ACTA ACUST UNITED AC 2004; 15:1009-17. [PMID: 15484878 DOI: 10.1109/tnn.2004.832715] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The globally connected active rotators with excitatory and inhibitory connections having different time constants under noise are analyzed using the nonlinear Fokker-Planck equation, and their oscillatory phenomena are investigated. Based on numerically calculated bifurcation diagrams, both periodic solutions and chaotic solutions are found. The periodic firings are classified based on the firing period, the coefficient of variation, and the correlation coefficient, and weakly synchronized periodic firings which are often observed in physiological experiments are found.
Collapse
Affiliation(s)
- Takashi Kanamaru
- Department of Electrical and Electronic Engineering, Tokyo University of Agriculture and Technology, 184-8588 Tokyo, Japan.
| | | |
Collapse
|
13
|
Sakaguchi H. Oscillatory phase transition and pulse propagation in noisy integrate-and-fire neurons. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2004; 70:022901. [PMID: 15447528 DOI: 10.1103/physreve.70.022901] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/21/2003] [Revised: 05/06/2004] [Indexed: 05/24/2023]
Abstract
We study nonlocally coupled noisy integrate-and-fire neurons with the Fokker-Planck equation. A propagating pulse state and a wavy state appear as a phase transition from an asynchronous state. We also find a solution in which traveling pulses are emitted periodically from a pacemaker region.
Collapse
Affiliation(s)
- Hidetsugu Sakaguchi
- Department of Applied Science for Electronics and Materials, Interdisciplinary of Engineering Sciences, Kyushu University, Kasuga Fukuoka 816-8580, Japan
| |
Collapse
|