1
|
Hore A, Bandyopadhyay S, Chakrabarti S. Persistent spiking activity in neuromorphic circuits incorporating post-inhibitory rebound excitation. J Neural Eng 2024; 21:036048. [PMID: 38861961 DOI: 10.1088/1741-2552/ad56c8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 06/11/2024] [Indexed: 06/13/2024]
Abstract
Objective. This study introduces a novel approach for integrating the post-inhibitory rebound excitation (PIRE) phenomenon into a neuronal circuit. Excitatory and inhibitory synapses are designed to establish a connection between two hardware neurons, effectively forming a network. The model demonstrates the occurrence of PIRE under strong inhibitory input. Emphasizing the significance of incorporating PIRE in neuromorphic circuits, the study showcases generation of persistent activity within cyclic and recurrent spiking neuronal networks.Approach. The neuronal and synaptic circuits are designed and simulated in Cadence Virtuoso using TSMC 180 nm technology. The operating mechanism of the PIRE phenomenon integrated into a hardware neuron is discussed. The proposed circuit encompasses several parameters for effectively controlling multiple electrophysiological features of a neuron.Main results. The neuronal circuit has been tuned to match the response of a biological neuron. The efficiency of this circuit is evaluated by computing the average power dissipation and energy consumption per spike through simulation. The sustained firing of neural spikes is observed till 1.7 s using the two neuronal networks.Significance. Persistent activity has significant implications for various cognitive functions such as working memory, decision-making, and attention. Therefore, hardware implementation of these functions will require our PIRE-integrated model. Energy-efficient neuromorphic systems are useful in many artificial intelligence applications, including human-machine interaction, IoT devices, autonomous systems, and brain-computer interfaces.
Collapse
|
2
|
Athota A, Caccam B, Kochis R, Ray A, Cauwenberghs G, Broccard FD. Neuromorphic Instantiation of Spiking Half-Centered Oscillator Models for Central Pattern Generation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6703-6706. [PMID: 34892646 DOI: 10.1109/embc46164.2021.9629606] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
In both invertebrate and vertebrate animals, small networks called central pattern generators (CPGs) form the building blocks of the neuronal circuits involved in locomotion. Most CPGs contain a simple half-center oscillator (HCO) motif which consists of two neurons, or populations of neurons, connected by reciprocal inhibition. CPGs and HCOs are well characterized neuronal networks and have been extensively modeled at different levels of abstraction. In the past two decades, hardware implementation of spiking CPG and HCO models in neuromorphic hardware has opened up new applications in mobile robotics, computational neuroscience, and neuroprosthetics. Despite their relative simplicity, the parameter space of GPG and HCO models can become exhaustive when considering various neuron models and network topologies. Motivated by computational work in neuroscience that used a brute-force approach to generate a large database of millions of simulations of the heartbeat HCO of the leech, we have started to build a database of spiking chains of multiple HCOs for different neuron model types and network topologies. Here we present preliminary results using the Izhikevich and Morris-Lecar neuron models for single and pairs of HCOs with different inter-HCO coupling schemes.
Collapse
|
3
|
Stoliar P, Schneegans O, Rozenberg MJ. Biologically Relevant Dynamical Behaviors Realized in an Ultra-Compact Neuron Model. Front Neurosci 2020; 14:421. [PMID: 32595437 PMCID: PMC7247826 DOI: 10.3389/fnins.2020.00421] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Accepted: 04/07/2020] [Indexed: 11/16/2022] Open
Abstract
We demonstrate a variety of biologically relevant dynamical behaviors building on a recently introduced ultra-compact neuron (UCN) model. We provide the detailed circuits which all share a common basic block that realizes the leaky-integrate-and-fire (LIF) spiking behavior. All circuits have a small number of active components and the basic block has only three, two transistors and a silicon controlled rectifier (SCR). We also demonstrate that numerical simulations can faithfully represent the variety of spiking behavior and can be used for further exploration of dynamical behaviors. Taking Izhikevich’s set of biologically relevant behaviors as a reference, our work demonstrates that a circuit of a LIF neuron model can be used as a basis to implement a large variety of relevant spiking patterns. These behaviors may be useful to construct neural networks that can capture complex brain dynamics or may also be useful for artificial intelligence applications. Our UCN model can therefore be considered the electronic circuit counterpart of Izhikevich’s (2003) mathematical neuron model, sharing its two seemingly contradicting features, extreme simplicity and rich dynamical behavior.
Collapse
Affiliation(s)
- Pablo Stoliar
- National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Japan
| | - Olivier Schneegans
- CentraleSupélec, CNRS, Université Paris-Saclay, Sorbonne Université, Laboratoire de Génie Electrique et Electronique de Paris, Gif-sur-Yvette, France
| | - Marcelo J Rozenberg
- Université Paris-Saclay, CNRS, Laboratoire de Physique des Solides, Orsay, France
| |
Collapse
|
4
|
A Parasitic Resistance-Adapted Programming Scheme for Memristor Crossbar-Based Neuromorphic Computing Systems. MATERIALS 2019; 12:ma12244097. [PMID: 31817956 PMCID: PMC6947318 DOI: 10.3390/ma12244097] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/10/2019] [Revised: 11/17/2019] [Accepted: 12/03/2019] [Indexed: 12/04/2022]
Abstract
Memristor crossbar arrays without selector devices, such as complementary-metal oxide semiconductor (CMOS) devices, are a potential for realizing neuromorphic computing systems. However, wire resistance of metal wires is one of the factors that degrade the performance of memristor crossbar circuits. In this work, we propose a wire resistance modeling method and a parasitic resistance-adapted programming scheme to reduce the impact of wire resistance in a memristor crossbar-based neuromorphic computing system. The equivalent wire resistances for the cells are estimated by analyzing the crossbar circuit using the superposition theorem. For the conventional programming scheme, the connection matrix composed of the target memristance values is used for crossbar array programming. In the proposed parasitic resistance-adapted programming scheme, the connection matrix is updated before it is used for crossbar array programming to compensate the equivalent wire resistance. The updated connection matrix is obtained by subtracting the equivalent connection matrix from the original connection matrix. The circuit simulations are performed to test the proposed wire resistance modeling method and the parasitic resistance-adapted programming scheme. The simulation results showed that the discrepancy of the output voltages of the crossbar between the conventional wire resistance modeling method and the proposed wire resistance modeling method is as low as 2.9% when wire resistance varied from 0.5 to 3.0 Ω. The recognition rate of the memristor crossbar with the conventional programming scheme is 99%, 95%, 81%, and 65% when wire resistance is set to be 1.5, 2.0, 2.5, and 3.0 Ω, respectively. By contrast, the memristor crossbar with the proposed parasitic resistance-adapted programming scheme can maintain the recognition as high as 100% when wire resistance is as high as 3.0 Ω.
Collapse
|
5
|
Abu-Hassan K, Taylor JD, Morris PG, Donati E, Bortolotto ZA, Indiveri G, Paton JFR, Nogaret A. Optimal solid state neurons. Nat Commun 2019; 10:5309. [PMID: 31796727 PMCID: PMC6890780 DOI: 10.1038/s41467-019-13177-3] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2019] [Accepted: 10/14/2019] [Indexed: 11/09/2022] Open
Abstract
Bioelectronic medicine is driving the need for neuromorphic microcircuits that integrate raw nervous stimuli and respond identically to biological neurons. However, designing such circuits remains a challenge. Here we estimate the parameters of highly nonlinear conductance models and derive the ab initio equations of intracellular currents and membrane voltages embodied in analog solid-state electronics. By configuring individual ion channels of solid-state neurons with parameters estimated from large-scale assimilation of electrophysiological recordings, we successfully transfer the complete dynamics of hippocampal and respiratory neurons in silico. The solid-state neurons are found to respond nearly identically to biological neurons under stimulation by a wide range of current injection protocols. The optimization of nonlinear models demonstrates a powerful method for programming analog electronic circuits. This approach offers a route for repairing diseased biocircuits and emulating their function with biomedical implants that can adapt to biofeedback.
Collapse
Affiliation(s)
- Kamal Abu-Hassan
- Department of Physics, University of Bath, Claverton Down, Bath, BA2 7AY, UK
| | - Joseph D Taylor
- Department of Physics, University of Bath, Claverton Down, Bath, BA2 7AY, UK
| | - Paul G Morris
- Department of Physics, University of Bath, Claverton Down, Bath, BA2 7AY, UK.,School of Physiology, Pharmacology and Neuroscience, University of Bristol, Bristol, BS8 1TD, UK
| | - Elisa Donati
- Institute of Neuroinformatics, University of Zürich and ETH Zürich, Winterthurerstrasse 190, 8057, Zürich, Switzerland
| | - Zuner A Bortolotto
- School of Physiology, Pharmacology and Neuroscience, University of Bristol, Bristol, BS8 1TD, UK
| | - Giacomo Indiveri
- Institute of Neuroinformatics, University of Zürich and ETH Zürich, Winterthurerstrasse 190, 8057, Zürich, Switzerland
| | - Julian F R Paton
- School of Physiology, Pharmacology and Neuroscience, University of Bristol, Bristol, BS8 1TD, UK.,Department of Physiology, Faculty of Medical and Health Sciences, University of Auckland, Grafton, Auckland, New Zealand
| | - Alain Nogaret
- Department of Physics, University of Bath, Claverton Down, Bath, BA2 7AY, UK.
| |
Collapse
|
6
|
Wang J, Cauwenberghs G, Broccard FD. Neuromorphic Dynamical Synapses With Reconfigurable Voltage-Gated Kinetics. IEEE Trans Biomed Eng 2019; 67:1831-1840. [PMID: 31647418 DOI: 10.1109/tbme.2019.2948809] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
OBJECTIVE Although biological synapses express a large variety of receptors in neuronal membranes, the current hardware implementation of neuromorphic synapses often rely on simple models ignoring the heterogeneity of synaptic transmission. Our objective is to emulate different types of synapses with distinct properties. METHODS Conductance-based chemical and electrical synapses were implemented between silicon neurons on a fully programmable and reconfigurable, biophysically realistic neuromorphic VLSI chip. Different synaptic properties were achieved by configuring on-chip digital parameters for the conductances, reversal potentials, and voltage dependence of the channel kinetics. The measured I-V characteristics of the artificial synapses were compared with biological data. RESULTS We reproduced the response properties of five different types of chemical synapses, including both excitatory ( AMPA, NMDA) and inhibitory ( GABAA, GABAC, glycine) ionotropic receptors. In addition, electrical synapses were implemented in a small network of four silicon neurons. CONCLUSION Our work extends the repertoire of synapse types between silicon neurons, providing greater flexibility for the design and implementation of biologically realistic neural networks on neuromorphic chips. SIGNIFICANCE A higher synaptic heterogeneity in neuromorphic chips is relevant for the hardware implementation of energy-efficient population codes as well as for dynamic clamp applications where neural models are implemented in neuromorphic VLSI hardware.
Collapse
|
7
|
Shi X, Zeng Z, Le Yang L, Huang Y. Memristor-Based Circuit Design for Neuron With Homeostatic Plasticity. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE 2018. [DOI: 10.1109/tetci.2018.2829914] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
8
|
Wang J, Breen D, Akinin A, Broccard F, Abarbanel HDI, Cauwenberghs G. Assimilation of Biophysical Neuronal Dynamics in Neuromorphic VLSI. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2017; 11:1258-1270. [PMID: 29324422 DOI: 10.1109/tbcas.2017.2776198] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
Representing the biophysics of neuronal dynamics and behavior offers a principled analysis-by-synthesis approach toward understanding mechanisms of nervous system functions. We report on a set of procedures assimilating and emulating neurobiological data on a neuromorphic very large scale integrated (VLSI) circuit. The analog VLSI chip, NeuroDyn, features 384 digitally programmable parameters specifying for 4 generalized Hodgkin-Huxley neurons coupled through 12 conductance-based chemical synapses. The parameters also describe reversal potentials, maximal conductances, and spline regressed kinetic functions for ion channel gating variables. In one set of experiments, we assimilated membrane potential recorded from one of the neurons on the chip to the model structure upon which NeuroDyn was designed using the known current input sequence. We arrived at the programmed parameters except for model errors due to analog imperfections in the chip fabrication. In a related set of experiments, we replicated songbird individual neuron dynamics on NeuroDyn by estimating and configuring parameters extracted using data assimilation from intracellular neural recordings. Faithful emulation of detailed biophysical neural dynamics will enable the use of NeuroDyn as a tool to probe electrical and molecular properties of functional neural circuits. Neuroscience applications include studying the relationship between molecular properties of neurons and the emergence of different spike patterns or different brain behaviors. Clinical applications include studying and predicting effects of neuromodulators or neurodegenerative diseases on ion channel kinetics.
Collapse
|
9
|
Kilinc D, Demir A. Noise in Neuronal and Electronic Circuits: A General Modeling Framework and Non-Monte Carlo Simulation Techniques. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2017; 11:958-974. [PMID: 28749345 DOI: 10.1109/tbcas.2017.2679039] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The brain is extremely energy efficient and remarkably robust in what it does despite the considerable variability and noise caused by the stochastic mechanisms in neurons and synapses. Computational modeling is a powerful tool that can help us gain insight into this important aspect of brain mechanism. A deep understanding and computational design tools can help develop robust neuromorphic electronic circuits and hybrid neuroelectronic systems. In this paper, we present a general modeling framework for biological neuronal circuits that systematically captures the nonstationary stochastic behavior of ion channels and synaptic processes. In this framework, fine-grained, discrete-state, continuous-time Markov chain models of both ion channels and synaptic processes are treated in a unified manner. Our modeling framework features a mechanism for the automatic generation of the corresponding coarse-grained, continuous-state, continuous-time stochastic differential equation models for neuronal variability and noise. Furthermore, we repurpose non-Monte Carlo noise analysis techniques, which were previously developed for analog electronic circuits, for the stochastic characterization of neuronal circuits both in time and frequency domain. We verify that the fast non-Monte Carlo analysis methods produce results with the same accuracy as computationally expensive Monte Carlo simulations. We have implemented the proposed techniques in a prototype simulator, where both biological neuronal and analog electronic circuits can be simulated together in a coupled manner.
Collapse
|
10
|
Broccard FD, Joshi S, Wang J, Cauwenberghs G. Neuromorphic neural interfaces: from neurophysiological inspiration to biohybrid coupling with nervous systems. J Neural Eng 2017; 14:041002. [PMID: 28573983 DOI: 10.1088/1741-2552/aa67a9] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
OBJECTIVE Computation in nervous systems operates with different computational primitives, and on different hardware, than traditional digital computation and is thus subjected to different constraints from its digital counterpart regarding the use of physical resources such as time, space and energy. In an effort to better understand neural computation on a physical medium with similar spatiotemporal and energetic constraints, the field of neuromorphic engineering aims to design and implement electronic systems that emulate in very large-scale integration (VLSI) hardware the organization and functions of neural systems at multiple levels of biological organization, from individual neurons up to large circuits and networks. Mixed analog/digital neuromorphic VLSI systems are compact, consume little power and operate in real time independently of the size and complexity of the model. APPROACH This article highlights the current efforts to interface neuromorphic systems with neural systems at multiple levels of biological organization, from the synaptic to the system level, and discusses the prospects for future biohybrid systems with neuromorphic circuits of greater complexity. MAIN RESULTS Single silicon neurons have been interfaced successfully with invertebrate and vertebrate neural networks. This approach allowed the investigation of neural properties that are inaccessible with traditional techniques while providing a realistic biological context not achievable with traditional numerical modeling methods. At the network level, populations of neurons are envisioned to communicate bidirectionally with neuromorphic processors of hundreds or thousands of silicon neurons. Recent work on brain-machine interfaces suggests that this is feasible with current neuromorphic technology. SIGNIFICANCE Biohybrid interfaces between biological neurons and VLSI neuromorphic systems of varying complexity have started to emerge in the literature. Primarily intended as a computational tool for investigating fundamental questions related to neural dynamics, the sophistication of current neuromorphic systems now allows direct interfaces with large neuronal networks and circuits, resulting in potentially interesting clinical applications for neuroengineering systems, neuroprosthetics and neurorehabilitation.
Collapse
Affiliation(s)
- Frédéric D Broccard
- Institute for Neural Computation, UC San Diego, United States of America. Department of Bioengineering, UC San Diego, United States of America
| | | | | | | |
Collapse
|
11
|
Sourikopoulos I, Hedayat S, Loyez C, Danneville F, Hoel V, Mercier E, Cappy A. A 4-fJ/Spike Artificial Neuron in 65 nm CMOS Technology. Front Neurosci 2017; 11:123. [PMID: 28360831 PMCID: PMC5351272 DOI: 10.3389/fnins.2017.00123] [Citation(s) in RCA: 80] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2016] [Accepted: 02/27/2017] [Indexed: 11/13/2022] Open
Abstract
As Moore's law reaches its end, traditional computing technology based on the Von Neumann architecture is facing fundamental limits. Among them is poor energy efficiency. This situation motivates the investigation of different processing information paradigms, such as the use of spiking neural networks (SNNs), which also introduce cognitive characteristics. As applications at very high scale are addressed, the energy dissipation needs to be minimized. This effort starts from the neuron cell. In this context, this paper presents the design of an original artificial neuron, in standard 65 nm CMOS technology with optimized energy efficiency. The neuron circuit response is designed as an approximation of the Morris-Lecar theoretical model. In order to implement the non-linear gating variables, which control the ionic channel currents, transistors operating in deep subthreshold are employed. Two different circuit variants describing the neuron model equations have been developed. The first one features spike characteristics, which correlate well with a biological neuron model. The second one is a simplification of the first, designed to exhibit higher spiking frequencies, targeting large scale bio-inspired information processing applications. The most important feature of the fabricated circuits is the energy efficiency of a few femtojoules per spike, which improves prior state-of-the-art by two to three orders of magnitude. This performance is achieved by minimizing two key parameters: the supply voltage and the related membrane capacitance. Meanwhile, the obtained standby power at a resting output does not exceed tens of picowatts. The two variants were sized to 200 and 35 μm2 with the latter reaching a spiking output frequency of 26 kHz. This performance level could address various contexts, such as highly integrated neuro-processors for robotics, neuroscience or medical applications.
Collapse
Affiliation(s)
- Ilias Sourikopoulos
- Centre National de la Recherche Scientifique, Université Lille, USR 3380 - IRCICA Lille, France
| | - Sara Hedayat
- Centre National de la Recherche Scientifique, Université Lille, USR 3380 - IRCICA Lille, France
| | - Christophe Loyez
- Centre National de la Recherche Scientifique, Université Lille, USR 3380 - IRCICALille, France; Centre National de la Recherche Scientifique, Université Lille, ISEN, Université Valenciennes, UMR 8520 - IEMNLille, France
| | - François Danneville
- Centre National de la Recherche Scientifique, Université Lille, USR 3380 - IRCICALille, France; Centre National de la Recherche Scientifique, Université Lille, ISEN, Université Valenciennes, UMR 8520 - IEMNLille, France
| | - Virginie Hoel
- Centre National de la Recherche Scientifique, Université Lille, USR 3380 - IRCICALille, France; Centre National de la Recherche Scientifique, Université Lille, ISEN, Université Valenciennes, UMR 8520 - IEMNLille, France
| | - Eric Mercier
- Université Grenoble Alpes, GrenobleGrenoble, France; CEA, LETI, MINATEC CampusGrenoble, France
| | - Alain Cappy
- Centre National de la Recherche Scientifique, Université Lille, USR 3380 - IRCICALille, France; Centre National de la Recherche Scientifique, Université Lille, ISEN, Université Valenciennes, UMR 8520 - IEMNLille, France
| |
Collapse
|
12
|
Grassia F, Kohno T, Levi T. Digital hardware implementation of a stochastic two-dimensional neuron model. ACTA ACUST UNITED AC 2017; 110:409-416. [PMID: 28237321 DOI: 10.1016/j.jphysparis.2017.02.002] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2016] [Revised: 02/09/2017] [Accepted: 02/17/2017] [Indexed: 11/15/2022]
Abstract
This study explores the feasibility of stochastic neuron simulation in digital systems (FPGA), which realizes an implementation of a two-dimensional neuron model. The stochasticity is added by a source of current noise in the silicon neuron using an Ornstein-Uhlenbeck process. This approach uses digital computation to emulate individual neuron behavior using fixed point arithmetic operation. The neuron model's computations are performed in arithmetic pipelines. It was designed in VHDL language and simulated prior to mapping in the FPGA. The experimental results confirmed the validity of the developed stochastic FPGA implementation, which makes the implementation of the silicon neuron more biologically plausible for future hybrid experiments.
Collapse
Affiliation(s)
- F Grassia
- LTI Lab., University of Picardie Jules Verne, France; IMS Lab., University of Bordeaux, France.
| | - T Kohno
- LIMMS/CNRS-IIS, Institute of Industrial Science, The University of Tokyo, Japan
| | - T Levi
- IMS Lab., University of Bordeaux, France; LIMMS/CNRS-IIS, Institute of Industrial Science, The University of Tokyo, Japan
| |
Collapse
|
13
|
You H, Wang DH. Neuromorphic Implementation of Attractor Dynamics in a Two-Variable Winner-Take-All Circuit with NMDARs: A Simulation Study. Front Neurosci 2017; 11:40. [PMID: 28223913 PMCID: PMC5293789 DOI: 10.3389/fnins.2017.00040] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2016] [Accepted: 01/19/2017] [Indexed: 11/13/2022] Open
Abstract
Neural networks configured with winner-take-all (WTA) competition and N-methyl-D-aspartate receptor (NMDAR)-mediated synaptic dynamics are endowed with various dynamic characteristics of attractors underlying many cognitive functions. This paper presents a novel method for neuromorphic implementation of a two-variable WTA circuit with NMDARs aimed at implementing decision-making, working memory and hysteresis in visual perceptions. The method proposed is a dynamical system approach of circuit synthesis based on a biophysically plausible WTA model. Notably, slow and non-linear temporal dynamics of NMDAR-mediated synapses was generated. Circuit simulations in Cadence reproduced ramping neural activities observed in electrophysiological recordings in experiments of decision-making, the sustained activities observed in the prefrontal cortex during working memory, and classical hysteresis behavior during visual discrimination tasks. Furthermore, theoretical analysis of the dynamical system approach illuminated the underlying mechanisms of decision-making, memory capacity and hysteresis loops. The consistence between the circuit simulations and theoretical analysis demonstrated that the WTA circuit with NMDARs was able to capture the attractor dynamics underlying these cognitive functions. Their physical implementations as elementary modules are promising for assembly into integrated neuromorphic cognitive systems.
Collapse
Affiliation(s)
- Hongzhi You
- Key Laboratory for NeuroInformation of Ministry of Education, Center for Information in BioMedicine, School of Life Science and Technology, University of Electronic Science and Technology of ChinaChengdu, China
| | - Da-Hui Wang
- School of Systems Science and National Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal UniversityBeijing, China
| |
Collapse
|
14
|
Haghiri S, Ahmadi A, Saif M. Complete Neuron-Astrocyte Interaction Model: Digital Multiplierless Design and Networking Mechanism. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2017; 11:117-127. [PMID: 27662685 DOI: 10.1109/tbcas.2016.2583920] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Glial cells, also known as neuroglia or glia, are non-neuronal cells providing support and protection for neurons in the central nervous system (CNS). They also act as supportive cells in the brain. Among a variety of glial cells, the star-shaped glial cells, i.e., astrocytes, are the largest cell population in the brain. The important role of astrocyte such as neuronal synchronization, synaptic information regulation, feedback to neural activity and extracellular regulation make the astrocytes play a vital role in brain disease. This paper presents a modified complete neuron-astrocyte interaction model that is more suitable for efficient and large scale biological neural network realization on digital platforms. Simulation results show that the modified complete interaction model can reproduce biological-like behavior of the original neuron-astrocyte mechanism. The modified interaction model is investigated in terms of digital realization feasibility and cost targeting a low cost hardware implementation. Networking behavior of this interaction is investigated and compared between two cases: i) the neuron spiking mechanism without astrocyte effects, and ii) the effect of astrocyte in regulating the neurons behavior and synaptic transmission via controlling the LTP and LTD processes. Hardware implementation on FPGA shows that the modified model mimics the main mechanism of neuron-astrocyte communication with higher performance and considerably lower hardware overhead cost compared with the original interaction model.
Collapse
|
15
|
Hayati M, Nouri M, Haghiri S, Abbott D. A Digital Realization of Astrocyte and Neural Glial Interactions. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2016; 10:518-529. [PMID: 26390499 DOI: 10.1109/tbcas.2015.2450837] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
The implementation of biological neural networks is a key objective of the neuromorphic research field. Astrocytes are the largest cell population in the brain. With the discovery of calcium wave propagation through astrocyte networks, now it is more evident that neuronal networks alone may not explain functionality of the strongest natural computer, the brain. Models of cortical function must now account for astrocyte activities as well as their relationships with neurons in encoding and manipulation of sensory information. From an engineering viewpoint, astrocytes provide feedback to both presynaptic and postsynaptic neurons to regulate their signaling behaviors. This paper presents a modified neural glial interaction model that allows a convenient digital implementation. This model can reproduce relevant biological astrocyte behaviors, which provide appropriate feedback control in regulating neuronal activities in the central nervous system (CNS). Accordingly, we investigate the feasibility of a digital implementation for a single astrocyte constructed by connecting a two coupled FitzHugh Nagumo (FHN) neuron model to an implementation of the proposed astrocyte model using neuron-astrocyte interactions. Hardware synthesis, physical implementation on FPGA, and theoretical analysis confirm that the proposed neuron astrocyte model, with significantly low hardware cost, can mimic biological behavior such as the regulation of postsynaptic neuron activity and the synaptic transmission mechanisms.
Collapse
|
16
|
Pagkalos I, Herrero P, Toumazou C, Georgiou P. Bio-Inspired glucose control in diabetes based on an analogue implementation of a β-cell model. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2014; 8:186-195. [PMID: 24686302 DOI: 10.1109/tbcas.2014.2301377] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
This paper presents a bio-inspired method for in-vivo control of blood glucose based on a model of the pancreatic β-cell. The proposed model is shown to be implementable using low-power analogue integrated circuits in CMOS, realizing a biologically faithful implementation which captures all the behaviours seen in physiology. This is then shown to be capable of glucose control using an in silico population of diabetic subjects achieving 93% of the time in tight glycemic target (i.e., [70, 140] mg/dl) . The proposed controller is then compared with a commonly used external physiological insulin delivery (ePID) controller for glucose control. Results confirm equivalent, or superior, performance in comparison with ePID. The system has been designed in a commercially available 0.35 μm CMOS process and achieves an overall power consumption of 1.907 mW.
Collapse
|
17
|
Moradi S, Indiveri G. An event-based neural network architecture with an asynchronous programmable synaptic memory. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2014; 8:98-107. [PMID: 24681923 DOI: 10.1109/tbcas.2013.2255873] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
We present a hybrid analog/digital very large scale integration (VLSI) implementation of a spiking neural network with programmable synaptic weights. The synaptic weight values are stored in an asynchronous Static Random Access Memory (SRAM) module, which is interfaced to a fast current-mode event-driven DAC for producing synaptic currents with the appropriate amplitude values. These currents are further integrated by current-mode integrator synapses to produce biophysically realistic temporal dynamics. The synapse output currents are then integrated by compact and efficient integrate and fire silicon neuron circuits with spike-frequency adaptation and adjustable refractory period and spike-reset voltage settings. The fabricated chip comprises a total of 32 × 32 SRAM cells, 4 × 32 synapse circuits and 32 × 1 silicon neurons. It acts as a transceiver, receiving asynchronous events in input, performing neural computation with hybrid analog/digital circuits on the input spikes, and eventually producing digital asynchronous events in output. Input, output, and synaptic weight values are transmitted to/from the chip using a common communication protocol based on the Address Event Representation (AER). Using this representation it is possible to interface the device to a workstation or a micro-controller and explore the effect of different types of Spike-Timing Dependent Plasticity (STDP) learning algorithms for updating the synaptic weights values in the SRAM module. We present experimental results demonstrating the correct operation of all the circuits present on the chip.
Collapse
|
18
|
Hasler J, Marr B. Finding a roadmap to achieve large neuromorphic hardware systems. Front Neurosci 2013; 7:118. [PMID: 24058330 PMCID: PMC3767911 DOI: 10.3389/fnins.2013.00118] [Citation(s) in RCA: 93] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2012] [Accepted: 06/20/2013] [Indexed: 11/13/2022] Open
Abstract
Neuromorphic systems are gaining increasing importance in an era where CMOS digital computing techniques are reaching physical limits. These silicon systems mimic extremely energy efficient neural computing structures, potentially both for solving engineering applications as well as understanding neural computation. Toward this end, the authors provide a glimpse at what the technology evolution roadmap looks like for these systems so that Neuromorphic engineers may gain the same benefit of anticipation and foresight that IC designers gained from Moore's law many years ago. Scaling of energy efficiency, performance, and size will be discussed as well as how the implementation and application space of Neuromorphic systems are expected to evolve over time.
Collapse
Affiliation(s)
- Jennifer Hasler
- School of Electrical and Computer Engineering, Georgia Institute of TechnologyAtlanta, GA, USA
| | | |
Collapse
|
19
|
Wang Y, Liu SC. Active processing of spatio-temporal input patterns in silicon dendrites. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2013; 7:307-318. [PMID: 23853330 DOI: 10.1109/tbcas.2012.2199487] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Capturing the functionality of active dendritic processing into abstract mathematical models will help us to understand the role of complex biophysical neurons in neuronal computation and to build future useful neuromorphic analog Very Large Scale Integrated (aVLSI) neuronal devices. Previous work based on an aVLSI multi-compartmental neuron model demonstrates that the compartmental response in the presence of either of two widely studied classes of active mechanisms, is a nonlinear sigmoidal function of the degree of either input temporal synchrony OR input clustering level. Using the same silicon model, this work expounds the interaction between both active mechanisms in a compartment receiving input patterns of varying temporal AND spatial clustering structure and demonstrates that this compartmental response can be captured by a combined sigmoid and radial-basis function over both input dimensions. This paper further shows that the response to input spatio-temporal patterns in a one-dimensional multi-compartmental dendrite, can be described by a radial-basis like function of the degree of temporal synchrony between the inter-compartmental inputs.
Collapse
Affiliation(s)
- Yingxue Wang
- Institute of Neuroinformatics, University of Zürich and ETH Zürich, CH-8057 Zürich, Switzerland.
| | | |
Collapse
|
20
|
Thanapitak S, Toumazou C. A bionics chemical synapse. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2013; 7:296-306. [PMID: 23853329 DOI: 10.1109/tbcas.2012.2202494] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Implementation of the current mode CMOS circuit for chemical synapses (AMPA and NMDA receptors) with dynamic change of glutamate as the neurotransmitter input is presented in this paper. Additionally, circuit realisation for receptor GABA(A) and GABA(B) with an electrical signal which symbolises γ-Aminobutyric Acid (GABA) perturbation is introduced. The chemical sensor for glutamate sensing is the modified ISFET with enzyme (glutamate oxidase) immobilisation. The measured results from these biomimetics chemical synapse circuits closely match with the simulation result from the mathematical model. The total power consumption of the whole chip (four chemical synapse circuits and all auxiliary circuits) is 168.3 μW. The total chip area is 3 mm(2) in 0.35-μm AMS CMOS technology.
Collapse
Affiliation(s)
- Surachoke Thanapitak
- Division of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK.
| | | |
Collapse
|
21
|
Li J, Katori Y, Kohno T. An FPGA-Based Silicon Neuronal Network with Selectable Excitability Silicon Neurons. Front Neurosci 2012; 6:183. [PMID: 23269911 PMCID: PMC3529302 DOI: 10.3389/fnins.2012.00183] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2012] [Accepted: 12/04/2012] [Indexed: 11/13/2022] Open
Abstract
This paper presents a digital silicon neuronal network which simulates the nerve system in creatures and has the ability to execute intelligent tasks, such as associative memory. Two essential elements, the mathematical-structure-based digital spiking silicon neuron (DSSN) and the transmitter release based silicon synapse, allow us to tune the excitability of silicon neurons and are computationally efficient for hardware implementation. We adopt mixed pipeline and parallel structure and shift operations to design a sufficient large and complex network without excessive hardware resource cost. The network with 256 full-connected neurons is built on a Digilent Atlys board equipped with a Xilinx Spartan-6 LX45 FPGA. Besides, a memory control block and USB control block are designed to accomplish the task of data communication between the network and the host PC. This paper also describes the mechanism of associative memory performed in the silicon neuronal network. The network is capable of retrieving stored patterns if the inputs contain enough information of them. The retrieving probability increases with the similarity between the input and the stored pattern increasing. Synchronization of neurons is observed when the successful stored pattern retrieval occurs.
Collapse
Affiliation(s)
- Jing Li
- Graduate School of Engineering, The University of Tokyo Tokyo, Japan
| | | | | |
Collapse
|
22
|
Cruz-Albrecht JM, Yung MW, Srinivasa N. Energy-efficient neuron, synapse and STDP integrated circuits. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2012; 6:246-256. [PMID: 23853146 DOI: 10.1109/tbcas.2011.2174152] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Ultra-low energy biologically-inspired neuron and synapse integrated circuits are presented. The synapse includes a spike timing dependent plasticity (STDP) learning rule circuit. These circuits have been designed, fabricated and tested using a 90 nm CMOS process. Experimental measurements demonstrate proper operation. The neuron and the synapse with STDP circuits have an energy consumption of around 0.4 pJ per spike and synaptic operation respectively.
Collapse
|
23
|
Grassia F, Buhry L, Lévi T, Tomas J, Destexhe A, Saïghi S. Tunable neuromimetic integrated system for emulating cortical neuron models. Front Neurosci 2011; 5:134. [PMID: 22163213 PMCID: PMC3233664 DOI: 10.3389/fnins.2011.00134] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2011] [Accepted: 11/18/2011] [Indexed: 11/13/2022] Open
Abstract
Nowadays, many software solutions are currently available for simulating neuron models. Less conventional than software-based systems, hardware-based solutions generally combine digital and analog forms of computation. In previous work, we designed several neuromimetic chips, including the Galway chip that we used for this paper. These silicon neurons are based on the Hodgkin–Huxley formalism and they are optimized for reproducing a large variety of neuron behaviors thanks to tunable parameters. Due to process variation and device mismatch in analog chips, we use a full-custom fitting method in voltage-clamp mode to tune our neuromimetic integrated circuits. By comparing them with experimental electrophysiological data of these cells, we show that the circuits can reproduce the main firing features of cortical cell types. In this paper, we present the experimental measurements of our system which mimic the four most prominent biological cells: fast spiking, regular spiking, intrinsically bursting, and low-threshold spiking neurons into analog neuromimetic integrated circuit dedicated to cortical neuron simulations. This hardware and software platform will allow to improve the hybrid technique, also called “dynamic-clamp,” that consists of connecting artificial and biological neurons to study the function of neuronal circuits.
Collapse
Affiliation(s)
- Filippo Grassia
- Laboratoire d'Intégration du Matériau au Système, UMR CNRS 5218, Université de Bordeaux Talence, France
| | | | | | | | | | | |
Collapse
|
24
|
Rast A, Galluppi F, Davies S, Plana L, Patterson C, Sharp T, Lester D, Furber S. Concurrent heterogeneous neural model simulation on real-time neuromimetic hardware. Neural Netw 2011; 24:961-78. [DOI: 10.1016/j.neunet.2011.06.014] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2010] [Revised: 06/14/2011] [Accepted: 06/16/2011] [Indexed: 11/28/2022]
|
25
|
Yu T, Sejnowski TJ, Cauwenberghs G. Biophysical Neural Spiking, Bursting, and Excitability Dynamics in Reconfigurable Analog VLSI. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2011; 5:420-9. [PMID: 22227949 PMCID: PMC3251010 DOI: 10.1109/tbcas.2011.2169794] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
We study a range of neural dynamics under variations in biophysical parameters underlying extended Morris-Lecar and Hodgkin-Huxley models in three gating variables. The extended models are implemented in NeuroDyn, a four neuron, twelve synapse continuous-time analog VLSI programmable neural emulation platform with generalized channel kinetics and biophysical membrane dynamics. The dynamics exhibit a wide range of time scales extending beyond 100 ms neglected in typical silicon models of tonic spiking neurons. Circuit simulations and measurements show transition from tonic spiking to tonic bursting dynamics through variation of a single conductance parameter governing calcium recovery. We similarly demonstrate transition from graded to all-or-none neural excitability in the onset of spiking dynamics through the variation of channel kinetic parameters governing the speed of potassium activation. Other combinations of variations in conductance and channel kinetic parameters give rise to phasic spiking and spike frequency adaptation dynamics. The NeuroDyn chip consumes 1.29 mW and occupies 3 mm × 3 mm in 0.5 μm CMOS, supporting emerging developments in neuromorphic silicon-neuron interfaces.
Collapse
Affiliation(s)
- Theodore Yu
- Department of Electrical and Computer Engineering, Jacobs School of Engineering and Institute of Neural Computation, University of California San Diego, La Jolla, CA 92093 USA
| | - Terrence J. Sejnowski
- Division of Biological Sciences and Institute of Neural Computation, University of California San Diego, La Jolla, CA 92093 USA and also with the Howard Hughes Medical Institute, Salk Institute, La Jolla, CA 92037 USA
| | - Gert Cauwenberghs
- Department of Bioengineering, Jacobs School of Engineering and Institute of Neural Computation, University of California San Diego, La Jolla, CA 92093 USA
| |
Collapse
|
26
|
Indiveri G, Linares-Barranco B, Hamilton TJ, van Schaik A, Etienne-Cummings R, Delbruck T, Liu SC, Dudek P, Häfliger P, Renaud S, Schemmel J, Cauwenberghs G, Arthur J, Hynna K, Folowosele F, Saighi S, Serrano-Gotarredona T, Wijekoon J, Wang Y, Boahen K. Neuromorphic silicon neuron circuits. Front Neurosci 2011; 5:73. [PMID: 21747754 PMCID: PMC3130465 DOI: 10.3389/fnins.2011.00073] [Citation(s) in RCA: 355] [Impact Index Per Article: 25.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2010] [Accepted: 05/07/2011] [Indexed: 11/13/2022] Open
Abstract
Hardware implementations of spiking neurons can be extremely useful for a large variety of applications, ranging from high-speed modeling of large-scale neural systems to real-time behaving systems, to bidirectional brain–machine interfaces. The specific circuit solutions used to implement silicon neurons depend on the application requirements. In this paper we describe the most common building blocks and techniques used to implement these circuits, and present an overview of a wide range of neuromorphic silicon neurons, which implement different computational models, ranging from biophysically realistic and conductance-based Hodgkin–Huxley models to bi-dimensional generalized adaptive integrate and fire models. We compare the different design methodologies used for each silicon neuron design described, and demonstrate their features with experimental results, measured from a wide range of fabricated VLSI chips.
Collapse
Affiliation(s)
- Giacomo Indiveri
- Institute of Neuroinformatics, University of Zurich and ETH Zurich Zurich, Switzerland
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|