1
|
Woo DS, Kim JK, Park GH, Lee WG, Han MJ, Jin SM, Shim TH, Kim JJ, Park J, Park JG. Real-Time Unsupervised Learning and Image Recognition via Memristive Neural Integrated Chip Based on Negative Differential Resistance of Electrochemical Metallization Cell Neuron Device. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2025; 21:e2407612. [PMID: 39838770 DOI: 10.1002/smll.202407612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/27/2024] [Revised: 01/12/2025] [Indexed: 01/23/2025]
Abstract
Spiking neurons are essential for building energy-efficient biomimetic spatiotemporal systems because they communicate with other neurons using sparse and binary signals. However, the achievable high density of artificial neurons having a capacitor for emulating the integrate function of biological neurons has a limit. Furthermore, a low-voltage operation (<1.0 V) is essential for connecting with modern complementary metal-oxide-semiconductor-field-effect-transistor-based (C-MOSFET-based) integrated circuits. Here, a capacitorless memristive-neural integrated chip (MnIC) based on the negative differential resistance of the electrochemical metallization cell designed using a 28-nm C-MOSFET process in a foundry is reported. The fabricated MnIC exhibits extremely low-voltage operation (<0.7 V) via the rupture dynamics of Ag filaments formed in the GeS2 chalcogenide layer, with a nonlinear increase in the action potential in a manner similar to a human sensory system. Moreover, to construct a fully-structured spiking neural network (SNN), an oxygenated amorphous carbon-based (α-COx-based) synaptic device having 32 multi-level conductance states is designed. The designed MnIC and α-COx-based synaptic device demonstrate real-time unsupervised learning via a spike-timing-dependent plasticity learning rule with an SNN. Using the trained SNN, the real-time hand-written digit image of a cell phone obtained from a live webcam is successfully classified, which suggests practical applications for brain-like neuromorphic chips.
Collapse
Affiliation(s)
- Dae-Seong Woo
- Department of Nano-scale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Jae-Kyeong Kim
- Department of Nano-scale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Gwang-Ho Park
- Department of Nano-scale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Woo-Guk Lee
- Department of Nano-scale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Min-Jong Han
- Department of Electronic Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Soo-Min Jin
- SK Hynix Inc., Icheon, Kyunggi-do, 17336, Republic of Korea
| | - Tae-Hun Shim
- Advanced Semiconductor Materials and Devices Development Center, Hanyang University, Seoul, 04763, Republic of Korea
| | - Jae-Joon Kim
- Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, Republic of Korea
| | - Jinsub Park
- Department of Nano-scale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
- Department of Electronic Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Jea-Gun Park
- Department of Nano-scale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
- Department of Electronic Engineering, Hanyang University, Seoul, 04763, Republic of Korea
- Advanced Semiconductor Materials and Devices Development Center, Hanyang University, Seoul, 04763, Republic of Korea
| |
Collapse
|
2
|
Gemo E, Spiga S, Brivio S. SHIP: a computational framework for simulating and validating novel technologies in hardware spiking neural networks. Front Neurosci 2024; 17:1270090. [PMID: 38264497 PMCID: PMC10804805 DOI: 10.3389/fnins.2023.1270090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 12/14/2023] [Indexed: 01/25/2024] Open
Abstract
Investigations in the field of spiking neural networks (SNNs) encompass diverse, yet overlapping, scientific disciplines. Examples range from purely neuroscientific investigations, researches on computational aspects of neuroscience, or applicative-oriented studies aiming to improve SNNs performance or to develop artificial hardware counterparts. However, the simulation of SNNs is a complex task that can not be adequately addressed with a single platform applicable to all scenarios. The optimization of a simulation environment to meet specific metrics often entails compromises in other aspects. This computational challenge has led to an apparent dichotomy of approaches, with model-driven algorithms dedicated to the detailed simulation of biological networks, and data-driven algorithms designed for efficient processing of large input datasets. Nevertheless, material scientists, device physicists, and neuromorphic engineers who develop new technologies for spiking neuromorphic hardware solutions would find benefit in a simulation environment that borrows aspects from both approaches, thus facilitating modeling, analysis, and training of prospective SNN systems. This manuscript explores the numerical challenges deriving from the simulation of spiking neural networks, and introduces SHIP, Spiking (neural network) Hardware In PyTorch, a numerical tool that supports the investigation and/or validation of materials, devices, small circuit blocks within SNN architectures. SHIP facilitates the algorithmic definition of the models for the components of a network, the monitoring of states and output of the modeled systems, and the training of the synaptic weights of the network, by way of user-defined unsupervised learning rules or supervised training techniques derived from conventional machine learning. SHIP offers a valuable tool for researchers and developers in the field of hardware-based spiking neural networks, enabling efficient simulation and validation of novel technologies.
Collapse
Affiliation(s)
- Emanuele Gemo
- CNR–IMM, Unit of Agrate Brianza, Agrate Brianza, Italy
| | | | | |
Collapse
|
3
|
Yi Z, Lian J, Liu Q, Zhu H, Liang D, Liu J. Learning Rules in Spiking Neural Networks: A Survey. Neurocomputing 2023. [DOI: 10.1016/j.neucom.2023.02.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023]
|
4
|
Boriskov P, Velichko A, Shilovsky N, Belyaev M. Bifurcation and Entropy Analysis of a Chaotic Spike Oscillator Circuit Based on the S-Switch. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1693. [PMID: 36421548 PMCID: PMC9689857 DOI: 10.3390/e24111693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 11/13/2022] [Accepted: 11/17/2022] [Indexed: 06/16/2023]
Abstract
This paper presents a model and experimental study of a chaotic spike oscillator based on a leaky integrate-and-fire (LIF) neuron, which has a switching element with an S-type current-voltage characteristic (S-switch). The oscillator generates spikes of the S-switch in the form of chaotic pulse position modulation driven by the feedback with rate coding instability of LIF neuron. The oscillator model with piecewise function of the S-switch has resistive feedback using a second order filter. The oscillator circuit is built on four operational amplifiers and two field-effect transistors (MOSFETs) that form an S-switch based on a Schmitt trigger, an active RC filter and a matching amplifier. We investigate the bifurcation diagrams of the model and the circuit and calculate the entropy of oscillations. For the analog circuit, the "regular oscillation-chaos" transition is analysed in a series of tests initiated by a step voltage in the matching amplifier. Entropy values are used to estimate the average time for the transition of oscillations to chaos and the degree of signal correlation of the transition mode of different tests. Study results can be applied in various reservoir computing applications, for example, in choosing and configuring the LogNNet network reservoir circuits.
Collapse
|