1
|
Dhull S, Misba WA, Nisar A, Atulasimha J, Kaushik BK. Quantized Magnetic Domain Wall Synapse for Efficient Deep Neural Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:4996-5005. [PMID: 38470601 DOI: 10.1109/tnnls.2024.3369969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/14/2024]
Abstract
The quantization of synaptic weights using emerging nonvolatile memory (NVM) devices has emerged as a promising solution to implement computationally efficient neural networks on resource constrained hardware. However, the practical implementation of such synaptic weights is hampered by the imperfect memory characteristics, specifically the availability of limited number of quantized states and the presence of large intrinsic device variation and stochasticity involved in writing the synaptic states. This article presents ON-chip training and inference of a neural network using quantized magnetic domain wall (DW)-based synaptic array and CMOS peripheral circuits. A rigorous model of the magnetic DW device considering stochasticity and process variations has been utilized for the synapse. To achieve stable quantized weights, DW pinning has been achieved by means of physical constrictions. Finally, VGG8 architecture for CIFAR-10 image classification has been simulated by using the extracted synaptic device characteristics. The performance in terms of accuracy, energy, latency, and area consumption has been evaluated while considering the process variations and nonidealities in the DW device as well as the peripheral circuits. The proposed quantized neural network (QNN) architecture achieves efficient ON-chip learning with 92.4% and 90.4% training and inference accuracy, respectively. In comparison to pure CMOS-based design, it demonstrates an overall improvement in area, energy, and latency by , , and , respectively.
Collapse
|
2
|
Sharma V, Negusse E, Kumar R, Budhani RC. Ferromagnetic resonance measurement with frequency modulation down to 2 K. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2024; 95:063902. [PMID: 38836719 DOI: 10.1063/5.0190105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/03/2023] [Accepted: 05/20/2024] [Indexed: 06/06/2024]
Abstract
Ferromagnetic resonance (FMR) spectroscopy is a powerful technique to study the precessional dynamics of magnetization in thin film heterostructures. It provides valuable information about the mechanisms of exchange bias, spin angular momentum transfer across interfaces, and excitation of magnons. A key desirable feature of FMR spectrometers is the capability to study magnetization dynamics over a wide phase space of temperature (T), frequency (f), and magnetic field (B). The design, fabrication, and testing of such a spectrometer, which uses frequency modulation techniques for improved detection of microwave absorption, reduces heat load in the cryostat and allows simultaneous measurements of inverse spin Hall effect (ISHE) induced dc voltages, is described in this paper. The apparatus is based on a 2-port transmitted microwave signal measurement using a grounded co-planar waveguide. The input radio frequency (RF) signal, frequency modulated at a tunable f-band, excites spin precession in the sample, and the attenuated RF signal is measured phase sensitively. The sample stage, inserted in the bore of a superconducting solenoid, allows magnetic field and temperature variability of 0 to ±5 T and 2-310 K, respectively. We demonstrate the working of this Cryo-FMR and ISHE spectrometer on thin films of Ni80Fe20 and Fe60Co20B20 over a wide T, B, and f phase space.
Collapse
Affiliation(s)
- Vinay Sharma
- Department of Physics, Morgan State University, Baltimore, Maryland 21251, USA
| | - Ezana Negusse
- Department of Physics, Morgan State University, Baltimore, Maryland 21251, USA
| | - Ravinder Kumar
- Department of Physics, Morgan State University, Baltimore, Maryland 21251, USA
| | - Ramesh C Budhani
- Department of Physics, Morgan State University, Baltimore, Maryland 21251, USA
| |
Collapse
|
3
|
Kumar A, Lin DJX, Das D, Huang L, Yap SLK, Tan HR, Tan HK, Lim RJJ, Toh YT, Chen S, Lim ST, Fong X, Ho P. Multistate Compound Magnetic Tunnel Junction Synapses for Digital Recognition. ACS APPLIED MATERIALS & INTERFACES 2024; 16:10335-10343. [PMID: 38376994 DOI: 10.1021/acsami.3c17195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Abstract
The quest to mimic the multistate synapses for bioinspired computing has triggered nascent research that leverages the well-established magnetic tunnel junction (MTJ) technology. Early works on the spin transfer torque MTJ-based artificial neural network (ANN) are susceptible to poor thermal reliability, high latency, and high critical current densities. Meanwhile, work on spin-orbit torque (SOT) MTJ-based ANN mainly utilized domain wall motion, which yields negligibly small readout signals differentiating consecutive states and has designs that are incompatible with technological scale-up. Here, we propose a multistate device concept built upon a compound MTJ consisting of multiple SOT-MTJs (number of MTJs, n = 1-4) on a shared write channel, mimicking the spin-based ANN. The n + 1 resistance states representing varying synaptic weights can be tuned by varying the voltage pulses (±1.5-1.8 V), pulse duration (100-300 ns), and applied in-plane fields (5.5-10.5 mT). A large TMR difference of more than 13.6% is observed between two consecutive states for the 4-cell compound MTJ, a 4-fold improvement from reported state-of-the-art spin-based synaptic devices. The ANN built upon the compound MTJ shows high learning accuracy for digital recognition tasks with incremental states and retraining, achieving test accuracy as high as 95.75% in the 4-cell compound MTJ. These results provide an industry-compatible platform to integrate these multistate SOT-MTJ synapses directly into neuromorphic architecture for in-memory and unconventional computing applications.
Collapse
Affiliation(s)
- Anuj Kumar
- Physics Department, National University of Singapore, 117551 Singapore
| | - Dennis J X Lin
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Debasis Das
- Electrical and Computer Engineering Department, National University of Singapore, 117583 Singapore
| | - Lisen Huang
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Sherry L K Yap
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Hui Ru Tan
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Hang Khume Tan
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Royston J J Lim
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Yeow Teck Toh
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Shaohai Chen
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Sze Ter Lim
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| | - Xuanyao Fong
- Electrical and Computer Engineering Department, National University of Singapore, 117583 Singapore
| | - Pin Ho
- Institute of Materials Research and Engineering, A*STAR, 138634 Singapore
| |
Collapse
|
4
|
Koo RH, Shin W, Kim S, Im J, Park SH, Ko JH, Kwon D, Kim JJ, Kwon D, Lee JH. Proposition of Adaptive Read Bias: A Solution to Overcome Power and Scaling Limitations in Ferroelectric-Based Neuromorphic System. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2303735. [PMID: 38039488 PMCID: PMC10837350 DOI: 10.1002/advs.202303735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 10/11/2023] [Indexed: 12/03/2023]
Abstract
Hardware neuromorphic systems are crucial for the energy-efficient processing of massive amounts of data. Among various candidates, hafnium oxide ferroelectric tunnel junctions (FTJs) are highly promising for artificial synaptic devices. However, FTJs exhibit non-ideal characteristics that introduce variations in synaptic weights, presenting a considerable challenge in achieving high-performance neuromorphic systems. The primary objective of this study is to analyze the origin and impact of these variations in neuromorphic systems. The analysis reveals that the major bottleneck in achieving a high-performance neuromorphic system is the dynamic variation, primarily caused by the intrinsic 1/f noise of the device. As the device area is reduced and the read bias (VRead ) is lowered, the intrinsic noise of the FTJs increases, presenting an inherent limitation for implementing area- and power-efficient neuromorphic systems. To overcome this limitation, an adaptive read-biasing (ARB) scheme is proposed that applies a different VRead to each layer of the neuromorphic system. By exploiting the different noise sensitivities of each layer, the ARB method demonstrates significant power savings of 61.3% and a scaling effect of 91.9% compared with conventional biasing methods. These findings contribute significantly to the development of more accurate, efficient, and scalable neuromorphic systems.
Collapse
Affiliation(s)
- Ryun-Han Koo
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Wonjun Shin
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Seungwhan Kim
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Jiseong Im
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Sung-Ho Park
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Jong Hyun Ko
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Dongseok Kwon
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Jae-Joon Kim
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Daewoong Kwon
- Department of Electrical Engineering, Hanyang University, Seoul, 04763, South Korea
| | - Jong-Ho Lee
- Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 08826, South Korea
- Ministry of Science and ICT, Sejong, 30109, South Korea
| |
Collapse
|
5
|
Abstract
Efforts to design devices emulating complex cognitive abilities and response processes of biological systems have long been a coveted goal. Recent advancements in flexible electronics, mirroring human tissue's mechanical properties, hold significant promise. Artificial neuron devices, hinging on flexible artificial synapses, bioinspired sensors, and actuators, are meticulously engineered to mimic the biological systems. However, this field is in its infancy, requiring substantial groundwork to achieve autonomous systems with intelligent feedback, adaptability, and tangible problem-solving capabilities. This review provides a comprehensive overview of recent advancements in artificial neuron devices. It starts with fundamental principles of artificial synaptic devices and explores artificial sensory systems, integrating artificial synapses and bioinspired sensors to replicate all five human senses. A systematic presentation of artificial nervous systems follows, designed to emulate fundamental human nervous system functions. The review also discusses potential applications and outlines existing challenges, offering insights into future prospects. We aim for this review to illuminate the burgeoning field of artificial neuron devices, inspiring further innovation in this captivating area of research.
Collapse
Affiliation(s)
- Ke He
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Cong Wang
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Yongli He
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Jiangtao Su
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Xiaodong Chen
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
- Institute for Digital Molecular Analytics and Science (IDMxS), Nanyang Technological University, 59 Nanyang Drive, Singapore 636921, Singapore
| |
Collapse
|
6
|
Hwang S, Yu J, Song MS, Hwang H, Kim H. Memcapacitor Crossbar Array with Charge Trap NAND Flash Structure for Neuromorphic Computing. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2303817. [PMID: 37752771 PMCID: PMC10646263 DOI: 10.1002/advs.202303817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Revised: 08/20/2023] [Indexed: 09/28/2023]
Abstract
The progress of artificial intelligence and the development of large-scale neural networks have significantly increased computational costs and energy consumption. To address these challenges, researchers are exploring low-power neural network implementation approaches and neuromorphic computing systems are being highlighted as potential candidates. Specifically, the development of high-density and reliable synaptic devices, which are the key elements of neuromorphic systems, is of particular interest. In this study, an 8 × 16 memcapacitor crossbar array that combines the technological maturity of flash cells with the advantages of NAND flash array structure is presented. The analog properties of the array with high reliability are experimentally demonstrated, and vector-matrix multiplication with extremely low error is successfully performed. Additionally, with the capability of weight fine-tuning characteristics, a spiking neural network for CIFAR-10 classification via off-chip learning at the wafer level is implemented. These experimental results demonstrate a high level of accuracy of 92.11%, with less than a 1.13% difference compared to software-based neural networks (93.24%).
Collapse
Affiliation(s)
- Sungmin Hwang
- Department of AI Semiconductor EngineeringKorea UniversitySejong30019South Korea
| | - Junsu Yu
- Department of Electrical and Computer EngineeringSeoul National UniversitySeoul08826South Korea
| | - Min Suk Song
- Department of Electrical and Computer EngineeringInha UniversityIncheon22212South Korea
| | - Hwiho Hwang
- Department of Electrical and Computer EngineeringInha UniversityIncheon22212South Korea
| | - Hyungjin Kim
- Department of Electrical and Computer EngineeringInha UniversityIncheon22212South Korea
| |
Collapse
|
7
|
Li J, Abbas H, Ang DS, Ali A, Ju X. Emerging memristive artificial neuron and synapse devices for the neuromorphic electronics era. NANOSCALE HORIZONS 2023; 8:1456-1484. [PMID: 37615055 DOI: 10.1039/d3nh00180f] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/25/2023]
Abstract
Growth of data eases the way to access the world but requires increasing amounts of energy to store and process. Neuromorphic electronics has emerged in the last decade, inspired by biological neurons and synapses, with in-memory computing ability, extenuating the 'von Neumann bottleneck' between the memory and processor and offering a promising solution to reduce the efforts both in data storage and processing, thanks to their multi-bit non-volatility, biology-emulated characteristics, and silicon compatibility. This work reviews the recent advances in emerging memristive devices for artificial neuron and synapse applications, including memory and data-processing ability: the physics and characteristics are discussed first, i.e., valence changing, electrochemical metallization, phase changing, interfaced-controlling, charge-trapping, ferroelectric tunnelling, and spin-transfer torquing. Next, we propose a universal benchmark for the artificial synapse and neuron devices on spiking energy consumption, standby power consumption, and spike timing. Based on the benchmark, we address the challenges, suggest the guidelines for intra-device and inter-device design, and provide an outlook for the neuromorphic applications of resistive switching-based artificial neuron and synapse devices.
Collapse
Affiliation(s)
- Jiayi Li
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Haider Abbas
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Diing Shenp Ang
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Asif Ali
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Xin Ju
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Singapore 138634
| |
Collapse
|
8
|
Shukla G, Abdullah HM, Schwingenschlögl U. Potential of AlP and GaN as barriers in magnetic tunnel junctions. NANOSCALE 2023; 15:15161-15170. [PMID: 37702989 DOI: 10.1039/d3nr04143c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/14/2023]
Abstract
AlP and GaN are wide band gap semiconductors used industrially in light emitting diodes. We investigate their potential as tunnel barriers in magnetic tunnel junctions, employing density functional theory and the non-equilibrium Green's function method for ground state and quantum transport calculations, respectively. We show that the valence band edges are dominated by pz orbitals and the conduction band edges are dominated by s orbitals. Both materials filter Bloch states of Δ1 symmetry at the Γ-point of the Brillouin zone. In the zero bias limit, we find for the Co/AlP/Co junction a high tunnel magnetoresistance of ∼200% at the Fermi energy and for the Co/GaN/Co junction a tunnel magnetoresistance of even ∼300% about 1.4 eV below the Fermi energy.
Collapse
Affiliation(s)
- Gokaran Shukla
- King Abdullah University of Science and Technology (KAUST), Physical Science and Engineering Division (PSE), Thuwal 23955-6900, Saudi Arabia.
| | - Hasan M Abdullah
- King Abdullah University of Science and Technology (KAUST), Physical Science and Engineering Division (PSE), Thuwal 23955-6900, Saudi Arabia.
| | - Udo Schwingenschlögl
- King Abdullah University of Science and Technology (KAUST), Physical Science and Engineering Division (PSE), Thuwal 23955-6900, Saudi Arabia.
| |
Collapse
|
9
|
Wang M, Yuan Y, Jiang Y. Realization of Artificial Neurons and Synapses Based on STDP Designed by an MTJ Device. MICROMACHINES 2023; 14:1820. [PMID: 37893257 PMCID: PMC10609371 DOI: 10.3390/mi14101820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 09/22/2023] [Accepted: 09/22/2023] [Indexed: 10/29/2023]
Abstract
As the third-generation neural network, the spiking neural network (SNN) has become one of the most promising neuromorphic computing paradigms to mimic brain neural networks over the past decade. The SNN shows many advantages in performing classification and recognition tasks in the artificial intelligence field. In the SNN, the communication between the pre-synapse neuron (PRE) and the post-synapse neuron (POST) is conducted by the synapse. The corresponding synaptic weights are dependent on both the spiking patterns of the PRE and the POST, which are updated by spike-timing-dependent plasticity (STDP) rules. The emergence and growing maturity of spintronic devices present a new approach for constructing the SNN. In the paper, a novel SNN is proposed, in which both the synapse and the neuron are mimicked with the spin transfer torque magnetic tunnel junction (STT-MTJ) device. The synaptic weight is presented by the conductance of the MTJ device. The mapping of the probabilistic spiking nature of the neuron to the stochastic switching behavior of the MTJ with thermal noise is presented based on the stochastic Landau-Lifshitz-Gilbert (LLG) equation. In this way, a simplified SNN is mimicked with the MTJ device. The function of the mimicked SNN is verified by a handwritten digit recognition task based on the MINIST database.
Collapse
Affiliation(s)
| | | | - Yanfeng Jiang
- Department of Electrical Engineering, School of Internet of Things (IoTs), Jiangnan University, Wuxi 214122, China; (M.W.); (Y.Y.)
| |
Collapse
|
10
|
Ju D, Kim S, Lee S, Kim S. Double-Forming Mechanism of TaO x-Based Resistive Memory Device and Its Synaptic Applications. MATERIALS (BASEL, SWITZERLAND) 2023; 16:6184. [PMID: 37763461 PMCID: PMC10533022 DOI: 10.3390/ma16186184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 09/12/2023] [Accepted: 09/12/2023] [Indexed: 09/29/2023]
Abstract
The bipolar resistive switching properties of Pt/TaOx/InOx/ITO-resistive random-access memory devices under DC and pulse measurement conditions are explored in this work. Transmission electron microscopy and X-ray photoelectron spectroscopy were used to confirm the structure and chemical compositions of the devices. A unique two-step forming process referred to as the double-forming phenomenon and self-compliance characteristics are demonstrated under a DC sweep. A model based on oxygen vacancy migration is proposed to explain its conduction mechanism. Varying reset voltages and compliance currents were applied to evaluate multilevel cell characteristics. Furthermore, pulses were applied to the devices to demonstrate the neuromorphic system's application via testing potentiation, depression, spike-timing-dependent plasticity, and spike-rate-dependent plasticity.
Collapse
Affiliation(s)
| | | | | | - Sungjun Kim
- Division of Electronics and Electrical Engineering, Dongguk University, Seoul 04620, Republic of Korea; (D.J.); (S.K.); (S.L.)
| |
Collapse
|
11
|
Farcis L, Teixeira BMS, Talatchian P, Salomoni D, Ebels U, Auffret S, Dieny B, Mizrahi FA, Grollier J, Sousa RC, Buda-Prejbeanu LD. Spiking Dynamics in Dual Free Layer Perpendicular Magnetic Tunnel Junctions. NANO LETTERS 2023; 23:7869-7875. [PMID: 37589447 DOI: 10.1021/acs.nanolett.3c01597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/18/2023]
Abstract
Spintronic devices have recently attracted a lot of attention in the field of unconventional computing due to their non-volatility for short- and long-term memory, nonlinear fast response, and relatively small footprint. Here we demonstrate experimentally how voltage driven magnetization dynamics of dual free layer perpendicular magnetic tunnel junctions can emulate spiking neurons in hardware. The output spiking rate was controlled by varying the dc bias voltage across the device. The field-free operation of this two-terminal device and its robustness against an externally applied magnetic field make it a suitable candidate to mimic the neuron response in a dense neural network. The small energy consumption of the device (4-16 pJ/spike) and its scalability are important benefits for embedded applications. This compact perpendicular magnetic tunnel junction structure could finally bring spiking neural networks to sub-100 nm size elements.
Collapse
Affiliation(s)
- Louis Farcis
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | - Bruno M S Teixeira
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | - Philippe Talatchian
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | - David Salomoni
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | - Ursula Ebels
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | - Stéphane Auffret
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | - Bernard Dieny
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | - Frank A Mizrahi
- Unité Mixte de Physique CNRS/Thales, Université Paris-Saclay, 91767 Palaiseau, France
| | - Julie Grollier
- Unité Mixte de Physique CNRS/Thales, Université Paris-Saclay, 91767 Palaiseau, France
| | - Ricardo C Sousa
- Université Grenoble Alpes, CEA, CNRS, Grenoble-INP, SPINTEC, Grenoble 38000, France
| | | |
Collapse
|
12
|
Liu H, Qin Y, Chen HY, Wu J, Ma J, Du Z, Wang N, Zou J, Lin S, Zhang X, Zhang Y, Wang H. Artificial Neuronal Devices Based on Emerging Materials: Neuronal Dynamics and Applications. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2205047. [PMID: 36609920 DOI: 10.1002/adma.202205047] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 12/02/2022] [Indexed: 06/17/2023]
Abstract
Artificial neuronal devices are critical building blocks of neuromorphic computing systems and currently the subject of intense research motivated by application needs from new computing technology and more realistic brain emulation. Researchers have proposed a range of device concepts that can mimic neuronal dynamics and functions. Although the switching physics and device structures of these artificial neurons are largely different, their behaviors can be described by several neuron models in a more unified manner. In this paper, the reports of artificial neuronal devices based on emerging volatile switching materials are reviewed from the perspective of the demonstrated neuron models, with a focus on the neuronal functions implemented in these devices and the exploitation of these functions for computational and sensing applications. Furthermore, the neuroscience inspirations and engineering methods to enrich the neuronal dynamics that remain to be implemented in artificial neuronal devices and networks toward realizing the full functionalities of biological neurons are discussed.
Collapse
Affiliation(s)
- Hefei Liu
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Yuan Qin
- Center for Power Electronics Systems, Bradley Department of Electrical and Computer Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA, 24060, USA
| | - Hung-Yu Chen
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Jiangbin Wu
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Jiahui Ma
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Zhonghao Du
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Nan Wang
- Mork Family Department of Chemical Engineering and Materials Science, University of Southern California, Los Angeles, CA, 90089, USA
| | - Jingyi Zou
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Sen Lin
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Xu Zhang
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Yuhao Zhang
- Center for Power Electronics Systems, Bradley Department of Electrical and Computer Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA, 24060, USA
| | - Han Wang
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
- Mork Family Department of Chemical Engineering and Materials Science, University of Southern California, Los Angeles, CA, 90089, USA
| |
Collapse
|
13
|
Mohanty HN, Tsuruoka T, Mohanty JR, Terabe K. Proton-Gated Synaptic Transistors, Based on an Electron-Beam Patterned Nafion Electrolyte. ACS APPLIED MATERIALS & INTERFACES 2023; 15:19279-19289. [PMID: 37023114 DOI: 10.1021/acsami.3c00756] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Neuromorphic processors using artificial neural networks are the center of attention for energy-efficient analog computing. Artificial synapses act as building blocks in such neural networks for parallel information processing and data storage. Herein we describe the fabrication of a proton-gated synaptic transistor using a Nafion electrolyte thin film, which is patterned by electron-beam lithography (EBL). The device has an active channel of indium-zinc-oxide (IZO) between the source and drain electrodes, which shows Ohmic behavior with a conductance level on the order of 100 μS. Under voltage applications to the gate electrode, the channel conductance is changed due to the injection and extraction of protons between the IZO channel and the Nafion electrolyte, emulating various synaptic functions with short-term and long-term plasticity. When positive (negative) gate voltage pulses are consecutively applied, the device exhibits long-term potentiation (depression) at the same number of steps as the number of input pulses. Based on these characteristics, an artificial neural network using this transistor shows ∼84% image recognition accuracy for handwritten digits. The subject transistor also successfully mimics paired-pulse facilitation and depression, Hebbian spike-timing-dependent plasticity, and Pavlovian associative learning followed by extinction activities. Finally, dynamical pattern image memorization is demonstrated in a 5 × 5 array of these synaptic transistors. The results indicate that EBL patternable Nafion electrolytes have great potential for use in the fabrication and circuit-level integration of synaptic devices for neuromorphic computing applications.
Collapse
Affiliation(s)
- Himadri Nandan Mohanty
- Nanomagnetism and Microscopy Laboratory, Department of Physics, Indian Institute of Technology Hyderabad, Kandi, Sangareddy 502285, Telangana, India
- Research Center for Materials Nanoarchitectonics, National Institute for Materials Science, Namiki 1-1, Tsukuba 305-004, Japan
| | - Tohru Tsuruoka
- Research Center for Materials Nanoarchitectonics, National Institute for Materials Science, Namiki 1-1, Tsukuba 305-004, Japan
| | - Jyoti Ranjan Mohanty
- Nanomagnetism and Microscopy Laboratory, Department of Physics, Indian Institute of Technology Hyderabad, Kandi, Sangareddy 502285, Telangana, India
| | - Kazuya Terabe
- Research Center for Materials Nanoarchitectonics, National Institute for Materials Science, Namiki 1-1, Tsukuba 305-004, Japan
| |
Collapse
|
14
|
Chen PX, Panda D, Tseng TY. All oxide based flexible multi-folded invisible synapse as vision photo-receptor. Sci Rep 2023; 13:1454. [PMID: 36702838 PMCID: PMC9880003 DOI: 10.1038/s41598-023-28505-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 01/19/2023] [Indexed: 01/27/2023] Open
Abstract
All oxide-based transparent flexible memristor is prioritized for the potential application in artificially simulated biological optoelectronic synaptic devices. SnOx memristor with HfOx layer is found to enable a significant effect on synaptic properties. The memristor exhibits good reliability with long retention, 104 s, and high endurance, 104 cycles. The optimized 6 nm thick HfOx layer in SnOx-based memristor possesses the excellent synaptic properties of stable 350 epochs training, multi-level conductance (MLC) behaviour, and the nonlinearity of 1.53 and 1.46 for long-term potentiation and depression, respectively, and faster image recognition accuracy of 100% after 23 iterations. The maximum weight changes of -73.12 and 79.91% for the potentiation and depression of the synaptic device, respectively, are observed from the spike-timing-dependent plasticity (STDP) characteristics making it suitable for biological applications. The flexibility of the device on the PEN substrate is confirmed by the acceptable change of nonlinearities up to 4 mm bending. Such a synaptic device is expected to be used as a vision photo-receptor.
Collapse
Affiliation(s)
- Ping-Xing Chen
- Institute of Electronics, National Yang-Ming Chiao Tung University, Hsinchu, 30010, Taiwan
| | - Debashis Panda
- Institute of Electronics, National Yang-Ming Chiao Tung University, Hsinchu, 30010, Taiwan.
- Department of Electronics and Communication Engineering, CV Raman Global University, Bhubaneswar, 752054, India.
| | - Tseung-Yuen Tseng
- Institute of Electronics, National Yang-Ming Chiao Tung University, Hsinchu, 30010, Taiwan
| |
Collapse
|
15
|
Chen W, Tang H, Wang Y, Hu X, Lin Y, Min T, Xie Y. E-Spin: A Stochastic Ising Spin Based on Electrically-Controlled MTJ for Constructing Large-Scale Ising Annealing Systems. MICROMACHINES 2023; 14:258. [PMID: 36837958 PMCID: PMC9962373 DOI: 10.3390/mi14020258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Revised: 01/01/2023] [Accepted: 01/14/2023] [Indexed: 06/18/2023]
Abstract
With its unique computer paradigm, the Ising annealing machine has become an emerging research direction. The Ising annealing system is highly effective at addressing combinatorial optimization (CO) problems that are difficult for conventional computers to tackle. However, Ising spins, which comprise the Ising system, are difficult to implement in high-performance physical circuits. We propose a novel type of Ising spin based on an electrically-controlled magnetic tunnel junction (MTJ). Electrical operation imparts true randomness, great stability, precise control, compact size, and easy integration to the MTJ-based spin. In addition, simulations demonstrate that the frequency of electrically-controlled stochastic Ising spin (E-spin) is 50 times that of the thermal disturbance MTJ-based spin (p-bit). To develop a large-scale Ising annealing system, up to 64 E-spins are implemented. Our Ising annealing system demonstrates factorization of integers up to 264 with a temporal complexity of around O(n). The proposed E-spin shows superiority in constructing large-scale Ising annealing systems and solving CO problems.
Collapse
Affiliation(s)
- Wenhan Chen
- State Key Laboratory of ASIC & System, School of Microelectronics, Fudan University, Shanghai 201203, China
| | - Haodi Tang
- State Key Laboratory of ASIC & System, School of Microelectronics, Fudan University, Shanghai 201203, China
| | - Yu Wang
- State Key Laboratory of ASIC & System, School of Microelectronics, Fudan University, Shanghai 201203, China
| | - Xianwu Hu
- State Key Laboratory of ASIC & System, School of Microelectronics, Fudan University, Shanghai 201203, China
| | - Yuming Lin
- State Key Laboratory of ASIC & System, School of Microelectronics, Fudan University, Shanghai 201203, China
| | - Tai Min
- Center for Spintronics and Quantum Systems, State Key Laboratory for Mechanical Behavior of Materials, Department of Materials Science and Engineering, Xi’an Jiaotong University, Xi’an 710049, China
| | - Yufeng Xie
- State Key Laboratory of ASIC & System, School of Microelectronics, Fudan University, Shanghai 201203, China
| |
Collapse
|
16
|
Lateral double magnetic tunnel junction device with orthogonal polarizer for high-performance magnetoresistive memory. Sci Rep 2022; 12:19762. [DOI: 10.1038/s41598-022-24075-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 11/09/2022] [Indexed: 11/18/2022] Open
Abstract
AbstractMagnetic tunnel junction (MTJ)-based memory devices have larger switching delay and energy consumption, compared to cache or dynamic random access memory. In order to broaden the applications of the magnetoresistive random access memory, reducing the switching time and energy consumption of the MTJ is required. Here, a novel lateral double MTJ with an orthogonal polarizer is proposed. The proposed device consists of three ferromagnetic regions: the first pinned region (PR1) with perpendicular magnetic anisotropy (PMA), a free region (FR) with PMA, and the second pinned region (PR2) with in-plane magnetic anisotropy (IMA). PR1 and PR2 are placed on top of the oxide barrier, which separates them from the FR, comprising a lateral double MTJ structure. The current pulse through PR2 helps to perturb the magnetization of the FR. Since the angle between PR2 and FR is 90°, the initial torque increases significantly, decreasing switching delay by 4.02 times and energy-delay product by 7.23 times. It is also shown, that the area of the access transistor can be reduced by approximately 10%, while maintaining the same energy-delay product and reducing gate RC delay.
Collapse
|
17
|
Compact artificial neuron based on anti-ferroelectric transistor. Nat Commun 2022; 13:7018. [PMID: 36384960 PMCID: PMC9668812 DOI: 10.1038/s41467-022-34774-9] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 11/07/2022] [Indexed: 11/18/2022] Open
Abstract
Neuromorphic machines are intriguing for building energy-efficient intelligent systems, where spiking neurons are pivotal components. Recently, memristive neurons with promising bio-plausibility have been developed, but with limited reliability, bulky capacitors or additional reset circuits. Here, we propose an anti-ferroelectric field-effect transistor neuron based on the inherent polarization and depolarization of Hf0.2Zr0.8O2 anti-ferroelectric film to meet these challenges. The intrinsic accumulated polarization/spontaneous depolarization of Hf0.2Zr0.8O2 films implements the integration/leaky behavior of neurons, avoiding external capacitors and reset circuits. Moreover, the anti-ferroelectric neuron exhibits low energy consumption (37 fJ/spike), high endurance (>1012), high uniformity and high stability. We further construct a two-layer fully ferroelectric spiking neural networks that combines anti-ferroelectric neurons and ferroelectric synapses, achieving 96.8% recognition accuracy on the Modified National Institute of Standards and Technology dataset. This work opens the way to emulate neurons with anti-ferroelectric materials and provides a promising approach to building high-efficient neuromorphic hardware.
Collapse
|
18
|
Xu S, Dai B, Cheng H, Tai L, Lang L, Sun Y, Shi Z, Wang KL, Zhao W. Electric-Field Control of Spin Diffusion Length and Electric-Assisted D'yakonov-Perel' Mechanism in Ultrathin Heavy Metal and Ferromagnetic Insulator Heterostructure. MATERIALS (BASEL, SWITZERLAND) 2022; 15:6368. [PMID: 36143680 PMCID: PMC9501297 DOI: 10.3390/ma15186368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 09/07/2022] [Accepted: 09/08/2022] [Indexed: 06/16/2023]
Abstract
Electric-field control of spin dynamics is significant for spintronic device applications. Thus far, effectively electric-field control of magnetic order, magnetic damping factor and spin-orbit torque (SOT) has been studied in magnetic materials, but the electric field control of spin relaxation still remains unexplored. Here, we use ionic liquid gating to control spin-related property in the ultra-thin (4 nm) heavy metal (HM) platinum (Pt) and ferromagnetic insulator (FMI) yttrium iron garnet (Y3Fe5O12, YIG) heterostructure. It is found that the anomalous Hall effect (AHE), spin relaxation time and spin diffusion length can be effectively controlled by the electric field. The anomalous Hall resistance is almost twice as large as at 0 voltage after applying a small voltage of 5.5 V. The spin relaxation time can vary by more than 50 percent with the electric field, from 41.6 to 64.5 fs. In addition, spin relaxation time at different gate voltage follows the reciprocal law of the electron momentum scattering time, which indicates that the D'yakonov-Perel' mechanism is dominant in the Pt/YIG system. Furthermore, the spin diffusion length can be effectively controlled by an ionic gate, which can be well explained by voltage-modulated interfacial spin scattering. These results help us to improve the interface spin transport properties in magnetic materials, with great contributions to the exploration of new physical mechanisms and spintronics device.
Collapse
Affiliation(s)
- Shijie Xu
- Fert Beijing Institute, Ministry of Industry and Information Technology Key Laboratory of Spintronics, School of Integrated Circuit Science and Engineering, Beihang University, Beijing 100191, China
- Department of Electrical and Computer Engineering, University of California, Los Angeles, CA 90095, USA
- Shanghai Key Laboratory of Special Artificial Microstructure, Pohl Institute of Solid State Physics, School of Physics Science and Engineering, Tongji University, Shanghai 200092, China
- Hefei Innovation Research Institute, Anhui High Reliability Chips Engineering Laboratory, Beihang University, Hefei 230013, China
| | - Bingqian Dai
- Department of Electrical and Computer Engineering, University of California, Los Angeles, CA 90095, USA
| | - Houyi Cheng
- Fert Beijing Institute, Ministry of Industry and Information Technology Key Laboratory of Spintronics, School of Integrated Circuit Science and Engineering, Beihang University, Beijing 100191, China
- Hefei Innovation Research Institute, Anhui High Reliability Chips Engineering Laboratory, Beihang University, Hefei 230013, China
| | - Lixuan Tai
- Department of Electrical and Computer Engineering, University of California, Los Angeles, CA 90095, USA
| | - Lili Lang
- Shanghai Key Laboratory of Special Artificial Microstructure, Pohl Institute of Solid State Physics, School of Physics Science and Engineering, Tongji University, Shanghai 200092, China
| | - Yadong Sun
- Shanghai Key Laboratory of Special Artificial Microstructure, Pohl Institute of Solid State Physics, School of Physics Science and Engineering, Tongji University, Shanghai 200092, China
| | - Zhong Shi
- Shanghai Key Laboratory of Special Artificial Microstructure, Pohl Institute of Solid State Physics, School of Physics Science and Engineering, Tongji University, Shanghai 200092, China
| | - Kang L. Wang
- Department of Electrical and Computer Engineering, University of California, Los Angeles, CA 90095, USA
| | - Weisheng Zhao
- Fert Beijing Institute, Ministry of Industry and Information Technology Key Laboratory of Spintronics, School of Integrated Circuit Science and Engineering, Beihang University, Beijing 100191, China
- Hefei Innovation Research Institute, Anhui High Reliability Chips Engineering Laboratory, Beihang University, Hefei 230013, China
| |
Collapse
|
19
|
Huang J, Stathopoulos S, Serb A, Prodromakis T. NeuroPack: An Algorithm-Level Python-Based Simulator for Memristor-Empowered Neuro-Inspired Computing. FRONTIERS IN NANOTECHNOLOGY 2022. [DOI: 10.3389/fnano.2022.851856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Emerging two-terminal nanoscale memory devices, known as memristors, have demonstrated great potential for implementing energy-efficient neuro-inspired computing architectures over the past decade. As a result, a wide range of technologies have been developed that, in turn, are described via distinct empirical models. This diversity of technologies requires the establishment of versatile tools that can enable designers to translate memristors’ attributes in novel neuro-inspired topologies. In this study, we present NeuroPack, a modular, algorithm-level Python-based simulation platform that can support studies of memristor neuro-inspired architectures for performing online learning or offline classification. The NeuroPack environment is designed with versatility being central, allowing the user to choose from a variety of neuron models, learning rules, and memristor models. Its hierarchical structure empowers NeuroPack to predict any memristor state changes and the corresponding neural network behavior across a variety of design decisions and user parameter options. The use of NeuroPack is demonstrated herein via an application example of performing handwritten digit classification with the MNIST dataset and an existing empirical model for metal-oxide memristors.
Collapse
|
20
|
Jin T, Lim GJ, Poh HY, Wu S, Tan F, Lew WS. Spin Reflection-Induced Field-Free Magnetization Switching in Perpendicularly Magnetized MgO/Pt/Co Heterostructures. ACS APPLIED MATERIALS & INTERFACES 2022; 14:9781-9787. [PMID: 35147025 DOI: 10.1021/acsami.1c22061] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Field-free magnetization switching is critical towards practical, integrated spin-orbit torque (SOT)-driven magnetic random-access memory with perpendicular magnetic anisotropy. Our work proposes a technique to modulate the spin reflection and spin density of states within a heavy-metal Pt through interfacing with a dielectric MgO layer. We demonstrate tunability of the effective out-of-plane spin torque acting on the ferromagnetic Co layer, enabling current-induced SOT magnetization switching without the assistance of an external magnetic field. The influence of the MgO layer thickness on effective SOT efficiency shows saturation at 4 nm, while up to 80% of field-free magnetization switching ratio is achieved with the MgO between 5 and 8 nm. We analyze and attribute the complex interaction to spin reflection at the dielectric/heavy metal interface and spin scattering within the dielectric medium due to interfacial electric fields. Further, through substituting the dielectric with Ti or Pt, we confirm that the MgO layer is indeed responsible for the observed field-free magnetization switching mechanism.
Collapse
Affiliation(s)
- Tianli Jin
- School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore
| | - Gerard Joseph Lim
- School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore
| | - Han Yin Poh
- School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore
| | - Shuo Wu
- School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore
| | - Funan Tan
- School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore
| | - Wen Siang Lew
- School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore
| |
Collapse
|
21
|
Li X, Yu B, Wang B, Bi R, Li H, Tu K, Chen G, Li Z, Huang R, Li M. Complementary Photo-Synapses Based on Light-Stimulated Porphyrin-Coated Silicon Nanowires Field-Effect Transistors (LPSNFET). SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2021; 17:e2101434. [PMID: 34187085 DOI: 10.1002/smll.202101434] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Revised: 05/03/2021] [Indexed: 06/13/2023]
Abstract
Neuromorphic computing has emerged as the high-energy-efficiency and intelligent solution for processing sensory data. As a potential alternative to neuromorphic computing, photo-excited synaptic systems can integrate the functions of optoelectronic sensing and synaptic computing to realize the low-power and high-performance visual perception. However, one major challenge in high-efficient photo-excited synaptic system is to realize the complementarily enhanced and inhibited synaptic behaviors with small hardware cost as possible. Another challenge is to fabricate the photo-synapse devices with complementary metal oxide semiconductor (CMOS)-compatible process to achieve high enough integration density for practical application. Here, a CMOS-compatible Light-stimulated Porphyrin-coated Silicon Nanowire Field Effect Transistor (LPSNFET) technology is proposed and developed to form the complementary photo-synapses with only two CMOS-like transistors. LPSNFET exhibits fivefold improvement in photo-sensitivity compared to the bare silicon nanowire (SiNW) devices, and can still show obvious responses when incident illumination power is as low as 0.1 mW cm-2 . Moreover, it enables tunable dynamic synaptic plasticity and versatile synaptic functions. Especially, the complementarily enhanced and inhibited behaviors can be realized by modulating SiNW/porphyrin interface via simply changing the MOS type of LPSNFET, which acts like the photonic counterpart of CMOS technology to provide the basic brick for building complex neuromorphic circuits efficiently and economically. Finally, the CMOS process compatibility of LPSNFET provides potential application in future large scale in-sensor computing.
Collapse
Affiliation(s)
- Xiaokang Li
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Bocheng Yu
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Bowen Wang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Ran Bi
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Haixia Li
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Kun Tu
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Gong Chen
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Zhihong Li
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Institute of Microelectronics, Peking University, Beijing, 100871, China
| | - Ru Huang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Institute of Microelectronics, Peking University, Beijing, 100871, China
- Frontiers Science Center for Nano-optoelectronics, Peking University, Beijing, 100871, China
| | - Ming Li
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing, 100871, China
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Institute of Microelectronics, Peking University, Beijing, 100871, China
- Frontiers Science Center for Nano-optoelectronics, Peking University, Beijing, 100871, China
| |
Collapse
|
22
|
Duan H, Liang L, Wu Z, Zhang H, Huang L, Cao H. IGZO/CsPbBr 3-Nanoparticles/IGZO Neuromorphic Phototransistors and Their Optoelectronic Coupling Applications. ACS APPLIED MATERIALS & INTERFACES 2021; 13:30165-30173. [PMID: 34143597 DOI: 10.1021/acsami.1c05396] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Optoelectronic synaptic devices are of great scientific and practical importance because of various potential applications such as ocular simulating and optical-electrical managers based on a new optoelectronic coupling mechanism. In this work, we design a novel channel layer with p-type CsPbBr3 nanoparticles (NPs) buried in an InGaZnO (IGZO) film to construct the corresponding thin-film transistors (TFTs), which exhibits intense improvement in visible-light photosensitivity and synaptic plasticity as compared to the pure IGZO counterpart. Specifically, the composite device is able to exhibit versatile synaptic behavior under light stimuli with density as low as 0.12 μW/cm2 and with the gain 5-20 times higher than that of the IGZO TFT in the visible-light region. Based on the band alignment between the IGZO and NPs, the excitation and decay processes of intrinsic and photoinduced carriers are discussed. Moreover, owing to the gate bias control in a three-terminal configuration, our TFT synapses can imitate complex biological behaviors including the famous "Pavlov's dog" experiment and the "reward and punishment mechanism" of the brain via editing the gate voltage/light pulse stimuli.
Collapse
Affiliation(s)
- Hongxiao Duan
- Laboratory of Advanced Nano Materials and Devices, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
| | - Lingyan Liang
- Laboratory of Advanced Nano Materials and Devices, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Zhendong Wu
- Laboratory of Advanced Nano Materials and Devices, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Hengbo Zhang
- Laboratory of Advanced Nano Materials and Devices, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Lu Huang
- School of Materials Science and Engineering, Shanghai University, Baoshan District, Shanghai 200444, China
| | - Hongtao Cao
- Laboratory of Advanced Nano Materials and Devices, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| |
Collapse
|
23
|
Yang JQ, Wang R, Ren Y, Mao JY, Wang ZP, Zhou Y, Han ST. Neuromorphic Engineering: From Biological to Spike-Based Hardware Nervous Systems. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2020; 32:e2003610. [PMID: 33165986 DOI: 10.1002/adma.202003610] [Citation(s) in RCA: 81] [Impact Index Per Article: 16.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Revised: 07/27/2020] [Indexed: 06/11/2023]
Abstract
The human brain is a sophisticated, high-performance biocomputer that processes multiple complex tasks in parallel with high efficiency and remarkably low power consumption. Scientists have long been pursuing an artificial intelligence (AI) that can rival the human brain. Spiking neural networks based on neuromorphic computing platforms simulate the architecture and information processing of the intelligent brain, providing new insights for building AIs. The rapid development of materials engineering, device physics, chip integration, and neuroscience has led to exciting progress in neuromorphic computing with the goal of overcoming the von Neumann bottleneck. Herein, fundamental knowledge related to the structures and working principles of neurons and synapses of the biological nervous system is reviewed. An overview is then provided on the development of neuromorphic hardware systems, from artificial synapses and neurons to spike-based neuromorphic computing platforms. It is hoped that this review will shed new light on the evolution of brain-like computing.
Collapse
Affiliation(s)
- Jia-Qin Yang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518060, P. R. China
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Ruopeng Wang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518060, P. R. China
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Yi Ren
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Jing-Yu Mao
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Zhan-Peng Wang
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Ye Zhou
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Su-Ting Han
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, 518060, P. R. China
| |
Collapse
|
24
|
Zhang S, Tserkovnyak Y. Antiferromagnet-Based Neuromorphics Using Dynamics of Topological Charges. PHYSICAL REVIEW LETTERS 2020; 125:207202. [PMID: 33258612 DOI: 10.1103/physrevlett.125.207202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Accepted: 10/13/2020] [Indexed: 06/12/2023]
Abstract
We propose a spintronics-based hardware implementation of neuromorphic computing, specifically, the spiking neural network, using topological winding textures in one-dimensional antiferromagnets. The consistency of such a network is emphasized in light of the conservation of topological charges, and the natural spatiotemporal interconversions of magnetic winding. We discuss the realization of the leaky integrate-and-fire behavior of neurons and the spike-timing-dependent plasticity of synapses. Our proposal opens the possibility for an all-spin neuromorphic platform based on antiferromagnetic insulators.
Collapse
Affiliation(s)
- Shu Zhang
- Department of Physics and Astronomy, University of California, Los Angeles, California 90095, USA
| | - Yaroslav Tserkovnyak
- Department of Physics and Astronomy, University of California, Los Angeles, California 90095, USA
| |
Collapse
|
25
|
Abstract
Science, engineering, and medicine ultimately demand fast information processing with ultra-low power consumption. The recently developed spin-orbit torque (SOT)-induced magnetization switching paradigm has been fueling opportunities for spin-orbitronic devices, i.e., enabling SOT memory and logic devices at sub-nano second and sub-picojoule regimes. Importantly, spin-orbitronic devices are intrinsic of nonvolatility, anti-radiation, unlimited endurance, excellent stability, and CMOS compatibility, toward emerging applications, e.g., processing in-memory, neuromorphic computing, probabilistic computing, and 3D magnetic random access memory. Nevertheless, the cutting-edge SOT-based devices and application remain at a premature stage owing to the lack of scalable methodology on the field-free SOT switching. Moreover, spin-orbitronics poises as an interdisciplinary field to be driven by goals of both fundamental discoveries and application innovations, to open fascinating new paths for basic research and new line of technologies. In this perspective, the specific challenges and opportunities are summarized to exert momentum on both research and eventual applications of spin-orbitronic devices.
Collapse
Affiliation(s)
- Yi Cao
- Beijing Academy of Quantum Information Sciences, Beijing 100193, P. R. China
| | - Guozhong Xing
- Key Laboratory of Microelectronic Devices & Integrated Technology, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, P. R. China
| | - Huai Lin
- Key Laboratory of Microelectronic Devices & Integrated Technology, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, P. R. China
| | - Nan Zhang
- State Key Laboratory of Superlattices and Microstructures, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, P. R. China
| | - Houzhi Zheng
- State Key Laboratory of Superlattices and Microstructures, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, P. R. China
| | - Kaiyou Wang
- Beijing Academy of Quantum Information Sciences, Beijing 100193, P. R. China
- State Key Laboratory of Superlattices and Microstructures, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, P. R. China
- Corresponding author
| |
Collapse
|
26
|
Li X, Yu B, Wang B, Bao L, Zhang B, Li H, Yu Z, Zhang T, Yang Y, Huang R, Wu Y, Li M. Multi-terminal ionic-gated low-power silicon nanowire synaptic transistors with dendritic functions for neuromorphic systems. NANOSCALE 2020; 12:16348-16358. [PMID: 32725043 DOI: 10.1039/d0nr03141k] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
Neuromorphic computing systems have shown powerful capability in tasks, such as recognition, learning, classification and decision-making, which are both challenging and inefficient in using the traditional computation architecture. The key elements including synapses and neurons, and their feasible hardware implementation are essential for practical neuromorphic computing. However, most existing synaptic devices used to emulate functions of a single synapse and the synapse-based networks are more energy intensive and less sustainable than their biological counterparts. The dendritic functions such as integration of spatiotemporal signals and spike-frequency coding characteristics have not been well implemented in a single synaptic device and thus play an imperative role in future practical hardware-based spiking neural networks. Moreover, most emerging synaptic transistors are fabricated by nanofabrication processes without CMOS compatibility for further wafer-scale integration. Herein, we demonstrate a novel ionic-gated silicon nanowire synaptic field-effect transistor (IGNWFET) with low power consumption (<400 fJ per switching event) based on the standard CMOS process platform. For the first time, the dendritic integration and dual-synaptic dendritic computations (such as "Add" and "Subtraction") could be realized by processing frequency coded spikes using a single device. Meanwhile, multi-functional characteristics of artificial synapses including the short-term and long-term synaptic plasticity, paired pulse facilitation and high-pass filtering were also successfully demonstrated based on 40 nm wide IGNWFETs. The migration of ions in polymer electrolyte and trapping in high-k dielectric were also experimentally studied in-depth to understand the short-term plasticity and long-term plasticity. Combined with statistical uniformity across a 4-inch wafer, the comprehensive performance of IGNWFET demonstrates its potential application in future biologically emulated neuromorphic systems.
Collapse
Affiliation(s)
- Xiaokang Li
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Bocheng Yu
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Bowen Wang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Lin Bao
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Baotong Zhang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Haixia Li
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Zhizhen Yu
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Teng Zhang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Yuancheng Yang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Ru Huang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China.
| | - Yanqing Wu
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China. and Frontiers Science Center for Nano-optoelectronics, Peking University, Beijing, 100871, China
| | - Ming Li
- Key Laboratory of Microelectronic Devices and Circuits (MOE), Institute of Microelectronics, Peking University, Beijing 100871, China. and Frontiers Science Center for Nano-optoelectronics, Peking University, Beijing, 100871, China
| |
Collapse
|
27
|
Lee J, Ryu JH, Kim B, Hussain F, Mahata C, Sim E, Ismail M, Abbas Y, Abbas H, Lee DK, Kim MH, Kim Y, Choi C, Park BG, Kim S. Synaptic Characteristics of Amorphous Boron Nitride-Based Memristors on a Highly Doped Silicon Substrate for Neuromorphic Engineering. ACS APPLIED MATERIALS & INTERFACES 2020; 12:33908-33916. [PMID: 32608233 DOI: 10.1021/acsami.0c07867] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In this study, the resistive switching and synaptic properties of a complementary metal-oxide semiconductor-compatible Ti/a-BN/Si device are investigated for neuromorphic systems. A gradual change in resistance is observed in a positive SET operation in which Ti diffusion is involved in the conducting path. This operation is extremely suitable for synaptic devices in hardware-based neuromorphic systems. The isosurface charge density plots and experimental results confirm that boron vacancies can help generate a conducting path, whereas the conducting path generated by a Ti cation from interdiffusion forms is limited. A negative SET operation causes a considerable decrease in the formation energy of only boron vacancies, thereby increasing the conductivity in the low-resistance state, which may be related to RESET failure and poor endurance. The pulse transient characteristics, potentiation and depression characteristics, and good retention property of eight multilevel cells also indicate that the positive SET operation is more suitable for a synaptic device owing to the gradual modulation of conductance. Moreover, pattern recognition accuracy is examined by considering the conductance values of the measured data in the Ti/a-BN/Si device as the synaptic part of a neural network. The linear and symmetric synaptic weight update in a positive SET operation with an incremental voltage pulse scheme ensures higher pattern recognition accuracy.
Collapse
Affiliation(s)
- Jinju Lee
- School of Electronics Engineering, Chungbuk National University, Cheongju 28644, South Korea
| | - Ji-Ho Ryu
- School of Electronics Engineering, Chungbuk National University, Cheongju 28644, South Korea
| | - Boram Kim
- School of Electrical and Computer Engineering, University of Seoul, Seoul, 02504, South Korea
| | - Fayyaz Hussain
- Materials Research Simulation Laboratory (MSRL) Department of physics, Bahauddin Zakariya University, Multan 60800, Pakistan
| | - Chandreswar Mahata
- School of Electronics Engineering, Chungbuk National University, Cheongju 28644, South Korea
| | - Eunjin Sim
- School of Electronics Engineering, Chungbuk National University, Cheongju 28644, South Korea
| | - Muhammad Ismail
- School of Electronics Engineering, Chungbuk National University, Cheongju 28644, South Korea
| | - Yawar Abbas
- Department of Physics, Khalifa University, Abu Dhabi 127788, United Arab Emirates
| | - Haider Abbas
- Division of Materials Science and Engineering, Hanyang University, Seoul 04763, South Korea
| | - Dong Keun Lee
- Inter-university Semiconductor Research Center (ISRC) and the Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, South Korea
| | - Min-Hwi Kim
- Inter-university Semiconductor Research Center (ISRC) and the Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, South Korea
| | - Yoon Kim
- School of Electrical and Computer Engineering, University of Seoul, Seoul, 02504, South Korea
| | - Changhwan Choi
- Division of Materials Science and Engineering, Hanyang University, Seoul 04763, South Korea
| | - Byung-Gook Park
- Inter-university Semiconductor Research Center (ISRC) and the Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, South Korea
| | - Sungjun Kim
- Division of Electronics and Electrical Engineering, Dongguk University, Seoul 04620, South Korea
| |
Collapse
|
28
|
Hong SB, Kim DK, Chae J, Kim K, Jeong K, Kim J, Park H, Yi Y, Cho MH. Enhanced Photoinduced Carrier Generation Efficiency through Surface Band Bending in Topological Insulator Bi 2Se 3 Thin Films by the Oxidized Layer. ACS APPLIED MATERIALS & INTERFACES 2020; 12:26649-26658. [PMID: 32397708 DOI: 10.1021/acsami.0c05165] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Topological insulators (TIs) have become popular in the field of optoelectronic devices because of their broadband and high-sensitivity properties, which are attributed to the narrow band gap of the bulk state and high mobility of the Dirac surface state. Although perfectly grown TIs are known to exhibit strong stability against oxidation, in most cases, the existence of vacancy defects in TIs reacts to air and the characteristics of TIs is affected by oxidation. Therefore, changes in the band structure and electrical characteristics by oxidation should be considered. A significant change occurs because of the oxidation; however, the dependence of the photoresponse of TIs on oxidation has not been studied in detail. In this study, the photoresponsivity of oxidized Bi2Se3 films is enhanced, rather than degraded, after oxidation in air for 24 h, resulting in a maximum responsivity of 140 mA W-1. This responsivity is substantially higher than previously reported values for Bi2Se3. Furthermore, a change in the photoresponse time of Bi2Se3 due to air exposure is systematically observed. Based on variations in the Fermi level and work function, using photoelectron spectroscopy, it is confirmed that the responsivity is improved from the junction effect of the Bi-based surface oxidized layer.
Collapse
Affiliation(s)
- Seok-Bo Hong
- Department of Physics, Yonsei University, Seoul 03722, Republic of Korea
- Atomic-scale Surface Science Center, Yonsei University, Seoul 03722, Republic of Korea
| | - Dae-Kyoung Kim
- Department of Physics, Yonsei University, Seoul 03722, Republic of Korea
- Atomic-scale Surface Science Center, Yonsei University, Seoul 03722, Republic of Korea
| | - Jimin Chae
- Department of Physics, Yonsei University, Seoul 03722, Republic of Korea
- Atomic-scale Surface Science Center, Yonsei University, Seoul 03722, Republic of Korea
| | - Kiwoong Kim
- Institute of Physics and Applied Physics, Yonsei University, 50 Yonsei-ro, Seodaemun-go, Seoul 03722, Republic of Korea
| | - Kwangsik Jeong
- Department of Physics, Yonsei University, Seoul 03722, Republic of Korea
- Atomic-scale Surface Science Center, Yonsei University, Seoul 03722, Republic of Korea
| | - Jonghoon Kim
- Department of Physics, Yonsei University, Seoul 03722, Republic of Korea
- Atomic-scale Surface Science Center, Yonsei University, Seoul 03722, Republic of Korea
| | - Hanbum Park
- Department of Physics, Yonsei University, Seoul 03722, Republic of Korea
- Atomic-scale Surface Science Center, Yonsei University, Seoul 03722, Republic of Korea
| | - Yeonjin Yi
- Institute of Physics and Applied Physics, Yonsei University, 50 Yonsei-ro, Seodaemun-go, Seoul 03722, Republic of Korea
| | - Mann-Ho Cho
- Department of Physics, Yonsei University, Seoul 03722, Republic of Korea
- Atomic-scale Surface Science Center, Yonsei University, Seoul 03722, Republic of Korea
| |
Collapse
|
29
|
Improving the Recognition Accuracy of Memristive Neural Networks via Homogenized Analog Type Conductance Quantization. MICROMACHINES 2020; 11:mi11040427. [PMID: 32325690 PMCID: PMC7231361 DOI: 10.3390/mi11040427] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Revised: 04/16/2020] [Accepted: 04/17/2020] [Indexed: 11/17/2022]
Abstract
Conductance quantization (QC) phenomena occurring in metal oxide based memristors demonstrate great potential for high-density data storage through multilevel switching, and analog synaptic weight update for effective training of the artificial neural networks. Continuous, linear and symmetrical modulation of the device conductance is a critical issue in QC behavior of memristors. In this contribution, we employ the scanning probe microscope (SPM) assisted electrode engineering strategy to control the ion migration process to construct single conductive filaments in Pt/HfOx/Pt devices. Upon deliberate tuning and evolution of the filament, 32 half integer quantized conductance states in the 16 G0 to 0.5 G0 range with enhanced distribution uniformity was achieved. Simulation results revealed that the numbers of the available QC states and fluctuation of the conductance at each state play an important role in determining the overall performance of the neural networks. The 32-state QC behavior of the hafnium oxide device shows improved recognition accuracy approaching 90% for handwritten digits, based on analog type operation of the multilayer perception (MLP) neural network.
Collapse
|
30
|
Exploring the Impact of Variability in Resistance Distributions of RRAM on the Prediction Accuracy of Deep Learning Neural Networks. ELECTRONICS 2020. [DOI: 10.3390/electronics9030414] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In this work, we explore the use of the resistive random access memory (RRAM) device as a synapse for mimicking the trained weights linking neurons in a deep learning neural network (DNN) (AlexNet). The RRAM devices were fabricated in-house and subjected to 1000 bipolar read-write cycles to measure the resistances recorded for Logic-0 and Logic-1 (we demonstrate the feasibility of achieving eight discrete resistance states in the same device depending on the RESET stop voltage). DNN simulations have been performed to compare the relative error between the output of AlexNet Layer 1 (Convolution) implemented with the standard backpropagation (BP) algorithm trained weights versus the weights that are encoded using the measured resistance distributions from RRAM. The IMAGENET dataset is used for classification purpose here. We focus only on the Layer 1 weights in the AlexNet framework with 11 × 11 × 96 filters values coded into a binary floating point and substituted with the RRAM resistance values corresponding to Logic-0 and Logic-1. The impact of variability in the resistance states of RRAM for the low and high resistance states on the accuracy of image classification is studied by formulating a look-up table (LUT) for the RRAM (from measured I-V data) and comparing the convolution computation output of AlexNet Layer 1 with the standard outputs from the BP-based pre-trained weights. This is one of the first studies dedicated to exploring the impact of RRAM device resistance variability on the prediction accuracy of a convolutional neural network (CNN) on an AlexNet platform through a framework that requires limited actual device switching test data.
Collapse
|
31
|
Milo V, Malavena G, Monzio Compagnoni C, Ielmini D. Memristive and CMOS Devices for Neuromorphic Computing. MATERIALS (BASEL, SWITZERLAND) 2020; 13:E166. [PMID: 31906325 PMCID: PMC6981548 DOI: 10.3390/ma13010166] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2019] [Revised: 12/17/2019] [Accepted: 12/18/2019] [Indexed: 11/17/2022]
Abstract
Neuromorphic computing has emerged as one of the most promising paradigms to overcome the limitations of von Neumann architecture of conventional digital processors. The aim of neuromorphic computing is to faithfully reproduce the computing processes in the human brain, thus paralleling its outstanding energy efficiency and compactness. Toward this goal, however, some major challenges have to be faced. Since the brain processes information by high-density neural networks with ultra-low power consumption, novel device concepts combining high scalability, low-power operation, and advanced computing functionality must be developed. This work provides an overview of the most promising device concepts in neuromorphic computing including complementary metal-oxide semiconductor (CMOS) and memristive technologies. First, the physics and operation of CMOS-based floating-gate memory devices in artificial neural networks will be addressed. Then, several memristive concepts will be reviewed and discussed for applications in deep neural network and spiking neural network architectures. Finally, the main technology challenges and perspectives of neuromorphic computing will be discussed.
Collapse
Affiliation(s)
| | | | | | - Daniele Ielmini
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano and Italian Universities Nanoelectronics Team (IU.NET), Piazza L. da Vinci 32, 20133 Milano, Italy; (V.M.); (G.M.); (C.M.C.)
| |
Collapse
|
32
|
Grollier J, Querlioz D, Camsari KY, Everschor-Sitte K, Fukami S, Stiles MD. Neuromorphic Spintronics. NATURE ELECTRONICS 2020; 3:10.1038/s41928-019-0360-9. [PMID: 33367204 PMCID: PMC7754689 DOI: 10.1038/s41928-019-0360-9] [Citation(s) in RCA: 225] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2019] [Accepted: 12/18/2019] [Indexed: 05/06/2023]
Abstract
Neuromorphic computing uses basic principles inspired by the brain to design circuits that perform artificial intelligence tasks with superior energy efficiency. Traditional approaches have been limited by the energy area of artificial neurons and synapses realized with conventional electronic devices. In recent years, multiple groups have demonstrated that spintronic nanodevices, which exploit the magnetic as well as electrical properties of electrons, can increase the energy efficiency and decrease the area of these circuits. Among the variety of spintronic devices that have been used, magnetic tunnel junctions play a prominent role because of their established compatibility with standard integrated circuits and their multifunctionality. Magnetic tunnel junctions can serve as synapses, storing connection weights, functioning as local, nonvolatile digital memory or as continuously varying resistances. As nano-oscillators, they can serve as neurons, emulating the oscillatory behavior of sets of biological neurons. As superparamagnets, they can do so by emulating the random spiking of biological neurons. Magnetic textures like domain walls or skyrmions can be configured to function as neurons through their non-linear dynamics. Several implementations of neuromorphic computing with spintronic devices demonstrate their promise in this context. Used as variable resistance synapses, magnetic tunnel junctions perform pattern recognition in an associative memory. As oscillators, they perform spoken digit recognition in reservoir computing and when coupled together, classification of signals. As superparamagnets, they perform population coding and probabilistic computing. Simulations demonstrate that arrays of nanomagnets and films of skyrmions can operate as components of neuromorphic computers. While these examples show the unique promise of spintronics in this field, there are several challenges to scaling up, including the efficiency of coupling between devices and the relatively low ratio of maximum to minimum resistances in the individual devices.
Collapse
Affiliation(s)
- J. Grollier
- Unité Mixte de Physique CNRS, Thales, Univ. Paris-Sud, Université Paris-Saclay, 91767 Palaiseau, France
| | - D. Querlioz
- Centre de Nanosciences et de Nanotechnologies, Univ. Paris-Sud, CNRS, Université Paris-Saclay, 91405 Orsay, France
| | - K. Y. Camsari
- School of Electrical & Computer Engineering, Purdue University, West Lafayette, Indiana 47907 USA
| | - K. Everschor-Sitte
- Institute of Physics, Johannes Gutenberg University Mainz, D-55099 Mainz, Germany
| | - S. Fukami
- Research Institute of Electrical Communication, Tohoku University, Sendai, Miyagi 9808577, Japan
| | - M. D. Stiles
- National Institute of Standards and Technology, Gaithersburg, Maryland 20899, USA
| |
Collapse
|
33
|
Maciel N, Marques E, Naviner L, Zhou Y, Cai H. Magnetic Tunnel Junction Applications. SENSORS 2019; 20:s20010121. [PMID: 31878139 PMCID: PMC6982960 DOI: 10.3390/s20010121] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Revised: 12/11/2019] [Accepted: 12/20/2019] [Indexed: 11/16/2022]
Abstract
Spin-based devices can reduce energy leakage and thus increase energy efficiency. They have been seen as an approach to overcoming the constraints of CMOS downscaling, specifically, the Magnetic Tunnel Junction (MTJ) which has been the focus of much research in recent years. Its nonvolatility, scalability and low power consumption are highly attractive when applied in several components. This paper aims at providing a survey of a selection of MTJ applications such as memory and analog to digital converter, among others.
Collapse
Affiliation(s)
- Nilson Maciel
- LTCI, Télécom Paris, Institut Polytechnique de Paris, 91128 Palaiseau, France; (E.M.); (L.N.)
- Correspondence:
| | - Elaine Marques
- LTCI, Télécom Paris, Institut Polytechnique de Paris, 91128 Palaiseau, France; (E.M.); (L.N.)
| | - Lírida Naviner
- LTCI, Télécom Paris, Institut Polytechnique de Paris, 91128 Palaiseau, France; (E.M.); (L.N.)
| | - Yongliang Zhou
- National ASIC System Engineering Center, Southeast University, Nanjing 210096, China; (Y.Z.); (H.C.)
| | - Hao Cai
- National ASIC System Engineering Center, Southeast University, Nanjing 210096, China; (Y.Z.); (H.C.)
| |
Collapse
|
34
|
Tang J, Yuan F, Shen X, Wang Z, Rao M, He Y, Sun Y, Li X, Zhang W, Li Y, Gao B, Qian H, Bi G, Song S, Yang JJ, Wu H. Bridging Biological and Artificial Neural Networks with Emerging Neuromorphic Devices: Fundamentals, Progress, and Challenges. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2019; 31:e1902761. [PMID: 31550405 DOI: 10.1002/adma.201902761] [Citation(s) in RCA: 219] [Impact Index Per Article: 36.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Revised: 08/16/2019] [Indexed: 05/08/2023]
Abstract
As the research on artificial intelligence booms, there is broad interest in brain-inspired computing using novel neuromorphic devices. The potential of various emerging materials and devices for neuromorphic computing has attracted extensive research efforts, leading to a large number of publications. Going forward, in order to better emulate the brain's functions, its relevant fundamentals, working mechanisms, and resultant behaviors need to be re-visited, better understood, and connected to electronics. A systematic overview of biological and artificial neural systems is given, along with their related critical mechanisms. Recent progress in neuromorphic devices is reviewed and, more importantly, the existing challenges are highlighted to hopefully shed light on future research directions.
Collapse
Affiliation(s)
- Jianshi Tang
- Institute of Microelectronics, Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Fang Yuan
- Institute of Microelectronics, Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Xinke Shen
- Tsinghua Laboratory of Brain and Intelligence and Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Zhongrui Wang
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, 01003, USA
| | - Mingyi Rao
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, 01003, USA
| | - Yuanyuan He
- Tsinghua Laboratory of Brain and Intelligence and Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Yuhao Sun
- Tsinghua Laboratory of Brain and Intelligence and Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Xinyi Li
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Wenbin Zhang
- Institute of Microelectronics, Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Yijun Li
- Institute of Microelectronics, Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Bin Gao
- Institute of Microelectronics, Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - He Qian
- Institute of Microelectronics, Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Guoqiang Bi
- School of Life Sciences, University of Science and Technology of China, Hefei, 230027, China
| | - Sen Song
- Tsinghua Laboratory of Brain and Intelligence and Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - J Joshua Yang
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, 01003, USA
| | - Huaqiang Wu
- Institute of Microelectronics, Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| |
Collapse
|
35
|
Towards spike-based machine intelligence with neuromorphic computing. Nature 2019; 575:607-617. [PMID: 31776490 DOI: 10.1038/s41586-019-1677-2] [Citation(s) in RCA: 410] [Impact Index Per Article: 68.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2018] [Accepted: 07/09/2019] [Indexed: 11/08/2022]
Abstract
Guided by brain-like 'spiking' computational frameworks, neuromorphic computing-brain-inspired computing for machine intelligence-promises to realize artificial intelligence while reducing the energy requirements of computing platforms. This interdisciplinary field began with the implementation of silicon circuits for biological neural routines, but has evolved to encompass the hardware implementation of algorithms with spike-based encoding and event-driven representations. Here we provide an overview of the developments in neuromorphic computing for both algorithms and hardware and highlight the fundamentals of learning and hardware frameworks. We discuss the main challenges and the future prospects of neuromorphic computing, with emphasis on algorithm-hardware codesign.
Collapse
|
36
|
Zhang B, Huang J, Jian J, Rutherford BX, Li L, Misra S, Sun X, Wang H. Tuning magnetic anisotropy in Co-BaZrO 3 vertically aligned nanocomposites for memory device integration. NANOSCALE ADVANCES 2019; 1:4450-4458. [PMID: 36134413 PMCID: PMC9417828 DOI: 10.1039/c9na00438f] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2019] [Accepted: 09/28/2019] [Indexed: 05/18/2023]
Abstract
Ferromagnetic nanostructures with strong anisotropic properties are highly desired for their potential integration into spintronic devices. Several anisotropic candidates, such as CoFeB and Fe-Pt, have been previously proposed, but many of them have limitations such as patterning issues or thickness restrictions. In this work, Co-BaZrO3 (Co-BZO) vertically aligned nanocomposite (VAN) films with tunable magnetic anisotropy and coercive field strength have been demonstrated to address this need. Such tunable magnetic properties are achieved through tuning the thickness of the Co-BZO VAN structures and the aspect ratio of the Co nanostructures, which can be easily integrated into spintronic devices. As a demonstration, we have integrated the Co-BZO VAN nanostructure into tunnel junction devices, which demonstrated resistive switching alluding to Co-BZO's immense potential for future spintronic devices.
Collapse
Affiliation(s)
- Bruce Zhang
- School of Electrical and Computer Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| | - Jijie Huang
- School of Materials Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| | - Jie Jian
- School of Materials Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| | - Bethany X Rutherford
- School of Materials Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| | - Leigang Li
- School of Materials Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| | - Shikhar Misra
- School of Materials Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| | - Xing Sun
- School of Materials Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| | - Haiyan Wang
- School of Electrical and Computer Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
- School of Materials Engineering, Purdue University West Lafayette Indiana 47907-2045 USA
| |
Collapse
|
37
|
Two-dimensional materials for synaptic electronics and neuromorphic systems. Sci Bull (Beijing) 2019; 64:1056-1066. [PMID: 36659765 DOI: 10.1016/j.scib.2019.01.016] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2018] [Revised: 01/02/2019] [Accepted: 01/11/2019] [Indexed: 01/21/2023]
Abstract
Synapses in biology provide a variety of functions for the neural system. Artificial synaptic electronics that mimic the biological neuron functions are basic building blocks and developing novel artificial synapses is essential for neuromorphic computation. Inspired by the unique features of biological synapses that the basic connection components of the nervous system and the parallelism, low power consumption, fault tolerance, self-learning and robustness of biological neural systems, artificial synaptic electronics and neuromorphic systems have the potential to overcome the traditional von Neumann bottleneck and create a new paradigm for dealing with complex problems such as pattern recognition, image classification, decision making and associative learning. Nowadays, two-dimensional (2D) materials have drawn great attention in simulating synaptic dynamic plasticity and neuromorphic computing with their unique properties. Here we describe the basic concepts of bio-synaptic plasticity and learning, the 2D materials library and its preparation. We review recent advances in synaptic electronics and artificial neuromorphic systems based on 2D materials and provide our perspective in utilizing 2D materials to implement synaptic electronics and neuromorphic systems in hardware.
Collapse
|
38
|
Choi JY, Jun H, Ashiba K, Baek JU, Shim TH, Park JG. Double Pinned Perpendicular-Magnetic-Tunnel-Junction Spin-Valve Providing Multi-level Resistance States. Sci Rep 2019; 9:11932. [PMID: 31417114 PMCID: PMC6695488 DOI: 10.1038/s41598-019-48311-0] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2018] [Accepted: 08/02/2019] [Indexed: 11/09/2022] Open
Abstract
A new design for high density integration greater than gigabits of perpendicular-magnetic-tunnel-junction (p-MTJ) spin-valve, called the double pinned (i.e., bottom and top pinned structures) p-MTJ spin-valve achieved a multi-level memory-cell operation exhibiting four-level resistances. Three key magnetic properties, the anisotropy exchange field (Hex) of the bottom pinned structure, the coercivity (Hc) of the double free-layer, and the Hc of the top pinned structure mainly determined four-level resistances producing tunneling-magnetoresistance (TMR) ratios of 152.6%, 33.6%, and 166.5%. The three key-design concepts are: i) the bottom pinned structure with a sufficiently large Hex to avoid a write-error, ii) the Hc of the double free-layer (i.e., ~0.1 kOe) much less than the Hc of the top pinned structure (i.e., ~1.0 kOe), and iii) the top pinned structure providing different electron spin directions.
Collapse
Affiliation(s)
- Jin-Young Choi
- MRAM Center, Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Hansol Jun
- MRAM Center, Department of Nanoscale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Kei Ashiba
- MRAM Center, Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea.,Wafer Engineering Department, SUMCO CORPORATION, 1-52 Kubara, Imari, Saga, 849-4256, Japan
| | - Jong-Ung Baek
- MRAM Center, Department of Nanoscale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Tae-Hun Shim
- MRAM Center, Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Jea-Gun Park
- MRAM Center, Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea. .,MRAM Center, Department of Nanoscale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea.
| |
Collapse
|
39
|
Jang EK, Park Y, Lee JS. Reversible uptake and release of sodium ions in layered SnS 2-reduced graphene oxide composites for neuromorphic devices. NANOSCALE 2019; 11:15382-15388. [PMID: 31389935 DOI: 10.1039/c9nr03073e] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
With the advent of brain-inspired computing for complex data processing, emerging nonvolatile memories have been widely studied to develop neuromorphic devices for pattern recognition and deep learning. However, the devices still suffer from limitations such as nonlinearity and large write noise because they adopt a stochastic switching approach. Here, we suggest a biomimetic three-terminal electrochemical artificial synapse that is operated by a conductance change in response to intercalation of sodium (Na+) ions into a layered SnS2-reduced graphene oxide (RGO) composite channel. SnS2-RGO can reversibly uptake and release Na+ ions, so the conductance of the channel in artificial synapse can be controlled effectively and thereby it can emulate essential synaptic functions including short-term plasticity, spatiotemporal signal processing, and transition from short-term to long-term plasticity. The artificial synapse also shows linear and symmetric potentiation/depression with low cycle-to-cycle variation; these responses could improve the write linearity and reduce the write noise of devices. This study demonstrates the feasibility of next-generation neuromorphic memory using ion-based electrochemical devices that can mimic biological synapses with the migration of Na+ ions.
Collapse
Affiliation(s)
- Eun-Kyeong Jang
- Department of Materials Science and Engineering, Pohang University of Science and Technology (POSTECH), Pohang 37673, Korea.
| | | | | |
Collapse
|
40
|
Fang Y, Wang Z, Gomez J, Datta S, Khan AI, Raychowdhury A. A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks. Front Neurosci 2019; 13:855. [PMID: 31456659 PMCID: PMC6700359 DOI: 10.3389/fnins.2019.00855] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2019] [Accepted: 07/30/2019] [Indexed: 11/13/2022] Open
Abstract
As computational models inspired by the biological neural system, spiking neural networks (SNN) continue to demonstrate great potential in the landscape of artificial intelligence, particularly in tasks such as recognition, inference, and learning. While SNN focuses on achieving high-level intelligence of individual creatures, Swarm Intelligence (SI) is another type of bio-inspired models that mimic the collective intelligence of biological swarms, i.e., bird flocks, fish school and ant colonies. SI algorithms provide efficient and practical solutions to many difficult optimization problems through multi-agent metaheuristic search. Bridging these two distinct subfields of artificial intelligence has the potential to harness collective behavior and learning ability of biological systems. In this work, we explore the feasibility of connecting these two models by implementing a generalized SI model on SNN. In the proposed computing paradigm, we use SNNs to represent agents in the swarm and encode problem solutions with the spike firing rate and with spike timing. The coupled neurons communicate and modulate each other's action potentials through event-driven spikes and synchronize their dynamics around the states of optimal solutions. We demonstrate that such an SI-SNN model is capable of efficiently solving optimization problems, such as parameter optimization of continuous functions and a ubiquitous combinatorial optimization problem, namely, the traveling salesman problem with near-optimal solutions. Furthermore, we demonstrate an efficient implementation of such neural dynamics on an emerging hardware platform, namely ferroelectric field-effect transistor (FeFET) based spiking neurons. Such an emerging in-silico neuron is composed of a compact 1T-1FeFET structure with both excitatory and inhibitory inputs. We show that the designed neuromorphic system can serve as an optimization solver with high-performance and high energy-efficiency.
Collapse
Affiliation(s)
- Yan Fang
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Zheng Wang
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Jorge Gomez
- Department of Electrical Engineering, University of Notre Dame, Notre Dame, IN, United States
| | - Suman Datta
- Department of Electrical Engineering, University of Notre Dame, Notre Dame, IN, United States
| | - Asif I Khan
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Arijit Raychowdhury
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| |
Collapse
|
41
|
Flexible organic synaptic device based on poly (methyl methacrylate):CdSe/CdZnS quantum-dot nanocomposites. Sci Rep 2019; 9:9755. [PMID: 31278307 PMCID: PMC6611803 DOI: 10.1038/s41598-019-46226-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2018] [Accepted: 05/15/2019] [Indexed: 11/08/2022] Open
Abstract
A synaptic device that functionally mimics a biological synapse is a promising candidate for use as an electronic element in a neuromorphic system. In this study, flexible electronic synaptic devices based on poly (methyl methacrylate) (PMMA):CdSe/CdZnS core-shell quantum-dot (QD) nanocomposites are demonstrated. The current-voltage characteristics for the synaptic devices under consecutive voltage sweeps show clockwise hysteresis, which is a critical feature of an artificial synaptic device. The effect of the CdSe/CdZnS QD concentration on the device performance is studied. The flexible electronic synaptic devices under bending show the similar and stable electrical performances. The memory retention measurements show that the e-synapse exhibits long-term potentiation and depression. The carrier transport mechanisms are analyzed, and thermionic emission and space-charge-limited-current conduction are found to be dominant.
Collapse
|
42
|
Ji X, Wang C, Lim KG, Tan CC, Chong TC, Zhao R. Tunable Resistive Switching Enabled by Malleable Redox Reaction in the Nano-Vacuum Gap. ACS APPLIED MATERIALS & INTERFACES 2019; 11:20965-20972. [PMID: 31117430 DOI: 10.1021/acsami.9b02498] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Neuromorphic computing has emerged as a highly promising alternative to conventional computing. The key to constructing a large-scale neural network in hardware for neuromorphic computing is to develop artificial neurons with leaky integrate-and-fire behavior and artificial synapses with synaptic plasticity using nanodevices. So far, these two basic computing elements have been built in separate devices using different materials and technologies, which poses a significant challenge to system design and manufacturing. In this work, we designed a resistive device embedded with an innovative nano-vacuum gap between a bottom electrode and a mixed-ionic-electronic-conductor (MIEC) layer. Through redox reaction on the MIEC surface, metallic filaments dynamically grew within the nano-vacuum gap. The nano-vacuum gap provided an additional control factor for controlling the evolution dynamics of metallic filaments by tuning the electron tunneling efficiency, in analogy to a pseudo-three-terminal device, resulting in tunable switching behavior in various forms from volatile to nonvolatile switching in a single device. Our device demonstrated cross-functions, in particular, tunable neuronal firing and synaptic plasticity on demand, providing seamless integration for building large-scale artificial neural networks for neuromorphic computing.
Collapse
Affiliation(s)
- Xinglong Ji
- Department of Engineering Product Design , Singapore University of Technology and Design , 8 Somapah Road , Singapore 487372 , Singapore
| | - Chao Wang
- Department of Engineering Product Design , Singapore University of Technology and Design , 8 Somapah Road , Singapore 487372 , Singapore
| | - Kian Guan Lim
- Department of Engineering Product Design , Singapore University of Technology and Design , 8 Somapah Road , Singapore 487372 , Singapore
| | - Chun Chia Tan
- Department of Engineering Product Design , Singapore University of Technology and Design , 8 Somapah Road , Singapore 487372 , Singapore
| | - Tow Chong Chong
- Department of Engineering Product Design , Singapore University of Technology and Design , 8 Somapah Road , Singapore 487372 , Singapore
| | - Rong Zhao
- Department of Engineering Product Design , Singapore University of Technology and Design , 8 Somapah Road , Singapore 487372 , Singapore
| |
Collapse
|
43
|
Shi Y, Nguyen L, Oh S, Liu X, Kuzum D. A Soft-Pruning Method Applied During Training of Spiking Neural Networks for In-memory Computing Applications. Front Neurosci 2019; 13:405. [PMID: 31080402 PMCID: PMC6497807 DOI: 10.3389/fnins.2019.00405] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2018] [Accepted: 04/09/2019] [Indexed: 11/13/2022] Open
Abstract
Inspired from the computational efficiency of the biological brain, spiking neural networks (SNNs) emulate biological neural networks, neural codes, dynamics, and circuitry. SNNs show great potential for the implementation of unsupervised learning using in-memory computing. Here, we report an algorithmic optimization that improves energy efficiency of online learning with SNNs on emerging non-volatile memory (eNVM) devices. We develop a pruning method for SNNs by exploiting the output firing characteristics of neurons. Our pruning method can be applied during network training, which is different from previous approaches in the literature that employ pruning on already-trained networks. This approach prevents unnecessary updates of network parameters during training. This algorithmic optimization can complement the energy efficiency of eNVM technology, which offers a unique in-memory computing platform for the parallelization of neural network operations. Our SNN maintains ~90% classification accuracy on the MNIST dataset with up to ~75% pruning, significantly reducing the number of weight updates. The SNN and pruning scheme developed in this work can pave the way toward applications of eNVM based neuro-inspired systems for energy efficient online learning in low power applications.
Collapse
Affiliation(s)
- Yuhan Shi
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Leon Nguyen
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Sangheon Oh
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Xin Liu
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Duygu Kuzum
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| |
Collapse
|
44
|
Srinivasan G, Roy K. ReStoCNet: Residual Stochastic Binary Convolutional Spiking Neural Network for Memory-Efficient Neuromorphic Computing. Front Neurosci 2019; 13:189. [PMID: 30941003 PMCID: PMC6434391 DOI: 10.3389/fnins.2019.00189] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Accepted: 02/18/2019] [Indexed: 11/13/2022] Open
Abstract
In this work, we propose ReStoCNet, a residual stochastic multilayer convolutional Spiking Neural Network (SNN) composed of binary kernels, to reduce the synaptic memory footprint and enhance the computational efficiency of SNNs for complex pattern recognition tasks. ReStoCNet consists of an input layer followed by stacked convolutional layers for hierarchical input feature extraction, pooling layers for dimensionality reduction, and fully-connected layer for inference. In addition, we introduce residual connections between the stacked convolutional layers to improve the hierarchical feature learning capability of deep SNNs. We propose Spike Timing Dependent Plasticity (STDP) based probabilistic learning algorithm, referred to as Hybrid-STDP (HB-STDP), incorporating Hebbian and anti-Hebbian learning mechanisms, to train the binary kernels forming ReStoCNet in a layer-wise unsupervised manner. We demonstrate the efficacy of ReStoCNet and the presented HB-STDP based unsupervised training methodology on the MNIST and CIFAR-10 datasets. We show that residual connections enable the deeper convolutional layers to self-learn useful high-level input features and mitigate the accuracy loss observed in deep SNNs devoid of residual connections. The proposed ReStoCNet offers >20 × kernel memory compression compared to full-precision (32-bit) SNN while yielding high enough classification accuracy on the chosen pattern recognition tasks.
Collapse
|
45
|
Kim S, Abbas Y, Jeon YR, Sokolov AS, Ku B, Choi C. Engineering synaptic characteristics of TaO x/HfO 2 bi-layered resistive switching device. NANOTECHNOLOGY 2018; 29:415204. [PMID: 30051887 DOI: 10.1088/1361-6528/aad64c] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
We performed various pulse measurements on an atomic layer deposited (ALD) HfO2-based resistive switching random access memory (RRAM) device and investigated its electronic synaptic characteristics. Unlike requirements for RRAM device application, to achieve the multi-state conductance changes required for the synaptic device, we employed additional sputtered TaOx thin film formation on the ALD HfO2 switching medium, which leads to engineering the concentration of oxygen vacancies and modulating the conductive filaments. With this TaOx/HfO2 bi-layered device, we attained gradual resistive switching, linear and symmetric conductance change, improved endurance and reproducibility characteristics compared to a single HfO2 device. Finally, we emulated spike-timing-dependent plasticity based learning rule with pulses inspired by neural action potential, indicating its potential as an electronic synaptic device in a hardware neuromorphic system.
Collapse
Affiliation(s)
- Sohyeon Kim
- Division of Materials Science and Engineering, Hanyang University, Seoul 04763, Republic of Korea
| | | | | | | | | | | |
Collapse
|
46
|
Liu J, Yang H, Ji Y, Ma Z, Chen K, Zhang X, Zhang H, Sun Y, Huang X, Oda S. An electronic synaptic device based on HfO 2TiO x bilayer structure memristor with self-compliance and deep-RESET characteristics. NANOTECHNOLOGY 2018; 29:415205. [PMID: 30051885 DOI: 10.1088/1361-6528/aad64d] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
We reported on a Ti/HfO2/TiOx/Pt memristor with self-compliance, deep-RESET characteristics and excellent switching performance, including ultrafast program/erase speed (10 ns), a large memory window (103) and good pulse endurance (107 cycles). The self-compliance and deep-RESET characteristics are beneficial for protecting the device from permanent breakdown in both SET and RESET processes especially under the pulse operation mode. In addition to bistable state switching, we also achieved multiple or even continuous conductance state switching under a DC sweep and a pulse-train operation mode in the Ti/HfO2/TiOx/Pt memristor, which can be seen as a substitution of a biological synapse. The capability of continuous modulation conductance (synaptic weight) in the Ti/HfO2/TiOx/Pt memristor was investigated and the potentiation and depression characteristics of the synaptic weight could be precisely tuned by the number or amplitude of the input pulse-train. Moreover, clear experimental evidence of short-term plasticity (STP) and long-term plasticity (LTP) in a single memristor was also demonstrated. Increasing the pulse amplitude or width, or decreasing the interval of two adjacent pulses of the input pulse-train resulted in the memristor behavior transitioning from STP to LTP. The realization of those important synaptic functions in the Ti/HfO2/TiOx/Pt memristor may be suitable for applications in artificial neural systems.
Collapse
Affiliation(s)
- Jian Liu
- School of Electronic Science and Engineering, and State Key Laboratory of Solid State Microstructures, Nanjing University, Nanjing 210093, People's Republic of China. Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing 210093, People's Republic of China
| | | | | | | | | | | | | | | | | | | |
Collapse
|
47
|
Nandakumar S, Kulkarni SR, Babu AV, Rajendran B. Building Brain-Inspired Computing Systems: Examining the Role of Nanoscale Devices. IEEE NANOTECHNOLOGY MAGAZINE 2018. [DOI: 10.1109/mnano.2018.2845078] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
48
|
Boybat I, Le Gallo M, Nandakumar SR, Moraitis T, Parnell T, Tuma T, Rajendran B, Leblebici Y, Sebastian A, Eleftheriou E. Neuromorphic computing with multi-memristive synapses. Nat Commun 2018; 9:2514. [PMID: 29955057 PMCID: PMC6023896 DOI: 10.1038/s41467-018-04933-y] [Citation(s) in RCA: 194] [Impact Index Per Article: 27.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2017] [Accepted: 06/04/2018] [Indexed: 11/10/2022] Open
Abstract
Neuromorphic computing has emerged as a promising avenue towards building the next generation of intelligent computing systems. It has been proposed that memristive devices, which exhibit history-dependent conductivity modulation, could efficiently represent the synaptic weights in artificial neural networks. However, precise modulation of the device conductance over a wide dynamic range, necessary to maintain high network accuracy, is proving to be challenging. To address this, we present a multi-memristive synaptic architecture with an efficient global counter-based arbitration scheme. We focus on phase change memory devices, develop a comprehensive model and demonstrate via simulations the effectiveness of the concept for both spiking and non-spiking neural networks. Moreover, we present experimental results involving over a million phase change memory devices for unsupervised learning of temporal correlations using a spiking neural network. The work presents a significant step towards the realization of large-scale and energy-efficient neuromorphic computing systems. Memristive technology is a promising avenue towards realizing efficient non-von Neumann neuromorphic hardware. Boybat et al. proposes a multi-memristive synaptic architecture with a counter-based global arbitration scheme to address challenges associated with the non-ideal memristive device behavior.
Collapse
Affiliation(s)
- Irem Boybat
- IBM Research - Zurich, Säumerstrasse 4, 8803, Rüschlikon, Switzerland. .,Microelectronic Systems Laboratory, EPFL, Bldg ELD, Station 11, CH-1015, Lausanne, Switzerland.
| | - Manuel Le Gallo
- IBM Research - Zurich, Säumerstrasse 4, 8803, Rüschlikon, Switzerland
| | - S R Nandakumar
- IBM Research - Zurich, Säumerstrasse 4, 8803, Rüschlikon, Switzerland.,Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ, 07102, USA
| | - Timoleon Moraitis
- IBM Research - Zurich, Säumerstrasse 4, 8803, Rüschlikon, Switzerland
| | - Thomas Parnell
- IBM Research - Zurich, Säumerstrasse 4, 8803, Rüschlikon, Switzerland
| | - Tomas Tuma
- IBM Research - Zurich, Säumerstrasse 4, 8803, Rüschlikon, Switzerland
| | - Bipin Rajendran
- Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ, 07102, USA
| | - Yusuf Leblebici
- Microelectronic Systems Laboratory, EPFL, Bldg ELD, Station 11, CH-1015, Lausanne, Switzerland
| | - Abu Sebastian
- IBM Research - Zurich, Säumerstrasse 4, 8803, Rüschlikon, Switzerland.
| | | |
Collapse
|
49
|
Sung C, Lim S, Kim H, Kim T, Moon K, Song J, Kim JJ, Hwang H. Effect of conductance linearity and multi-level cell characteristics of TaO x-based synapse device on pattern recognition accuracy of neuromorphic system. NANOTECHNOLOGY 2018; 29:115203. [PMID: 29328054 DOI: 10.1088/1361-6528/aaa733] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
To improve the classification accuracy of an image data set (CIFAR-10) by using analog input voltage, synapse devices with excellent conductance linearity (CL) and multi-level cell (MLC) characteristics are required. We analyze the CL and MLC characteristics of TaOx-based filamentary resistive random access memory (RRAM) to implement the synapse device in neural network hardware. Our findings show that the number of oxygen vacancies in the filament constriction region of the RRAM directly controls the CL and MLC characteristics. By adopting a Ta electrode (instead of Ti) and the hot-forming step, we could form a dense conductive filament. As a result, a wide range of conductance levels with CL is achieved and significantly improved image classification accuracy is confirmed.
Collapse
Affiliation(s)
- Changhyuck Sung
- Department of Material Science and Engineering, Pohang University of Science and Technology (POSTECH), Pohang, 790-784, Republic of Korea
| | | | | | | | | | | | | | | |
Collapse
|
50
|
Choi JY, Lee DG, Baek JU, Park JG. Double MgO-based Perpendicular Magnetic-Tunnel-Junction Spin-valve Structure with a Top Co 2Fe 6B 2 Free Layer using a Single SyAF [Co/Pt] n Layer. Sci Rep 2018; 8:2139. [PMID: 29391577 PMCID: PMC5794754 DOI: 10.1038/s41598-018-20626-4] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2017] [Accepted: 01/22/2018] [Indexed: 11/09/2022] Open
Abstract
A new perpendicular spin-transfer-torque magnetic-tunnel-junction (p-MTJ) spin-valve was developed to achieve a high tunneling magnetoresistance (TMR) ratio. It had a double MgO-based spin-valve structure with a top Co2Fe6B2 free layer and incorporated a single SyAF [Co(0.4 nm)/Pt(0.3 nm)]3 layer and a new buffer layer of Co(0.6)/Pt(0.3)/Co(0.4). It had a TMR ratio of 180% and anisotropy exchange field (H ex ) of 3.44 kOe after ex-situ annealing of 350 °C for 30 min under a vacuum below 10-6 torr and a perpendicular magnetic field of 3 tesla, thereby ensuring a memory margin and avoiding read disturbance failures. Its high level of performance was due to the face-center-cubic crystallinity of the MgO tunneling barrier being significantly improved by decreasing its surface roughness (i.e., peak-to-valley length of 1.4 nm).
Collapse
Affiliation(s)
- Jin-Young Choi
- MRAM Center, Department of Electronics and Computer Engineering, Hanyang University, Seoul, 133-791, Republic of Korea
| | - Dong-Gi Lee
- MRAM Center, Department of Electronics and Computer Engineering, Hanyang University, Seoul, 133-791, Republic of Korea
| | - Jong-Ung Baek
- MRAM Center, Department of Nanoscale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Jea-Gun Park
- MRAM Center, Department of Electronics and Computer Engineering, Hanyang University, Seoul, 133-791, Republic of Korea. .,MRAM Center, Department of Nanoscale Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea.
| |
Collapse
|