1
|
Mohan C, Crepaldi M, Torazza D, Adamatzky A, Abdi G, Szkudlarek A, Chiolerio A. Liquid ferrofluid synapses for spike-based neuromorphic learning. MATERIALS HORIZONS 2025. [PMID: 40241544 DOI: 10.1039/d4mh01592d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/18/2025]
Abstract
Solid-state memory devices have emerged as promising synapses for neuromorphic engineering and computing. However, features such as limited endurance, static sensitivity, and lower ON/OFF ratios, as well as the need for peculiar conditions including current compliance and forming, still make their adoption challenging. Here we report a liquid state neuromorphic device based on a ferrofluid that exhibits short-term plasticity featuring extraordinary properties: a lower dynamic range, a high endurance, a fault tolerance capability, a deterministic resistance switching behavior, and no need for prerequisites such as a forming procedure and compliance current requirements. We also show how to stabilize nanoparticles using oleic acid as the surfactant, resulting in a yield increase and a smaller resistance variance. Additionally, we propose a low-power inference system on such a liquid synapse by applying the minimal magnitude of read biases, which are only affected to about 10% by the offset, gain errors, and noise of the system. Finally, we show the liquid synapse's feature to scale down the size and the capability to classify digits using a spike-based unsupervised learning method.
Collapse
Affiliation(s)
- Charanraj Mohan
- Electronic Design Laboratory, Istituto Italiano di Tecnologia, Via Melen 83, Genova 16152, Liguria, Italy
| | - Marco Crepaldi
- Electronic Design Laboratory, Istituto Italiano di Tecnologia, Via Melen 83, Genova 16152, Liguria, Italy
| | - Diego Torazza
- Mechanical Workshop, Istituto Italiano di Tecnologia, Via Morego 30, Genova 16163, Liguria, Italy
| | - Andrew Adamatzky
- Unconventional Computing Laboratory, University of West England, Frenchay Campus, Coldharbour Ln, Bristol, BS16 1QY Bristol, UK
| | - Gisya Abdi
- Academic Centre for Materials and Nanotechnology, AGH University of Krakow, Kawiory 30, 30-055 Kraków, Poland
| | - Aleksandra Szkudlarek
- Academic Centre for Materials and Nanotechnology, AGH University of Krakow, Kawiory 30, 30-055 Kraków, Poland
| | - Alessandro Chiolerio
- Unconventional Computing Laboratory, University of West England, Frenchay Campus, Coldharbour Ln, Bristol, BS16 1QY Bristol, UK
- Bioinspired Soft Robotics, Istituto Italiano di Tecnologia, Via Morego 30, Genova 16163, Liguria, Italy.
| |
Collapse
|
2
|
Ding Z, Li M, Wang L, Li S, Cheng L. Design and characteristic analysis of incommensurate-order fractional discrete memristor-based hyperchaotic system. CHAOS (WOODBURY, N.Y.) 2025; 35:043123. [PMID: 40207725 DOI: 10.1063/5.0257053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2025] [Accepted: 03/27/2025] [Indexed: 04/11/2025]
Abstract
The discrete memristive chaotic system is characterized by discontinuous phase trajectories. To address the limitations of the ideal integer-order discrete memristor model, which fails to accurately reflect the characteristics of practical devices, this study introduces a Grunwald-Letnikov type quadratic trivariate fractional discrete memristor model to enhance the nonlinearity and memory properties of memristors. Simultaneously, it is demonstrated that our model satisfies the essential characteristics of the generalized memristor. Based on this newly proposed fractional discrete memristor, a new four-dimensional fractional discrete memristive hyperchaotic system is constructed by coupling non-uniform, incommensurate-order memristors. This system advances the structure of existing discrete chaotic systems and provides a more flexible strategy for optimizing memory effects. The dynamical behaviors are analyzed using attractor phase diagrams, bifurcation diagrams, Lyapunov exponent spectra, and permutation entropy complexity. Numerical simulation results show that the system can exhibit a larger hyperchaotic region, higher complexity, and rich multistable behaviors, such as the coexistence of infinitely symmetric attractors and enhanced offset. Additionally, the impact of the incommensurate-order parameter on the system's chaotic behavior is revealed, with order serving as a tunable control variable that dynamically reconfigures bifurcation paths as needed, thereby enabling transitions between hyperchaotic, chaotic, and non-chaotic states. Furthermore, a simulation circuit was designed to validate the numerical simulation results.
Collapse
Affiliation(s)
- Zhixia Ding
- School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China
| | - Mengyan Li
- School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China
| | - Liheng Wang
- School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China
| | - Sai Li
- School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China
| | - Lili Cheng
- Department of Mechanical and Electrical Engineering, Wenhua College, Wuhan 430000, China
| |
Collapse
|
3
|
Secco J, Spinazzola E, Pittarello M, Ricci E, Pareschi F. Clinically validated classification of chronic wounds method with memristor-based cellular neural network. Sci Rep 2024; 14:30839. [PMID: 39730505 DOI: 10.1038/s41598-024-81521-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 11/27/2024] [Indexed: 12/29/2024] Open
Abstract
Chronic wounds are a syndrome that affects around 4% of the world population due to several pathologies. The COV-19 pandemic has enforced the need of developing new techniques and technologies that can help clinicians to monitor the affected patients easily and reliably. In this prospective observational study a new device, the Wound Viewer, that works through a memristor-based Discrete-Time Cellular Neural Network (DT-CNN) has been developed and tested through a clinical trial of 150 patients. The WV has been developed to serve as the state-of-art tool, capable to return the actual clinical information that is most needed by the caregivers: through the WBP scale, it classifies four classes of wounds by the type of tissue: A-only granular tissue; B-<50% slough; C->50% slough; D-necrosis. This work aims to describe in depth the technology and the computational techniques that have been implemented, and to demonstrate reliability in automatically identifying, classifying through internationally accepted clinical scales and measuring such wounds, that peaked to over a 90% of accuracy.
Collapse
Affiliation(s)
- Jacopo Secco
- Department of Electronics and Telecommunications, Politecnico di Torino, 10123, Torino, Italy
| | - Elisabetta Spinazzola
- Department of Electronics and Telecommunications, Politecnico di Torino, 10123, Torino, Italy.
| | | | - Elia Ricci
- Vulnology Unit, Clinica Eporediese, 10015, Ivrea, Italy
| | - Fabio Pareschi
- Department of Electronics and Telecommunications, Politecnico di Torino, 10123, Torino, Italy
| |
Collapse
|
4
|
Lyu B, Wang S, Wen S, Shi K, Yang Y, Zeng L, Huang T. AutoGMap: Learning to Map Large-Scale Sparse Graphs on Memristive Crossbars. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:12888-12898. [PMID: 37071512 DOI: 10.1109/tnnls.2023.3265383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
The sparse representation of graphs has shown great potential for accelerating the computation of graph applications (e.g., social networks and knowledge graphs) on traditional computing architectures (CPU, GPU, or TPU). But, the exploration of large-scale sparse graph computing on processing-in-memory (PIM) platforms (typically with memristive crossbars) is still in its infancy. To implement the computation or storage of large-scale or batch graphs on memristive crossbars, a natural assumption is that a large-scale crossbar is demanded, but with low utilization. Some recent works question this assumption; to avoid the waste of storage and computational resource, the fixed-size or progressively scheduled "block partition" schemes are proposed. However, these methods are coarse-grained or static and are not effectively sparsity-aware. This work proposes the dynamic sparsity-aware mapping scheme generating method that models the problem with a sequential decision-making model, and optimizes it by reinforcement learning (RL) algorithm (REINFORCE). Our generating model [long short-term memory (LSTM), combined with the dynamic-fill scheme] generates remarkable mapping performance on the small-scale graph/matrix data (complete mapping costs 43% area of the original matrix) and two large-scale matrix data (costing 22.5% area on qh882 and 17.1% area on qh1484). Our method may be extended to sparse graph computing on other PIM architectures, not limited to the memristive device-based platforms.
Collapse
|
5
|
Youn S, Lee J, Kim S, Park J, Kim K, Kim H. Programmable Threshold Logic Implementations in a Memristor Crossbar Array. NANO LETTERS 2024; 24:3581-3589. [PMID: 38471119 DOI: 10.1021/acs.nanolett.3c04073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/14/2024]
Abstract
In this study, we demonstrate the implementation of programmable threshold logics using a 32 × 32 memristor crossbar array. Thanks to forming-free characteristics obtained by the annealing process, its accurate programming characteristics are presented by a 256-level grayscale image. By simultaneous subtraction between weighted sum and threshold values with a differential pair in an opposite way, 3-input and 4-input Boolean logics are implemented in the crossbar without additional reference bias. Also, we verify a full-adder circuit and analyze its fidelity, depending on the device programming accuracy. Lastly, we successfully implement a 4-bit ripple carry adder in the crossbar and achieve reliable operations by read-based logic operations. Compared to stateful logic driven by device switching, a 4-bit ripple carry adder on a memristor crossbar array can perform more reliably in fewer steps thanks to its read-based parallel logic operation.
Collapse
Affiliation(s)
- Sangwook Youn
- Division of Materials Science and Engineering, Hanyang University, Seoul 04763, Korea
| | - Jungjin Lee
- Department of Electrical and Computer Engineering, Inha University, Incheon 22212, Korea
| | - Sungjoon Kim
- Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, Korea
| | - Jinwoo Park
- Division of Materials Science and Engineering, Hanyang University, Seoul 04763, Korea
| | - Kyuree Kim
- Division of Materials Science and Engineering, Hanyang University, Seoul 04763, Korea
| | - Hyungjin Kim
- Division of Materials Science and Engineering, Hanyang University, Seoul 04763, Korea
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea
| |
Collapse
|
6
|
Dalgaty T, Moro F, Demirağ Y, De Pra A, Indiveri G, Vianello E, Payvand M. Mosaic: in-memory computing and routing for small-world spike-based neuromorphic systems. Nat Commun 2024; 15:142. [PMID: 38167293 PMCID: PMC10761708 DOI: 10.1038/s41467-023-44365-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Accepted: 12/11/2023] [Indexed: 01/05/2024] Open
Abstract
The brain's connectivity is locally dense and globally sparse, forming a small-world graph-a principle prevalent in the evolution of various species, suggesting a universal solution for efficient information routing. However, current artificial neural network circuit architectures do not fully embrace small-world neural network models. Here, we present the neuromorphic Mosaic: a non-von Neumann systolic architecture employing distributed memristors for in-memory computing and in-memory routing, efficiently implementing small-world graph topologies for Spiking Neural Networks (SNNs). We've designed, fabricated, and experimentally demonstrated the Mosaic's building blocks, using integrated memristors with 130 nm CMOS technology. We show that thanks to enforcing locality in the connectivity, routing efficiency of Mosaic is at least one order of magnitude higher than other SNN hardware platforms. This is while Mosaic achieves a competitive accuracy in a variety of edge benchmarks. Mosaic offers a scalable approach for edge systems based on distributed spike-based computing and in-memory routing.
Collapse
Affiliation(s)
| | - Filippo Moro
- CEA, LETI, Université Grenoble Alpes, Grenoble, France
| | - Yiğit Demirağ
- Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland
| | | | - Giacomo Indiveri
- Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland
| | | | - Melika Payvand
- Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland.
| |
Collapse
|
7
|
Lai Q, Yang L. Hyperchaos of neuron under local active discrete memristor simulating electromagnetic radiation. CHAOS (WOODBURY, N.Y.) 2024; 34:013145. [PMID: 38285719 DOI: 10.1063/5.0182723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 01/02/2024] [Indexed: 01/31/2024]
Abstract
Memristor enables the coupling of magnetic flux to membrane voltage and is widely used to investigate the response characteristics of neurons to electromagnetic radiation. In this paper, a local active discrete memristor is constructed and used to study the effect of electromagnetic radiation on the dynamics of neurons. The research results demonstrate that increasing electromagnetic radiation intensity could induce hyperchaotic attractors. Furthermore, this neuron model generates hyperchaotic and three points coexistence attractors with the introduction of the memristor. A digital circuit is designed to implement the model and evaluate the randomness of its output sequence. Neuronal models exhibit a rich dynamic behavior with electrical radiation stimulation, which can provide new directions for exploring the production mechanisms of certain neurological diseases.
Collapse
Affiliation(s)
- Qiang Lai
- School of Electrical and Automation Engineering, East China Jiaotong University, Nanchang 3300113, People's Republic of China
| | - Liang Yang
- School of Electrical and Automation Engineering, East China Jiaotong University, Nanchang 3300113, People's Republic of China
| |
Collapse
|
8
|
Zhu S, Gao Y, Hou Y, Yang C. Reachable Set Estimation for Memristive Complex-Valued Neural Networks With Disturbances. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:11029-11034. [PMID: 35446773 DOI: 10.1109/tnnls.2022.3167117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
This brief focuses on reachable set estimation for memristive complex-valued neural networks (MCVNNs) with disturbances. Based on algebraic calculation and Gronwall-Bellman inequality, the states of MCVNNs with bounded input disturbances converge within a sphere. From this, the convergence speed is also obtained. In addition, an observer for MCVNNs is designed. Two illustrative simulations are also given to show the effectiveness of the obtained conclusions.
Collapse
|
9
|
R RT, Das RR, Reghuvaran C, James A. Graphene-based RRAM devices for neural computing. Front Neurosci 2023; 17:1253075. [PMID: 37886675 PMCID: PMC10598392 DOI: 10.3389/fnins.2023.1253075] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 09/13/2023] [Indexed: 10/28/2023] Open
Abstract
Resistive random access memory is very well known for its potential application in in-memory and neural computing. However, they often have different types of device-to-device and cycle-to-cycle variability. This makes it harder to build highly accurate crossbar arrays. Traditional RRAM designs make use of various filament-based oxide materials for creating a channel that is sandwiched between two electrodes to form a two-terminal structure. They are often subjected to mechanical and electrical stress over repeated read-and-write cycles. The behavior of these devices often varies in practice across wafer arrays over these stresses when fabricated. The use of emerging 2D materials is explored to improve electrical endurance, long retention time, high switching speed, and fewer power losses. This study provides an in-depth exploration of neuro-memristive computing and its potential applications, focusing specifically on the utilization of graphene and 2D materials in RRAM for neural computing. The study presents a comprehensive analysis of the structural and design aspects of graphene-based RRAM, along with a thorough examination of commercially available RRAM models and their fabrication techniques. Furthermore, the study investigates the diverse range of applications that can benefit from graphene-based RRAM devices.
Collapse
Affiliation(s)
| | | | | | - Alex James
- Digital University, Thiruvananthapuram, Kerala, India
| |
Collapse
|
10
|
Lai Q, Wan Z, Zhang H, Chen G. Design and Analysis of Multiscroll Memristive Hopfield Neural Network With Adjustable Memductance and Application to Image Encryption. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:7824-7837. [PMID: 35143405 DOI: 10.1109/tnnls.2022.3146570] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Memristor is an ideal electronic device used as an artificial nerve synapse due to its unique memory function. This article presents a design of a new Hopfield neural network (HNN) that can generate multiscroll attractors by utilizing a new memristor as a synapse in the HNN. Differing from the others, this memristor is constructed with hyperbolic tangent functions. Taking the memristor as a self-feedback synapse of a neuron in the HNN, the memristive HNN can yield multidouble-scroll attractors, and its parameters can be used to effectively control the number of double scrolls contained in an attractor. Interestingly, the generation of multidouble-scroll attractors is independent of the memductance function but depends only on the internal state equation. Thus, the memductance function can be adjusted to yield various complex dynamical behaviors. Moreover, amplitude control effects and quantitatively controllable multistability are revealed by numerical analysis. The accurate reproduction of some dynamical behaviors by a designed circuit verifies the correctness of the numerical analysis. Finally, based on the proposed memristive HNN, a novel image encryption scheme in the 3-D setting is designed and evaluated, demonstrating its good encryption performances.
Collapse
|
11
|
Yi Z, Lian J, Liu Q, Zhu H, Liang D, Liu J. Learning Rules in Spiking Neural Networks: A Survey. Neurocomputing 2023. [DOI: 10.1016/j.neucom.2023.02.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023]
|
12
|
Jyoti K, Sushma S, Yadav S, Kumar P, Pachori RB, Mukherjee S. Automatic diagnosis of COVID-19 with MCA-inspired TQWT-based classification of chest X-ray images. Comput Biol Med 2023; 152:106331. [PMID: 36502692 PMCID: PMC9683525 DOI: 10.1016/j.compbiomed.2022.106331] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 11/01/2022] [Accepted: 11/14/2022] [Indexed: 11/25/2022]
Abstract
In this era of Coronavirus disease 2019 (COVID-19), an accurate method of diagnosis with less diagnosis time and cost can effectively help in controlling the disease spread with the new variants taking birth from time to time. In order to achieve this, a two-dimensional (2D) tunable Q-wavelet transform (TQWT) based on a memristive crossbar array (MCA) is introduced in this work for the decomposition of chest X-ray images of two different datasets. TQWT has resulted in promising values of peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) at the optimum values of its parameters namely quality factor (Q) of 4, and oversampling rate (r) of 3 and at a decomposition level (J) of 2. The MCA-based model is used to process decomposed images for further classification with efficient storage. These images have been further used for the classification of COVID-19 and non-COVID-19 images using ResNet50 and AlexNet convolutional neural network (CNN) models. The average accuracy values achieved for the processed chest X-ray images classification in the small and large datasets are 98.82% and 94.64%, respectively which are higher than the reported conventional methods based on different models of deep learning techniques. The average accuracy of detection of COVID-19 via the proposed method of image classification has also been achieved with less complexity, energy, power, and area consumption along with lower cost estimation as compared to CMOS-based technology.
Collapse
Affiliation(s)
- Kumari Jyoti
- Hybrid Nanodevice Research Group (HNRG), Department of Electrical Engineering, Indian Institute of Technology Indore, Madhya Pradesh, 453552, India
| | - Sai Sushma
- Hybrid Nanodevice Research Group (HNRG), Department of Electrical Engineering, Indian Institute of Technology Indore, Madhya Pradesh, 453552, India
| | - Saurabh Yadav
- Hybrid Nanodevice Research Group (HNRG), Centre for Advanced Electronics (CAE), Indian Institute of Technology Indore, Madhya Pradesh, 453552, India
| | - Pawan Kumar
- Hybrid Nanodevice Research Group (HNRG), Department of Electrical Engineering, Indian Institute of Technology Indore, Madhya Pradesh, 453552, India
| | - Ram Bilas Pachori
- Department of Electrical Engineering, Indian Institute of Technology Indore, Madhya Pradesh, 453552, India
| | - Shaibal Mukherjee
- Hybrid Nanodevice Research Group (HNRG), Department of Electrical Engineering, Indian Institute of Technology Indore, Madhya Pradesh, 453552, India; Hybrid Nanodevice Research Group (HNRG), Centre for Advanced Electronics (CAE), Indian Institute of Technology Indore, Madhya Pradesh, 453552, India; Centre for Rural Development and Technology (CRDT), Indian Institute of Technology Indore, Madhya Pradesh, 453552, India; School of Engineering, RMIT University, Melbourne, Victoria, 3001, Australia.
| |
Collapse
|
13
|
Delay-dependent and Order-dependent Conditions for Stability and Stabilization of Fractional-order Memristive Neural Networks with Time-varying Delays. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.12.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
14
|
Zhang XW, Wu HN, Wang JL, Liu Z, Li R. Membership-Function-Dependent Fuzzy Control of Reaction-Diffusion Memristive Neural Networks With a Finite Number of Actuators and Sensors. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.09.126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
15
|
Review on the Basic Circuit Elements and Memristor Interpretation: Analysis, Technology and Applications. JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS 2022. [DOI: 10.3390/jlpea12030044] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Circuit or electronic components are useful elements allowing the realization of different circuit functionalities. The resistor, capacitor and inductor represent the three commonly known basic passive circuit elements owing to their fundamental nature relating them to the four circuit variables, namely voltage, magnetic flux, current and electric charge. The memory resistor (or memristor) was claimed to be the fourth basic passive circuit element, complementing the resistor, capacitor and inductor. This paper presents a review on the four basic passive circuit elements. After a brief recall on the first three known basic passive circuit elements, a thorough description of the memristor follows. Memristor sparks interest in the scientific community due to its interesting features, for example nano-scalability, memory capability, conductance modulation, connection flexibility and compatibility with CMOS technology, etc. These features among many others are currently in high demand on an industrial scale. For this reason, thousands of memristor-based applications are reported. Hence, the paper presents an in-depth overview of the philosophical argumentations of memristor, technologies and applications.
Collapse
|
16
|
|
17
|
Discrete-Time Memristor Model for Enhancing Chaotic Complexity and Application in Secure Communication. ENTROPY 2022; 24:e24070864. [PMID: 35885087 PMCID: PMC9316279 DOI: 10.3390/e24070864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Revised: 05/28/2022] [Accepted: 06/20/2022] [Indexed: 02/01/2023]
Abstract
The physical implementation of the continuous-time memristor makes it widely used in chaotic circuits, whereas the discrete-time memristor has not received much attention. In this paper, the backward-Euler method is used to discretize the TiO2 memristor model, and the discretized model also meets the three fingerprints characteristics of the generalized memristor. The short period phenomenon and uneven output distribution of one-dimensional chaotic systems affect their applications in some fields, so it is necessary to improve the dynamic characteristics of one-dimensional chaotic systems. In this paper, a two-dimensional discrete-time memristor model is obtained by linear coupling of the proposed TiO2 memristor model and one-dimensional chaotic systems. Since the two-dimensional model has infinite fixed points, the stability of these fixed points depends on the coupling parameters and the initial state of the discrete TiO2 memristor model. Furthermore, the dynamic characteristics of one-dimensional chaotic systems can be enhanced by the proposed method. Finally, we apply the generated chaotic sequence to secure communication.
Collapse
|
18
|
Gu Y, Wang H, Yu Y. Stability and synchronization of fractional-order generalized reaction–diffusion neural networks with multiple time delays and parameter mismatch. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07414-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
19
|
Li J, Xu H, Sun SY, Li N, Li Q, Li Z, Liu H. In Situ Learning in Hardware Compatible Multilayer Memristive Spiking Neural Network. IEEE Trans Cogn Dev Syst 2022. [DOI: 10.1109/tcds.2021.3049487] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Affiliation(s)
- Jiwei Li
- College of Electronic Science and Technology, National University of Defense Technology, Changsha~, China
| | - Hui Xu
- College of Electronic Science and Technology, National University of Defense Technology, Changsha~, China
| | - Sheng-Yang Sun
- College of Electronic Science and Technology, National University of Defense Technology, Changsha~, China
| | - Nan Li
- College of Electronic Science and Technology, National University of Defense Technology, Changsha~, China
| | - Qingjiang Li
- College of Electronic Science and Technology, National University of Defense Technology, Changsha~, China
| | - Zhiwei Li
- College of Electronic Science and Technology, National University of Defense Technology, Changsha~, China
| | - Haijun Liu
- College of Electronic Science and Technology, National University of Defense Technology, Changsha~, China
| |
Collapse
|
20
|
Wang L, Zhang CK. Exponential Synchronization of Memristor-Based Competitive Neural Networks With Reaction-Diffusions and Infinite Distributed Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; PP:745-758. [PMID: 35622804 DOI: 10.1109/tnnls.2022.3176887] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Taking into account the infinite distributed delays and reaction-diffusions, this article investigates the global exponential synchronization problem of a class of memristor-based competitive neural networks (MCNNs) with different time scales. Based on the Lyapunov-Krasovskii functional and inequality approach, an adaptive control approach is proposed to ensure the exponential synchronization of the addressed drive-response networks. The closed-loop system is a discontinuous and delayed partial differential system in a cascade form, involving the spatial diffusion, the infinite distributed delays, the parametric adaptive law, the state-dependent switching parameters, and the variable structure controllers. By combining the theories of nonsmooth analysis, partial differential equation (PDE) and adaptive control, we present a new analytical method for rigorously deriving the synchronization of the states of the complex system. The derived m-norm (m ≥ 2)-based synchronization criteria are easily verified and the theoretical results are easily extended to memristor-based neural networks (NNs) without different time scales and reaction-diffusions. Finally, numerical simulations are presented to verify the effectiveness of the theoretical results.
Collapse
|
21
|
Lin WJ, He Y, Zhang CK, Wang L, Wu M. Event-Triggered Fault Detection Filter Design for Discrete-Time Memristive Neural Networks With Time Delays. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:3359-3369. [PMID: 32784148 DOI: 10.1109/tcyb.2020.3011527] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In this article, the fault detection (FD) filter design problem is addressed for discrete-time memristive neural networks with time delays. When constructing the system model, an event-triggered communication mechanism is investigated to reduce the communication burden and a fault weighting matrix function is adopted to improve the accuracy of the FD filter. Then, based on the Lyapunov functional theory, an augmented Lyapunov functional is constructed. By utilizing the summation inequality approach and the improved reciprocally convex combination method, an FD filter that guarantees the asymptotic stability and the prescribed H∞ performance level of the residual system is designed. Finally, numerical simulations are provided to illustrate the effectiveness of the presented results.
Collapse
|
22
|
Yao W, Yu F, Zhang J, Zhou L. Asymptotic Synchronization of Memristive Cohen-Grossberg Neural Networks with Time-Varying Delays via Event-Triggered Control Scheme. MICROMACHINES 2022; 13:mi13050726. [PMID: 35630193 PMCID: PMC9147740 DOI: 10.3390/mi13050726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2021] [Revised: 04/26/2022] [Accepted: 04/28/2022] [Indexed: 11/17/2022]
Abstract
This paper investigates the asymptotic synchronization of memristive Cohen-Grossberg neural networks (MCGNNs) with time-varying delays under event-triggered control (ETC). First, based on the designed feedback controller, some ETC conditions are provided. It is demonstrated that ETC can significantly reduce the update times of the controller and decrease the computing cost. Next, some sufficient conditions are derived to ensure the asymptotic synchronization of MCGNNs with time-varying delays under the ETC method. Finally, a numerical example is provided to verify the correctness and effectiveness of the obtained results.
Collapse
Affiliation(s)
- Wei Yao
- School of Computer and Communication Engineering, Changsha University of Science & Technology, Changsha 410114, China; (W.Y.); (F.Y.)
| | - Fei Yu
- School of Computer and Communication Engineering, Changsha University of Science & Technology, Changsha 410114, China; (W.Y.); (F.Y.)
| | - Jin Zhang
- School of Computer and Communication Engineering, Changsha University of Science & Technology, Changsha 410114, China; (W.Y.); (F.Y.)
- Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou 310058, China
- Correspondence: (J.Z.); (L.Z.)
| | - Ling Zhou
- School of Intelligent Manufacturing, Hunan University of Science and Engineering, Yongzhou 425199, China
- Correspondence: (J.Z.); (L.Z.)
| |
Collapse
|
23
|
Suresh R, Syed Ali M, Saroha S. Global exponential stability of memristor based uncertain neural networks with time-varying delays via Lagrange sense. J EXP THEOR ARTIF IN 2022. [DOI: 10.1080/0952813x.2021.1960632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- R. Suresh
- Department of Mathematics, Sri Venkateswara College of Engineering, Sriperumbudur, India
| | - M. Syed Ali
- Department of Mathematics, Thiruvalluvar University, Vellore, India
| | - Sumit Saroha
- Department of Electrical Engineering, Guru Jambheswar University of Science and Technology, Hisar, India
| |
Collapse
|
24
|
A New Memristive Neuron Map Model and Its Network’s Dynamics under Electrochemical Coupling. ELECTRONICS 2022. [DOI: 10.3390/electronics11010153] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
A memristor is a vital circuit element that can mimic biological synapses. This paper proposes the memristive version of a recently proposed map neuron model based on the phase space. The dynamic of the memristive map model is investigated by using bifurcation and Lyapunov exponents’ diagrams. The results prove that the memristive map can present different behaviors such as spiking, periodic bursting, and chaotic bursting. Then, a ring network is constructed by hybrid electrical and chemical synapses, and the memristive neuron models are used to describe the nodes. The collective behavior of the network is studied. It is observed that chemical coupling plays a crucial role in synchronization. Different kinds of synchronization, such as imperfect synchronization, complete synchronization, solitary state, two-cluster synchronization, chimera, and nonstationary chimera, are identified by varying the coupling strengths.
Collapse
|
25
|
Lag projective synchronization of nonidentical fractional delayed memristive neural networks. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2021.10.061] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
26
|
Camps O, Al Chawa MM, Stavrinides SG, Picos R. Stochastic Computing Emulation of Memristor Cellular Nonlinear Networks. MICROMACHINES 2021; 13:mi13010067. [PMID: 35056232 PMCID: PMC8779373 DOI: 10.3390/mi13010067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 12/21/2021] [Accepted: 12/27/2021] [Indexed: 11/16/2022]
Abstract
Cellular Nonlinear Networks (CNN) are a concept introduced in 1988 by Leon Chua and Lin Yang as a bio-inspired architecture capable of massively parallel computation. Since then, CNN have been enhanced by incorporating designs that incorporate memristors to profit from their processing and memory capabilities. In addition, Stochastic Computing (SC) can be used to optimize the quantity of required processing elements; thus it provides a lightweight approximate computing framework, quite accurate and effective, however. In this work, we propose utilization of SC in designing and implementing a memristor-based CNN. As a proof of the proposed concept, an example of application is presented. This application combines Matlab and a FPGA in order to create the CNN. The implemented CNN was then used to perform three different real-time applications on a 512 × 512 gray-scale and a 768 × 512 color image: storage of the image, edge detection, and image sharpening. It has to be pointed out that the same CNN was used for the three different tasks, with the sole change of some programmable parameters. Results show an excellent capability with significant accompanying advantages, such as the low number of needed elements further allowing for a low cost FPGA-based system implementation, something confirming the system's capacity for real time operation.
Collapse
Affiliation(s)
- Oscar Camps
- Industrial Engineering and Construction Department, University of Balearic Islands, 07122 Palma Mallorca, Spain;
| | - Mohamad Moner Al Chawa
- Institute of Circuits and Systems, Technical University of Dresden, 01062 Dresden, Germany;
| | - Stavros G. Stavrinides
- School of Science and Technology, International Hellenic University, 57006 Thessaloniki, Greece;
| | - Rodrigo Picos
- Industrial Engineering and Construction Department, University of Balearic Islands, 07122 Palma Mallorca, Spain;
- Health Institute of the Balearic Islands (IDISBA), 07120 Palma Mallorca, Spain
- Correspondence:
| |
Collapse
|
27
|
Wu A, Chen Y, Zeng Z. Multi-mode function synchronization of memristive neural networks with mixed delays and parameters mismatch via event-triggered control. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2021.04.101] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
28
|
Zhang L, Hu X, Zhou Y, Zhou G, Duan S. Memristive DeepLab: A hardware friendly deep CNN for semantic segmentation. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.04.061] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
29
|
Tang Z, Zhu R, Hu R, Chen Y, Wu EQ, Wang H, He J, Huang Q, Chang S. A Multilayer Neural Network Merging Image Preprocessing and Pattern Recognition by Integrating Diffusion and Drift Memristors. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2020.3003377] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
30
|
Sheng Y, Huang T, Zeng Z, Miao X. Global Exponential Stability of Memristive Neural Networks With Mixed Time-Varying Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:3690-3699. [PMID: 32857700 DOI: 10.1109/tnnls.2020.3015944] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This article investigates the Lagrange exponential stability and the Lyapunov exponential stability of memristive neural networks with discrete and distributed time-varying delays (DMNNs). By means of inequality techniques, theories of the M-matrix, and the comparison strategy, the Lagrange exponential stability of the underlying DMNNs is considered in the sense of Filippov, and the globally exponentially attractive set is estimated through employing the M-matrix and external input. Especially, when the external input is not concerned, the Lyapunov exponential stability of the corresponding DMNNs is developed immediately in the form of an M-matrix, which contains some published outcomes as special cases. Furthermore, by constructing an M-matrix-based differential system, the Lyapunov exponential stability of the DMNNs is studied, which is less conservative than some existing ones. Finally, three simulation examples are carried out to examine the validness of the theories.
Collapse
|
31
|
Lv X, Cao J, Rutkowski L. Dynamical and static multisynchronization analysis for coupled multistable memristive neural networks with hybrid control. Neural Netw 2021; 143:515-524. [PMID: 34284298 DOI: 10.1016/j.neunet.2021.07.004] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2020] [Revised: 05/15/2021] [Accepted: 07/04/2021] [Indexed: 11/16/2022]
Abstract
This paper investigates the dynamical multisynchronization (DMS) and static multisynchronization (SMS) problems for a class of delayed coupled multistable memristive neural networks (DCMMNNs) via a novel hybrid controller which includes delayed impulsive control and state feedback control. Based on the state-space partition method and the geometrical properties of the activation function, each subnetwork has multiple locally exponential stable equilibrium states. By employing a new Halanay-type inequality and the impulsive control theory, some new linear matrix inequalities (LMIs)-based sufficient conditions are proposed. It is shown that the delayed impulsive control with suitable impulsive interval and allowable time-varying delay can still guarantee the DMS and SMS of DCMMNNs. Finally, a numerical example is presented to illustrate the effectiveness of the hybrid controller.
Collapse
Affiliation(s)
- Xiaoxiao Lv
- School of Mathematics, Research Center for Complex Systems and Network Sciences, Southeast University, Nanjing 211189, PR China
| | - Jinde Cao
- School of Mathematics, Research Center for Complex Systems and Network Sciences, Southeast University, Nanjing 211189, PR China; Yonsei Frontier Lab, Yonsei University, Seoul 03722, South Korea.
| | - Leszek Rutkowski
- Institute of Computational Intelligence, Czestochowa University of Technology, 42-200 Czestochowa, Poland; Information Technology Institute, Academy of Social Sciences, 90-113, Łódź, Poland
| |
Collapse
|
32
|
Ascoli A, Tetzlaff R, Kang SMS, Chua L. System-Theoretic Methods for Designing Bio-Inspired Mem-Computing Memristor Cellular Nonlinear Networks. FRONTIERS IN NANOTECHNOLOGY 2021. [DOI: 10.3389/fnano.2021.633026] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
The introduction of nano-memristors in electronics may allow to boost the performance of integrated circuits beyond the Moore era, especially in view of their extraordinary capability to process and store data in the very same physical volume. However, recurring to nonlinear system theory is absolutely necessary for the development of a systematic approach to memristive circuit design. In fact, the application of linear system-theoretic techniques is not suitable to explore thoroughly the rich dynamics of resistance switching memories, and designing circuits without a comprehensive picture of the nonlinear behaviour of these devices may lead to the realization of technical systems failing to operate as desired. Converting traditional circuits to memristive equivalents may require the adaptation of classical methods from nonlinear system theory. This paper extends the theory of time- and space-invariant standard cellular nonlinear networks with first-order processing elements for the case where a single non-volatile memristor is inserted in parallel to the capacitor in each cell. A novel nonlinear system-theoretic method allows to draw a comprehensive picture of the dynamical phenomena emerging in the memristive mem-computing array, beautifully illustrated in the so-called Primary Mosaic for the class of uncoupled memristor cellular nonlinear networks. Employing this new analysis tool it is possible to elucidate, with the support of illustrative examples, how to design variability-tolerant bio-inspired cellular nonlinear networks with second-order memristive cells for the execution of computing tasks or of memory operations. The capability of the class of memristor cellular nonlinear networks under focus to store and process information locally, without the need to insert additional memory units in each cell, may allow to increase considerably the spatial resolution of state-of-the-art purely CMOS sensor-processor arrays. This is of great appeal for edge computing applications, especially since the Internet-of-Things industry is currently calling for the realization of miniaturized, lightweight, low-power, and high-speed mem-computers with sensing capability on board.
Collapse
|
33
|
Covi E, Donati E, Liang X, Kappel D, Heidari H, Payvand M, Wang W. Adaptive Extreme Edge Computing for Wearable Devices. Front Neurosci 2021; 15:611300. [PMID: 34045939 PMCID: PMC8144334 DOI: 10.3389/fnins.2021.611300] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Accepted: 03/24/2021] [Indexed: 11/13/2022] Open
Abstract
Wearable devices are a fast-growing technology with impact on personal healthcare for both society and economy. Due to the widespread of sensors in pervasive and distributed networks, power consumption, processing speed, and system adaptation are vital in future smart wearable devices. The visioning and forecasting of how to bring computation to the edge in smart sensors have already begun, with an aspiration to provide adaptive extreme edge computing. Here, we provide a holistic view of hardware and theoretical solutions toward smart wearable devices that can provide guidance to research in this pervasive computing era. We propose various solutions for biologically plausible models for continual learning in neuromorphic computing technologies for wearable sensors. To envision this concept, we provide a systematic outline in which prospective low power and low latency scenarios of wearable sensors in neuromorphic platforms are expected. We successively describe vital potential landscapes of neuromorphic processors exploiting complementary metal-oxide semiconductors (CMOS) and emerging memory technologies (e.g., memristive devices). Furthermore, we evaluate the requirements for edge computing within wearable devices in terms of footprint, power consumption, latency, and data size. We additionally investigate the challenges beyond neuromorphic computing hardware, algorithms and devices that could impede enhancement of adaptive edge computing in smart wearable devices.
Collapse
Affiliation(s)
| | - Elisa Donati
- Institute of Neuroinformatics, University of Zurich, Eidgenössische Technische Hochschule Zürich (ETHZ), Zurich, Switzerland
| | - Xiangpeng Liang
- Microelectronics Lab, James Watt School of Engineering, University of Glasgow, Glasgow, United Kingdom
| | - David Kappel
- Bernstein Center for Computational Neuroscience, III Physikalisches Institut–Biophysik, Georg-August Universität, Göttingen, Germany
| | - Hadi Heidari
- Microelectronics Lab, James Watt School of Engineering, University of Glasgow, Glasgow, United Kingdom
| | - Melika Payvand
- Institute of Neuroinformatics, University of Zurich, Eidgenössische Technische Hochschule Zürich (ETHZ), Zurich, Switzerland
| | - Wei Wang
- The Andrew and Erna Viterbi Department of Electrical Engineering, Technion–Israel Institute of Technology, Haifa, Israel
| |
Collapse
|
34
|
Abstract
The rapid development of artificial intelligence (AI), big data analytics, cloud computing, and Internet of Things applications expect the emerging memristor devices and their hardware systems to solve massive data calculation with low power consumption and small chip area. This paper provides an overview of memristor device characteristics, models, synapse circuits, and neural network applications, especially for artificial neural networks and spiking neural networks. It also provides research summaries, comparisons, limitations, challenges, and future work opportunities.
Collapse
|
35
|
Dynamic Analysis of the Switched-Inductor Buck-Boost Converter Based on the Memristor. ELECTRONICS 2021. [DOI: 10.3390/electronics10040452] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The direct current (DC)–DC converter presents abundant nonlinear phenomena, such as periodic bifurcation and chaotic motion, under certain conditions. For a switched-inductor buck-boost (SIBB) converter with the memristive load, this paper constructs its state equation model under two operating statuses, investigates its chaotic dynamic characteristics, and draws and analyzes the bifurcation diagrams of the inductive current and phase portraits, under some parameter changing by the MATLAB simulation based on the state equation. Then, by applying certain minor perturbations to parameters, the chaotic phenomenon suppression method is explored by controlling peak current in continuous current mode (CCM) to keep the converter run normally. Finally, the power simulation (PSIM) verifies that the waveforms and the phase portraits controlling the corresponding parameters are consistent with those of the MATLAB simulation.
Collapse
|
36
|
|
37
|
Rajchakit G, Chanthorn P, Niezabitowski M, Raja R, Baleanu D, Pratap A. Impulsive effects on stability and passivity analysis of memristor-based fractional-order competitive neural networks. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.07.036] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
38
|
Wang W, Song W, Yao P, Li Y, Van Nostrand J, Qiu Q, Ielmini D, Yang JJ. Integration and Co-design of Memristive Devices and Algorithms for Artificial Intelligence. iScience 2020; 23:101809. [PMID: 33305176 PMCID: PMC7718163 DOI: 10.1016/j.isci.2020.101809] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Memristive devices share remarkable similarities to biological synapses, dendrites, and neurons at both the physical mechanism level and unit functionality level, making the memristive approach to neuromorphic computing a promising technology for future artificial intelligence. However, these similarities do not directly transfer to the success of efficient computation without device and algorithm co-designs and optimizations. Contemporary deep learning algorithms demand the memristive artificial synapses to ideally possess analog weighting and linear weight-update behavior, requiring substantial device-level and circuit-level optimization. Such co-design and optimization have been the main focus of memristive neuromorphic engineering, which often abandons the “non-ideal” behaviors of memristive devices, although many of them resemble what have been observed in biological components. Novel brain-inspired algorithms are being proposed to utilize such behaviors as unique features to further enhance the efficiency and intelligence of neuromorphic computing, which calls for collaborations among electrical engineers, computing scientists, and neuroscientists.
Collapse
Affiliation(s)
- Wei Wang
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano and IU.NET, Piazza L. da Vinci 32, Milano 20133, Italy
| | - Wenhao Song
- Electrical and Computer Engineering Department, University of Southern California, Los Angeles, CA, USA
| | - Peng Yao
- Electrical and Computer Engineering Department, University of Southern California, Los Angeles, CA, USA
| | - Yang Li
- The Andrew and Erna Viterbi Department of Electrical Engineering, Technion-Israel Institute of Technology, Haifa 32000, Israel
| | | | - Qinru Qiu
- Electrical Engineering and Computer Science Department, Syracuse University, NY, USA
| | - Daniele Ielmini
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano and IU.NET, Piazza L. da Vinci 32, Milano 20133, Italy
| | - J Joshua Yang
- Electrical and Computer Engineering Department, University of Southern California, Los Angeles, CA, USA
| |
Collapse
|
39
|
|
40
|
Wang L, He H, Zeng Z, Hu C. Global Stabilization of Fuzzy Memristor-Based Reaction-Diffusion Neural Networks. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:4658-4669. [PMID: 31725407 DOI: 10.1109/tcyb.2019.2949468] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This article investigates the global stabilization problem of Takagi-Sugeno fuzzy memristor-based neural networks with reaction-diffusion terms and distributed time-varying delays. By using the Green formula and proposing fuzzy feedback controllers, several algebraic criteria dependent on the diffusion coefficients are established to guarantee the global exponential stability of the addressed networks. Moreover, a simpler stability criterion is obtained by designing an adaptive fuzzy controller. The results derived in this article are generalized and include some existing ones as special cases. Finally, the validity of the theoretical results is verified by two examples.
Collapse
|
41
|
Zhu S, Wang L, Dong Z, Duan S. Convolution Kernel Operations on a Two-Dimensional Spin Memristor Cross Array. SENSORS 2020; 20:s20216229. [PMID: 33142866 PMCID: PMC7662316 DOI: 10.3390/s20216229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Revised: 10/28/2020] [Accepted: 10/29/2020] [Indexed: 11/16/2022]
Abstract
In recent years, convolution operations often consume a lot of time and energy in deep learning algorithms, and convolution is usually used to remove noise or extract the edges of an image. However, under data-intensive conditions, frequent operations of the above algorithms will cause a significant memory/communication burden to the computing system. This paper proposes a circuit based on spin memristor cross array to solve the problems mentioned above. First, a logic switch based on spin memristors is proposed, which realizes the control of the memristor cross array. Secondly, a new type of spin memristor cross array and peripheral circuits is proposed, which realizes the multiplication and addition operation in the convolution operation and significantly alleviates the computational memory bottleneck. At last, the color image filtering and edge extraction simulation are carried out. By calculating the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) of the image result, the processing effects of different operators are compared, and the correctness of the circuit is verified.
Collapse
Affiliation(s)
- Saike Zhu
- School of Electronic Information Engineering, Southwest University, Chongqing 400715, China; (S.Z.); (S.D.)
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China
| | - Lidan Wang
- School of Electronic Information Engineering, Southwest University, Chongqing 400715, China; (S.Z.); (S.D.)
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China
- Correspondence:
| | - Zhekang Dong
- School of Electronic Information, Hangzhou Dianzi University, Hangzhou 310018, China;
| | - Shukai Duan
- School of Electronic Information Engineering, Southwest University, Chongqing 400715, China; (S.Z.); (S.D.)
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China
| |
Collapse
|
42
|
Yao W, Wang C, Sun Y, Zhou C, Lin H. Synchronization of inertial memristive neural networks with time-varying delays via static or dynamic event-triggered control. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.04.099] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
43
|
Tang Z, Chen Y, Ye S, Hu R, Wang H, He J, Huang Q, Chang S. Fully memristive spiking-neuron learning framework and its applications on pattern recognition and edge detection. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.04.012] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
|
44
|
Sheng Y, Lewis FL, Zeng Z, Huang T. Lagrange Stability and Finite-Time Stabilization of Fuzzy Memristive Neural Networks With Hybrid Time-Varying Delays. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:2959-2970. [PMID: 31059467 DOI: 10.1109/tcyb.2019.2912890] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
This paper focuses on Lagrange exponential stability and finite-time stabilization of Takagi-Sugeno (T-S) fuzzy memristive neural networks with discrete and distributed time-varying delays (DFMNNs). By resorting to theories of differential inclusions and the comparison strategy, an algebraic condition is developed to confirm Lagrange exponential stability of the underlying DFMNNs in Filippov's sense, and the exponentially attractive set is estimated. When external input is not considered, global exponential stability of DFMNNs is derived directly, which includes some existing ones as special cases. Furthermore, finite-time stabilization of the addressed DFMNNs is analyzed by exploiting inequality techniques and the comparison approach via designing a nonlinear state feedback controller. The boundedness assumption of activation functions is removed herein. Finally, two simulations are presented to demonstrate the validness of the outcomes, and an application is performed in pseudorandom number generation.
Collapse
|
45
|
Stochastic Memristive Quaternion-Valued Neural Networks with Time Delays: An Analysis on Mean Square Exponential Input-to-State Stability. MATHEMATICS 2020. [DOI: 10.3390/math8050815] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In this paper, we study the mean-square exponential input-to-state stability (exp-ISS) problem for a new class of neural network (NN) models, i.e., continuous-time stochastic memristive quaternion-valued neural networks (SMQVNNs) with time delays. Firstly, in order to overcome the difficulties posed by non-commutative quaternion multiplication, we decompose the original SMQVNNs into four real-valued models. Secondly, by constructing suitable Lyapunov functional and applying It o ^ ’s formula, Dynkin’s formula as well as inequity techniques, we prove that the considered system model is mean-square exp-ISS. In comparison with the conventional research on stability, we derive a new mean-square exp-ISS criterion for SMQVNNs. The results obtained in this paper are the general case of previously known results in complex and real fields. Finally, a numerical example has been provided to show the effectiveness of the obtained theoretical results.
Collapse
|
46
|
Liu H, Ma L, Wang Z, Liu Y, Alsaadi FE. An overview of stability analysis and state estimation for memristive neural networks. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.01.066] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
47
|
Global Mittag–Leffler Stability and Stabilization Analysis of Fractional-Order Quaternion-Valued Memristive Neural Networks. MATHEMATICS 2020. [DOI: 10.3390/math8030422] [Citation(s) in RCA: 42] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This paper studies the global Mittag–Leffler stability and stabilization analysis of fractional-order quaternion-valued memristive neural networks (FOQVMNNs). The state feedback stabilizing control law is designed in order to stabilize the considered problem. Based on the non-commutativity of quaternion multiplication, the original fractional-order quaternion-valued systems is divided into four fractional-order real-valued systems. By using the method of Lyapunov fractional-order derivative, fractional-order differential inclusions, set-valued maps, several global Mittag–Leffler stability and stabilization conditions of considered FOQVMNNs are established. Two numerical examples are provided to illustrate the usefulness of our analytical results.
Collapse
|
48
|
Wang X, Park JH, Zhong S, Yang H. A Switched Operation Approach to Sampled-Data Control Stabilization of Fuzzy Memristive Neural Networks With Time-Varying Delay. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2020; 31:891-900. [PMID: 31059457 DOI: 10.1109/tnnls.2019.2910574] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
This paper investigates the issue of sampled-data stabilization for Takagi-Sugeno fuzzy memristive neural networks (FMNNs) with time-varying delay. First, the concerned FMNNs are transformed into the tractable fuzzy NNs based on the excitatory and inhibitory of memristive synaptic weights using a new convex combination technique. Meanwhile, a switched fuzzy sampled-data controller is employed for the first time to tackle stability problems related to FMNNs. Then, the novel stabilization criteria of the FMNNs are established using the fuzzy membership functions (FMFs)-dependent Lyapunov-Krasovskii functional. This sufficiently utilizes information from not only the delayed state and the actual sampling pattern but also the FMFs. Two simulation examples are presented to demonstrate the feasibility and validity of the proposed method.
Collapse
|
49
|
Guo Z, Ou S, Wang J. Multistability of switched neural networks with sigmoidal activation functions under state-dependent switching. Neural Netw 2020; 122:239-252. [DOI: 10.1016/j.neunet.2019.10.012] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2019] [Revised: 09/04/2019] [Accepted: 10/17/2019] [Indexed: 11/12/2022]
|
50
|
Krestinskaya O, James AP, Chua LO. Neuromemristive Circuits for Edge Computing: A Review. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2020; 31:4-23. [PMID: 30892238 DOI: 10.1109/tnnls.2019.2899262] [Citation(s) in RCA: 52] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
The volume, veracity, variability, and velocity of data produced from the ever increasing network of sensors connected to Internet pose challenges for power management, scalability, and sustainability of cloud computing infrastructure. Increasing the data processing capability of edge computing devices at lower power requirements can reduce several overheads for cloud computing solutions. This paper provides the review of neuromorphic CMOS-memristive architectures that can be integrated into edge computing devices. We discuss why the neuromorphic architectures are useful for edge devices and show the advantages, drawbacks, and open problems in the field of neuromemristive circuits for edge computing.
Collapse
|