1
|
Carbajal JP, Martin DA, Chialvo DR. Learning by mistakes in memristor networks. Phys Rev E 2022; 105:054306. [PMID: 35706169 DOI: 10.1103/physreve.105.054306] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 04/20/2022] [Indexed: 06/15/2023]
Abstract
Recent results revived the interest in the implementation of analog devices able to perform brainlike operations. Here we introduce a training algorithm for a memristor network which is inspired by previous work on biological learning. Robust results are obtained from computer simulations of a network of voltage-controlled memristive devices. Its implementation in hardware is straightforward, being scalable and requiring very little peripheral computation overhead.
Collapse
Affiliation(s)
- Juan Pablo Carbajal
- Institute for Energy Technology, University of Applied Sciences of Eastern Switzerland, Oberseestrasse 10, 8640 Rapperswil, Switzerland
| | - Daniel A Martin
- Center for Complex Systems and Brain Sciences (CEMSC3) and Instituto de Ciencias Físicas, CONICET, Escuela de Ciencia y Tecnología, Universidad Nacional de General San Martín, Campus Miguelete, CP 1650, 25 de Mayo y Francia, San Martín, Buenos Aires, Argentina
| | - Dante R Chialvo
- Center for Complex Systems and Brain Sciences (CEMSC3) and Instituto de Ciencias Físicas, CONICET, Escuela de Ciencia y Tecnología, Universidad Nacional de General San Martín, Campus Miguelete, CP 1650, 25 de Mayo y Francia, San Martín, Buenos Aires, Argentina
| |
Collapse
|
2
|
Caravelli F, Sheldon FC, Traversa FL. Global minimization via classical tunneling assisted by collective force field formation. SCIENCE ADVANCES 2021; 7:eabh1542. [PMID: 34936465 PMCID: PMC8694608 DOI: 10.1126/sciadv.abh1542] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Accepted: 11/05/2021] [Indexed: 06/14/2023]
Abstract
Simple elements interacting in networks can give rise to intricate emergent behaviors. Examples such as synchronization and phase transitions often apply in many contexts, as many different systems may reduce to the same effective model. Here, we demonstrate such a behavior in a model inspired by memristors. When weakly driven, the system is described by movement in an effective potential, but when strongly driven, instabilities cause escapes from local minima, which can be interpreted as an unstable tunneling mechanism. We dub this collective and nonperturbative effect a “Lyapunov force,” which steers the system toward the global minimum of the potential function, even if the full system has a constellation of equilibrium points growing exponentially with the system size. This mechanism is appealing for its physical relevance in nanoscale physics and for its possible applications in optimization, Monte Carlo schemes, and machine learning.
Collapse
Affiliation(s)
- Francesco Caravelli
- Theoretical Division (T4), Los Alamos National Laboratory, Los Alamos, NM 87545, USA
| | - Forrest C. Sheldon
- Theoretical Division (T4), Los Alamos National Laboratory, Los Alamos, NM 87545, USA
- Center for Nonlinear Studies, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
- London Institute for Mathematical Sciences, 35a South St., London W1K 2XF, UK
| | | |
Collapse
|
3
|
Hochstetter J, Zhu R, Loeffler A, Diaz-Alvarez A, Nakayama T, Kuncic Z. Avalanches and edge-of-chaos learning in neuromorphic nanowire networks. Nat Commun 2021; 12:4008. [PMID: 34188085 PMCID: PMC8242064 DOI: 10.1038/s41467-021-24260-z] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 06/10/2021] [Indexed: 02/06/2023] Open
Abstract
The brain's efficient information processing is enabled by the interplay between its neuro-synaptic elements and complex network structure. This work reports on the neuromorphic dynamics of nanowire networks (NWNs), a unique brain-inspired system with synapse-like memristive junctions embedded within a recurrent neural network-like structure. Simulation and experiment elucidate how collective memristive switching gives rise to long-range transport pathways, drastically altering the network's global state via a discontinuous phase transition. The spatio-temporal properties of switching dynamics are found to be consistent with avalanches displaying power-law size and life-time distributions, with exponents obeying the crackling noise relationship, thus satisfying criteria for criticality, as observed in cortical neuronal cultures. Furthermore, NWNs adaptively respond to time varying stimuli, exhibiting diverse dynamics tunable from order to chaos. Dynamical states at the edge-of-chaos are found to optimise information processing for increasingly complex learning tasks. Overall, these results reveal a rich repertoire of emergent, collective neural-like dynamics in NWNs, thus demonstrating the potential for a neuromorphic advantage in information processing.
Collapse
Affiliation(s)
- Joel Hochstetter
- School of Physics, University of Sydney, Sydney, NSW, Australia.
| | - Ruomin Zhu
- School of Physics, University of Sydney, Sydney, NSW, Australia
| | - Alon Loeffler
- School of Physics, University of Sydney, Sydney, NSW, Australia
| | - Adrian Diaz-Alvarez
- International Center for Materials Nanoarchitectonics (WPI-MANA), National Institute for Materials Science (NIMS), Tsukuba, Ibaraki, Japan
| | - Tomonobu Nakayama
- School of Physics, University of Sydney, Sydney, NSW, Australia
- International Center for Materials Nanoarchitectonics (WPI-MANA), National Institute for Materials Science (NIMS), Tsukuba, Ibaraki, Japan
- Graduate School of Pure and Applied Sciences, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Zdenka Kuncic
- School of Physics, University of Sydney, Sydney, NSW, Australia.
- International Center for Materials Nanoarchitectonics (WPI-MANA), National Institute for Materials Science (NIMS), Tsukuba, Ibaraki, Japan.
- The University of Sydney Nano Institute, Sydney, NSW, Australia.
| |
Collapse
|
4
|
Caravelli F. Asymptotic Behavior of Memristive Circuits. ENTROPY 2019; 21:e21080789. [PMID: 33267502 PMCID: PMC7515318 DOI: 10.3390/e21080789] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Revised: 08/02/2019] [Accepted: 08/06/2019] [Indexed: 11/16/2022]
Abstract
The interest in memristors has risen due to their possible application both as memory units and as computational devices in combination with CMOS. This is in part due to their nonlinear dynamics, and a strong dependence on the circuit topology. We provide evidence that also purely memristive circuits can be employed for computational purposes. In the present paper we show that a polynomial Lyapunov function in the memory parameters exists for the case of DC controlled memristors. Such a Lyapunov function can be asymptotically approximated with binary variables, and mapped to quadratic combinatorial optimization problems. This also shows a direct parallel between memristive circuits and the Hopfield-Little model. In the case of Erdos-Renyi random circuits, we show numerically that the distribution of the matrix elements of the projectors can be roughly approximated with a Gaussian distribution, and that it scales with the inverse square root of the number of elements. This provides an approximated but direct connection with the physics of disordered system and, in particular, of mean field spin glasses. Using this and the fact that the interaction is controlled by a projector operator on the loop space of the circuit. We estimate the number of stationary points of the approximate Lyapunov function and provide a scaling formula as an upper bound in terms of the circuit topology only.
Collapse
Affiliation(s)
- Francesco Caravelli
- Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
| |
Collapse
|
5
|
Zegarac A, Caravelli F. Memristive networks: From graph theory to statistical physics. ACTA ACUST UNITED AC 2019. [DOI: 10.1209/0295-5075/125/10001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
6
|
Abstract
We present both an overview and a perspective of recent experimental advances and proposed new approaches to performing computation using memristors. A memristor is a 2-terminal passive component with a dynamic resistance depending on an internal parameter. We provide an brief historical introduction, as well as an overview over the physical mechanism that lead to memristive behavior. This review is meant to guide nonpractitioners in the field of memristive circuits and their connection to machine learning and neural computation.
Collapse
|
7
|
Mizrahi A, Marsh T, Hoskins B, Stiles MD. Scalable Method to Find the Shortest Path in a Graph with Circuits of Memristors. PHYSICAL REVIEW APPLIED 2018; 10:10.1103/physrevapplied.10.064035. [PMID: 39450158 PMCID: PMC11500059 DOI: 10.1103/physrevapplied.10.064035] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/26/2024]
Abstract
Finding the shortest path in a graph has applications in a wide range of optimization problems. However, algorithmic methods scale with the size of the graph in terms of time and energy. We propose a method to solve the shortest-path problem using circuits of nanodevices called memristors and validate it on graphs of different sizes and topologies. It is both valid for an experimentally derived memristor model and robust to device variability. The time and energy of the computation scale with the length of the shortest path rather than with the size of the graph, making this method particularly attractive for solving large graphs with small path lengths.
Collapse
Affiliation(s)
- Alice Mizrahi
- National Institute of Standards and Technology, Gaithersburg, Maryland, USA
- Maryland NanoCenter, University of Maryland, College Park, Maryland, USA
| | - Thomas Marsh
- National Institute of Standards and Technology, Gaithersburg, Maryland, USA
| | - Brian Hoskins
- National Institute of Standards and Technology, Gaithersburg, Maryland, USA
| | - M. D. Stiles
- National Institute of Standards and Technology, Gaithersburg, Maryland, USA
| |
Collapse
|