A neuromorphic physiological signal processing system based on VO2 memristor for next-generation human-machine interface

Memristor-based adaptive neuromorphic perception in unstructured environments

Efficient operation of control systems in robotics or autonomous driving targeting real-world navigation scenarios requires perception methods that allow them to understand and adapt to unstructured environments with good accuracy, adaptation, and generality, similar to humans. To address this need, we present a memristor-based differential neuromorphic computing, perceptual signal processing, and online adaptation method providing neuromorphic style adaptation to external sensory stimuli. The adaptation ability and generality of this method are confirmed in two application scenarios: object grasping and autonomous driving. In the former, a robot hand realizes safe and stable grasping through fast ( ~ 1 ms) adaptation based on the tactile object features with a single memristor. In the latter, decision-making information of 10 unstructured environments in autonomous driving is extracted with an accuracy of 94% with a 40×25 memristor array. By mimicking human low-level perception mechanisms, the electronic neuromorphic circuit-based method achieves real-time adaptation and high-level reactions to unstructured environments.

Tuning the Intrinsic Stochasticity of Resistive Switching in VO2 Microresistors

Vanadium dioxide (VO2) microresistors exhibit resistive switching above a certain threshold voltage, allowing them to emulate neurons in neuromorphic systems. However, such devices present intrinsic cycle-to-cycle variations in their resistances and threshold voltages, which can be detrimental or beneficial, depending on their use. Here, we study this stochasticity in VO2 microresistors with various grain sizes and dimensions, through high-resolution electrical and optical measurements across numerous cycles. Our results highlight that the cycle-to-cycle variations in threshold voltage increase as the grain size becomes comparable to the device dimensions. We also present observations of multimodal threshold voltage distributions in the smaller-length resistors. To understand the underlying phenomenon, we investigate the relationship between the device insulating resistance and threshold voltage distributions, showing that these modes could correspond to distinct percolation paths and filaments. Our findings provide the first experimentally verified guidelines for designing VO2 devices with minimized/maximized stochasticity, depending on the targeted application.

Gate Voltage- and Bias Voltage-Tunable Staggered-Gap to Broken-Gap Transition Based on WSe2/Ta2NiSe5 Heterostructure for Multimode Optoelectronic Logic Gate

Two-dimensional (2D) materials with superior properties exhibit tremendous potential in developing next-generation electronic and optoelectronic devices. Integrating various functions into one device is highly expected as that endows 2D materials great promise for more Moore and more-than-Moore device applications. Here, we construct a WSe2/Ta2NiSe5 heterostructure by stacking the p-type WSe2 and the n-type narrow gap Ta2NiSe5 with the aim to achieve a multifunction optoelectronic device. Owing to the large interface potential barrier, the heterostructure device reveals a prominent diode feature with a large rectify ratio (7.6 × 104) and a low dark current (10-12 A). Especially, gate voltage- and bias voltage-tunable staggered-gap to broken-gap transition is achieved on the heterostructure device, which enables gate voltage-tunable forward and reverse rectifying features. As results, the heterostructure device exhibits superior self-powered photodetection properties, including a high detectivity of 1.08 × 1010 Jones and a fast response time of 91 μs. Additionally, the intrinsic structural anisotropy of Ta2NiSe5 endows the heterostructure device with strong polarization-sensitive photodetection and high-resolution polarization imaging. Based on these characteristics, a multimode optoelectronic logic gate is realized on the heterostructure via synergistically modulating the light on/off, polarization angle, gate voltage, and bias voltage. This work shed light on the future development of constructing high-performance multifunctional optoelectronic devices.

Reconfigurable Resistive Switching in VO2/La0.7Sr0.3MnO3/Al2O3 (0001) Memristive Devices for Neuromorphic Computing

The coexistence of nonvolatile and volatile switching modes in a single memristive device provides flexibility to emulate both neuronal and synaptic functions in the brain. Furthermore, such a device structure may eliminate the need for additional circuit elements such as transistor-based selectors, enabling low-power consumption and high-density device integration in fully memristive spiking neural networks. In this work, we report dual resistive switching (RS) modes in VO2/La0.7Sr0.3MnO3 (LSMO) bilayer memristive devices. Specifically, the nonvolatile RS is driven by the movement of oxygen vacancies (Vo) at the VO2/LSMO interface and requires a higher biasing voltage, whereas the volatile RS is controlled by the metal-insulator transition (MIT) of VO2 under a lower biasing voltage. The simple device structure is electrically driven between the two RS modes and thus can operate as a one selector-one resistor (1S1R) cell, which is a desirable feature in memristive crossbar arrays to avoid the sneak-path current issue. The RS modes are found to be stable and repeatable and can be reconfigured by exploiting the interfacial and phase transition properties, and thus, they hold great promise for applications in memristive neural networks and neuromorphic computing.

Memristive Bionic Memory Circuit Implementation and Its Application in Multisensory Mutual Associative Learning Networks

Memory is vital and indispensable for organisms and brain-inspired intelligence to gain complete sensation and cognition of the environment. In this work, a memristive bionic memory circuit inspired by human memory model is proposed, which includes 1) receptor and sensory neuron (SN), 2) short-term memory (STM) module, and 3) long-term memory (LTM) module. By leveraging the in-memory computing characteristic of memristors, various functions such as sensation, learning, forgetting, recall, consolidation, reconsolidation, retrieval, and reset are realized. Besides, a multisensory mutual associative learning network is constructed with several bionic memory units to memorize and associate sensory information of different modalities bidirectionally. Except for association establishment, enhancement, and extinction, we also mimicked multisensory integration to manifest the synthetic process of information from different sensory channels. According to the simulation results in PSPICE, the proposed circuit performs high robustness, low area overhead, and low power consumption. Combining associative memory with human memory model, this work provides a possible idea for further research in associative learning networks.

VO2 memristor-based frequency converter with in-situ synthesize and mix for wireless internet-of-things

Wireless internet-of-things (WIoT) with data acquisition sensors are evolving rapidly and the demand for transmission efficiency is growing rapidly. Frequency converter that synthesizes signals at different frequencies and mixes them with sensor datastreams is a key component for efficient wireless transmission. However, existing frequency converters employ separate synthesize and mix circuits with complex digital and analog circuits using complementary metal-oxide semiconductor (CMOS) devices, naturally incurring excessive latency and energy consumption. Here we report a highly uniform and calibratable VO2 memristor oscillator, based on which we build memristor-based frequency converter using 8[Formula: see text]8 VO2 array that can realize in-situ frequency synthesize and mix with help of compact periphery circuits. We investigate the self-oscillation based on negative differential resistance of VO2 memristors and the programmability with different driving currents and calibration resistances, demonstrating capabilities of such frequency converter for in-situ frequency synthesize and mix for 2 ~ 8 channels with frequencies up to 48 kHz for low frequency transmission link. When transmitting classical sensor data (acoustic, vision and spatial) in an end-to-end WIoT experimental setup, our VO2-based memristive frequency converter presents up to 1.45× ~ 1.94× power enhancement with only 0.02 ~ 0.21 dB performance degradations compared with conventional CMOS-based frequency converter. This work highlights the potential in solving frequency converter's speed and energy efficiency problems in WIoT using high crystalline quality epitaxially grown VO2 and calibratable VO2-based oscillator array, revealing a promising direction for next-generation WIoT system design.

Toward a Brain-Neuromorphics Interface

Brain-computer interfaces (BCIs) that enable human-machine interaction have immense potential in restoring or augmenting human capabilities. Traditional BCIs are realized based on complementary metal-oxide-semiconductor (CMOS) technologies with complex, bulky, and low biocompatible circuits, and suffer with the low energy efficiency of the von Neumann architecture. The brain-neuromorphics interface (BNI) would offer a promising solution to advance the BCI technologies and shape the interactions with machineries. Neuromorphic devices and systems are able to provide substantial computation power with extremely high energy-efficiency by implementing in-materia computing such as in situ vector-matrix multiplication (VMM) and physical reservoir computing. Recent progresses on integrating neuromorphic components with sensing and/or actuating modules, give birth to the neuromorphic afferent nerve, efferent nerve, sensorimotor loop, and so on, which has advanced the technologies for future neurorobotics by achieving sophisticated sensorimotor capabilities as the biological system. With the development on the compact artificial spiking neuron and bioelectronic interfaces, the seamless communication between a BNI and a bioentity is reasonably expectable. In this review, the upcoming BNIs are profiled by introducing the brief history of neuromorphics, reviewing the recent progresses on related areas, and discussing the future advances and challenges that lie ahead.

IGZO/WO3-x -Heterostructured Artificial Optoelectronic Synaptic Devices Mimicking Image Segmentation and Motion Capture

Currently, artificial neural networks (ANNs) based on memristors are limited to recognizing static images of objects when simulating human visual system, preventing them from performing high-dimensional information perception, and achieving more complex biomimetic functions is subject to certain limitations. In this work, indium gallium zinc oxide (IGZO)/tungsten oxide (WO3-x )-heterostructured artificial optoelectronic synaptic devices mimicking image segmentation and motion capture exhibiting high-performance optoelectronic synaptic responses are proposed and demonstrated. Upon electrical and optical stimulations, the device shows a variety of fundamental and advanced electrical and optical synaptic plasticity. Most importantly, outstanding and repeatable linear synaptic weight changes are attained by the developed memristor. By taking advantage of the notable linear synaptic weight changes, ANNs have been constructed and successfully utilized to demonstrate two applications in the field of computer vision, including image segmentation and object tracking. The accuracy attained by the memristor-based ANNs is similar to that of the computer algorithms, while its power has been significantly reduced by 105 orders of magnitude. With successful emulations of the human brain reactions when observing objects, the demonstrated memristor and related ANNs can be effectively utilized in constructing artificial optoelectronic synaptic devices and show promising potential in emulating human visual perception.

Design of Edge-IoMT Network Architecture with Weight-Based Scheduling

Population health monitoring based on the Internet of Medical Things (IoMT) is becoming an important application trend healthcare improvement. This work aims to develop an autonomous network architecture, collecting sensor data with a cluster topology, forwarding information through relay nodes, and applying edge computing and transmission scheduling for network scalability and operational efficiency. The proposed distributed network architecture incorporates data compression technologies and effective scheduling algorithms for handling the transmission scheduling of various physiological signals. Compared to existing scheduling mechanisms, the experimental results depict the network performance and show that in analyzing the delay and jitter, the proposed WFQ-based algorithms have reduced the delay and jitter ratio by about 40% and 19.47% compared to LLQ with priority queueing scheme, respectively. The experimental results also demonstrate that the proposed network topology is more effective than the direct path transmission approach in terms of energy consumption, which suggests that the proposed network architecture may improve the development of medical applications with body area networks such that the goal of self-organizing population health monitoring can be achieved.