An artificial sensory neuron with visual-haptic fusion

A Monolithic Neuromorphic Device for In-Sensor Tactile Computing

To emulate the tactile perception of human skin, the integration of tactile sensors with neuromorphic devices has emerged as a promising approach to achieve near-sensor information processing. Here, we present a monolithic electronic device that seamlessly integrates tactile perception and neuromorphic computing functionalities within a single architecture, with synaptic plasticity directly tunable by tactile inputs. This unique capability stems from our engineered device structure employing SnO2 nanowires as the conductive channel coupled with a pressure-sensitive chitosan layer ionic gating layer. The device demonstrates pressure-dependent memory retention and learning behaviors, effectively mimicking the enhanced cognitive functions observed in humans under stressful conditions. Furthermore, the integrated design exhibits potential for implementing bioinspired electronic systems requiring adaptive tactile information processing.

2D Atomic-Molecular Heterojunctions toward Brainoid Applications

Brainoid computing using 2D atomic crystals and their heterostructures, by emulating the human brain's remarkable efficiency and minimal energy consumption in information processing, poses a formidable solution to the energy-efficiency and processing speed constraints inherent in the von Neumann architecture. However, conventional 2D material based heterostructures employed in brainoid devices are beset with limitations, performance uniformity, fabrication intricacies, and weak interfacial adhesion, which restrain their broader application. The introduction of novel 2D atomic-molecular heterojunctions (2DAMH), achieved through covalent functionalization of 2D materials with functional molecules, ushers in a new era for brain-like devices by providing both stability and tunability of functionalities. This review chiefly delves into the electronic attributes of 2DAMH derived from the synergy of polymer materials with 2D materials, emphasizing the most recent advancements in their utilization within memristive devices, particularly their potential in replicating the functionality of biological synapses. Despite ongoing challenges pertaining to precision in modification, scalability in production, and the refinement of underlying theories, the proliferation of innovative research is actively pursuing solutions. These endeavors illuminate the vast potential for incorporating 2DAMH within brain-inspired intelligent systems, highlighting the prospect of achieving a more efficient and energy-conserving computing paradigm.

In-Sensor Computing with Visual-Tactile Perception Enabled by Mechano-Optical Artificial Synapse

In-sensor computing paradigm holds the promise of realizing rapid and low-power signal processing. Constructing crossmodal in-sensor computing systems to emulate human sensory and recognition capabilities has been a persistent pursuit for developing humanoid robotics. Here, an artificial mechano-optical synapse is reported to implement in-sensor dynamic computing with visual-tactile perception. By employing mechanoluminescence (ML) material, direct conversion of the mechanical signals into light emission is achieved and the light is transported to an adjacent photostimulated luminescence (PSL) layer without pre- and post-irradiation. The PSL layer acts as a photon reservoir as well as a processing unit for achieving in-memory computing. The approach based on ML coupled with PSL material is different from traditional circuit-constrained methods, enabling remote operation and easy accessibility. Individual and synergistic plasticity are elaborately investigated under force and light pulses, including paired-pulse facilitation, learning behavior, and short-term and long-term memory. A multisensory neural network is built for processing the obtained handwritten patterns with a tablet consisting of the device, achieving a recognition accuracy of up to 92.5%. Moreover, material identification has been explored based on visual-tactile sensing, with an accuracy rate of 98.6%. This work provides a promising strategy to construct in-sensor computing systems with crossmodal integration and recognition.

Soft Materials and Devices Enabling Sensorimotor Functions in Soft Robots

Sensorimotor functions, the seamless integration of sensing, decision-making, and actuation, are fundamental for robots to interact with their environments. Inspired by biological systems, the incorporation of soft materials and devices into robotics holds significant promise for enhancing these functions. However, current robotics systems often lack the autonomy and intelligence observed in nature due to limited sensorimotor integration, particularly in flexible sensing and actuation. As the field progresses toward soft, flexible, and stretchable materials, developing such materials and devices becomes increasingly critical for advanced robotics. Despite rapid advancements individually in soft materials and flexible devices, their combined applications to enable sensorimotor capabilities in robots are emerging. This review addresses this emerging field by providing a comprehensive overview of soft materials and devices that enable sensorimotor functions in robots. We delve into the latest development in soft sensing technologies, actuation mechanism, structural designs, and fabrication techniques. Additionally, we explore strategies for sensorimotor control, the integration of artificial intelligence (AI), and practical application across various domains such as healthcare, augmented and virtual reality, and exploration. By drawing parallels with biological systems, this review aims to guide future research and development in soft robots, ultimately enhancing the autonomy and adaptability of robots in unstructured environments.

Bio-inspired organic electrosense transistor for impalpable perception

Artificial sense technologies predominantly rely on visual and tactile input, which often prove inadequate in obscured or opaque environments. Inspired by the natural electrosensory capabilities of electrogenic fishes, we introduce an organic electrosense transistor designed to detect electric fields generated by nearby objects, facilitating the creation of impalpable perception systems. Unlike traditional sensors, our electrosense transistor perceives bipolar electric fields with high sensitivity and stability. We use compact models and device simulations to elucidate the mechanisms of charge induction and transport within organic electrosense transistors when exposed to spatial electric fields. Demonstrating its practical utility, we show that robots equipped with our electrosense transistor can successfully navigate and detect concealed objects without requiring direct contact. This work not only advances the understanding of charge dynamics in electrosensory systems but also establishes a platform for developing highly sensitive, noninvasive artificial sensing technologies applicable in surveillance, search and rescue, and other challenging environments.

Mechanics-Photophysics Correlation in Tough, Stretchable and Long-Lived Room Temperature Phosphorescence Ionogels Deciphered by Dynamic Mechanical Analysis

The development of tough, stretchable and long-lived room temperature phosphorescence (RTP) materials holds great significance for manufacturing and processing photoluminescent materials, but limited techniques are available to profile their mechanics-photophysics correlation. Here we report glassy ionogels, and their mechanical properties and photophysical properties are fused by dynamic mechanical analysis (DMA), functioning like a human brain that perceives a material instantaneously by linking sensory perception and cognition. Depending on two special temperatures presented in DMA curves, Tloss (the peak of loss modulus (E")) and Tg (glass transition temperature), the ionogels can vary from being either tough with persistent phosphorescence, extensible with effective phosphorescence or resilience with inefficient phosphorescence. Leveraging this method, we achieve stretchable and long-lived RTP ionogels with tensile yield strength of 53 MPa, tensile strain of 497 %, Young's modulus of 782 MPa, toughness of 111.2 MJ/m3, and lifetime of 113.05 ms. Our work provides a simple yet powerful method to reveal the mechanics-photophysics correlation of RTP ionogels, to predict their performance without laborious synthesis and characterization, opening new avenues for applications of RTP materials, including applications in harsh conditions (257 K or 347 K), shape memory and shape reconstruction.

Self-Powered Artificial Neuron Devices: Towards the All-In-One Perception and Computation System

The increasing demand for energy supply in sensing units and the computational efficiency of computation units has prompted researchers to explore novel, integrated technology that offers high efficiency and low energy consumption. Self-powered sensing technology enables environmental perception without external energy sources, while neuromorphic computation provides energy-efficient and high-performance computing capabilities. The integration of self-powered sensing technology and neuromorphic computation presents a promising solution for an all-in-one system. This review examines recent developments and advancements in self-powered artificial neuron devices based on triboelectric, piezoelectric, and photoelectric effects, focusing on their structures, mechanisms, and functions. Furthermore, it compares the electrical characteristics of various types of self-powered artificial neuron devices and discusses effective methods for enhancing their performance. Additionally, this review provides a comprehensive summary of self-powered perception systems, encompassing tactile, visual, and auditory perception systems. Moreover, it elucidates recently integrated systems that combine perception, computing, and actuation units into all-in-one configurations, aspiring to realize closed-loop control. The seamless integration of self-powered sensing and neuromorphic computation holds significant potential for shaping a more intelligent future for humanity.

Light-induced negative differential resistance and neural oscillations in neuromorphic photonic semiconductor micropillar sensory neurons

Neuromorphic systems, inspired by nature, are sought to efficiently process analogue inputs in real and complex environments. This could lead to ultralow-power in-sensor intelligent edge computers. Here, we present an artificial sensory oscillator neuron consisting of a III-V semiconductor micropillar quantum resonant tunnelling diode (RTD) with GaAs photosensitive absorption layers. The oscillatory optical neuron encodes incoming analogue optical data into spatiotemporal oscillatory signals. We demonstrate that near-infrared light within a certain intensity range activates a region of negative differential resistance, and subsequently, large-amplitude voltage oscillations. As a result, optic analogue information is encoded into electrical oscillations resulting in amplification of sensory light inputs. Under pulse-modulated light, excitation and inhibition of burst firing patterns can be controlled within a single oscillatory neuron, simulating neural activity in networks in the form of breather-type oscillatory phenomena. Such spatiotemporal oscillatory patterns (burst firing) form the basis for the combined sensing, pre-processing, and encoding abilities of the vision-nervous system found in biological organisms. This work paves the way for future artificial visual systems using III-V semiconductor nano-optoelectronic circuits in applications for light-driven neurorobotics, bioinspired optoelectronics, and in-sensor neuromorphic computing systems for real-time processing of sensory data.

Electrolyte Gated Transistors for Brain Inspired Neuromorphic Computing and Perception Applications: A Review

Emerging neuromorphic computing offers a promising and energy-efficient approach to developing advanced intelligent systems by mimicking the information processing modes of the human brain. Moreover, inspired by the high parallelism, fault tolerance, adaptability, and low power consumption of brain perceptual systems, replicating these efficient and intelligent systems at a hardware level will endow artificial intelligence (AI) and neuromorphic engineering with unparalleled appeal. Therefore, construction of neuromorphic devices that can simulate neural and synaptic behaviors are crucial for achieving intelligent perception and neuromorphic computing. As novel memristive devices, electrolyte-gated transistors (EGTs) stand out among numerous neuromorphic devices due to their unique interfacial ion coupling effects. Thus, the present review discusses the applications of the EGTs in neuromorphic electronics. First, operational modes of EGTs are discussed briefly. Second, the advancements of EGTs in mimicking biological synapses/neurons and neuromorphic computing functions are introduced. Next, applications of artificial perceptual systems utilizing EGTs are discussed. Finally, a brief outlook on future developments and challenges is presented.

Thin and Flexible Breeze-Sense Generators for Non-Contact Haptic Feedback in Virtual Reality

In the realm of virtual reality (VR), haptic feedback is integral to enhance the immersive experience; yet, existing wearable devices predominantly rely on skin contact feedback, lacking options for compact and non-contact breeze-sense feedback. Herein, we propose a compact and non-contact working model piezoelectret actuator for providing a gentle and safe breeze sensation. This easy-fabricated and flexible breeze-sense generator with thickness around 1 mm generates air flow pressure up to ~ 163 Pa, which is significantly sensed by human skin. In a typical demonstration, the breeze-sense generators array showcases its versatility by employing multiple coded modes for non-contact information transmitting. The thin thinness and good flexibility facilitate seamless integration with wearable VR setups, and the wearable arrays empower volunteers to precisely perceive the continuous and sudden breeze senses in the virtual environments. This work is expected to inspire developing new haptic feedback devices that play pivotal roles in human-machine interfaces for VR applications.

A Self-Formed Ag Nanostructure Based Neuromorphic Device Performing Arithmetic Computation and Area Integration: Influence of Presynaptic Pulsing Scheme on Mathematical Precision

A material equivalent of a biosynapse is the key to neuromorphic architecture. Here we report a self-forming labyrinthine Ag nanostructure activated with a few pulses of 0.5 V, width and interval set at 50 ms, at current compliance (ICC) of 400 nA, serving as the active material for a highly stable device with programmable volatility. Both the conductance (G) and its retention time (tr) in the potentiated state are found to vary linearly with the pulse number for pulses of positive and negative polarities, with the nonlinearity factors being noticeably small, ∼0.03 for G during potentiation and ∼0.08 during depression. This was tested for over 200 days, and the results were highly reproducible. Relying on the high linearity, arithmetic operations involving counting of positive and negative integers were realized using pulses of both polarities, often by mixing them in the feeding sequence. The observed outcomes based on G and independently from tr are highly accurate, with deviations being typically less than ∼1.5% from the expected results. Notably, the way the pulse polarities are mixed is found to have an influence, with random sequences producing relatively larger deviations in integer estimation. However, deviations decreased with higher ICC values, which promoted stronger filament formation in the percolation networks. Besides, the G and tr values were found to vary with the pulse amplitude as well, which enabled the calculation of the area under a curve. Further, the device exhibited a simulation-based image classification accuracy of 94.95%, close to the ideal value (96.05%). Simulations utilizing the finite element method have showcased the uniqueness of the labyrinthine morphology, giving rise to field intensification along potential percolative paths.

Mechano-Graded Contact-Electrification Interfaces Based Artificial Mechanoreceptors for Robotic Adaptive Reception

Triboelectrification-based artificial mechanoreceptors (TBAMs) is able to convert mechanical stimuli directly into electrical signals, realizing self-adaptive protection and human-machine interactions of robots. However, traditional contact-electrification interfaces are prone to reaching their deformation limits under large pressures, resulting in a relatively narrow linear range. In this work, we fabricated mechano-graded microstructures to modulate the strain behavior of contact-electrification interfaces, simultaneously endowing the TBAMs with a high sensitivity and a wide linear detection range. The presence of step regions within the mechanically graded microstructures helps contact-electrification interfaces resist fast compressive deformation and provides a large effective area. The highly sensitive linear region of TBAM with 1.18 V/kPa can be effectively extended to four times of that for the devices with traditional interfaces. In addition, the device is able to maintain a high sensitivity of 0.44 V/kPa even under a large pressure from 40 to 600 kPa. TBAM has been successfully used as an electronic skin to realize self-adaptive protection and grip strength perception for a commercial robot arm. Finally, a high angle resolution of 2° and an excellent linearity of 99.78% for joint bending detection were also achieved. With the aid of a convolutional neural network algorithm, a data glove based on TBAMs realizes a high accuracy rate of 95.5% for gesture recognition in a dark environment.

An organic electrochemical neuron for a neuromorphic perception system

Human perception systems are highly refined, relying on an adaptive, plastic, and event-driven network of sensory neurons. Drawing inspiration from Nature, neuromorphic perception systems hold tremendous potential for efficient multisensory signal processing in the physical world; however, the development of an efficient artificial neuron with a widely calibratable spiking range and reduced footprint remains challenging. Here, we report an efficient organic electrochemical neuron (OECN) with reduced footprint (<37 mm2) based on high-performance vertical OECT (vOECT) complementary circuitry enabled by an advanced n-type polymer for balanced p-/n-type vOECT performance. The OECN exhibits outstanding neuronal characteristics, capable of producing spikes with a widely calibratable state-of-the art firing frequency range of 0.130 to 147.1 Hz. Leveraging this capability, we develop a neuromorphic perception system that integrates mechanical sensors with the OECN and integrates them with an artificial synapse for tactile perception. The system successfully encodes tactile stimulations into frequency-dependent spikes, which are further converted into postsynaptic responses. This bioinspired design demonstrates significant potential to advance cyborg and neuromorphic systems, providing them with perceptual capabilities.

Bio-Inspired Neuromorphic Sensory Systems from Intelligent Perception to Nervetronics

Inspired by the extensive signal processing capabilities of the human nervous system, neuromorphic artificial sensory systems have emerged as a pivotal technology in advancing brain-like computing for applications in humanoid robotics, prosthetics, and wearable technologies. These systems mimic the functionalities of the central and peripheral nervous systems through the integration of sensory synaptic devices and neural network algorithms, enabling external stimuli to be converted into actionable electrical signals. This review delves into the intricate relationship between synaptic device technologies and neural network processing algorithms, highlighting their mutual influence on artificial intelligence capabilities. This study explores the latest advancements in artificial synaptic properties triggered by various stimuli, including optical, auditory, mechanical, and chemical inputs, and their subsequent processing through artificial neural networks for applications in image recognition and multimodal pattern recognition. The discussion extends to the emulation of biological perception via artificial synapses and concludes with future perspectives and challenges in neuromorphic system development, emphasizing the need for a deeper understanding of neural network processing to innovate and refine these complex systems.

Bio-Plausible Multimodal Learning with Emerging Neuromorphic Devices

Multimodal machine learning, as a prospective advancement in artificial intelligence, endeavors to emulate the brain's multimodal learning abilities with the objective to enhance interactions with humans. However, this approach requires simultaneous processing of diverse types of data, leading to increased model complexity, longer training times, and higher energy consumption. Multimodal neuromorphic devices have the capability to preprocess spatio-temporal information from various physical signals into unified electrical signals with high information density, thereby enabling more biologically plausible multimodal learning with low complexity and high energy-efficiency. Here, this work conducts a comparison between the expression of multimodal machine learning and multimodal neuromorphic computing, followed by an overview of the key characteristics associated with multimodal neuromorphic devices. The bio-plausible operational principles and the multimodal learning abilities of emerging devices are examined, which are classified into heterogeneous and homogeneous multimodal neuromorphic devices. Subsequently, this work provides a detailed description of the multimodal learning capabilities demonstrated by neuromorphic circuits and their respective applications. Finally, this work highlights the limitations and challenges of multimodal neuromorphic computing in order to hopefully provide insight into potential future research directions.

Nanomaterials for Flexible Neuromorphics

The quest to imbue machines with intelligence akin to that of humans, through the development of adaptable neuromorphic devices and the creation of artificial neural systems, has long stood as a pivotal goal in both scientific inquiry and industrial advancement. Recent advancements in flexible neuromorphic electronics primarily rely on nanomaterials and polymers owing to their inherent uniformity, superior mechanical and electrical capabilities, and versatile functionalities. However, this field is still in its nascent stage, necessitating continuous efforts in materials innovation and device/system design. Therefore, it is imperative to conduct an extensive and comprehensive analysis to summarize current progress. This review highlights the advancements and applications of flexible neuromorphics, involving inorganic nanomaterials (zero-/one-/two-dimensional, and heterostructure), carbon-based nanomaterials such as carbon nanotubes (CNTs) and graphene, and polymers. Additionally, a comprehensive comparison and summary of the structural compositions, design strategies, key performance, and significant applications of these devices are provided. Furthermore, the challenges and future directions pertaining to materials/devices/systems associated with flexible neuromorphics are also addressed. The aim of this review is to shed light on the rapidly growing field of flexible neuromorphics, attract experts from diverse disciplines (e.g., electronics, materials science, neurobiology), and foster further innovation for its accelerated development.

Recent Advances in Artificial Sensory Neurons: Biological Fundamentals, Devices, Applications, and Challenges

Spike-based neural networks, which use spikes or action potentials to represent information, have gained a lot of attention because of their high energy efficiency and low power consumption. To fully leverage its advantages, converting the external analog signals to spikes is an essential prerequisite. Conventional approaches including analog-to-digital converters or ring oscillators, and sensors suffer from high power and area costs. Recent efforts are devoted to constructing artificial sensory neurons based on emerging devices inspired by the biological sensory system. They can simultaneously perform sensing and spike conversion, overcoming the deficiencies of traditional sensory systems. This review summarizes and benchmarks the recent progress of artificial sensory neurons. It starts with the presentation of various mechanisms of biological signal transduction, followed by the systematic introduction of the emerging devices employed for artificial sensory neurons. Furthermore, the implementations with different perceptual capabilities are briefly outlined and the key metrics and potential applications are also provided. Finally, we highlight the challenges and perspectives for the future development of artificial sensory neurons.

Optically Mediated Hydrogel-Based Ionic Diode

Ionic diodes with environmentally modulated ion-rectifying characteristics have attracted much attention and show great promise in the construction of smart devices with environmental adaptability. One immediate challenge is to integrate stimuli responsiveness and ion rectification into one single ionic diode, which requires a close cooperation of chemical principles and device technologies. Herein, an ionic diode based on a photoresponsive hydrogel with optically mediated ion-rectifying performances is introduced. Relying on the photoresponsive concentration of proton in the hydrogel, the ionic current rectification can be prominently enhanced upon ultraviolet (UV) irradiation. A maximum ionic current rectification ratio of the optically mediated ionic diode about 4 × 105 is achieved. Furthermore, the hydrogel-based diode can serve as an AND logic gate operated by UV light and voltage bias as two independent inputs. As a proof of concept, to use the optically mediated diode is achieved to modulate the feedback of a robot with logic behaviors. This work provides a novel and valuable strategy for designing functional hydrogel-based devices with the integration of stimuli-responsiveness and logic signal processing through chemical approaches.

A Narrative Review of Haptic Technologies and Their Value for Training, Rehabilitation, and the Education of Persons with Special Needs

Haptic technologies are increasingly valuable for human-computer interaction in its many flavors, including, of course, virtual reality systems, which are becoming very useful tools for education, training, and rehabilitation in many areas of medicine, engineering, and daily life. There is a broad spectrum of technologies and approaches that provide haptic stimuli, ranging from the well-known force feedback to subtile pseudo-haptics and visual haptics. Correspondingly, there is a broad spectrum of applications and system designs that include haptic technologies as a relevant component and interaction feature. Paramount is their use in training of medical procedures, but they appear in a plethora of systems deploying virtual reality applications. This narrative review covers the panorama of haptic devices and approaches and the most salient areas of application. Special emphasis is given to education of persons with special needs, aiming to foster the development of innovative systems and methods addressing the enhancement of the quality of life of this segment of the population.

An evaluation of recent advancements in biological sensory organ-inspired neuromorphically tuned biomimetic devices

In the field of neuroscience, significant progress has been made regarding how the brain processes information. Unlike computer processors, the brain comprises neurons and synapses instead of memory blocks and transistors. Despite advancements in artificial neural networks, a complete understanding concerning brain functions remains elusive. For example, to achieve more accurate neuron replication, we must better understand signal transmission during synaptic processes, neural network tunability, and the creation of nanodevices featuring neurons and synapses. This study discusses the latest algorithms utilized in neuromorphic systems, the production of synaptic devices, differences between single and multisensory gadgets, recent advances in multisensory devices, and the promising research opportunities available in this field. We also explored the ability of an artificial synaptic device to mimic biological neural systems across diverse applications. Despite existing challenges, neuroscience-based computing technology holds promise for attracting scientists seeking to enhance solutions and augment the capabilities of neuromorphic devices, thereby fostering future breakthroughs in algorithms and the widespread application of cutting-edge technologies.

Comprehensively Modulated Sub-Attojoule Operated Optoelectronic Synapses for Image Encryption and Inpainting

High-performance optoelectronic synaptic transistors play a crucial role in developing and emulating artificial visual systems. However, due to the predominant use of single-structure material modulation in optimizing optoelectronic synapses, their energy consumption significantly trails behind that of electronic synapses by several orders of magnitude. Herein, polymer dielectric layers and optimized contact strategies are adopted to realize the ultralow consumption optoelectronic synapses. Integration of polyimide dielectric significantly enhances photogenerated charge carrier dissociation, leading to substantial improvements in photoresponsivity (1.5 × 106 A·W-1), photodetectivity (6.9 × 1012 Jones), and external quantum efficiency (4.0 × 108%). Additionally, optimized contact properties augment their appeal for ultralow energy consumption in optoelectronic synapse applications. Excitatory postsynaptic current is triggered at an incredibly low voltage of 5 μV and boosts an impressively low energy consumption of 0.05 aJ, ranking among the best-reported results in this field. Next, we demonstrate an integrated system combining the MoS2 optoelectronic synapses with a recurrent neural network enabling 100% accurate recognition of optical signals, particularly in scenarios with aJ-leveled energy consumption. Finally, an image encryption system has been developed, in which images are encrypted by photoelectronic conversion of synapse arrays with random voltage settings and decrypted according to the recurrent neural network-based accuracy. More importantly, once partially damaged images are encrypted, through the decryption image inpainting can be realized due to the high accuracy. The proposed innovative approach holds promise for advancing artificial intelligence applications with improved energy efficiency, information security, and computational capabilities.

Toward an AI Era: Advances in Electronic Skins

Electronic skins (e-skins) have seen intense research and rapid development in the past two decades. To mimic the capabilities of human skin, a multitude of flexible/stretchable sensors that detect physiological and environmental signals have been designed and integrated into functional systems. Recently, researchers have increasingly deployed machine learning and other artificial intelligence (AI) technologies to mimic the human neural system for the processing and analysis of sensory data collected by e-skins. Integrating AI has the potential to enable advanced applications in robotics, healthcare, and human-machine interfaces but also presents challenges such as data diversity and AI model robustness. In this review, we first summarize the functions and features of e-skins, followed by feature extraction of sensory data and different AI models. Next, we discuss the utilization of AI in the design of e-skin sensors and address the key topic of AI implementation in data processing and analysis of e-skins to accomplish a range of different tasks. Subsequently, we explore hardware-layer in-skin intelligence before concluding with an analysis of the challenges and opportunities in the various aspects of AI-enabled e-skins.

Toward a Brain-Neuromorphics Interface

Brain-computer interfaces (BCIs) that enable human-machine interaction have immense potential in restoring or augmenting human capabilities. Traditional BCIs are realized based on complementary metal-oxide-semiconductor (CMOS) technologies with complex, bulky, and low biocompatible circuits, and suffer with the low energy efficiency of the von Neumann architecture. The brain-neuromorphics interface (BNI) would offer a promising solution to advance the BCI technologies and shape the interactions with machineries. Neuromorphic devices and systems are able to provide substantial computation power with extremely high energy-efficiency by implementing in-materia computing such as in situ vector-matrix multiplication (VMM) and physical reservoir computing. Recent progresses on integrating neuromorphic components with sensing and/or actuating modules, give birth to the neuromorphic afferent nerve, efferent nerve, sensorimotor loop, and so on, which has advanced the technologies for future neurorobotics by achieving sophisticated sensorimotor capabilities as the biological system. With the development on the compact artificial spiking neuron and bioelectronic interfaces, the seamless communication between a BNI and a bioentity is reasonably expectable. In this review, the upcoming BNIs are profiled by introducing the brief history of neuromorphics, reviewing the recent progresses on related areas, and discussing the future advances and challenges that lie ahead.

Stretchable and Self-Powered Mechanoluminescent Triboelectric Nanogenerator Fibers toward Wearable Amphibious Electro-Optical Sensor Textiles

Flexible electro-optical dual-mode sensor fibers with capability of the perceiving and converting mechanical stimuli into digital-visual signals show good prospects in smart human-machine interaction interfaces. However, heavy mass, low stretchability, and lack of non-contact sensing function seriously impede their practical application in wearable electronics. To address these challenges, a stretchable and self-powered mechanoluminescent triboelectric nanogenerator fiber (MLTENGF) based on lightweight carbon nanotube fiber is successfully constructed. Taking advantage of their mechanoluminescent-triboelectric synergistic effect, the well-designed MLTENGF delivers an excellent enhancement electrical signal of 200% and an evident optical signal whether on land or underwater. More encouragingly, the MLTENGF device possesses outstanding stability with almost unchanged sensitivity after stretching for 200%. Furthermore, an extraordinary non-contact sensing capability with a detection distance of up to 35 cm is achieved for the MLTENGF. As application demonstrations, MLTENGFs can be used for home security monitoring, intelligent zither, traffic vehicle collision avoidance, and underwater communication. Thus, this work accelerates the development of wearable electro-optical textile electronics for smart human-machine interaction interfaces.

Neuromorphic Nanoionics for Human-Machine Interaction: From Materials to Applications

Human-machine interaction (HMI) technology has undergone significant advancements in recent years, enabling seamless communication between humans and machines. Its expansion has extended into various emerging domains, including human healthcare, machine perception, and biointerfaces, thereby magnifying the demand for advanced intelligent technologies. Neuromorphic computing, a paradigm rooted in nanoionic devices that emulate the operations and architecture of the human brain, has emerged as a powerful tool for highly efficient information processing. This paper delivers a comprehensive review of recent developments in nanoionic device-based neuromorphic computing technologies and their pivotal role in shaping the next-generation of HMI. Through a detailed examination of fundamental mechanisms and behaviors, the paper explores the ability of nanoionic memristors and ion-gated transistors to emulate the intricate functions of neurons and synapses. Crucial performance metrics, such as reliability, energy efficiency, flexibility, and biocompatibility, are rigorously evaluated. Potential applications, challenges, and opportunities of using the neuromorphic computing technologies in emerging HMI technologies, are discussed and outlooked, shedding light on the fusion of humans with machines.

Crossmodal sensory neurons based on high-performance flexible memristors for human-machine in-sensor computing system

Constructing crossmodal in-sensor processing system based on high-performance flexible devices is of great significance for the development of wearable human-machine interfaces. A bio-inspired crossmodal in-sensor computing system can perform real-time energy-efficient processing of multimodal signals, alleviating data conversion and transmission between different modules in conventional chips. Here, we report a bio-inspired crossmodal spiking sensory neuron (CSSN) based on a flexible VO2 memristor, and demonstrate a crossmodal in-sensor encoding and computing system for wearable human-machine interfaces. We demonstrate excellent performance in the VO2 memristor including endurance (>1012), uniformity (0.72% for cycle-to-cycle variations and 3.73% for device-to-device variations), speed (<30 ns), and flexibility (bendable to a curvature radius of 1 mm). A flexible hardware processing system is implemented based on the CSSN, which can directly perceive and encode pressure and temperature bimodal information into spikes, and then enables the real-time haptic-feedback for human-machine interaction. We successfully construct a crossmodal in-sensor spiking reservoir computing system via the CSSNs, which can achieve dynamic objects identification with a high accuracy of 98.1% and real-time signal feedback. This work provides a feasible approach for constructing flexible bio-inspired crossmodal in-sensor computing systems for wearable human-machine interfaces.

Artificial organic afferent nerves enable closed-loop tactile feedback for intelligent robot

The emulation of tactile sensory nerves to achieve advanced sensory functions in robotics with artificial intelligence is of great interest. However, such devices remain bulky and lack reliable competence to functionalize further synaptic devices with proprioceptive feedback. Here, we report an artificial organic afferent nerve with low operating bias (-0.6 V) achieved by integrating a pressure-activated organic electrochemical synaptic transistor and artificial mechanoreceptors. The dendritic integration function for neurorobotics is achieved to perceive directional movement of object, further reducing the control complexity by exploiting the distributed and parallel networks. An intelligent robot assembled with artificial afferent nerve, coupled with a closed-loop feedback program is demonstrated to rapidly implement slip recognition and prevention actions upon occurrence of object slippage. The spatiotemporal features of tactile patterns are well differentiated with a high recognition accuracy after processing spike-encoded signals with deep learning model. This work represents a breakthrough in mimicking synaptic behaviors, which is essential for next-generation intelligent neurorobotics and low-power biomimetic electronics.

Adaptive Processing Enabled by Sodium Alginate Based Complementary Memristor for Neuromorphic Sensory System

Adaptive processing allows sensory systems to autonomically adjust their sensitivity with exposure to a constant sensory stimulus and thus organisms to adapt to environmental variations. Bioinspired electronics with adaptive functions are highly desirable for the development of neuromorphic sensory systems (NSSs). Herein, the functions of desensitization and sensitivity changing with background intensity (i.e., Weber's law), as two fundamental cues of sensory adaptation, are biorealistically demonstrated in an Ag nanowire (NW)-embedded sodium alginate (SA) based complementary memristor. In particular, Weber's law is experimentally emulated in a single complementary memristor. Furthermore, three types of adaptive NSS unit are constructed to realize a multiple perceptual capability that processes the stimuli of illuminance, temperature, and pressure signals. Taking neuromorphic vision as an example, scotopic and photopic adaptation functions are well reproduced for image enhancement against dark and bright backgrounds. Importantly, an NSS system with multisensory integration function is demonstrated by combining light and pressure spikes, where the accuracy of pattern recognition is obviously enhanced relative to that of an individual sense. This work offers a new strategy for developing neuromorphic electronics with adaptive functions and paves the way toward developing a highly efficient NSS.

Biomimetic Neuromorphic Sensory System via Electrolyte Gated Transistors

Biomimetic neuromorphic sensing systems, inspired by the structure and function of biological neural networks, represent a major advancement in the field of sensing technology and artificial intelligence. This review paper focuses on the development and application of electrolyte gated transistors (EGTs) as the core components (synapses and neuros) of these neuromorphic systems. EGTs offer unique advantages, including low operating voltage, high transconductance, and biocompatibility, making them ideal for integrating with sensors, interfacing with biological tissues, and mimicking neural processes. Major advances in the use of EGTs for neuromorphic sensory applications such as tactile sensors, visual neuromorphic systems, chemical neuromorphic systems, and multimode neuromorphic systems are carefully discussed. Furthermore, the challenges and future directions of the field are explored, highlighting the potential of EGT-based biomimetic systems to revolutionize neuromorphic prosthetics, robotics, and human-machine interfaces. Through a comprehensive analysis of the latest research, this review is intended to provide a detailed understanding of the current status and future prospects of biomimetic neuromorphic sensory systems via EGT sensing and integrated technologies.

Human somatosensory systems based on sensor-memory-integrated technology

As a representative artificial neural network (ANN) for incorporating sensing functions and memory functions into one system to achieve highly miniaturized and highly integrated devices or systems, artificial sensory systems (ASSs) can have a far-reaching influence on precise instrumentation, sensing, and automation engineering. Artificial sensory systems have enjoyed considerable progress in recent years, from low degree integrations to highly advanced sophisticated integrations, from single-modal perceptions to multimode-fused perceptions. However, there are issues around the large hardware area, power consumption, and communication bandwidth needed during the processes where multimodal sensing signals are converted into a digital mode before they can be processed by a digital processor. Therefore, deepening the research into sensory integration is of great importance. In this review, we briefly introduce fundamental knowledge about the memristor mechanism, describe some representative human somatosensory systems, and elucidate the relationship between the properties of memristor devices and the structure. The electronic character of the sensors, future prospects, and key challenges surrounding sensor-memory integrated technologies are also discussed.

Bioinspired In-Sensor Multimodal Fusion for Enhanced Spatial and Spatiotemporal Association

Multimodal perception can capture more precise and comprehensive information compared with unimodal approaches. However, current sensory systems typically merge multimodal signals at computing terminals following parallel processing and transmission, which results in the potential loss of spatial association information and requires time stamps to maintain temporal coherence for time-series data. Here we demonstrate bioinspired in-sensor multimodal fusion, which effectively enhances comprehensive perception and reduces the level of data transfer between sensory terminal and computation units. By adopting floating gate phototransistors with reconfigurable photoresponse plasticity, we realize the agile spatial and spatiotemporal fusion under nonvolatile and volatile photoresponse modes. To realize an optimal spatial estimation, we integrate spatial information from visual-tactile signals. For dynamic events, we capture and fuse in real time spatiotemporal information from visual-audio signals, realizing a dance-music synchronization recognition task without a time-stamping process. This in-sensor multimodal fusion approach provides the potential to simplify the multimodal integration system, extending the in-sensor computing paradigm.

Integration of MoS2 Memtransistor Devices and Analogue Circuits for Sensor Fusion in Autonomous Vehicle Target Localization

In contemporary autonomous driving systems relying on sensor fusion, traditional digital processors encounter challenges associated with analogue-to-digital conversion and iterative vector-matrix operations, which are encumbered by limitations in terms of response time and energy consumption. In this study, we present an analogue Kalman filter circuit based on molybdenum disulfide (MoS2) memtransistor, designed to accelerate sensor fusion for precise localization in autonomous vehicle applications. The nonvolatile memory characteristics of the memtransistor allow for the storage of a fixed Kalman gain, which eliminates the data convergence and thus accelerates the processing speeds. Additionally, the modulation of multiple conductance states by the gate terminal enables fast adaptability to diverse autonomous driving scenarios by tuning multiple Kalman filter gains. Our proposed analogue Kalman filter circuit accurately estimates the position coordinates of target vehicles by fusing sensor data from light detection and ranging (LiDAR), millimeter-wave radar (Radar), and camera, and it successfully solves real-word problems in a signal-free crossroad intersection. Notably, our system achieves a 1000-fold improvement in energy efficiency compared to that of digital circuits. This work underscores the viability of a memtransistor for achieving fast, energy-efficient real-time sensing, and continuous signal processing in advanced sensor fusion technology.

Bio-Inspired Sensory Receptors for Artificial-Intelligence Perception

In the era of artificial intelligence (AI), there is a growing interest in replicating human sensory perception. Selective and sensitive bio-inspired sensory receptors with synaptic plasticity have recently gained significant attention in developing energy-efficient AI perception. Various bio-inspired sensory receptors and their applications in AI perception are reviewed here. The critical challenges for the future development of bio-inspired sensory receptors are outlined, emphasizing the need for innovative solutions to overcome hurdles in sensor design, integration, and scalability. AI perception can revolutionize various fields, including human-machine interaction, autonomous systems, medical diagnostics, environmental monitoring, industrial optimization, and assistive technologies. As advancements in bio-inspired sensing continue to accelerate, the promise of creating more intelligent and adaptive AI systems becomes increasingly attainable, marking a significant step forward in the evolution of human-like sensory perception.

The Differential Effects of Multisensory Attentional Cues on Task Performance in VR Depending on the Level of Cognitive Load and Cognitive Capacity

As the utilization of VR is expanding across diverse fields, research on devising attentional cues that could optimize users' task performance in VR has become crucial. Since the cognitive load imposed by the context and the individual's cognitive capacity are representative factors that are known to determine task performance, we aimed to examine how the effects of multisensory attentional cues on task performance are modulated by the two factors. For this purpose, we designed a new experimental paradigm in which participants engaged in dual (N-back, visual search) tasks under different levels of cognitive load while an attentional cue (visual, tactile, or visuotactile) was presented to facilitate search performance. The results showed that multi-sensory attentional cues are generally more effective than uni-sensory cues in enhancing task performance, but the benefit of multi-sensory cues changes according to the level of cognitive load and the individual's cognitive capacity; the amount of benefit increases as the cognitive load is higher and the cognitive capacity is lower. The findings of this study provide practical implications for designing attentional cues to enhance VR task performance, considering both the complexity of the VR context and users' internal characteristics.

All-Photolithography Fabrication of Ion-Gated Flexible Organic Transistor Array for Multimode Neuromorphic Computing

Organic ion-gated transistors (OIGTs) demonstrate commendable performance for versatile neuromorphic systems. However, due to the fragility of organic materials to organic solvents, efficient and reliable all-photolithography methods for scalable manufacturing of high-density OIGT arrays with multimode neuromorphic functions are still missing, especially when all active layers are patterned in high-density. Here, a flexible high-density (9662 devices per cm2) OIGT array with high yield and minimal device-to-device variation is fabricated by a modified all-photolithography method. The unencapsulated flexible array can withstand 1000 times' bending at a radius of 1 mm, and 3 months' storage test in air, without obvious performance degradation. More interesting, the OIGTs can be configured between volatile and nonvolatile modes, suitable for constructing reservoir computing systems to achieve high accuracy in classifying handwritten digits with low training costs. This work proposes a promising design of organic and flexible electronics for affordable neuromorphic systems, encompassing both array and algorithm aspects.

A Retina-Inspired Optoelectronic Synapse Using Quantum Dots for Neuromorphic Photostimulation of Neurons

Neuromorphic electronics, inspired by the functions of neurons, have the potential to enable biomimetic communication with cells. Such systems require operation in aqueous environments, generation of sufficient levels of ionic currents for neurostimulation, and plasticity. However, their implementation requires a combination of separate devices, such as sensors, organic synaptic transistors, and stimulation electrodes. Here, a compact neuromorphic synapse that combines photodetection, memory, and neurostimulation functionalities all-in-one is presented. The artificial photoreception is facilitated by a photovoltaic device based on cell-interfacing InP/ZnS quantum dots, which induces photo-faradaic charge-transfer mediated plasticity. The device sends excitatory post-synaptic currents exhibiting paired-pulse facilitation and post-tetanic potentiation to the hippocampal neurons via the biohybrid synapse. The electrophysiological recordings indicate modulation of the probability of action potential firing due to biomimetic temporal summation of excitatory post-synaptic currents. The results pave the way for the development of novel bioinspired neuroprosthetics and soft robotics and highlight the potential of quantum dots for achieving versatile neuromorphic functionality in aqueous environments.

A Retina-Inspired Optoelectronic Synapse Using Quantum Dots for Neuromorphic Photostimulation of Neurons

Neuromorphic electronics, inspired by the functions of neurons, have the potential to enable biomimetic communication with cells. Such systems require operation in aqueous environments, generation of sufficient levels of ionic currents for neurostimulation, and plasticity. However, their implementation requires a combination of separate devices, such as sensors, organic synaptic transistors, and stimulation electrodes. Here, a compact neuromorphic synapse that combines photodetection, memory, and neurostimulation functionalities all-in-one is presented. The artificial photoreception is facilitated by a photovoltaic device based on cell-interfacing InP/ZnS quantum dots, which induces photo-faradaic charge-transfer mediated plasticity. The device sends excitatory post-synaptic currents exhibiting paired-pulse facilitation and post-tetanic potentiation to the hippocampal neurons via the biohybrid synapse. The electrophysiological recordings indicate modulation of the probability of action potential firing due to biomimetic temporal summation of excitatory post-synaptic currents. These results pave the way for the development of novel bioinspired neuroprosthetics and soft robotics, and highlight the potential of quantum dots for achieving versatile neuromorphic functionality in aqueous environments.

Multimodal Sensors Enabled Autonomous Soft Robotic System with Self-Adaptive Manipulation

Human hands are amazingly skilled at recognizing and handling objects of different sizes and shapes. To date, soft robots rarely demonstrate autonomy equivalent to that of humans for fine perception and dexterous operation. Here, an intelligent soft robotic system with autonomous operation and multimodal perception ability is developed by integrating capacitive sensors with triboelectric sensor. With distributed multiple sensors, our robot system can not only sense and memorize multimodal information but also enable an adaptive grasping method for robotic positioning and grasp control, during which the multimodal sensory information can be captured sensitively and fused at feature level for crossmodally recognizing objects, leading to a highly enhanced recognition capability. The proposed system, combining the performance and physical intelligence of biological systems (i.e., self-adaptive behavior and multimodal perception), will greatly advance the integration of soft actuators and robotics in many fields.

Recent advancements in implantable neural links based on organic synaptic transistors

The progress of brain synaptic devices has witnessed an era of rapid and explosive growth. Because of their integrated storage, excellent plasticity and parallel computing, and system information processing abilities, various field effect transistors have been used to replicate the synapses of a human brain. Organic semiconductors are characterized by simplicity of processing, mechanical flexibility, low cost, biocompatibility, and flexibility, making them the most promising materials for implanted brain synaptic bioelectronics. Despite being used in numerous intelligent integrated circuits and implantable neural linkages with multiple terminals, organic synaptic transistors still face many obstacles that must be overcome to advance their development. A comprehensive review would be an excellent tool in this respect. Therefore, the latest advancements in implantable neural links based on organic synaptic transistors are outlined. First, the distinction between conventional and synaptic transistors are highlighted. Next, the existing implanted organic synaptic transistors and their applicability to the brain as a neural link are summarized. Finally, the potential research directions are discussed.

Oxide Ionic Neuro-Transistors for Bio-inspired Computing

Current computing systems rely on Boolean logic and von Neumann architecture, where computing cells are based on high-speed electron-conducting complementary metal-oxide-semiconductor (CMOS) transistors. In contrast, ions play an essential role in biological neural computing. Compared with CMOS units, the synapse/neuron computing speed is much lower, but the human brain performs much better in many tasks such as pattern recognition and decision-making. Recently, ionic dynamics in oxide electrolyte-gated transistors have attracted increasing attention in the field of neuromorphic computing, which is more similar to the computing modality in the biological brain. In this review article, we start with the introduction of some ionic processes in biological brain computing. Then, electrolyte-gated ionic transistors, especially oxide ionic transistors, are briefly introduced. Later, we review the state-of-the-art progress in oxide electrolyte-gated transistors for ionic neuromorphic computing including dynamic synaptic plasticity emulation, spatiotemporal information processing, and artificial sensory neuron function implementation. Finally, we will address the current challenges and offer recommendations along with potential research directions.

High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network

The development of neuromorphic visual systems has recently gained momentum due to their potential in areas such as autonomous vehicles and robotics. However, current machine visual systems based on silicon technology usually contain photosensor arrays, format conversion, memory and processing modules. As a result, the redundant data shuttling between each unit, resulting in large latency and high-power consumption, seriously limits the performance of neuromorphic vision chips. Here, we demonstrate an artificial neural network (ANN) architecture based on an integrated 2D MoS2/Ag nanograting phototransistor array, which can simultaneously sense, pre-process and recognize optical images without latency. The pre-processing function of the device under photoelectric synergy ensures considerable improvement of efficiency and accuracy of subsequent image recognition. The comprehensive performance of the proof-of-concept device demonstrates great potential for machine vision applications in terms of large dynamic range (180 dB), high speed (500 ns) and low energy consumption per spike (2.4 × 10-17 J).

Flexible and Stretchable Light-Emitting Diodes and Photodetectors for Human-Centric Optoelectronics

Optoelectronic devices with unconventional form factors, such as flexible and stretchable light-emitting or photoresponsive devices, are core elements for the next-generation human-centric optoelectronics. For instance, these deformable devices can be utilized as closely fitted wearable sensors to acquire precise biosignals that are subsequently uploaded to the cloud for immediate examination and diagnosis, and also can be used for vision systems for human-interactive robotics. Their inception was propelled by breakthroughs in novel optoelectronic material technologies and device blueprinting methodologies, endowing flexibility and mechanical resilience to conventional rigid optoelectronic devices. This paper reviews the advancements in such soft optoelectronic device technologies, honing in on various materials, manufacturing techniques, and device design strategies. We will first highlight the general approaches for flexible and stretchable device fabrication, including the appropriate material selection for the substrate, electrodes, and insulation layers. We will then focus on the materials for flexible and stretchable light-emitting diodes, their device integration strategies, and representative application examples. Next, we will move on to the materials for flexible and stretchable photodetectors, highlighting the state-of-the-art materials and device fabrication methods, followed by their representative application examples. At the end, a brief summary will be given, and the potential challenges for further development of functional devices will be discussed as a conclusion.

Hierarchies in Visual Pathway: Functions and Inspired Artificial Vision

The development of artificial intelligence has posed a challenge to machine vision based on conventional complementary metal-oxide semiconductor (CMOS) circuits owing to its high latency and inefficient power consumption originating from the data shuffling between memory and computation units. Gaining more insights into the function of every part of the visual pathway for visual perception can bring the capabilities of machine vision in terms of robustness and generality. Hardware acceleration of more energy-efficient and biorealistic artificial vision highly necessitates neuromorphic devices and circuits that are able to mimic the function of each part of the visual pathway. In this paper, we review the structure and function of the entire class of visual neurons from the retina to the primate visual cortex within reach (Chapter 2) are reviewed. Based on the extraction of biological principles, the recent hardware-implemented visual neurons located in different parts of the visual pathway are discussed in detail in Chapters 3 and 4. Furthermore, valuable applications of inspired artificial vision in different scenarios (Chapter 5) are provided. The functional description of the visual pathway and its inspired neuromorphic devices/circuits are expected to provide valuable insights for the design of next-generation artificial visual perception systems.

Humidity/Oxygen-Insensitive Organic Synaptic Transistors Based on Optical Radical Effect

For most organic synaptic transistors based on the charge trapping effect, different atmosphere conditions lead to significantly different device performance. Some devices even lose the synaptic responses under vacuum or inert atmosphere. The stable device performance of these organic synaptic transistors under varied working environments with different humidity and oxygen levels can be a challenge. Herein, a moisture- and oxygen-insensitive organic synaptic device based on the organic semiconductor and photoinitiator molecules is reported. Unlike the widely reported charge trapping effect, the photoinduced free radical is utilized to realize the photosynaptic performance. The resulting synaptic transistor displays typical excitatory postsynaptic current, paired-pulse facilitation, learning, and forgetting behaviors. Furthermore, the device exhibits decent and stable photosynaptic performances under high humidity and vacuum conditions. This type of organic synaptic device also demonstrates high potential in ultraviolet B perception based on its environmental stability and broad ultraviolet detection capability. Finally, the contrast-enhanced capability of the device is successfully validated by the single-layer-perceptron/double-layer network based Modified National Institute of Standards and Technology pattern recognition. This work could have important implications for the development of next-generation environment-stable organic synaptic devices and systems.

Artificial Neuron Devices

Efforts to design devices emulating complex cognitive abilities and response processes of biological systems have long been a coveted goal. Recent advancements in flexible electronics, mirroring human tissue's mechanical properties, hold significant promise. Artificial neuron devices, hinging on flexible artificial synapses, bioinspired sensors, and actuators, are meticulously engineered to mimic the biological systems. However, this field is in its infancy, requiring substantial groundwork to achieve autonomous systems with intelligent feedback, adaptability, and tangible problem-solving capabilities. This review provides a comprehensive overview of recent advancements in artificial neuron devices. It starts with fundamental principles of artificial synaptic devices and explores artificial sensory systems, integrating artificial synapses and bioinspired sensors to replicate all five human senses. A systematic presentation of artificial nervous systems follows, designed to emulate fundamental human nervous system functions. The review also discusses potential applications and outlines existing challenges, offering insights into future prospects. We aim for this review to illuminate the burgeoning field of artificial neuron devices, inspiring further innovation in this captivating area of research.

Functional PDMS Elastomers: Bulk Composites, Surface Engineering, and Precision Fabrication

Polydimethylsiloxane (PDMS)-the simplest and most common silicone compound-exemplifies the central characteristics of its class and has attracted tremendous research attention. The development of PDMS-based materials is a vivid reflection of the modern industry. In recent years, PDMS has stood out as the material of choice for various emerging technologies. The rapid improvement in bulk modification strategies and multifunctional surfaces has enabled a whole new generation of PDMS-based materials and devices, facilitating, and even transforming enormous applications, including flexible electronics, superwetting surfaces, soft actuators, wearable and implantable sensors, biomedicals, and autonomous robotics. This paper reviews the latest advances in the field of PDMS-based functional materials, with a focus on the added functionality and their use as programmable materials for smart devices. Recent breakthroughs regarding instant crosslinking and additive manufacturing are featured, and exciting opportunities for future research are highlighted. This review provides a quick entrance to this rapidly evolving field and will help guide the rational design of next-generation soft materials and devices.

Ion trap and release dynamics enables nonintrusive tactile augmentation in monolithic sensory neuron

An iontronic-based artificial tactile nerve is a promising technology for emulating the tactile recognition and learning of human skin with low power consumption. However, its weak tactile memory and complex integration structure remain challenging. We present an ion trap and release dynamics (iTRD)-driven, neuro-inspired monolithic artificial tactile neuron (NeuroMAT) that can achieve tactile perception and memory consolidation in a single device. Through the tactile-driven release of ions initially trapped within iTRD-iongel, NeuroMAT only generates nonintrusive synaptic memory signals when mechanical stress is applied under voltage stimulation. The induced tactile memory is augmented by auxiliary voltage pulses independent of tactile sensing signals. We integrate NeuroMAT with an anthropomorphic robotic hand system to imitate memory-based human motion; the robust tactile memory of NeuroMAT enables the hand to consistently perform reliable gripping motion.

Biodegradable Oxide Neuromorphic Transistors for Neuromorphic Computing and Anxiety Disorder Emulation

Brain-inspired neuromorphic computing and portable intelligent electronic products have received increasing attention. In the present work, nanocellulose-gated indium tin oxide neuromorphic transistors are fabricated. The device exhibits good electrical performance. Short-term synaptic plasticities were mimicked, including excitatory postsynaptic current, paired-pulse facilitation, and dynamic high-pass synaptic filtering. Interestingly, an effective linear synaptic weight updating strategy was adopted, resulting in an excellent recognition accuracy of ∼92.93% for the Modified National Institute of Standard and Technology database adopting a two-layer multilayer perceptron neural network. Moreover, with unique interfacial protonic coupling, anxiety disorder behavior was conceptually emulated, exhibiting "neurosensitization", "primary and secondary fear", and "fear-adrenaline secretion-exacerbated fear". Finally, the neuromorphic transistors could be dissolved in water, demonstrating potential in "green" electronics. These findings indicate that the proposed oxide neuromorphic transistors would have potential as implantable chips for nerve health diagnosis, neural prostheses, and brain-machine interfaces.

Trainable Bilingual Synaptic Functions in Bio-enabled Synaptic Transistors

The signal transmission of the nervous system is regulated by neurotransmitters. Depending on the type of neurotransmitter released by presynaptic neurons, neuron cells can either be excited or inhibited. Maintaining a balance between excitatory and inhibitory synaptic responses is crucial for the nervous system's versatility, elasticity, and ability to perform parallel computing. On the way to mimic the brain's versatility and plasticity traits, creating a preprogrammed balance between excitatory and inhibitory responses is required. Despite substantial efforts to investigate the balancing of the nervous system, a complex circuit configuration has been suggested to simulate the interaction between excitatory and inhibitory synapses. As a meaningful approach, an optoelectronic synapse for balancing the excitatory and inhibitory responses assisted by light mediation is proposed here by deploying humidity-sensitive chiral nematic phases of known polysaccharide cellulose nanocrystals. The environment-induced pitch tuning changes the polarization of the helicoidal organization, affording different hysteresis effects with the subsequent excitatory and inhibitory nonvolatile behavior in the bio-electrolyte-gated transistors. By applying voltage pulses combined with stimulation of chiral light, the artificial optoelectronic synapse tunes not only synaptic functions but also learning pathways and color recognition. These multifunctional bio-based synaptic field-effect transistors exhibit potential for enhanced parallel neuromorphic computing and robot vision technology.

Tactile Features of Human Finger Contact Motor Primitives

The human hand interacts with the environment via physical contact, and tactile information is closely associated with finger movement patterns. Studying the relationship between motor primitives of the finger and the corresponding tactile feedback provides valuable insight into the nature of touch and informs the simulation of humanoid tactile. This research decomposed finger contact into three fundamental motor primitives: contact-on, stick-to-slip, and full slip, then examined the tactile features associated with each motor primitive, including the center of mass (COM) and the centroid of the contact pressure distribution matrix and the total contact area. The change in fingertip contact area during contact-on was in accordance with a first-order kinetic model. In the stick-to-slip, there was a generalized linear relationship between the fingertip skin stretch and the magnitude of the tangential force. Moreover, the skin stretch of the fingertip mirrored the direction of the motion. During the full slip, the COM's movement effectively represented the direction of the tangential force, with an error margin of no more than five degrees. Experiments showed that certain fingertip motions can be portrayed, transmitted, and replicated using tactile information. This research opens potential avenues for remote immersive physical communication in robotics and other related fields.