A Digital Hardware Realization for Spiking Model of Cutaneous Mechanoreceptor

Artificial sensory system based on memristive devices

In the biological nervous system, the integration and cooperation of parallel system of receptors, neurons, and synapses allow efficient detection and processing of intricate and disordered external information. Such systems acquire and process environmental data in real-time, efficiently handling complex tasks with minimal energy consumption. Memristors can mimic typical biological receptors, neurons, and synapses by implementing key features of neuronal signal-processing functions such as selective adaption in receptors, leaky integrate-and-fire in neurons, and synaptic plasticity in synapses. External stimuli are sensitively detected and filtered by "artificial receptors," encoded into spike signals via "artificial neurons," and integrated and stored through "artificial synapses." The high operational speed, low power consumption, and superior scalability of memristive devices make their integration with high-performance sensors a promising approach for creating integrated artificial sensory systems. These integrated systems can extract useful data from a large volume of raw data, facilitating real-time detection and processing of environmental information. This review explores the recent advances in memristor-based artificial sensory systems. The authors begin with the requirements of artificial sensory elements and then present an in-depth review of such elements demonstrated by memristive devices. Finally, the major challenges and opportunities in the development of memristor-based artificial sensory systems are discussed.

Correlations among Firing Rates of Tactile, Thermal, Gustatory, Olfactory, and Auditory Sensations Mimicked by Artificial Hybrid Fluid (HF) Rubber Mechanoreceptors

In order to advance the development of sensors fabricated with monofunctional sensation systems capable of a versatile response to tactile, thermal, gustatory, olfactory, and auditory sensations, mechanoreceptors fabricated as a single platform with an electric circuit require investigation. In addition, it is essential to resolve the complicated structure of the sensor. In order to realize the single platform, our proposed hybrid fluid (HF) rubber mechanoreceptors of free nerve endings, Merkel cells, Krause end bulbs, Meissner corpuscles, Ruffini endings, and Pacinian corpuscles mimicking the bio-inspired five senses are useful enough to facilitate the fabrication process for the resolution of the complicated structure. This study used electrochemical impedance spectroscopy (EIS) to elucidate the intrinsic structure of the single platform and the physical mechanisms of the firing rate such as slow adaption (SA) and fast adaption (FA), which were induced from the structure and involved the capacitance, inductance, reactance, etc. of the HF rubber mechanoreceptors. In addition, the relations among the firing rates of the various sensations were clarified. The adaption of the firing rate in the thermal sensation is the opposite of that in the tactile sensation. The firing rates in the gustation, olfaction, and auditory sensations at frequencies of less than 1 kHz have the same adaption as in the tactile sensation. The present findings are useful not only in the field of neurophysiology, to research the biochemical reactions of neurons and brain perceptions of stimuli, but also in the field of sensors, to advance salient developments in sensors mimicking bio-inspired sensations.

Estimation of Fast and Slow Adaptions in the Tactile Sensation of Mechanoreceptors Mimicked by Hybrid Fluid (HF) Rubber with Equivalent Electric Circuits and Properties

In order to advance engineering applications of robotics such as wearable health-monitoring devices, humanoid robots, etc., it is essential to investigate the tactile sensations of artificial haptic sensors mimicking bioinspired human cutaneous mechanoreceptors such as free nerve endings, Merkel's cells, Krause end bulbs, Meissner corpuscles, Ruffini endings, and Pacinian corpuscles. The generated receptor's potential response to extraneous stimuli, categorized as slow adaption (SA) or fast adaption (FA), is particularly significant as a typical property. The present study addressed the estimation of SA and FA by utilizing morphologically fabricated mechanoreceptors made of our proposed magnetically responsive intelligent fluid, hybrid fluid (HF), and by applying our proposed electrolytic polymerization. Electric circuit models of the mechanoreceptors were generated using experimental data on capacitance and inductance on the basis of the electric characteristics of impedance. The present results regarding equivalent firing rates based on FA and SA are consistent with the FA and SA findings of vital mechanoreceptors by biomedical analysis. The present investigative process is useful to clarify the time of response to a force on the fabricated artificial mechanoreceptor.

A review of motor neural system robotic modeling approaches and instruments

In this review, we are considering an actively developing tool in neuroscience-robotic modeling. The new perspective and existing application fields, tools, and methods are discussed. We try to determine starting positions and approaches that are useful at the beginning of new research in this field. Among multiple directions of the research is robotic modeling on the level of muscles fibers and their afferents, skin surface sensors, muscles, and joints proprioceptors. Some examples of technical implementation for physical modeling are reviewed. They are software and hardware tools like event-related modeling algorithms, reduced neuron models, robotic drives constructions. We observe existing drives technologies and prospective electric motor types: switched reluctance and transverse flux motors. Next, we look at the existing examples and approaches for robotic modeling of the cerebellum and spinal cord neural networks. These examples show practical methods for the model neural network architecture and adaptation. Those methods allow the use of cortical and spinal cord reflexes for the network training and apply additional artificial blocks for data processing in other brain structures that transmit and receive data from biologically realistic models.

Self-Powered Artificial Mechanoreceptor Based on Triboelectrification for a Neuromorphic Tactile System

A self-powered artificial mechanoreceptor module is demonstrated with a triboelectric nanogenerator (TENG) as a pressure sensor with sustainable energy harvesting and a biristor as a neuron. By mimicking a biological mechanoreceptor, it simultaneously detects the pressure and encodes spike signals to act as an input neuron of a spiking neural network (SNN). A self-powered neuromorphic tactile system composed of artificial mechanoreceptor modules with an energy harvester can greatly reduce the power consumption compared to the conventional tactile system based on von Neumann computing, as the artificial mechanoreceptor module itself does not demand an external energy source and information is transmitted with spikes in a SNN. In addition, the system can detect low pressures near 3 kPa due to the high output range of the TENG. It therefore can be advantageously applied to robotics, prosthetics, and medical and healthcare devices, which demand low energy consumption and low-pressure detection levels. For practical applications of the neuromorphic tactile system, classification of handwritten digits is demonstrated with a software-based simulation. Furthermore, a fully hardware-based breath-monitoring system is implemented using artificial mechanoreceptor modules capable of detecting wind pressure of exhalation in the case of pulmonary respiration and bending pressure in the case of abdominal breathing.

A Skin-Inspired Artificial Mechanoreceptor for Tactile Enhancement and Integration

Mechanoreceptors endow humans with the sense of touch by translating the external stimuli into coded spikes, inspiring the rise of artificial mechanoreceptor systems. However, to incorporate slow adaptive receptors-like pressure sensors with artificial neurons remains a challenge. Here we demonstrate an artificial mechanoreceptor by rationally integrating a polypyrrole-based resistive pressure sensor with a volatile NbO_x memristor, to mimic the tactile sensation and perception in natural skin, respectively. The artificial mechanoreceptor enables the tactile sensory coding by converting the external mechanical stimuli into strength-modulated electrical spikes. Also, tactile sensation enhancement is achieved by processing the spike frequency characteristics with the pulse coupled neural network. Furthermore, the artificial mechanoreceptor can integrate signals from parallel sensor channels and encode them into unified electrical spikes, resembling the coding of intensity in tactile neural processing. These results provide simple and efficient strategies for constructing future bio-inspired electronic systems.

A Biomimetic Circuit for Electronic Skin With Application in Hand Prosthesis

One major challenge in upper limb prostheses is providing sensory feedback to amputees. Reproducing the spiking patterns of human primary tactile afferents can be considered as the first step for this challenging problem. In this study, a novel biomimetic circuit for SA-I and RA-I afferents is proposed to functionally replicate the spiking response of the biological tactile afferents to indentation stimuli. The circuit has been designed, laid out, and simulated in TSMC 180nm CMOS technology with a 1.8V supply voltage. A pair of SA-I and RA-I afferent circuits consume [Formula: see text] of power. The occupied silicon area is [Formula: see text] for 32 afferents. To provide the inputs for circuit testing, a patch of skin with a grid of mechanoreceptors is simulated and tested by an edge stimulus presented at different orientations. Experimental data are collected using indentation of 3D-printed edges at different orientations on a tactile sensor mounted on a robotic arm. Inspired by innervation patterns observed in biology, the artificial afferents are connected to several neighboring mechanoreceptors with different weights to form complex receptive fields which cover the entire mechanoreceptor grid. Machine learning algorithms are applied offline to classify the edge orientations based on the pattern of neural responses. Our results show that the complex receptive fields arising from the innervation pattern led to smaller circuit area and lower power consumption, while facilitating data encoding from high-resolution sensors. The proposed biomimetic circuit and tactile encoding example demonstrate potential applications in modern tactile sensing modules for developing novel bio-robotic and prosthetic technologies.

Sharpness recognition based on synergy between bio-inspired nociceptors and tactile mechanoreceptors

Touch and pain sensations are complementary aspects of daily life that convey crucial information about the environment while also providing protection to our body. Technological advancements in prosthesis design and control mechanisms assist amputees to regain lost function but often they have no meaningful tactile feedback or perception. In the present study, we propose a bio-inspired tactile system with a population of 23 digital afferents: 12 RA-I, 6 SA-I, and 5 nociceptors. Indeed, the functional concept of the nociceptor is implemented on the FPGA for the first time. One of the main features of biological tactile afferents is that their distal axon branches in the skin, creating complex receptive fields. Given these physiological observations, the bio-inspired afferents are randomly connected to the several neighboring mechanoreceptors with different weights to form their own receptive field. To test the performance of the proposed neuromorphic chip in sharpness detection, a robotic system with three-degree of freedom equipped with the tactile sensor indents the 3D-printed objects. Spike responses of the biomimetic afferents are then collected for analysis by rate and temporal coding algorithms. In this way, the impact of the innervation mechanism and collaboration of afferents and nociceptors on sharpness recognition are investigated. Our findings suggest that the synergy between sensory afferents and nociceptors conveys more information about tactile stimuli which in turn leads to the robustness of the proposed neuromorphic system against damage to the taxels or afferents. Moreover, it is illustrated that spiking activity of the biomimetic nociceptors is amplified as the sharpness increases which can be considered as a feedback mechanism for prosthesis protection. This neuromorphic approach advances the development of prosthesis to include the sensory feedback and to distinguish innocuous (non-painful) and noxious (painful) stimuli.

A functional spiking neuronal network for tactile sensing pathway to process edge orientation

To obtain deeper insights into the tactile processing pathway from a population-level point of view, we have modeled three stages of the tactile pathway from the periphery to the cortex in response to indentation and scanned edge stimuli at different orientations. Three stages in the tactile pathway are, (1) the first-order neurons which innervate the cutaneous mechanoreceptors, (2) the cuneate nucleus in the midbrain and (3) the cortical neurons of the somatosensory area. In the proposed network, the first layer mimics the spiking patterns generated by the primary afferents. These afferents have complex skin receptive fields. In the second layer, the role of lateral inhibition on projection neurons in the cuneate nucleus is investigated. The third layer acts as a biomimetic decoder consisting of pyramidal and cortical interneurons that correspond to heterogeneous receptive fields with excitatory and inhibitory sub-regions on the skin. In this way, the activity of pyramidal neurons is tuned to the specific edge orientations. By modifying afferent receptive field size, it is observed that the larger receptive fields convey more information about edge orientation in the first spikes of cortical neurons when edge orientation stimuli move across the patch of skin. In addition, the proposed spiking neural model can detect edge orientation at any location on the simulated mechanoreceptor grid with high accuracy. The results of this research advance our knowledge about tactile information processing and can be employed in prosthetic and bio-robotic applications.

A Digital Hardware System for Spiking Network of Tactile Afferents

In the present research, we explore the possibility of utilizing a hardware-based neuromorphic approach to develop a tactile sensory system at the level of first-order afferents, which are slowly adapting type 1 (SA-I) and fast adapting type 1 (FA-I) afferents. Four spiking models are used to mimic neural signals of both SA-I and FA-I primary afferents. Next, a digital circuit is designed for each spiking model for both afferents to be implemented on the field-programmable gate array (FPGA). The four different digital circuits are then compared from source utilization point of view to find the minimum cost circuit for creating a population of digital afferents. In this way, the firing responses of both SA-I and FA-I afferents are physically measured in hardware. Finally, a population of 243 afferents consisting of 90 SA-I and 153 FA-I digital neuromorphic circuits are implemented on the FPGA. The FPGA also receives nine inputs from the force sensors through an interfacing board. Therefore, the data of multiple inputs are processed by the spiking network of tactile afferents, simultaneously. Benefiting from parallel processing capabilities of FPGA, the proposed architecture offers a low-cost neuromorphic structure for tactile information processing. Applying machine learning algorithms on the artificial spiking patterns collected from FPGA, we successfully classified three different objects based on the firing rate paradigm. Consequently, the proposed neuromorphic system provides the opportunity for development of new tactile processing component for robotic and prosthetic applications.