Hybrid-Flexible Bimodal Sensing Wearable Glove System for Complex Hand Gesture Recognition

Millimeter wave gesture recognition using multi-feature fusion models in complex scenes

As a form of body language, the gesture plays an important role in smart homes, game interactions, and sign language communication, etc. The gesture recognition methods have been carried out extensively. The existing methods have inherent limitations regarding user experience, visual environment, and recognition granularity. Millimeter wave radar provides an effective method for the problems lie ahead gesture recognition because of the advantage of considerable bandwidth and high precision perception. Interfering factors and the complexity of the model raise an enormous challenge to the practical application of gesture recognition methods as the millimeter wave radar is applied to complex scenes. Based on multi-feature fusion, a gesture recognition method for complex scenes is proposed in this work. We collected data in variety places to improve sample reliability, filtered clutters to improve the signal's signal-to-noise ratio (SNR), and then obtained multi features involves range-time map (RTM), Doppler-time map (DTM) and angle-time map (ATM) and fused them to enhance the richness and expression ability of the features. A lightweight neural network model multi-CNN-LSTM is designed to gestures recognition. This model consists of three convolutional neural network (CNN) for three obtained features and one long short-term memory (LSTM) for temporal features. We analyzed the performance and complexity of the model and verified the effectiveness of feature extraction. Numerous experiments have shown that this method has generalization ability, adaptability, and high robustness in complex scenarios. The recognition accuracy of 14 experimental gestures reached 97.28%.

Incorporating Machine Learning Strategies to Smart Gloves Enabled by Dual-Network Hydrogels for Multitask Control and User Identification

Smart gloves are often used in human-computer interaction scenarios due to their portability and ease of integration. However, their application in the field of information security has been less studied. Herein, we propose a smart glove using an iontronic capacitive sensor with significant pressure-sensing performance. Besides, an operator interface has been developed to match the smart glove, which is capable of multitasking integration of mouse movement, music playback, game control, and message typing in Internet chat rooms by capturing and encoding finger-tapping movements. In addition, by integrating machine learning, we can mine the characteristics of individual behavioral habits contained in the sensor signals and, based on this, achieve a deep binding of the user to the smart glove. The proposed smart glove can greatly facilitate people's lives, as well as explore a new strategy in research on the application of smart gloves in data security.

Proximity Sensing Electronic Skin: Principles, Characteristics, and Applications

The research on proximity sensing electronic skin has garnered significant attention. This electronic skin technology enables detection without physical contact and holds vast application prospects in areas such as human-robot collaboration, human-machine interfaces, and remote monitoring. Especially in the context of the spread of infectious diseases like COVID-19, there is a pressing need for non-contact detection to ensure safe and hygienic operations. This article comprehensively reviews the significant advancements in the field of proximity sensing electronic skin technology in recent years. It covers the principles, as well as single-type proximity sensors with characteristics such as a large area, multifunctionality, strain, and self-healing capabilities. Additionally, it delves into the research progress of dual-type proximity sensors. Furthermore, the article places a special emphasis on the widespread applications of flexible proximity sensors in human-robot collaboration, human-machine interfaces, and remote monitoring, highlighting their importance and potential value across various domains. Finally, the paper provides insights into future advancements in flexible proximity sensor technology.

Bioinspired nanoplatforms for human-machine interfaces: Recent progress in materials and device applications

The panoramic characteristics of human-machine interfaces (HMIs) have prompted the needs to update the biotechnology community with the recent trends, developments, and future research direction toward next-generation bioelectronics. Bioinspired materials are promising for integrating various bioelectronic devices to realize HMIs. With the advancement of scientific biotechnology, state-of-the-art bioelectronic applications have been extensively investigated to improve the quality of life by developing and integrating bioinspired nanoplatforms in HMIs. This review highlights recent trends and developments in the field of biotechnology based on bioinspired nanoplatforms by demonstrating recently explored materials and cutting-edge device applications. Section 1 introduces the recent trends and developments of bioinspired nanomaterials for HMIs. Section 2 reviews various flexible, wearable, biocompatible, and biodegradable nanoplatforms for bioinspired applications. Section 3 furnishes recently explored substrates as carriers for advanced nanomaterials in developing HMIs. Section 4 addresses recently invented biomimetic neuroelectronic, nanointerfaces, biointerfaces, and nano/microfluidic wearable bioelectronic devices for various HMI applications, such as healthcare, biopotential monitoring, and body fluid monitoring. Section 5 outlines designing and engineering of bioinspired sensors for HMIs. Finally, the challenges and opportunities for next-generation bioinspired nanoplatforms in extending the potential on HMIs are discussed for a near-future scenario. We believe this review can stimulate the integration of bioinspired nanoplatforms into the HMIs in addition to wearable electronic skin and health-monitoring devices while addressing prevailing and future healthcare and material-related problems in biotechnologies.

Machine Learning-Enabled Intelligent Gesture Recognition and Communication System Using Printed Strain Sensors

Gesture contains abundant and complicated information in daily life; as a consequence, gesture recognition attracts a wide range of application prospects and academic values as an important way of achieving human-machine interactions (HMIs). Here, we report an intelligent system consisting of a smart glove made by printed CNT-graphene/PDMS strain sensors. The smart glove shows excellent fitness, comfort, and lightness for human hands. Inspired by machine learning strategies, several objects and gestures can be well classified and implemented by a customized artificial neural network. Several data sets of different sign language gestures and object-grabbing gestures were established, and the result shows that the intelligent system can achieve an average accuracy of 97% and up to 99.4% for a number of gesture groups. Moreover, a robot hand is connected to this system, which is able to react to the motion of human hands with certain gestures where simple sign communication is achieved. These features provide a feasible practical application scheme for gesture recognition in HMIs.

Technology Roadmap for Flexible Sensors

Humans rely increasingly on sensors to address grand challenges and to improve quality of life in the era of digitalization and big data. For ubiquitous sensing, flexible sensors are developed to overcome the limitations of conventional rigid counterparts. Despite rapid advancement in bench-side research over the last decade, the market adoption of flexible sensors remains limited. To ease and to expedite their deployment, here, we identify bottlenecks hindering the maturation of flexible sensors and propose promising solutions. We first analyze challenges in achieving satisfactory sensing performance for real-world applications and then summarize issues in compatible sensor-biology interfaces, followed by brief discussions on powering and connecting sensor networks. Issues en route to commercialization and for sustainable growth of the sector are also analyzed, highlighting environmental concerns and emphasizing nontechnical issues such as business, regulatory, and ethical considerations. Additionally, we look at future intelligent flexible sensors. In proposing a comprehensive roadmap, we hope to steer research efforts towards common goals and to guide coordinated development strategies from disparate communities. Through such collaborative efforts, scientific breakthroughs can be made sooner and capitalized for the betterment of humanity.

Machine Learning-Enhanced Flexible Mechanical Sensing

To realize a hyperconnected smart society with high productivity, advances in flexible sensing technology are highly needed. Nowadays, flexible sensing technology has witnessed improvements in both the hardware performances of sensor devices and the data processing capabilities of the device's software. Significant research efforts have been devoted to improving materials, sensing mechanism, and configurations of flexible sensing systems in a quest to fulfill the requirements of future technology. Meanwhile, advanced data analysis methods are being developed to extract useful information from increasingly complicated data collected by a single sensor or network of sensors. Machine learning (ML) as an important branch of artificial intelligence can efficiently handle such complex data, which can be multi-dimensional and multi-faceted, thus providing a powerful tool for easy interpretation of sensing data. In this review, the fundamental working mechanisms and common types of flexible mechanical sensors are firstly presented. Then how ML-assisted data interpretation improves the applications of flexible mechanical sensors and other closely-related sensors in various areas is elaborated, which includes health monitoring, human-machine interfaces, object/surface recognition, pressure prediction, and human posture/motion identification. Finally, the advantages, challenges, and future perspectives associated with the fusion of flexible mechanical sensing technology and ML algorithms are discussed. These will give significant insights to enable the advancement of next-generation artificial flexible mechanical sensing.

All Solution-Processed Inorganic, Multilevel Memristors Utilizing Liquid Metals Electrodes Suitable for Analog Computing

Herein, we report a solution-processable memristive device based on bismuth vanadate (BiVO₄) and titanium dioxide (TiO₂) with gallium-based eutectic gallium-indium (EGaIn) and gallium-indium-tin alloy (GaInSn) liquid metal as the top electrode. Scanning electron microscopy (SEM) shows the formation of a nonporous structure of BiVO₄ and TiO₂ for efficient resistive switching. Additionally, the gallium-based liquid metal (GLM)-contacted memristors exhibit stable memristor behavior over a wide temperature range from -10 to +90 °C. Gallium atoms in the liquid metal play an important role in the conductive filament formation as well as the device's operation stability as elucidated by I-V characteristics. The synaptic behavior of the GLM-memristors was characterized, with excellent long-term potentiation (LTP) and long-term depression (LTD) linearity. Using the performance of our device in a multilayer perceptron (MLP) network, a ∼90% accuracy in the handwriting recognition of modified national institute of standards and technology database (MNIST) was achieved. Our findings pave a path for solution-processed/GLM-based memristors which can be used in neuromorphic applications on flexible substrates in a harsh environment.

A Flexible, Wearable, and Wireless Biosensor Patch with Internet of Medical Things Applications

Monitoring the vital signs and physiological responses of the human body in daily activities is particularly useful for the early diagnosis and prevention of cardiovascular diseases. Here, we proposed a wireless and flexible biosensor patch for continuous and longitudinal monitoring of different physiological signals, including body temperature, blood pressure (BP), and electrocardiography. Moreover, these modalities for tracking body movement and GPS locations for emergency rescue have been included in biosensor devices. We optimized the flexible patch design with high mechanical stretchability and compatibility that can provide reliable and long-term attachment to the curved skin surface. Regarding smart healthcare applications, this research presents an Internet of Things-connected healthcare platform consisting of a smartphone application, website service, database server, and mobile gateway. The IoT platform has the potential to reduce the demand for medical resources and enhance the quality of healthcare services. To further address the advances in non-invasive continuous BP monitoring, an optimized deep learning architecture with one-channel electrocardiogram signals is introduced. The performance of the BP estimation model was verified using an independent dataset; this experimental result satisfied the Association for the Advancement of Medical Instrumentation, and the British Hypertension Society standards for BP monitoring devices. The experimental results demonstrated the practical application of the wireless and flexible biosensor patch for continuous physiological signal monitoring with Internet of Medical Things-connected healthcare applications.