Bioinspired Stretchable Fiber-Based Sensor toward Intelligent Human-Machine Interactions

Wearable Photonic Artificial Throat for Silent Communication and Speech Recognition

Advocating for the voices of the disabled, particularly through wearable artificial throats, has garnered significant attention recently. Such devices necessitate sensors with stretchability, high sensitivity, and excellent skin conformability. In this study, an intelligent photonic artificial throat has been developed. It features a sandwich-structured optical fiber sensor encapsulated in Dragon Skin 20, which has an elastic modulus similar to human tissue and is integrated with sensitivity-enhancing rings and fabric for enhanced wearability. With ultrafast response (response time: 10 ms, recovery time: 32 ms) and high sensitivity (1.92 μW/mN), it detects throat area vibrations and muscle contractions, accurately identifying tones in Mandarin, vowels, words, and sentences in English, achieving accurate bilingual detection. It also distinguishes animal sounds (horse neighing and cuckoo's call) and pop songs when mounted on speakers. Furthermore, the artificial throat can accurately detect subtle movements of the head and neck, and by combining nodding actions with the MORSE code, silent communication between individuals has been successfully achieved. Integrated with an advanced artificial intelligence (AI) algorithm, it recognizes tones (97.50%), vowel letters (97.00%), common words (98.00%) and sentences (96.52%), opening prospects for biomedical applications, language education, speech recognition, motion monitoring, and more.

Multimodal Flexible Sensor for the Detection of Pressing-Bending-Twisting Mechanical Deformations

Flexible sensors are increasingly significant in applications such as smart wearables and human-computer interactions. However, typical flexible sensors are spatially limited and can generally detect only one deformation mode. This study presents a novel multimodal flexible sensor that combines three sensing units: optoelectronics, ionic liquids, and conductive fabrics. It employs a sophisticated superposition and combination of the three sensing methods to achieve up to eight mechanical deformations, including pressing, bending, twisting, and combinations thereof, all within a very small sensor space. This sensor has excellent detection performance, high sensitivity (optoelectronics 4.312, ionic liquid 8.186, conductive fabric 2.438), a wide measurement range (pressing 0-75 kPa, bending 0-90°, and twisting 0-180°), and good consistency and repeatability. To address the signal coupling problem in multimode sensors, a deep learning method based on the Transformer is combined to provide precise decoupling of multimode signals and high-precision characterization of each mechanical deformation. Finally, the wrist joint experiments demonstrate the sensor's versatile uses in human-computer interaction.

Toward an AI Era: Advances in Electronic Skins

Electronic skins (e-skins) have seen intense research and rapid development in the past two decades. To mimic the capabilities of human skin, a multitude of flexible/stretchable sensors that detect physiological and environmental signals have been designed and integrated into functional systems. Recently, researchers have increasingly deployed machine learning and other artificial intelligence (AI) technologies to mimic the human neural system for the processing and analysis of sensory data collected by e-skins. Integrating AI has the potential to enable advanced applications in robotics, healthcare, and human-machine interfaces but also presents challenges such as data diversity and AI model robustness. In this review, we first summarize the functions and features of e-skins, followed by feature extraction of sensory data and different AI models. Next, we discuss the utilization of AI in the design of e-skin sensors and address the key topic of AI implementation in data processing and analysis of e-skins to accomplish a range of different tasks. Subsequently, we explore hardware-layer in-skin intelligence before concluding with an analysis of the challenges and opportunities in the various aspects of AI-enabled e-skins.

Highly efficient recognition of similar objects based on ionic robotic tactile sensors

Tactile sensing provides robots the ability of object recognition, fine operation, natural interaction, etc. However, in the actual scenario, robotic tactile recognition of similar objects still faces difficulties such as low efficiency and accuracy, resulting from a lack of high-performance sensors and intelligent recognition algorithms. In this paper, a flexible sensor combining a pyramidal microstructure with a gradient conformal ionic gel coating was demonstrated, exhibiting excellent signal-to-noise ratio (48 dB), low detection limit (1 Pa), high sensitivity (92.96 kPa-1), fast response time (55 ms), and outstanding stability over 15,000 compression-release cycles. Furthermore, a Pressure-Slip Dual-Branch Convolutional Neural Network (PSNet) architecture was proposed to separately extract hardness and texture features and perform feature fusion. In tactile experiments on different kinds of leaves, a recognition rate of 97.16% was achieved, and surpassed that of human hands recognition (72.5%). These researches showed the great potential in a broad application in bionic robots, intelligent prostheses, and precise human-computer interaction.

AI-Assisted Insole Sensing System for Multifunctional Plantar-Healthcare Applications

The pervasive global issue of population aging has led to a growing demand for health monitoring, while the advent of electronic wearable devices has greatly alleviated the strain on the industry. However, these devices come with inherent limitations, such as electromagnetic radiation, complex structures, and high prices. Herein, a Solaris silicone rubber-integrated PMMA polymer optical fiber (S-POF) intelligent insole sensing system has been developed for remote, portable, cost-effective, and real-time gait monitoring. The system is capable of sensitively converting the pressure of key points on the sole into changes in light intensity with correlation coefficients of 0.995, 0.952, and 0.910. The S-POF sensing structure demonstrates excellent durability with a 4.8% variation in output after 10,000 cycles and provides stable feedback for bending angles. It also exhibits water resistance and temperature resistance within a certain range. Its multichannel multiplexing framework allows a smartphone to monitor multiple S-POF channels simultaneously, meeting the requirements of convenience for daily care. Also, the system can efficiently and accurately provide parameters such as pressure, step cadence, and pressure distribution, enabling the analysis of gait phases and patterns with errors of only 4.16% and 6.25% for the stance phase (STP) and the swing phase (SWP), respectively. Likewise, after comparing various AI models, an S-POF channel-based gait pattern recognition technique has been proposed with a high accuracy of up to 96.87%. Such experimental results demonstrate that the system is promising to further promote the development of rehabilitation and healthcare.

A Review of Wearable Optical Fiber Sensors for Rehabilitation Monitoring

As the global aging population increases, the demand for rehabilitation of elderly hand conditions has attracted increased attention in the field of wearable sensors. Owing to their distinctive anti-electromagnetic interference properties, high sensitivity, and excellent biocompatibility, optical fiber sensors exhibit substantial potential for applications in monitoring finger movements, physiological parameters, and tactile responses during rehabilitation. This review provides a brief introduction to the principles and technologies of various fiber sensors, including the Fiber Bragg Grating sensor, self-luminescent stretchable optical fiber sensor, and optic fiber Fabry-Perot sensor. In addition, specific applications are discussed within the rehabilitation field. Furthermore, challenges inherent to current optical fiber sensing technology, such as enhancing the sensitivity and flexibility of the sensors, reducing their cost, and refining system integration, are also addressed. Due to technological developments and greater efforts by researchers, it is likely that wearable optical fiber sensors will become commercially available and extensively utilized for rehabilitation.

Stretchable Electronics with Strain-Resistive Performance

Stretchable electronics have attracted tremendous attention amongst academic and industrial communities due to their prospective applications in personal healthcare, human-activity monitoring, artificial skins, wearable displays, human-machine interfaces, etc. Other than mechanical robustness, stable performances under complex strains in these devices that are not for strain sensing are equally important for practical applications. Here, a comprehensive summarization of recent advances in stretchable electronics with strain-resistive performance is presented. First, detailed overviews of intrinsically strain-resistive stretchable materials, including conductors, semiconductors, and insulators, are given. Then, systematic representations of advanced structures, including helical, serpentine, meshy, wrinkled, and kirigami-based structures, for strain-resistive performance are summarized. Next, stretchable arrays and circuits with strain-resistive performance, that integrate multiple functionalities and enable complex behaviors, are introduced. This review presents a detailed overview of recent progress in stretchable electronics with strain-resistive performances and provides a guideline for the future development of stretchable electronics.

PDMS-embedded wearable FBG sensors for gesture recognition and communication assistance

This study introduces fiber Bragg grating (FBG) sensors embedded in polydimethylsiloxane (PDMS) silicone elastomer specifically engineered for recognizing intricate gestures like wrist pitch, finger bending, and mouth movement. Sensors with different PDMS patch thicknesses underwent evaluation including thermal, tensile strain, and bending deformation characterization, demonstrating a stability of at least four months. Experiments revealed the FBG sensors' accurate wrist pitch recognition across participants after calibration, confirmed by statistical metrics and Bland-Altman plots. Utilizing finger and mouth movements, the developed system shows promise in assisting post-stroke patients and individuals with disabilities, enhancing their interaction capabilities with the external surroundings.

Porous Conductive Textiles for Wearable Electronics

Over the years, researchers have made significant strides in the development of novel flexible/stretchable and conductive materials, enabling the creation of cutting-edge electronic devices for wearable applications. Among these, porous conductive textiles (PCTs) have emerged as an ideal material platform for wearable electronics, owing to their light weight, flexibility, permeability, and wearing comfort. This Review aims to present a comprehensive overview of the progress and state of the art of utilizing PCTs for the design and fabrication of a wide variety of wearable electronic devices and their integrated wearable systems. To begin with, we elucidate how PCTs revolutionize the form factors of wearable electronics. We then discuss the preparation strategies of PCTs, in terms of the raw materials, fabrication processes, and key properties. Afterward, we provide detailed illustrations of how PCTs are used as basic building blocks to design and fabricate a wide variety of intrinsically flexible or stretchable devices, including sensors, actuators, therapeutic devices, energy-harvesting and storage devices, and displays. We further describe the techniques and strategies for wearable electronic systems either by hybridizing conventional off-the-shelf rigid electronic components with PCTs or by integrating multiple fibrous devices made of PCTs. Subsequently, we highlight some important wearable application scenarios in healthcare, sports and training, converging technologies, and professional specialists. At the end of the Review, we discuss the challenges and perspectives on future research directions and give overall conclusions. As the demand for more personalized and interconnected devices continues to grow, PCT-based wearables hold immense potential to redefine the landscape of wearable technology and reshape the way we live, work, and play.

Optical Microfiber Intelligent Sensor: Wearable Cardiorespiratory and Behavior Monitoring with a Flexible Wave-Shaped Polymer Optical Microfiber

With the advantages of high flexibility, strong real-time monitoring capabilities, and convenience, wearable devices have shown increasingly powerful application potential in medical rehabilitation, health monitoring, the Internet of Things, and human-computer interaction. In this paper, we propose a novel and wearable optical microfiber intelligent sensor based on a wavy-shaped polymer optical microfiber (WPOMF) for cardiorespiratory and behavioral monitoring of humans. The optical fibers based on polymer materials are prepared into optical microfibers, fully using the advantages of the polymer material and optical microfibers. The prepared polymer optical microfiber is designed into a flexible wave-shaped structure, which enables the WPOMF sensor to have higher tensile properties and detection sensitivity. Cardiorespiratory and behavioral detection experiments based on the WPOMF sensor are successfully performed, which demonstrates the high sensitivity and stability potential of the WPOMF sensor when performing wearable tasks. Further, the success of the AI-assisted medical keyword pronunciation recognition experiment fully demonstrates the feasibility of integrating AI technology with the WPOMF sensor, which can effectively improve the intelligence of the sensor as a wearable device. As an optical microfiber intelligent sensor, the WPOMF sensor offers broad application prospects in disease monitoring, rehabilitation medicine, the Internet of Things, and other fields.

Bioinspired nanoplatforms for human-machine interfaces: Recent progress in materials and device applications

The panoramic characteristics of human-machine interfaces (HMIs) have prompted the needs to update the biotechnology community with the recent trends, developments, and future research direction toward next-generation bioelectronics. Bioinspired materials are promising for integrating various bioelectronic devices to realize HMIs. With the advancement of scientific biotechnology, state-of-the-art bioelectronic applications have been extensively investigated to improve the quality of life by developing and integrating bioinspired nanoplatforms in HMIs. This review highlights recent trends and developments in the field of biotechnology based on bioinspired nanoplatforms by demonstrating recently explored materials and cutting-edge device applications. Section 1 introduces the recent trends and developments of bioinspired nanomaterials for HMIs. Section 2 reviews various flexible, wearable, biocompatible, and biodegradable nanoplatforms for bioinspired applications. Section 3 furnishes recently explored substrates as carriers for advanced nanomaterials in developing HMIs. Section 4 addresses recently invented biomimetic neuroelectronic, nanointerfaces, biointerfaces, and nano/microfluidic wearable bioelectronic devices for various HMI applications, such as healthcare, biopotential monitoring, and body fluid monitoring. Section 5 outlines designing and engineering of bioinspired sensors for HMIs. Finally, the challenges and opportunities for next-generation bioinspired nanoplatforms in extending the potential on HMIs are discussed for a near-future scenario. We believe this review can stimulate the integration of bioinspired nanoplatforms into the HMIs in addition to wearable electronic skin and health-monitoring devices while addressing prevailing and future healthcare and material-related problems in biotechnologies.

A Fully Self-Powered Wearable Leg Movement Sensing System for Human Health Monitoring

Energy-autonomous wearable human activity monitoring is imperative for daily healthcare, benefiting from long-term sustainable uses. Herein, a fully self-powered wearable system, enabling real-time monitoring and assessments of human multimodal health parameters including knee joint movement, metabolic energy, locomotion speed, and skin temperature, which are fully self-powered by highly-efficient flexible thermoelectric generators (f-TEGs) is proposed and developed. The wearable system is composed of f-TEGs, fabric strain sensors, ultra-low-power edge computing, and Bluetooth. The f-TEGs worn on the leg not only harvest energy from body heat and supply power sustainably for the whole monitoring system, but also serve as zero-power motion sensors to detect limb movement and skin temperature. The fabric strain sensor made by printing PEDOT: PSS on pre-stretched nylon fiber-wrapped rubber band enables high-fidelity and ultralow-power measurements on highly-dynamic knee movements. Edge computing is elaborately designed to estimate multimodal health parameters including time-varying metabolic energy in real-time, which are wirelessly transmitted via Bluetooth. The whole monitoring system is operated automatically and intelligently, works sustainably in both static and dynamic states, and is fully self-powered by the f-TEGs.

Wearable cardiorespiratory monitoring with stretchable elastomer optical fiber

This work presents a stretchable elastomer optical fiber sensor incorporated into a belt for respiratory rate (RR) and heart rate (HR) monitoring. Different materials and shapes of prototypes designed were tested in terms of performance and the best choice was identified. The optimal sensor was tested by 10 volunteers to evaluate the performance. The proposed elastomer optical fiber sensor can achieve simultaneous measurement of RR and HR in different body positions, and also ballistocardiography (BCG) signal measurement in the lying position. The sensor has good accuracy and stability, with maximum errors of 1 bpm and 3 bpm for RR and HR, respectively, and average weighted mean absolute percentage error (MAPE) of 5.25% and root mean square error (RMSE) of 1.28 bpm. Moreover, the results of the Bland-Altman method showed good agreement of the sensor with manual counting of RR and with electrocardiogram (ECG) measurements of HR.