A Method for Remotely Sensing Vital Signs of Human Subjects Outdoors

Cellulose Nanocrystal-Based All-3D-Printed Pyro-Piezoelectric Nanogenerator for Hybrid Energy Harvesting and Self-Powered Cardiorespiratory Monitoring toward the Human-Machine Interface

Biomaterials with spontaneous piezoelectric property are highly emerging in recent times for the generation of electricity from mechanical energy sources that are amply available in nature. In this context, pyroelectricity, an integral property of piezoelectric materials, might be an interesting tool in harvesting thermal energy from the fluctuations of temperature. On the other hand, respiration and heart pulse are the significant human vital signs that can be used for early detection and prevention of cardiorespiratory diseases. Here, we report an all-three-dimensional (3D)-printed pyro-piezoelectric nanogenerator (Py-PNG) based on the most abundant and completely biodegradable biopolymer on earth, i.e., cellulose nanocrystal (CNC) for hybrid (mechanical as well as thermal) energy harvesting, and interestingly, the NG could be used as an e-skin sensor for application in self-powered noninvasive cardiorespiratory monitoring for personal healthcare. Notably, the CNC-based device will be biocompatible and economically advantageous due to its biomaterial-based supremacy and huge availability. This is an original approach with 3D geometrical advancement in designing a NG/sensor, where the unique all-3D-printed manner is adopted, and certainly, it has promising potential in reducing the number of processing steps to required equipment during the multilayer fabrication. The all-3D-printed NG/sensor shows outstanding mechano-thermal energy harvesting performance along with sensitivity and is capable of accurate detection of heart pulse as well as respiration, whenever and whichever required without the need of any battery or an external power supply. In addition, we have also extended its application in demonstrating a smart mask-based breath monitoring system. Thus, the real-time cardiorespiratory monitoring provides notable and fascinating information in medical diagnosis, stepping toward biomedical device development and human-machine interface.

Development of the Use of Unmanned Aerial Vehicles (UAVs) in Emergency Rescue in China

With the frequent occurrence of various disaster events, China has attached high importance to emergency rescue in recent years. Unmanned aerial vehicles (UAVs) are becoming more extensively used in emergency rescue, thanks to their flexibility, intellectuality, and safety in operation. It is therefore timely to evaluate UAV utilization in emergency rescue and explore the impediments to its further development in China. To date, UAVs have been mainly used for on-site monitoring and commanding, relay of communications, delivery of materials, disaster assessment, and life detection. Aerial emergency rescue is a vital component of the whole emergency rescue system in China. In the future, it is recommended that China take measures to boost UAV technical innovation and professional team development and promote the integrated application of manned aircraft and UAVs.

Real-time breath recognition by movies from a small drone landing on victim's bodies

In local and global disaster scenes, rapid recognition of victims' breathing is vital. It is unclear whether the footage transmitted from small drones can enable medical providers to detect breathing. This study investigated the ability of small drones to evaluate breathing correctly after landing on victims' bodies and hovering over them. We enrolled 46 medical workers in this prospective, randomized, crossover study. The participants were provided with envelopes, from which they were asked to pull four notes sequentially and follow the written instructions ("breathing" and "no breathing"). After they lied on the ground in the supine position, a drone was landed on their abdomen, subsequently hovering over them. Two evaluators were asked to determine whether the participant had followed the "breathing" or "no breathing" instruction based on the real-time footage transmitted from the drone camera. The same experiment was performed while the participant was in the prone position. If both evaluators were able to determine the participant's breathing status correctly, the results were tagged as "correct." All experiments were successfully performed. Breathing was correctly determined in all 46 participants (100%) when the drone was landed on the abdomen and in 19 participants when the drone hovered over them while they were in the supine position (p < 0.01). In the prone position, breathing was correctly determined in 44 participants when the drone was landed on the abdomen and in 10 participants when it was kept hovering over them (p < 0.01). Notably, breathing status was misinterpreted as "no breathing" in 8 out of 27 (29.6%) participants lying in the supine position and 13 out of 36 (36.1%) participants lying in the prone position when the drone was kept hovering over them. The landing points seemed wider laterally when the participants were in the supine position than when they were in the prone position. Breathing status was more reliably determined when a small drone was landed on an individual's body than when it hovered over them.

An Overview of Signal Processing Techniques for Remote Health Monitoring Using Impulse Radio UWB Transceiver

Non-invasive remote health monitoring plays a vital role in epidemiological situations such as SARS outbreak (2003), MERS (2015) and the recently ongoing outbreak of COVID-19 because it is extremely risky to get close to the patient due to the spread of contagious infections. Non-invasive monitoring is also extremely necessary in situations where it is difficult to use complicated wired connections, such as ECG monitoring for infants, burn victims or during rescue missions when people are buried during building collapses/earthquakes. Due to the unique characteristics such as higher penetration capabilities, extremely precise ranging, low power requirement, low cost, simple hardware and robustness to multipath interferences, Impulse Radio Ultra Wideband (IR-UWB) technology is appropriate for non-invasive medical applications. IR-UWB sensors detect the macro as well as micro movement inside the human body due to its fine range resolution. The two vital signs, i.e., respiration rate and heart rate, can be measured by IR-UWB radar by measuring the change in the magnitude of signal due to displacement caused by human lungs, heart during respiration and heart beating. This paper reviews recent advances in IR- UWB radar sensor design for healthcare, such as vital signs measurements of a stationary human, vitals of a non-stationary human, vital signs of people in a vehicle, through the wall vitals measurement, neonate’s health monitoring, fall detection, sleep monitoring and medical imaging. Although we have covered many topics related to health monitoring using IR-UWB, this paper is mainly focused on signal processing techniques for measurement of vital signs, i.e., respiration and heart rate monitoring.

A Contactless Respiratory Rate Estimation Method Using a Hermite Magnification Technique and Convolutional Neural Networks

The monitoring of respiratory rate is a relevant factor in medical applications and day-to-day activities. Contact sensors have been used mostly as a direct solution and they have shown their effectiveness, but with some disadvantages for example in vulnerable skins such as burns patients. For this reason, contactless monitoring systems are gaining increasing attention for respiratory detection. In this paper, we present a new non-contact strategy to estimate respiratory rate based on Eulerian motion video magnification technique using Hermite transform and a system based on a Convolutional Neural Network (CNN). The system tracks chest movements of the subject using two strategies: using a manually selected ROI and without the selection of a ROI in the image frame. The system is based on the classifications of the frames as an inhalation or exhalation using CNN. Our proposal has been tested on 10 healthy subjects in different positions. To compare performance of methods to detect respiratory rate the mean average error and a Bland and Altman analysis is used to investigate the agreement of the methods. The mean average error for the automatic strategy is 3.28 ± 3.33 % with and agreement with respect of the reference of ≈98%.

A Novel Signal Separation and De-Noising Technique for Doppler Radar Vital Signal Detection

Doppler radar for monitoring vital signals is an emerging tool, and how to remove the noise during the detection process and reconstruct the accurate respiration and heartbeat signals are hot issues in current research. In this paper, a novel radar vital signal separation and de-noising technique based on improved complete ensemble empirical mode decomposition with adaptive noise (ICEEMDAN), sample entropy (SampEn), and wavelet threshold is proposed. First, the noisy radar signal was decomposed into a series of intrinsic mode functions (IMFs) using ICEEMDAN. Then, each IMF was analyzed using SampEn to find out the first few IMFs containing noise, and these IMFs were de-noised using the wavelet threshold. Finally, in order to extract accurate vital signals, spectrum analysis and Kullback-Leible (KL) divergence calculations were performed on all IMFs, and appropriate IMFs were selected to reconstruct respiration and heartbeat signals. Moreover, as far as we know, there is almost no previous research on radar vital signal de-noising based on the proposed technique. The effectiveness of the algorithm was verified using simulated and measured experiments. The results show that the proposed algorithm could effectively reduce the noise and was superior to the existing de-noising technologies, which is beneficial for extracting more accurate vital signals.

Ultra-Wideband Impulse Radar Through-Wall Detection of Vital Signs

This paper presents a new system for the detection of human respiration behind obstacles using impulse ultra-wideband (UWB) radar. In complex environments, low signal-to-noise ratios (SNRs) as they can result in significant errors in the respiration, heartbeat frequency, and range estimates. To improve the performance, the complex signal demodulation (CSD) technique is extended by employing the signal logarithm and derivative. A frequency accumulation (FA) method is proposed to suppress mixed products of the heartbeat and respiration signals and spurious respiration signal harmonics. The respiration frequency is estimated using the phase variations in the received signal, and a discrete short-time Fourier transform (DSFT) is used to estimate the range. The performance of the proposed system is evaluated along with that of several well-known techniques in the literature.

Detection of the Vibration Signal from Human Vocal Folds Using a 94-GHz Millimeter-Wave Radar

The detection of the vibration signal from human vocal folds provides essential information for studying human phonation and diagnosing voice disorders. Doppler radar technology has enabled the noncontact measurement of the human-vocal-fold vibration. However, existing systems must be placed in close proximity to the human throat and detailed information may be lost because of the low operating frequency. In this paper, a long-distance detection method, involving the use of a 94-GHz millimeter-wave radar sensor, is proposed for detecting the vibration signals from human vocal folds. An algorithm that combines empirical mode decomposition (EMD) and the auto-correlation function (ACF) method is proposed for detecting the signal. First, the EMD method is employed to suppress the noise of the radar-detected signal. Further, the ratio of the energy and entropy is used to detect voice activity in the radar-detected signal, following which, a short-time ACF is employed to extract the vibration signal of the human vocal folds from the processed signal. For validating the method and assessing the performance of the radar system, a vibration measurement sensor and microphone system are additionally employed for comparison. The experimental results obtained from the spectrograms, the vibration frequency of the vocal folds, and coherence analysis demonstrate that the proposed method can effectively detect the vibration of human vocal folds from a long detection distance.

Short-Range Vital Signs Sensing Based on EEMD and CWT Using IR-UWB Radar

The radar sensor described realizes healthcare monitoring capable of detecting subject chest-wall movement caused by cardiopulmonary activities and wirelessly estimating the respiration and heartbeat rates of the subject without attaching any devices to the body. Conventional single-tone Doppler radar can only capture Doppler signatures because of a lack of bandwidth information with noncontact sensors. In contrast, we take full advantage of impulse radio ultra-wideband (IR-UWB) radar to achieve low power consumption and convenient portability, with a flexible detection range and desirable accuracy. A noise reduction method based on improved ensemble empirical mode decomposition (EEMD) and a vital sign separation method based on the continuous-wavelet transform (CWT) are proposed jointly to improve the signal-to-noise ratio (SNR) in order to acquire accurate respiration and heartbeat rates. Experimental results illustrate that respiration and heartbeat signals can be extracted accurately under different conditions. This noncontact healthcare sensor system proves the commercial feasibility and considerable accessibility of using compact IR-UWB radar for emerging biomedical applications.

Through-Wall Multiple Targets Vital Signs Tracking Based on VMD Algorithm

Targets located at the same distance are easily neglected in most through-wall multiple targets detecting applications which use the single-input single-output (SISO) ultra-wideband (UWB) radar system. In this paper, a novel multiple targets vital signs tracking algorithm for through-wall detection using SISO UWB radar has been proposed. Taking advantage of the high-resolution decomposition of the Variational Mode Decomposition (VMD) based algorithm, the respiration signals of different targets can be decomposed into different sub-signals, and then, we can track the time-varying respiration signals accurately when human targets located in the same distance. Intensive evaluation has been conducted to show the effectiveness of our scheme with a 0.15 m thick concrete brick wall. Constant, piecewise-constant and time-varying vital signs could be separated and tracked successfully with the proposed VMD based algorithm for two targets, even up to three targets. For the multiple targets’ vital signs tracking issues like urban search and rescue missions, our algorithm has superior capability in most detection applications.

Short-Range Noncontact Sensors for Healthcare and Other Emerging Applications: A Review

Short-range noncontact sensors are capable of remotely detecting the precise movements of the subjects or wirelessly estimating the distance from the sensor to the subject. They find wide applications in our day lives such as noncontact vital sign detection of heart beat and respiration, sleep monitoring, occupancy sensing, and gesture sensing. In recent years, short-range noncontact sensors are attracting more and more efforts from both academia and industry due to their vast applications. Compared to other radar architectures such as pulse radar and frequency-modulated continuous-wave (FMCW) radar, Doppler radar is gaining more popularity in terms of system integration and low-power operation. This paper reviews the recent technical advances in Doppler radars for healthcare applications, including system hardware improvement, digital signal processing, and chip integration. This paper also discusses the hybrid FMCW-interferometry radars and the emerging applications and the future trends.

Searching for Survivors through Random Human-Body Movement Outdoors by Continuous-Wave Radar Array

It is a major challenge to search for survivors after chemical or nuclear leakage or explosions. At present, biological radar can be used to achieve this goal by detecting the survivor's respiration signal. However, owing to the random posture of an injured person at a rescue site, the radar wave may directly irradiate the person's head or feet, in which it is difficult to detect the respiration signal. This paper describes a multichannel-based antenna array technology, which forms an omnidirectional detection system via 24-GHz Doppler biological radar, to address the random positioning relative to the antenna of an object to be detected. Furthermore, since the survivors often have random body movement such as struggling and twitching, the slight movements of the body caused by breathing are obscured by these movements. Therefore, a method is proposed to identify random human-body movement by utilizing multichannel information to calculate the background variance of the environment in combination with a constant-false-alarm-rate detector. The conducted outdoor experiments indicate that the system can realize the omnidirectional detection of random human-body movement and distinguish body movement from environmental interference such as movement of leaves and grass. The methods proposed in this paper will be a promising way to search for survivors outdoors.

A Novel Method for Speech Acquisition and Enhancement by 94 GHz Millimeter-Wave Sensor

In order to improve the speech acquisition ability of a non-contact method, a 94 GHz millimeter wave (MMW) radar sensor was employed to detect speech signals. This novel non-contact speech acquisition method was shown to have high directional sensitivity, and to be immune to strong acoustical disturbance. However, MMW radar speech is often degraded by combined sources of noise, which mainly include harmonic, electrical circuit and channel noise. In this paper, an algorithm combining empirical mode decomposition (EMD) and mutual information entropy (MIE) was proposed for enhancing the perceptibility and intelligibility of radar speech. Firstly, the radar speech signal was adaptively decomposed into oscillatory components called intrinsic mode functions (IMFs) by EMD. Secondly, MIE was used to determine the number of reconstructive components, and then an adaptive threshold was employed to remove the noise from the radar speech. The experimental results show that human speech can be effectively acquired by a 94 GHz MMW radar sensor when the detection distance is 20 m. Moreover, the noise of the radar speech is greatly suppressed and the speech sounds become more pleasant to human listeners after being enhanced by the proposed algorithm, suggesting that this novel speech acquisition and enhancement method will provide a promising alternative for various applications associated with speech detection.