Advancements in noncontact, multiparameter physiological measurements using a webcam

Robust Pulse Rate Measurements from Facial Videos in Diverse Environments

Pulse wave and pulse rate are important indicators of cardiovascular health. Technologies that can check the pulse by contacting the skin with optical sensors built into smart devices have been developed. However, this may cause inconvenience, such as foreign body sensation. Accordingly, studies have been conducted on non-contact pulse rate measurements using facial videos focused on the indoors. Moreover, since the majority of studies are conducted indoors, the error in the pulse rate measurement in outdoor environments, such as an outdoor bench, car and drone, is high. In this paper, to deal with this issue, we focus on developing a robust pulse measurement method based on facial videos taken in diverse environments. The proposed method stably detects faces by removing high-frequency components of face coordinate signals derived from fine body tremors and illumination conditions. It optimizes for extracting skin color changes by reducing illumination-caused noise using the Cg color difference component. The robust pulse wave is extracted from the Cg signal using FFT-iFFT with zero-padding. It can eliminate signal-filtering distortion effectively. We demonstrate that the proposed method relieves pulse rate measurement problems, producing 3.36, 5.81, and 6.09 bpm RMSE for an outdoor bench, driving car, and flying drone, respectively.

Photoplethysmographic Imaging of Hemodynamics and Two-Dimensional Oximetry

The review of recent papers devoted to actively developing methods of photoplethysmographic imaging (the PPGI) of blood volume pulsations in vessels and non-contact two-dimensional oximetry on the surface of a human body has been carried out. The physical fundamentals and technical aspects of the PPGI and oximetry have been considered. The manifold of the physiological parameters available for the analysis by the PPGI method has been shown. The prospects of the PPGI technology have been discussed. The possibilities of non-contact determination of blood oxygen saturation SpO2 (pulse saturation O2) have been described. The relevance of remote determination of the level of oxygenation in connection with the spread of a new coronavirus infection SARS-CoV-2 (COVID-19) has been emphasized. Most of the works under consideration cover the period 2010-2021.

A real-time heart rate estimation framework based on a facial video while wearing a mask

BACKGROUND: The imaging photoplethysmography (iPPG) method is a non-invasive, non-contact measurement method that uses a camera to detect physiological indicators. On the other hand, wearing a mask has become essential today when COVID-19 is rampant, which has become a new challenge for heart rate (HR) estimation from facial videos recorded by a camera. OBJECTIVE: The aim is to propose an iPPG-based method that can accurately estimate HR with or without a mask. METHODS: First, the facial regions of interest (ROI) were divided into two sub-ROIs, and the original signal was obtained through spatial averaging with different weights according to the result of judging whether wearing a mask or not, and the CDF, which emphasizes the main component signal, was combined with the improved POS suitable for real-time HR estimation to obtain the noise-removed BVP signal. RESULTS: For self-collected data while wearing a mask, MAE, RMSE, and ACC were 1.09 bpm, 1.44 bpm, and 99.08%, respectively. CONCLUSION: Experimental results show that the proposed framework can estimate HR stably in real-time in both cases of wearing a mask or not. This study expands the application range of HR estimation based on facial videos and has very practical value in real-time HR estimation in daily life.

RobustPPG: camera-based robust heart rate estimation using motion cancellation

Camera-based heart rate measurement is becoming an attractive option as a non-contact modality for continuous remote health and engagement monitoring. However, reliable heart rate extraction from camera-based measurement is challenging in realistic scenarios, especially when the subject is moving. In this work, we develop a motion-robust algorithm, labeled RobustPPG, for extracting photoplethysmography signals (PPG) from face video and estimating the heart rate. Our key innovation is to explicitly model and generate motion distortions due to the movements of the person's face. We use inverse rendering to obtain the 3D shape and albedo of the face and environment lighting from video frames and then render the human face for each frame. The rendered face is similar to the original face but does not contain the heart rate signal; facial movements alone cause pixel intensity variation in the generated video frames. Finally, we use the generated motion distortion to filter the motion-induced measurements. We demonstrate that our approach performs better than the state-of-the-art methods in extracting a clean blood volume signal with over 2 dB signal quality improvement and 30% improvement in RMSE of estimated heart rate in intense motion scenarios.

RGB camera-based simultaneous measurements of percutaneous arterial oxygen saturation, tissue oxygen saturation, pulse rate, and respiratory rate

We propose a method to perform simultaneous measurements of percutaneous arterial oxygen saturation (SpO₂), tissue oxygen saturation (StO₂), pulse rate (PR), and respiratory rate (RR) in real-time, using a digital red–green–blue (RGB) camera. Concentrations of oxygenated hemoglobin (C_HbO), deoxygenated hemoglobin (C_HbR), total hemoglobin (C_HbT), and StO₂ were estimated from videos of the human face using a method based on a tissue-like light transport model of the skin. The photoplethysmogram (PPG) signals are extracted from the temporal fluctuations in C_HbO, C_HbR, and C_HbT using a finite impulse response (FIR) filter (low and high cut-off frequencies of 0.7 and 3 Hz, respectively). The PR is calculated from the PPG signal for C_HbT. The ratio of pulse wave amplitude for C_HbO and that for C_HbR are associated with the reference value of SpO₂ measured by a commercially available pulse oximeter, which provides an empirical formula to estimate SpO₂ from videos. The respiration-dependent oscillation in C_HbT was extracted from another FIR filter (low and high cut-off frequencies of 0.05 and 0.5 Hz, respectively) and used to calculate the RR. In vivo experiments with human volunteers while varying the fraction of inspired oxygen were performed to evaluate the comparability of the proposed method with commercially available devices. The Bland–Altman analysis showed that the mean bias for PR, RR, SpO₂, and StO₂ were -1.4 (bpm), -1.2(rpm), 0.5 (%), and -3.0 (%), respectively. The precisions for PR, RR, Sp O₂, and StO₂ were ±3.1 (bpm), ±3.5 (rpm), ±4.3 (%), and ±4.8 (%), respectively. The resulting precision and RMSE for StO₂ were pretty close to the clinical accuracy requirement. The accuracy of the RR is considered a little less accurate than clinical requirements. This is the first demonstration of a low-cost RGB camera-based method for contactless simultaneous measurements of the heart rate, percutaneous arterial oxygen saturation, and tissue oxygen saturation in real-time.

Performance analysis of remote photoplethysmography deep filtering using long short-term memory neural network

BACKGROUND

Remote photoplethysmography (rPPG) is a technique developed to estimate heart rate using standard video cameras and ambient light. Due to the multiple sources of noise that deteriorate the quality of the signal, conventional filters such as the bandpass and wavelet-based filters are commonly used. However, after using conventional filters, some alterations remain, but interestingly an experienced eye can easily identify them.

RESULTS

We studied a long short-term memory (LSTM) network in the rPPG filtering task to identify these alterations using many-to-one and many-to-many approaches. We used three public databases in intra-dataset and cross-dataset scenarios, along with different protocols to analyze the performance of the method. We demonstrate how the network can be easily trained with a set of 90 signals totaling around 45 min. On the other hand, we show the stability of the LSTM performance with six state-of-the-art rPPG methods.

CONCLUSIONS

This study demonstrates the superiority of the LSTM-based filter experimentally compared with conventional filters in an intra-dataset scenario. For example, we obtain on the VIPL database an MAE of 3.9 bpm, whereas conventional filtering improves performance on the same dataset from 10.3 bpm to 7.7 bpm. The cross-dataset approach presents a dependence in the network related to the average signal-to-noise ratio on the rPPG signals, where the closest signal-to-noise ratio values in the training and testing set the better. Moreover, it was demonstrated that a relatively small amount of data are sufficient to successfully train the network and outperform the results obtained by classical filters. More precisely, we have shown that about 45 min of rPPG signal could be sufficient to train an effective LSTM deep-filter.

Using Computer Vision to Track Facial Color Changes and Predict Heart Rate

The current technological advances have pushed the quantification of exercise intensity to new era of physical exercise sciences. Monitoring physical exercise is essential in the process of planning, applying, and controlling loads for performance optimization and health. A lot of research studies applied various statistical approaches to estimate various physiological indices, to our knowledge, no studies found to investigate the relationship of facial color changes and increased exercise intensity. The aim of this study was to develop a non-contact method based on computer vision to determine the heart rate and, ultimately, the exercise intensity. The method was based on analyzing facial color changes during exercise by using RGB, HSV, YCbCr, Lab, and YUV color models. Nine university students participated in the study (mean age = 26.88 ± 6.01 years, mean weight = 72.56 ± 14.27 kg, mean height = 172.88 ± 12.04 cm, six males and three females, and all white Caucasian). The data analyses were carried out separately for each participant (personalized model) as well as all the participants at a time (universal model). The multiple auto regressions, and a multiple polynomial regression model were designed to predict maximum heart rate percentage (maxHR%) from each color models. The results were analyzed and evaluated using Root Mean Square Error (RMSE), F-values, and R-square. The multiple polynomial regression using all participants exhibits the best accuracy with RMSE of 6.75 (R-square = 0.78). Exercise prescription and monitoring can benefit from the use of these methods, for example, to optimize the process of online monitoring, without having the need to use any other instrumentation.

Intelligent Remote Photoplethysmography-Based Methods for Heart Rate Estimation from Face Videos: A Survey

Over the last few years, a rich amount of research has been conducted on remote vital sign monitoring of the human body. Remote photoplethysmography (rPPG) is a camera-based, unobtrusive technology that allows continuous monitoring of changes in vital signs and thereby helps to diagnose and treat diseases earlier in an effective manner. Recent advances in computer vision and its extensive applications have led to rPPG being in high demand. This paper specifically presents a survey on different remote photoplethysmography methods and investigates all facets of heart rate analysis. We explore the investigation of the challenges of the video-based rPPG method and extend it to the recent advancements in the literature. We discuss the gap within the literature and suggestions for future directions.

Skin tissue perfusion mapping triggered by an audio-(de)modulated reference signal

Spatial mapping of skin perfusion provides essential information about physiological processes that are often hidden from the eyes of the examining physician. The perfusion map quality depends on several key factors, such as the camera system type, frame rate, sensitivity, or signal-to-noise ratio. When investigating physiological parameters, the reference signal allows for increasing the spatial resolution of the photoplethysmography imaging (PPGI) system. On the other hand, it increases the system complexity and the synchronization prerequisites. Our solution is a hardware device that modulates the reference biosignal into the audio frequency band. This signal is connected to the mic input of a digital camera or a smartphone, enabling the transformation of such a device into a PPGI measurement system even in the case of compressed video recording using lock-in amplification technique. It also brings the possibility of synchronous recording of PPGI and another reference signal such as conventional photoplethysmogram or electrocardiogram.

Remote Photoplethysmography and Heart Rate Estimation by Dynamic Region of Interest Tracking

Remote photoplethysmography (PPG) estimates vital signs by measuring changes in the reflected light from the human skin. Compared to traditional PPG techniques, remote PPG enables contactless measurement at a reduced cost. In this paper, we propose a novel method to extract remote PPG signals and heart rate from videos. We propose an algorithm to dynamically track regions of interest (ROIs) and combine the signals from all ROIs based on signal qualities. To maintain a stable frame rate and accuracy, we propose a dynamic down-sampling approach, which makes our system robust to the different video resolutions and user-camera distances. We also propose the strategy of adaptive measurement time to estimate HR, which can achieve comparable accuracy in HR estimation while reducing the average measurement time. To test the accuracy of the proposed system, we have collected data from 30 subjects with facial masks. Experimental results show that the proposed system can achieve 3.0 bpm mean absolute error in HR estimation.

Unobtrusive Heart Rate Monitoring using Near-Infrared Imaging During Driving

In-vehicle health monitoring allows for continuous vital sign measurement in everyday life. Eventually, this could lead to early detection of cardiovascular diseases. In this work, we propose non-contact heart rate (HR) monitoring utilizing near-infrared (NIR) camera technology. Ten healthy volunteers are monitored in a realistic driving simulator during resting (5 min) and driving (10 min). We synchronously acquire videos using an out-of-the-shelf, low-cost NIR camera and 3-lead electrocardiography (ECG) serves as ground truth. The MediaPipe face detector delivers the region of interest (ROI) and we determine the HR from the peak with maximum amplitude within the power spectrum of skin color changes. We compare video-based with ECG-based HR, resulting in a mean absolute error (MAE) of 7.8 bpm and 13.0 bpm in resting and driving condition, respectively. As we apply only a simple signal processing pipeline without sophisticated filtering, we conclude that NIR camera-based HR measurements enables unobtrusive and non-contact monitoring to a certain extent, but artifacts from subject movement pose a challenge. If these issues can be addressed, continuous vital sign measurement in everyday life could become reality.

Automated Remote Pulse Oximetry System (ARPOS)

Current methods of measuring heart rate (HR) and oxygen levels (SPO2) require physical contact, are individualised, and for accurate oxygen levels may also require a blood test. No-touch or non-invasive technologies are not currently commercially available for use in healthcare settings. To date, there has been no assessment of a system that measures HR and SPO2 using commercial off-the-shelf camera technology that utilises R, G, B, and IR data. Moreover, no formal remote photoplethysmography studies have been performed in real-life scenarios with participants at home with different demographic characteristics. This novel study addresses all these objectives by developing, optimising, and evaluating a system that measures the HR and SPO2 of 40 participants. HR and SPO2 are determined by measuring the frequencies from different wavelength band regions using FFT and radiometric measurements after pre-processing face regions of interest (forehead, lips, and cheeks) from colour, IR, and depth data. Detrending, interpolating, hamming, and normalising the signal with FastICA produced the lowest RMSE of 7.8 for HR with the r-correlation value of 0.85 and RMSE 2.3 for SPO2. This novel system could be used in several critical care settings, including in care homes and in hospitals and prompt clinical intervention as required.

A deep learning approach to estimate pulse rate by remote photoplethysmography

OBJECTIVE

This study proposes an U-net shaped Deep Neural Network (DNN) model to extract remote photoplethysmography (rPPG) signals from skin color signals to estimate Pulse Rate (PR).

APPROACH

Three input window sizes are used into the DNN: 256 samples (5.12 s), 512 samples (10.24 s), and 1024 (20.48 s). A data argumentation algorithm based on interpolation is also used here to artificially increase the number of training samples.

MAIN RESULTS

The proposed model outperformed a prior-knowledge rPPG method by using input signals with window of 256 and 512 samples. Also, it was found that the data augmentation procedure only increased the performance for window of 1024 samples. The trained model achieved a Mean Absolute Error (MAE) of 3.97 Beats per Minute (BPM) and Root Mean Squared Error (RMSE) of 6.47 BPM, for the 256 samples window, and MAE of 3.00 BPM and RMSE of 5.45 BPM for the window of 512 samples. On the other hand, the prior-knowledge rPPG method got a MAE of 8.04 BPM and RMSE of 16.63 BPM for the window of 256 samples, and MAE of 3.49 BPM and RMSE of 7.92 BPM for the window of 512. For the longest window (1024 samples), the concordance of the predicted PRs from the DNNs and the true PRs was higher when applying the data augmentation procedure.

SIGNIFICANCE

These results demonstrate a big potential of this technique for PR estimation, showing that the DNN proposed here may generate reliable rPPG signals even with short window lengths (5.12 s and 10.24 s), suggesting that it needs less data for a faster rPPG measurement and PR estimation.

Measuring Heart Rate Variability Using Facial Video

Heart Rate Variability (HRV) has become an important risk assessment tool when diagnosing illnesses related to heart health. HRV is typically measured with an electrocardiogram; however, there are multiple studies that use Photoplethysmography (PPG) instead. Measuring HRV with video is beneficial as a non-invasive, hands-free alternative and represents a more accessible approach. We developed a methodology to extract HRV from video based on face detection algorithms and color augmentation. We applied this methodology to 45 samples. Signals obtained from PPG and video recorded an average mean error of less than 1 bpm when measuring the heart rate of all subjects. Furthermore, utilizing PPG and video, we computed 61 variables related to HRV. We compared each of them with three correlation metrics (i.e., Kendall, Pearson, and Spearman), adjusting them for multiple comparisons with the Benjamini–Hochberg method to control the false discovery rate and to retrieve the q-value when considering statistical significance lower than 0.5. Using these methods, we found significant correlations for 38 variables (e.g., Heart Rate, 0.991; Mean NN Interval, 0.990; and NN Interval Count, 0.955) using time-domain, frequency-domain, and non-linear methods.

Respiratory Rate Estimation Using U-Net-Based Cascaded Framework From Electrocardiogram and Seismocardiogram Signals

OBJECTIVE

At-home monitoring of respiration is of critical urgency especially in the era of the global pandemic due to COVID-19. Electrocardiogram (ECG) and seismocardiogram (SCG) signals-measured in less cumbersome contact form factors than the conventional sealed mask that measures respiratory air flow-are promising solutions for respiratory monitoring. In particular, respiratory rates (RR) can be estimated from ECG-derived respiratory (EDR) and SCG-derived respiratory (SDR) signals. Yet, non-respiratory artifacts might still be present in these surrogates of respiratory signals, hindering the accuracy of the RRs estimated.

METHODS

In this paper, we propose a novel U-Net-based cascaded framework to address this problem. The EDR and SDR signals were transformed to the spectro-temporal domain and subsequently denoised by a 2D U-Net to reduce the non-respiratory artifacts.

MAJOR RESULTS

We have shown that the U-Net that fused an EDR input and an SDR input achieved a low mean absolute error of 0.82 breaths per minute (bpm) and a coefficient of determination (R2) of 0.89 using data collected from our chest-worn wearable patch. We also qualitatively provided insights on the complementariness between EDR and SDR signals and demonstrated the generalizability of the proposed framework.

CONCLUSION

ECG and SCG collected from a chest-worn wearable patch can complement each other and yield reliable RR estimation using the proposed cascaded framework.

SIGNIFICANCE

We anticipate that convenient and comfortable ECG and SCG measurement systems can be augmented with this framework to facilitate pervasive and accurate RR measurement.

Availability and performance of face based non-contact methods for heart rate and oxygen saturation estimations: A systematic review

BACKGROUND

Consumer-level cameras have provided an advantage of designing cost-effective, non-contact physiological parameters estimation approaches which is not possible with gold standard estimation techniques. This encourages the development of non-contact estimation methods using camera technology. Therefore, this work aims to present a systematic review summarizing the currently existing face-based non-contact methods along with their performance.

METHODS

This review includes all heart rate (HR) and oxygen saturation (SpO2) studies published in journals and a few reputed conferences, which have compared the proposed estimation methods with one or more standard reference devices. The articles were collected from the following research databases: Institute of Electrical and Electronics Engineers (IEEE), PubMed, Web of Science (WoS), Science Direct, and Association of Computer Machinery (ACM) digital library. All database searches were completed on May 20, 2021. Each study was assessed using a finite set of identified factors for reporting bias.

RESULTS

Out of 332 identified studies, 32 studies were selected for the final review. Additionally, 18 studies were included by thoroughly checking these studies. 3 out of 50 (6%) studies were performed in clinical conditions, while the remaining studies were carried out on a healthy population. 42 out of 50 (84%) studies have estimated HR, while 5/50 (10%) studies have measured SpO₂ only. The remaining three studies have estimated both parameters. The majority of the studies have used 1-3 min videos for estimation. Among the estimation methods, Deep Learning and Independent component analysis (ICA) were used by 11/42 (26.19%) and 9/42 (21.42%) studies, respectively. According to the Bland-Altman analysis, only 8/45 (17.77%) HR studies achieved the clinically accepted error limits whereas, for SpO₂, 4/5 (80%) studies have matched the industry standards (±3%).

DISCUSSION

Deep Learning and ICA have been predominantly used for HR estimations. Among deep learning estimation methods, convolutional neural networks have been employed till date due to their good generalization ability. Most non-contact HR estimation methods need significant improvements to implement these methods in a clinical environment. Furthermore, these methods need to be tested on the subjects suffering from any related disease. SpO₂ estimation studies are challenging and need to be tested by conducting hypoxemic events. The authors would encourage reporting the detailed information about the study population, the use of longer videos, and appropriate performance metrics and testing under abnormal HR and SpO₂ ranges for future estimation studies.

Continuous Monitoring of Vital Signs Using Cameras: A Systematic Review

In recent years, noncontact measurements of vital signs using cameras received a great amount of interest. However, some questions are unanswered: (i) Which vital sign is monitored using what type of camera? (ii) What is the performance and which factors affect it? (iii) Which health issues are addressed by camera-based techniques? Following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement, we conduct a systematic review of continuous camera-based vital sign monitoring using Scopus, PubMed, and the Association for Computing Machinery (ACM) databases. We consider articles that were published between January 2018 and April 2021 in the English language. We include five vital signs: heart rate (HR), respiratory rate (RR), blood pressure (BP), body skin temperature (BST), and oxygen saturation (SpO2). In total, we retrieve 905 articles and screened them regarding title, abstract, and full text. One hundred and four articles remained: 60, 20, 6, 2, and 1 of the articles focus on HR, RR, BP, BST, and SpO2, respectively, and 15 on multiple vital signs. HR and RR can be measured using red, green, and blue (RGB) and near-infrared (NIR) as well as far-infrared (FIR) cameras. So far, BP and SpO2 are monitored with RGB cameras only, whereas BST is derived from FIR cameras only. Under ideal conditions, the root mean squared error is around 2.60 bpm, 2.22 cpm, 6.91 mm Hg, 4.88 mm Hg, and 0.86 °C for HR, RR, systolic BP, diastolic BP, and BST, respectively. The estimated error for SpO2 is less than 1%, but it increases with movements of the subject and the camera-subject distance. Camera-based remote monitoring mainly explores intensive care, post-anaesthesia care, and sleep monitoring, but also explores special diseases such as heart failure. The monitored targets are newborn and pediatric patients, geriatric patients, athletes (e.g., exercising, cycling), and vehicle drivers. Camera-based techniques monitor HR, RR, and BST in static conditions within acceptable ranges for certain applications. The research gaps are large and heterogeneous populations, real-time scenarios, moving subjects, and accuracy of BP and SpO2 monitoring.

Mobile Robotic Platform for Contactless Vital Sign Monitoring

The COVID-19 pandemic has accelerated methods to facilitate contactless evaluation of patients in hospital settings. By minimizing in-person contact with individuals who may have COVID-19, healthcare workers can prevent disease transmission and conserve personal protective equipment. Obtaining vital signs is a ubiquitous task that is commonly done in person by healthcare workers. To eliminate the need for in-person contact for vital sign measurement in the hospital setting, we developed Dr. Spot, a mobile quadruped robotic system. The system includes IR and RGB cameras for vital sign monitoring and a tablet computer for face-to-face medical interviewing. Dr. Spot is teleoperated by trained clinical staff to simultaneously measure the skin temperature, respiratory rate, and heart rate while maintaining social distancing from patients and without removing their mask. To enable accurate, contactless measurements on a mobile system without a static black body as reference, we propose novel methods for skin temperature compensation and respiratory rate measurement at various distances between the subject and the cameras, up to 5 m. Without compensation, the skin temperature MAE is 1.3°C. Using the proposed compensation method, the skin temperature MAE is reduced to 0.3°C. The respiratory rate method can provide continuous monitoring with a MAE of 1.6 BPM in 30 s or rapid screening with a MAE of 2.1 BPM in 10 s. For the heart rate estimation, our system is able to achieve a MAE less than 8 BPM in 10 s measured in arbitrary indoor light conditions at any distance below 2 m.

Psychophysiological reactions of Internet users exposed to fluoride information and disinformation: Protocol for a randomized controlled trial (Preprint)

Background

False messages on the internet continually propagate possible adverse effects of fluoridated oral care products and water, despite their essential role in preventing and controlling dental caries.

Objective

This study aims to evaluate the patterns of psychophysiological reactions of adults after the consumption of internet-based fluoride-related information and disinformation.

Methods

A 2-armed, single-blinded, parallel, and randomized controlled trial will be conducted with 58 parents or caregivers of children who attend the Clinics of Pediatric Dentistry at the Bauru School of Dentistry, considering an attrition of 10% and a significance level of 5%. The participants will be randomized into test and intervention groups, being respectively exposed to fluoride-related information and disinformation presented on a computer with simultaneous monitoring of their psychophysiological reactions, including analysis of their heart rates (HRs) and 7 facial features (mouth outer, mouth corner, eye area, eyebrow activity, face area, face motion, and facial center of mass). Then, participants will respond to questions about the utility and truthfulness of content, their emotional state after the experiment, eHealth literacy, oral health knowledge, and socioeconomic characteristics. The Shapiro-Wilk and Levene tests will be used to determine the normality and homogeneity of the data, which could lead to further statistical analyses for elucidating significant differences between groups, using parametric (Student t test) or nonparametric (Mann-Whitney U test) analyses. Moreover, multiple logistic regression models will be developed to evaluate the association of distinct variables with the psychophysiological aspects. Only factors with significant Wald statistics in the simple analysis will be included in the multiple models (P<.2). Furthermore, receiver operating characteristic curve analysis will be performed to determine the accuracy of the remote HR with respect to the measured HR. For all analyses, P<.05 will be considered significant.

Results

From June 2022, parents and caregivers who frequent the Clinics of Pediatric Dentistry at the Bauru School of Dentistry will be invited to participate in the study and will be randomized into 1 of the 2 groups (control or intervention). Data collection is expected to be completed in December 2023. Subsequently, the authors will analyze the data and publish the findings of the clinical trial by June 2024.

Conclusions

This randomized controlled trial aims to elucidate differences between psychophysiological patterns of adults exposed to true or false oral health content. This evidence may support the development of further studies and digital strategies, such as neural network models to automatically detect disinformation available on the internet.

Trial Registration

Brazilian Clinical Trials Registry (RBR-7q4ymr2) U1111-1263-8227; https://tinyurl.com/2kf73t3d

International Registered Report Identifier (IRRID)

PRR1-10.2196/39133

Speech as a Biomarker for COVID-19 Detection Using Machine Learning

The use of speech as a biomedical signal for diagnosing COVID-19 is investigated using statistical analysis of speech spectral features and classification algorithms based on machine learning. It is established that spectral features of speech, obtained by computing the short-time Fourier Transform (STFT), get altered in a statistical sense as a result of physiological changes. These spectral features are then used as input features to machine learning-based classification algorithms to classify them as coming from a COVID-19 positive individual or not. Speech samples from healthy as well as “asymptomatic” COVID-19 positive individuals have been used in this study. It is shown that the RMS error of statistical distribution fitting is higher in the case of speech samples of COVID-19 positive speech samples as compared to the speech samples of healthy individuals. Five state-of-the-art machine learning classification algorithms have also been analyzed, and the performance evaluation metrics of these algorithms are also presented. The tuning of machine learning model parameters is done so as to minimize the misclassification of COVID-19 positive individuals as being COVID-19 negative since the cost associated with this misclassification is higher than the opposite misclassification. The best performance in terms of the “recall” metric is observed for the Decision Forest algorithm which gives a recall value of 0.7892.

A new principle of pulse detection based on terahertz wave plethysmography

This study presents findings in the terahertz (THz) frequency spectrum for non-contact cardiac sensing applications. Cardiac pulse information is simultaneously extracted using THz waves based on the established principles in electronics and optics. The first fundamental principle is micro-Doppler motion effect. This motion based method, primarily using coherent phase information from the radar receiver, has been widely exploited in microwave frequency bands and has recently found popularity in millimeter waves (mmWave) for breathe rate and heart rate detection. The second fundamental principle is reflectance based optical measurement using infrared or visible light. The variation in the light reflection is proportional to the volumetric change of the heart, often referred as photoplethysmography (PPG). Herein, we introduce the concept of terahertz-wave-plethysmography (TPG), which detects blood volume changes in the upper dermis tissue layer by measuring the reflectance of THz waves, similar to the existing remote PPG (rPPG) principle. The TPG principle is justified by scientific deduction, electromagnetic wave simulations and carefully designed experimental demonstrations. Additionally, pulse measurements from various peripheral body parts of interest (BOI), palm, inner elbow, temple, fingertip and forehead, are demonstrated using a wideband THz sensing system developed by the Terahertz Electronics Lab at Arizona State University, Tempe. Among the BOIs under test, it is found that the measurements from forehead BOI gives the best accuracy with mean heart rate (HR) estimation error 1.51 beats per minute (BPM) and standard deviation 1.08 BPM. The results validate the feasibility of TPG for direct pulse monitoring. A comparative study on pulse sensitivity is conducted between TPG and rPPG. The results indicate that the TPG contains more pulsatile information from the forehead BOI than that in the rPPG signals in regular office lighting condition and thus generate better heart rate estimation statistic in the form of empirical cumulative distribution function of HR estimation error. Last but not least, TPG penetrability test for covered skin is demonstrated using two types of garment materials commonly used in daily life.

Prospective validation of smartphone-based heart rate and respiratory rate measurement algorithms

Background

Measuring vital signs plays a key role in both patient care and wellness, but can be challenging outside of medical settings due to the lack of specialized equipment.

Methods

In this study, we prospectively evaluated smartphone camera-based techniques for measuring heart rate (HR) and respiratory rate (RR) for consumer wellness use. HR was measured by placing the finger over the rear-facing camera, while RR was measured via a video of the participants sitting still in front of the front-facing camera.

Results

In the HR study of 95 participants (with a protocol that included both measurements at rest and post exercise), the mean absolute percent error (MAPE) ± standard deviation of the measurement was 1.6% ± 4.3%, which was significantly lower than the pre-specified goal of 5%. No significant differences in the MAPE were present across colorimeter-measured skin-tone subgroups: 1.8% ± 4.5% for very light to intermediate, 1.3% ± 3.3% for tan and brown, and 1.8% ± 4.9% for dark. In the RR study of 50 participants, the mean absolute error (MAE) was 0.78 ± 0.61 breaths/min, which was significantly lower than the pre-specified goal of 3 breaths/min. The MAE was low in both healthy participants (0.70 ± 0.67 breaths/min), and participants with chronic respiratory conditions (0.80 ± 0.60 breaths/min).

Conclusions

These results validate the accuracy of our smartphone camera-based techniques to measure HR and RR across a range of pre-defined subgroups.

Accurate measurement of the number of times a heart beats per minute (heart rate, HR) and the number of breaths taken per minute (respiratory rate, RR) is usually undertaken using specialized equipment or training. We evaluated whether smartphone cameras could be used to measure HR and RR. We tested the accuracy of two computational approaches that determined HR and RR from the videos obtained using a smartphone. Changes in blood flow through the finger were used to determine HR; similar results were seen for people with different skin tones. Chest movements were used to determine RR; similar results were seen between people with and without chronic lung conditions. This study demonstrates that smartphones can be used to measure HR and RR accurately.

Bae et al. prospectively evaluated smartphone camera-based techniques for measuring heart rate and respiratory rate. They found measurements were accurate across a range of pre-defined subgroups.

Rational selection of RGB channels for disease classification based on IPPG technology

The green channel is usually selected as the optimal channel for vital signs monitoring in image photoplethysmography (IPPG) technology. However, some controversies arising from the different penetrability of skin tissue in visible light remain unresolved, i.e., making the optical and physiological information carried by the IPPG signals of the RGB channels inconsistent. This study clarifies that the optimal channels for different diseases are different when IPPG technology is used for disease classification. We further verified this conclusion in the classification model of heart disease and diabetes mellitus based on the random forest classification algorithm. The experimental results indicate that the green channel has a considerably excellent performance in classifying heart disease patients and the healthy with an average Accuracy value of 88.43% and an average F1score value of 93.72%. The optimal channel for classifying diabetes mellitus patients and the healthy is the red channel with an average Accuracy value of 82.12% and the average F1score value of 89.31%. Due to the limited penetration depth of the blue channel into the skin tissue, the blue channel is not as effective as the green and red channels as a disease classification channel. This investigation is of great significance to the development of IPPG technology and its application in disease classification.

Imaging PPG for In Vivo Human Tissue Perfusion Assessment during Surgery

Surgical excision is the golden standard for treatment of intestinal tumors. In this surgical procedure, inadequate perfusion of the anastomosis can lead to postoperative complications, such as anastomotic leakages. Imaging photoplethysmography (iPPG) can potentially provide objective and real-time feedback of the perfusion status of tissues. This feasibility study aims to evaluate an iPPG acquisition system during intestinal surgeries to detect the perfusion levels of the microvasculature tissue bed in different perfusion conditions. This feasibility study assesses three patients that underwent resection of a portion of the small intestine. Data was acquired from fully perfused, non-perfused and anastomosis parts of the intestine during different phases of the surgical procedure. Strategies for limiting motion and noise during acquisition were implemented. iPPG perfusion maps were successfully extracted from the intestine microvasculature, demonstrating that iPPG can be successfully used for detecting perturbations and perfusion changes in intestinal tissues during surgery. This study provides proof of concept for iPPG to detect changes in organ perfusion levels.

Multi-ROI Spectral Approach for the Continuous Remote Cardio-Respiratory Monitoring from Mobile Device Built-In Cameras

Heart rate (HR) and respiratory rate (f_R) can be estimated by processing videos framing the upper body and face regions without any physical contact with the subject. This paper proposed a technique for continuously monitoring HR and f_R via a multi-ROI approach based on the spectral analysis of RGB video frames recorded with a mobile device (i.e., a smartphone's camera). The respiratory signal was estimated by the motion of the chest, whereas the cardiac signal was retrieved from the pulsatile activity at the level of right and left cheeks and forehead. Videos were recorded from 18 healthy volunteers in four sessions with different user-camera distances (i.e., 0.5 m and 1.0 m) and illumination conditions (i.e., natural and artificial light). For HR estimation, three approaches were investigated based on single or multi-ROI approaches. A commercially available multiparametric device was used to record reference respiratory signals and electrocardiogram (ECG). The results demonstrated that the multi-ROI approach outperforms the single-ROI approach providing temporal trends of both the vital parameters comparable to those provided by the reference, with a mean absolute error (MAE) consistently below 1 breaths·min^-1 for f_R in all the scenarios, and a MAE between 0.7 bpm and 6 bpm for HR estimation, whose values increase at higher distances.

Shielding facial physiological information in video

With the recent development of non-contact physiological signal detection methods based on videos, it is possible to obtain the physiological parameters through the ordinary video only, such as heart rate and its variability of an individual. Therefore, personal physiological information may be leaked unknowingly with the spread of videos, which may cause privacy or security problems. In this paper a new method is proposed, which can shield physiological information in the video without reducing the video quality significantly. Firstly, the principle of the most widely used physiological signal detection algorithm: remote photoplethysmography (rPPG) was analyzed. Then the region of interest (ROI) of face contain physiological information with high signal to noise ratio was selected. Two physiological information forgery operation: single-channel periodic noise addition with blur filtering and brightness fine-tuning are conducted on the ROIs. Finally, the processed ROI images are merged into video frames to obtain the processed video. Experiments were performed on the VIPL-HR video dataset. The interference efficiencies of the proposed method on two mainly used rPPG methods: Independent Component Analysis (ICA) and Chrominance-based Method (CHROM) are 82.9 % and 84.6 % respectively, which demonstrated the effectiveness of the proposed method.

Diagnostic Features and Potential Applications of PPG Signal in Healthcare: A Systematic Review

Recent research indicates that Photoplethysmography (PPG) signals carry more information than oxygen saturation level (SpO2) and can be utilized for affordable, fast, and noninvasive healthcare applications. All these encourage the researchers to estimate its feasibility as an alternative to many expansive, time-wasting, and invasive methods. This systematic review discusses the current literature on diagnostic features of PPG signal and their applications that might present a potential venue to be adapted into many health and fitness aspects of human life. The research methodology is based on the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines 2020. To this aim, papers from 1981 to date are reviewed and categorized in terms of the healthcare application domain. Along with consolidated research areas, recent topics that are growing in popularity are also discovered. We also highlight the potential impact of using PPG signals on an individual's quality of life and public health. The state-of-the-art studies suggest that in the years to come PPG wearables will become pervasive in many fields of medical practices, and the main domains include cardiology, respiratory, neurology, and fitness. Main operation challenges, including performance and robustness obstacles, are identified.

Validation study of the use of the HRVCAM software for the evaluation of heart rate and heart rate variability at rest

Aims

The existing instruments for assessing heart rate (HR) and heart rate variability (HRV) require contact area. This is difficult to obtain from specific groups of patients and from those moving. The aim of this study was to validate the use of the HRVCam software for measuring HR and HRV in healthy adults.

Methods and results

The HR and HRV variables were evaluated in terms of time and frequency using a webcam and Polar® S810i. The Shapiro-Wilk test was used to test the normality of the data, and the Pearson's correlation coefficient (r) was used to identify the possible correlation between the two instruments. The size of the effect was calculated based on a generalized linear model, and the Bland-Altman plots were used to analyse the agreement between the methods. The level of significance for all analyses was set at P < 0.05. We evaluated 102 participants, of whom 52% were men; 83.3% were aged between 18 and 29.9 years; and 84.3% were single.

Conclusion

There was a good agreement and moderate to strong correlations among all analysed variables. The biases were low, except for the low frequency/high frequency measures. Moreover, the difference between the samples was small to moderate. The results of this study corroborate the use of HRVCam for measuring HR and HRV.

Contactless Vital Signs Monitoring From Videos Recorded With Digital Cameras: An Overview

The measurement of physiological parameters is fundamental to assess the health status of an individual. The contactless monitoring of vital signs may provide benefits in various fields of application, from healthcare and clinical setting to occupational and sports scenarios. Recent research has been focused on the potentiality of camera-based systems working in the visible range (380-750 nm) for estimating vital signs by capturing subtle color changes or motions caused by physiological activities but invisible to human eyes. These quantities are typically extracted from videos framing some exposed body areas (e.g., face, torso, and hands) with adequate post-processing algorithms. In this review, we provided an overview of the physiological and technical aspects behind the estimation of vital signs like respiratory rate, heart rate, blood oxygen saturation, and blood pressure from digital images as well as the potential fields of application of these technologies. Per each vital sign, we provided the rationale for the measurement, a classification of the different techniques implemented for post-processing the original videos, and the main results obtained during various applications or in validation studies. The available evidence supports the premise of digital cameras as an unobtrusive and easy-to-use technology for physiological signs monitoring. Further research is needed to promote the advancements of the technology, allowing its application in a wide range of population and everyday life, fostering a biometrical holistic of the human body (BHOHB) approach.

Using High-Fidelity Avatars to Advance Camera-based Cardiac Pulse Measurement

Non-contact physiological measurement has the potential to provide low-cost, non-invasive health monitoring. However, machine vision approaches are often limited by the availability and diversity of annotated video datasets resulting in poor generalization to complex real-life conditions. To address these challenges, this work proposes the use of synthetic avatars that display facial blood flow changes and allow for systematic generation of samples under a wide variety of conditions. Our results show that training on both simulated and real video data can lead to performance gains under challenging conditions. We show strong performance on three large benchmark datasets and improved robustness to skin type and motion. These results highlight the promise of synthetic data for training camera-based pulse measurement; however, further research and validation is needed to establish whether synthetic data alone could be sufficient for training models.

Efficient Spatiotemporal Attention Network for Remote Heart Rate Variability Analysis

Studies have shown that ordinary color cameras can detect the subtle color changes of the skin caused by the heartbeat cycle. Therefore, cameras can be used to remotely monitor the pulse in a non-contact manner. The technology for non-contact physiological measurement in this way is called remote photoplethysmography (rPPG). Heart rate variability (HRV) analysis, as a very important physiological feature, requires us to be able to accurately recover the peak time locations of the rPPG signal. This paper proposes an efficient spatiotemporal attention network (ESA-rPPGNet) to recover high-quality rPPG signal for heart rate variability analysis. First, 3D depth-wise separable convolution and a structure based on mobilenet v3 are used to greatly reduce the time complexity of the network. Next, a lightweight attention block called 3D shuffle attention (3D-SA), which integrates spatial attention and channel attention, is designed to enable the network to effectively capture inter-channel dependencies and pixel-level dependencies. Moreover, ConvGRU is introduced to further improve the network’s ability to learn long-term spatiotemporal feature information. Compared with existing methods, the experimental results show that the method proposed in this paper has better performance and robustness on the remote HRV analysis.

Non-contact physiological monitoring of post-operative patients in the intensive care unit

Prolonged non-contact camera-based monitoring in critically ill patients presents unique challenges, but may facilitate safe recovery. A study was designed to evaluate the feasibility of introducing a non-contact video camera monitoring system into an acute clinical setting. We assessed the accuracy and robustness of the video camera-derived estimates of the vital signs against the electronically-recorded reference values in both day and night environments. We demonstrated non-contact monitoring of heart rate and respiratory rate for extended periods of time in 15 post-operative patients. Across day and night, heart rate was estimated for up to 53.2% (103.0 h) of the total valid camera data with a mean absolute error (MAE) of 2.5 beats/min in comparison to two reference sensors. We obtained respiratory rate estimates for 63.1% (119.8 h) of the total valid camera data with a MAE of 2.4 breaths/min against the reference value computed from the chest impedance pneumogram. Non-contact estimates detected relevant changes in the vital-sign values between routine clinical observations. Pivotal respiratory events in a post-operative patient could be identified from the analysis of video-derived respiratory information. Continuous vital-sign monitoring supported by non-contact video camera estimates could be used to track early signs of physiological deterioration during post-operative care.

Comparative study on the effect of color spaces and color formats on heart rate measurement using the imaging photoplethysmography (IPPG) method

BACKGROUND

The imaging photoplethysmography (IPPG) technology has been demonstrated to be an effective method for heart rate (HR) monitoring. However, some interference caused by the ambient illumination variation and facial motion severely influences the accuracy of the HR measurement. Some color spaces and color formats are assumed to reduce the interference, and enhance the accuracy of HR estimation.

OBJECTIVE

The aim is to identify the optimal color space and format for IPPG based HR measurement.

METHODS

Six color spaces and 3 color formats are compared in this study, based on an IPPG based HR measurement system. 424 pieces of videos captured by the system are used for the selection of the optimal color channel and color space; while 10 pieces of videos are for the identification of the optimal color format.

RESULTS

The results shows that the green channel of RGB space is the optimal color channel, and RGB is the optimal color space, in respect of the mean squared error of HR estimation. BayerBG 8bit is found to be the optimal color format for video recording, which can significantly reduce the HR estimation error.

CONCLUSIONS

BayerBG 8bit color format for video recording, and RGB color space for video analysis is suggested for the IPPG based HR measurement system. The suitable configuration of color space and format could enhance the accuracy of HR measurement.

Cost-Effective Solution of Remote Photoplethysmography Capable of Real-Time, Multi-Subject Monitoring with Social Distancing

Recent advances in remote-photoplethysmography (rPPG) have enabled the measurement of heart rate (HR), oxygen saturation (SpO₂), and blood pressure (BP) in a fully contactless manner. These techniques are increasingly applied clinically given a desire to minimize exposure to individuals with infectious symptoms. However, accurate rPPG estimation often leads to heavy loading in computation that either limits its real-time capacity or results in a costly setup. Additionally, acquiring rPPG while maintaining protective distance would require high resolution cameras to ensure adequate pixels coverage for the region of interest, increasing computational burden. Here, we propose a cost-effective platform capable of the real-time, continuous, multi-subject monitoring while maintaining social distancing. The platform is composed of a centralized computing unit and multiple low-cost wireless cameras. We demonstrate that the central computing unit is able to simultaneously handle continuous rPPG monitoring of five subjects with social distancing without compromising the frame rate and rPPG accuracy.

Evaluation of Remote Photoplethysmography Measurement Conditions toward Telemedicine Applications

Camera-based remote photoplethysmography (rPPG) is a low-cost and casual non-contact heart rate measurement method suitable for telemedicine. Several factors affect the accuracy of measuring the heart rate and heart rate variability (HRV) using rPPG despite HRV being an important indicator for healthcare monitoring. This study aimed to investigate the appropriate setup for precise HRV measurements using rPPG while considering the effects of possible factors including illumination, direction of the light, frame rate of the camera, and body motion. In the lighting conditions experiment, the smallest mean absolute R–R interval (RRI) error was obtained when light greater than 500 lux was cast from the front (among the following conditions—illuminance: 100, 300, 500, and 700 lux; directions: front, top, and front and top). In addition, the RRI and HRV were measured with sufficient accuracy at frame rates above 30 fps. The accuracy of the HRV measurement was greatly reduced when the body motion was not constrained; thus, it is necessary to limit the body motion, especially the head motion, in an actual telemedicine situation. The results of this study can act as guidelines for setting up the shooting environment and camera settings for rPPG use in telemedicine.

VidAF: A Motion-Robust Model for Screening Atrial Fibrillation from Facial Videos

Atrial fibrillation (AF) is the most common arrhythmia, but an estimated 30% of patients with AF are unaware of their conditions. The purpose of this work is to design a model for AF screening from facial videos, with a focus on addressing typical motion disturbances in our real life, such as head movements and expression changes. This model detects a pulse signal from the skin color changes in a facial video by a convolution neural network, incorporating a phase-driven attention mechanism to suppress motion signals in the space domain. It then encodes the pulse signal into discriminative features for AF classification by a coding neural network, using a de-noise coding strategy to improve the robustness of the features to motion signals in the time domain. The proposed model was tested on a dataset containing 1200 samples of 100 AF patients and 100 non-AF subjects. Experimental results demonstrated that VidAF had significant robustness to facial motions, predicting clean pulse signals with the mean absolute error of inter-pulse intervals less than 100 milliseconds. Besides, the model achieved promising performance in AF identification, showing an accuracy of more than 90% in multiple challenging scenarios. VidAF provides a more convenient and cost-effective approach for opportunistic AF screening in the community.

Arrhythmia detection and classification using ECG and PPG techniques: a review

Electrocardiogram (ECG) and photoplethysmograph (PPG) are non-invasive techniques that provide electrical and hemodynamic information of the heart, respectively. This information is advantageous in the diagnosis of various cardiac abnormalities. Arrhythmia is the most common cardiovascular disease, manifested as single or multiple irregular heartbeats. However, due to the continuous manual observation, it becomes troublesome for experts sometimes to identify the paroxysmal nature of arrhythmia correctly. Moreover, due to advancements in technology, there is an inclination towards wearable sensors which monitor such patients continuously. Thus, there is a need for automatic detection techniques for the identification of arrhythmia. In the presented work, ECG and PPG-based state-of-the-art methods have been described, including preprocessing, feature extraction, and classification techniques for the detection of various arrhythmias. Additionally, this review exhibits various wearable sensors used in the literature and public databases available for the evaluation of results. The study also highlights the limitations of the current techniques and pragmatic solutions to improvise the ongoing effort.

Contactless Heart Rate Variability (HRV) Estimation Using a Smartphone During Respiratory Maneuvers and Body Movement

Heart rate variability (HRV) has been extensively investigated as a noninvasive marker to evaluate the functionality of the autonomic nervous system (ANS). Many studies have provided photoplethysmography (PPG) as a surrogate for electrocardiogram (ECG) signal HRV measurements. Remote PPG (rPPG) has been also investigated for pulse rate variability (PRV) estimation but in controlled conditions. We remotely extracted PRV using a smartphone camera for subjects in static and lateral motion while their respiratory rate was set to three breathing rates in an indoor illumination environment. PRV was compared with ECG-based HRV as a gold standard. We tested our algorithms on five healthy subjects. The results showed high correlation for rPPG-based HRV by presenting means of standard deviation of normal-to-normal intervals (SDNN) and root mean square of successive heartbeat interval differences (RMSSD) correlation coefficient greater than 0.95 in rest and greater than 0.87 in motion. The error of mean low frequency over high frequency (LF/HF) ratio estimated from PRV was 0.13 in rest and 0.25 in lateral motion. Moreover, a statistically significant correlation was obtained between HRV and PRV power spectra and temporal signals for all performed tasks. The obtained results contributed to confirm that remote imaging measurement of cardiac parameters is a promising, convenient, and low-cost alternative to specialized biomedical sensors in a diversity of relevant experimental maneuver.

Non-contact Measurement of Pulse Rate Variability Using a Webcam and Application to Mental Illness Screening System

The COVID-19 pandemic is a global health crisis. Mental health is critical in such uncertain situations, particularly when people are required to significantly restrict their movements and change their lifestyles. Under these conditions, many countries have turned to telemedicine to strengthen and expand mental health services. Our research group previously developed a mental illness screening system based on heart rate variability (HRV) analysis, enabling an objective and easy mental health self-check. This screening system cannot be used for telemedicine because it uses electrocardiography (ECG) and contact photoplethysmography (PPG), that are not widely available outside of a clinical setting. The purpose of this study is to enable the extension of the aforementioned system to telemedicine by the application of non-contact PPG using an RGB webcam, also called imaging- photoplethysmography (iPPG). The iPPG measurement errors occur due to changes in the relative position between the camera and the target, and due to changes in light. Conventionally, in image processing, the pixel value of the entire face region is used. We propose skin pixel extraction to eliminate blinks, eye movements, and changes in light and shadow. In signal processing, the green channel signal is conventionally used as a pulse wave owing to the absorption characteristics of blood flow. Taking advantage of the fact that the red and blue channels contain noise, we propose a signal reconstruction method for removing noise and strengthening the signal in the pulse rate variability (PRV) frequency band by weighting the three signals of the RGB camera. We conducted an experiment with 13 healthy subjects, and showed that the PRV index and pulse rate (PR) errors estimated by the proposed method were smaller than those of the conventional method. The correlation coefficients between estimated values by the proposed method and reference values of LF, HF, and PR were 0.86, 0.69, and 0.96, respectively.

iPPG 2 cPPG: Reconstructing contact from imaging photoplethysmographic signals using U-Net architectures

Imaging photoplethysmography (iPPG) is an optical technique dedicated to the assessment of several vital functions using a simple camera. Significant efforts have been made to reliably estimate heart and respiratory rates. Currently, research is focusing on the remote estimation of oxygen saturation and blood pressure (BP). The limited number of publicly available data tends to restrict the advancements related to BP estimation. To overcome this limit, we propose to split the problem in a two-stage processing chain: (i) converting iPPG to contact PPG (cPPG) signals using available video dataset and (ii) estimate BP from converted cPPG signals by exploiting large existing databases (e.g. MIMIC). This article presents the first developments where a method for converting iPPG signals measured using a camera into cPPG signals measured by contact sensors is proposed. Real and imaginary parts of the continuous wavelet transform (CWT) of cPPG and iPPG signals are passed to various deep pre-trained U-shaped architectures. Conventional metrics and specific waveform estimators have been implemented to validate the relevance of the predictions. The results exhibit good agreements towards a large portion of metrics, showing that the neural architectures properly estimated cPPG from iPPG signals through their CWT representations. The performance indicates that BP estimation from iPPG signals converted to cPPG signals can now be envisaged. Consequently, future work will focus on the integration of models dedicated to BP estimation trained on MIMIC. This is the first demonstration of a method for accurate reconstruction of cPPG from iPPG signals satisfying pulse waveform criteria.