Motion Robust Remote-PPG in Infrared

Skin inhomogeneity as a source of error in remote PPG-imaging

Remote photoplethysmography (rPPG) imaging is an optical technique to remotely assess the local cutaneous microcirculation. Despite its potential for enabling health-related applications, the current understanding of the outcome images/maps remains incomplete. In this paper, we present a model and supporting experiments confirming the contribution of skin inhomogeneity to the morphology of PPG waveforms. Since rPPG imagers rely on the complex inner-product operator and may combine multiple wavelengths, the derived phase measurements reflect morphological heterogeneity of PPG signals to a larger extent than propagation-related phase differences. The influence of light penetration depth on PPG was observed and modeled on the green and red wavelengths at the hand region. We further show how our work contributes to understanding reproducibility issues in recent papers on pulse wave velocity (PWV) estimation.

Illumination Variation-Resistant Video-Based Heart Rate Measurement Using Joint Blind Source Separation and Ensemble Empirical Mode Decomposition

Recent studies have demonstrated that heart rate (HR) could be estimated using video data [e.g., exploring human facial regions of interest (ROIs)] under well-controlled conditions. However, in practice, the pulse signals may be contaminated by motions and illumination variations. In this paper, tackling the illumination variation challenge, we propose an illumination-robust framework using joint blind source separation (JBSS) and ensemble empirical mode decomposition (EEMD) to effectively evaluate HR from webcam videos. The framework takes the hypotheses that both facial ROI and background ROI have similar illumination variations. The background ROI is then considered as a noise reference sensor to denoise the facial signals by using the JBSS technique to extract the underlying illumination variation sources. Further, the reconstructed illumination-resisted green channel of the facial ROI is detrended and decomposed into a number of intrinsic mode functions using EEMD to estimate the HR. Experimental results demonstrated that the proposed framework could estimate HR more accurately than the state-of-the-art methods. The Bland-Altman plots showed that it led to better agreement with HR ground truth with the mean bias 1.15 beats/min (bpm), with 95% limits from -15.43 to 17.73 bpm, and the correlation coefficient 0.53. This study provides a promising solution for realistic noncontact and robust HR measurement applications.

A survey of remote optical photoplethysmographic imaging methods

In recent years researchers have presented a number of new methods for recovering physiological parameters using just low-cost digital cameras and image processing. The ubiquity of digital cameras presents the possibility for many new, low-cost applications of vital sign monitoring. In this paper we present a review of the work on remote photoplethysmographic (PPG) imaging using digital cameras. This review specifically focuses on the state-of-the-art in PPG imaging where: 1) measures beyond pulse rate are evaluated, 2) non-ideal conditions (e.g., the presence of motion artifacts) are explored, and 3) use cases in relevant environments are demonstrated. We discuss gaps within the literature and future challenges for the research community. To aid in the continuing advancement of PPG imaging research, we are making available a website with the references collected for this review as well as information on available code and datasets of interest. It is our hope that this website will become a valuable resource for the PPG imaging community. The site can be found at: http://web.mit.edu/~djmcduff/www/ remote-physiology.html.

Unobtrusive sleep state measurements in preterm infants - A review

Sleep is important for the development of preterm infants. During sleep, neural connections are formed and the development of brain regions is triggered. In general, various rudimentary sleep states can be identified in the preterm infant, namely active sleep (AS), quiet sleep (QS) and intermediate sleep (IS). As the infant develops, sleep states change in length and organization, with these changes as important indicators of brain development. As a result, several methods have been deployed to distinguish between the different preterm infant sleep states, among which polysomnography (PSG) is the most frequently used. However, this method is limited by the use of adhesive electrodes or patches that are attached to the body by numerous cables that can disturb sleep. Given the importance of sleep, this review explores more unobtrusive methods that can identify sleep states without disturbing the infant. To this end, after a brief introduction to preterm sleep states, an analysis of the physiological characteristics associated with the different sleep states is provided and various methods of measuring these physiological characteristics are explored. Finally, the advantages and disadvantages of each of these methods are evaluated and recommendations for neonatal sleep monitoring proposed.

Ballistocardiographic Artifacts in PPG Imaging

OBJECTIVE

Photoplethysmography (PPG) is a noninvasive technique to measure the blood-volume pulse and derive various vital signs. Camera-based PPG imaging was recently proposed for clinical microvascular assessment, but motion robustness is still an issue for this technique. Our study aims to quantify cardiac-related, i.e., ballistocardiographic (BCG), motion as a source of artifacts in PPG imaging.

METHODS

In this paper, using the human head as a relevant region of interest, the amplitude of BCG-artifacts was modeled for a Lambertian surface illuminated by a light source. To derive peak-to-peak head displacements for the model, we recorded, on 54 subjects, PPG and inertial sensor data at the pulse and cranial vertex. We simulated the effect of light source location at a mesh representation of a human face and conducted additional experiments on a real subject.

RESULTS

Under nonorthogonal illumination, the relative strength of the BCG artifacts is strong enough, compared to the amplitude of PPG signals, to compromise PPG imaging in realistic scenarios. Particularly affected are the signals obtained in the nongreen part of the spectrum and/or when the incident angle at the skin surface exceeds 45 (°).

CONCLUSION

From the model and an additional experiment conducted on real skin, we were able to prove that homogenous and orthogonal illumination is a means to minimize the problem.

SIGNIFICANCE

Our illumination recommendation provides a simple and effective means to improve the validity of remote PPG-imagers. We hope that it helps to prevent mistakes currently seen in many publications on remote PPG.

Photoplethysmography Revisited: From Contact to Noncontact, From Point to Imaging

Photoplethysmography (PPG) is a noninvasive optical technique for detecting microvascular blood volume changes in tissues. Its ease of use, low cost and convenience make it an attractive area of research in the biomedical and clinical communities. Nevertheless, its single spot monitoring and the need to apply a PPG sensor directly to the skin limit its practicality in situations such as perfusion mapping and healing assessments or when free movement is required. The introduction of fast digital cameras into clinical imaging monitoring and diagnosis systems, the desire to reduce the physical restrictions, and the possible new insights that might come from perfusion imaging and mapping inspired the evolution of the conventional PPG technology to imaging PPG (IPPG). IPPG is a noncontact method that can detect heart-generated pulse waves by means of peripheral blood perfusion measurements. Since its inception, IPPG has attracted significant public interest and provided opportunities to improve personal healthcare. This study presents an overview of the wide range of IPPG systems currently being introduced along with examples of their application in various physiological assessments. We believe that the widespread acceptance of IPPG is happening, and it will dramatically accelerate the promotion of this healthcare model in the near future.