An effective cross-scenario remote heart rate estimation network based on global-local information and video transformer

Remote photoplethysmography (rPPG) technology is a non-contact physiological signal measurement method, characterized by non-invasiveness and ease of use. It has broad application potential in medical health, human factors engineering, and other fields. However, current rPPG technology is highly susceptible to variations in lighting conditions, head pose changes, and partial occlusions, posing significant challenges for its widespread application. In order to improve the accuracy of remote heart rate estimation and enhance model generalization, we propose PulseFormer, a dual-path network based on transformer. By integrating local and global information and utilizing fast and slow paths, PulseFormer effectively captures the temporal variations of key regions and spatial variations of the global area, facilitating the extraction of rPPG feature information while mitigating the impact of background noise variations. Heart rate estimation results on the popular rPPG dataset show that PulseFormer achieves state-of-the-art performance on public datasets. Additionally, we establish a dataset containing facial expressions and synchronized physiological signals in driving scenarios and test the pre-trained model from the public dataset on this collected dataset. The results indicate that PulseFormer exhibits strong generalization capabilities across different data distributions in cross-scenario settings. Therefore, this model is applicable for heart rate estimation of individuals in various scenarios.

Analysis of photoplethysmogram signal to estimate heart rate during physical activity using fractional fourier transform - A sampling frequency independent and reference signal-less method

BACKGROUND AND OBJECTIVE

Acquiring accurate and reliable health information using a PPG signal in wearable devices requires suppressing motion artifacts. This paper presents a method based on the Fractional Fourier transform (FrFT) to effectively suppress the motion artifacts in a Photoplethysmogram (PPG) signal for an accurate estimation of heart rate (HR).

METHODS

By analyzing various PPG signals recorded under various physiological conditions and sampling frequencies, the proposed work determines an optimal value of the fractional order of the proposed FrFT. The proposed FrFT-based algorithm separates the motion artifacts component from the acquired PPG signal. Finally, the HR estimation accuracy during the strong motion artifact-affected windows is improved using a post-processing technique. The efficacy of the proposed method is evaluated by computing the root mean square error (RMSE).

RESULTS

The performance of the proposed algorithm is compared with methods in recent studies using test and training datasets from the IEEE Signal Processing Cup (SPC). The proposed method provides the mean absolute error of 1.88 beats per minute (BPM) on all twenty-three recordings.

CONCLUSIONS

The proposed method uses the Fourier method in the fractional domain. A noisy signal is rotated into an intermediate plane between the time and frequency domains to separate the signal from the noise. The algorithm incorporates FrFT analysis to suppress motion artifacts from PPG signals to estimate HR accurately. Further, a post-processing step is used to track the HR for accurate and reliable HR estimation. The proposed FrFT-based algorithm doesn't require additional reference accelerometers or hardware to estimate HR in real-time. The noise and signal separation is optimum for a fractional order (a) value in the vicinity of 0.6. The optimized value of fractional order is constant irrespective of the physical activity and sampling frequency.

AND-rPPG: A novel denoising-rPPG network for improving remote heart rate estimation

Heart rate (HR) estimation is an essential physiological parameter in the field of biomedical imaging. Remote Photoplethysmography (r-PPG) is a pathbreaking development in this field wherein the PPG signal is extracted from non-contact face videos. In the COVID-19 pandemic, rPPG plays a vital role for doctors and patients to perform telehealthcare. Existing rPPG methods provide incorrect HR estimation when face video contains facial deformations induced by facial expression. These methods process the entire face and utilize the same knowledge to mitigate different noises. It limits the performance of these methods because different facial expressions induce different noise characteristics depending on the facial region. Another limitation is that these methods neglect the facial expression for denoising even though it is the prominent noise source in temporal signals. These issues are mitigated in this paper by proposing a novel HR estimation method AND-rPPG, that is, A Novel Denoising-rPPG. We initiate the utilization of Action Units (AUs) for denoising temporal signals. Our denoising network models the temporal signals better than sequential architectures and mitigate the AUs-based (or face expression-based) noises effectively. The experiments performed on publicly available datasets reveal that our proposed method outperforms state-of-the-art HR estimation methods, and our denoising model can be easily integrated with existing methods to improve their HR estimation.

SPECMAR: fast heart rate estimation from PPG signal using a modified spectral subtraction scheme with composite motion artifacts reference generation

The task of heart rate estimation using photoplethysmographic (PPG) signal is challenging due to the presence of various motion artifacts in the recorded signals. In this paper, a fast algorithm for heart rate estimation based on modified SPEctral subtraction scheme utilizing Composite Motion Artifacts Reference generation (SPECMAR) is proposed using two-channel PPG and three-axis accelerometer signals. First, the preliminary noise reduction is obtained by filtering unwanted frequency components from the recorded signals. Next, a composite motion artifacts reference generation method is developed to be employed in the proposed SPECMAR algorithm for motion artifacts reduction. The heart rate is then computed from the noise and motion artifacts reduced PPG signal. Finally, a heart rate tracking algorithm is proposed considering neighboring estimates. The performance of the SPECMAR algorithm has been tested on publicly available PPG database. The average heart rate estimation error is found to be 2.09 BPM on 23 recordings. The Pearson correlation is 0.9907. Due to low computational complexity, the method is faster than the comparing methods. The low estimation error, smooth and fast heart rate tracking makes SPECMAR an ideal choice to be implemented in wearable devices. Graphical Abstract Flow chart for the heart rate estimation using modified SPEctral subtraction scheme utilizing Composite Motion Artifacts Reference generation (SPECMAR) from photoplethysmographic (PPG) signals.