Motion and Noise Artifact-Resilient Atrial Fibrillation Detection using a Smartphone

Detecting cardiac states with wearable photoplethysmograms and implications for out-of-hospital cardiac arrest detection

Out-of-hospital cardiac arrest (OHCA) is a global health problem affecting approximately 4.4 million individuals yearly. OHCA has a poor survival rate, specifically when unwitnessed (accounting for up to 75% of cases). Rapid recognition can significantly improve OHCA survival, and consumer wearables with continuous cardiopulmonary monitoring capabilities hold potential to "witness" cardiac arrest and activate emergency services. In this study, we used an arterial occlusion model to simulate cardiac arrest and investigated the ability of infrared photoplethysmogram (PPG) sensors, often utilized in consumer wearable devices, to differentiate normal cardiac pulsation, pulseless cardiac (i.e., resembling a cardiac arrest), and non-physiologic (i.e., off-body) states. Across the classification models trained and evaluated on three anatomical locations, higher classification performances were observed on the finger (macro average F1-score of 0.964 on the fingertip and 0.954 on the finger base) compared to the wrist (macro average F1-score of 0.837). The wrist-based classification model, which was trained and evaluated using all PPG measurements, including both high- and low-quality recordings, achieved a macro average precision and recall of 0.922 and 0.800, respectively. This wrist-based model, which represents the most common form factor in consumer wearables, could only capture about 43.8% of pulseless events. However, models trained and tested exclusively on high-quality recordings achieved higher classification outcomes (macro average F1-score of 0.975 on the fingertip, 0.973 on the finger base, and 0.934 on the wrist). The fingertip model had the highest performance to differentiate arterial occlusion pulselessness from normal cardiac pulsation and off-body measurements with macro average precision and recall of 0.978 and 0.972, respectively. This model was able to identify 93.7% of pulseless states (i.e., resembling a cardiac arrest event), with a 0.4% false positive rate. All classification models relied on a combination of time-, power spectral density (PSD)-, and frequency-domain features to differentiate normal cardiac pulsation, pulseless cardiac, and off-body PPG recordings. However, our best model represented an idealized detection condition, relying on ensuring high-quality PPG data for training and evaluation of machine learning algorithms. While 90.7% of our PPG recordings from the fingertip were considered of high quality, only 53.2% of the measurements from the wrist passed the quality criteria. Our findings have implications for adapting consumer wearables to provide OHCA detection, involving advancements in hardware and software to ensure high-quality measurements in real-world settings, as well as development of wearables with form factors that enable high-quality PPG data acquisition more consistently. Given these improvements, we demonstrate that OHCA detection can feasibly be made available to anyone using PPG-based consumer wearables.

Visual Reassessment with Flux-Interval Plot Configuration after Automatic Classification for Accurate Atrial Fibrillation Detection by Photoplethysmography

Atrial fibrillation (AFib) is a common type of arrhythmia that is often clinically asymptomatic, which increases the risk of stroke significantly but can be prevented with anticoagulation. The photoplethysmogram (PPG) has recently attracted a lot of attention as a surrogate for electrocardiography (ECG) on atrial fibrillation (AFib) detection, with its out-of-hospital usability for rapid screening or long-term monitoring. Previous studies on AFib detection via PPG signals have achieved good results, but were short of intuitive criteria like ECG p-wave absence or not, especially while using interval randomness to detect AFib suffering from conjunction with premature contractions (PAC/PVC). In this study, we newly developed a PPG flux (pulse amplitude) and interval plots-based methodology, simply comprising an irregularity index threshold of 20 and regression error threshold of 0.06 for the precise automatic detection of AFib. The proposed method with automated detection on AFib shows a combined sensitivity, specificity, accuracy, and precision of 1, 0.995, 0.995, and 0.952 across the 460 samples. Furthermore, the flux-interval plot configuration also acts as a very intuitive tool for visual reassessment to confirm the automatic detection of AFib by its distinctive plot pattern compared to other cardiac rhythms. The study demonstrated that exclusive 2 false-positive cases could be corrected after the reassessment. With the methodology’s background theory well established, the detection process automated and visualized, and the PPG sensors already extensively used, this technology is very user-friendly and convincing for promoted to in-house AFib diagnostics.

Recent Advances in Materials and Flexible Sensors for Arrhythmia Detection

Arrhythmias are one of the leading causes of death in the United States, and their early detection is essential for patient wellness. However, traditional arrhythmia diagnosis by expert evaluation from intermittent clinical examinations is time-consuming and often lacks quantitative data. Modern wearable sensors and machine learning algorithms have attempted to alleviate this problem by providing continuous monitoring and real-time arrhythmia detection. However, current devices are still largely limited by the fundamental mismatch between skin and sensor, giving way to motion artifacts. Additionally, the desirable qualities of flexibility, robustness, breathability, adhesiveness, stretchability, and durability cannot all be met at once. Flexible sensors have improved upon the current clinical arrhythmia detection methods by following the topography of skin and reducing the natural interface mismatch between cardiac monitoring sensors and human skin. Flexible bioelectric, optoelectronic, ultrasonic, and mechanoelectrical sensors have been demonstrated to provide essential information about heart-rate variability, which is crucial in detecting and classifying arrhythmias. In this review, we analyze the current trends in flexible wearable sensors for cardiac monitoring and the efficacy of these devices for arrhythmia detection.

Enhancing the Robustness of Smartphone Photoplethysmography: A Signal Quality Index Approach

Heart rate variability (HRV) provides essential health information such as the risks of heart attacks and mental disorders. However, inconvenience related to the accurate detection of HRV limits its potential applications. The ubiquitous use of smartphones makes them an excellent choice for regular and portable health monitoring. Following this trend, smartphone photoplethysmography (PPG) has recently garnered prominence; however, the lack of robustness has prevented both researchers and practitioners from embracing this technology. This study aimed to bridge the gap in the literature by developing a novel smartphone PPG quality index (SPQI) that can filter corrupted data. A total of 226 participants joined the study, and results from 1343 samples were used to validate the proposed sinusoidal function-based model. In both the correlation coefficient and Bland-Altman analyses, the agreement between HRV measurements generated by both the smartphone PPG and the reference electrocardiogram improved when data were filtered through the SPQI. Our results support not only the proposed approach but also the general value of using smartphone PPG in HRV analysis.

Analysis of Relevant Features from Photoplethysmographic Signals for Atrial Fibrillation Classification

Atrial Fibrillation (AF) is the most common cardiac arrhythmia found in clinical practice. It affects an estimated 33.5 million people, representing approximately 0.5% of the world's population. Electrocardiogram (ECG) is the main diagnostic criterion for AF. Recently, photoplethysmography (PPG) has emerged as a simple and portable alternative for AF detection. However, it is not completely clear which are the most important features of the PPG signal to perform this process. The objective of this paper is to determine which are the most relevant features for PPG signal analysis in the detection of AF. This study is divided into two stages: (a) a systematic review carried out following the Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) statement in six databases, in order to identify the features of the PPG signal reported in the literature for the detection of AF, and (b) an experimental evaluation of them, using machine learning, in order to determine which have the greatest influence on the process of detecting AF. Forty-four features were found when analyzing the signal in the time, frequency, or time-frequency domains. From those 44 features, 27 were implemented, and through machine learning, it was found that only 11 are relevant in the detection process. An algorithm was developed for the detection of AF based on these 11 features, which obtained an optimal performance in terms of sensitivity (98.43%), specificity (99.52%), and accuracy (98.97%).

Photoplethysmography based atrial fibrillation detection: a review

Atrial fibrillation (AF) is a cardiac rhythm disorder associated with increased morbidity and mortality. It is the leading risk factor for cardioembolic stroke and its early detection is crucial in both primary and secondary stroke prevention. Continuous monitoring of cardiac rhythm is today possible thanks to consumer-grade wearable devices, enabling transformative diagnostic and patient management tools. Such monitoring is possible using low-cost easy-to-implement optical sensors that today equip the majority of wearables. These sensors record blood volume variations-a technology known as photoplethysmography (PPG)-from which the heart rate and other physiological parameters can be extracted to inform about user activity, fitness, sleep, and health. Recently, new wearable devices were introduced as being capable of AF detection, evidenced by large prospective trials in some cases. Such devices would allow for early screening of AF and initiation of therapy to prevent stroke. This review is a summary of a body of work on AF detection using PPG. A thorough account of the signal processing, machine learning, and deep learning approaches used in these studies is presented, followed by a discussion of their limitations and challenges towards clinical applications.

Novel Image Processing Method for Detecting Strep Throat (Streptococcal Pharyngitis) Using Smartphone

In this paper, we propose a novel strep throat detection method using a smartphone with an add-on gadget. Our smartphone-based strep throat detection method is based on the use of camera and flashlight embedded in a smartphone. The proposed algorithm acquires throat image using a smartphone with a gadget, processes the acquired images using color transformation and color correction algorithms, and finally classifies streptococcal pharyngitis (or strep) throat from healthy throat using machine learning techniques. Our developed gadget was designed to minimize the reflection of light entering the camera sensor. The scope of this paper is confined to binary classification between strep and healthy throats. Specifically, we adopted k-fold validation technique for classification, which finds the best decision boundary from training and validation sets and applies the acquired best decision boundary to the test sets. Experimental results show that our proposed detection method detects strep throats with 93.75% accuracy, 88% specificity, and 87.5% sensitivity on average.

Monitoring of Heart Rate from Photoplethysmographic Signals Using a Samsung Galaxy Note8 in Underwater Environments

Photoplethysmography (PPG) is a commonly used in determining heart rate and oxygen saturation (SpO₂). However, PPG measurements and its accuracy are heavily affected by the measurement procedure and environmental factors such as light, temperature, and medium. In this paper, we analyzed the effects of different mediums (water vs. air) and temperature on the PPG signal quality and heart rate estimation. To evaluate the accuracy, we compared our measurement output with a gold-standard PPG device (NeXus-10 MKII). The experimental results show that the average PPG signal amplitude values of the underwater environment decreased considerably (22% decrease) compared to PPG signals of dry environments, and the heart rate measurement deviated 7% (5 beats per minute on average. The experimental results also show that the signal to noise ratio (SNR) and signal amplitude decrease as temperature decreases. Paired t-test which compares amplitude and heart rate values between the underwater and dry environments was performed and the test results show statistically significant differences for both amplitude and heart rate values (p < 0.05). Moreover, experimental results indicate that decreasing the temperature from 45 °C to 5 °C or changing the medium from air to water decreases PPG signal quality, (e.g., PPG signal amplitude decreases from 0.560 to 0.112). The heart rate is estimated within 5.06 bpm deviation at 18 °C in underwater environment, while estimation accuracy decreases as temperature goes down.

A novel diversity method for smartphone camera-based heart rhythm signals in the presence of motion and noise artifacts

The advent of smartphones has advanced the use of embedded sensors to acquire various physiological information. For example, smartphone camera sensors and accelerometers can provide heart rhythm signals to the subjects, while microphones can give respiratory signals. However, the acquired smartphone-based physiological signals are more vulnerable to motion and noise artifacts (MNAs) compared to using medical devices, since subjects need to hold the smartphone with proper contact to the smartphone camera and lens stably and tightly for a duration of time without any movement in the hand or finger. This results in more MNA than traditional methods, such as placing a finger inside a tightly enclosed pulse oximeter to get PPG signals, which provides stable contact between the sensor and the subject's finger. Moreover, a smartphone lens does not block ambient light in an effective way, while pulse oximeters are designed to block the ambient light effectively. In this paper, we propose a novel diversity method for smartphone signals that reduces the effect of MNAs during heart rhythm signal detection by 1) acquiring two heterogeneous signals from a color intensity signal and a fingertip movement signal, and 2) selecting the less MNA-corrupted signal of the two signals. The proposed method has advantages in that 1) diversity gain can be obtained from the two heterogeneous signals when one signal is clean while the other signal is corrupted, and 2) acquisition of the two heterogeneous signals does not double the acquisition procedure but maintains a single acquisition procedure, since two heterogeneous signals can be obtained from a single smartphone camera recording. In our diversity method, we propose to choose the better signal based on the signal quality indices (SQIs), i.e., standard deviation of instantaneous heart rate (STD-HR), root mean square of the successive differences of peak-to-peak time intervals (RMSSD-T), and standard deviation of peak values (STD-PV). As a performance metric evaluating the proposed diversity method, the ratio of usable period is considered. Experimental results show that our diversity method increases the usable period 19.53% and 6.25% compared to the color intensity or the fingertip movement signals only, respectively.

A Novel Personalized Motion and Noise Artifact (MNA) Detection Method for Smartphone Photoplethysmograph (PPG) Signals

Photoplethysmography (PPG) is a technique to detect blood volume changes in an optical way. Representative PPG applications are the measurements of oxygen saturation, heart rate, and respiratory rate. However, PPG signals are sensitive to motion and noise artifacts (MNAs) especially when they are obtained from smartphone cameras. Moreover, PPG signals are different among users and each individual's PPG signal has a unique characteristic. Hence, an effective MNA detection and reduction method for smartphone PPG signals, which adapts itself to each user in a personalized way, is highly demanded. Here, a concept of the probabilistic neural network (PNN) is introduced to be used with the proposed extracted parameters. The signal amplitude, standard deviation of peak to peak time intervals and amplitudes, along with the mean of moving standard deviation, signal slope changes, and the optimal autoregressive (AR) model order are proposed for effective MNA detection. Accordingly, the performance of the proposed personalized algorithm is compared with conventional MNA detection algorithms. As performance metrics, we considered accuracy, sensitivity, and specificity. The results show that the overall performance of the personalized MNA detection is enhanced compared to the generalized algorithm. The average values of the accuracy, sensitivity and specificity of the personalized one are 98.07%, 92.6%, and 99.78%, respectively, while these are 89.92%, 84.21%, and 93.63% for the general one.