1
|
Davoodi M, Aspis N, Drori Y, Weiser-Bitoun I, Yaniv Y. LieRHRV system for remote lie detection using heart rate variability parameters. Sci Rep 2024; 14:30749. [PMID: 39730487 DOI: 10.1038/s41598-024-80480-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2024] [Accepted: 11/19/2024] [Indexed: 12/29/2024] Open
Abstract
The standard polygraph, or lie detector, is limited by its reliance on average heart rate, subjective examiner interpretation, and the need for direct subject contact. Remote photoplethysmography (rPPG) offers a promising contactless alternative, by using facial videos to extract heart rate variability (HRV). We introduce "LieRHRV," a remote lie detection algorithm based solely on extracted HRV parameters. To test the HRV parameter quality, we compared these parameters to HRV parameters extracted from ECG and photoplethysmography (PPG) records archived in five gold-standard ECG/PPG datasets. A prospective study of 39 healthy volunteers was also performed to evaluate the accuracy of lie detection based on PPG- or rPPG-derived HRV parameters. Effective HRV parameter extraction from both PPG and ECG sources was demonstrated, with comparable outcomes among 60% of the parameters on average with the publicly available datasets, and prospective study with 80% of the parameters. LieRHRV performance on ECG, PPG or rPPG (with parameters selected for PPG) exhibited an accuracy of 83.3 ± 3%, 87.3 ± 4% or 91.7 ± 3.5%, respectively. In comparison, the naïve model for ECG, PPG or rPPG data achieved an accuracy of 58.3 ± 3%, 61.0 ± 3% or 67.0 ± 5%, respectively. This study demonstrated the feasibility and effectiveness of LieRHRV, and offers a promising avenue for advancing lie detection technologies beyond polygraph limitations.
Collapse
Affiliation(s)
- Moran Davoodi
- Laboratory of Bioelectric and Bioenergetic Systems, Faculty of Biomedical Engineering, Technion-Israel Institute of Technology, Haifa, Israel
| | - Nitay Aspis
- Laboratory of Bioelectric and Bioenergetic Systems, Faculty of Biomedical Engineering, Technion-Israel Institute of Technology, Haifa, Israel
- Rappaport Faculty of Medicine, Technion-Israel Institute of Technology, Haifa, Israel
| | - Yael Drori
- Laboratory of Bioelectric and Bioenergetic Systems, Faculty of Biomedical Engineering, Technion-Israel Institute of Technology, Haifa, Israel
| | - Ido Weiser-Bitoun
- Laboratory of Bioelectric and Bioenergetic Systems, Faculty of Biomedical Engineering, Technion-Israel Institute of Technology, Haifa, Israel
- Department of Internal Medicine "C", Rambam Health Care Campus, 3109601, Haifa, Israel
| | - Yael Yaniv
- Laboratory of Bioelectric and Bioenergetic Systems, Faculty of Biomedical Engineering, Technion-Israel Institute of Technology, Haifa, Israel.
| |
Collapse
|
2
|
Syversen A, Dosis A, Jayne D, Zhang Z. Wearable Sensors as a Preoperative Assessment Tool: A Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:482. [PMID: 38257579 PMCID: PMC10820534 DOI: 10.3390/s24020482] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Revised: 01/06/2024] [Accepted: 01/09/2024] [Indexed: 01/24/2024]
Abstract
Surgery is a common first-line treatment for many types of disease, including cancer. Mortality rates after general elective surgery have seen significant decreases whilst postoperative complications remain a frequent occurrence. Preoperative assessment tools are used to support patient risk stratification but do not always provide a precise and accessible assessment. Wearable sensors (WS) provide an accessible alternative that offers continuous monitoring in a non-clinical setting. They have shown consistent uptake across the perioperative period but there has been no review of WS as a preoperative assessment tool. This paper reviews the developments in WS research that have application to the preoperative period. Accelerometers were consistently employed as sensors in research and were frequently combined with photoplethysmography or electrocardiography sensors. Pre-processing methods were discussed and missing data was a common theme; this was dealt with in several ways, commonly by employing an extraction threshold or using imputation techniques. Research rarely processed raw data; commercial devices that employ internal proprietary algorithms with pre-calculated heart rate and step count were most commonly employed limiting further feature extraction. A range of machine learning models were used to predict outcomes including support vector machines, random forests and regression models. No individual model clearly outperformed others. Deep learning proved successful for predicting exercise testing outcomes but only within large sample-size studies. This review outlines the challenges of WS and provides recommendations for future research to develop WS as a viable preoperative assessment tool.
Collapse
Affiliation(s)
- Aron Syversen
- School of Computing, University of Leeds, Leeds LS2 9JT, UK
| | - Alexios Dosis
- School of Medicine, University of Leeds, Leeds LS2 9JT, UK; (A.D.); (D.J.)
| | - David Jayne
- School of Medicine, University of Leeds, Leeds LS2 9JT, UK; (A.D.); (D.J.)
| | - Zhiqiang Zhang
- School of Electrical Engineering, University of Leeds, Leeds LS2 9JT, UK;
| |
Collapse
|
3
|
Kumar A, Ashdhir A, Komaragiri R, Kumar M. Analysis of photoplethysmogram signal to estimate heart rate during physical activity using fractional fourier transform - A sampling frequency independent and reference signal-less method. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 229:107294. [PMID: 36528998 DOI: 10.1016/j.cmpb.2022.107294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 11/13/2022] [Accepted: 11/29/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND AND OBJECTIVE Acquiring accurate and reliable health information using a PPG signal in wearable devices requires suppressing motion artifacts. This paper presents a method based on the Fractional Fourier transform (FrFT) to effectively suppress the motion artifacts in a Photoplethysmogram (PPG) signal for an accurate estimation of heart rate (HR). METHODS By analyzing various PPG signals recorded under various physiological conditions and sampling frequencies, the proposed work determines an optimal value of the fractional order of the proposed FrFT. The proposed FrFT-based algorithm separates the motion artifacts component from the acquired PPG signal. Finally, the HR estimation accuracy during the strong motion artifact-affected windows is improved using a post-processing technique. The efficacy of the proposed method is evaluated by computing the root mean square error (RMSE). RESULTS The performance of the proposed algorithm is compared with methods in recent studies using test and training datasets from the IEEE Signal Processing Cup (SPC). The proposed method provides the mean absolute error of 1.88 beats per minute (BPM) on all twenty-three recordings. CONCLUSIONS The proposed method uses the Fourier method in the fractional domain. A noisy signal is rotated into an intermediate plane between the time and frequency domains to separate the signal from the noise. The algorithm incorporates FrFT analysis to suppress motion artifacts from PPG signals to estimate HR accurately. Further, a post-processing step is used to track the HR for accurate and reliable HR estimation. The proposed FrFT-based algorithm doesn't require additional reference accelerometers or hardware to estimate HR in real-time. The noise and signal separation is optimum for a fractional order (a) value in the vicinity of 0.6. The optimized value of fractional order is constant irrespective of the physical activity and sampling frequency.
Collapse
Affiliation(s)
- Ashish Kumar
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu, India
| | - Aryaman Ashdhir
- Department of Electronics and Communication Engineering, Bennett University, Greater Noida, India.
| | - Rama Komaragiri
- Department of Electronics and Communication Engineering, Bennett University, Greater Noida, India
| | - Manjeet Kumar
- Department of Electronics and Communication Engineering, Delhi Technological University, Delhi, India.
| |
Collapse
|
4
|
Handouzi W, Maaoui C, Pruski A. Virtual reality exposure aided-diagnosis system for anxiety disorders: Long short-term memory architecture for three levels of anxiety recognition. Biomed Mater Eng 2023; 34:491-502. [PMID: 37248874 DOI: 10.3233/bme-222542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
BACKGROUND The COVID-19 pandemic has resulted in increased psychological pressure on mental health since 2019. The resulting anxiety and stress have permeated every aspect of life during confinement. OBJECTIVE To provide psychologists with an unbiased measure that can aid in the preliminary diagnosis of anxiety disorders and be used as an initial treatment in cognitive-behavioral therapy, this article introduces automated recognition of three levels of anxiety. METHODS Anxiety was elicited by exposing participants to virtual environments inspired by social situations in reference to the Liebowitz social anxiety scale. Relevant parameters, such as heart rate variability and vasoconstriction were derived from the measurement of the blood volume pulse (BVP) signal. RESULTS A long short-term memory architecture achieved an accuracy of approximately 98% on the training and test set. CONCLUSION The generated model allowed for careful study of the state of seven phobic participants during virtual reality exposure (VRE).
Collapse
Affiliation(s)
- Wahida Handouzi
- Laboratoire d'Automatique de Tlemcen (LAT), Tlemcen University, Tlemcen, Algeria
| | | | | |
Collapse
|
5
|
Effects of Missing Data on Heart Rate Variability Metrics. SENSORS 2022; 22:s22155774. [PMID: 35957328 PMCID: PMC9371086 DOI: 10.3390/s22155774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 07/29/2022] [Accepted: 07/30/2022] [Indexed: 02/05/2023]
Abstract
Heart rate variability (HRV) has been studied for decades in clinical environments. Currently, the exponential growth of wearable devices in health monitoring is leading to new challenges that need to be solved. These devices have relatively poor signal quality and are affected by numerous motion artifacts, with data loss being the main stumbling block for their use in HRV analysis. In the present paper, it is shown how data loss affects HRV metrics in the time domain and frequency domain and Poincaré plots. A gap-filling method is proposed and compared to other existing approaches to alleviate these effects, both with simulated (16 subjects) and real (20 subjects) missing data. Two different data loss scenarios have been simulated: (i) scattered missing beats, related to a low signal to noise ratio; and (ii) bursts of missing beats, with the most common due to motion artifacts. In addition, a real database of photoplethysmography-derived pulse detection series provided by Apple Watch during a protocol including relax and stress stages is analyzed. The best correction method and maximum acceptable missing beats are given. Results suggest that correction without gap filling is the best option for the standard deviation of the normal-to-normal intervals (SDNN), root mean square of successive differences (RMSSD) and Poincaré plot metrics in datasets with bursts of missing beats predominance (p<0.05), whereas they benefit from gap-filling approaches in the case of scattered missing beats (p<0.05). Gap-filling approaches are also the best for frequency-domain metrics (p<0.05). The findings of this work are useful for the design of robust HRV applications depending on missing data tolerance and the desired HRV metrics.
Collapse
|
6
|
Guo Y, Liu X, Peng S, Jiang X, Xu K, Chen C, Wang Z, Dai C, Chen W. A review of wearable and unobtrusive sensing technologies for chronic disease management. Comput Biol Med 2021; 129:104163. [PMID: 33348217 PMCID: PMC7733550 DOI: 10.1016/j.compbiomed.2020.104163] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Revised: 11/30/2020] [Accepted: 11/30/2020] [Indexed: 11/25/2022]
Abstract
With the rapidly increasing number of patients with chronic disease, numerous recent studies have put great efforts into achieving long-term health monitoring and patient management. Specifically, chronic diseases including cardiovascular disease, chronic respiratory disease and brain disease can threaten patients' health conditions over a long period of time, thus effecting their daily lives. Vital health parameters, such as heart rate, respiratory rate, SpO2 and blood pressure, are closely associated with patients’ conditions. Wearable devices and unobtrusive sensing technologies can detect such parameters in a convenient way and provide timely predictions on health condition deterioration by tracking these biomedical signals and health parameters. In this paper, we review current advancements in wearable devices and unobtrusive sensing technologies that can provides possible tools and technological supports for chronic disease management. Current challenges and future directions of related techniques are addressed accordingly.
Collapse
Affiliation(s)
- Yao Guo
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Xiangyu Liu
- School of Art Design and Media, East China University of Science and Technology, Shanghai, 200237, China
| | - Shun Peng
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Xinyu Jiang
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Ke Xu
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Chen Chen
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Zeyu Wang
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Chenyun Dai
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China.
| | - Wei Chen
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai, 200433, China.
| |
Collapse
|
7
|
Hurley NC, Spatz ES, Krumholz HM, Jafari R, Mortazavi BJ. A Survey of Challenges and Opportunities in Sensing and Analytics for Risk Factors of Cardiovascular Disorders. ACM TRANSACTIONS ON COMPUTING FOR HEALTHCARE 2021; 2:9. [PMID: 34337602 PMCID: PMC8320445 DOI: 10.1145/3417958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Accepted: 08/01/2020] [Indexed: 10/22/2022]
Abstract
Cardiovascular disorders cause nearly one in three deaths in the United States. Short- and long-term care for these disorders is often determined in short-term settings. However, these decisions are made with minimal longitudinal and long-term data. To overcome this bias towards data from acute care settings, improved longitudinal monitoring for cardiovascular patients is needed. Longitudinal monitoring provides a more comprehensive picture of patient health, allowing for informed decision making. This work surveys sensing and machine learning in the field of remote health monitoring for cardiovascular disorders. We highlight three needs in the design of new smart health technologies: (1) need for sensing technologies that track longitudinal trends of the cardiovascular disorder despite infrequent, noisy, or missing data measurements; (2) need for new analytic techniques designed in a longitudinal, continual fashion to aid in the development of new risk prediction techniques and in tracking disease progression; and (3) need for personalized and interpretable machine learning techniques, allowing for advancements in clinical decision making. We highlight these needs based upon the current state of the art in smart health technologies and analytics. We then discuss opportunities in addressing these needs for development of smart health technologies for the field of cardiovascular disorders and care.
Collapse
|
8
|
Dzieżyc M, Gjoreski M, Kazienko P, Saganowski S, Gams M. Can We Ditch Feature Engineering? End-to-End Deep Learning for Affect Recognition from Physiological Sensor Data. SENSORS 2020; 20:s20226535. [PMID: 33207564 PMCID: PMC7697590 DOI: 10.3390/s20226535] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Revised: 11/01/2020] [Accepted: 11/06/2020] [Indexed: 01/18/2023]
Abstract
To further extend the applicability of wearable sensors in various domains such as mobile health systems and the automotive industry, new methods for accurately extracting subtle physiological information from these wearable sensors are required. However, the extraction of valuable information from physiological signals is still challenging—smartphones can count steps and compute heart rate, but they cannot recognize emotions and related affective states. This study analyzes the possibility of using end-to-end multimodal deep learning (DL) methods for affect recognition. Ten end-to-end DL architectures are compared on four different datasets with diverse raw physiological signals used for affect recognition, including emotional and stress states. The DL architectures specialized for time-series classification were enhanced to simultaneously facilitate learning from multiple sensors, each having their own sampling frequency. To enable fair comparison among the different DL architectures, Bayesian optimization was used for hyperparameter tuning. The experimental results showed that the performance of the models depends on the intensity of the physiological response induced by the affective stimuli, i.e., the DL models recognize stress induced by the Trier Social Stress Test more successfully than they recognize emotional changes induced by watching affective content, e.g., funny videos. Additionally, the results showed that the CNN-based architectures might be more suitable than LSTM-based architectures for affect recognition from physiological sensors.
Collapse
Affiliation(s)
- Maciej Dzieżyc
- Department of Computational Intelligence, Wrocław University of Science and Technology, 50-370 Wrocław, Poland; (P.K.); (S.S.)
- Faculty of Computer Science and Management, Wrocław University of Science and Technology, 50-370 Wrocław, Poland
- Correspondence:
| | - Martin Gjoreski
- Jožef Stefan Institute, 1000 Ljubljana, Slovenia; (M.G.); (M.G.)
- Jožef Stefan Postgraduate School, 1000 Ljubljana, Slovenia
| | - Przemysław Kazienko
- Department of Computational Intelligence, Wrocław University of Science and Technology, 50-370 Wrocław, Poland; (P.K.); (S.S.)
- Faculty of Computer Science and Management, Wrocław University of Science and Technology, 50-370 Wrocław, Poland
| | - Stanisław Saganowski
- Department of Computational Intelligence, Wrocław University of Science and Technology, 50-370 Wrocław, Poland; (P.K.); (S.S.)
- Faculty of Computer Science and Management, Wrocław University of Science and Technology, 50-370 Wrocław, Poland
| | - Matjaž Gams
- Jožef Stefan Institute, 1000 Ljubljana, Slovenia; (M.G.); (M.G.)
- Jožef Stefan Postgraduate School, 1000 Ljubljana, Slovenia
| |
Collapse
|
9
|
Acceptance and Potential Impact of the eWALL Platform for Health Monitoring and Promotion in Persons with a Chronic Disease or Age-Related Impairment. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:ijerph17217893. [PMID: 33126506 PMCID: PMC7662387 DOI: 10.3390/ijerph17217893] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 10/22/2020] [Accepted: 10/24/2020] [Indexed: 12/18/2022]
Abstract
Pervasive health technologies can increase the effectiveness of personal health monitoring and training, but more user studies are necessary to understand the interest for these technologies, and how they should be designed and implemented. In the present study, we evaluated eWALL, a user-centered pervasive health technology consisting of a platform that monitors users’ physical and cognitive behavior, providing feedback and motivation via an easy-to-use, touch-based user interface. The eWALL was placed for one month in the home of 48 subjects with a chronic condition (chronic obstructive pulmonary disease—COPD or mild cognitive impairment—MCI) or with an age-related impairment. User acceptance, platform use, and potential clinical effects were evaluated using surveys, data logs, and clinical scales. Although some features of the platform need to be improved before reaching technical maturity and making a difference in patients’ lives, the real-life evaluation of eWALL has shown how some features may influence patients’ intention to use this promising technology. Furthermore, this study made it clear how the free use of different health apps is modulated by the real needs of the patient and by their usefulness in the context of the patient’s clinical status.
Collapse
|