1
|
Hu D, Gao W, Ang KK, Hu M, Huang R, Chuai G, Li X. CHMMConvScaleNet: a hybrid convolutional neural network and continuous hidden Markov model with multi-scale features for sleep posture detection. Sci Rep 2025; 15:12206. [PMID: 40204818 PMCID: PMC11982233 DOI: 10.1038/s41598-025-93541-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Accepted: 03/07/2025] [Indexed: 04/11/2025] Open
Abstract
Sleep posture, a vital aspect of sleep wellness, has become a crucial focus in sleep medicine. Studies show that supine posture can lead to a higher occurrence of obstructive sleep apnea, while lateral posture might reduce it. For bedridden patients, frequent posture changes are essential to prevent ulcers and bedsores, highlighting the importance of monitoring sleep posture. This paper introduces CHMMConvScaleNet, a novel method for sleep posture recognition using pressure signals from limited piezoelectric ceramic sensors. It employs a Movement Artifact and Rollover Identification (MARI) module to detect critical rollover events and extracts multi-scale spatiotemporal features using six sub-convolution networks with different-length adjacent segments. To optimize performance, a Continuous Hidden Markov Model (CHMM) with rollover features is presented. We collected continuous real sleep data from 22 participants, yielding a total of 8583 samples from a 32-sensor array. Experiments show that CHMMConvScaleNet achieves a recall of 92.91%, precision of 91.87%, and accuracy of 93.41%, comparable to state-of-the-art methods that require ten times more sensors to achieve a slightly improved accuracy of 96.90% on non-continuous datasets. Thus, CHMMConvScaleNet demonstrates potential for home sleep monitoring using portable devices.
Collapse
Affiliation(s)
- Dikun Hu
- School of Information and Communication Engineering, Institute for Beijing University of Posts and Telecommunications (BUPT), Beijing, 100876, China
| | - Weidong Gao
- School of Information and Communication Engineering, Institute for Beijing University of Posts and Telecommunications (BUPT), Beijing, 100876, China.
| | - Kai Keng Ang
- Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), Singapore, 138632, Singapore
- College of Computing and Data Science, Nanyang Technological University, Singapore, 639798, Singapore
| | - Mengjiao Hu
- Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), Singapore, 138632, Singapore
| | - Rong Huang
- Department of Respiratory and Critical Care Medicine, Peking Union Medical College Hospital, Beijing, 100730, China.
| | - Gang Chuai
- School of Information and Communication Engineering, Institute for Beijing University of Posts and Telecommunications (BUPT), Beijing, 100876, China
| | - Xiaoyan Li
- Vaccination Clinic of Zhaoyuan Mengzhi Sub District Community Health Service Center, Shandong, 265400, China
| |
Collapse
|
2
|
Hu D, Gao W, Ang KK, Hu M, Chuai G, Huang R. Smart Sleep Monitoring: Sparse Sensor-Based Spatiotemporal CNN for Sleep Posture Detection. SENSORS (BASEL, SWITZERLAND) 2024; 24:4833. [PMID: 39123879 PMCID: PMC11314976 DOI: 10.3390/s24154833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Revised: 07/20/2024] [Accepted: 07/24/2024] [Indexed: 08/12/2024]
Abstract
Sleep quality is heavily influenced by sleep posture, with research indicating that a supine posture can worsen obstructive sleep apnea (OSA) while lateral postures promote better sleep. For patients confined to beds, regular changes in posture are crucial to prevent the development of ulcers and bedsores. This study presents a novel sparse sensor-based spatiotemporal convolutional neural network (S3CNN) for detecting sleep posture. This S3CNN holistically incorporates a pair of spatial convolution neural networks to capture cardiorespiratory activity maps and a pair of temporal convolution neural networks to capture the heart rate and respiratory rate. Sleep data were collected in actual sleep conditions from 22 subjects using a sparse sensor array. The S3CNN was then trained to capture the spatial pressure distribution from the cardiorespiratory activity and temporal cardiopulmonary variability from the heart and respiratory data. Its performance was evaluated using three rounds of 10 fold cross-validation on the 8583 data samples collected from the subjects. The results yielded 91.96% recall, 92.65% precision, and 93.02% accuracy, which are comparable to the state-of-the-art methods that use significantly more sensors for marginally enhanced accuracy. Hence, the proposed S3CNN shows promise for sleep posture monitoring using sparse sensors, demonstrating potential for a more cost-effective approach.
Collapse
Affiliation(s)
- Dikun Hu
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China; (D.H.); (W.G.); (G.C.)
| | - Weidong Gao
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China; (D.H.); (W.G.); (G.C.)
| | - Kai Keng Ang
- Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), 1 Fusionopolis Way, #21-01 Connexis (South Tower), Singapore 138632, Singapore;
- College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Ave., Singapore 639798, Singapore
| | - Mengjiao Hu
- Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), 1 Fusionopolis Way, #21-01 Connexis (South Tower), Singapore 138632, Singapore;
| | - Gang Chuai
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China; (D.H.); (W.G.); (G.C.)
| | - Rong Huang
- Department of Respiratory and Critical Care Medicine, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No. 1 Shuaifuyuan Wangfujing, Beijing 100730, China;
| |
Collapse
|
3
|
Shin S, Choi S, Kim C, Mousavi AS, Hahn JO, Jeong S, Jeong H. BCG Signal Quality Assessment Based on Time-Series Imaging Methods. SENSORS (BASEL, SWITZERLAND) 2023; 23:9382. [PMID: 38067755 PMCID: PMC10708708 DOI: 10.3390/s23239382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 11/01/2023] [Accepted: 11/15/2023] [Indexed: 12/18/2023]
Abstract
This paper describes a signal quality classification method for arm ballistocardiogram (BCG), which has the potential for non-invasive and continuous blood pressure measurement. An advantage of the BCG signal for wearable devices is that it can easily be measured using accelerometers. However, the BCG signal is also susceptible to noise caused by motion artifacts. This distortion leads to errors in blood pressure estimation, thereby lowering the performance of blood pressure measurement based on BCG. In this study, to prevent such performance degradation, a binary classification model was created to distinguish between high-quality versus low-quality BCG signals. To estimate the most accurate model, four time-series imaging methods (recurrence plot, the Gramain angular summation field, the Gramain angular difference field, and the Markov transition field) were studied to convert the temporal BCG signal associated with each heartbeat into a 448 × 448 pixel image, and the image was classified using CNN models such as ResNet, SqueezeNet, DenseNet, and LeNet. A total of 9626 BCG beats were used for training, validation, and testing. The experimental results showed that the ResNet and SqueezeNet models with the Gramain angular difference field method achieved a binary classification accuracy of up to 87.5%.
Collapse
Affiliation(s)
- Sungtae Shin
- Department of Mechanical Engineering, Dong-A University, Busan 49315, Republic of Korea; (S.S.); (S.C.)
| | - Soonyoung Choi
- Department of Mechanical Engineering, Dong-A University, Busan 49315, Republic of Korea; (S.S.); (S.C.)
| | - Chaeyoung Kim
- Institute for Digital Antiaging and Healthcare, Inje University, Gimhae 50834, Republic of Korea;
| | - Azin Sadat Mousavi
- Department of Mechanical Engineering, University of Maryland, College Park, MD 20742, USA; (A.S.M.); (J.-O.H.)
| | - Jin-Oh Hahn
- Department of Mechanical Engineering, University of Maryland, College Park, MD 20742, USA; (A.S.M.); (J.-O.H.)
| | - Sehoon Jeong
- Institute for Digital Antiaging and Healthcare, Inje University, Gimhae 50834, Republic of Korea;
- Department of Healthcare Information Technology, Inje University, Gimhae 50834, Republic of Korea
- Paik Institute for Clinical Research, Inje University, Busan 50834, Republic of Korea
| | - Hyundoo Jeong
- Department of Mechatronics Engineering, Incheon National University, Incheon 22012, Republic of Korea
| |
Collapse
|
4
|
Feng J, Huang W, Jiang J, Wang Y, Zhang X, Li Q, Jiao X. Non-invasive monitoring of cardiac function through Ballistocardiogram: an algorithm integrating short-time Fourier transform and ensemble empirical mode decomposition. Front Physiol 2023; 14:1201722. [PMID: 37664434 PMCID: PMC10472450 DOI: 10.3389/fphys.2023.1201722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Accepted: 07/24/2023] [Indexed: 09/05/2023] Open
Abstract
The Ballistocardiogram (BCG) is a vibration signal that is generated by the displacement of the entire body due to the injection of blood during each heartbeat. It has been extensively utilized to monitor heart rate. The morphological features of the BCG signal serve as effective indicators for the identification of atrial fibrillation and heart failure, holding great significance for BCG signal analysis. The IJK-complex identification allows for the estimation of inter-beat intervals (IBI) and enables a more detailed analysis of BCG amplitude and interval waves. This study presents a novel algorithm for identifying the IJK-complex in BCG signals, which is an improvement over most existing algorithms that only perform IBI estimation. The proposed algorithm employs a short-time Fourier transform and summation across frequencies to initially estimate the occurrence of the J wave using peak finding, followed by Ensemble Empirical Mode Decomposition and a regional search to precisely identify the J wave. The algorithm's ability to detect the morphological features of BCG signals and estimate heart rates was validated through experiments conducted on 10 healthy subjects and 2 patients with coronary heart disease. In comparison to commonly used methods, the presented scheme ensures accurate heart rate estimation and exhibits superior capability in detecting BCG morphological features. This advancement holds significant value for future applications involving BCG signals.
Collapse
Affiliation(s)
- Jingda Feng
- Department of Aerospace Science and Technology, Space Engineering University, Beijing, China
- China Astronaut Research and Training Center, Beijing, China
| | - WeiFen Huang
- China Astronaut Research and Training Center, Beijing, China
| | - Jin Jiang
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing, China
| | - Yanlei Wang
- China Astronaut Research and Training Center, Beijing, China
| | - Xiang Zhang
- China Astronaut Research and Training Center, Beijing, China
| | - Qijie Li
- China Astronaut Research and Training Center, Beijing, China
| | - Xuejun Jiao
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing, China
| |
Collapse
|
5
|
Liu SH, Wu YR, Chen W, Su CH, Chin CL. Using Ballistocardiogram and Impedance Plethysmogram for Minimal Contact Measurement of Blood Pressure Based on a Body Weight-Fat Scale. SENSORS (BASEL, SWITZERLAND) 2023; 23:2318. [PMID: 36850917 PMCID: PMC9966183 DOI: 10.3390/s23042318] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 02/14/2023] [Accepted: 02/17/2023] [Indexed: 06/18/2023]
Abstract
Electronic health (eHealth) is a strategy to improve the physical and mental condition of a human, collecting daily physiological data and information from digital apparatuses. Body weight and blood pressure (BP) are the most popular and important physiological data. The goal of this study is to develop a minimal contact BP measurement method based on a commercial body weight-fat scale, capturing biometrics when users stand on it. The pulse transit time (PTT) is extracted from the ballistocardiogram (BCG) and impedance plethysmogram (IPG), measured by four strain gauges and four footpads of a commercial body weight-fat scale. Cuffless BP measurement using the electrocardiogram (ECG) and photoplethysmogram (PPG) serves as the reference method. The BP measured by a commercial BP monitor is considered the ground truth. Twenty subjects participated in this study. By the proposed model, the root-mean-square errors and correlation coefficients (r2s) of estimated systolic blood pressure and diastolic blood pressure are 7.3 ± 2.1 mmHg and 4.5 ± 1.8 mmHg, and 0.570 ± 0.205 and 0.284 ± 0.166, respectively. This accuracy level achieves the C grade of the corresponding IEEE standard. Thus, the proposed method has the potential benefit for eHealth monitoring in daily application.
Collapse
Affiliation(s)
- Shing-Hong Liu
- Department of Computer Science and Information Engineering, Chaoyang University of Technology, Taichung City 41349, Taiwan
| | - Yan-Rong Wu
- Department of Computer Science and Information Engineering, Chaoyang University of Technology, Taichung City 41349, Taiwan
| | - Wenxi Chen
- Biomedical Information Engineering Laboratory, The University of Aizu, Aizu-Wakamatsu City 965-8580, Japan
| | - Chun-Hung Su
- Institute of Medicine, School of Medicine, Chung-Shan Medical University, Taichung City 40201, Taiwan
- Department of Internal Medicine, Chung-Shan Medical University Hospital, Taichung City 40201, Taiwan
| | - Chiun-Li Chin
- Department of Medical Informatics, Chung-Shan Medical University, Taichung City 40201, Taiwan
| |
Collapse
|
6
|
Liu SH, Zhang BH, Chen W, Su CH, Chin CL. Cuffless and Touchless Measurement of Blood Pressure from Ballistocardiogram Based on a Body Weight Scale. Nutrients 2022; 14:2552. [PMID: 35745282 PMCID: PMC9229996 DOI: 10.3390/nu14122552] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Revised: 06/14/2022] [Accepted: 06/18/2022] [Indexed: 11/16/2022] Open
Abstract
Currently, in terms of reducing the infection risk of the COVID-19 virus spreading all over the world, the development of touchless blood pressure (BP) measurement has potential benefits. The pulse transit time (PTT) has a high relation with BP, which can be measured by electrocardiogram (ECG) and photoplethysmogram (PPG). The ballistocardiogram (BCG) reflects the mechanical vibration (or displacement) caused by the heart contraction/relaxation (or heart beating), which can be measured from multiple degrees of the body. The goal of this study is to develop a cuffless and touchless BP-measurement method based on a commercial weight scale combined with a PPG sensor when measuring body weight. The proposed method was that the PTTBCG-PPGT was extracted from the BCG signal measured by a weight scale, and the PPG signal was measured from the PPG probe placed at the toe. Four PTT models were used to estimate BP. The reference method was the PTTECG-PPGF extracted from the ECG signal and PPG signal measured from the PPG probe placed at the finger. The standard BP was measured by an electronic blood pressure monitor. Twenty subjects were recruited in this study. By the proposed method, the root-mean-square error (ERMS) of estimated systolic blood pressure (SBP) and diastolic blood pressure (DBP) are 6.7 ± 1.60 mmHg and 4.8 ± 1.47 mmHg, respectively. The correlation coefficients, r2, of the proposed model for the SBP and DBP are 0.606 ± 0.142 and 0.284 ± 0.166, respectively. The results show that the proposed method can serve for cuffless and touchless BP measurement.
Collapse
Affiliation(s)
- Shing-Hong Liu
- Department of Computer Science and Information Engineering, Chaoyang University of Technology, Taichung City 41349, Taiwan; (S.-H.L.); (B.-H.Z.)
| | - Bing-Hao Zhang
- Department of Computer Science and Information Engineering, Chaoyang University of Technology, Taichung City 41349, Taiwan; (S.-H.L.); (B.-H.Z.)
| | - Wenxi Chen
- Biomedical Information Engineering Laboratory, The University of Aizu, Aizu-Wakamatsu City 965-8580, Fukushima, Japan;
| | - Chun-Hung Su
- Institute of Medicine, School of Medicine, Chung-Shan Medical University, Taichung City 40201, Taiwan;
- Department of Internal Medicine, Chung-Shan Medical University Hospital, Taichung City 40201, Taiwan
| | - Chiun-Li Chin
- Department of Medical Informatics, Chung-Shan Medical University, Taichung City 40201, Taiwan
| |
Collapse
|
7
|
Cuffless blood pressure measuring devices: review and statement by the European Society of Hypertension Working Group on Blood Pressure Monitoring and Cardiovascular Variability. J Hypertens 2022; 40:1449-1460. [PMID: 35708294 DOI: 10.1097/hjh.0000000000003224] [Citation(s) in RCA: 95] [Impact Index Per Article: 31.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
BACKGROUND Many cuffless blood pressure (BP) measuring devices are currently on the market claiming that they provide accurate BP measurements. These technologies have considerable potential to improve the awareness, treatment, and management of hypertension. However, recent guidelines by the European Society of Hypertension do not recommend cuffless devices for the diagnosis and management of hypertension. OBJECTIVE This statement by the European Society of Hypertension Working Group on BP Monitoring and Cardiovascular Variability presents the types of cuffless BP technologies, issues in their validation, and recommendations for clinical practice. STATEMENTS Cuffless BP monitors constitute a wide and heterogeneous group of novel technologies and devices with different intended uses. Cuffless BP devices have specific accuracy issues, which render the established validation protocols for cuff BP devices inadequate for their validation. In 2014, the Institute of Electrical and Electronics Engineers published a standard for the validation of cuffless BP devices, and the International Organization for Standardization is currently developing another standard. The validation of cuffless devices should address issues related to the need of individual cuff calibration, the stability of measurements post calibration, the ability to track BP changes, and the implementation of machine learning technology. Clinical field investigations may also be considered and issues regarding the clinical implementation of cuffless BP readings should be investigated. CONCLUSION Cuffless BP devices have considerable potential for changing the diagnosis and management of hypertension. However, fundamental questions regarding their accuracy, performance, and implementation need to be carefully addressed before they can be recommended for clinical use.
Collapse
|
8
|
Barvik D, Cerny M, Penhaker M, Noury N. Noninvasive Continuous Blood Pressure Estimation from Pulse Transit Time: A review of the calibration models. IEEE Rev Biomed Eng 2021; 15:138-151. [PMID: 34487496 DOI: 10.1109/rbme.2021.3109643] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Noninvasive continuous blood pressure estimation is a promising alternative to minimally invasive blood pressure measurement using cuff and invasive catheter measurement, because it opens the way to both long-term and continuous blood pressure monitoring in ecological situation. The most current estimation algorithm is based on pulse transit time measurement where at least two measured signals need to be acquired. From the pulse transit time values, it is possible to estimate the continuous blood pressure for each cardiac cycle. This measurement highly depends on arterial properties which are not easily accessible with common measurement techniques; but these properties are needed as input for the estimation algorithm. With every change of input arterial properties, the error in the blood pressure estimation rises, thus a periodic calibration procedure is needed for error minimization. Recent research is focused on simplified constant arterial properties which are not constant over time and uses only linear model based on initial measurement. The elaboration of continuous calibration procedures, independent of recalibration measurement, is the key to improving the accuracy and robustness of noninvasive continuous blood pressure estimation. However, most models in literature are based on linear approximation and we discuss here the need for more complete calibration models.
Collapse
|