1
|
Hu D, Gao W, Ang KK, Hu M, Chuai G, Huang R. Smart Sleep Monitoring: Sparse Sensor-Based Spatiotemporal CNN for Sleep Posture Detection. SENSORS (BASEL, SWITZERLAND) 2024; 24:4833. [PMID: 39123879 PMCID: PMC11314976 DOI: 10.3390/s24154833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Revised: 07/20/2024] [Accepted: 07/24/2024] [Indexed: 08/12/2024]
Abstract
Sleep quality is heavily influenced by sleep posture, with research indicating that a supine posture can worsen obstructive sleep apnea (OSA) while lateral postures promote better sleep. For patients confined to beds, regular changes in posture are crucial to prevent the development of ulcers and bedsores. This study presents a novel sparse sensor-based spatiotemporal convolutional neural network (S3CNN) for detecting sleep posture. This S3CNN holistically incorporates a pair of spatial convolution neural networks to capture cardiorespiratory activity maps and a pair of temporal convolution neural networks to capture the heart rate and respiratory rate. Sleep data were collected in actual sleep conditions from 22 subjects using a sparse sensor array. The S3CNN was then trained to capture the spatial pressure distribution from the cardiorespiratory activity and temporal cardiopulmonary variability from the heart and respiratory data. Its performance was evaluated using three rounds of 10 fold cross-validation on the 8583 data samples collected from the subjects. The results yielded 91.96% recall, 92.65% precision, and 93.02% accuracy, which are comparable to the state-of-the-art methods that use significantly more sensors for marginally enhanced accuracy. Hence, the proposed S3CNN shows promise for sleep posture monitoring using sparse sensors, demonstrating potential for a more cost-effective approach.
Collapse
Affiliation(s)
- Dikun Hu
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China; (D.H.); (W.G.); (G.C.)
| | - Weidong Gao
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China; (D.H.); (W.G.); (G.C.)
| | - Kai Keng Ang
- Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), 1 Fusionopolis Way, #21-01 Connexis (South Tower), Singapore 138632, Singapore;
- College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Ave., Singapore 639798, Singapore
| | - Mengjiao Hu
- Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), 1 Fusionopolis Way, #21-01 Connexis (South Tower), Singapore 138632, Singapore;
| | - Gang Chuai
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China; (D.H.); (W.G.); (G.C.)
| | - Rong Huang
- Department of Respiratory and Critical Care Medicine, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No. 1 Shuaifuyuan Wangfujing, Beijing 100730, China;
| |
Collapse
|
2
|
Kontaxis S, Kanellos F, Ntanis A, Kostikis N, Konitsiotis S, Rigas G. An Inertial-Based Wearable System for Monitoring Vital Signs during Sleep. SENSORS (BASEL, SWITZERLAND) 2024; 24:4139. [PMID: 39000917 PMCID: PMC11244494 DOI: 10.3390/s24134139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 06/17/2024] [Accepted: 06/22/2024] [Indexed: 07/16/2024]
Abstract
This study explores the feasibility of a wearable system to monitor vital signs during sleep. The system incorporates five inertial measurement units (IMUs) located on the waist, the arms, and the legs. To evaluate the performance of a novel framework, twenty-three participants underwent a sleep study, and vital signs, including respiratory rate (RR) and heart rate (HR), were monitored via polysomnography (PSG). The dataset comprises individuals with varying severity of sleep-disordered breathing (SDB). Using a single IMU sensor positioned at the waist, strong correlations of more than 0.95 with the PSG-derived vital signs were obtained. Low inter-participant mean absolute errors of about 0.66 breaths/min and 1.32 beats/min were achieved, for RR and HR, respectively. The percentage of data available for analysis, representing the time coverage, was 98.3% for RR estimation and 78.3% for HR estimation. Nevertheless, the fusion of data from IMUs positioned at the arms and legs enhanced the inter-participant time coverage of HR estimation by over 15%. These findings imply that the proposed methodology can be used for vital sign monitoring during sleep, paving the way for a comprehensive understanding of sleep quality in individuals with SDB.
Collapse
Affiliation(s)
| | - Foivos Kanellos
- PD Neurotechnology Ltd., 45500 Ioannina, Greece
- Department of Physiology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | | | | | - Spyridon Konitsiotis
- University Hospital of Ioannina and Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | | |
Collapse
|
3
|
Sattaratpaijit N, Thanawattano C, Leelasittikul K, Pugongchai A, Saiborisut N, Yuenyongchaiwat K, Tepwimonpetkun C, Saiphoklang N. Comparison of sleep position monitoring between NaTu sensor and video-validated polysomnography in patients with obstructive sleep apnea. Sleep Breath 2024:10.1007/s11325-024-03076-3. [PMID: 38907950 DOI: 10.1007/s11325-024-03076-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Revised: 04/28/2024] [Accepted: 06/07/2024] [Indexed: 06/24/2024]
Abstract
PURPOSE This study aimed to evaluate the accuracy of a Bluetooth position monitor called NaTu sensor and its mobile phone application for detecting sleep position among patients with obstructive sleep apnea (OSA) during polysomnography (PSG). METHODS A cross-sectional study was conducted on adults with suspected of having OSA who underwent PSG. Sleep positions were recorded simultaneously using a video-validated PSG position sensor and the NaTu sensor. The area under the Receiver Operator Characteristic curve (ROC AUC), sensitivity, and specificity values were calculated to evaluate the validity of the NaTu sensor. RESULTS Ninety participants (56.7% male) were included, with median age of 40.0 years and body mass index of 29.4 kg/m2. The mean AHI was 58.4 ± 31.2 events/hour, categorizing the severity of OSA as mild (5.6%), moderate (18.9%), and severe (75.5%). Sleep positions (supine, lateral right, lateral left) identified by the NaTu sensor closely agreed with the video-validated PSG. The kappa statistic demonstrated almost perfect agreement (k = 0.95, P < 0.001) for overall position recording. The ROC AUC for identifying supine, lateral right, and lateral left positions ranged from 0.974 to 0.981, with sensitivity ranging from 95.1% to 99.1% and specificity from 96.5% to 99.6%. CONCLUSION Our wearable sensor monitoring significantly agrees with video-validated PSG in identifying sleep positions. This device is reliable and accurate for position monitoring and could be an alternative tool for monitoring positions in in-lab PSG, home sleep apnea testing, or tracking positional treatment at home. REGISTRATION Thaiclinicaltrials.org with number TCTR20210701008.
Collapse
Affiliation(s)
- Nithita Sattaratpaijit
- Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine, Thammasat University, Pathum Thani, Thailand
- Sleep Center of Thammasat (SCENT), Thammasat University Hospital, Pathum Thani, Thailand
| | - Chusak Thanawattano
- National Science and Technology Development Agency (NSTDA), Pathum Thani, Thailand
| | - Kanyada Leelasittikul
- Sleep Center of Thammasat (SCENT), Thammasat University Hospital, Pathum Thani, Thailand
- Medical Diagnostics Unit, Thammasat University Hospital, Pathum Thani, Thailand
| | - Apiwat Pugongchai
- Sleep Center of Thammasat (SCENT), Thammasat University Hospital, Pathum Thani, Thailand
- Medical Diagnostics Unit, Thammasat University Hospital, Pathum Thani, Thailand
| | - Nannaphat Saiborisut
- Sleep Center of Thammasat (SCENT), Thammasat University Hospital, Pathum Thani, Thailand
- Medical Diagnostics Unit, Thammasat University Hospital, Pathum Thani, Thailand
| | - Kornanong Yuenyongchaiwat
- Department of Physiotherapy, Faculty of Allied Health Sciences, Thammasat University, Pathum Thani, Thailand
| | - Chatkarin Tepwimonpetkun
- Sleep Center of Thammasat (SCENT), Thammasat University Hospital, Pathum Thani, Thailand
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Faculty of Medicine, Thammasat University, 99/209 Paholyotin Road, Klong Luang, Pathum Thani, 12120, Thailand
| | - Narongkorn Saiphoklang
- Sleep Center of Thammasat (SCENT), Thammasat University Hospital, Pathum Thani, Thailand.
- Medical Diagnostics Unit, Thammasat University Hospital, Pathum Thani, Thailand.
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Faculty of Medicine, Thammasat University, 99/209 Paholyotin Road, Klong Luang, Pathum Thani, 12120, Thailand.
| |
Collapse
|
4
|
Jung H, Kim D, Choi J, Joo EY. Validating a Consumer Smartwatch for Nocturnal Respiratory Rate Measurements in Sleep Monitoring. SENSORS (BASEL, SWITZERLAND) 2023; 23:7976. [PMID: 37766031 PMCID: PMC10536355 DOI: 10.3390/s23187976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 09/10/2023] [Accepted: 09/16/2023] [Indexed: 09/29/2023]
Abstract
Wrist-based respiratory rate (RR) measurement during sleep faces accuracy limitations. This study aimed to assess the accuracy of the RR estimation function during sleep based on the severity of obstructive sleep apnea (OSA) using the Samsung Galaxy Watch (GW) series. These watches are equipped with accelerometers and photoplethysmography sensors for RR estimation. A total of 195 participants visiting our sleep clinic underwent overnight polysomnography while wearing the GW, and the RR estimated by the GW was compared with the reference RR obtained from the nasal thermocouple. For all participants, the root mean squared error (RMSE) of the average overnight RR and continuous RR measurements were 1.13 bpm and 1.62 bpm, respectively, showing a small bias of 0.39 bpm and 0.37 bpm, respectively. The Bland-Altman plots indicated good agreement in the RR measurements for the normal, mild, and moderate OSA groups. In participants with normal-to-moderate OSA, both average overnight RR and continuous RR measurements achieved accuracy rates exceeding 90%. However, for patients with severe OSA, these accuracy rates decreased to 79.45% and 75.8%, respectively. The study demonstrates the GW's ability to accurately estimate RR during sleep, even though accuracy may be compromised in patients with severe OSA.
Collapse
Affiliation(s)
- Hyunjun Jung
- Samsung Electronics, Suwon 16677, Republic of Korea
| | - Dongyeop Kim
- Department of Neurology, Ewha Womans University Seoul Hospital, Ewha Womans University College of Medicine, Seoul 07804, Republic of Korea
| | - Jongmin Choi
- Samsung Electronics, Suwon 16677, Republic of Korea
| | - Eun Yeon Joo
- Departments of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea
| |
Collapse
|
5
|
Naik GR, Breen PP, Jayarathna T, Tong BK, Eckert DJ, Gargiulo GD. Morphic Sensors for Respiratory Parameters Estimation: Validation against Overnight Polysomnography. BIOSENSORS 2023; 13:703. [PMID: 37504102 PMCID: PMC10377422 DOI: 10.3390/bios13070703] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 06/19/2023] [Accepted: 06/26/2023] [Indexed: 07/29/2023]
Abstract
Effective monitoring of respiratory disturbances during sleep requires a sensor capable of accurately capturing chest movements or airflow displacement. Gold-standard monitoring of sleep and breathing through polysomnography achieves this task through dedicated chest/abdomen bands, thermistors, and nasal flow sensors, and more detailed physiology, evaluations via a nasal mask, pneumotachograph, and airway pressure sensors. However, these measurement approaches can be invasive and time-consuming to perform and analyze. This work compares the performance of a non-invasive wearable stretchable morphic sensor, which does not require direct skin contact, embedded in a t-shirt worn by 32 volunteer participants (26 males, 6 females) with sleep-disordered breathing who performed a detailed, overnight in-laboratory sleep study. Direct comparison of computed respiratory parameters from morphic sensors versus traditional polysomnography had approximately 95% (95 ± 0.7) accuracy. These findings confirm that novel wearable morphic sensors provide a viable alternative to non-invasively and simultaneously capture respiratory rate and chest and abdominal motions.
Collapse
Affiliation(s)
- Ganesh R Naik
- Adelaide Institute for Sleep Health (Flinders Health and Medical Research Institute: Sleep Health), College of Medicine and Public Health, Flinders University, Bedford Park, SA 5042, Australia
- College of Science and Engineering, Flinders University, Bedford Park, SA 5042, Australia
| | - Paul P Breen
- The MARCS Institute, Western Sydney University, Westmead, NSW 2145, Australia
| | - Titus Jayarathna
- The MARCS Institute, Western Sydney University, Westmead, NSW 2145, Australia
| | - Benjamin K Tong
- Neuroscience Research Australia, Randwick, NSW 2031, Australia
- Sleep Research Group, Charles Perkins Centre, School of Medicine, University of Sydney, Camperdown, NSW 2006, Australia
| | - Danny J Eckert
- Adelaide Institute for Sleep Health (Flinders Health and Medical Research Institute: Sleep Health), College of Medicine and Public Health, Flinders University, Bedford Park, SA 5042, Australia
- Neuroscience Research Australia, Randwick, NSW 2031, Australia
| | - Gaetano D Gargiulo
- The MARCS Institute, Western Sydney University, Westmead, NSW 2145, Australia
- School of Engineering, Design and Built Environment, Western Sydney University, Penrith, NSW 2751, Australia
| |
Collapse
|
6
|
Doheny EP, O'Callaghan BP, Fahed VS, Liegey J, Goulding C, Ryan S, Lowery MM. Estimation of respiratory rate and exhale duration using audio signals recorded by smartphone microphones. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
7
|
De Fazio R, Greco MR, De Vittorio M, Visconti P. A Differential Inertial Wearable Device for Breathing Parameter Detection: Hardware and Firmware Development, Experimental Characterization. SENSORS (BASEL, SWITZERLAND) 2022; 22:9953. [PMID: 36560322 PMCID: PMC9787627 DOI: 10.3390/s22249953] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 12/03/2022] [Accepted: 12/12/2022] [Indexed: 06/17/2023]
Abstract
Breathing monitoring is crucial for evaluating a patient's health status. The technologies commonly used to monitor respiration are costly, bulky, obtrusive, and inaccurate, mainly when the user moves. Consequently, efforts have been devoted to providing new solutions and methodologies to overcome these limitations. These methods have several uses, including healthcare monitoring, measuring athletic performance, and aiding patients with respiratory diseases, such as COPD (chronic obtrusive pulmonary disease), sleep apnea, etc. Breathing-induced chest movements can be measured noninvasively and discreetly using inertial sensors. This research work presents the development and testing of an inertia-based chest band for breathing monitoring through a differential approach. The device comprises two IMUs (inertial measurement units) placed on the patient's chest and back to determine the differential inertial signal, carrying out information detection about the breathing activity. The chest band includes a low-power microcontroller section to acquire inertial data from the two IMUs and process them to extract the breathing parameters (i.e., RR-respiration rate; TI/TE-inhalation/exhalation time; IER-inhalation-to-exhalation time; V-flow rate), using the back IMU as a reference. A BLE transceiver wirelessly transmits the acquired breathing parameters to a mobile application. Finally, the test results demonstrate the effectiveness of the used dual-inertia solution; correlation and Bland-Altman analyses were performed on the RR measurements from the chest band and the reference, demonstrating a high correlation (r¯ = 0.92) and low mean difference (MD¯ = -0.27 BrPM (breaths per minute)), limits of agreement (LoA¯ = +1.16/-1.75 BrPM), and mean absolute error (MAE¯ = 1.15%). Additionally, the experimental results demonstrated that the developed device correctly measured the other breathing parameters (TI, TE, IER, and V), keeping an MAE of ≤5%. The obtained results indicated that the developed chest band is a viable solution for long-term breathing monitoring, both in stationary and moving users.
Collapse
Affiliation(s)
- Roberto De Fazio
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
| | - Maria Rosaria Greco
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
| | - Massimo De Vittorio
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
- Center for Biomolecular Nanotechnologies, Italian Institute of Technology IIT, 73010 Arnesano, Italy
| | - Paolo Visconti
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
- Center for Biomolecular Nanotechnologies, Italian Institute of Technology IIT, 73010 Arnesano, Italy
| |
Collapse
|
8
|
Abdulsadig RS, Singh S, Patel Z, Rodriguez-Villegas E. Sleep Posture Detection Using an Accelerometer Placed on the Neck. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:2430-2433. [PMID: 36086102 DOI: 10.1109/embc48229.2022.9871300] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Sleep position monitoring is key when attempting to address posture triggered sleep disorders. Many studies have explored sleep posture detection from a dedicated physical sensing channel exploiting optimum body locations, such as the torso; or alternatively non-contact approaches. But, little work has been done to try to detect sleep position from a body location which, whilst being suboptimal for that purpose, does however allow for better extraction of more critical biomarkers from other sensing modalities, making possible multi-modal monitoring in certain clinical applications. This work presents two different approaches, at varying levels of complexity, for detecting 4 main sleep positions (supine, prone, lateral right and lateral left) from accelerometry data obtained by a single wearable device placed on the neck. An ultra light-weight threshold-based model is presented in this work, in addition to an Extra-Trees classifier. The threshold-based model was able to achieve 95% average accuracy and 0.89 F1-score on out-of-sample data, showing that it is possible to obtain a moderately high classification performance using a simple rule-based model. The ExtraTrees classifier, on the other hand, was able to achieve 99 % average accuracy and 0.99 average F1-score using only 25 base estimators with maximum depth of 20. Both models show promise in detecting sleep posture with high accuracy when collecting the signals from a neck-worn accelerometer sensor.
Collapse
|
9
|
Ranta J, Ilén E, Palmu K, Salama J, Roienko O, Vanhatalo S. An openly available wearable, a diaper cover, monitors infant's respiration and position during rest and sleep. Acta Paediatr 2021; 110:2766-2771. [PMID: 34146357 DOI: 10.1111/apa.15996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Revised: 06/17/2021] [Accepted: 06/18/2021] [Indexed: 12/01/2022]
Abstract
AIM To describe and test the accuracy of respiratory rate assessment in long-term surveillance using an open-source infant wearable, NAPping PAnts (NAPPA). METHODS We recorded 24 infants aged 1-9 months using our newly developed infant wearable that is a diaper cover with an integrated programmable electronics with accelerometer and gyroscope sensors. The sensor collects child's respiration rate (RR), activity and body posture in 30-s epochs, to be downloaded afterwards into a mobile phone application. An automated RR quality measure was also implemented using autocorrelation function, and the accuracy of RR estimate was compared with a reference obtained from the simultaneously recorded capnography signal that was part of polysomnography recordings. RESULTS Altogether 88 h 27 min of data were recorded, and 4147 epochs (39% of all data) were accepted after quality detection. The median of patient wise mean absolute errors in RR estimates was 1.5 breaths per minute (interquartile range 1.1-2.6 bpm), and the Blandt-Altman analysis indicated an RR bias of 0.0 bpm with the 95% limits of agreement of -5.7-5.7 bpm. CONCLUSION Long-term monitoring of RR and posture can be done with reasonable accuracy in out-of-hospital settings using NAPPA, an openly available infant wearable.
Collapse
Affiliation(s)
- Jukka Ranta
- BABA Center Children's Hospital Helsinki University Hospital and University of Helsinki Helsinki Finland
| | - Elina Ilén
- Department of Design Aalto University Espoo Finland
| | - Kirsi Palmu
- BABA Center Children's Hospital Helsinki University Hospital and University of Helsinki Helsinki Finland
- Department of Clinical Neurophysiology HUS Medical Imaging Center University of HelsinkiHelsinki University Hospital and University of Helsinki Helsinki Finland
| | - Jonna Salama
- BABA Center Children's Hospital Helsinki University Hospital and University of Helsinki Helsinki Finland
- Department of Clinical Neurophysiology HUS Medical Imaging Center University of HelsinkiHelsinki University Hospital and University of Helsinki Helsinki Finland
| | - Oleksii Roienko
- BABA Center Children's Hospital Helsinki University Hospital and University of Helsinki Helsinki Finland
| | - Sampsa Vanhatalo
- BABA Center Children's Hospital Helsinki University Hospital and University of Helsinki Helsinki Finland
- Department of Clinical Neurophysiology HUS Medical Imaging Center University of HelsinkiHelsinki University Hospital and University of Helsinki Helsinki Finland
- Neuroscience Center University of Helsinki Helsinki Finland
| |
Collapse
|