1
|
Kazemi K, Abiri A, Zhou Y, Rahmani A, Khayat RN, Liljeberg P, Khine M. Improved sleep stage predictions by deep learning of photoplethysmogram and respiration patterns. Comput Biol Med 2024; 179:108679. [PMID: 39033682 DOI: 10.1016/j.compbiomed.2024.108679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Revised: 05/28/2024] [Accepted: 05/29/2024] [Indexed: 07/23/2024]
Abstract
Sleep staging is a crucial tool for diagnosing and monitoring sleep disorders, but the standard clinical approach using polysomnography (PSG) in a sleep lab is time-consuming, expensive, uncomfortable, and limited to a single night. Advancements in sensor technology have enabled home sleep monitoring, but existing devices still lack sufficient accuracy to inform clinical decisions. To address this challenge, we propose a deep learning architecture that combines a convolutional neural network and bidirectional long short-term memory to accurately classify sleep stages. By supplementing photoplethysmography (PPG) signals with respiratory sensor inputs, we demonstrated significant improvements in prediction accuracy and Cohen's kappa (k) for 2- (92.7 %; k = 0.768), 3- (80.2 %; k = 0.714), 4- (76.8 %, k = 0.550), and 5-stage (76.7 %, k = 0.616) sleep classification using raw data. This relatively translatable approach, with a less intensive AI model and leveraging only a few, inexpensive sensors, shows promise in accurately staging sleep. This has potential for diagnosing and managing sleep disorders in a more accessible and practical manner, possibly even at home.
Collapse
Affiliation(s)
| | - Arash Abiri
- Department of Biomedical Engineering, University of California Irvine, Irvine, CA, United States
| | - Yongxiao Zhou
- Department of Biomedical Engineering, University of California Irvine, Irvine, CA, United States
| | - Amir Rahmani
- Department of Computer Science, University of California, Irvine, Irvine, CA, United States; School of Nursing, University of California, Irvine, Irvine, CA, United States
| | - Rami N Khayat
- Division of Pulmonary and Critical Care Medicine, The UCI Comprehensive Sleep Center, University of California. Irvine, Newport Beach, CA, United States
| | | | - Michelle Khine
- Department of Biomedical Engineering, University of California Irvine, Irvine, CA, United States.
| |
Collapse
|
2
|
Li Z, Jia Y, Li Y, Han D. Automatic prediction of obstructive sleep apnea event using deep learning algorithm based on ECG and thoracic movement signals. Acta Otolaryngol 2024; 144:52-57. [PMID: 38240117 DOI: 10.1080/00016489.2024.2301732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 12/23/2023] [Indexed: 03/16/2024]
Abstract
BACKGROUND Obstructive sleep apnea (OSA) is a sleeping disorder that can cause multiple complications. AIMS/OBJECTIVE Our aim is to build an automatic deep learning model for OSA event detection using combined signals from the electrocardiogram (ECG) and thoracic movement signals. MATERIALS AND METHODS We retrospectively obtained 420 cases of PSG data and extracted the signals of ECG, as well as the thoracic movement signal. A deep learning algorithm named ResNeSt34 was used to construct the model using ECG with or without thoracic movement signal. The model performance was assessed by parameters such as accuracy, precision, recall, F1-score, receiver operating characteristic (ROC), and area under the ROC curve (AUC). RESULTS The model using combined signals of ECG and thoracic movement signal performed much better than the model using ECG alone. The former had accuracy, precision, recall, F1-score, and AUC values of 89.0%, 88.8%, 89.0%, 88.2%, and 92.9%, respectively, while the latter had values of 84.1%, 83.1%, 84.1%, 83.3%, and 82.8%, respectively. CONCLUSIONS AND SIGNIFICANCE The automatic OSA event detection model using combined signals of ECG and thoracic movement signal with the ResNeSt34 algorithm is reliable and can be used for OSA screening.
Collapse
Affiliation(s)
- Zufei Li
- Department of Otolaryngology Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing, People's Republic of China
- Key Laboratory of Otolaryngology Head and Neck Surgery, Ministry of Education, Capital Medical University, Beijing, People's Republic of China
| | - Yajie Jia
- Department of Otolaryngology Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing, People's Republic of China
- Key Laboratory of Otolaryngology Head and Neck Surgery, Ministry of Education, Capital Medical University, Beijing, People's Republic of China
| | - Yanru Li
- Department of Otolaryngology Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing, People's Republic of China
- Key Laboratory of Otolaryngology Head and Neck Surgery, Ministry of Education, Capital Medical University, Beijing, People's Republic of China
| | - Demin Han
- Department of Otolaryngology Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing, People's Republic of China
- Key Laboratory of Otolaryngology Head and Neck Surgery, Ministry of Education, Capital Medical University, Beijing, People's Republic of China
| |
Collapse
|
3
|
Rossi M, Sala D, Bovio D, Salito C, Alessandrelli G, Lombardi C, Mainardi L, Cerveri P. SLEEP-SEE-THROUGH: Explainable Deep Learning for Sleep Event Detection and Quantification From Wearable Somnography. IEEE J Biomed Health Inform 2023; 27:3129-3140. [PMID: 37058373 DOI: 10.1109/jbhi.2023.3267087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/15/2023]
Abstract
Evidence is rapidly accumulating that multifactorial nocturnal monitoring, through the coupling of wearable devices and deep learning, may be disruptive for early diagnosis and assessment of sleep disorders. In this work, optical, differential air-pressure and acceleration signals, acquired by a chest-worn sensor, are elaborated into five somnographic-like signals, which are then used to feed a deep network. This addresses a three-fold classification problem to predict the overall signal quality (normal, corrupted), three breathing-related patterns (normal, apnea, irregular) and three sleep-related patterns (normal, snoring, noise). In order to promote explainability, the developed architecture generates additional information in the form of qualitative (saliency maps) and quantitative (confidence indices) data, which helps to improve the interpretation of the predictions. Twenty healthy subjects enrolled in this study were monitored overnight for approximately ten hours during sleep. Somnographic-like signals were manually labeled according to the three class sets to build the training dataset. Both record- and subject-wise analyses were performed to evaluate the prediction performance and the coherence of the results. The network was accurate (0.96) in distinguishing normal from corrupted signals. Breathing patterns were predicted with higher accuracy (0.93) than sleep patterns (0.76). The prediction of irregular breathing was less accurate (0.88) than that of apnea (0.97). In the sleep pattern set, the distinction between snoring (0.73) and noise events (0.61) was less effective. The confidence index associated with the prediction allowed us to elucidate ambiguous predictions better. The saliency map analysis provided useful insights to relate predictions to the input signal content. While preliminary, this work supported the recent perspective on the use of deep learning to detect particular sleep events in multiple somnographic signals, thus representing a step towards bringing the use of AI-based tools for sleep disorder detection incrementally closer to clinical translation.
Collapse
|
4
|
Alramadeen W, Ding Y, Costa C, Si B. A Novel Sparse Linear Mixed Model for Multi-Source Mixed-Frequency Data Fusion in Telemedicine. IISE TRANSACTIONS ON HEALTHCARE SYSTEMS ENGINEERING 2023; 13:215-225. [PMID: 37635864 PMCID: PMC10454975 DOI: 10.1080/24725579.2023.2202877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/29/2023]
Abstract
Digital health and telemonitoring have resulted in a wealth of information to be collected to monitor, manage, and improve human health. The multi-source mixed-frequency health data overwhelm the modeling capacity of existing statistical and machine learning models, due to many challenging properties. Although predictive analytics for big health data plays an important role in telemonitoring, there is a lack of rigorous prediction model that can automatically predicts patients' health conditions, e.g., Disease Severity Indicators (DSIs), from multi-source mixed-frequency data. Sleep disorder is a prevalent cardiac syndrome that is characterized by abnormal respiratory patterns during sleep. Although wearable devices are available to administrate sleep studies at home, the manual scoring process to generate the DSI remains a bottleneck in automated monitoring and diagnosis of sleep disorder. To address the multi-fold challenges for precise prediction of the DSI from high-dimensional multi-source mixed-frequency data in sleep disorder, we propose a sparse linear mixed model that combines the modified Cholesky decomposition with group lasso penalties to enable joint group selection of fixed effects and random effects. A novel Expectation Maximization (EM) algorithm integrated with an efficient Majorization Maximization (MM) algorithm is developed for model estimation of the proposed sparse linear mixed model with group variable selection. The proposed method was applied to the SHHS data for telemonitoring and diagnosis of sleep disorder and found that a few significant feature groups that are consistent with prior medical studies on sleep disorder. The proposed method also outperformed a few benchmark methods with the highest prediction accuracy.
Collapse
Affiliation(s)
- Wesam Alramadeen
- Department of Systems Science and Industrial Engineering, State University of New York at Binghamton, Binghamton, NY, USA 13902, USA
| | - Yu Ding
- Department of Systems Science and Industrial Engineering, State University of New York at Binghamton, Binghamton, NY, USA 13902, USA
| | - Carlos Costa
- IBM T. J. Watson Research Center, Yorktown Heights, NY 10510, USA
| | - Bing Si
- Department of Systems Science and Industrial Engineering, State University of New York at Binghamton, Binghamton, NY, USA 13902, USA
| |
Collapse
|
5
|
Xu S, Faust O, Seoni S, Chakraborty S, Barua PD, Loh HW, Elphick H, Molinari F, Acharya UR. A review of automated sleep disorder detection. Comput Biol Med 2022; 150:106100. [PMID: 36182761 DOI: 10.1016/j.compbiomed.2022.106100] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 09/04/2022] [Accepted: 09/12/2022] [Indexed: 12/22/2022]
Abstract
Automated sleep disorder detection is challenging because physiological symptoms can vary widely. These variations make it difficult to create effective sleep disorder detection models which support hu-man experts during diagnosis and treatment monitoring. From 2010 to 2021, authors of 95 scientific papers have taken up the challenge of automating sleep disorder detection. This paper provides an expert review of this work. We investigated whether digital technology and Artificial Intelligence (AI) can provide automated diagnosis support for sleep disorders. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines during the content discovery phase. We compared the performance of proposed sleep disorder detection methods, involving differ-ent datasets or signals. During the review, we found eight sleep disorders, of which sleep apnea and insomnia were the most studied. These disorders can be diagnosed using several kinds of biomedical signals, such as Electrocardiogram (ECG), Polysomnography (PSG), Electroencephalogram (EEG), Electromyogram (EMG), and snore sound. Subsequently, we established areas of commonality and distinctiveness. Common to all reviewed papers was that AI models were trained and tested with labelled physiological signals. Looking deeper, we discovered that 24 distinct algorithms were used for the detection task. The nature of these algorithms evolved, before 2017 only traditional Machine Learning (ML) was used. From 2018 onward, both ML and Deep Learning (DL) methods were used for sleep disorder detection. The strong emergence of DL algorithms has considerable implications for future detection systems because these algorithms demand significantly more data for training and testing when compared with ML. Based on our review results, we suggest that both type and amount of labelled data is crucial for the design of future sleep disorder detection systems because this will steer the choice of AI algorithm which establishes the desired decision support. As a guiding principle, more labelled data will help to represent the variations in symptoms. DL algorithms can extract information from these larger data quantities more effectively, therefore; we predict that the role of these algorithms will continue to expand.
Collapse
Affiliation(s)
- Shuting Xu
- Cogninet Brain Team, Sydney, NSW, 2010, Australia
| | - Oliver Faust
- Anglia Ruskin University, East Rd, Cambridge CB1 1PT, UK.
| | - Silvia Seoni
- Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW, 2351, Australia; Centre for Advanced Modelling and Geospatial Lnformation Systems (CAMGIS), Faculty of Engineer and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Sydney, NSW, 2010, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia; School of Business (Information System), University of Southern Queensland, Australia
| | - Hui Wen Loh
- School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, 599494, Singapore
| | | | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - U Rajendra Acharya
- School of Business (Information System), University of Southern Queensland, Australia; School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, 599494, Singapore; Department of Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taichung, Taiwan.
| |
Collapse
|
6
|
Abstract
Sleep Apnoea (SA) is a common chronic illness that affects nearly 1 billion people around the world, and the number of patients is rising. SA causes a wide range of psychological and physiological ailments that have detrimental effects on a patient’s wellbeing. The high prevalence and negative health effects make SA a public health problem. Whilst the current gold standard diagnostic procedure, polysomnography (PSG), is reliable, it is resource-expensive and can have a negative impact on sleep quality, as well as the environment. With this study, we focus on the environmental impact that arises from resource utilisation during SA detection, and we propose remote monitoring (RM) as a potential solution that can improve the resource efficiency and reduce travel. By reusing infrastructure technology, such as mobile communication, cloud computing, and artificial intelligence (AI), RM establishes SA detection and diagnosis support services in the home environment. However, there are considerable barriers to a widespread adoption of this technology. To gain a better understanding of the available technology and its associated strength, as well as weaknesses, we reviewed scientific papers that used various strategies for RM-based SA detection. Our review focused on 113 studies that were conducted between 2018 and 2022 and that were listed in Google Scholar. We found that just over 50% of the proposed RM systems incorporated real time signal processing and around 20% of the studies did not report on this important aspect. From an environmental perspective, this is a significant shortcoming, because 30% of the studies were based on measurement devices that must travel whenever the internal buffer is full. The environmental impact of that travel might constitute an additional need for changing from offline to online SA detection in the home environment.
Collapse
|
7
|
Rossi M, Alessandrelli G, Dombrovschi A, Bovio D, Salito C, Mainardi L, Cerveri P. Identification of Characteristic Points in Multivariate Physiological Signals by Sensor Fusion and Multi-Task Deep Networks. SENSORS 2022; 22:s22072684. [PMID: 35408297 PMCID: PMC9003131 DOI: 10.3390/s22072684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 03/28/2022] [Accepted: 03/28/2022] [Indexed: 11/28/2022]
Abstract
Identification of characteristic points in physiological signals, such as the peak of the R wave in the electrocardiogram and the peak of the systolic wave of the photopletismogram, is a fundamental step for the quantification of clinical parameters, such as the pulse transit time. In this work, we presented a novel neural architecture, called eMTUnet, to automate point identification in multivariate signals acquired with a chest-worn device. The eMTUnet consists of a single deep network capable of performing three tasks simultaneously: (i) localization in time of characteristic points (labeling task), (ii) evaluation of the quality of signals (classification task); (iii) estimation of the reliability of classification (reliability task). Preliminary results in overnight monitoring showcased the ability to detect characteristic points in the four signals with a recall index of about 1.00, 0.90, 0.90, and 0.80, respectively. The accuracy of the signal quality classification was about 0.90, on average over four different classes. The average confidence of the correctly classified signals, against the misclassifications, was 0.93 vs. 0.52, proving the worthiness of the confidence index, which may better qualify the point identification. From the achieved outcomes, we point out that high-quality segmentation and classification are both ensured, which brings the use of a multi-modal framework, composed of wearable sensors and artificial intelligence, incrementally closer to clinical translation.
Collapse
Affiliation(s)
- Matteo Rossi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (G.A.); (A.D.); (L.M.)
- Correspondence: (M.R.); (P.C.)
| | - Giulia Alessandrelli
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (G.A.); (A.D.); (L.M.)
| | - Andra Dombrovschi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (G.A.); (A.D.); (L.M.)
| | - Dario Bovio
- Biocubica SRL, 20154 Milan, Italy; (D.B.); (C.S.)
| | | | - Luca Mainardi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (G.A.); (A.D.); (L.M.)
| | - Pietro Cerveri
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (G.A.); (A.D.); (L.M.)
- Correspondence: (M.R.); (P.C.)
| |
Collapse
|
8
|
Huysmans D, Castro I, Borzée P, Patel A, Torfs T, Buyse B, Testelmans D, Van Huffel S, Varon C. Capacitively-Coupled ECG and Respiration for Sleep-Wake Prediction and Risk Detection in Sleep Apnea Patients. SENSORS (BASEL, SWITZERLAND) 2021; 21:6409. [PMID: 34640728 PMCID: PMC8512805 DOI: 10.3390/s21196409] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 09/14/2021] [Accepted: 09/18/2021] [Indexed: 12/02/2022]
Abstract
Obstructive sleep apnea (OSA) patients would strongly benefit from comfortable home diagnosis, during which detection of wakefulness is essential. Therefore, capacitively-coupled electrocardiogram (ccECG) and bioimpedance (ccBioZ) sensors were used to record the sleep of suspected OSA patients, in parallel with polysomnography (PSG). The three objectives were quality assessment of the unobtrusive signals during sleep, prediction of sleep-wake using ccECG and ccBioZ, and detection of high-risk OSA patients. First, signal quality indicators (SQIs) determined the data coverage of ccECG and ccBioZ. Then, a multimodal convolutional neural network (CNN) for sleep-wake prediction was tested on these preprocessed ccECG and ccBioZ data. Finally, two indices derived from this prediction detected patients at risk. The data included 187 PSG recordings of suspected OSA patients, 36 (dataset "Test") of which were recorded simultaneously with PSG, ccECG, and ccBioZ. As a result, two improvements were made compared to prior studies. First, the ccBioZ signal coverage increased significantly due to adaptation of the acquisition system. Secondly, the utility of the sleep-wake classifier increased as it became a unimodal network only requiring respiratory input. This was achieved by using data augmentation during training. Sleep-wake prediction on "Test" using PSG respiration resulted in a Cohen's kappa (κ) of 0.39 and using ccBioZ in κ = 0.23. The OSA risk model identified severe OSA patients with a κ of 0.61 for PSG respiration and κ of 0.39 using ccBioZ (accuracy of 80.6% and 69.4%, respectively). This study is one of the first to perform sleep-wake staging on capacitively-coupled respiratory signals in suspected OSA patients and to detect high risk OSA patients based on ccBioZ. The technology and the proposed framework could be applied in multi-night follow-up of OSA patients.
Collapse
Affiliation(s)
- Dorien Huysmans
- STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, Department of Electrical Engineering (ESAT), KU Leuven, 3001 Leuven, Belgium; (S.V.H.); (C.V.)
| | - Ivan Castro
- Circuits and Systems for Health, Imec-Leuven, 3001 Leuven, Belgium; (I.C.); (A.P.); (T.T.)
| | - Pascal Borzée
- Department of Pneumology, UZ Leuven, 3000 Leuven, Belgium; (P.B.); (B.B.); (D.T.)
| | - Aakash Patel
- Circuits and Systems for Health, Imec-Leuven, 3001 Leuven, Belgium; (I.C.); (A.P.); (T.T.)
| | - Tom Torfs
- Circuits and Systems for Health, Imec-Leuven, 3001 Leuven, Belgium; (I.C.); (A.P.); (T.T.)
| | - Bertien Buyse
- Department of Pneumology, UZ Leuven, 3000 Leuven, Belgium; (P.B.); (B.B.); (D.T.)
| | - Dries Testelmans
- Department of Pneumology, UZ Leuven, 3000 Leuven, Belgium; (P.B.); (B.B.); (D.T.)
| | - Sabine Van Huffel
- STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, Department of Electrical Engineering (ESAT), KU Leuven, 3001 Leuven, Belgium; (S.V.H.); (C.V.)
| | - Carolina Varon
- STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, Department of Electrical Engineering (ESAT), KU Leuven, 3001 Leuven, Belgium; (S.V.H.); (C.V.)
- Service de Chimie-Physique E.P., Université Libre de Bruxelles, 1050 Brussels, Belgium
| |
Collapse
|