1
|
Jirakittayakorn N, Wongsawat Y, Mitrirattanakul S. ZleepAnlystNet: a novel deep learning model for automatic sleep stage scoring based on single-channel raw EEG data using separating training. Sci Rep 2024; 14:9859. [PMID: 38684765 PMCID: PMC11058251 DOI: 10.1038/s41598-024-60796-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 04/26/2024] [Indexed: 05/02/2024] Open
Abstract
Numerous models for sleep stage scoring utilizing single-channel raw EEG signal have typically employed CNN and BiLSTM architectures. While these models, incorporating temporal information for sequence classification, demonstrate superior overall performance, they often exhibit low per-class performance for N1-stage, necessitating an adjustment of loss function. However, the efficacy of such adjustment is constrained by the training process. In this study, a pioneering training approach called separating training is introduced, alongside a novel model, to enhance performance. The developed model comprises 15 CNN models with varying loss function weights for feature extraction and 1 BiLSTM for sequence classification. Due to its architecture, this model cannot be trained using an end-to-end approach, necessitating separate training for each component using the Sleep-EDF dataset. Achieving an overall accuracy of 87.02%, MF1 of 82.09%, Kappa of 0.8221, and per-class F1-socres (W 90.34%, N1 54.23%, N2 89.53%, N3 88.96%, and REM 87.40%), our model demonstrates promising performance. Comparison with sleep technicians reveals a Kappa of 0.7015, indicating alignment with reference sleep stags. Additionally, cross-dataset validation and adaptation through training with the SHHS dataset yield an overall accuracy of 84.40%, MF1 of 74.96% and Kappa of 0.7785 when tested with the Sleep-EDF-13 dataset. These findings underscore the generalization potential in model architecture design facilitated by our novel training approach.
Collapse
Affiliation(s)
- Nantawachara Jirakittayakorn
- Institute for Innovative Learning, Mahidol University, Nakhon Pathom, Thailand
- Faculty of Dentistry, Mahidol University, Bangkok, Thailand
| | - Yodchanan Wongsawat
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Nakhon Pathom, Thailand
| | - Somsak Mitrirattanakul
- Department of Masticatory Science, Faculty of Dentistry, Mahidol University, Bangkok, Thailand.
| |
Collapse
|
2
|
Ontimare Manlises C, Chen JW, Huang CC. A gated recurrent unit model based on ultrasound images of dynamic tongue movement for determining the severity of obstructive sleep apnea. ULTRASONICS 2024; 141:107320. [PMID: 38678641 DOI: 10.1016/j.ultras.2024.107320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 04/14/2024] [Accepted: 04/17/2024] [Indexed: 05/01/2024]
Abstract
Obstructive sleep apnea (OSA) presents as a respiratory disorder characterized by recurrent upper pharyngeal airway collapse during sleep. Dynamic tongue movement (DTM) analysis emerges as a promising avenue for elucidating the pathophysiological underpinnings of OSA, thereby facilitating its diagnosis. Recent endeavors have utilized artificial intelligence techniques to categorize OSA severity leveraging electrocardiography and blood oxygen saturation data. Nonetheless, the integration of ultrasound (US) imaging of the tongue remains largely untapped in the development of machine learning models aimed at determining the severity of OSA. This study endeavors to bridge this gap by capturing US images of DTM dynamics during wakefulness, encompassing transitions from normal breathing (NB) to the performance of the Müller maneuver (MM) in a cohort of 53 patients. Leveraging the modified optical flow method (MOFM), the trajectories of patients' DTM were tracked, facililtating the extraction of 27 parameters vital for model training. These parameters encompassed nine-point lateral movement, nine-point axial movement, and nine-point total displacement of the tongue, resulting in a dataset of 186,030 samples. The gated recurrent unit (GRU) method, renowned for its efficacy in motion tracking, was employed for model development in this study. Validation of the developed model was conducted via stratified k-fold cross-validation (SCV). The systems' overall performance in classifying OSA severity, as quantified by mean accuracy (MA), yielded a value of 43.49%. This pilot investigation marks an exploratory endeavor into the utilization of artificial intelligence for the classification of OSA severity based on US images and dynamic movement patterns. This novel model holds potential to assist clinicians in categorizing OSA severity and guiding the selection of pertinent treatment modalities tailored to the individual needs of patients afflicted with OSA.
Collapse
Affiliation(s)
- Cyrel Ontimare Manlises
- Department of Biomedical Engineering, National Cheng Kung University, Tainan, Taiwan; School of Electrical, Electronics, and Computer Engineering, Mapua University, Manila 1002 Philippines
| | - Jeng-Wen Chen
- Department of Otolaryngology-Head and Neck Surgery, Cardinal Tien Hospital and Schhool of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan; Department of Otolaryngology-Head and Neck Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Chih-Chung Huang
- Department of Biomedical Engineering, National Cheng Kung University, Tainan, Taiwan.
| |
Collapse
|
3
|
Yue H, Chen Z, Guo W, Sun L, Dai Y, Wang Y, Ma W, Fan X, Wen W, Lei W. Research and application of deep learning-based sleep staging: Data, modeling, validation, and clinical practice. Sleep Med Rev 2024; 74:101897. [PMID: 38306788 DOI: 10.1016/j.smrv.2024.101897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 12/30/2023] [Accepted: 01/04/2024] [Indexed: 02/04/2024]
Abstract
Over the past few decades, researchers have attempted to simplify and accelerate the process of sleep stage classification through various approaches; however, only a few such approaches have gained widespread acceptance. Artificial intelligence technology, particularly deep learning, is promising for earning the trust of the sleep medicine community in automated sleep-staging systems, thus facilitating its application in clinical practice and integration into daily life. We aimed to comprehensively review the latest methods that are applying deep learning for enhancing sleep staging efficiency and accuracy. Starting from the requisite "data" for constructing deep learning algorithms, we elucidated the current landscape of this domain and summarized the fundamental modeling process, encompassing signal selection, data pre-processing, model architecture, classification tasks, and performance metrics. Furthermore, we reviewed the applications of automated sleep staging in scenarios such as sleep-disorder screening, diagnostic procedures, and health monitoring and management. Finally, we conducted an in-depth analysis and discussion of the challenges and future in intelligent sleep staging, particularly focusing on large-scale sleep datasets, interdisciplinary collaborations, and human-computer interactions.
Collapse
Affiliation(s)
- Huijun Yue
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Zhuqi Chen
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Wenbin Guo
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Lin Sun
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Yidan Dai
- School of Computer Science, South China Normal University, Guangzhou, People's Republic of China
| | - Yiming Wang
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Wenjun Ma
- School of Computer Science, South China Normal University, Guangzhou, People's Republic of China
| | - Xiaomao Fan
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, People's Republic of China
| | - Weiping Wen
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China; Department of Otolaryngology, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China.
| | - Wenbin Lei
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China.
| |
Collapse
|
4
|
Alattar M, Govind A, Mainali S. Artificial Intelligence Models for the Automation of Standard Diagnostics in Sleep Medicine-A Systematic Review. Bioengineering (Basel) 2024; 11:206. [PMID: 38534480 DOI: 10.3390/bioengineering11030206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/31/2024] [Accepted: 02/09/2024] [Indexed: 03/28/2024] Open
Abstract
Sleep disorders, prevalent in the general population, present significant health challenges. The current diagnostic approach, based on a manual analysis of overnight polysomnograms (PSGs), is costly and time-consuming. Artificial intelligence has emerged as a promising tool in this context, offering a more accessible and personalized approach to diagnosis, particularly beneficial for under-served populations. This is a systematic review of AI-based models for sleep disorder diagnostics that were trained, validated, and tested on diverse clinical datasets. An extensive search of PubMed and IEEE databases yielded 2114 articles, but only 18 met our stringent selection criteria, underscoring the scarcity of thoroughly validated AI models in sleep medicine. The findings emphasize the necessity of a rigorous validation of AI models on multimodal clinical data, a step crucial for their integration into clinical practice. This would be in line with the American Academy of Sleep Medicine's support of AI research.
Collapse
Affiliation(s)
- Maha Alattar
- Division of Adult Neurology, Sleep Medicine, Vascular Neurology, Department of Neurology, Virginia Commonwealth University, Richmond, VA 23284, USA
| | - Alok Govind
- Department of Neurology, National Institute of Mental Health and Neurosciences, Bangalore 560029, India
| | - Shraddha Mainali
- Division of Vascular Neurology and Neurocritical Care, Department of Neurology, Virginia Commonwealth University, Richmond, VA 23284, USA
| |
Collapse
|
5
|
Wei Y, Zhu Y, Zhou Y, Yu X, Luo Y. Automatic Sleep Staging Based on Contextual Scalograms and Attention Convolution Neural Network Using Single-Channel EEG. IEEE J Biomed Health Inform 2024; 28:801-811. [PMID: 37955995 DOI: 10.1109/jbhi.2023.3332503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Single-channel EEG based sleep staging is of interest to researchers due to its broad application prospect in daily sleep monitoring recently. We proposed using contextual scalograms as input and developed a convolutional neural network with attention modules named Co-ScaleNet for sleep staging. The contextual scalograms were obtained by combining the same color channels of three original RGB scalograms from consecutive epochs, and a simple and efficient data augmentation was designed according to their various forms. The Co-ScaleNet consists of two main parts. Firstly, three parallel convolutional branches with attention modules correspondingly extract and fuse features from contextual scalograms at the top layers. The remaining part is a stack of lightweight blocks. We achieved an overall accuracy of 87.0% for healthy individuals, 84.7% for depressed patients. And we obtained comparable performance on the public Sleep-EDFx (82.8%), ISRUC (84.6%) and SHHS datasets (87.7%), including a high recall of N1. The contextual scalograms of R channel as input achieved the best performance, which conform to the features of interest in visual scoring. The attention modules improved the recall of N1 and N3. Overall, the contextual scalograms provided a novel scheme for both contextual information extraction and data augmentation. Our study successfully expanded its application to depression datasets, as well as patients with sleep apnea, demonstrating its wide applicability.
Collapse
|
6
|
Van Der Aar JF, Van Den Ende DA, Fonseca P, Van Meulen FB, Overeem S, Van Gilst MM, Peri E. Deep transfer learning for automated single-lead EEG sleep staging with channel and population mismatches. Front Physiol 2024; 14:1287342. [PMID: 38250654 PMCID: PMC10796543 DOI: 10.3389/fphys.2023.1287342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Accepted: 12/08/2023] [Indexed: 01/23/2024] Open
Abstract
Introduction: Automated sleep staging using deep learning models typically requires training on hundreds of sleep recordings, and pre-training on public databases is therefore common practice. However, suboptimal sleep stage performance may occur from mismatches between source and target datasets, such as differences in population characteristics (e.g., an unrepresented sleep disorder) or sensors (e.g., alternative channel locations for wearable EEG). Methods: We investigated three strategies for training an automated single-channel EEG sleep stager: pre-training (i.e., training on the original source dataset), training-from-scratch (i.e., training on the new target dataset), and fine-tuning (i.e., training on the original source dataset, fine-tuning on the new target dataset). As source dataset, we used the F3-M2 channel of healthy subjects (N = 94). Performance of the different training strategies was evaluated using Cohen's Kappa (κ) in eight smaller target datasets consisting of healthy subjects (N = 60), patients with obstructive sleep apnea (OSA, N = 60), insomnia (N = 60), and REM sleep behavioral disorder (RBD, N = 22), combined with two EEG channels, F3-M2 and F3-F4. Results: No differences in performance between the training strategies was observed in the age-matched F3-M2 datasets, with an average performance across strategies of κ = .83 in healthy, κ = .77 in insomnia, and κ = .74 in OSA subjects. However, in the RBD set, where data availability was limited, fine-tuning was the preferred method (κ = .67), with an average increase in κ of .15 to pre-training and training-from-scratch. In the presence of channel mismatches, targeted training is required, either through training-from-scratch or fine-tuning, increasing performance with κ = .17 on average. Discussion: We found that, when channel and/or population mismatches cause suboptimal sleep staging performance, a fine-tuning approach can yield similar to superior performance compared to building a model from scratch, while requiring a smaller sample size. In contrast to insomnia and OSA, RBD data contains characteristics, either inherent to the pathology or age-related, which apparently demand targeted training.
Collapse
Affiliation(s)
- Jaap F. Van Der Aar
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands
- Philips Research, Eindhoven, Netherlands
| | | | - Pedro Fonseca
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands
- Philips Research, Eindhoven, Netherlands
| | - Fokke B. Van Meulen
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands
- Kempenhaeghe Center for Sleep Medicine, Heeze, Netherlands
| | - Sebastiaan Overeem
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands
- Kempenhaeghe Center for Sleep Medicine, Heeze, Netherlands
| | - Merel M. Van Gilst
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands
- Kempenhaeghe Center for Sleep Medicine, Heeze, Netherlands
| | - Elisabetta Peri
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands
| |
Collapse
|
7
|
Jeong J, Yoon W, Lee JG, Kim D, Woo Y, Kim DK, Shin HW. Standardized image-based polysomnography database and deep learning algorithm for sleep-stage classification. Sleep 2023; 46:zsad242. [PMID: 37703391 DOI: 10.1093/sleep/zsad242] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 08/11/2023] [Indexed: 09/15/2023] Open
Abstract
STUDY OBJECTIVES Polysomnography (PSG) scoring is labor-intensive, subjective, and often ambiguous. Recently several deep learning (DL) models for automated sleep scoring have been developed, they are tied to a fixed amount of input channels and resolution. In this study, we constructed a standardized image-based PSG dataset in order to overcome the heterogeneity of raw signal data obtained from various PSG devices and various sleep laboratory environments. METHODS All individually exported European data format files containing raw signals were converted into images with an annotation file, which contained the demographics, diagnoses, and sleep statistics. An image-based DL model for automatic sleep staging was developed, compared with a signal-based model, and validated in an external dataset. RESULTS We constructed 10253 image-based PSG datasets using a standardized format. Among these, 7745 diagnostic PSG data were used to develop our DL model. The DL model using the image dataset showed similar performance to the signal-based dataset for the same subject. The overall DL accuracy was greater than 80%, even with severe obstructive sleep apnea. Moreover, for the first time, we showed explainable DL in the field of sleep medicine as visualized key inference regions using Eigen-class activation maps. Furthermore, when a DL model for sleep scoring performs external validation, we achieved a relatively good performance. CONCLUSIONS Our main contribution demonstrates the availability of a standardized image-based dataset, and highlights that changing the data sampling rate or number of sensors may not require retraining, although performance decreases slightly as the number of sensors decreases.
Collapse
Affiliation(s)
- Jaemin Jeong
- Department of Computer Engineering, School of Software, Hallym University, Chuncheon, Republic of Korea
| | | | - Jeong-Gun Lee
- Department of Computer Engineering, School of Software, Hallym University, Chuncheon, Republic of Korea
| | - Dongyoung Kim
- Department of Computer Engineering, School of Software, Hallym University, Chuncheon, Republic of Korea
| | - Yunhee Woo
- Institute of New Frontier Research, Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon, Republic of Korea
| | - Dong-Kyu Kim
- OUaR LaB, Inc, Seoul, Republic of Korea
- Institute of New Frontier Research, Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon, Republic of Korea
- Department of Otorhinolaryngology-Head and Neck Surgery, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon, Republic of Korea¸
| | - Hyun-Woo Shin
- OUaR LaB, Inc, Seoul, Republic of Korea
- Obstructive Upper Airway Research (OUaR) Laboratory, Department of Pharmacology, Seoul National University College of Medicine, Seoul, Republic of Korea
- Department of Biomedical Sciences, Seoul National University Graduate School, Seoul, Republic of Korea
- Cancer Research Institute, Seoul National University College of Medicine, Seoul, Republic of Korea
- Sensory Organ Research Institute, Seoul National University College of Medicine, Seoul, Republic of Korea
- Department of Otorhinolaryngology-Head and Neck Surgery, Seoul National University Hospital, Seoul, Republic of Korea
| |
Collapse
|
8
|
Lee J, Kim HC, Lee YJ, Lee S. Development of generalizable automatic sleep staging using heart rate and movement based on large databases. Biomed Eng Lett 2023; 13:649-658. [PMID: 37872992 PMCID: PMC10590335 DOI: 10.1007/s13534-023-00288-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 05/12/2023] [Accepted: 05/14/2023] [Indexed: 10/25/2023] Open
Abstract
Purpose With the advancement of deep neural networks in biosignals processing, the performance of automatic sleep staging algorithms has improved significantly. However, sleep staging using only non-electroencephalogram features has not been as successful, especially following the current American Association of Sleep Medicine (AASM) standards. This study presents a fine-tuning based approach to widely generalizable automatic sleep staging using heart rate and movement features trained and validated on large databases of polysomnography. Methods A deep neural network is used to predict sleep stages using heart rate and movement features. The model is optimized on a dataset of 8731 nights of polysomnography recordings labeled using the Rechtschaffen & Kales scoring system, and fine-tuned to a smaller dataset of 1641 AASM-labeled recordings. The model prior to and after fine-tuning is validated on two AASM-labeled external datasets totaling 1183 recordings. In order to measure the performance of the model, the output of the optimized model is compared to reference expert-labeled sleep stages using accuracy and Cohen's κ as key metrics. Results The fine-tuned model showed accuracy of 76.6% with Cohen's κ of 0.606 in one of the external validation datasets, outperforming a previously reported result, and showed accuracy of 81.0% with Cohen's κ of 0.673 in another external validation dataset. Conclusion These results indicate that the proposed model is generalizable and effective in predicting sleep stages using features which can be extracted from non-contact sleep monitors. This holds valuable implications for future development of home sleep evaluation systems.
Collapse
Affiliation(s)
| | - Hee Chan Kim
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, 03080 South Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, 08826 South Korea
| | - Yu Jin Lee
- Department of Neuropsychiatry, Seoul National University Hospital, Seoul, 03080 South Korea
- Center for Sleep and Chronobiology, Seoul National University Hospital, Seoul, 03080 South Korea
| | - Saram Lee
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, 03080 South Korea
| |
Collapse
|
9
|
Anido-Alonso A, Alvarez-Estevez D. Decentralized Data-Privacy Preserving Deep-Learning Approaches for Enhancing Inter-Database Generalization in Automatic Sleep Staging. IEEE J Biomed Health Inform 2023; 27:5610-5621. [PMID: 37651482 DOI: 10.1109/jbhi.2023.3310869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Automatic sleep staging has been an active field of development. Despite multiple efforts, the area remains a focus of research interest. Indeed, while promising results have reported in past literature, uptake of automatic sleep scoring in the clinical setting remains low. One of the current issues regards the difficulty to generalization performance results beyond the local testing scenario, i.e. across data from different clinics. Issues derived from data-privacy restrictions, that generally apply in the medical domain, pose additional difficulties in the successful development of these methods. We propose the use of several decentralized deep-learning approaches, namely ensemble models and federated learning, for robust inter-database performance generalization and data-privacy preservation in automatic sleep staging scenario. Specifically, we explore four ensemble combination strategies (max-voting, output averaging, size-proportional weighting, and Nelder-Mead) and present a new federated learning algorithm, so-called sub-sampled federated stochastic gradient descent (ssFedSGD). To evaluate generalization capabilities of such approaches, experimental procedures are carried out using a leaving-one-database-out direct-transfer scenario on six independent and heterogeneous public sleep staging databases. The resulting performance is compared with respect to two baseline approaches involving single-database and centralized multiple-database derived models. Our results show that proposed decentralized learning methods outperform baseline local approaches, and provide similar generalization results to centralized database-combined approaches. We conclude that these methods are more preferable choices, as they come with additional advantages concerning improved scalability, flexible design, and data-privacy preservation.
Collapse
|
10
|
Vaquerizo-Villar F, Gutiérrez-Tobal GC, Calvo E, Álvarez D, Kheirandish-Gozal L, Del Campo F, Gozal D, Hornero R. An explainable deep-learning model to stage sleep states in children and propose novel EEG-related patterns in sleep apnea. Comput Biol Med 2023; 165:107419. [PMID: 37703716 DOI: 10.1016/j.compbiomed.2023.107419] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 07/26/2023] [Accepted: 08/28/2023] [Indexed: 09/15/2023]
Abstract
Automatic deep-learning models used for sleep scoring in children with obstructive sleep apnea (OSA) are perceived as black boxes, limiting their implementation in clinical settings. Accordingly, we aimed to develop an accurate and interpretable deep-learning model for sleep staging in children using single-channel electroencephalogram (EEG) recordings. We used EEG signals from the Childhood Adenotonsillectomy Trial (CHAT) dataset (n = 1637) and a clinical sleep database (n = 980). Three distinct deep-learning architectures were explored to automatically classify sleep stages from a single-channel EEG data. Gradient-weighted Class Activation Mapping (Grad-CAM), an explainable artificial intelligence (XAI) algorithm, was then applied to provide an interpretation of the singular EEG patterns contributing to each predicted sleep stage. Among the tested architectures, a standard convolutional neural network (CNN) demonstrated the highest performance for automated sleep stage detection in the CHAT test set (accuracy = 86.9% and five-class kappa = 0.827). Furthermore, the CNN-based estimation of total sleep time exhibited strong agreement in the clinical dataset (intra-class correlation coefficient = 0.772). Our XAI approach using Grad-CAM effectively highlighted the EEG features associated with each sleep stage, emphasizing their influence on the CNN's decision-making process in both datasets. Grad-CAM heatmaps also allowed to identify and analyze epochs within a recording with a highly likelihood to be misclassified, revealing mixed features from different sleep stages within these epochs. Finally, Grad-CAM heatmaps unveiled novel features contributing to sleep scoring using a single EEG channel. Consequently, integrating an explainable CNN-based deep-learning model in the clinical environment could enable automatic sleep staging in pediatric sleep apnea tests.
Collapse
Affiliation(s)
- Fernando Vaquerizo-Villar
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain.
| | - Gonzalo C Gutiérrez-Tobal
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain
| | - Eva Calvo
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain
| | - Daniel Álvarez
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain; Sleep-Ventilation Unit, Pneumology Department, Río Hortega University Hospital, Valladolid, Spain
| | - Leila Kheirandish-Gozal
- Departments of Neurology and Child Health and Child Health Research Institute, The University of Missouri School of Medicine, Columbia, MO, USA
| | - Félix Del Campo
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain; Sleep-Ventilation Unit, Pneumology Department, Río Hortega University Hospital, Valladolid, Spain
| | - David Gozal
- Office of The Dean, Joan C. Edwards School of Medicine, Marshall University, 1600 Medical Center Dr, Huntington, WV, 25701, USA
| | - Roberto Hornero
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain
| |
Collapse
|
11
|
Almarshad MA, Al-Ahmadi S, Islam MS, BaHammam AS, Soudani A. Adoption of Transformer Neural Network to Improve the Diagnostic Performance of Oximetry for Obstructive Sleep Apnea. SENSORS (BASEL, SWITZERLAND) 2023; 23:7924. [PMID: 37765980 PMCID: PMC10536445 DOI: 10.3390/s23187924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 09/03/2023] [Accepted: 09/14/2023] [Indexed: 09/29/2023]
Abstract
Scoring polysomnography for obstructive sleep apnea diagnosis is a laborious, long, and costly process. Machine learning approaches, such as deep neural networks, can reduce scoring time and costs. However, most methods require prior filtering and preprocessing of the raw signal. Our work presents a novel method for diagnosing obstructive sleep apnea using a transformer neural network with learnable positional encoding, which outperforms existing state-of-the-art solutions. This approach has the potential to improve the diagnostic performance of oximetry for obstructive sleep apnea and reduce the time and costs associated with traditional polysomnography. Contrary to existing approaches, our approach performs annotations at one-second granularity. Allowing physicians to interpret the model's outcome. In addition, we tested different positional encoding designs as the first layer of the model, and the best results were achieved using a learnable positional encoding based on an autoencoder with structural novelty. In addition, we tried different temporal resolutions with various granularity levels from 1 to 360 s. All experiments were carried out on an independent test set from the public OSASUD dataset and showed that our approach outperforms current state-of-the-art solutions with a satisfactory AUC of 0.89, accuracy of 0.80, and F1-score of 0.79.
Collapse
Affiliation(s)
- Malak Abdullah Almarshad
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
- Computer Science Department, College of Computer and Information Sciences, Al-Imam Mohammad Ibn Saud Islamic University, Riyadh 11432, Saudi Arabia
| | - Saad Al-Ahmadi
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
| | - Md Saiful Islam
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
| | - Ahmed S. BaHammam
- The University Sleep Disorders Center, Department of Medicine, College of Medicine, King Saud University, Riyadh 11324, Saudi Arabia
- Strategic Technologies Program of the National Plan for Sciences and Technology and Innovation in the Kingdom of Saudi Arabia, Riyadh 11324, Saudi Arabia
| | - Adel Soudani
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
| |
Collapse
|
12
|
Sun J, Dong QX, Wang SW, Zheng YB, Liu XX, Lu TS, Yuan K, Shi J, Hu B, Lu L, Han Y. Artificial intelligence in psychiatry research, diagnosis, and therapy. Asian J Psychiatr 2023; 87:103705. [PMID: 37506575 DOI: 10.1016/j.ajp.2023.103705] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 07/16/2023] [Accepted: 07/20/2023] [Indexed: 07/30/2023]
Abstract
Psychiatric disorders are now responsible for the largest proportion of the global burden of disease, and even more challenges have been seen during the COVID-19 pandemic. Artificial intelligence (AI) is commonly used to facilitate the early detection of disease, understand disease progression, and discover new treatments in the fields of both physical and mental health. The present review provides a broad overview of AI methodology and its applications in data acquisition and processing, feature extraction and characterization, psychiatric disorder classification, potential biomarker detection, real-time monitoring, and interventions in psychiatric disorders. We also comprehensively summarize AI applications with regard to the early warning, diagnosis, prognosis, and treatment of specific psychiatric disorders, including depression, schizophrenia, autism spectrum disorder, attention-deficit/hyperactivity disorder, addiction, sleep disorders, and Alzheimer's disease. The advantages and disadvantages of AI in psychiatry are clarified. We foresee a new wave of research opportunities to facilitate and improve AI technology and its long-term implications in psychiatry during and after the COVID-19 era.
Collapse
Affiliation(s)
- Jie Sun
- Pain Medicine Center, Peking University Third Hospital, Beijing 100191, China; Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China
| | - Qun-Xi Dong
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
| | - San-Wang Wang
- Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China; Department of Psychiatry, Renmin Hospital of Wuhan University, Wuhan 430060, China
| | - Yong-Bo Zheng
- Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China; Peking-Tsinghua Center for Life Sciences and PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
| | - Xiao-Xing Liu
- Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China
| | - Tang-Sheng Lu
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence Research, Peking University, Beijing 100191, China
| | - Kai Yuan
- Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China
| | - Jie Shi
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence Research, Peking University, Beijing 100191, China
| | - Bin Hu
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China.
| | - Lin Lu
- Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China; Peking-Tsinghua Center for Life Sciences and PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China.
| | - Ying Han
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence Research, Peking University, Beijing 100191, China.
| |
Collapse
|
13
|
Abstract
Automatic polysomnography analysis can be leveraged to shorten scoring times, reduce associated costs, and ultimately improve the overall diagnosis of sleep disorders. Multiple and diverse strategies have been attempted for implementation of this technology at scale in the routine workflow of sleep centers. The field, however, is complex and presents unsolved challenges in a number of areas. Recent developments in computer science and artificial intelligence are nevertheless closing the gap. Technological advances are also opening new pathways for expanding our current understanding of the domain and its analysis.
Collapse
Affiliation(s)
- Diego Alvarez-Estevez
- Center for Information and Communications Technology Research (CITIC), Universidade da Coruña, 15071 A Coruña, Spain.
| |
Collapse
|
14
|
Zahid AN, Jennum P, Mignot E, Sorensen HBD. MSED: A Multi-Modal Sleep Event Detection Model for Clinical Sleep Analysis. IEEE Trans Biomed Eng 2023; 70:2508-2518. [PMID: 37028083 DOI: 10.1109/tbme.2023.3252368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Abstract
Clinical sleep analysis require manual analysis of sleep patterns for correct diagnosis of sleep disorders. However, several studies have shown significant variability in manual scoring of clinically relevant discrete sleep events, such as arousals, leg movements, and sleep disordered breathing (apneas and hypopneas). We investigated whether an automatic method could be used for event detection and if a model trained on all events (joint model) performed better than corresponding event-specific models (single-event models). We trained a deep neural network event detection model on 1653 individual recordings and tested the optimized model on 1000 separate hold-out recordings. F1 scores for the optimized joint detection model were 0.70, 0.63, and 0.62 for arousals, leg movements, and sleep disordered breathing, respectively, compared to 0.65, 0.61, and 0.60 for the optimized single-event models. Index values computed from detected events correlated positively with manual annotations (r2 = 0.73, r2 = 0.77, r2 = 0.78, respectively). We furthermore quantified model accuracy based on temporal difference metrics, which improved overall by using the joint model compared to single-event models. Our automatic model jointly detects arousals, leg movements and sleep disordered breathing events with high correlation with human annotations. Finally, we benchmark against previous state-of-the-art multi-event detection models and found an overall increase in F1 score with our proposed model despite a 97.5% reduction in model size.
Collapse
|
15
|
Tyagi PK, Agarwal D. Systematic review of automated sleep apnea detection based on physiological signal data using deep learning algorithm: a meta-analysis approach. Biomed Eng Lett 2023; 13:293-312. [PMID: 37519869 PMCID: PMC10382448 DOI: 10.1007/s13534-023-00297-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 06/10/2023] [Accepted: 06/18/2023] [Indexed: 08/01/2023] Open
Abstract
Sleep apnea (SLA) is a respiratory-related sleep disorder that affects a major proportion of the population. The gold standard in sleep testing, polysomnography, is costly, inconvenient, and unpleasant, and it requires a skilled professional to score. Multiple researchers have suggested and developed automated scoring processes with less detectors and automated classification algorithms to resolve these problems. An automatic detection system will allow for a high diagnosis rate and the analysis of additional patients. Deep learning (DL) is achieving high priority due to the availability of databases and recently developed methods. As the most up-and-coming technique for classification and generative tasks, DL has shown its significant potential in 2-dimensional clinical image processing studies. However, physiological information collected as 1-dimensional data has yet to be effectively extracted from this new approach to achieve the needed medical goals. So, in this study, we review the most recent studies in the field of DL applied to physiological data based on pulse oxygen saturation, electrocardiogram, airflow, and sound signal. A total of 47 articles from different journals and publishing houses that were published between 2012 and 2022 were identified. The primary objective of this work is to perform a comprehensive analysis to analyze, classify, and compare the main characteristics of deep-learning algorithms applied in physiological data processing for SLA detection. Overall, our analysis provides comprehensive and detailed information for researchers looking to add to this field. The data input source, objective, DL network, training framework, and database references are the critical factors of the DL approach examined. These are the most critical variables that influence system performance. We categorized the relevant research studies in physiological sensor data analysis using the DL approach based on (1) Physiological sensor data aspects, like signal types, sampling frequency, and window size; and (2) DL model perspectives, such as learning structure and input data types. Supplementary Information The online version contains supplementary material available at 10.1007/s13534-023-00297-5.
Collapse
Affiliation(s)
- Praveen Kumar Tyagi
- Department of ECE, Maulana Azad National Institute of Technology, Bhopal, 462003 India
| | - Dheeraj Agarwal
- Department of ECE, Maulana Azad National Institute of Technology, Bhopal, 462003 India
| |
Collapse
|
16
|
Gaiduk M, Serrano Alarcón Á, Seepold R, Martínez Madrid N. Current status and prospects of automatic sleep stages scoring: Review. Biomed Eng Lett 2023; 13:247-272. [PMID: 37519865 PMCID: PMC10382458 DOI: 10.1007/s13534-023-00299-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/07/2023] [Accepted: 06/18/2023] [Indexed: 08/01/2023] Open
Abstract
The scoring of sleep stages is one of the essential tasks in sleep analysis. Since a manual procedure requires considerable human and financial resources, and incorporates some subjectivity, an automated approach could result in several advantages. There have been many developments in this area, and in order to provide a comprehensive overview, it is essential to review relevant recent works and summarise the characteristics of the approaches, which is the main aim of this article. To achieve it, we examined articles published between 2018 and 2022 that dealt with the automated scoring of sleep stages. In the final selection for in-depth analysis, 125 articles were included after reviewing a total of 515 publications. The results revealed that automatic scoring demonstrates good quality (with Cohen's kappa up to over 0.80 and accuracy up to over 90%) in analysing EEG/EEG + EOG + EMG signals. At the same time, it should be noted that there has been no breakthrough in the quality of results using these signals in recent years. Systems involving other signals that could potentially be acquired more conveniently for the user (e.g. respiratory, cardiac or movement signals) remain more challenging in the implementation with a high level of reliability but have considerable innovation capability. In general, automatic sleep stage scoring has excellent potential to assist medical professionals while providing an objective assessment.
Collapse
Affiliation(s)
- Maksym Gaiduk
- HTWG Konstanz – University of Applied Sciences, Alfred-Wachtel-Str.8, 78462 Konstanz, Germany
| | | | - Ralf Seepold
- HTWG Konstanz – University of Applied Sciences, Alfred-Wachtel-Str.8, 78462 Konstanz, Germany
| | | |
Collapse
|
17
|
Alarcón ÁS, Madrid NM, Seepold R, Ortega JA. Obstructive sleep apnea event detection using explainable deep learning models for a portable monitor. Front Neurosci 2023; 17:1155900. [PMID: 37521695 PMCID: PMC10375719 DOI: 10.3389/fnins.2023.1155900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 06/16/2023] [Indexed: 08/01/2023] Open
Abstract
Background Polysomnography (PSG) is the gold standard for detecting obstructive sleep apnea (OSA). However, this technique has many disadvantages when using it outside the hospital or for daily use. Portable monitors (PMs) aim to streamline the OSA detection process through deep learning (DL). Materials and methods We studied how to detect OSA events and calculate the apnea-hypopnea index (AHI) by using deep learning models that aim to be implemented on PMs. Several deep learning models are presented after being trained on polysomnography data from the National Sleep Research Resource (NSRR) repository. The best hyperparameters for the DL architecture are presented. In addition, emphasis is focused on model explainability techniques, concretely on Gradient-weighted Class Activation Mapping (Grad-CAM). Results The results for the best DL model are presented and analyzed. The interpretability of the DL model is also analyzed by studying the regions of the signals that are most relevant for the model to make the decision. The model that yields the best result is a one-dimensional convolutional neural network (1D-CNN) with 84.3% accuracy. Conclusion The use of PMs using machine learning techniques for detecting OSA events still has a long way to go. However, our method for developing explainable DL models demonstrates that PMs appear to be a promising alternative to PSG in the future for the detection of obstructive apnea events and the automatic calculation of AHI.
Collapse
Affiliation(s)
- Ángel Serrano Alarcón
- School of Informatics, Reutlingen University, Reutlingen, Germany
- Computer Languages and Systems, University of Seville, Sevilla, Spain
| | | | - Ralf Seepold
- Computer Science, HTWG Konstanz, Konstanz, Germany
| | | |
Collapse
|
18
|
Bazoukis G, Bollepalli SC, Chung CT, Li X, Tse G, Bartley BL, Batool-Anwar S, Quan SF, Armoundas AA. Application of artificial intelligence in the diagnosis of sleep apnea. J Clin Sleep Med 2023; 19:1337-1363. [PMID: 36856067 PMCID: PMC10315608 DOI: 10.5664/jcsm.10532] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Revised: 02/21/2023] [Accepted: 02/21/2023] [Indexed: 03/02/2023]
Abstract
STUDY OBJECTIVES Machine learning (ML) models have been employed in the setting of sleep disorders. This review aims to summarize the existing data about the role of ML techniques in the diagnosis, classification, and treatment of sleep-related breathing disorders. METHODS A systematic search in Medline, EMBASE, and Cochrane databases through January 2022 was performed. RESULTS Our search strategy revealed 132 studies that were included in the systematic review. Existing data show that ML models have been successfully used for diagnostic purposes. Specifically, ML models showed good performance in diagnosing sleep apnea using easily obtained features from the electrocardiogram, pulse oximetry, and sound signals. Similarly, ML showed good performance for the classification of sleep apnea into obstructive and central categories, as well as predicting apnea severity. Existing data show promising results for the ML-based guided treatment of sleep apnea. Specifically, the prediction of outcomes following surgical treatment and optimization of continuous positive airway pressure therapy can be guided by ML models. CONCLUSIONS The adoption and implementation of ML in the field of sleep-related breathing disorders is promising. Advancements in wearable sensor technology and ML models can help clinicians predict, diagnose, and classify sleep apnea more accurately and efficiently. CITATION Bazoukis G, Bollepalli SC, Chung CT, et al. Application of artificial intelligence in the diagnosis of sleep apnea. J Clin Sleep Med. 2023;19(7):1337-1363.
Collapse
Affiliation(s)
- George Bazoukis
- Department of Cardiology, Larnaca General Hospital, Larnaca, Cyprus
- Department of Basic and Clinical Sciences, University of Nicosia Medical School, Nicosia, Cyprus
| | | | - Cheuk To Chung
- Cardiac Electrophysiology Unit, Cardiovascular Analytics Group, China-UK Collaboration, Hong Kong
| | - Xinmu Li
- Tianjin Key Laboratory of Ionic-Molecular Function of Cardiovascular disease, Department of Cardiology, Tianjin Institute of Cardiology, the Second Hospital of Tianjin Medical University, Tianjin, China
| | - Gary Tse
- Cardiac Electrophysiology Unit, Cardiovascular Analytics Group, China-UK Collaboration, Hong Kong
- Kent and Medway Medical School, Canterbury, Kent, United Kingdom
| | - Bethany L. Bartley
- Division of Sleep and Circadian Disorders, Brigham and Women’s Hospital, Boston, Massachusetts
| | - Salma Batool-Anwar
- Division of Sleep and Circadian Disorders, Brigham and Women’s Hospital, Boston, Massachusetts
| | - Stuart F. Quan
- Division of Sleep and Circadian Disorders, Brigham and Women’s Hospital, Boston, Massachusetts
- Asthma and Airway Disease Research Center, University of Arizona College of Medicine, Tucson, Arizona
| | - Antonis A. Armoundas
- Cardiovascular Research Center, Massachusetts General Hospital, Boston, Massachusetts
- Broad Institute, Massachusetts Institute of Technology, Cambridge, Massachusetts
| |
Collapse
|
19
|
Lambert I, Peter-Derex L. Spotlight on Sleep Stage Classification Based on EEG. Nat Sci Sleep 2023; 15:479-490. [PMID: 37405208 PMCID: PMC10317531 DOI: 10.2147/nss.s401270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 06/21/2023] [Indexed: 07/06/2023] Open
Abstract
The recommendations for identifying sleep stages based on the interpretation of electrophysiological signals (electroencephalography [EEG], electro-oculography [EOG], and electromyography [EMG]), derived from the Rechtschaffen and Kales manual, were published in 2007 at the initiative of the American Academy of Sleep Medicine, and regularly updated over years. They offer an important tool to assess objective markers in different types of sleep/wake subjective complaints. With the aims and advantages of simplicity, reproducibility and standardization of practices in research and, most of all, in sleep medicine, they have overall changed little in the way they describe sleep. However, our knowledge on sleep/wake physiology and sleep disorders has evolved since then. High-density electroencephalography and intracranial electroencephalography studies have highlighted local regulation of sleep mechanisms, with spatio-temporal heterogeneity in vigilance states. Progress in the understanding of sleep disorders has allowed the identification of electrophysiological biomarkers better correlated with clinical symptoms and outcomes than standard sleep parameters. Finally, the huge development of sleep medicine, with a demand for explorations far exceeding the supply, has led to the development of alternative studies, which can be carried out at home, based on a smaller number of electrophysiological signals and on their automatic analysis. In this perspective article, we aim to examine how our description of sleep has been constructed, has evolved, and may still be reshaped in the light of advances in knowledge of sleep physiology and the development of technical recording and analysis tools. After presenting the strengths and limitations of the classification of sleep stages, we propose to challenge the "EEG-EOG-EMG" paradigm by discussing the physiological signals required for sleep stages identification, provide an overview of new tools and automatic analysis methods and propose avenues for the development of new approaches to describe and understand sleep/wake states.
Collapse
Affiliation(s)
- Isabelle Lambert
- APHM, Timone Hospital, Sleep Unit, Epileptology and Cerebral Rhythmology, Marseille, France
- Aix Marseille University, INSERM, Institut de Neuroscience des Systemes, Marseille, France
| | - Laure Peter-Derex
- Center for Sleep Medicine and Respiratory Diseases, Croix-Rousse Hospital, Hospices Civils de Lyon, Lyon 1 University, Lyon, France
- Lyon Neuroscience Research Center, PAM Team, INSERM U1028, CNRS UMR 5292, Lyon, France
| |
Collapse
|
20
|
Kang C, An S, Kim HJ, Devi M, Cho A, Hwang S, Lee HW. Age-integrated artificial intelligence framework for sleep stage classification and obstructive sleep apnea screening. Front Neurosci 2023; 17:1059186. [PMID: 37389364 PMCID: PMC10300414 DOI: 10.3389/fnins.2023.1059186] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Accepted: 05/03/2023] [Indexed: 07/01/2023] Open
Abstract
Introduction Sleep is an essential function to sustain a healthy life, and sleep dysfunction can cause various physical and mental issues. In particular, obstructive sleep apnea (OSA) is one of the most common sleep disorders and, if not treated in a timely manner, OSA can lead to critical problems such as hypertension or heart disease. Methods The first crucial step in evaluating individuals' quality of sleep and diagnosing sleep disorders is to classify sleep stages using polysomnographic (PSG) data including electroencephalography (EEG). To date, such sleep stage scoring has been mainly performed manually via visual inspection by experts, which is not only a time-consuming and laborious process but also may yield subjective results. Therefore, we have developed a computational framework that enables automatic sleep stage classification utilizing the power spectral density (PSD) features of sleep EEG based on three different learning algorithms: support vector machine, k-nearest neighbors, and multilayer perceptron (MLP). In particular, we propose an integrated artificial intelligence (AI) framework to further inform the risk of OSA based on the characteristics in automatically scored sleep stages. Given the previous finding that the characteristics of sleep EEG differ by age group, we employed a strategy of training age-specific models (younger and older groups) and a general model and comparing their performance. Results The performance of the younger age-specific group model was similar to that of the general model (and even higher than the general model at certain stages), but the performance of the older age-specific group model was rather low, suggesting that bias in individual variables, such as age bias, should be considered during model training. Our integrated model yielded an accuracy of 73% in sleep stage classification and 73% in OSA screening when MLP algorithm was applied, which indicates that patients with OSA could be screened with the corresponding accuracy level only with sleep EEG without respiration-related measures. Discussion The current outcomes demonstrate the feasibility of AI-based computational studies that when combined with advances in wearable devices and relevant technologies could contribute to personalized medicine by not only assessing an individuals' sleep status conveniently at home but also by alerting them to the risk of sleep disorders and enabling early intervention.
Collapse
Affiliation(s)
- Chaewon Kang
- Computational Medicine, System Health Science and Engineering Program, Ewha Womans University, Seoul, Republic of Korea
| | - Sora An
- Department of Communication Disorders, Ewha Womans University, Seoul, Republic of Korea
| | - Hyeon Jin Kim
- Department of Neurology, Korea University Ansan Hospital, Ansan, Republic of Korea
- Department of Neurology, Ewha Womans University School of Medicine, Seoul, Republic of Korea
| | - Maithreyee Devi
- Computational Medicine, System Health Science and Engineering Program, Ewha Womans University, Seoul, Republic of Korea
| | - Aram Cho
- Department of Nursing Science, Ewha Womans University, Seoul, Republic of Korea
| | - Sungeun Hwang
- Department of Neurology, Ewha Womans University Mogdong Hospital, Seoul, Republic of Korea
| | - Hyang Woon Lee
- Computational Medicine, System Health Science and Engineering Program, Ewha Womans University, Seoul, Republic of Korea
- Department of Neurology, Ewha Womans University School of Medicine, Seoul, Republic of Korea
- Department of Medical Science, Ewha Womans University School of Medicine and Ewha Medical Research Institute, Seoul, Republic of Korea
| |
Collapse
|
21
|
Nasiri S, Ganglberger W, Sun H, Thomas RJ, Westover MB. Exploiting labels from multiple experts in automated sleep scoring. Sleep 2023; 46:zsad034. [PMID: 36795078 PMCID: PMC10171620 DOI: 10.1093/sleep/zsad034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2023] [Indexed: 02/17/2023] Open
Affiliation(s)
- Samaneh Nasiri
- Department of Neurology, Massachusetts General Hospital (MGH), Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
- Clinical Data Animation Center (CDAC), Boston, MA, USA
- McCance Center for Brain Health, MGH, Boston, MA, USA
| | - Wolfgang Ganglberger
- Harvard Medical School, Boston, MA, USA
- Clinical Data Animation Center (CDAC), Boston, MA, USA
- McCance Center for Brain Health, MGH, Boston, MA, USA
| | - Haoqi Sun
- Harvard Medical School, Boston, MA, USA
- Clinical Data Animation Center (CDAC), Boston, MA, USA
- McCance Center for Brain Health, MGH, Boston, MA, USA
- Department of Medicine, Division of Pulmonary, Critical Care & Sleep, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Robert J Thomas
- Harvard Medical School, Boston, MA, USA
- McCance Center for Brain Health, MGH, Boston, MA, USA
| | - M Brandon Westover
- Department of Neurology, Massachusetts General Hospital (MGH), Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
- Clinical Data Animation Center (CDAC), Boston, MA, USA
- McCance Center for Brain Health, MGH, Boston, MA, USA
- Department of Medicine, Division of Pulmonary, Critical Care & Sleep, Beth Israel Deaconess Medical Center, Boston, MA, USA
| |
Collapse
|
22
|
Sun H, Ye E, Paixao L, Ganglberger W, Chu CJ, Zhang C, Rosand J, Mignot E, Cash SS, Gozal D, Thomas RJ, Westover MB. The sleep and wake electroencephalogram over the lifespan. Neurobiol Aging 2023; 124:60-70. [PMID: 36739622 PMCID: PMC9957961 DOI: 10.1016/j.neurobiolaging.2023.01.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2022] [Revised: 12/29/2022] [Accepted: 01/11/2023] [Indexed: 01/20/2023]
Abstract
Both sleep and wake encephalograms (EEG) change over the lifespan. While prior studies have characterized age-related changes in the EEG, the datasets span a particular age group, or focused on sleep and wake macrostructure rather than the microstructure. Here, we present sex-stratified data from 3372 community-based or clinic-based otherwise neurologically and psychiatrically healthy participants ranging from 11 days to 80 years of age. We estimate age norms for key sleep and wake EEG parameters including absolute and relative powers in delta, theta, alpha, and sigma bands, as well as sleep spindle density, amplitude, duration, and frequency. To illustrate the potential use of the reference measures developed herein, we compare them to sleep EEG recordings from age-matched participants with Alzheimer's disease, severe sleep apnea, depression, osteoarthritis, and osteoporosis. Although the partially clinical nature of the datasets may bias the findings towards less normal and hence may underestimate pathology in practice, age-based EEG reference values enable objective screening of deviations from healthy aging among individuals with a variety of disorders that affect brain health.
Collapse
Affiliation(s)
- Haoqi Sun
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Henry and Allison McCance Center for Brain Health, Massachusetts General Hospital, MA, USA
| | - Elissa Ye
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Luis Paixao
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; School of Medicine, Washington University in St. Louis, St. Louis, MO, USA
| | | | - Catherine J Chu
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Can Zhang
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Jonathan Rosand
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Henry and Allison McCance Center for Brain Health, Massachusetts General Hospital, MA, USA
| | - Emmanuel Mignot
- Center for Sleep Sciences and Medicine, Stanford University, Stanford, CA USA
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - David Gozal
- Department of Child Health, University of Missouri, Columbia, MO, USA
| | - Robert J Thomas
- Department of Medicine, Division of Pulmonary, Critical Care & Sleep, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - M Brandon Westover
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Henry and Allison McCance Center for Brain Health, Massachusetts General Hospital, MA, USA.
| |
Collapse
|
23
|
Fiorillo L, Monachino G, van der Meer J, Pesce M, Warncke JD, Schmidt MH, Bassetti CLA, Tzovara A, Favaro P, Faraci FD. U-Sleep's resilience to AASM guidelines. NPJ Digit Med 2023; 6:33. [PMID: 36878957 PMCID: PMC9988983 DOI: 10.1038/s41746-023-00784-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 02/21/2023] [Indexed: 03/08/2023] Open
Abstract
AASM guidelines are the result of decades of efforts aiming at standardizing sleep scoring procedure, with the final goal of sharing a worldwide common methodology. The guidelines cover several aspects from the technical/digital specifications, e.g., recommended EEG derivations, to detailed sleep scoring rules accordingly to age. Automated sleep scoring systems have always largely exploited the standards as fundamental guidelines. In this context, deep learning has demonstrated better performance compared to classical machine learning. Our present work shows that a deep learning-based sleep scoring algorithm may not need to fully exploit the clinical knowledge or to strictly adhere to the AASM guidelines. Specifically, we demonstrate that U-Sleep, a state-of-the-art sleep scoring algorithm, can be strong enough to solve the scoring task even using clinically non-recommended or non-conventional derivations, and with no need to exploit information about the chronological age of the subjects. We finally strengthen a well-known finding that using data from multiple data centers always results in a better performing model compared with training on a single cohort. Indeed, we show that this latter statement is still valid even by increasing the size and the heterogeneity of the single data cohort. In all our experiments we used 28528 polysomnography studies from 13 different clinical studies.
Collapse
Affiliation(s)
- Luigi Fiorillo
- Institute of Informatics, University of Bern, Bern, Switzerland.
- Institute of Digital Technologies for Personalized Healthcare ∣ MeDiTech, Department of Innovative Technologies, University of Applied Sciences and Arts of Southern Switzerland, Lugano, Switzerland.
| | - Giuliana Monachino
- Institute of Informatics, University of Bern, Bern, Switzerland
- Institute of Digital Technologies for Personalized Healthcare ∣ MeDiTech, Department of Innovative Technologies, University of Applied Sciences and Arts of Southern Switzerland, Lugano, Switzerland
| | - Julia van der Meer
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Marco Pesce
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Jan D Warncke
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Markus H Schmidt
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Claudio L A Bassetti
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Athina Tzovara
- Institute of Informatics, University of Bern, Bern, Switzerland
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Paolo Favaro
- Institute of Informatics, University of Bern, Bern, Switzerland
| | - Francesca D Faraci
- Institute of Digital Technologies for Personalized Healthcare ∣ MeDiTech, Department of Innovative Technologies, University of Applied Sciences and Arts of Southern Switzerland, Lugano, Switzerland
| |
Collapse
|
24
|
Bandyopadhyay A, Goldstein C. Clinical applications of artificial intelligence in sleep medicine: a sleep clinician's perspective. Sleep Breath 2023; 27:39-55. [PMID: 35262853 PMCID: PMC8904207 DOI: 10.1007/s11325-022-02592-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 01/25/2022] [Accepted: 03/02/2022] [Indexed: 12/27/2022]
Abstract
BACKGROUND The past few years have seen a rapid emergence of artificial intelligence (AI)-enabled technology in the field of sleep medicine. AI refers to the capability of computer systems to perform tasks conventionally considered to require human intelligence, such as speech recognition, decision-making, and visual recognition of patterns and objects. The practice of sleep tracking and measuring physiological signals in sleep is widely practiced. Therefore, sleep monitoring in both the laboratory and ambulatory environments results in the accrual of massive amounts of data that uniquely positions the field of sleep medicine to gain from AI. METHOD The purpose of this article is to provide a concise overview of relevant terminology, definitions, and use cases of AI in sleep medicine. This was supplemented by a thorough review of relevant published literature. RESULTS Artificial intelligence has several applications in sleep medicine including sleep and respiratory event scoring in the sleep laboratory, diagnosing and managing sleep disorders, and population health. While still in its nascent stage, there are several challenges which preclude AI's generalizability and wide-reaching clinical applications. Overcoming these challenges will help integrate AI seamlessly within sleep medicine and augment clinical practice. CONCLUSION Artificial intelligence is a powerful tool in healthcare that may improve patient care, enhance diagnostic abilities, and augment the management of sleep disorders. However, there is a need to regulate and standardize existing machine learning algorithms prior to its inclusion in the sleep clinic.
Collapse
Affiliation(s)
- Anuja Bandyopadhyay
- Department of Pediatrics, Indiana University School of Medicine, Indianapolis, IN, USA.
| | - Cathy Goldstein
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
25
|
Topalidis P, Heib DPJ, Baron S, Eigl ES, Hinterberger A, Schabus M. The Virtual Sleep Lab-A Novel Method for Accurate Four-Class Sleep Staging Using Heart-Rate Variability from Low-Cost Wearables. SENSORS (BASEL, SWITZERLAND) 2023; 23:2390. [PMID: 36904595 PMCID: PMC10006886 DOI: 10.3390/s23052390] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 02/07/2023] [Accepted: 02/11/2023] [Indexed: 06/18/2023]
Abstract
Sleep staging based on polysomnography (PSG) performed by human experts is the de facto "gold standard" for the objective measurement of sleep. PSG and manual sleep staging is, however, personnel-intensive and time-consuming and it is thus impractical to monitor a person's sleep architecture over extended periods. Here, we present a novel, low-cost, automatized, deep learning alternative to PSG sleep staging that provides a reliable epoch-by-epoch four-class sleep staging approach (Wake, Light [N1 + N2], Deep, REM) based solely on inter-beat-interval (IBI) data. Having trained a multi-resolution convolutional neural network (MCNN) on the IBIs of 8898 full-night manually sleep-staged recordings, we tested the MCNN on sleep classification using the IBIs of two low-cost (<EUR 100) consumer wearables: an optical heart rate sensor (VS) and a breast belt (H10), both produced by POLAR®. The overall classification accuracy reached levels comparable to expert inter-rater reliability for both devices (VS: 81%, κ = 0.69; H10: 80.3%, κ = 0.69). In addition, we used the H10 and recorded daily ECG data from 49 participants with sleep complaints over the course of a digital CBT-I-based sleep training program implemented in the App NUKKUAA™. As proof of principle, we classified the IBIs extracted from H10 using the MCNN over the course of the training program and captured sleep-related changes. At the end of the program, participants reported significant improvements in subjective sleep quality and sleep onset latency. Similarly, objective sleep onset latency showed a trend toward improvement. Weekly sleep onset latency, wake time during sleep, and total sleep time also correlated significantly with the subjective reports. The combination of state-of-the-art machine learning with suitable wearables allows continuous and accurate monitoring of sleep in naturalistic settings with profound implications for answering basic and clinical research questions.
Collapse
Affiliation(s)
- Pavlos Topalidis
- Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology and Centre for Cognitive Neuroscience Salzburg (CCNS), Paris-Lodron University of Salzburg, 5020 Salzburg, Austria
| | - Dominik P. J. Heib
- Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology and Centre for Cognitive Neuroscience Salzburg (CCNS), Paris-Lodron University of Salzburg, 5020 Salzburg, Austria
- Institut Proschlaf, 5020 Salzburg, Austria
| | - Sebastian Baron
- Department of Mathematics, Paris-Lodron University of Salzburg, 5020 Salzburg, Austria
- Department of Artificial Intelligence and Human Interfaces (AIHI), Paris-Lodron University of Salzburg, 5020 Salzburg, Austria
| | - Esther-Sevil Eigl
- Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology and Centre for Cognitive Neuroscience Salzburg (CCNS), Paris-Lodron University of Salzburg, 5020 Salzburg, Austria
| | - Alexandra Hinterberger
- Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology and Centre for Cognitive Neuroscience Salzburg (CCNS), Paris-Lodron University of Salzburg, 5020 Salzburg, Austria
| | - Manuel Schabus
- Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology and Centre for Cognitive Neuroscience Salzburg (CCNS), Paris-Lodron University of Salzburg, 5020 Salzburg, Austria
| |
Collapse
|
26
|
Haghayegh S, Hu K, Stone K, Redline S, Schernhammer E. Automated Sleep Stages Classification Using Convolutional Neural Network From Raw and Time-Frequency Electroencephalogram Signals: Systematic Evaluation Study. J Med Internet Res 2023; 25:e40211. [PMID: 36763454 PMCID: PMC9960035 DOI: 10.2196/40211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Revised: 09/09/2022] [Accepted: 01/09/2023] [Indexed: 02/11/2023] Open
Abstract
BACKGROUND Most existing automated sleep staging methods rely on multimodal data, and scoring a specific epoch requires not only the current epoch but also a sequence of consecutive epochs that precede and follow the epoch. OBJECTIVE We proposed and tested a convolutional neural network called SleepInceptionNet, which allows sleep classification of a single epoch using a single-channel electroencephalogram (EEG). METHODS SleepInceptionNet is based on our systematic evaluation of the effects of different EEG preprocessing methods, EEG channels, and convolutional neural networks on automatic sleep staging performance. The evaluation was performed using polysomnography data of 883 participants (937,975 thirty-second epochs). Raw data of individual EEG channels (ie, frontal, central, and occipital) and 3 specific transformations of the data, including power spectral density, continuous wavelet transform, and short-time Fourier transform, were used separately as the inputs of the convolutional neural network models. To classify sleep stages, 7 sequential deep neural networks were tested for the 1D data (ie, raw EEG and power spectral density), and 16 image classifier convolutional neural networks were tested for the 2D data (ie, continuous wavelet transform and short-time Fourier transform time-frequency images). RESULTS The best model, SleepInceptionNet, which uses time-frequency images developed by the continuous wavelet transform method from central single-channel EEG data as input to the InceptionV3 image classifier algorithm, achieved a Cohen κ agreement of 0.705 (SD 0.077) in reference to the gold standard polysomnography. CONCLUSIONS SleepInceptionNet may allow real-time automated sleep staging in free-living conditions using a single-channel EEG, which may be useful for on-demand intervention or treatment during specific sleep stages.
Collapse
Affiliation(s)
- Shahab Haghayegh
- Harvard Medical School, Boston, MA, United States
- Brigham and Women's Hospital, Boston, MA, United States
| | - Kun Hu
- Harvard Medical School, Boston, MA, United States
- Brigham and Women's Hospital, Boston, MA, United States
| | - Katie Stone
- California Pacific Medical Center Research Institute, San Francisco, CA, United States
| | - Susan Redline
- Harvard Medical School, Boston, MA, United States
- Brigham and Women's Hospital, Boston, MA, United States
| | - Eva Schernhammer
- Harvard Medical School, Boston, MA, United States
- Brigham and Women's Hospital, Boston, MA, United States
- Medical University of Vienna, Vienna, Austria
| |
Collapse
|
27
|
Bakker JP, Ross M, Cerny A, Vasko R, Shaw E, Kuna S, Magalang UJ, Punjabi NM, Anderer P. Scoring sleep with artificial intelligence enables quantification of sleep stage ambiguity: hypnodensity based on multiple expert scorers and auto-scoring. Sleep 2023; 46:6628222. [PMID: 35780449 PMCID: PMC9905781 DOI: 10.1093/sleep/zsac154] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 06/22/2022] [Indexed: 11/12/2022] Open
Abstract
STUDY OBJECTIVES To quantify the amount of sleep stage ambiguity across expert scorers and to validate a new auto-scoring platform against sleep staging performed by multiple scorers. METHODS We applied a new auto-scoring system to three datasets containing 95 PSGs scored by 6-12 scorers, to compare sleep stage probabilities (hypnodensity; i.e. the probability of each sleep stage being assigned to a given epoch) as the primary output, as well as a single sleep stage per epoch assigned by hierarchical majority rule. RESULTS The percentage of epochs with 100% agreement across scorers was 46 ± 9%, 38 ± 10% and 32 ± 9% for the datasets with 6, 9, and 12 scorers, respectively. The mean intra-class correlation coefficient between sleep stage probabilities from auto- and manual-scoring was 0.91, representing excellent reliability. Within each dataset, agreement between auto-scoring and consensus manual-scoring was significantly higher than agreement between manual-scoring and consensus manual-scoring (0.78 vs. 0.69; 0.74 vs. 0.67; and 0.75 vs. 0.67; all p < 0.01). CONCLUSIONS Analysis of scoring performed by multiple scorers reveals that sleep stage ambiguity is the rule rather than the exception. Probabilities of the sleep stages determined by artificial intelligence auto-scoring provide an excellent estimate of this ambiguity. Compared to consensus manual-scoring, sleep staging derived from auto-scoring is for each individual PSG noninferior to manual-scoring meaning that auto-scoring output is ready for interpretation without the need for manual adjustment.
Collapse
Affiliation(s)
| | - Marco Ross
- Philips Sleep and Respiratory Care, Vienna, Austria
| | | | - Ray Vasko
- Philips Sleep and Respiratory Care, Pittsburgh, PA,USA
| | - Edmund Shaw
- Philips Sleep and Respiratory Care, Pittsburgh, PA,USA
| | - Samuel Kuna
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA,USA.,Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA,USA
| | - Ulysses J Magalang
- Division of Pulmonary, Critical Care, and Sleep Medicine, Ohio State University Wexner Medical Center, Columbus, OH, USA
| | - Naresh M Punjabi
- Division of Pulmonary, Critical Care, and Sleep Medicine, University of Miami, Miami FL, USA
| | | |
Collapse
|
28
|
Du Z, Wang J, Ren Y, Ren Y. A novel deep domain adaptation method for automated detection of sleep apnea/hypopnea events. Physiol Meas 2023; 44. [PMID: 36595309 DOI: 10.1088/1361-6579/aca879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Accepted: 12/01/2022] [Indexed: 12/05/2022]
Abstract
Objective.Sleep apnea-hypopnea syndrome (SAHS) is a common sleep-related respiratory disorder that is generally assessed for severity using polysomnography (PSG); however, the diversity of sampling devices and patients makes this not only costly but may also degrade the performance of the algorithms.Approach.This paper proposes a novel deep domain adaptation module which uses a long short-term memory-convolutional neural network embedded with the channel attention mechanism to achieve autonomous extraction of high-quality features. Meanwhile, a domain adaptation module was built to achieve domain-invariant feature extraction for reducing the differences in data distribution caused by different devices and other factors. In addition, during the training process, the algorithm used the last second label as the label of the PSG segment, so that second-by-second evaluation of respiratory events could be achieved.Main results.The algorithm applied the two datasets provided by PhysioNet as the source and target domains. The accuracy, sensitivity and specificity of the algorithm on the source domain were 86.46%, 86.11% and 93.17%, respectively, and on the target domain were 83.63%, 82.52%, 91.62%, respectively. The proposed algorithm showed strong generalization ability and the classification results were comparable to the current advanced methods. Besides, the apnea-hypopnea index values estimated by the proposed algorithm showed a high correlation with the manual scoring values on both domains.Significance.The proposed algorithm can effectively perform SAHS detection and evaluation with certain generalization.
Collapse
Affiliation(s)
- Zonglin Du
- Northeastern University, Shenyang, Liaoning, 110819, People's Republic of China
| | - Jiao Wang
- Northeastern University, Shenyang, Liaoning, 110819, People's Republic of China
| | - Yingxin Ren
- Northeastern University, Shenyang, Liaoning, 110819, People's Republic of China
| | - Yingtong Ren
- Northeastern University, Shenyang, Liaoning, 110819, People's Republic of China
| |
Collapse
|
29
|
Dakhale BJ, Sharma M, Arif M, Asthana K, Bhurane AA, Kothari AG, Rajendra Acharya U. An automatic sleep-scoring system in elderly women with osteoporosis fractures using frequency localized finite orthogonal quadrature Fejer Korovkin kernels. Med Eng Phys 2023; 112:103956. [PMID: 36842776 DOI: 10.1016/j.medengphy.2023.103956] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 01/04/2023] [Accepted: 02/04/2023] [Indexed: 02/10/2023]
Abstract
Healthy sleep signifies a good physical and mental state of the body. However, factors such as inappropriate work schedules, medical complications, and others can make it difficult to get enough sleep, leading to various sleep disorders. The identification of these disorders requires sleep stage classification. Visual evaluation of sleep stages is time intensive, placing a significant strain on sleep experts and prone to human errors. As a result, it is crucial to develop machine learning algorithms to score sleep stages to acquire an accurate diagnosis. Hence, a new methodology for automated sleep stage classification is suggested using machine learning and filtering electroencephalogram (EEG) signals. The national sleep research resource's (NSRR) study of osteoporotic fractures (SOF) dataset comprising 453 subjects' polysomnograph (PSG) data is used in this study. Only two unipolar EEG derivations C4-A1 and C3-A2 are employed individually and jointly in this work. The EEG signals are decomposed into sub-bands using a frequency-localized finite orthogonal quadrature Fejer Korovkin wavelet filter bank. The wavelet-based entropy features are extracted from sub-bands. Subsequently, extracted features are classified using machine learning techniques. Our developed model obtained the highest classification accuracy of 81.3%, using an ensembled bagged trees classifier with a 10-fold cross-validation method and Cohen's Kappa coefficient of 0.72. The proposed model is accurate, dependable, and easy to implement and can be employed as an alternative to a PSG-based system at home with minimal resources. It is also ready to be tested on other EEG data to evaluate the sleep stages of healthy and unhealthy subjects.
Collapse
Affiliation(s)
- Bharti Jogi Dakhale
- Department of Electonics and Communication, Indian Institute of Information Technology Nagpur, Maharashtra, India.
| | - Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Mohammad Arif
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Kushagra Asthana
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Ankit A Bhurane
- Department of Electronics and Communication, Visvesvaraya National Institute of Technology Nagpur, Maharashtra, India.
| | - Ashwin G Kothari
- Department of Electronics and Communication, Visvesvaraya National Institute of Technology Nagpur, Maharashtra, India.
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 639798, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan; Department of Biomedical Engineering, School of Science and Technology, Singapore 639798, Singapore.
| |
Collapse
|
30
|
Moradhasel B, Sheikhani A, Aloosh O, Jafarnia Dabanloo N. Spectrogram classification of patient chin electromyography based on deep learning: A novel method for accurate diagnosis obstructive sleep apnea. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
31
|
Yang C, Xiao C, Westover MB, Sun J. Self-Supervised Electroencephalogram Representation Learning for Automatic Sleep Staging: Model Development and Evaluation Study. JMIR AI 2023; 2:e46769. [PMID: 38090533 PMCID: PMC10715804 DOI: 10.2196/46769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/01/2024]
Abstract
Background Deep learning models have shown great success in automating tasks in sleep medicine by learning from carefully annotated electroencephalogram (EEG) data. However, effectively using a large amount of raw EEG data remains a challenge. Objective In this study, we aim to learn robust vector representations from massive unlabeled EEG signals, such that the learned vectorized features (1) are expressive enough to replace the raw signals in the sleep staging task, and (2) provide better predictive performance than supervised models in scenarios involving fewer labels and noisy samples. Methods We propose a self-supervised model, Contrast with the World Representation (ContraWR), for EEG signal representation learning. Unlike previous models that use a set of negative samples, our model uses global statistics (ie, the average representation) from the data set to distinguish signals associated with different sleep stages. The ContraWR model is evaluated on 3 real-world EEG data sets that include both settings: at-home and in-laboratory EEG recording. Results ContraWR outperforms 4 recently reported self-supervised learning methods on the sleep staging task across 3 large EEG data sets. ContraWR also supersedes supervised learning when fewer training labels are available (eg, 4% accuracy improvement when less than 2% of data are labeled on the Sleep EDF data set). Moreover, the model provides informative, representative feature structures in 2D projection. Conclusions We show that ContraWR is robust to noise and can provide high-quality EEG representations for downstream prediction tasks. The proposed model can be generalized to other unsupervised physiological signal learning tasks. Future directions include exploring task-specific data augmentations and combining self-supervised methods with supervised methods, building upon the initial success of self-supervised learning reported in this study.
Collapse
Affiliation(s)
- Chaoqi Yang
- Computer Science Department, Carle's Illinois College of Medicine, University of Illinois, Urbana Champaign, Urbana, IL, United States
| | - Cao Xiao
- Relativity Inc, Chicago, IL, United States
| | | | - Jimeng Sun
- Computer Science Department, Carle's Illinois College of Medicine, University of Illinois, Urbana Champaign, Urbana, IL, United States
| |
Collapse
|
32
|
Somaskandhan P, Leppänen T, Terrill PI, Sigurdardottir S, Arnardottir ES, Ólafsdóttir KA, Serwatko M, Sigurðardóttir SÞ, Clausen M, Töyräs J, Korkalainen H. Deep learning-based algorithm accurately classifies sleep stages in preadolescent children with sleep-disordered breathing symptoms and age-matched controls. Front Neurol 2023; 14:1162998. [PMID: 37122306 PMCID: PMC10140398 DOI: 10.3389/fneur.2023.1162998] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 03/23/2023] [Indexed: 05/02/2023] Open
Abstract
Introduction Visual sleep scoring has several shortcomings, including inter-scorer inconsistency, which may adversely affect diagnostic decision-making. Although automatic sleep staging in adults has been extensively studied, it is uncertain whether such sophisticated algorithms generalize well to different pediatric age groups due to distinctive EEG characteristics. The preadolescent age group (10-13-year-olds) is relatively understudied, and thus, we aimed to develop an automatic deep learning-based sleep stage classifier specifically targeting this cohort. Methods A dataset (n = 115) containing polysomnographic recordings of Icelandic preadolescent children with sleep-disordered breathing (SDB) symptoms, and age and sex-matched controls was utilized. We developed a combined convolutional and long short-term memory neural network architecture relying on electroencephalography (F4-M1), electrooculography (E1-M2), and chin electromyography signals. Performance relative to human scoring was further evaluated by analyzing intra- and inter-rater agreements in a subset (n = 10) of data with repeat scoring from two manual scorers. Results The deep learning-based model achieved an overall cross-validated accuracy of 84.1% (Cohen's kappa κ = 0.78). There was no meaningful performance difference between SDB-symptomatic (n = 53) and control subgroups (n = 52) [83.9% (κ = 0.78) vs. 84.2% (κ = 0.78)]. The inter-rater reliability between manual scorers was 84.6% (κ = 0.78), and the automatic method reached similar agreements with scorers, 83.4% (κ = 0.76) and 82.7% (κ = 0.75). Conclusion The developed algorithm achieved high classification accuracy and substantial agreements with two manual scorers; the performance metrics compared favorably with typical inter-rater reliability between manual scorers and performance reported in previous studies. These suggest that our algorithm may facilitate less labor-intensive and reliable automatic sleep scoring in preadolescent children.
Collapse
Affiliation(s)
- Pranavan Somaskandhan
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- *Correspondence: Pranavan Somaskandhan,
| | - Timo Leppänen
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| | - Philip I. Terrill
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
| | - Sigridur Sigurdardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Erna Sif Arnardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
- Internal Medicine Services, Landspitali–The National University Hospital of Iceland, Reykjavik, Iceland
| | - Kristín A. Ólafsdóttir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Marta Serwatko
- Department of Clinical Engineering, Landspitali University Hospital, Reykjavik, Iceland
| | - Sigurveig Þ. Sigurðardóttir
- Department of Immunology, Landspitali University Hospital, Reykjavik, Iceland
- Faculty of Medicine, University of Iceland, Reykjavik, Iceland
| | - Michael Clausen
- Department of Allergy, Landspitali University Hospital, Reykjavik, Iceland
- Children's Hospital Reykjavik, Reykjavik, Iceland
| | - Juha Töyräs
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Science Service Center, Kuopio University Hospital, Kuopio, Finland
| | - Henri Korkalainen
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| |
Collapse
|
33
|
Sharma M, Kumar K, Kumar P, Tan RS, Rajendra Acharya U. Pulse oximetry SpO2signal for automated identification of sleep apnea: a review and future trends. Physiol Meas 2022; 43. [PMID: 36215979 DOI: 10.1088/1361-6579/ac98f0] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 10/10/2022] [Indexed: 02/07/2023]
Abstract
Sleep apnea (SA) is characterized by intermittent episodes of apnea or hypopnea paused or reduced breathing, respectively each lasting at least ten seconds that occur during sleep. SA has an estimated global prevalence of 200 million and is associated with medical comorbidity, and sufferers are also more likely to sustain traffic- and work-related injury due to daytime somnolence. SA is amenable to treatment if detected early. Polysomnography (PSG) involving multi-channel signal acquisition is the reference standard for diagnosing SA but is onerous and costly. For home-based detection of SA, single-channelSpO2signal acquisition using portable pulse oximeters is feasible. Machine (ML) and deep learning (DL) models have been developed for automated classification of SA versus no SA usingSpO2signals alone. In this work, we review studies published between 2012 and 2022 on the use of ML and DL forSpO2signal-based diagnosis of SA. A literature search based on PRISMA recommendations yielded 297 publications, of which 31 were selected after considering the inclusion and exclusion criteria. There were 20 ML and 11 DL models; their methods, differences, results, merits, and limitations were discussed. Many studies reported encouraging performance, which indicates the utility ofSpO2signals in wearable devices for home-based SA detection.
Collapse
Affiliation(s)
- Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Kamlesh Kumar
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Prince Kumar
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Ru-San Tan
- Department of Cardiology, National Heart Centre Singapore, Singapore 169609, Singapore
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 639798, Singapore.,Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan.,Department of Biomedical Engineering, School of Science and Technology, Singapore 639798, Singapore
| |
Collapse
|
34
|
Arslan RS, Ulutas H, Köksal AS, Bakir M, Çiftçi B. Sensitive deep learning application on sleep stage scoring by using all PSG data. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-08037-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
35
|
Alvarez-Estevez D, Rijsman RM. Computer-assisted analysis of polysomnographic recordings improves inter-scorer associated agreement and scoring times. PLoS One 2022; 17:e0275530. [PMID: 36174095 PMCID: PMC9522290 DOI: 10.1371/journal.pone.0275530] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Accepted: 09/19/2022] [Indexed: 11/18/2022] Open
Abstract
Study objectives To investigate inter-scorer agreement and scoring time differences associated with visual and computer-assisted analysis of polysomnographic (PSG) recordings. Methods A group of 12 expert scorers reviewed 5 PSGs that were independently selected in the context of each of the following tasks: (i) sleep staging, (ii) scoring of leg movements, (iii) detection of respiratory (apneic-related) events, and (iv) of electroencephalographic (EEG) arousals. All scorers independently reviewed the same recordings, hence resulting in 20 scoring exercises per scorer from an equal amount of different subjects. The procedure was repeated, separately, using the classical visual manual approach and a computer-assisted (semi-automatic) procedure. Resulting inter-scorer agreement and scoring times were examined and compared among the two methods. Results Computer-assisted sleep scoring showed a consistent and statistically relevant effect toward less time required for the completion of each of the PSG scoring tasks. Gain factors ranged from 1.26 (EEG arousals) to 2.41 (leg movements). Inter-scorer kappa agreement was also consistently increased with the use of supervised semi-automatic scoring. Specifically, agreement increased from Κ = 0.76 to K = 0.80 (sleep stages), Κ = 0.72 to K = 0.91 (leg movements), Κ = 0.55 to K = 0.66 (respiratory events), and Κ = 0.58 to Κ = 0.65 (EEG arousals). Inter-scorer agreement on the examined set of diagnostic indices did also show a trend toward higher Interclass Correlation Coefficient scores when using the semi-automatic scoring approach. Conclusions Computer-assisted analysis can improve inter-scorer agreement and scoring times associated with the review of PSG studies resulting in higher efficiency and overall quality in the diagnosis sleep disorders.
Collapse
Affiliation(s)
- Diego Alvarez-Estevez
- Center for Information and Communications Technology Research (CITIC), Universidade da Coruña, A Coruña, Spain
- * E-mail:
| | - Roselyne M. Rijsman
- Sleep Center and Clinical Neurophysiology Department, Haaglanden Medisch Centrum, The Hague, The Netherlands
| |
Collapse
|
36
|
Waters SH, Clifford GD. Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging. Biomed Eng Online 2022; 21:66. [PMID: 36096868 PMCID: PMC9465946 DOI: 10.1186/s12938-022-01033-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Accepted: 08/18/2022] [Indexed: 11/10/2022] Open
Abstract
Background Obtaining medical data using wearable sensors is a potential replacement for in-hospital monitoring, but the lack of data for such sensors poses a challenge for development. One solution is using in-hospital recordings to boost performance via transfer learning. While there are many possible transfer learning algorithms, few have been tested in the domain of EEG-based sleep staging. Furthermore, there are few ways for determining which transfer learning method will work best besides exhaustive testing. Measures of transferability do exist, but are typically used for selection of pre-trained models rather than algorithms and few have been tested on medical signals. We tested several supervised transfer learning algorithms on a sleep staging task using a single channel of EEG (AF7-Fpz) captured from an in-home commercial system. Results Two neural networks—one bespoke and another state-of-art open-source architecture—were pre-trained on one of six source datasets comprising 11,561 subjects undergoing clinical polysomnograms (PSGs), then re-trained on a target dataset of 75 full-night recordings from 24 subjects. Several transferability measures were then tested to determine which is most effective for assessing performance on unseen target data. Performance on the target dataset was improved using transfer learning, with re-training the head layers being the most effective in the majority of cases (up to 63.9% of cases). Transferability measures generally provided significant correlations with accuracy (up to \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$r = -0.53$$\end{document}r=-0.53). Conclusion Re-training the head layers provided the largest performance boost. Transferability measures are useful indicators of transfer learning effectiveness.
Collapse
Affiliation(s)
- Samuel H Waters
- Department of Bioengineering, Georgia Institute of Technology, Atlanta, United States.
| | - Gari D Clifford
- Department of Biomedical Informatics, Emory University, Atlanta, United States
| |
Collapse
|
37
|
Phan H, Chen OY, Tran MC, Koch P, Mertins A, De Vos M. XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2022; 44:5903-5915. [PMID: 33788679 DOI: 10.1109/tpami.2021.3070057] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Automating sleep staging is vital to scale up sleep assessment and diagnosis to serve millions experiencing sleep deprivation and disorders and enable longitudinal sleep monitoring in home environments. Learning from raw polysomnography signals and their derived time-frequency image representations has been prevalent. However, learning from multi-view inputs (e.g., both the raw signals and the time-frequency images) for sleep staging is difficult and not well understood. This work proposes a sequence-to-sequence sleep staging model, XSleepNet,1 that is capable of learning a joint representation from both raw signals and time-frequency images. Since different views may generalize or overfit at different rates, the proposed network is trained such that the learning pace on each view is adapted based on their generalization/overfitting behavior. In simple terms, the learning on a particular view is speeded up when it is generalizing well and slowed down when it is overfitting. View-specific generalization/overfitting measures are computed on-the-fly during the training course and used to derive weights to blend the gradients from different views. As a result, the network is able to retain the representation power of different views in the joint features which represent the underlying distribution better than those learned by each individual view alone. Furthermore, the XSleepNet architecture is principally designed to gain robustness to the amount of training data and to increase the complementarity between the input views. Experimental results on five databases of different sizes show that XSleepNet consistently outperforms the single-view baselines and the multi-view baseline with a simple fusion strategy. Finally, XSleepNet also outperforms prior sleep staging methods and improves previous state-of-the-art results on the experimental databases.
Collapse
|
38
|
Affiliation(s)
- Thomas Penzel
- Corresponding author. Thomas Penzel, Interdisciplinary Sleep Medicine Center, Charite center for Pneumology CC12, Charite University Hospital, Chariteplatz 1, 10117 Berlin, Germany.
| |
Collapse
|
39
|
Jiménez-García J, García M, Gutiérrez-Tobal GC, Kheirandish-Gozal L, Vaquerizo-Villar F, Álvarez D, del Campo F, Gozal D, Hornero R. A 2D convolutional neural network to detect sleep apnea in children using airflow and oximetry. Comput Biol Med 2022; 147:105784. [DOI: 10.1016/j.compbiomed.2022.105784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 04/19/2022] [Accepted: 06/26/2022] [Indexed: 11/03/2022]
|
40
|
Rodrigues J, Ziebell P, Müller M, Hewig J. Standardizing continuous data classifications in a virtual T-maze using two-layer feedforward networks. Sci Rep 2022; 12:12879. [PMID: 35896573 PMCID: PMC9329455 DOI: 10.1038/s41598-022-17013-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Accepted: 07/19/2022] [Indexed: 11/09/2022] Open
Abstract
There continues to be difficulties when it comes to replication of studies in the field of Psychology. In part, this may be caused by insufficiently standardized analysis methods that may be subject to state dependent variations in performance. In this work, we show how to easily adapt the two-layer feedforward neural network architecture provided by Huang1 to a behavioral classification problem as well as a physiological classification problem which would not be solvable in a standardized way using classical regression or "simple rule" approaches. In addition, we provide an example for a new research paradigm along with this standardized analysis method. This paradigm as well as the analysis method can be adjusted to any necessary modification or applied to other paradigms or research questions. Hence, we wanted to show that two-layer feedforward neural networks can be used to increase standardization as well as replicability and illustrate this with examples based on a virtual T-maze paradigm2-5 including free virtual movement via joystick and advanced physiological data signal processing.
Collapse
Affiliation(s)
| | | | - Mathias Müller
- Julius-Maximilians-Universität Würzburg, Würzburg, Germany
| | - Johannes Hewig
- Julius-Maximilians-Universität Würzburg, Würzburg, Germany
| |
Collapse
|
41
|
Arslan RS, Ulutaş H, Köksal AS, Bakır M, Çiftçi B. Automated sleep scoring system using multi-channel data and machine learning. Comput Biol Med 2022; 146:105653. [DOI: 10.1016/j.compbiomed.2022.105653] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/06/2022] [Accepted: 05/18/2022] [Indexed: 11/03/2022]
|
42
|
Zhu L, Yang Z, Odani K, Shi G, Kan Y, Chen Z, Zhang R. Adaptive Spike-Like Representation of EEG Signals for Sleep Stages Scoring. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:4453-4456. [PMID: 36086600 DOI: 10.1109/embc48229.2022.9871250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Recently there has seen promising results on auto-matic stage scoring by extracting spatio-temporal features from electroencephalogram (EEG). Such methods entail laborious manual feature engineering and domain knowledge. In this study, we propose an adaptive scheme to probabilistically encode, filter and accumulate the input signals and weight the resultant features by the half-Gaussian probabilities of signal intensities. The adaptive representations are subsequently fed into a transformer model to automatically mine the relevance between features and corresponding stages. Extensive exper-iments on the largest public dataset against state-of-the-art methods validate the effectiveness of our proposed method and reveal promising future directions.
Collapse
|
43
|
An Automated Wavelet-Based Sleep Scoring Model Using EEG, EMG, and EOG Signals with More Than 8000 Subjects. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19127176. [PMID: 35742426 PMCID: PMC9223057 DOI: 10.3390/ijerph19127176] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 05/27/2022] [Accepted: 06/07/2022] [Indexed: 01/16/2023]
Abstract
Human life necessitates high-quality sleep. However, humans suffer from a lower quality of life because of sleep disorders. The identification of sleep stages is necessary to predict the quality of sleep. Manual sleep-stage scoring is frequently conducted through sleep experts’ visually evaluations of a patient’s neurophysiological data, gathered in sleep laboratories. Manually scoring sleep is a tough, time-intensive, tiresome, and highly subjective activity. Hence, the need of creating automatic sleep-stage classification has risen due to the limitations imposed by manual sleep-stage scoring methods. In this study, a novel machine learning model is developed using dual-channel unipolar electroencephalogram (EEG), chin electromyogram (EMG), and dual-channel electrooculgram (EOG) signals. Using an optimum orthogonal filter bank, sub-bands are obtained by decomposing 30 s epochs of signals. Tsallis entropies are then calculated from the coefficients of these sub-bands. Then, these features are fed an ensemble bagged tree (EBT) classifier for automated sleep classification. We developed our automated sleep classification model using the Sleep Heart Health Study (SHHS) database, which contains two parts, SHHS-1 and SHHS-2, containing more than 8455 subjects with more than 75,000 h of recordings. The proposed model separated three classes if sleep: rapid eye movement (REM), non-REM, and wake, with a classification accuracy of 90.70% and 91.80% using the SHHS-1 and SHHS-2 datasets, respectively. For the five-class problem, the model produces a classification accuracy of 84.3% and 86.3%, corresponding to the SHHS-1 and SHHS-2 databases, respectively, to classify wake, N1, N2, N3, and REM sleep stages. The model acquired Cohen’s kappa (κ) coefficients as 0.838 with SHHS-1 and 0.86 with SHHS-2 for the three-class classification problem. Similarly, the model achieved Cohen’s κ of 0.7746 for SHHS-1 and 0.8007 for SHHS-2 in five-class classification tasks. The model proposed in this study has achieved better performance than the best existing methods. Moreover, the model that has been proposed has been developed to classify sleep stages for both good sleepers as well as patients suffering from sleep disorders. Thus, the proposed wavelet Tsallis entropy-based model is robust and accurate and may help clinicians to comprehend and interpret sleep stages efficiently.
Collapse
|
44
|
Validation Study on Automated Sleep Stage Scoring Using a Deep Learning Algorithm. MEDICINA (KAUNAS, LITHUANIA) 2022; 58:medicina58060779. [PMID: 35744042 PMCID: PMC9228793 DOI: 10.3390/medicina58060779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Revised: 06/06/2022] [Accepted: 06/07/2022] [Indexed: 11/16/2022]
Abstract
Background and Objectives: Polysomnography is manually scored by sleep experts. However, manual scoring is a time-consuming and labor-intensive task. The goal of this study was to verify the accuracy of automated sleep-stage scoring based on a deep learning algorithm compared to manual sleep-stage scoring. Materials and Methods: A total of 602 polysomnography datasets from subjects (Male:Female = 397:205) aged 19 to 65 years (mean age, 43.8, standard deviation = 12.2) were included in the study. The performance of the proposed model was evaluated based on kappa value and bootstrapped point-estimate of median percent agreement with a 95% bootstrap confidence interval and R = 1000. The proposed model was trained using 482 datasets and validated using 48 datasets. For testing, 72 datasets were selected randomly. Results: The proposed model exhibited good concordance rates with manual scoring for stages W (94%), N1 (83.9%), N2 (89%), N3 (92%), and R (93%). The average kappa value was 0.84. For the bootstrap method, high overall agreement between the automated deep learning algorithm and manual scoring was observed in stages W (98%), N1 (94%), N2 (92%), N3 (99%), and R (98%) and total (96%). Conclusions: Automated sleep-stage scoring using the proposed model may be a reliable method for sleep-stage classification.
Collapse
|
45
|
Hanidziar D, Westover MB. Monitoring of sedation in mechanically ventilated patients using remote technology. Curr Opin Crit Care 2022; 28:360-366. [PMID: 35653256 PMCID: PMC9434805 DOI: 10.1097/mcc.0000000000000940] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
PURPOSE OF REVIEW Two years of coronavirus disease 2019 (COVID-19) pandemic highlighted that excessive sedation in the ICU leading to coma and other adverse outcomes remains pervasive. There is a need to improve monitoring and management of sedation in mechanically ventilated patients. Remote technologies that are based on automated analysis of electroencephalogram (EEG) could enhance standard care and alert clinicians real-time when severe EEG suppression or other abnormal brain states are detected. RECENT FINDINGS High rates of drug-induced coma as well as delirium were found in several large cohorts of mechanically ventilated patients with COVID-19 pneumonia. In patients with acute respiratory distress syndrome, high doses of sedatives comparable to general anesthesia have been commonly administered without defined EEG endpoints. Continuous limited-channel EEG can reveal pathologic brain states such as burst suppression, that cannot be diagnosed by neurological examination alone. Recent studies documented that machine learning-based analysis of continuous EEG signal is feasible and that this approach can identify burst suppression as well as delirium with high specificity. SUMMARY Preventing oversedation in the ICU remains a challenge. Continuous monitoring of EEG activity, automated EEG analysis, and generation of alerts to clinicians may reduce drug-induced coma and potentially improve patient outcomes.
Collapse
Affiliation(s)
- Dusan Hanidziar
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA
| | | |
Collapse
|
46
|
A meta-learning algorithm for respiratory flow prediction from FBG-based wearables in unrestrained conditions. Artif Intell Med 2022; 130:102328. [DOI: 10.1016/j.artmed.2022.102328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Revised: 05/23/2022] [Accepted: 05/25/2022] [Indexed: 11/23/2022]
|
47
|
Sharma M, Darji J, Thakrar M, Acharya UR. Automated identification of sleep disorders using wavelet-based features extracted from electrooculogram and electromyogram signals. Comput Biol Med 2022; 143:105224. [PMID: 35091364 DOI: 10.1016/j.compbiomed.2022.105224] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 12/20/2021] [Accepted: 01/04/2022] [Indexed: 01/20/2023]
Abstract
Sleep is imperative for a healthy life as it rejuvenates memory, cognitive performance, cell repair and eliminates waste from the muscles. Sleep-related disorders such as insomnia, narcolepsy, sleep-disordered breathing (SDB), periodic leg movement (PLM), and bruxism lead to hormonal imbalance, slower reaction time, memory problems, depression, and headaches. This adversity of sleep disorder gained the attention of many sleep researchers. To examine the reasons for sleep disorders, it is imperative to monitor and analyze the sleep of the affected patients. The conventional method of monitoring sleep and identifying the sleep disorders using polysomnographic (PSG) recording is a complicated and cumbersome task in which multiple physiological signals with multiple modalities are recorded for a long (overnight) duration. The PSG recordings are carried out in sophisticated sleep laboratories and cannot be considered suitable for real-time sleep monitoring. Thus, a simple and patient-convenient system is highly desirable to monitor and analyze the quality of sleep. We proposed an automatic detection of sleep disorders using single modal electrooculogram (EOG) and electromyogram (EMG) signals. We have used a new maximally flat multiplier-less biorthogonal filter bank for obtaining discrete wavelet transform of the signals. We computed Hjorth parameters (HOP) such as activity, mobility, and complexity from the wavelet sub-bands. Highly discriminative HOP features are fed to different machine learning classifiers to develop the model. Our results show that the developed system can classify insomnia, narcolepsy, NFLE, PLM, and REM behaviour disorder (RBD) against normal healthy subjects with an accuracy of 99.7%, 97.6%, 97.5%, 97.5%, and 98.3%, respectively using combined features from EOG and EMG signal. The proposed model has yielded an accuracy of 94.3% in classifying six classes using an ensemble bagged trees classifier (EBTC) with a 10-fold cross-validation technique. Hence, EOG and EMG-based proposed methods can be deployed in a portable home-based environment to identify the type of sleep disorders automatically.
Collapse
Affiliation(s)
- Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Jay Darji
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Madhav Thakrar
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - U Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taiwan; School of Science and Technology, Singapore University of Social Sciences, Singapore.
| |
Collapse
|
48
|
Phan H, Mikkelsen K. Automatic sleep staging of EEG signals: recent development, challenges, and future directions. Physiol Meas 2022; 43. [PMID: 35320788 DOI: 10.1088/1361-6579/ac6049] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 03/23/2022] [Indexed: 11/11/2022]
Abstract
Modern deep learning holds a great potential to transform clinical practice on human sleep. Teaching a machine to carry out routine tasks would be a tremendous reduction in workload for clinicians. Sleep staging, a fundamental step in sleep practice, is a suitable task for this and will be the focus in this article. Recently, automatic sleep staging systems have been trained to mimic manual scoring, leading to similar performance to human sleep experts, at least on scoring of healthy subjects. Despite tremendous progress, we have not seen automatic sleep scoring adopted widely in clinical environments. This review aims to give a shared view of the authors on the most recent state-of-the-art development in automatic sleep staging, the challenges that still need to be addressed, and the future directions for automatic sleep scoring to achieve clinical value.
Collapse
Affiliation(s)
- Huy Phan
- School of Electronic Engineering and Computer Science, Queen Mary University of London, Mile End Rd, London, E1 4NS, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Kaare Mikkelsen
- Department of Electrical and Computer Engineering, Aarhus Universitet, Finlandsgade 22, Aarhus, 8000, DENMARK
| |
Collapse
|
49
|
Automated detection of obstructive sleep apnea in more than 8000 subjects using frequency optimized orthogonal wavelet filter bank with respiratory and oximetry signals. Comput Biol Med 2022; 144:105364. [PMID: 35299046 DOI: 10.1016/j.compbiomed.2022.105364] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 02/27/2022] [Accepted: 02/27/2022] [Indexed: 12/12/2022]
Abstract
Obstructive sleep apnea (OSA) is a common respiratory disorder marked by interruption of the respiratory tract and difficulty in breathing. The risk of serious health damage can be reduced if OSA is diagnosed and treated at an early stage. OSA is primarily diagnosed using polysomnography (PSG) monitoring performed for overnight sleep; furthermore, capturing PSG signals during the night is expensive, time-consuming, complex and highly inconvenient to patients. Hence, we are proposing to detect OSA automatically using respiratory and oximetry signals. The aim of this study is to develop a simple and computationally efficient wavelet-based automated system based on these signals to detect OSA in elderly subjects. In this study, we proposed an accurate, reliable, and less complex OSA automated detection system by using pulse oximetry (SpO2) and respiratory signals including thoracic (ThorRes) movement, abdominal (AbdoRes) movement, and airflow (AF). These signals are collected from the Sleep Heart Health Study (SHHS) database from the National Sleep Research Resource (NSRR), which is one of the largest repositories of publicly available sleep databases. The database comprises of two groups SHHS-1 and SHHS-2, which involves 5,793 and 2,651 subjects, respectively with an average age of ≥60 years. The 30-s epochs of the signals are decomposed into sub-bands using frequency optimized orthogonal wavelet filter bank. Tsallis entropies are extracted from the sub-band coefficients of wavelet filter bank. A total 4,415,229 epochs of respiratory and oximetry signals are used to develop the model. The proposed model is developed using GentleBoost and Random under-sampling Boosting (RUSBoosted Tree) algorithms with 10-fold cross-validation technique. Our developed model has obtained the highest classification accuracy of 89.39% and 84.64% for the imbalanced and balanced datasets, respectively using 10-fold cross-validation technique. Using the 20% hold-out validation, the model yielded an accuracy of 88.26% and 84.31% for the imbalanced and balanced datasets, respectively. Hence, the respiratory and SpO2 signals-based model can be used for automated OSA detection. The results obtained from the proposed model are better than the state-of-the-art models and can be used in-home for screening the OSA.
Collapse
|
50
|
Phan H, Mikkelsen K, Chen OY, Koch P, Mertins A, De Vos M. SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantification. IEEE Trans Biomed Eng 2022; 69:2456-2467. [PMID: 35100107 DOI: 10.1109/tbme.2022.3147187] [Citation(s) in RCA: 30] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
BACKGROUND Black-box skepticism is one of the main hindrances impeding deep-learning-based automatic sleep scoring from being used in clinical environments. METHODS Towards interpretability, this work proposes a sequence-to-sequence sleep staging model, namely SleepTransformer. It is based on the transformer backbone and offers interpretability of the models decisions at both the epoch and sequence level. We further propose a simple yet efficient method to quantify uncertainty in the models decisions. The method, which is based on entropy, can serve as a metric for deferring low-confidence epochs to a human expert for further inspection. RESULTS Making sense of the transformers self-attention scores for interpretability, at the epoch level, the attention scores are encoded as a heat map to highlight sleep-relevant features captured from the input EEG signal. At the sequence level, the attention scores are visualized as the influence of different neighboring epochs in an input sequence (i.e. the context) to recognition of a target epoch, mimicking the way manual scoring is done by human experts. CONCLUSION Additionally, we demonstrate that SleepTransformer performs on par with existing methods on two databases of different sizes. SIGNIFICANCE Equipped with interpretability and the ability of uncertainty quantification, SleepTransformer holds promise for being integrated into clinical settings.
Collapse
|