51
|
章 浩, 许 哲, 苑 成, 季 曹, 刘 颖. [Automatic sleep staging model based on single channel electroencephalogram signal]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2023; 40:458-464. [PMID: 37380384 PMCID: PMC10307605 DOI: 10.7507/1001-5515.202210072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 04/09/2023] [Indexed: 06/30/2023]
Abstract
Sleep staging is the basis for solving sleep problems. There's an upper limit for the classification accuracy of sleep staging models based on single-channel electroencephalogram (EEG) data and features. To address this problem, this paper proposed an automatic sleep staging model that mixes deep convolutional neural network (DCNN) and bi-directional long short-term memory network (BiLSTM). The model used DCNN to automatically learn the time-frequency domain features of EEG signals, and used BiLSTM to extract the temporal features between the data, fully exploiting the feature information contained in the data to improve the accuracy of automatic sleep staging. At the same time, noise reduction techniques and adaptive synthetic sampling were used to reduce the impact of signal noise and unbalanced data sets on model performance. In this paper, experiments were conducted using the Sleep-European Data Format Database Expanded and the Shanghai Mental Health Center Sleep Database, and achieved an overall accuracy rate of 86.9% and 88.9% respectively. When compared with the basic network model, all the experimental results outperformed the basic network, further demonstrating the validity of this paper's model, which can provide a reference for the construction of a home sleep monitoring system based on single-channel EEG signals.
Collapse
Affiliation(s)
- 浩伟 章
- 上海理工大学 健康科学与工程学院(上海 200093)School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, P. R. China
| | - 哲 许
- 上海理工大学 健康科学与工程学院(上海 200093)School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, P. R. China
| | - 成梅 苑
- 上海理工大学 健康科学与工程学院(上海 200093)School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, P. R. China
| | - 曹珺 季
- 上海理工大学 健康科学与工程学院(上海 200093)School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, P. R. China
| | - 颖 刘
- 上海理工大学 健康科学与工程学院(上海 200093)School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, P. R. China
| |
Collapse
|
52
|
Toma TI, Choi S. An End-to-End Multi-Channel Convolutional Bi-LSTM Network for Automatic Sleep Stage Detection. SENSORS (BASEL, SWITZERLAND) 2023; 23:4950. [PMID: 37430865 DOI: 10.3390/s23104950] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 05/17/2023] [Accepted: 05/19/2023] [Indexed: 07/12/2023]
Abstract
Sleep stage detection from polysomnography (PSG) recordings is a widely used method of monitoring sleep quality. Despite significant progress in the development of machine-learning (ML)-based and deep-learning (DL)-based automatic sleep stage detection schemes focusing on single-channel PSG data, such as single-channel electroencephalogram (EEG), electrooculogram (EOG), and electromyogram (EMG), developing a standard model is still an active subject of research. Often, the use of a single source of information suffers from data inefficiency and data-skewed problems. Instead, a multi-channel input-based classifier can mitigate the aforementioned challenges and achieve better performance. However, it requires extensive computational resources to train the model, and, hence, a tradeoff between performance and computational resources cannot be ignored. In this article, we aim to introduce a multi-channel, more specifically a four-channel, convolutional bidirectional long short-term memory (Bi-LSTM) network that can effectively exploit spatiotemporal features of data collected from multiple channels of the PSG recording (e.g., EEG Fpz-Cz, EEG Pz-Oz, EOG, and EMG) for automatic sleep stage detection. First, a dual-channel convolutional Bi-LSTM network module has been designed and pre-trained utilizing data from every two distinct channels of the PSG recording. Subsequently, we have leveraged the concept of transfer learning circuitously and have fused two dual-channel convolutional Bi-LSTM network modules to detect sleep stages. In the dual-channel convolutional Bi-LSTM module, a two-layer convolutional neural network has been utilized to extract spatial features from two channels of the PSG recordings. These extracted spatial features are subsequently coupled and given as input at every level of the Bi-LSTM network to extract and learn rich temporal correlated features. Both Sleep EDF-20 and Sleep EDF-78 (expanded version of Sleep EDF-20) datasets are used in this study to evaluate the result. The model that includes an EEG Fpz-Cz + EOG module and an EEG Fpz-Cz + EMG module can classify sleep stage with the highest value of accuracy (ACC), Kappa (Kp), and F1 score (e.g., 91.44%, 0.89, and 88.69%, respectively) on the Sleep EDF-20 dataset. On the other hand, the model consisting of an EEG Fpz-Cz + EMG module and an EEG Pz-Oz + EOG module shows the best performance (e.g., the value of ACC, Kp, and F1 score are 90.21%, 0.86, and 87.02%, respectively) compared to other combinations for the Sleep EDF-78 dataset. In addition, a comparative study with respect to other existing literature has been provided and discussed in order to exhibit the efficacy of our proposed model.
Collapse
Affiliation(s)
- Tabassum Islam Toma
- School of Electrical Engineering, Kookmin University, Seoul 02707, Republic of Korea
| | - Sunwoong Choi
- School of Electrical Engineering, Kookmin University, Seoul 02707, Republic of Korea
| |
Collapse
|
53
|
Wenjian W, Qian X, Jun X, Zhikun H. DynamicSleepNet: a multi-exit neural network with adaptive inference time for sleep stage classification. Front Physiol 2023; 14:1171467. [PMID: 37250117 PMCID: PMC10213983 DOI: 10.3389/fphys.2023.1171467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Accepted: 04/26/2023] [Indexed: 05/31/2023] Open
Abstract
Sleep is an essential human physiological behavior, and the quality of sleep directly affects a person's physical and mental state. In clinical medicine, sleep stage is an important basis for doctors to diagnose and treat sleep disorders. The traditional method of classifying sleep stages requires sleep experts to classify them manually, and the whole process is time-consuming and laborious. In recent years, with the help of deep learning, automatic sleep stage classification has made great progress, especially networks using multi-modal electrophysiological signals, which have greatly improved in terms of accuracy. However, we found that the existing multimodal networks have a large number of redundant calculations in the process of using multiple electrophysiological signals, and the networks become heavier due to the use of multiple signals, and difficult to be used in small devices. To solve these two problems, this paper proposes DynamicSleepNet, a network that can maximize the use of multiple electrophysiological signals and can dynamically adjust between accuracy and efficiency. DynamicSleepNet consists of three effective feature extraction modules (EFEMs) and three classifier modules, each EFEM is connected to a classifier. Each EFEM is able to extract signal features while making the effective features more prominent and the invalid features are suppressed. The samples processed by the EFEM are given to the corresponding classifier for classification, and if the classifier considers the uncertainty of the sample to be below the threshold we set, the sample can be output early without going through the whole network. We validated our model on four datasets. The results show that the highest accuracy of our model outperforms all baselines. With accuracy close to baselines, our model is faster than the baselines by a factor of several to several tens, and the number of parameters of the model is lower or close. The implementation code is available at: https://github.com/Quinella7291/A-Multi-exit-Neural-Network-with-Adaptive-Inference-Time-for-Sleep-Stage-Classification/.
Collapse
Affiliation(s)
- Wang Wenjian
- School of Information Science, Yunnan University, Kunming, China
| | | | | | | |
Collapse
|
54
|
Li J, Wang F, Huang H, Qi F, Pan J. A novel semi-supervised meta learning method for subject-transfer brain-computer interface. Neural Netw 2023; 163:195-204. [PMID: 37062178 DOI: 10.1016/j.neunet.2023.03.039] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Revised: 02/22/2023] [Accepted: 03/28/2023] [Indexed: 04/09/2023]
Abstract
The brain-computer interface (BCI) provides a direct communication pathway between the human brain and external devices. However, the models trained for existing subjects perform poorly on new subjects, which is termed the subject calibration problem. In this paper, we propose a semi-supervised meta learning (SSML) method for subject-transfer calibration. The proposed SSML learns a model-agnostic meta learner with existing subjects and then fine-tunes the meta learner in a semi-supervised learning manner, i.e. using a few labelled samples and many unlabelled samples of the target subject for calibration. It is significant for BCI applications in which labelled data are scarce or expensive while unlabelled data are readily available. Three different BCI paradigms are tested: event-related potential detection, emotion recognition and sleep staging. The SSML achieved classification accuracies of 0.95, 0.89 and 0.83 in the benchmark datasets of three paradigms. The runtime complexity of SSML grows linearly as the number of samples of target subject increases so that is possible to apply it in real-time systems. This study is the first attempt to apply semi-supervised model-agnostic meta learning methodology for subject calibration. The experimental results demonstrated the effectiveness and potential of the SSML method for subject-transfer BCI applications.
Collapse
Affiliation(s)
- Jingcong Li
- School of Software, South China Normal University, Guangzhou, China; Pazhou Lab, Guangzhou, China
| | - Fei Wang
- School of Software, South China Normal University, Guangzhou, China; Pazhou Lab, Guangzhou, China
| | - Haiyun Huang
- School of Software, South China Normal University, Guangzhou, China; Pazhou Lab, Guangzhou, China
| | - Feifei Qi
- School of Internet Finance and Information Engineering, Guangdong University of Finance, Guangzhou, China; Pazhou Lab, Guangzhou, China
| | - Jiahui Pan
- School of Software, South China Normal University, Guangzhou, China; Pazhou Lab, Guangzhou, China.
| |
Collapse
|
55
|
Cheng YH, Lech M, Wilkinson RH. Simultaneous Sleep Stage and Sleep Disorder Detection from Multimodal Sensors Using Deep Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:3468. [PMID: 37050528 PMCID: PMC10099216 DOI: 10.3390/s23073468] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 03/21/2023] [Accepted: 03/23/2023] [Indexed: 06/19/2023]
Abstract
Sleep scoring involves the inspection of multimodal recordings of sleep data to detect potential sleep disorders. Given that symptoms of sleep disorders may be correlated with specific sleep stages, the diagnosis is typically supported by the simultaneous identification of a sleep stage and a sleep disorder. This paper investigates the automatic recognition of sleep stages and disorders from multimodal sensory data (EEG, ECG, and EMG). We propose a new distributed multimodal and multilabel decision-making system (MML-DMS). It comprises several interconnected classifier modules, including deep convolutional neural networks (CNNs) and shallow perceptron neural networks (NNs). Each module works with a different data modality and data label. The flow of information between the MML-DMS modules provides the final identification of the sleep stage and sleep disorder. We show that the fused multilabel and multimodal method improves the diagnostic performance compared to single-label and single-modality approaches. We tested the proposed MML-DMS on the PhysioNet CAP Sleep Database, with VGG16 CNN structures, achieving an average classification accuracy of 94.34% and F1 score of 0.92 for sleep stage detection (six stages) and an average classification accuracy of 99.09% and F1 score of 0.99 for sleep disorder detection (eight disorders). A comparison with related studies indicates that the proposed approach significantly improves upon the existing state-of-the-art approaches.
Collapse
|
56
|
Huang X, Shirahama K, Irshad MT, Nisar MA, Piet A, Grzegorzek M. Sleep Stage Classification in Children Using Self-Attention and Gaussian Noise Data Augmentation. SENSORS (BASEL, SWITZERLAND) 2023; 23:3446. [PMID: 37050506 PMCID: PMC10098613 DOI: 10.3390/s23073446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 03/20/2023] [Accepted: 03/22/2023] [Indexed: 06/19/2023]
Abstract
The analysis of sleep stages for children plays an important role in early diagnosis and treatment. This paper introduces our sleep stage classification method addressing the following two challenges: the first is the data imbalance problem, i.e., the highly skewed class distribution with underrepresented minority classes. For this, a Gaussian Noise Data Augmentation (GNDA) algorithm was applied to polysomnography recordings to seek the balance of data sizes for different sleep stages. The second challenge is the difficulty in identifying a minority class of sleep stages, given their short sleep duration and similarities to other stages in terms of EEG characteristics. To overcome this, we developed a DeConvolution- and Self-Attention-based Model (DCSAM) which can inverse the feature map of a hidden layer to the input space to extract local features and extract the correlations between all possible pairs of features to distinguish sleep stages. The results on our dataset show that DCSAM based on GNDA obtains an accuracy of 90.26% and a macro F1-score of 86.51% which are higher than those of our previous method. We also tested DCSAM on a well-known public dataset-Sleep-EDFX-to prove whether it is applicable to sleep data from adults. It achieves a comparable performance to state-of-the-art methods, especially accuracies of 91.77%, 92.54%, 94.73%, and 95.30% for six-stage, five-stage, four-stage, and three-stage classification, respectively. These results imply that our DCSAM based on GNDA has a great potential to offer performance improvements in various medical domains by considering the data imbalance problems and correlations among features in time series data.
Collapse
Affiliation(s)
- Xinyu Huang
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Kimiaki Shirahama
- Department of Informatics, Kindai University, 3-4-1 Kowakae, Higashiosaka City 577-8502, Osaka, Japan
| | - Muhammad Tausif Irshad
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of IT, University of the Punjab, Lahore 54000, Pakistan
| | | | - Artur Piet
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Marcin Grzegorzek
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of Knowledge Engineering, University of Economics, Bogucicka 3, 40287 Katowice, Poland
| |
Collapse
|
57
|
Ellis CA, Sendi MSE, Zhang R, Carbajal DA, Wang MD, Miller RL, Calhoun VD. Novel methods for elucidating modality importance in multimodal electrophysiology classifiers. Front Neuroinform 2023; 17:1123376. [PMID: 37006636 PMCID: PMC10050434 DOI: 10.3389/fninf.2023.1123376] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Accepted: 03/01/2023] [Indexed: 03/17/2023] Open
Abstract
Introduction Multimodal classification is increasingly common in electrophysiology studies. Many studies use deep learning classifiers with raw time-series data, which makes explainability difficult, and has resulted in relatively few studies applying explainability methods. This is concerning because explainability is vital to the development and implementation of clinical classifiers. As such, new multimodal explainability methods are needed. Methods In this study, we train a convolutional neural network for automated sleep stage classification with electroencephalogram (EEG), electrooculogram, and electromyogram data. We then present a global explainability approach that is uniquely adapted for electrophysiology analysis and compare it to an existing approach. We present the first two local multimodal explainability approaches. We look for subject-level differences in the local explanations that are obscured by global methods and look for relationships between the explanations and clinical and demographic variables in a novel analysis. Results We find a high level of agreement between methods. We find that EEG is globally the most important modality for most sleep stages and that subject-level differences in importance arise in local explanations that are not captured in global explanations. We further show that sex, followed by medication and age, had significant effects upon the patterns learned by the classifier. Discussion Our novel methods enhance explainability for the growing field of multimodal electrophysiology classification, provide avenues for the advancement of personalized medicine, yield unique insights into the effects of demographic and clinical variables upon classifiers, and help pave the way for the implementation of multimodal electrophysiology clinical classifiers.
Collapse
Affiliation(s)
- Charles A. Ellis
- The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science, Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
| | - Mohammad S. E. Sendi
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science, Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
- McLean Hospital and Harvard Medical School, Boston, MA, United States
| | - Rongen Zhang
- Hankamer School of Business, Baylor University, Waco, TX, United States
| | - Darwin A. Carbajal
- The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - May D. Wang
- The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
| | - Robyn L. Miller
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science, Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
- Department of Computer Science, Georgia State University, Atlanta, GA, United States
| | - Vince D. Calhoun
- The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science, Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
- Department of Computer Science, Georgia State University, Atlanta, GA, United States
| |
Collapse
|
58
|
He Z, Tang M, Wang P, Du L, Chen X, Cheng G, Fang Z. Cross-scenario automatic sleep stage classification using transfer learning and single-channel EEG. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
59
|
Do not sleep on traditional machine learning. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
60
|
Sharma M, Makwana P, Chad RS, Acharya UR. A novel automated robust dual-channel EEG-based sleep scoring system using optimal half-band pair linear-phase biorthogonal wavelet filter bank. APPL INTELL 2023; 53:1-19. [PMID: 36777881 PMCID: PMC9906594 DOI: 10.1007/s10489-022-04432-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/21/2022] [Indexed: 02/11/2023]
Abstract
Nowadays, the hectic work life of people has led to sleep deprivation. This may further result in sleep-related disorders and adverse physiological conditions. Therefore, sleep study has become an active research area. Sleep scoring is crucial for detecting sleep-related disorders like sleep apnea, insomnia, narcolepsy, periodic leg movement (PLM), and restless leg syndrome (RLS). Sleep is conventionally monitored in a sleep laboratory using polysomnography (PSG) which is the recording of various physiological signals. The traditional sleep stage scoring (SSG) done by professional sleep scorers is a tedious, strenuous, and time-consuming process as it is manual. Hence, developing a machine-learning model for automatic SSG is essential. In this study, we propose an automated SSG approach based on the biorthogonal wavelet filter bank's (BWFB) novel least squares (LS) design. We have utilized a huge Wisconsin sleep cohort (WSC) database in this study. The proposed study is a pioneering work on automatic sleep stage classification using the WSC database, which includes good sleepers and patients suffering from various sleep-related disorders, including apnea, insomnia, hypertension, diabetes, and asthma. To investigate the generalization of the proposed system, we evaluated the proposed model with the following publicly available databases: cyclic alternating pattern (CAP), sleep EDF, ISRUC, MIT-BIH, and the sleep apnea database from St. Vincent's University. This study uses only two unipolar EEG channels, namely O1-M2 and C3-M2, for the scoring. The Hjorth parameters (HP) are extracted from the wavelet subbands (SBS) that are obtained from the optimal BWFB. To classify sleep stages, the HP features are fed to several supervised machine learning classifiers. 12 different datasets have been created to develop a robust model. A total of 12 classification tasks (CT) have been conducted employing various classification algorithms. Our developed model achieved the best accuracy of 83.2% and Cohen's Kappa of 0.7345 to reliably distinguish five sleep stages, using an ensemble bagged tree classifier with 10-fold cross-validation using WSC data. We also observed that our system is either better or competitive with existing state-of-art systems when we tested with the above-mentioned five databases other than WSC. This method yielded promising results using only two EEG channels using a huge WSC database. Our approach is simple and hence, the developed model can be installed in home-based clinical systems and wearable devices for sleep scoring.
Collapse
Affiliation(s)
- Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, 380026 India
| | - Paresh Makwana
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, 380026 India
| | - Rajesh Singh Chad
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, 380026 India
| | - U Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore, 599489 Singapore
- Department of Bioinformatics and Medical Engineering, Asia University, Taichung, 41354 Taiwan
- Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore, Singapore
| |
Collapse
|
61
|
Kong G, Li C, Peng H, Han Z, Qiao H. EEG-Based Sleep Stage Classification via Neural Architecture Search. IEEE Trans Neural Syst Rehabil Eng 2023; 31:1075-1085. [PMID: 37022068 DOI: 10.1109/tnsre.2023.3238764] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
With the improvement of quality of life, people are more and more concerned about the quality of sleep. The electroencephalogram (EEG)-based sleep stage classification is a good guide for sleep quality and sleep disorders. At this stage, most automatic staging neural networks are designed by human experts, and this process is time-consuming and laborious. In this paper, we propose a novel neural architecture search (NAS) framework based on bilevel optimization approximation for EEG-based sleep stage classification. The proposed NAS architecture mainly performs the architectural search through a bilevel optimization approximation, and the model is optimized by search space approximation and search space regularization with parameters shared among cells. Finally, we evaluated the performance of the model searched by NAS on the Sleep-EDF-20, Sleep-EDF-78 and SHHS datasets with an average accuracy of 82.7%, 80.0% and 81.9%, respectively. The experimental results show that the proposed NAS algorithm provides some reference for the subsequent automatic design of networks for sleep classification.
Collapse
|
62
|
Ullah W, Ahmad K, Ullah S, Tahir AA, Javed MF, Nazir A, Abbasi AM, Aziz M, Mohamed A. Analysis of the relationship among land surface temperature (LST), land use land cover (LULC), and normalized difference vegetation index (NDVI) with topographic elements in the lower Himalayan region. Heliyon 2023; 9:e13322. [PMID: 36825192 PMCID: PMC9942242 DOI: 10.1016/j.heliyon.2023.e13322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 01/24/2023] [Accepted: 01/26/2023] [Indexed: 02/05/2023] Open
Abstract
Land Surface Temperature (LST) affects exchange of energy between earth surface and atmosphere which is important for studying environmental changes. However, research on the relationship between LST, Land Use Land Cover (LULC), and Normalized Difference Vegetation Index (NDVI) with topographic elements in the lower Himalayan region has not been done. Therefore, the present study explored the relationship between LST and NDVI, and LULC types with topographic elements in the lower Himalayan region of Pakistan. The study area was divided into North-South, West-East, North-West to South-East and North-East to South-East directions using ArcMap 3D analysis. The current study used Landsat 8 (OLI/TIRS) data from May 2021 for LULC and LST analysis in the study area. The LST data was obtained from the thermal band of Landsat 8 (TIRS), while the LULC of the study areas was classified using the Maximum Likelihood Classification (MLC) method utilizing Landsat 8 (OLI) data. TIRS collects data for two narrow spectral bands (B10 and B11) with spectral wavelength of 10.6 μm-12.51 μm in the thermal region formerly covered by one wide spectral band (B6) on Landsat 4-7. With 12-bit data products, TIRS data is available in radiometric, geometric, and terrain-corrected file format. The effect of elevation on LST was assessed using LST and elevation data obtained from the USGS website. The LST across LULC types with sunny and shady slopes was analyzed to assess the influence of slope directions. The relationship of LST with elevation and NDVI was examined using correlation analysis. The results indicated that LST decreased from North-South and South-East, while increasing from North-East and South-West directions. The correlation coefficient between LST and elevation was negative, with an R-value of -0.51. The NDVI findings with elevation showed that NDVI increases with an increase in elevation. Zonal analysis of LST for different LULC types showed that built-up and bare soil had the highest mean LST, which was 35.76 °C and 28.08 °C, respectively, followed by agriculture, vegetation, and water bodies. The mean LST difference between sunny and shady slopes was 1.02 °C. The correlation between NDVI and LST was negative for all LULC types except the water body. This study findings can be used to ensure sustainable urban development and minimize urban heat island effects by providing effective guidelines for urban planners, policymakers, and respective authorities in the Lower Himalayan region. The current thermal remote sensing findings can be used to model energy fluxes and surface processes in the study area.
Collapse
Affiliation(s)
- Waheed Ullah
- Department of Environmental Sciences, COMSATS University Islamabad, Abbottabad Campus, 22060, Pakistan
| | - Khalid Ahmad
- Department of Environmental Sciences, COMSATS University Islamabad, Abbottabad Campus, 22060, Pakistan,Corresponding author.
| | - Siddique Ullah
- Department of Civil Engineering, COMSATS University Islamabad, Abbottabad Campus, Tobe Camp University Road Abbottabad 22060, Pakistan
| | - Adnan Ahmad Tahir
- Department of Environmental Sciences, COMSATS University Islamabad, Abbottabad Campus, 22060, Pakistan
| | - Muhammad Faisal Javed
- Department of Civil Engineering, COMSATS University Islamabad, Abbottabad Campus, Tobe Camp University Road Abbottabad 22060, Pakistan
| | - Abdul Nazir
- Department of Environmental Sciences, COMSATS University Islamabad, Abbottabad Campus, 22060, Pakistan
| | - Arshad Mehmood Abbasi
- Department of Environmental Sciences, COMSATS University Islamabad, Abbottabad Campus, 22060, Pakistan
| | - Mubashir Aziz
- Department of Civil and Environmental Engineering, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia,Interdisciplinary Research Center for Construction and Building Materials, King Fahd, University of Petroleum and Minerals, Dhahran 31261, Saudi Arabia
| | - Abdullah Mohamed
- Research Centre, Future University in Egypt, New Cairo 11835, Egypt
| |
Collapse
|
63
|
Sun L, Wu J, Xu Y, Zhang Y. A federated learning and blockchain framework for physiological signal classification based on continual learning. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.02.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2023]
|
64
|
Zan H, Yildiz A. Local Pattern Transformation-Based convolutional neural network for sleep stage scoring. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
65
|
Efe E, Ozsen S. CoSleepNet: Automated sleep staging using a hybrid CNN-LSTM network on imbalanced EEG-EOG datasets. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
66
|
Lu C, Pathak S, Englebienne G, Seifert C. Channel Contribution in Deep Learning Based Automatic Sleep Scoring-How Many Channels Do We Need? IEEE Trans Neural Syst Rehabil Eng 2023; 31:494-505. [PMID: 37015588 DOI: 10.1109/tnsre.2022.3227040] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Machine learning based sleep scoring methods aim to automate the process of annotating polysomnograms with sleep stages. Although sleep signals of multiple modalities and channels should contain more information according to sleep guidelines, most multi-channel multi-modal models in the literature showed only a little performance improvement compared to single-channel EEG models and sometimes even failed to outperform them. In this paper, we investigate whether the high performance of single-channel EEG models can be attributed to specific model features in their deep learning architectures and to which extent multi-channel multi-modal models take the information from different channels of modalities into account. First, we transfer the model features from single-channel EEG models, such as combinations of small and large filters in CNNs, to multi-channel multi-modal models and measure their impacts. Second, we employ two explainability methods, the layer-wise relevance propagation as post-hoc and the embedded channel attention network as intrinsic interpretability methods, to measure the contribution of different channels on predictive performance. We find that i) single-channel model features can improve the performance of multi-channel multi-modal models and ii) multi-channel multi-modal models focus on one important channel per modality and use the remaining channels to complement the information of the focused channels. Our results suggest that more advanced methods for aggregating channel information using complementary information from other channels may improve sleep scoring performance for multi-channel multi-modal models.
Collapse
|
67
|
A Siamese Network-Based Method for Improving the Performance of Sleep Staging with Single-Channel EEG. Biomedicines 2023; 11:biomedicines11020327. [PMID: 36830864 PMCID: PMC9953225 DOI: 10.3390/biomedicines11020327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 01/18/2023] [Accepted: 01/19/2023] [Indexed: 01/26/2023] Open
Abstract
Sleep staging is of critical significance to the diagnosis of sleep disorders, and the electroencephalogram (EEG), which is used for monitoring brain activity, is commonly employed in sleep staging. In this paper, we propose a novel method for improving the performance of sleep staging models based on Siamese networks, based on single-channel EEG. Our proposed method consists of a Siamese network architecture and a redesigned loss with distance metrics. Two encoders are used in the Siamese network to generate latent features of the EEG epochs, and the contrastive loss, which is also a distance metric, is used to compare the similarity or differences between EEG epochs from the same or different sleep stages. We evaluated our method on single-channel EEGs from different channels (Fpz-Cz and F4-EOG (left)) from two public datasets SleepEDF and MASS-SS3 and achieved the overall accuracies MF1 and Cohen's kappa coefficient of 85.2%, 78.3% and 0.79 on SleepEDF and 87.2%, 82.1% and 0.81 on MASS-SS3. The results show that our method can significantly improve the performance of sleep staging models and outperform the state-of-the-art sleep staging methods. The performance of our method also confirms that the features captured by Siamese networks and distance metrics are useful for sleep staging.
Collapse
|
68
|
Fang Y, Xia Y, Chen P, Zhang J, Zhang Y. A dual-stream deep neural network integrated with adaptive boosting for sleep staging. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
69
|
Chen Z, Yang Z, Wang D, Zhu X, Ono N, Altaf-Ul-Amin MD, Kanaya S, Huang M. Sleep Staging Framework with Physiologically Harmonized Sub-Networks. Methods 2023; 209:18-28. [PMID: 36436760 DOI: 10.1016/j.ymeth.2022.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Revised: 11/15/2022] [Accepted: 11/21/2022] [Indexed: 11/26/2022] Open
Abstract
Sleep screening is an important tool for both healthcare and neuroscientific research. Automatic sleep scoring is an alternative to the time-consuming gold-standard manual scoring procedure. Recently there have seen promising results on automatic stage scoring by extracting spatio-temporal features via deep neural networks from electroencephalogram (EEG). However, such methods fail to consistently yield good performance due to a missing piece in data representation: the medical criterion of the sleep scoring task on top of EEG features. We argue that capturing stage-specific features that satisfy the criterion of sleep medicine is non-trivial for automatic sleep scoring. This paper considers two criteria: Transient stage marker and Overall profile of EEG features, then we propose a physiologically meaningful framework for sleep stage scoring via mixed deep neural networks. The framework consists of two sub-networks: feature extraction networks, constructed in consideration of the physiological characteristics of sleep, and an attention-based scoring decision network. Moreover, we quantize the framework for potential use under an IoT setting. For proof-of-concept, the performance of the proposed framework is demonstrated by introducing multiple sleep datasets with the largest comprising 42,560 h recorded from 5,793 subjects. From the experiment results, the proposed method achieves a competitive stage scoring performance, especially for Wake, N2, and N3, with higher F1 scores of 0.92, 0.86, and 0.88, respectively. Moreover, the feasibility analysis of framework quantization provides a potential for future implementation in the edge computing field and clinical settings.
Collapse
Affiliation(s)
- Zheng Chen
- Graduate School of Engineering Science, Osaka University, Japan.
| | - Ziwei Yang
- Graduate School of Science and Technology, Nara Institute of Science and Technology, Japan
| | - Dong Wang
- Graduate School and Faculty of Information Science and Electrical Engineering, Kyushu University, Japan
| | - Xin Zhu
- Biomedical Information Engineering Lab, The University of Aizu, Japan
| | - Naoaki Ono
- Graduate School of Science and Technology, Nara Institute of Science and Technology, Japan; Data Science Center, Nara Insitute of Science and Technology, Japan
| | - M D Altaf-Ul-Amin
- Graduate School of Science and Technology, Nara Institute of Science and Technology, Japan
| | - Shigehiko Kanaya
- Graduate School of Science and Technology, Nara Institute of Science and Technology, Japan; Data Science Center, Nara Insitute of Science and Technology, Japan
| | - Ming Huang
- Graduate School of Science and Technology, Nara Institute of Science and Technology, Japan; Data Science Center, Nara Insitute of Science and Technology, Japan.
| |
Collapse
|
70
|
Somaskandhan P, Leppänen T, Terrill PI, Sigurdardottir S, Arnardottir ES, Ólafsdóttir KA, Serwatko M, Sigurðardóttir SÞ, Clausen M, Töyräs J, Korkalainen H. Deep learning-based algorithm accurately classifies sleep stages in preadolescent children with sleep-disordered breathing symptoms and age-matched controls. Front Neurol 2023; 14:1162998. [PMID: 37122306 PMCID: PMC10140398 DOI: 10.3389/fneur.2023.1162998] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 03/23/2023] [Indexed: 05/02/2023] Open
Abstract
Introduction Visual sleep scoring has several shortcomings, including inter-scorer inconsistency, which may adversely affect diagnostic decision-making. Although automatic sleep staging in adults has been extensively studied, it is uncertain whether such sophisticated algorithms generalize well to different pediatric age groups due to distinctive EEG characteristics. The preadolescent age group (10-13-year-olds) is relatively understudied, and thus, we aimed to develop an automatic deep learning-based sleep stage classifier specifically targeting this cohort. Methods A dataset (n = 115) containing polysomnographic recordings of Icelandic preadolescent children with sleep-disordered breathing (SDB) symptoms, and age and sex-matched controls was utilized. We developed a combined convolutional and long short-term memory neural network architecture relying on electroencephalography (F4-M1), electrooculography (E1-M2), and chin electromyography signals. Performance relative to human scoring was further evaluated by analyzing intra- and inter-rater agreements in a subset (n = 10) of data with repeat scoring from two manual scorers. Results The deep learning-based model achieved an overall cross-validated accuracy of 84.1% (Cohen's kappa κ = 0.78). There was no meaningful performance difference between SDB-symptomatic (n = 53) and control subgroups (n = 52) [83.9% (κ = 0.78) vs. 84.2% (κ = 0.78)]. The inter-rater reliability between manual scorers was 84.6% (κ = 0.78), and the automatic method reached similar agreements with scorers, 83.4% (κ = 0.76) and 82.7% (κ = 0.75). Conclusion The developed algorithm achieved high classification accuracy and substantial agreements with two manual scorers; the performance metrics compared favorably with typical inter-rater reliability between manual scorers and performance reported in previous studies. These suggest that our algorithm may facilitate less labor-intensive and reliable automatic sleep scoring in preadolescent children.
Collapse
Affiliation(s)
- Pranavan Somaskandhan
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- *Correspondence: Pranavan Somaskandhan,
| | - Timo Leppänen
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| | - Philip I. Terrill
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
| | - Sigridur Sigurdardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Erna Sif Arnardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
- Internal Medicine Services, Landspitali–The National University Hospital of Iceland, Reykjavik, Iceland
| | - Kristín A. Ólafsdóttir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Marta Serwatko
- Department of Clinical Engineering, Landspitali University Hospital, Reykjavik, Iceland
| | - Sigurveig Þ. Sigurðardóttir
- Department of Immunology, Landspitali University Hospital, Reykjavik, Iceland
- Faculty of Medicine, University of Iceland, Reykjavik, Iceland
| | - Michael Clausen
- Department of Allergy, Landspitali University Hospital, Reykjavik, Iceland
- Children's Hospital Reykjavik, Reykjavik, Iceland
| | - Juha Töyräs
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Science Service Center, Kuopio University Hospital, Kuopio, Finland
| | - Henri Korkalainen
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| |
Collapse
|
71
|
Dutt M, Redhu S, Goodwin M, Omlin CW. SleepXAI: An explainable deep learning approach for multi-class sleep stage identification. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04357-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
AbstractExtensive research has been conducted on the automatic classification of sleep stages utilizing deep neural networks and other neurophysiological markers. However, for sleep specialists to employ models as an assistive solution, it is necessary to comprehend how the models arrive at a particular outcome, necessitating the explainability of these models. This work proposes an explainable unified CNN-CRF approach (SleepXAI) for multi-class sleep stage classification designed explicitly for univariate time-series signals using modified gradient-weighted class activation mapping (Grad-CAM). The proposed approach significantly increases the overall accuracy of sleep stage classification while demonstrating the explainability of the multi-class labeling of univariate EEG signals, highlighting the parts of the signals emphasized most in predicting sleep stages. We extensively evaluated our approach to the sleep-EDF dataset, and it demonstrates the highest overall accuracy of 86.8% in identifying five sleep stage classes. More importantly, we achieved the highest accuracy when classifying the crucial sleep stage N1 with the lowest number of instances, outperforming the state-of-the-art machine learning approaches by 16.3%. These results motivate us to adopt the proposed approach in clinical practice as an aid to sleep experts.
Collapse
|
72
|
Yu R, Zhou Z, Wu S, Gao X, Bin G. MRASleepNet: a multi-resolution attention network for sleep stage classification using single-channel EEG. J Neural Eng 2022; 19. [PMID: 36379059 DOI: 10.1088/1741-2552/aca2de] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Accepted: 11/15/2022] [Indexed: 11/16/2022]
Abstract
Objective. Computerized classification of sleep stages based on single-lead electroencephalography (EEG) signals is important, but still challenging. In this paper, we proposed a deep neural network called MRASleepNet for automatic sleep stage classification using single-channel EEG signals.Approach. The proposed MRASleepNet model consisted of a feature extraction (FE) module, a multi-resolution attention (MRA) module, and a gated multilayer perceptron (gMLP) module, as well as a direct pathway for computing statistical features. The FE, MRA, and gMLP modules were used to extract features, establish feature attention, and obtain temporal relationships between features, respectively. EEG signals were normalized and cut into 30 s segments, and enhanced by incorporating contextual information from adjacent data segments. After data enhancement, the 40 s data segments were input to the MRASleepNet model. The model was evaluated on the SleepEDF and the cyclic alternating pattern (CAP) databases, using such metrics as the accuracy, Kappa, and macro-F1 (MF1).Main results.For the SleepEDF-20 database, the proposed model had an accuracy of 84.5%, an MF1 of 0.789, and a Kappa of 0.786. For the SleepEDF-78 database, the model had an accuracy of 81.4%, an MF1 of 0.754, and a Kappa of 0.743. For the CAP database, the model had an accuracy of 74.3%, an MF1 of 0.656, and a Kappa of 0.652. The proposed model achieved satisfactory performance in automatic sleep stage classification tasks.Significance. The time- and frequency-domain features extracted by the FE module and filtered by the MRA module, together with the temporal features extracted by the gMLP module and the statistical features extracted by the statistical highway, enabled the proposed model to obtain a satisfying performance in sleep staging. The proposed MRASleepNet model may be used as a new deep learning method for automatic sleep stage classification. The code of MRASleepNet will be made available publicly onhttps://github.com/YuRui8879/.
Collapse
Affiliation(s)
- Rui Yu
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, People's Republic of China
| | - Zhuhuang Zhou
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, People's Republic of China
| | - Shuicai Wu
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, People's Republic of China
| | - Xiaorong Gao
- Department of Biomedical Engineering, Tsinghua University, 100084 Beijing, People's Republic of China
| | - Guangyu Bin
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, People's Republic of China
| |
Collapse
|
73
|
A Few-Shot Learning-Based EEG and Stage Transition Sequence Generator for Improving Sleep Staging Performance. Biomedicines 2022; 10:biomedicines10123006. [PMID: 36551762 PMCID: PMC9775526 DOI: 10.3390/biomedicines10123006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Revised: 11/16/2022] [Accepted: 11/19/2022] [Indexed: 11/24/2022] Open
Abstract
In this study, generative adversarial networks named SleepGAN are proposed to expand the training set for automatic sleep stage classification tasks by generating both electroencephalogram (EEG) epochs and sequence relationships of sleep stages. In order to reach high accuracy, most existing classification methods require substantial amounts of training data, but obtaining such quantities of real EEG epochs is expensive and time-consuming. We introduce few-shot learning, which is a method of training a GAN using a very small set of training data. This paper presents progressive Wasserstein divergence generative adversarial networks (GANs) and a relational memory generator to generate EEG epochs and stage transition sequences, respectively. For the evaluation of our generated data, we use single-channel EEGs from the public dataset Sleep-EDF. The addition of our augmented data and sequence to the training set was shown to improve the performance of the classification model. The accuracy of the model increased by approximately 1% after incorporating generated EEG epochs. Adding both the augmented data and sequence to the training set resulted in a further increase of 3%, from the original accuracy of 79.40% to 83.06%. The result proves that SleepGAN is a set of GANs capable of generating realistic EEG epochs and transition sequences under the condition of insufficient training data and can be used to enlarge the training dataset and improve the performance of sleep stage classification models in clinical practice.
Collapse
|
74
|
ElMoaqet H, Eid M, Ryalat M, Penzel T. A Deep Transfer Learning Framework for Sleep Stage Classification with Single-Channel EEG Signals. SENSORS (BASEL, SWITZERLAND) 2022; 22:8826. [PMID: 36433422 PMCID: PMC9693852 DOI: 10.3390/s22228826] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 11/07/2022] [Accepted: 11/08/2022] [Indexed: 06/16/2023]
Abstract
The polysomnogram (PSG) is the gold standard for evaluating sleep quality and disorders. Attempts to automate this process have been hampered by the complexity of the PSG signals and heterogeneity among subjects and recording hardwares. Most of the existing methods for automatic sleep stage scoring rely on hand-engineered features that require prior knowledge of sleep analysis. This paper presents an end-to-end deep transfer learning framework for automatic feature extraction and sleep stage scoring based on a single-channel EEG. The proposed framework was evaluated over the three primary signals recommended by the American Academy of Sleep Medicine (C4-M1, F4-M1, O2-M1) from two data sets that have different properties and are recorded with different hardware. Different Time-Frequency (TF) imaging approaches were evaluated to generate TF representations for the 30 s EEG sleep epochs, eliminating the need for complex EEG signal pre-processing or manual feature extraction. Several training and detection scenarios were investigated using transfer learning of convolutional neural networks (CNN) and combined with recurrent neural networks. Generating TF images from continuous wavelet transform along with a deep transfer architecture composed of a pre-trained GoogLeNet CNN followed by a bidirectional long short-term memory (BiLSTM) network showed the best scoring performance among all tested scenarios. Using 20-fold cross-validation applied on the C4-M1 channel, the proposed framework achieved an average per-class accuracy of 91.2%, sensitivity of 77%, specificity of 94.1%, and precision of 75.9%. Our results demonstrate that without changing the model architecture and the training algorithm, our model could be applied to different single-channel EEGs from different data sets. Most importantly, the proposed system receives a single EEG epoch as an input at a time and produces a single corresponding output label, making it suitable for real time monitoring outside sleep labs as well as to help sleep lab specialists arrive at a more accurate diagnoses.
Collapse
Affiliation(s)
- Hisham ElMoaqet
- Department of Mechatronics Engineering, German Jordanian University, Amman 11180, Jordan
| | - Mohammad Eid
- Department of Biomedical Engineering, German Jordanian University, Amman 11180, Jordan
| | - Mutaz Ryalat
- Department of Mechatronics Engineering, German Jordanian University, Amman 11180, Jordan
| | - Thomas Penzel
- Interdisciplinary Center of Sleep Medicine, Charité-Universitätsmedizin Berlin, 10117 Berlin, Germany
| |
Collapse
|
75
|
Han J, Zhang S, Men A, Chen Q. Cross-Modal Contrastive Hashing Retrieval for Infrared Video and EEG. SENSORS (BASEL, SWITZERLAND) 2022; 22:8804. [PMID: 36433399 PMCID: PMC9699584 DOI: 10.3390/s22228804] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 11/07/2022] [Accepted: 11/08/2022] [Indexed: 06/16/2023]
Abstract
It is essential to estimate the sleep quality and diagnose the clinical stages in time and at home, because they are closely related to and important causes of chronic diseases and daily life dysfunctions. However, the existing "gold-standard" sensing machine for diagnosis (Polysomnography (PSG) with Electroencephalogram (EEG) measurements) is almost infeasible to deploy at home in a "ubiquitous" manner. In addition, it is costly to train clinicians for the diagnosis of sleep conditions. In this paper, we proposed a novel technical and systematic attempt to tackle the previous barriers: first, we proposed to monitor and sense the sleep conditions using the infrared (IR) camera videos synchronized with the EEG signal; second, we proposed a novel cross-modal retrieval system termed as Cross-modal Contrastive Hashing Retrieval (CCHR) to build the relationship between EEG and IR videos, retrieving the most relevant EEG signal given an infrared video. Specifically, the CCHR is novel in the following two perspectives. Firstly, to eliminate the large cross-modal semantic gap between EEG and IR data, we designed a novel joint cross-modal representation learning strategy using a memory-enhanced hard-negative mining design under the framework of contrastive learning. Secondly, as the sleep monitoring data are large-scale (8 h long for each subject), a novel contrastive hashing module is proposed to transform the joint cross-modal features to the discriminative binary hash codes, enabling the efficient storage and inference. Extensive experiments on our collected cross-modal sleep condition dataset validated that the proposed CCHR achieves superior performances compared with existing cross-modal hashing methods.
Collapse
Affiliation(s)
- Jianan Han
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | | | - Aidong Men
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Qingchao Chen
- National Institute of Health Data Science, Peking University, Beijing 100191, China
| |
Collapse
|
76
|
Montazeri S, Nevalainen P, Stevenson NJ, Vanhatalo S. Sleep State Trend (SST), a bedside measure of neonatal sleep state fluctuations based on single EEG channels. Clin Neurophysiol 2022; 143:75-83. [PMID: 36155385 DOI: 10.1016/j.clinph.2022.08.022] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 07/27/2022] [Accepted: 08/31/2022] [Indexed: 11/03/2022]
Abstract
OBJECTIVE To develop and validate an automated method for bedside monitoring of sleep state fluctuations in neonatal intensive care units. METHODS A deep learning-based algorithm was designed and trained using 53 EEG recordings from a long-term (a)EEG monitoring in 30 near-term neonates. The results were validated using an independent dataset from 30 polysomnography recordings. In addition, we constructed Sleep State Trend (SST), a bedside-ready means for visualizing classifier outputs. RESULTS The accuracy of quiet sleep detection in the training data was 90%, and the accuracy was comparable (85-86 %) in all bipolar derivations available from the 4-electrode recordings. The algorithm generalized well to a polysomnography dataset, showing 81% overall accuracy despite different signal derivations. SST allowed an intuitive, clear visualization of the classifier output. CONCLUSIONS Fluctuations in sleep states can be detected at high fidelity from a single EEG channel, and the results can be visualized as a transparent and intuitive trend in the bedside monitors. SIGNIFICANCE The Sleep State Trend (SST) may provide caregivers and clinical studies a real-time view of sleep state fluctuations and its cyclicity.
Collapse
Affiliation(s)
- Saeed Montazeri
- BABA Center, Department of Clinical Neurophysiology, HUS diagnostic center, Children's Hospital, University of Helsinki and Helsinki University Hospital, Helsinki, Finland; Department of Physiology, University of Helsinki, Helsinki, Finland.
| | - Päivi Nevalainen
- BABA Center, Department of Clinical Neurophysiology, HUS diagnostic center, Children's Hospital, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| | - Nathan J Stevenson
- Brain Modeling Group, QIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia
| | - Sampsa Vanhatalo
- BABA Center, Department of Clinical Neurophysiology, HUS diagnostic center, Children's Hospital, University of Helsinki and Helsinki University Hospital, Helsinki, Finland; Department of Physiology, University of Helsinki, Helsinki, Finland
| |
Collapse
|
77
|
Single-channel EEG sleep staging based on data augmentation and cross-subject discrepancy alleviation. Comput Biol Med 2022; 149:106044. [PMID: 36084381 DOI: 10.1016/j.compbiomed.2022.106044] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 07/30/2022] [Accepted: 08/20/2022] [Indexed: 11/20/2022]
Abstract
Automatic sleep stage classification is an effective technology compared to conventional artificial visual inspection in the field of sleep staging. Numerous algorithms based on machine learning and deep learning on single-channel electroencephalogram (EEG) have been proposed in recent years, however, category imbalance and cross-subject discrepancy are still the main factors restricting the accuracy of existing methods. This study proposed an innovative end-to-end neural network to solve these problems, specifically, four data augmentation methods were designed to eliminate category imbalance, and domain adaptation modules were designed for the alignment of marginal distribution, conditional distribution, and channel and spatial level distribution of feature maps, as well as the capture of transferable regions on the feature maps using a transfer attention mechanism. We conducted experiments on two publicly available datasets (Sleep-EDF Database Expanded, 2013 and 2018 version), Cohen's kappa coefficient (k) of 0.77 (Fpz-Cz) and 0.73 (Pz-Oz) were realized on the Sleep-EDF-2013 dataset, and a k of 0.75 (Fpz-Cz) and 0.68 (Pz-Oz) were realized on the Sleep-EDF-2018 dataset. An experiment was also conducted on the dataset drawn from the 2018 Physionet challenge, which containing people with sleep disorders, and a performance improvement was still found. Our comparative experiments with similar studies showed that our model was superior to most other studies, indicating our proposed EEG data augmentation and domain adaptation based cross-subject discrepancy alleviation approach is effective to improve the performance of automatic sleep staging.
Collapse
|
78
|
A Multilevel Temporal Context Network for Sleep Stage Classification. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:6104736. [PMID: 36188714 PMCID: PMC9522503 DOI: 10.1155/2022/6104736] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 08/18/2022] [Accepted: 09/01/2022] [Indexed: 11/25/2022]
Abstract
Sleep stage classification is essential in diagnosing and treating sleep disorders. Many deep learning models have been proposed to classify sleep stages by automatic learning features and temporal context information. These temporal context features come from the intra-epoch temporal features, which represent the overall morphology of an epoch, and temporal features of adjacent epochs and long epochs, which represent the influence between epochs. However, most existing methods do not fully use the complementarity of the three-level temporal features, resulting in incomplete extracted temporal features. To solve this problem, we propose a multilevel temporal context network (MLTCN) to learn the temporal features from intra-epoch, adjacent epochs, and long epochs, which utilizes the complete temporal features to improve classification accuracy. We evaluate the performance of the proposed model on the Sleep-EDF datasets published in 2013 and 2018. The experimental results show that our MLTCN can achieve an overall accuracy of 84.2% and a kappa coefficient of 0.78 on the Sleep-EDF-2013 dataset. On the larger Sleep-EDF-2018 dataset, the overall accuracy is 81.0%, and a kappa coefficient is 0.74. Our model can better assist sleep experts in diagnosing sleep disorders.
Collapse
|
79
|
Phyo J, Ko W, Jeon E, Suk HI. TransSleep: Transitioning-Aware Attention-Based Deep Neural Network for Sleep Staging. IEEE TRANSACTIONS ON CYBERNETICS 2022; PP:4500-4510. [PMID: 36063512 DOI: 10.1109/tcyb.2022.3198997] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine/deep learning methods for sleep staging. However, two key challenges hinder the practical use of those methods: 1) effectively capturing salient waveforms in sleep signals and 2) correctly classifying confusing stages in transitioning epochs. In this study, we propose a novel deep neural-network structure, TransSleep, that captures distinctive local temporal patterns and distinguishes confusing stages using two auxiliary tasks. In particular, TransSleep captures salient waveforms in sleep signals by an attention-based multiscale feature extractor and correctly classifies confusing stages in transitioning epochs, while modeling contextual relationships with two auxiliary tasks. Results show that TransSleep achieves promising performance in automatic sleep staging. The validity of TransSleep is demonstrated by its state-of-the-art performance on two publicly available datasets: 1) Sleep-EDF and 2) MASS. Furthermore, we performed ablations to analyze our results from different perspectives. Based on our overall results, we believe that TransSleep has immense potential to provide new insights into deep-learning-based sleep staging.
Collapse
|
80
|
Phan H, Chen OY, Tran MC, Koch P, Mertins A, De Vos M. XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2022; 44:5903-5915. [PMID: 33788679 DOI: 10.1109/tpami.2021.3070057] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Automating sleep staging is vital to scale up sleep assessment and diagnosis to serve millions experiencing sleep deprivation and disorders and enable longitudinal sleep monitoring in home environments. Learning from raw polysomnography signals and their derived time-frequency image representations has been prevalent. However, learning from multi-view inputs (e.g., both the raw signals and the time-frequency images) for sleep staging is difficult and not well understood. This work proposes a sequence-to-sequence sleep staging model, XSleepNet,1 that is capable of learning a joint representation from both raw signals and time-frequency images. Since different views may generalize or overfit at different rates, the proposed network is trained such that the learning pace on each view is adapted based on their generalization/overfitting behavior. In simple terms, the learning on a particular view is speeded up when it is generalizing well and slowed down when it is overfitting. View-specific generalization/overfitting measures are computed on-the-fly during the training course and used to derive weights to blend the gradients from different views. As a result, the network is able to retain the representation power of different views in the joint features which represent the underlying distribution better than those learned by each individual view alone. Furthermore, the XSleepNet architecture is principally designed to gain robustness to the amount of training data and to increase the complementarity between the input views. Experimental results on five databases of different sizes show that XSleepNet consistently outperforms the single-view baselines and the multi-view baseline with a simple fusion strategy. Finally, XSleepNet also outperforms prior sleep staging methods and improves previous state-of-the-art results on the experimental databases.
Collapse
|
81
|
Shen N, Luo T, Chen C, Zhang Y, Zhu H, Zhou Y, Wang Y, Chen W. Towards an automatic narcolepsy detection on ambiguous sleep staging and sleep transition dynamics joint model. J Neural Eng 2022; 19. [PMID: 36001951 DOI: 10.1088/1741-2552/ac8c6b] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Accepted: 08/24/2022] [Indexed: 11/11/2022]
Abstract
Objective.Mixing/dissociation of sleep stages in narcolepsy adds to the difficulty in automatic sleep staging. Moreover, automatic analytical studies for narcolepsy and multiple sleep latency test (MSLT) have only done automatic sleep staging without leveraging the sleep stage profile for further patient identification. This study aims to establish an automatic narcolepsy detection method for MSLT.Approach.We construct a two-phase model on MSLT recordings, where ambiguous sleep staging and sleep transition dynamics make joint efforts to address this issue. In phase 1, we extract representative features from electroencephalogram (EEG) and electrooculogram (EOG) signals. Then, the features are input to an EasyEnsemble classifier for automatic sleep staging. In phase 2, we investigate sleep transition dynamics, including sleep stage transitions and sleep stages, and output likelihood of narcolepsy by virtue of principal component analysis (PCA) and a logistic regression classifier. To demonstrate the proposed framework in clinical application, we conduct experiments on 24 participants from our hospital, considering ten patients with narcolepsy and fourteen patients with MSLT negative.Main results.Applying the two-phase leave-one-subject-out testing scheme, the model reaches an accuracy, sensitivity, and specificity of 87.5%, 80.0%, and 92.9% for narcolepsy detection. Influenced by disease pathology, accuracy of automatic sleep staging in narcolepsy appears to decrease compared to that in the non-narcoleptic population.Significance.This method can automatically and efficiently distinguish patients with narcolepsy based on MSLT. It probes into the amalgamation of automatic sleep staging and sleep transition dynamics for narcolepsy detection, which would assist clinic and neuroelectrophysiology specialists in visual interpretation and diagnosis.
Collapse
Affiliation(s)
- Ning Shen
- Fudan University School of Information Science and Engineering, 220 Handan Road, Yangpu District, Shanghai, China, 2005 Songhu Road, Yangpu District, Shanghai, China, Shanghai, 200433, CHINA
| | - Tian Luo
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Chen Chen
- Fudan University Human Phenome Institute, 825 Zhangheng Road, Pudong District, Shanghai, China, Shanghai, 201203, CHINA
| | - Yanjiong Zhang
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Hangyu Zhu
- Fudan University School of Information Science and Engineering, 220 Handan Road, Yangpu District, Shanghai, China, 2005 Songhu Road, Yangpu District, Shanghai, China, Shanghai, 200433, CHINA
| | - Yuanfeng Zhou
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Yi Wang
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Wei Chen
- Department of Electronic Engineering, Fudan University, 220 Handan Road, Yangpu District, Shanghai, China, 2005 Songhu Road, Yangpu District, Shanghai, China, Shanghai, Shanghai, 200433, CHINA
| |
Collapse
|
82
|
Yubo Z, Yingying L, Bing Z, Lin Z, Lei L. MMASleepNet: A multimodal attention network based on electrophysiological signals for automatic sleep staging. Front Neurosci 2022; 16:973761. [PMID: 36051650 PMCID: PMC9424881 DOI: 10.3389/fnins.2022.973761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 07/22/2022] [Indexed: 11/13/2022] Open
Abstract
Pandemic-related sleep disorders affect human physical and mental health. The artificial intelligence (AI) based sleep staging with multimodal electrophysiological signals help people diagnose and treat sleep disorders. However, the existing AI-based methods could not capture more discriminative modalities and adaptively correlate these multimodal features. This paper introduces a multimodal attention network (MMASleepNet) to efficiently extract, perceive and fuse multimodal features of electrophysiological signals. The MMASleepNet has a multi-branch feature extraction (MBFE) module followed by an attention-based feature fusing (AFF) module. In the MBFE module, branches are designed to extract multimodal signals' temporal and spectral features. Each branch has two-stream convolutional networks with a unique kernel to perceive features of different time scales. The AFF module contains a modal-wise squeeze and excitation (SE) block to adjust the weights of modalities with more discriminative features and a Transformer encoder (TE) to generate attention matrices and extract the inter-dependencies among multimodal features. Our MMASleepNet outperforms state-of-the-art models in terms of different evaluation matrices on the datasets of Sleep-EDF and ISRUC-Sleep. The implementation code is available at: https://github.com/buptantEEG/MMASleepNet/.
Collapse
Affiliation(s)
| | | | | | | | - Li Lei
- School of Artificial Intelligence, University of Posts and Telecommunications, Beijing, China
| |
Collapse
|
83
|
A comprehensive evaluation of contemporary methods used for automatic sleep staging. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
84
|
Zhuang L, Dai M, Zhou Y, Sun L. Intelligent automatic sleep staging model based on CNN and LSTM. Front Public Health 2022; 10:946833. [PMID: 35968483 PMCID: PMC9364961 DOI: 10.3389/fpubh.2022.946833] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 06/22/2022] [Indexed: 01/10/2023] Open
Abstract
Since electroencephalogram (EEG) is a significant basis to treat and diagnose somnipathy, sleep electroencephalogram automatic staging methods play important role in the treatment and diagnosis of sleep disorders. Due to the characteristics of weak signals, EEG needs accurate and efficient algorithms to extract feature information before applying it in the sleep stages. Conventional feature extraction methods have low efficiency and are difficult to meet the time validity of fast staging. In addition, it can easily lead to the omission of key features owing to insufficient a priori knowledge. Deep learning networks, such as convolutional neural networks (CNNs), have powerful processing capabilities in data analysis and data mining. In this study, a deep learning network is introduced into the study of the sleep stage. In this study, the feature fusion method is presented, and long-term and short-term memory (LSTM) is selected as the classification network to improve the accuracy of sleep stage recognition. First, based on EEG and deep learning network, an automatic sleep phase method based on a multi-channel EGG is proposed. Second, CNN-LSTM is used to monitor EEG and EOG samples during sleep. In addition, without any signal preprocessing or feature extraction, data expansion (DA) can be realized for unbalanced data, and special data and non-general data can be deleted. Finally, the MIT-BIH dataset is used to train and evaluate the proposed model. The experimental results show that the EEG-based sleep phase method proposed in this paper provides an effective method for the diagnosis and treatment of sleep disorders, and hence has a practical application value.
Collapse
Affiliation(s)
- Lan Zhuang
- Staff Hospital, Central South University, Changsha, China
| | - Minhui Dai
- Teaching and Research Section of Clinical Nursing, Xiangya Hospital of Central South University, Changsha, China
- Department of Ophthalmology, Xiangya Hospital, Central South University, Changsha, China
| | - Yi Zhou
- Department of Ophthalmology, Xiangya Hospital, Central South University, Changsha, China
| | - Lingyu Sun
- Teaching and Research Section of Clinical Nursing, Xiangya Hospital of Central South University, Changsha, China
- Department of Ophthalmology, Xiangya Hospital, Central South University, Changsha, China
- *Correspondence: Lingyu Sun
| |
Collapse
|
85
|
Zhu L, Yang Z, Odani K, Shi G, Kan Y, Chen Z, Zhang R. Adaptive Spike-Like Representation of EEG Signals for Sleep Stages Scoring. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:4453-4456. [PMID: 36086600 DOI: 10.1109/embc48229.2022.9871250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Recently there has seen promising results on auto-matic stage scoring by extracting spatio-temporal features from electroencephalogram (EEG). Such methods entail laborious manual feature engineering and domain knowledge. In this study, we propose an adaptive scheme to probabilistically encode, filter and accumulate the input signals and weight the resultant features by the half-Gaussian probabilities of signal intensities. The adaptive representations are subsequently fed into a transformer model to automatically mine the relevance between features and corresponding stages. Extensive exper-iments on the largest public dataset against state-of-the-art methods validate the effectiveness of our proposed method and reveal promising future directions.
Collapse
|
86
|
Multi-scale ResNet and BiGRU automatic sleep staging based on attention mechanism. PLoS One 2022; 17:e0269500. [PMID: 35709101 PMCID: PMC9202858 DOI: 10.1371/journal.pone.0269500] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 05/20/2022] [Indexed: 11/29/2022] Open
Abstract
Sleep staging is the basis of sleep evaluation and a key step in the diagnosis of sleep-related diseases. Despite being useful, the existing sleep staging methods have several disadvantages, such as relying on artificial feature extraction, failing to recognize temporal sequence patterns in the long-term associated data, and reaching the accuracy upper limit of sleep staging. Hence, this paper proposes an automatic Electroencephalogram (EEG) sleep signal staging model, which based on Multi-scale Attention Residual Nets (MAResnet) and Bidirectional Gated Recurrent Unit (BiGRU). The proposed model is based on the residual neural network in deep learning. Compared with the traditional residual learning module, the proposed model additionally uses the improved channel and spatial feature attention units and convolution kernels of different sizes in parallel at the same position. Thus, multiscale feature extraction of the EEG sleep signals and residual learning of the neural networks is performed to avoid network degradation. Finally, BiGRU is used to determine the dependence between the sleep stages and to realize the automatic learning of sleep data staging features and sleep cycle extraction. According to the experiment, the classification accuracy and kappa coefficient of the proposed method on sleep-EDF data set are 84.24% and 0.78, which are respectively 0.24% and 0.21 higher than the traditional residual net. At the same time, this paper also verified the proposed method on UCD and SHHS data sets, and the figure of classification accuracy is 79.34% and 81.6%, respectively. Compared to related existing studies, the recognition accuracy is significantly improved, which validates the effectiveness and generalization performance of the proposed method.
Collapse
|
87
|
Tao Y, Yang Y, Yang P, Nan F, Zhang Y, Rao Y, Du F. A novel feature relearning method for automatic sleep staging based on single-channel EEG. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-022-00779-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
AbstractCorrectly identifying sleep stages is essential for assessing sleep quality and treating sleep disorders. However, the current sleep staging methods have the following problems: (1) Manual or semi-automatic extraction of features requires professional knowledge, which is time-consuming and laborious. (2) Due to the similarity of stage features, it is necessary to strengthen the learning of features. (3) Acquisition of a variety of data has high requirements on equipment. Therefore, this paper proposes a novel feature relearning method for automatic sleep staging based on single-channel electroencephalography (EEG) to solve these three problems. Specifically, we design a bottom–up and top–down network and use the attention mechanism to learn EEG information fully. The cascading step with an imbalanced strategy is used to further improve the overall classification performance and realize automatic sleep classification. The experimental results on the public dataset Sleep-EDF show that the proposed method is advanced. The results show that the proposed method outperforms the state-of-the-art methods. The code and supplementary materials are available at GitHub: https://github.com/raintyj/A-novel-feature-relearning-method.
Collapse
|
88
|
Wang H, Guo H, Zhang K, Gao L, Zheng J. Automatic sleep staging method of EEG signal based on transfer learning and fusion network. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.02.049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
89
|
Ma Q, Kobayashi E, Fan B, Hara K, Nakagawa K, Masamune K, Sakuma I, Suenaga H. Machine‐learning‐based approach for predicting postoperative skeletal changes for orthognathic surgical planning. Int J Med Robot 2022; 18:e2379. [DOI: 10.1002/rcs.2379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 01/11/2022] [Accepted: 01/12/2022] [Indexed: 11/07/2022]
Affiliation(s)
- Qingchuan Ma
- Department of Oral‐Maxillofacial Surgery and Orthodontics The University of Tokyo Hospital Tokyo Japan
- School of Engineering Medicine Beihang University Beijing China
| | - Etsuko Kobayashi
- Department of Precision Engineering The University of Tokyo Tokyo Japan
| | - Bowen Fan
- Department of Precision Engineering The University of Tokyo Tokyo Japan
| | - Kazuaki Hara
- Department of Precision Engineering The University of Tokyo Tokyo Japan
| | - Keiichi Nakagawa
- Department of Precision Engineering The University of Tokyo Tokyo Japan
| | - Ken Masamune
- Institute of Advanced BioMedical Engineering and Science Tokyo Women's Medical University Tokyo Japan
| | - Ichiro Sakuma
- Department of Precision Engineering The University of Tokyo Tokyo Japan
| | - Hideyuki Suenaga
- Department of Oral‐Maxillofacial Surgery and Orthodontics The University of Tokyo Hospital Tokyo Japan
| |
Collapse
|
90
|
Zhao C, Li J, Guo Y. SleepContextNet: A temporal context network for automatic sleep staging based single-channel EEG. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 220:106806. [PMID: 35461126 DOI: 10.1016/j.cmpb.2022.106806] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Revised: 04/07/2022] [Accepted: 04/07/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVE Single-channel EEG is the most popular choice of sensing modality in sleep staging studies, because it widely conforms to the sleep staging guidelines. The current deep learning method using single-channel EEG signals for sleep staging mainly extracts the features of its surrounding epochs to obtain the short-term temporal context information of EEG epochs, and ignore the influence of the long-term temporal context information on sleep staging. However, the long-term context information includes sleep stage transition rules in a sleep cycle, which can further improve the performance of sleep staging. The aim of this research is to develop a temporal context network to capture the long-term context between EEG sleep stages. METHODS In this paper, we design a sleep staging network named SleepContextNet for sleep stage sequence. SleepContextNet can extract and utilize the long-term temporal context between consecutive EEG epochs, and combine it with the short-term context. we utilize Convolutional Neural Network(CNN) layers for learning representative features from each sleep stage and the representation features sequence learned are fed into a Recurrent Neural Network(RNN) layer for learning long-term and short-term context information among sleep stage in chronological order. In addition, we design a data augmentation algorithm for EEG to retain the long-term context information without changing the number of samples. RESULTS We evaluate the performance of our proposed network using four public datasets, the 2013 version of Sleep-EDF (SEDF), the 2018 version of Sleep-EDF Expanded (SEDFX), Sleep Heart Health Study (SHHS) and the CAP Sleep Database. The experimental results demonstrate that SleepContextNet outperforms state-of-the-art techniques in terms of different evaluation metrics by capturing long-term and short-term temporal context information. On average, accuracy of 84.8% in SEDF, 82.7% in SEDFX, 86.4% in SHHS and 78.8% in CAP are obtained under subject-independent cross validation. CONCLUSIONS The network extracts the long-term and short-term temporal context information of sleep stages from the sequence features, which utilizes the temporal dependencies among the EEG epochs effectively and improves the accuracy of sleep stages. The sleep staging method based on forward temporal context information is suitable for real-time family sleep monitoring system.
Collapse
Affiliation(s)
- Caihong Zhao
- School of Electronic and Engineer, Heilongjiang University, Harbin, 150080, China; School of Computer Science and Technology, Heilongjiang University, Harbin, 150080, China
| | - Jinbao Li
- Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250353, China.
| | - Yahong Guo
- School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250353, China.
| |
Collapse
|
91
|
Fan M, Yuan C, Huang G, Xu M, Wang S, Gao X, Li L. A framework for deep multitask learning with multiparametric magnetic resonance imaging for the joint prediction of histological characteristics in breast cancer. IEEE J Biomed Health Inform 2022; 26:3884-3895. [PMID: 35635826 DOI: 10.1109/jbhi.2022.3179014] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The clinical management and decision-making process related to breast cancer are based on multiple histological indicators. This study aims to jointly predict the Ki-67 expression level, luminal A subtype and histological grade molecular biomarkers using a new deep multitask learning method with multiparametric magnetic resonance imaging. A multitask learning network structure was proposed by introducing a common-task layer and task-specific layers to learn the high-level features that are common to all tasks and related to a specific task, respectively. A network pretrained with knowledge from the ImageNet dataset was used and fine-tuned with MRI data. Information from multiparametric MR images was fused using the strategy at the feature and decision levels. The area under the receiver operating characteristic curve (AUC) was used to measure model performance. For single-task learning using a single image series, the deep learning model generated AUCs of 0.752, 0.722, and 0.596 for the Ki-67, luminal A and histological grade prediction tasks, respectively. The performance was improved by freezing the first 5 convolutional layers, using 20% shared layers and fusing multiparametric series at the feature level, which achieved AUCs of 0.819, 0.799 and 0.747 for Ki-67, luminal A and histological grade prediction tasks, respectively. Our study showed advantages in jointly predicting correlated clinical biomarkers using a deep multitask learning framework with an appropriate number of fine-tuned convolutional layers by taking full advantage of common and complementary imaging features. Multiparametric image series-based multitask learning could be a promising approach for the multiple clinical indicator-based management of breast cancer.
Collapse
|
92
|
Li C, Qi Y, Ding X, Zhao J, Sang T, Lee M. A Deep Learning Method Approach for Sleep Stage Classification with EEG Spectrogram. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:6322. [PMID: 35627856 PMCID: PMC9141573 DOI: 10.3390/ijerph19106322] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Revised: 05/11/2022] [Accepted: 05/18/2022] [Indexed: 11/17/2022]
Abstract
The classification of sleep stages is an important process. However, this process is time-consuming, subjective, and error-prone. Many automated classification methods use electroencephalogram (EEG) signals for classification. These methods do not classify well enough and perform poorly in the N1 due to unbalanced data. In this paper, we propose a sleep stage classification method using EEG spectrogram. We have designed a deep learning model called EEGSNet based on multi-layer convolutional neural networks (CNNs) to extract time and frequency features from the EEG spectrogram, and two-layer bi-directional long short-term memory networks (Bi-LSTMs) to learn the transition rules between features from adjacent epochs and to perform the classification of sleep stages. In addition, to improve the generalization ability of the model, we have used Gaussian error linear units (GELUs) as the activation function of CNN. The proposed method was evaluated by four public databases, the Sleep-EDFX-8, Sleep-EDFX-20, Sleep-EDFX-78, and SHHS. The accuracy of the method is 94.17%, 86.82%, 83.02% and 85.12%, respectively, for the four datasets, the MF1 is 87.78%, 81.57%, 77.26% and 78.54%, respectively, and the Kappa is 0.91, 0.82, 0.77 and 0.79, respectively. In addition, our proposed method achieved better classification results on N1, with an F1-score of 70.16%, 52.41%, 50.03% and 47.26% for the four datasets.
Collapse
Affiliation(s)
- Chengfan Li
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (C.L.); (Y.Q.); (J.Z.); (T.S.)
| | - Yueyu Qi
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (C.L.); (Y.Q.); (J.Z.); (T.S.)
| | - Xuehai Ding
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (C.L.); (Y.Q.); (J.Z.); (T.S.)
| | - Junjuan Zhao
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (C.L.); (Y.Q.); (J.Z.); (T.S.)
| | - Tian Sang
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (C.L.); (Y.Q.); (J.Z.); (T.S.)
| | - Matthew Lee
- 12th Grade, The Bishop’s School, La Jolla, CA 92037, USA;
| |
Collapse
|
93
|
A Holistic Strategy for Classification of Sleep Stages with EEG. SENSORS 2022; 22:s22093557. [PMID: 35591246 PMCID: PMC9103466 DOI: 10.3390/s22093557] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 05/03/2022] [Accepted: 05/05/2022] [Indexed: 02/01/2023]
Abstract
Manual sleep stage scoring is usually implemented with the help of sleep specialists by means of visual inspection of the neurophysiological signals of the patient. As it is a very hectic task to perform, automated sleep stage classification systems were developed in the past, and advancements are being made consistently by researchers. The various stages of sleep are identified by these automated sleep stage classification systems, and it is quite an important step to assist doctors for the diagnosis of sleep-related disorders. In this work, a holistic strategy named as clustering and dimensionality reduction with feature extraction cum selection for classification along with deep learning (CDFCD) is proposed for the classification of sleep stages with EEG signals. Though the methodology follows a similar structural flow as proposed in the past works, many advanced and novel techniques are proposed under each category in this work flow. Initially, clustering is applied with the help of hierarchical clustering, spectral clustering, and the proposed principal component analysis (PCA)-based subspace clustering. Then the dimensionality of it is reduced with the help of the proposed singular value decomposition (SVD)-based spectral algorithm and the standard variational Bayesian matrix factorization (VBMF) technique. Then the features are extracted and selected with the two novel proposed techniques, such as the sparse group lasso technique with dual-level implementation (SGL-DLI) and the ridge regression technique with limiting weight scheme (RR-LWS). Finally, the classification happens with the less explored multiclass Gaussian process classification (MGC), the proposed random arbitrary collective classification (RACC), and the deep learning technique using long short-term memory (LSTM) along with other conventional machine learning techniques. This methodology is validated on the sleep EDF database, and the results obtained with this methodology have surpassed the results of the previous studies in terms of the obtained classification accuracy reporting a high accuracy of 93.51% even for the six-classes classification problem.
Collapse
|
94
|
Zhou D, Wang J, Hu G, Zhang J, Li F, Yan R, Kettunen L, Chang Z, Xu Q, Cong F. SingleChannelNet: A model for automatic sleep stage classification with raw single-channel EEG. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103592] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
95
|
Li Y, Xu Z, Zhang Y, Cao Z, Chen H. Automatic sleep stage classification based on two-channel EOG and one-channel EMG. Physiol Meas 2022; 43. [PMID: 35487205 DOI: 10.1088/1361-6579/ac6bdb] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Accepted: 04/29/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE The sleep monitoring with Polysomnography (PSG) severely degrades the sleep quality. In order to reduce the load of sleep monitoring, an approach to automatic sleep stage classification without electroencephalogram (EEG) was proposed. APPROACH Totally 124 records from the public dataset ISRUC-Sleep with AASM standard were used, in which only 10 records were from the healthy group while the rest ones were from sleep disorder groups. The 124 records were collected from 116 subjects (8 subjects with two records for each subject, others with one record per subject) with their ages range in [20, 85] years. Totally 108 features were extracted from two-channel electrooculogram (EOG), and 6 features were extracted from one-channel electromyogram (EMG). A novel 'quasi-normalization' method was proposed and used for feature normalization. Then the random forest (RF) was used to classify five stages, including wakefulness, REM sleep, N1 sleep, N2 sleep and N3 sleep. MAIN RESULTS Using 114 normalized features from the combination of EOG (108 features) and EMG (6 features), the Cohen's kappa coefficient was 0.749 and the accuracy was 80.8% by leave-one-out cross-validation (LOOCV). As a reference for AASM standard using computer assisted method, the Cohen's kappa coefficient was 0.801 and the accuracy was 84.7% for the same dataset based on 438 normalized features from the combination of EEG (324 features), EOG (108 features) and EMG (6 features). SIGNIFICANCE The combination of EOG and EMG can reduce the load of sleep monitoring, and achieves comparable performances with the "gold standard" signals of EEG, EOG and EMG on sleep stage classification.
Collapse
Affiliation(s)
- Yanjun Li
- China Astronaut Research and Training Center, China Astronaut Research and Training Center, Haidian District, Beijing, China, Beijing, 100094, CHINA
| | - Zhi Xu
- China Astronaut Research and Training Center, China Astronaut Research and Training Center, Haidian District, Beijing, China, Beijing, Beijing, 100094, CHINA
| | - Yu Zhang
- China Astronaut Research and Training Center, China Astronaut Research and Training Center, Haidian District, Beijing, China, Beijing, Beijing, 100094, CHINA
| | - Zhongping Cao
- China Astronaut Research and Training Center, China Astronaut Research and Training Center, Haidian District, Beijing, China, Beijing, Beijing, 100094, CHINA
| | - Hua Chen
- China Astronaut Research and Training Center, China Astronaut Research and Training Center, Haidian District, Beijing, China, Beijing, Beijing, 100094, CHINA
| |
Collapse
|
96
|
Li T, Zhang B, Lv H, Hu S, Xu Z, Tuergong Y. CAttSleepNet: Automatic End-to-End Sleep Staging Using Attention-Based Deep Neural Networks on Single-Channel EEG. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:5199. [PMID: 35564593 PMCID: PMC9104971 DOI: 10.3390/ijerph19095199] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Revised: 04/20/2022] [Accepted: 04/22/2022] [Indexed: 12/04/2022]
Abstract
Accurate sleep staging results can be used to measure sleep quality, providing a reliable basis for the prevention and diagnosis of sleep-related diseases. The key to sleep staging is the feature representation of EEG signals. Existing approaches rarely consider local features in feature extraction, and fail to distinguish the importance of critical and non-critical local features. We propose an innovative model for automatic sleep staging with single-channel EEG, named CAttSleepNet. We add an attention module to the convolutional neural network (CNN) that can learn the weights of local sequences of EEG signals by exploiting intra-epoch contextual information. Then, a two-layer bidirectional-Long Short-Term Memory (Bi-LSTM) is used to encode the global correlations of successive epochs. Therefore, the feature representations of EEG signals are enhanced by both local and global context correlation. Experimental results achieved on two real-world sleep datasets indicate that the CAttSleepNet model outperforms existing models. Moreover, ablation experiments demonstrate the validity of our proposed attention module.
Collapse
Affiliation(s)
- Tingting Li
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (T.L.); (H.L.); (S.H.); (Z.X.)
| | - Bofeng Zhang
- School of Computer and Communication Engineering, Shanghai Polytechnic University, Shanghai 201209, China
- School of Computer Science and Technology, Kashi University, Kashi 844008, China;
| | - Hehe Lv
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (T.L.); (H.L.); (S.H.); (Z.X.)
| | - Shengxiang Hu
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (T.L.); (H.L.); (S.H.); (Z.X.)
| | - Zhikang Xu
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; (T.L.); (H.L.); (S.H.); (Z.X.)
| | - Yierxiati Tuergong
- School of Computer Science and Technology, Kashi University, Kashi 844008, China;
| |
Collapse
|
97
|
An Attention-Guided Spatiotemporal Graph Convolutional Network for Sleep Stage Classification. Life (Basel) 2022; 12:life12050622. [PMID: 35629290 PMCID: PMC9144567 DOI: 10.3390/life12050622] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 04/19/2022] [Accepted: 04/19/2022] [Indexed: 12/25/2022] Open
Abstract
Sleep staging has been widely used as an approach in sleep diagnoses at sleep clinics. Graph neural network (GNN)-based methods have been extensively applied for automatic sleep stage classifications with significant results. However, the existing GNN-based methods rely on a static adjacency matrix to capture the features of the different electroencephalogram (EEG) channels, which cannot grasp the information of each electrode. Meanwhile, these methods ignore the importance of spatiotemporal relations in classifying sleep stages. In this work, we propose a combination of a dynamic and static spatiotemporal graph convolutional network (ST-GCN) with inter-temporal attention blocks to overcome two shortcomings. The proposed method consists of a GCN with a CNN that takes into account the intra-frame dependency of each electrode in the brain region to extract spatial and temporal features separately. In addition, the attention block was used to capture the long-range dependencies between the different electrodes in the brain region, which helps the model to classify the dynamics of each sleep stage more accurately. In our experiments, we used the sleep-EDF and the subgroup III of the ISRUC-SLEEP dataset to compare with the most current methods. The results show that our method performs better in accuracy from 4.6% to 5.3%, in Kappa from 0.06 to 0.07, and in macro-F score from 4.9% to 5.7%. The proposed method has the potential to be an effective tool for improving sleep disorders.
Collapse
|
98
|
|
99
|
SONG XUAN, GAO HAIYUN, HERRUP KARL, HART RONALDP. Optimized splitting of mixed-species RNA sequencing data. J Bioinform Comput Biol 2022; 20:2250001. [PMID: 34991436 PMCID: PMC9081140 DOI: 10.1142/s0219720022500019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Gene expression studies using xenograft transplants or co-culture systems, usually with mixed human and mouse cells, have proven to be valuable to uncover cellular dynamics during development or in disease models. However, the mRNA sequence similarities among species presents a challenge for accurate transcript quantification. To identify optimal strategies for analyzing mixed-species RNA sequencing data, we evaluate both alignment-dependent and alignment-independent methods. Alignment of reads to a pooled reference index is effective, particularly if optimal alignments are used to classify sequencing reads by species, which are re-aligned with individual genomes, generating [Formula: see text] accuracy across a range of species ratios. Alignment-independent methods, such as convolutional neural networks, which extract the conserved patterns of sequences from two species, classify RNA sequencing reads with over 85% accuracy. Importantly, both methods perform well with different ratios of human and mouse reads. While non-alignment strategies successfully partitioned reads by species, a more traditional approach of mixed-genome alignment followed by optimized separation of reads proved to be the more successful with lower error rates.
Collapse
Affiliation(s)
- XUAN SONG
- Department of Neurology, Alzheimer’s Disease Research Center, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - HAI YUN GAO
- Department of Cell Biology & Neuroscience, Rutgers University, Piscataway, NJ 08854, USA
| | - KARL HERRUP
- Department of Neurology, Alzheimer’s Disease Research Center, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - RONALD P. HART
- Department of Cell Biology & Neuroscience, Rutgers University, Piscataway, NJ 08854, USA
| |
Collapse
|
100
|
Siyahjani F, Garcia Molina G, Barr S, Mushtaq F. Performance Evaluation of a Smart Bed Technology against Polysomnography. SENSORS 2022; 22:s22072605. [PMID: 35408220 PMCID: PMC9002520 DOI: 10.3390/s22072605] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/22/2022] [Accepted: 03/24/2022] [Indexed: 12/27/2022]
Abstract
The Sleep Number smart bed uses embedded ballistocardiography, together with network connectivity, signal processing, and machine learning, to detect heart rate (HR), breathing rate (BR), and sleep vs. wake states. This study evaluated the performance of the smart bed relative to polysomnography (PSG) in estimating epoch-by-epoch HR, BR, sleep vs. wake, mean overnight HR and BR, and summary sleep variables. Forty-five participants (aged 22–64 years; 55% women) slept one night on the smart bed with standard PSG. Smart bed data were compared to PSG by Bland–Altman analysis and Pearson correlation for epoch-by-epoch HR and epoch-by-epoch BR. Agreement in sleep vs. wake classification was quantified using Cohen’s kappa, ROC analysis, sensitivity, specificity, accuracy, and precision. Epoch-by-epoch HR and BR were highly correlated with PSG (HR: r = 0.81, |bias| = 0.23 beats/min; BR: r = 0.71, |bias| = 0.08 breaths/min), as were estimations of mean overnight HR and BR (HR: r = 0.94, |bias| = 0.15 beats/min; BR: r = 0.96, |bias| = 0.09 breaths/min). Calculated agreement for sleep vs. wake detection included kappa (prevalence and bias-adjusted) = 0.74 ± 0.11, AUC = 0.86, sensitivity = 0.94 ± 0.05, specificity = 0.48 ± 0.18, accuracy = 0.86 ± 0.11, and precision = 0.90 ± 0.06. For all-night summary variables, agreement was moderate to strong. Overall, the findings suggest that the Sleep Number smart bed may provide reliable metrics to unobtrusively characterize human sleep under real life-conditions.
Collapse
|