1
|
Cong Z, Zhao M, Gao H, Lou M, Zheng G, Wang Z, Wang X, Yan C, Ling L, Li J, Liu C. BiTS-SleepNet: An Attention-Based Two Stage Temporal-Spectral Fusion Model for Sleep Staging With Single-Channel EEG. IEEE J Biomed Health Inform 2025; 29:3366-3376. [PMID: 40030778 DOI: 10.1109/jbhi.2024.3523908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Automated sleep staging is crucial for assessing sleep quality and diagnosing sleep-related diseases. Single-channel EEG has attracted significant attention due to its portability and accessibility. Most existing automated sleep staging methods often emphasize temporal information and neglect spectral information, the relationship between sleep stage contextual features, and transition rules between sleep stages. To overcome these obstacles, this paper proposes an attention-based two stage temporal-spectral fusion model (BiTS-SleepNet). The BiTS-SleepNet stage 1 network consists of a dual-stream temporal-spectral feature extractor branch and a temporal-spectral feature fusion module based on the cross-attention mechanism. These blocks are designed to autonomously extract and integrate the temporal and spectral features of EEG signals, leveraging temporal-spectral fusion information to discriminate between different sleep stages. The BiTS-SleepNet stage 2 network includes a feature context learning module (FCLM) based on Bi-GRU and a transition rules learning module (TRLM) based on the Conditional Random Field (CRF). The FCLM optimizes preliminary sleep stage results from the stage 1 network by learning dependencies between features of multiple adjacent stages. The TRLM additionally employs transition rules to optimize overall outcomes. We evaluated the BiTS-SleepNet on three public datasets: Sleep-EDF-20, Sleep-EDF-78, and SHHS, achieving accuracies of 88.50%, 85.09%, and 87.01%, respectively. The experimental results demonstrate that BiTS-SleepNet achieves competitive performance in comparison to recently published methods. This highlights its promise for practical applications.
Collapse
|
2
|
Xu X, Zhang B, Xu T, Tang J. An Effective and Interpretable Sleep Stage Classification Approach Using Multi-Domain Electroencephalogram and Electrooculogram Features. Bioengineering (Basel) 2025; 12:286. [PMID: 40150750 PMCID: PMC11939799 DOI: 10.3390/bioengineering12030286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2025] [Revised: 03/07/2025] [Accepted: 03/12/2025] [Indexed: 03/29/2025] Open
Abstract
Accurate sleep staging is critical for assessing sleep quality and diagnosing sleep disorders. Recent research efforts on automated sleep staging have focused on complex deep learning architectures that have achieved modest improvements in classification accuracy but have limited real-world applicability due to the complexity of model training and deployment and a lack of interpretability. This paper presents an effective and interpretable sleep staging scheme that follows a classical machine learning pipeline. Multi-domain features were extracted from preprocessed electroencephalogram (EEG) signals, and novel electrooculogram (EOG) features were created to characterize different sleep stages. A two-step feature selection strategy combining F-score pre-filtering and XGBoost feature ranking was designed to select the most discriminating feature subset, which was then fed into an XGBoost model for sleep stage classification. Through a rigorous double-cross-validation procedure, our approach achieved competitive classification performance on the public Sleep-EDF dataset (accuracy 87.0%, F1-score 86.6%, Kappa coefficient 0.81) compared with the state-of-the-art deep learning methods and provided interpretability through feature importance analysis. These promising results demonstrate the effectiveness of the proposed sleep staging model and show its potential in practical applications due to its low complexity, interpretability, and transparency.
Collapse
Affiliation(s)
| | | | - Tingting Xu
- School of Communication and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China; (X.X.); (B.Z.); (J.T.)
| | | |
Collapse
|
3
|
Moctezuma LA, Suzuki Y, Furuki J, Molinas M, Abe T. GRU-powered sleep stage classification with permutation-based EEG channel selection. Sci Rep 2024; 14:17952. [PMID: 39095608 PMCID: PMC11297028 DOI: 10.1038/s41598-024-68978-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 07/30/2024] [Indexed: 08/04/2024] Open
Abstract
We present a new approach to classifying the sleep stage that incorporates a computationally inexpensive method based on permutations for channel selection and takes advantage of deep learning power, specifically the gated recurrent unit (GRU) model, along with other deep learning methods. By systematically permuting the electroencephalographic (EEG) channels, different combinations of EEG channels are evaluated to identify the most informative subset for the classification of the 5-class sleep stage. For analysis, we used an EEG dataset that was collected at the International Institute for Integrative Sleep Medicine (WPI-IIIS) at the University of Tsukuba in Japan. The results of these explorations provide many new insights such as the (1) drastic decrease in performance when channels are fewer than 3, (2) 3-random channels selected by permutation provide the same or better prediction than the 3 channels recommended by the American Academy of Sleep Medicine (AASM), (3) N1 class suffers the most in prediction accuracy as the channels drop from 128 to 3 random or 3 AASM, and (4) no single channel provides acceptable levels of accuracy in the prediction of 5 classes. The results obtained show the GRU's ability to retain essential temporal information from EEG data, which allows capturing the underlying patterns associated with each sleep stage effectively. Using permutation-based channel selection, we enhance or at least maintain as high model efficiency as when using high-density EEG, incorporating only the most informative EEG channels.
Collapse
Affiliation(s)
- Luis Alfredo Moctezuma
- International Institute for Integrative Sleep Medicine (WPI-IIIS), University of Tsukuba, Tsukuba, Ibaraki, Japan.
| | - Yoko Suzuki
- International Institute for Integrative Sleep Medicine (WPI-IIIS), University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Junya Furuki
- International Institute for Integrative Sleep Medicine (WPI-IIIS), University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Marta Molinas
- Department of Engineering Cybernetics, Norwegian University of Science and Technology, Trondheim, Norway
| | - Takashi Abe
- International Institute for Integrative Sleep Medicine (WPI-IIIS), University of Tsukuba, Tsukuba, Ibaraki, Japan
| |
Collapse
|
4
|
Yazdi M, Samaee M, Massicotte D. A Review on Automated Sleep Study. Ann Biomed Eng 2024; 52:1463-1491. [PMID: 38493234 DOI: 10.1007/s10439-024-03486-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 02/25/2024] [Indexed: 03/18/2024]
Abstract
In recent years, research on automated sleep analysis has witnessed significant growth, reflecting advancements in understanding sleep patterns and their impact on overall health. This review synthesizes findings from an exhaustive analysis of 87 papers, systematically retrieved from prominent databases such as Google Scholar, PubMed, IEEE Xplore, and ScienceDirect. The selection criteria prioritized studies focusing on methods employed, signal modalities utilized, and machine learning algorithms applied in automated sleep analysis. The overarching goal was to critically evaluate the strengths and weaknesses of the proposed methods, shedding light on the current landscape and future directions in sleep research. An in-depth exploration of the reviewed literature revealed a diverse range of methodologies and machine learning approaches employed in automated sleep studies. Notably, K-Nearest Neighbors (KNN), Ensemble Learning Methods, and Support Vector Machine (SVM) emerged as versatile and potent classifiers, exhibiting high accuracies in various applications. However, challenges such as performance variability and computational demands were observed, necessitating judicious classifier selection based on dataset intricacies. In addition, the integration of traditional feature extraction methods with deep structures and the combination of different deep neural networks were identified as promising strategies to enhance diagnostic accuracy in sleep-related studies. The reviewed literature emphasized the need for adaptive classifiers, cross-modality integration, and collaborative efforts to drive the field toward more accurate, robust, and accessible sleep-related diagnostic solutions. This comprehensive review serves as a solid foundation for researchers and practitioners, providing an organized synthesis of the current state of knowledge in automated sleep analysis. By highlighting the strengths and challenges of various methodologies, this review aims to guide future research toward more effective and nuanced approaches to sleep diagnostics.
Collapse
Affiliation(s)
- Mehran Yazdi
- Laboratory of Signal and System Integration, Department of Electrical and Computer Engineering, Université du Québec à Trois-Rivières, Trois-Rivières, Canada.
- Signal and Image Processing Laboratory, School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran.
| | - Mahdi Samaee
- Signal and Image Processing Laboratory, School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran
| | - Daniel Massicotte
- Laboratory of Signal and System Integration, Department of Electrical and Computer Engineering, Université du Québec à Trois-Rivières, Trois-Rivières, Canada
| |
Collapse
|
5
|
Satapathy SK, Brahma B, Panda B, Barsocchi P, Bhoi AK. Machine learning-empowered sleep staging classification using multi-modality signals. BMC Med Inform Decis Mak 2024; 24:119. [PMID: 38711099 DOI: 10.1186/s12911-024-02522-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2023] [Accepted: 04/29/2024] [Indexed: 05/08/2024] Open
Abstract
The goal is to enhance an automated sleep staging system's performance by leveraging the diverse signals captured through multi-modal polysomnography recordings. Three modalities of PSG signals, namely electroencephalogram (EEG), electrooculogram (EOG), and electromyogram (EMG), were considered to obtain the optimal fusions of the PSG signals, where 63 features were extracted. These include frequency-based, time-based, statistical-based, entropy-based, and non-linear-based features. We adopted the ReliefF (ReF) feature selection algorithms to find the suitable parts for each signal and superposition of PSG signals. Twelve top features were selected while correlated with the extracted feature sets' sleep stages. The selected features were fed into the AdaBoost with Random Forest (ADB + RF) classifier to validate the chosen segments and classify the sleep stages. This study's experiments were investigated by obtaining two testing schemes: epoch-wise testing and subject-wise testing. The suggested research was conducted using three publicly available datasets: ISRUC-Sleep subgroup1 (ISRUC-SG1), sleep-EDF(S-EDF), Physio bank CAP sleep database (PB-CAPSDB), and S-EDF-78 respectively. This work demonstrated that the proposed fusion strategy overestimates the common individual usage of PSG signals.
Collapse
Affiliation(s)
- Santosh Kumar Satapathy
- Department of Information and Communication Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, 382007, India.
| | - Biswajit Brahma
- McKesson Corporation, 1 Post St, San Francisco, CA, 94104, USA
| | - Baidyanath Panda
- LTIMindtree, 1 American Row, 3Rd Floor, Hartford, CT, 06103, USA
| | - Paolo Barsocchi
- Institute of Information Science and Technologies, National Research Council, 56124, Pisa, Italy.
| | - Akash Kumar Bhoi
- Directorate of Research, Sikkim Manipal University, Gangtok, 737102, Sikkim, India.
| |
Collapse
|
6
|
Li Y, Chen J, Ma W, Zhao G, Fan X. MVF-SleepNet: Multi-View Fusion Network for Sleep Stage Classification. IEEE J Biomed Health Inform 2024; 28:2485-2495. [PMID: 36129857 DOI: 10.1109/jbhi.2022.3208314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Sleep stage classification is of great importance in human health monitoring and disease diagnosing. Clinically, visual-inspected classifying sleep into different stages is quite time consuming and highly relies on the expertise of sleep specialists. Many automated models for sleep stage classification have been proposed in previous studies but their performances still exist a gap to the real clinical application. In this work, we propose a novel multi-view fusion network named MVF-SleepNet based on multi-modal physiological signals of electroencephalography (EEG), electrocardiography (ECG), electrooculography (EOG), and electromyography (EMG). To capture the relationship representation among multi-modal physiological signals, we construct two views of Time-frequency images (TF images) and Graph-learned graphs (GL graphs). To learn the spectral-temporal representation from sequentially timed TF images, the combination of VGG-16 and GRU networks is utilized. To learn the spatial-temporal representation from sequentially timed GL graphs, the combination of Chebyshev graph convolution and temporal convolution networks is employed. Fusing the spectral-temporal representation and spatial-temporal representation can further boost the performance of sleep stage classification. A large number of experiment results on the publicly available datasets of ISRUC-S1 and ISRUC-S3 show that the MVF-SleepNet achieves overall accuracy of 0.821, F1 score of 0.802 and Kappa of 0.768 on ISRUC-S1 dataset, and accuracy of 0.841, F1 score of 0.828 and Kappa of 0.795 on ISRUC-S3 dataset. The MVF-SleepNet achieves competitive results on both datasets of ISRUC-S1 and ISRUC-S3 for sleep stage classification compared to the state-of-the-art baselines. The source code of MVF-SleepNet is available on Github (https://github.com/YJPai65/MVF-SleepNet).
Collapse
|
7
|
Radhakrishnan BL, Ezra K, Jebadurai IJ, Selvakumar I, Karthikeyan P. An Autonomous Sleep-Stage Detection Technique in Disruptive Technology Environment. SENSORS (BASEL, SWITZERLAND) 2024; 24:1197. [PMID: 38400354 PMCID: PMC10892786 DOI: 10.3390/s24041197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 02/07/2024] [Accepted: 02/08/2024] [Indexed: 02/25/2024]
Abstract
Autonomous sleep tracking at home has become inevitable in today's fast-paced world. A crucial aspect of addressing sleep-related issues involves accurately classifying sleep stages. This paper introduces a novel approach PSO-XGBoost, combining particle swarm optimisation (PSO) with extreme gradient boosting (XGBoost) to enhance the XGBoost model's performance. Our model achieves improved overall accuracy and faster convergence by leveraging PSO to fine-tune hyperparameters. Our proposed model utilises features extracted from EEG signals, spanning time, frequency, and time-frequency domains. We employed the Pz-oz signal dataset from the sleep-EDF expanded repository for experimentation. Our model achieves impressive metrics through stratified-K-fold validation on ten selected subjects: 95.4% accuracy, 95.4% F1-score, 95.4% precision, and 94.3% recall. The experiment results demonstrate the effectiveness of our technique, showcasing an average accuracy of 95%, outperforming traditional machine learning classifications. The findings revealed that the feature-shifting approach supplements the classification outcome by 3 to 4 per cent. Moreover, our findings suggest that prefrontal EEG derivations are ideal options and could open up exciting possibilities for using wearable EEG devices in sleep monitoring. The ease of obtaining EEG signals with dry electrodes on the forehead enhances the feasibility of this application. Furthermore, the proposed method demonstrates computational efficiency and holds significant value for real-time sleep classification applications.
Collapse
Affiliation(s)
- Baskaran Lizzie Radhakrishnan
- Department of Computer Science and Engineering, Karunya Institute of Technology and Sciences, Coimbatore 641114, India; (B.L.R.); (I.J.J.)
| | - Kirubakaran Ezra
- Department of Computer Science and Engineering, Grace College of Engineering, Coimbatore 628005, India;
| | - Immanuel Johnraja Jebadurai
- Department of Computer Science and Engineering, Karunya Institute of Technology and Sciences, Coimbatore 641114, India; (B.L.R.); (I.J.J.)
| | - Immanuel Selvakumar
- Department of Electrical and Electronics Engineering, Karunya Institute of Technology and Sciences, Coimbatore 641114, India;
| | | |
Collapse
|
8
|
Zhang Z, Lin BS, Peng CW, Lin BS. Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2096-2105. [PMID: 38848223 DOI: 10.1109/tnsre.2024.3394738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2024]
Abstract
Sleep staging serves as a fundamental assessment for sleep quality measurement and sleep disorder diagnosis. Although current deep learning approaches have successfully integrated multimodal sleep signals, enhancing the accuracy of automatic sleep staging, certain challenges remain, as follows: 1) optimizing the utilization of multi-modal information complementarity, 2) effectively extracting both long- and short-range temporal features of sleep information, and 3) addressing the class imbalance problem in sleep data. To address these challenges, this paper proposes a two-stream encode-decoder network, named TSEDSleepNet, which is inspired by the depth sensitive attention and automatic multi-modal fusion (DSA2F) framework. In TSEDSleepNet, a two-stream encoder is used to extract the multiscale features of electrooculogram (EOG) and electroencephalogram (EEG) signals. And a self-attention mechanism is utilized to fuse the multiscale features, generating multi-modal saliency features. Subsequently, the coarser-scale construction module (CSCM) is adopted to extract and construct multi-resolution features from the multiscale features and the salient features. Thereafter, a Transformer module is applied to capture both long- and short-range temporal features from the multi-resolution features. Finally, the long- and short-range temporal features are restored with low-layer details and mapped to the predicted classification results. Additionally, the Lovász loss function is applied to alleviate the class imbalance problem in sleep datasets. Our proposed method was tested on the Sleep-EDF-39 and Sleep-EDF-153 datasets, and it achieved classification accuracies of 88.9% and 85.2% and Macro-F1 scores of 84.8% and 79.7%, respectively, thus outperforming conventional traditional baseline models. These results highlight the efficacy of the proposed method in fusing multi-modal information. This method has potential for application as an adjunct tool for diagnosing sleep disorders.
Collapse
|
9
|
Huang X, Schmelter F, Irshad MT, Piet A, Nisar MA, Sina C, Grzegorzek M. Optimizing sleep staging on multimodal time series: Leveraging borderline synthetic minority oversampling technique and supervised convolutional contrastive learning. Comput Biol Med 2023; 166:107501. [PMID: 37742416 DOI: 10.1016/j.compbiomed.2023.107501] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 08/15/2023] [Accepted: 09/15/2023] [Indexed: 09/26/2023]
Abstract
Sleep is an important research area in nutritional medicine that plays a crucial role in human physical and mental health restoration. It can influence diet, metabolism, and hormone regulation, which can affect overall health and well-being. As an essential tool in the sleep study, the sleep stage classification provides a parsing of sleep architecture and a comprehensive understanding of sleep patterns to identify sleep disorders and facilitate the formulation of targeted sleep interventions. However, the class imbalance issue is typically salient in sleep datasets, which severely affects classification performances. To address this issue and to extract optimal multimodal features of EEG, EOG, and EMG that can improve the accuracy of sleep stage classification, a Borderline Synthetic Minority Oversampling Technique (B-SMOTE)-Based Supervised Convolutional Contrastive Learning (BST-SCCL) is proposed, which can avoid the risk of data mismatch between various sleep knowledge domains (varying health conditions and annotation rules) and strengthening learning characteristics of the N1 stage from the pair-wise segments comparison strategy. The lightweight residual network architecture with a novel truncated cross-entropy loss function is designed to accommodate multimodal time series and boost the training speed and performance stability. The proposed model has been validated on four well-known public sleep datasets (Sleep-EDF-20, Sleep-EDF-78, ISRUC-1, and ISRUC-3) and its superior performance (overall accuracy of 91.31-92.34%, MF1 of 88.21-90.08%, and Cohen's Kappa coefficient k of 0.87-0.89) has further demonstrated its effectiveness. It shows the great potential of contrastive learning for cross-domain knowledge interaction in precision medicine.
Collapse
Affiliation(s)
- Xinyu Huang
- Institute of Medical Informatics, University of Lübeck, Germany.
| | - Franziska Schmelter
- Institute of Nutritional Medicine, University of Lübeck and University Medical Center Schleswig-Holstein, Lübeck, Germany.
| | | | - Artur Piet
- Institute of Medical Informatics, University of Lübeck, Germany.
| | | | - Christian Sina
- Institute of Nutritional Medicine, University of Lübeck and University Medical Center Schleswig-Holstein, Lübeck, Germany; Fraunhofer Research Institution for Individualized and Cell-Based Medical Engineering (IMTE), Lübeck, Germany.
| | - Marcin Grzegorzek
- Institute of Medical Informatics, University of Lübeck, Germany; Fraunhofer Research Institution for Individualized and Cell-Based Medical Engineering (IMTE), Lübeck, Germany.
| |
Collapse
|
10
|
Zan H, Yildiz A. Multi-task learning for arousal and sleep stage detection using fully convolutional networks. J Neural Eng 2023; 20:056034. [PMID: 37769664 DOI: 10.1088/1741-2552/acfe3a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 09/28/2023] [Indexed: 10/03/2023]
Abstract
Objective.Sleep is a critical physiological process that plays a vital role in maintaining physical and mental health. Accurate detection of arousals and sleep stages is essential for the diagnosis of sleep disorders, as frequent and excessive occurrences of arousals disrupt sleep stage patterns and lead to poor sleep quality, negatively impacting physical and mental health. Polysomnography is a traditional method for arousal and sleep stage detection that is time-consuming and prone to high variability among experts.Approach. In this paper, we propose a novel multi-task learning approach for arousal and sleep stage detection using fully convolutional neural networks. Our model, FullSleepNet, accepts a full-night single-channel EEG signal as input and produces segmentation masks for arousal and sleep stage labels. FullSleepNet comprises four modules: a convolutional module to extract local features, a recurrent module to capture long-range dependencies, an attention mechanism to focus on relevant parts of the input, and a segmentation module to output final predictions.Main results.By unifying the two interrelated tasks as segmentation problems and employing a multi-task learning approach, FullSleepNet achieves state-of-the-art performance for arousal detection with an area under the precision-recall curve of 0.70 on Sleep Heart Health Study and Multi-Ethnic Study of Atherosclerosis datasets. For sleep stage classification, FullSleepNet obtains comparable performance on both datasets, achieving an accuracy of 0.88 and an F1-score of 0.80 on the former and an accuracy of 0.83 and an F1-score of 0.76 on the latter.Significance. Our results demonstrate that FullSleepNet offers improved practicality, efficiency, and accuracy for the detection of arousal and classification of sleep stages using raw EEG signals as input.
Collapse
Affiliation(s)
- Hasan Zan
- Vocational School, Mardin Artuklu University, Mardin, Turkey
| | - Abdulnasır Yildiz
- Department of Electrical and Electronics Engineering, Dicle University, Diyarbakir, Turkey
| |
Collapse
|
11
|
Li W, Gao J. Automatic sleep staging by a hybrid model based on deep 1D-ResNet-SE and LSTM with single-channel raw EEG signals. PeerJ Comput Sci 2023; 9:e1561. [PMID: 37810362 PMCID: PMC10557479 DOI: 10.7717/peerj-cs.1561] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 08/10/2023] [Indexed: 10/10/2023]
Abstract
Sleep staging is crucial for assessing sleep quality and diagnosing sleep disorders. Recent advances in deep learning methods with electroencephalogram (EEG) signals have shown remarkable success in automatic sleep staging. However, the use of deeper neural networks may lead to the issues of gradient disappearance and explosion, while the non-stationary nature and low signal-to-noise ratio of EEG signals can negatively impact feature representation. To overcome these challenges, we proposed a novel lightweight sequence-to-sequence deep learning model, 1D-ResNet-SE-LSTM, to classify sleep stages into five classes using single-channel raw EEG signals. Our proposed model consists of two main components: a one-dimensional residual convolutional neural network with a squeeze-and-excitation module to extract and reweight features from EEG signals, and a long short-term memory network to capture the transition rules among sleep stages. In addition, we applied the weighted cross-entropy loss function to alleviate the class imbalance problem. We evaluated the performance of our model on two publicly available datasets; Sleep-EDF Expanded consists of 153 overnight PSG recordings collected from 78 healthy subjects and ISRUC-Sleep includes 100 PSG recordings collected from 100 subjects diagnosed with various sleep disorders, and obtained an overall accuracy rate of 86.39% and 81.97%, respectively, along with corresponding macro average F1-scores of 81.95% and 79.94%. Our model outperforms existing sleep staging models in terms of overall performance metrics and per-class F1-scores for several sleep stages, particularly for the N1 stage, where it achieves F1-scores of 59.00% and 55.53%. The kappa coefficient is 0.812 and 0.766 for the Sleep-EDF Expanded and ISRUC-Sleep datasets, respectively, indicating strong agreement with certified sleep experts. We also investigated the effect of different weight coefficient combinations and sequence lengths of EEG epochs used as input to the model on its performance. Furthermore, the ablation study was conducted to evaluate the contribution of each component to the model's performance. The results demonstrate the effectiveness and robustness of the proposed model in classifying sleep stages, and highlights its potential to reduce human clinicians' workload, making sleep assessment and diagnosis more effective. However, the proposed model is subject to several limitations. Firstly, the model is a sequence-to-sequence network, which requires input sequences of EEG epochs. Secondly, the weight coefficients in the loss function could be further optimized to balance the classification performance of each sleep stage. Finally, apart from the channel attention mechanism, incorporating more advanced attention mechanisms could enhance the model's effectiveness.
Collapse
Affiliation(s)
- Weiming Li
- Shanghai Nuanhe Brain Technology Co. Ltd., Shanghai, China
| | - Junhui Gao
- Shanghai Nuanhe Brain Technology Co. Ltd., Shanghai, China
| |
Collapse
|
12
|
Ji X, Li Y, Wen P. 3DSleepNet: A Multi-Channel Bio-Signal Based Sleep Stages Classification Method Using Deep Learning. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3513-3523. [PMID: 37639413 DOI: 10.1109/tnsre.2023.3309542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
A novel multi-channel-based 3D convolutional neural network (3D-CNN) is proposed in this paper to classify sleep stages. Time domain features, frequency domain features, and time-frequency domain features are extracted from electroencephalography (EEG), electromyogram (EMG), and electrooculogram (EOG) channels and fed into the 3D-CNN model to classify sleep stages. Intrinsic connections among different bio-signals and different frequency bands in time series and time-frequency are learned by 3D convolutional layers, while the frequency relations are learned by 2D convolutional layers. Partial dot-product attention layers help this model find the most important channels and frequency bands in different sleep stages. A long short-term memory unit is added to learn the transition rules among neighboring epochs. Classification experiments were conducted using both ISRUC-S3 datasets and ISRUC-S1, sleep-disorder datasets. The experimental results showed that the overall accuracy achieved 0.832 and the F1-score and Cohen's kappa reached 0.814 and 0.783, respectively, on ISRUC-S3, which are a competitive classification performance with the state-of-the-art baselines. The overall accuracy, F1-score, and Cohen's kappa on ISRUC-S1 achieved 0.820, 0.797, and 0.768, respectively, which also demonstrate its generality on unhealthy subjects. Further experiments were conducted on ISRUC-S3 subset to evaluate its training time. The training time on 10 subjects from ISRUC-S3 with 8549 epochs is 4493s, which indicates its highest calculation speed compared with the existing high-performance graph convolutional networks and [Formula: see text]Net architecture algorithms.
Collapse
|
13
|
Jin Z, Jia K. A temporal multi-scale hybrid attention network for sleep stage classification. Med Biol Eng Comput 2023; 61:2291-2303. [PMID: 36997808 DOI: 10.1007/s11517-023-02808-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 02/13/2023] [Indexed: 04/01/2023]
Abstract
Sleep is crucial for human health. Automatic sleep stage classification based on polysomnogram (PSG) is meaningful for the diagnosis of sleep disorders, which has attracted extensive attention in recent years. Most existing methods could not fully consider the different transitions of sleep stages and fit the visual inspection of sleep experts simultaneously. To this end, we propose a temporal multi-scale hybrid attention network, namely TMHAN, to automatically achieve sleep staging. The temporal multi-scale mechanism incorporates short-term abrupt and long-term periodic transitions of the successive PSG epochs. Furthermore, the hybrid attention mechanism includes 1-D local attention, 2-D global attention, and 2-D contextual sparse multi-head self-attention for three kinds of sequence-level representations. The concatenated representation is subsequently fed into a softmax layer to train an end-to-end model. Experimental results on two benchmark sleep datasets show that TMHAN obtains the best performance compared with several baselines, demonstrating the effectiveness of our model. In general, our work not only provides good classification performance, but also fits the actual sleep staging processes, which makes contribution for the combination of deep learning and sleep medicine.
Collapse
Affiliation(s)
- Zheng Jin
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
- Beijing Laboratory of Advanced Information Networks, Beijing, 100124, China
| | - Kebin Jia
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China.
- Beijing Laboratory of Advanced Information Networks, Beijing, 100124, China.
| |
Collapse
|
14
|
Huang X, Shirahama K, Irshad MT, Nisar MA, Piet A, Grzegorzek M. Sleep Stage Classification in Children Using Self-Attention and Gaussian Noise Data Augmentation. SENSORS (BASEL, SWITZERLAND) 2023; 23:3446. [PMID: 37050506 PMCID: PMC10098613 DOI: 10.3390/s23073446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 03/20/2023] [Accepted: 03/22/2023] [Indexed: 06/19/2023]
Abstract
The analysis of sleep stages for children plays an important role in early diagnosis and treatment. This paper introduces our sleep stage classification method addressing the following two challenges: the first is the data imbalance problem, i.e., the highly skewed class distribution with underrepresented minority classes. For this, a Gaussian Noise Data Augmentation (GNDA) algorithm was applied to polysomnography recordings to seek the balance of data sizes for different sleep stages. The second challenge is the difficulty in identifying a minority class of sleep stages, given their short sleep duration and similarities to other stages in terms of EEG characteristics. To overcome this, we developed a DeConvolution- and Self-Attention-based Model (DCSAM) which can inverse the feature map of a hidden layer to the input space to extract local features and extract the correlations between all possible pairs of features to distinguish sleep stages. The results on our dataset show that DCSAM based on GNDA obtains an accuracy of 90.26% and a macro F1-score of 86.51% which are higher than those of our previous method. We also tested DCSAM on a well-known public dataset-Sleep-EDFX-to prove whether it is applicable to sleep data from adults. It achieves a comparable performance to state-of-the-art methods, especially accuracies of 91.77%, 92.54%, 94.73%, and 95.30% for six-stage, five-stage, four-stage, and three-stage classification, respectively. These results imply that our DCSAM based on GNDA has a great potential to offer performance improvements in various medical domains by considering the data imbalance problems and correlations among features in time series data.
Collapse
Affiliation(s)
- Xinyu Huang
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Kimiaki Shirahama
- Department of Informatics, Kindai University, 3-4-1 Kowakae, Higashiosaka City 577-8502, Osaka, Japan
| | - Muhammad Tausif Irshad
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of IT, University of the Punjab, Lahore 54000, Pakistan
| | | | - Artur Piet
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Marcin Grzegorzek
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of Knowledge Engineering, University of Economics, Bogucicka 3, 40287 Katowice, Poland
| |
Collapse
|
15
|
Al-Salman W, Li Y, Oudah AY, Almaged S. Sleep stage classification in EEG signals using the clustering approach based probability distribution features coupled with classification algorithms. Neurosci Res 2023; 188:51-67. [PMID: 36152918 DOI: 10.1016/j.neures.2022.09.009] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 08/20/2022] [Accepted: 09/20/2022] [Indexed: 10/14/2022]
Abstract
Sleep scoring is one of the primary tasks for the classification of sleep stages in Electroencephalogram (EEG) signals. Manual visual scoring of sleep stages is time-consuming as well as being dependent on the experience of a highly qualified sleep expert. This paper aims to address these issues by developing a new method to automatically classify sleep stages in EEG signals. In this research, a robust method has been presented based on the clustering approach, coupled with probability distribution features, to identify six sleep stages with the use of EEG signals. Using this method, each 30-second EEG signal is firstly segmented into small epochs and then each epoch is divided into 60 sub-segments. Each sub-segment is decomposed into five levels by using a discrete wavelet transform (DWT) to obtain the approximation and detailed coefficient. The wavelet coefficient of each level is clustered using the k-means algorithm. Subsequently, features are extracted based on the probability distribution for each wavelet coefficient. The extracted features then are forwarded to the least squares support vector machine classifier (LS-SVM) to identify sleep stages. Comparisons with several existing methods are also made in this study. The proposed method for the classification of the sleep stages achieves an average accuracy rate of 97.4%. It can be an effective tool for sleep stages classification and can be useful for doctors and neurologists for diagnosing sleep disorders.
Collapse
Affiliation(s)
- Wessam Al-Salman
- School of Mathematics, Physics and Computing, University of Southern Queensland, Australia; University of Thi-Qar, College of Education for Pure Science, Iraq.
| | - Yan Li
- School of Mathematics, Physics and Computing, University of Southern Queensland, Australia; School of Electrical and Electronic Engineering, Hubei University of Technology, Wuhan, China
| | - Atheer Y Oudah
- University of Thi-Qar, College of Education for Pure Science, Iraq; Information and Communication Technology Research Group, Scientific Research Centre, Al-Ayen University, Thi-Qar, Iraq
| | | |
Collapse
|
16
|
Luo Y, Li J, He K, Cheuk W. A Hierarchical Attention-Based Method for Sleep Staging Using Movement and Cardiopulmonary Signals. IEEE J Biomed Health Inform 2023; 27:1354-1363. [PMID: 37015702 DOI: 10.1109/jbhi.2022.3228341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Sleep monitoring typically requires the uncomfortable and expensive polysomnography (PSG) test to determine the sleep stages. Body movement and cardiopulmonary signals provide an alternative way to perform sleep staging. In recent years, long-short term memory (LSTM) networks and convolutional neural networks (CNN) have dominated automatic sleep staging due to their better learning ability than machine learning classifiers. However, LSTM may lose information when dealing with long sequences, while CNN is not good at sequence modeling. As an improvement, we develop a hierarchical attention-based deep learning method for sleep staging using body movement, electrocardiogram (ECG), and abdominal breathing signals. We apply the multi-head self-attention to model the global context of feature sequences and coupled it with CNN to achieve a hierarchical self-attention weight assignment. We evaluate the performance of the method using two public datasets. Our method outperforms other baselines in the three sleep stages, achieving an accuracy of 84.3$\%$, an F1 score of 0.8038, and a Cohen's Kappa coefficient of 0.7036. The result demonstrates the effectiveness of the hierarchical self-attention mechanism when processing feature sequences in the sleep stage classification problem. This paper provides new possibilities for long-term sleep monitoring using movement and cardiopulmonary signals obtained from non-invasive devices.
Collapse
|
17
|
Abdulla S, Diykh M, Siuly S, Ali M. An intelligent model involving multi-channels spectrum patterns based features for automatic sleep stage classification. Int J Med Inform 2023; 171:105001. [PMID: 36708665 DOI: 10.1016/j.ijmedinf.2023.105001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Revised: 01/05/2023] [Accepted: 01/14/2023] [Indexed: 01/21/2023]
Abstract
Effective sleep monitoring from electroencephalogram (EEG) signals is meaningful for the diagnosis of sleep disorders, such as sleep Apnea, Insomnia, Snoring, Sleep Hypoventilation, and restless legs syndrome. Hence, developing an automatic sleep stage scoring method based on EEGs has attracted extensive research attention in recent years. The existing methods of sleep stage classification are insufficient to investigate waveform patterns, texture patterns, and temporal transformation of EEG signals, which are most associated with sleep stages scoring. To address these issues, we proposed an intelligence model based on multi-channels texture colour analysis to automatically classify sleep staging. In the proposed model, a short-time Fourier transform is applied to each EEG 30 s segment to convert it into an image form. Then the resulted spectrum image is analysed using Multiple channels Information Local Binary Pattern (MILBP). The extracted information using MILBP is then deployed to differentiate EEG sleep stages. The extracted features are tested, and the most effective ones are used to the represented EEG sleep stages. The selected characteristics are fed to an ensemble classifier integrated with a genetic algorithm which is used to select the optimal weight for each classifier, to classify EEG signal into designated sleep stages. The experimental results on two benchmark sleep datasets showed that the proposed model obtained the best performance compared with several baseline methods, including accuracy of 0.96 and 0.95, and F1-score of 0.94 and 0.93, thus demonstrating the effectiveness of our proposed model.
Collapse
Affiliation(s)
- Shahab Abdulla
- UinSQ College, University of Southern Queensland, QLD, Australia; Information and Communication Technology Research Group, Scientific Research Centre, Al-Ayen University, Iraq.
| | - Mohammed Diykh
- University of Thi-Qar, College of Education for Pure Science, Iraq; Information and Communication Technology Research Group, Scientific Research Centre, Al-Ayen University, Iraq.
| | - Siuly Siuly
- Institute for Sustainable Industries & Liveable Cities, Victoria University, Australia.
| | - Mumtaz Ali
- UinSQ College, University of Southern Queensland, QLD, Australia.
| |
Collapse
|
18
|
Do not sleep on traditional machine learning. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
19
|
Fu G, Zhou Y, Gong P, Wang P, Shao W, Zhang D. A Temporal-Spectral Fused and Attention-Based Deep Model for Automatic Sleep Staging. IEEE Trans Neural Syst Rehabil Eng 2023; 31:1008-1018. [PMID: 37022069 DOI: 10.1109/tnsre.2023.3238852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
Sleep staging is a vital process for evaluating sleep quality and diagnosing sleep-related diseases. Most of the existing automatic sleep staging methods focus on time-domain information and often ignore the transformation relationship between sleep stages. To deal with the above problems, we propose a Temporal-Spectral fused and Attention-based deep neural Network model (TSA-Net) for automatic sleep staging, using a single-channel electroencephalogram (EEG) signal. The TSA-Net is composed of a two-stream feature extractor, feature context learning, and conditional random field (CRF). Specifically, the two-stream feature extractor module can automatically extract and fuse EEG features from time and frequency domains, considering that both temporal and spectral features can provide abundant distinguishing information for sleep staging. Subsequently, the feature context learning module learns the dependencies between features using the multi-head self-attention mechanism and outputs a preliminary sleep stage. Finally, the CRF module further applies transition rules to improve classification performance. We evaluate our model on two public datasets, Sleep-EDF-20 and Sleep-EDF-78. In terms of accuracy, the TSA-Net achieves 86.64% and 82.21% on the Fpz-Cz channel, respectively. The experimental results illustrate that our TSA-Net can optimize the performance of sleep staging and achieve better staging performance than state-of-the-art methods.
Collapse
|
20
|
Radhakrishnan B. L., Ezra K, Jebadurai IJ. Feature Extraction From Single-Channel EEG Using Tsfresh and Stacked Ensemble Approach for Sleep Stage Classification. INTERNATIONAL JOURNAL OF E-COLLABORATION 2023. [DOI: 10.4018/ijec.316774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
The smart world under Industry 4.0 is witnessing a notable spurt in sleep disorders and sleep-related issues in patients. Artificial intelligence and IoT are taking a giant leap in connecting sleep patients remotely with healthcare providers. The contemporary single-channel-based monitoring devices play a tremendous role in predicting sleep quality and related issues. Handcrafted feature extraction is a time-consuming job in machine learning-based automatic sleep classification. The proposed single-channel work uses Tsfresh to extract features from both the EEG channels (Pz-oz and Fpz-Cz) of the SEDFEx database individually to realise a single-channel EEG. The adopted mRMR feature selection approach selected 55 features from the extracted 787 features. A stacking ensemble classifier achieved 95%, 94%, 91%, and 88% accuracy using stratified 5-fold validation in 2, 3, 4, and 5 class classification employing healthy subjects data. The outcome of the experiments indicates that Tsfresh is an excellent tool to extract standard features from EEG signals.
Collapse
Affiliation(s)
- Radhakrishnan B. L.
- Department of Computer Science and Engineering, Karunya Institute of Technology and Sciences, Coimbatore, India
| | - Kirubakaran Ezra
- Department of Computer Science and Engineering, GRACE College of Engineering, Thoothukudi, India
| | - Immanuel Johnraja Jebadurai
- Department of Computer Science and Engineering, Karunya Institute of Technology and Sciences, Coimbatore, India
| |
Collapse
|
21
|
ElMoaqet H, Eid M, Ryalat M, Penzel T. A Deep Transfer Learning Framework for Sleep Stage Classification with Single-Channel EEG Signals. SENSORS (BASEL, SWITZERLAND) 2022; 22:8826. [PMID: 36433422 PMCID: PMC9693852 DOI: 10.3390/s22228826] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 11/07/2022] [Accepted: 11/08/2022] [Indexed: 06/16/2023]
Abstract
The polysomnogram (PSG) is the gold standard for evaluating sleep quality and disorders. Attempts to automate this process have been hampered by the complexity of the PSG signals and heterogeneity among subjects and recording hardwares. Most of the existing methods for automatic sleep stage scoring rely on hand-engineered features that require prior knowledge of sleep analysis. This paper presents an end-to-end deep transfer learning framework for automatic feature extraction and sleep stage scoring based on a single-channel EEG. The proposed framework was evaluated over the three primary signals recommended by the American Academy of Sleep Medicine (C4-M1, F4-M1, O2-M1) from two data sets that have different properties and are recorded with different hardware. Different Time-Frequency (TF) imaging approaches were evaluated to generate TF representations for the 30 s EEG sleep epochs, eliminating the need for complex EEG signal pre-processing or manual feature extraction. Several training and detection scenarios were investigated using transfer learning of convolutional neural networks (CNN) and combined with recurrent neural networks. Generating TF images from continuous wavelet transform along with a deep transfer architecture composed of a pre-trained GoogLeNet CNN followed by a bidirectional long short-term memory (BiLSTM) network showed the best scoring performance among all tested scenarios. Using 20-fold cross-validation applied on the C4-M1 channel, the proposed framework achieved an average per-class accuracy of 91.2%, sensitivity of 77%, specificity of 94.1%, and precision of 75.9%. Our results demonstrate that without changing the model architecture and the training algorithm, our model could be applied to different single-channel EEGs from different data sets. Most importantly, the proposed system receives a single EEG epoch as an input at a time and produces a single corresponding output label, making it suitable for real time monitoring outside sleep labs as well as to help sleep lab specialists arrive at a more accurate diagnoses.
Collapse
Affiliation(s)
- Hisham ElMoaqet
- Department of Mechatronics Engineering, German Jordanian University, Amman 11180, Jordan
| | - Mohammad Eid
- Department of Biomedical Engineering, German Jordanian University, Amman 11180, Jordan
| | - Mutaz Ryalat
- Department of Mechatronics Engineering, German Jordanian University, Amman 11180, Jordan
| | - Thomas Penzel
- Interdisciplinary Center of Sleep Medicine, Charité-Universitätsmedizin Berlin, 10117 Berlin, Germany
| |
Collapse
|
22
|
Kim H, Lee SM, Choi S. Automatic sleep stages classification using multi-level fusion. Biomed Eng Lett 2022; 12:413-420. [PMID: 36238370 PMCID: PMC9550904 DOI: 10.1007/s13534-022-00244-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Revised: 07/12/2022] [Accepted: 07/25/2022] [Indexed: 10/15/2022] Open
Abstract
Sleep efficiency is a factor that can determine a person's healthy life. Sleep efficiency can be calculated by analyzing the results of the sleep stage classification. There have been many studies to classify sleep stages automatically using multiple signals to improve the accuracy of the sleep stage classification. The fusion method is used to process multi-signal data. Fusion methods include data-level fusion, feature-level fusion, and decision-level fusion methods. We propose a multi-level fusion method to increase the accuracy of the sleep stage classification when using multi-signal data consisting of electroencephalography and electromyography signals. First, we used feature-level fusion to fuse the extracted features using a convolutional neural network for multi-signal data. Then, after obtaining each classified result using the fused feature data, the sleep stage was derived using a decision-level fusion method that fused classified results. We used public datasets, Sleep-EDF, to measure performance; we confirmed that the proposed multi-level fusion method yielded a higher accuracy of 87.2%, respectively, compared to single-level fusion method and more existing methods. The proposed multi-level fusion method showed the most improved performance in classifying N1 stage, where existing methods had the lowest performance.
Collapse
Affiliation(s)
- Hyungjik Kim
- Department of Secured Smart Electric Vehicle, Kookmin University, 02707 Seoul, Korea
| | - Seung Min Lee
- Department of Electrical Engineering, Kookmin University, 02707 Seoul, Korea
| | - Sunwoong Choi
- Department of Electrical Engineering, Kookmin University, 02707 Seoul, Korea
| |
Collapse
|
23
|
L-Tetrolet Pattern-Based Sleep Stage Classification Model Using Balanced EEG Datasets. Diagnostics (Basel) 2022; 12:diagnostics12102510. [PMID: 36292199 PMCID: PMC9600064 DOI: 10.3390/diagnostics12102510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 10/10/2022] [Accepted: 10/13/2022] [Indexed: 11/24/2022] Open
Abstract
Background: Sleep stage classification is a crucial process for the diagnosis of sleep or sleep-related diseases. Currently, this process is based on manual electroencephalogram (EEG) analysis, which is resource-intensive and error-prone. Various machine learning models have been recommended to standardize and automate the analysis process to address these problems. Materials and methods: The well-known cyclic alternating pattern (CAP) sleep dataset is used to train and test an L-tetrolet pattern-based sleep stage classification model in this research. By using this dataset, the following three cases are created, and they are: Insomnia, Normal, and Fused cases. For each of these cases, the machine learning model is tasked with identifying six sleep stages. The model is structured in terms of feature generation, feature selection, and classification. Feature generation is established with a new L-tetrolet (Tetris letter) function and multiple pooling decomposition for level creation. We fuse ReliefF and iterative neighborhood component analysis (INCA) feature selection using a threshold value. The hybrid and iterative feature selectors are named threshold selection-based ReliefF and INCA (TSRFINCA). The selected features are classified using a cubic support vector machine. Results: The presented L-tetrolet pattern and TSRFINCA-based sleep stage classification model yield 95.43%, 91.05%, and 92.31% accuracies for Insomnia, Normal dataset, and Fused cases, respectively. Conclusion: The recommended L-tetrolet pattern and TSRFINCA-based model push the envelope of current knowledge engineering by accurately classifying sleep stages even in the presence of sleep disorders.
Collapse
|
24
|
Xu W. Reflections on the Discipline Construction Environment of World Literature and Comparative Literature in the Era of Big Data Analysis. JOURNAL OF ENVIRONMENTAL AND PUBLIC HEALTH 2022; 2022:2786610. [PMID: 36120150 PMCID: PMC9473910 DOI: 10.1155/2022/2786610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/26/2022] [Revised: 07/16/2022] [Accepted: 07/18/2022] [Indexed: 11/18/2022]
Abstract
Comparative literature and world literature were originally two independent disciplines, but now they are merged into one. In the era of big data, building an efficient information management method is one of the important contents of university reform. Based on the construction of comparative literature and world literature, this paper applies the DSS (Decision Support System) structure based on data warehouse to the construction of comparative literature and world literature, and constructs the DSS structure of comparative literature and world literature. The related knowledge of DM (data mining) is used for research, and the application design and implementation process of DM are introduced into the subject quality evaluation system. The research shows that the experimental results of NB (Naive Bayes) algorithm will not take too long, about 56.08 s, and the compression ratio is 0.897, when the parameters are basically the same. This model can effectively help schools to analyze data and make decisions, and improve the level of information construction in schools.
Collapse
Affiliation(s)
- Wen Xu
- School of Chinese Language and Literature, Suzhou University of Science and Technology, Suzhou 215000, China
| |
Collapse
|
25
|
Tăuțan AM, Rossi AC, Ionescu B. Automatic sleep scoring with LSTM networks: impact of time granularity and input signals. BIOMED ENG-BIOMED TE 2022; 67:267-281. [PMID: 35660133 DOI: 10.1515/bmt-2021-0408] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 05/17/2022] [Indexed: 01/04/2025]
Abstract
Supervised automatic sleep scoring algorithms are usually trained using sleep stage labels manually annotated on 30 s epochs of PSG data. In this study, we investigate the impact of using shorter epochs with various PSG input signals for training and testing a Long Short Term Memory (LSTM) neural network. An LSTM model is evaluated on the provided 30 s epoch sleep stage labels from a publicly available dataset, as well as on 10 s subdivisions. Additionally, three independent scorers re-labeled a subset of the dataset on shorter time windows. The automatic sleep scoring experiments were repeated on the re-annotated subset.The highest performance is achieved on features extracted from 30 s epochs of a single channel frontal EEG. The resulting accuracy, precision and recall were of 92.22%, 67.58% and 66.00% respectively. When using a shorter epoch as input, the performance decreased by approximately 20%. Re-annotating a subset of the dataset on shorter time epochs did not improve the results and further altered the sleep stage detection performance. Our results show that our feature-based LSTM classification algorithm performs better on 30 s PSG epochs when compared to 10 s epochs used as input. Future work could be oriented to determining whether varying the epoch size improves classification outcomes for different types of classification algorithms.
Collapse
Affiliation(s)
- Alexandra-Maria Tăuțan
- University Politehnica of Bucharest, Bucharest, Romania
- Onera Health, Eindhoven, The Netherlands
| | | | | |
Collapse
|
26
|
Shen N, Luo T, Chen C, Zhang Y, Zhu H, Zhou Y, Wang Y, Chen W. Towards an automatic narcolepsy detection on ambiguous sleep staging and sleep transition dynamics joint model. J Neural Eng 2022; 19. [PMID: 36001951 DOI: 10.1088/1741-2552/ac8c6b] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Accepted: 08/24/2022] [Indexed: 11/11/2022]
Abstract
Objective.Mixing/dissociation of sleep stages in narcolepsy adds to the difficulty in automatic sleep staging. Moreover, automatic analytical studies for narcolepsy and multiple sleep latency test (MSLT) have only done automatic sleep staging without leveraging the sleep stage profile for further patient identification. This study aims to establish an automatic narcolepsy detection method for MSLT.Approach.We construct a two-phase model on MSLT recordings, where ambiguous sleep staging and sleep transition dynamics make joint efforts to address this issue. In phase 1, we extract representative features from electroencephalogram (EEG) and electrooculogram (EOG) signals. Then, the features are input to an EasyEnsemble classifier for automatic sleep staging. In phase 2, we investigate sleep transition dynamics, including sleep stage transitions and sleep stages, and output likelihood of narcolepsy by virtue of principal component analysis (PCA) and a logistic regression classifier. To demonstrate the proposed framework in clinical application, we conduct experiments on 24 participants from our hospital, considering ten patients with narcolepsy and fourteen patients with MSLT negative.Main results.Applying the two-phase leave-one-subject-out testing scheme, the model reaches an accuracy, sensitivity, and specificity of 87.5%, 80.0%, and 92.9% for narcolepsy detection. Influenced by disease pathology, accuracy of automatic sleep staging in narcolepsy appears to decrease compared to that in the non-narcoleptic population.Significance.This method can automatically and efficiently distinguish patients with narcolepsy based on MSLT. It probes into the amalgamation of automatic sleep staging and sleep transition dynamics for narcolepsy detection, which would assist clinic and neuroelectrophysiology specialists in visual interpretation and diagnosis.
Collapse
Affiliation(s)
- Ning Shen
- Fudan University School of Information Science and Engineering, 220 Handan Road, Yangpu District, Shanghai, China, 2005 Songhu Road, Yangpu District, Shanghai, China, Shanghai, 200433, CHINA
| | - Tian Luo
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Chen Chen
- Fudan University Human Phenome Institute, 825 Zhangheng Road, Pudong District, Shanghai, China, Shanghai, 201203, CHINA
| | - Yanjiong Zhang
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Hangyu Zhu
- Fudan University School of Information Science and Engineering, 220 Handan Road, Yangpu District, Shanghai, China, 2005 Songhu Road, Yangpu District, Shanghai, China, Shanghai, 200433, CHINA
| | - Yuanfeng Zhou
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Yi Wang
- Department of Neurology, Children's Hospital of Fudan University, 399 Wanyuan Road, Minhang District, Shanghai, China, Shanghai, 201102, CHINA
| | - Wei Chen
- Department of Electronic Engineering, Fudan University, 220 Handan Road, Yangpu District, Shanghai, China, 2005 Songhu Road, Yangpu District, Shanghai, China, Shanghai, Shanghai, 200433, CHINA
| |
Collapse
|
27
|
Huang Z, Wing-Kuen Ling B. Joint ensemble empirical mode decomposition and tunable Q factor wavelet transform based sleep stage classifications. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103760] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
28
|
A comprehensive evaluation of contemporary methods used for automatic sleep staging. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
29
|
Urtnasan E, Park JU, Joo EY, Lee KJ. Deep Convolutional Recurrent Model for Automatic Scoring Sleep Stages Based on Single-Lead ECG Signal. Diagnostics (Basel) 2022; 12:1235. [PMID: 35626390 PMCID: PMC9140070 DOI: 10.3390/diagnostics12051235] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 05/13/2022] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND Sleep stage scoring, which is an essential step in the quantitative analysis of sleep monitoring, relies on human experts and is therefore subjective and time-consuming; thus, an easy and accurate method is needed for the automatic scoring of sleep stages. METHODS In this study, we constructed a deep convolutional recurrent (DCR) model for the automatic scoring of sleep stages based on a raw single-lead electrocardiogram (ECG). The DCR model uses deep convolutional and recurrent neural networks to apply the complex and cyclic rhythms of human sleep. It consists of three convolutional and two recurrent layers and is optimized by dropout and batch normalization. The constructed DCR model was evaluated using multiclass classification, including five-class sleep stages (wake, N1, N2, N3, and rapid eye movement (REM)) and three-class sleep stages (wake, non-REM (NREM), and REM), using a raw single-lead ECG signal. The single-lead ECG signal was collected from 112 subjects in two groups: control (52 subjects) and sleep apnea (60 subjects). The single-lead ECG signal was preprocessed, segmented at a duration of 30 s, and divided into a training set of 89 subjects and test set of 23 subjects. RESULTS We achieved an overall accuracy of 74.2% for five classes and 86.4% for three classes. CONCLUSIONS These results show the DCR model's superior performance over those in the previous studies, highlighting that the model can be an alternative tool for sleep monitoring and sleep screening.
Collapse
Affiliation(s)
- Erdenebayar Urtnasan
- Artificial Intelligence Big Data Medical Center, Wonju College of Medicine, Yonsei University, Wonju 26417, Korea;
| | - Jong-Uk Park
- Department of Medical Artificial Intelligence, Medical Engineering College, Konyang University, Daejeon 35365, Korea;
| | - Eun Yeon Joo
- Department of Neurology, Samsung Medical Center, School of Medicine, Sungkyunkwan University, Suwon 16419, Korea;
| | - Kyoung-Joung Lee
- Department of Biomedical Engineering, College of Health Science, Yonsei University, Wonju 26493, Korea
| |
Collapse
|
30
|
Automated Classification of Sleep Stages Using Single-Channel EEG A Machine Learning-Based Method. INTERNATIONAL JOURNAL OF INFORMATION RETRIEVAL RESEARCH 2022. [DOI: 10.4018/ijirr.299941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The main contribution of this paper is to present a novel approach for classifying the sleep stages based on optimal feature selection with ensemble learning stacking model using single-channel EEG signals.To find the suitable features from extracted feature vector, we obtained the ReliefF (ReF), Fisher Score (FS) and Online Stream Feature Selection (OSFS) selection algorithms.The proposed research work was performed on two different subgroups of sleep data of ISRUC-Sleep dataset. The experimental results of the proposed methodology signify that single-channel of EEG signal superior to other machine learning classification models with overall accuracies of 97.93%, 97%, and 95.96% using ISRUC-Sleep subgroup-I (SG-I) data and similarly the proposed model achieved an overall accuracies of 98.16%, 98.78%, and 95.26% using ISRUC-Sleep subgroup-III (SG-III) data with FS, ReF and OSFS respectively.
Collapse
|
31
|
U. R, Neelappa N, H.M. H. Automatic diseases detection and classification of EEG signal with pervasive computing using machine learning. INTERNATIONAL JOURNAL OF PERVASIVE COMPUTING AND COMMUNICATIONS 2022. [DOI: 10.1108/ijpcc-09-2021-0216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Purpose
The natural control, feedback, stimuli and protection of these subsequent principles founded this project. Via properly conducted experiments, a multilayer computer rehabilitation system was created that integrated natural interaction assisted by electroencephalogram (EEG), which enabled the movements in the virtual environment and real wheelchair. For blind wheelchair operator patients, this paper involved of expounding the proper methodology. For educating the value of life and independence of blind wheelchair users, outcomes have proven that virtual reality (VR) with EEG signals has that potential.
Design/methodology/approach
Individuals face numerous challenges with many disorders, particularly when multiple dysfunctions are diagnosed and especially for visually effected wheelchair users. This scenario, in reality, creates in a degree of incapacity on the part of the wheelchair user in terms of performing simple activities. Based on their specific medical needs, confined patients are treated in a modified method. Independent navigation is secured for individuals with vision and motor disabilities. There is a necessity for communication which justifies the use of VR in this navigation situation. For the effective integration of locomotion besides, it must be under natural guidance. EEG, which uses random brain impulses, has made significant progress in the field of health. The custom of an automated audio announcement system modified to have the help of VR and EEG for the training of locomotion and individualized interaction of wheelchair users with visual disability is demonstrated in this study through an experiment. Enabling the patients who were otherwise deemed incapacitated to participate in social activities, as the aim was to have efficient connections.
Findings
To protect their life straightaway and to report all these disputes, the military system should have high speed, more precise portable prototype device for nursing the soldier health, recognition of solider location and report about health sharing system to the concerned system. Field programmable gate array (FPGA)-based soldier’s health observing and position gratitude system is proposed in this paper. Reliant on heart rate which is centered on EEG signals, the soldier’s health is observed on systematic bases. By emerging Verilog hardware description language (HDL) programming language and executing on Artix-7 development FPGA board of part name XC7ACSG100t the whole work is approved in a Vivado Design Suite. Classification of different abnormalities and cloud storage of EEG along with the type of abnormalities, artifact elimination, abnormalities identification based on feature extraction, exist in the segment of suggested architecture. Irregularity circumstances are noticed through developed prototype system and alert the physically challenged (PHC) individual via an audio announcement. An actual method for eradicating motion artifacts from EEG signals that have anomalies in the PHC person’s brain has been established, and the established system is a portable device that can deliver differences in brain signal variation intensity. Primarily the EEG signals can be taken and the undesirable artifact can be detached, later structures can be mined by discrete wavelet transform these are the two stages through which artifact deletion can be completed. The anomalies in signal can be noticed and recognized by using machine learning algorithms known as multirate support vector machine classifiers when the features have been extracted using a combination of hidden Markov model (HMM) and Gaussian mixture model (GMM). Intended for capable declaration about action taken by a blind person, these result signals are protected in storage devices and conveyed to the controller. Pretending daily motion schedules allows the pretentious EEG signals to be caught. Aimed at the validation of planned system, the database can be used and continued with numerous recorded signals of EEG. The projected strategy executes better in terms of re-storing theta, delta, alpha and beta complexes of the original EEG with less alteration and a higher signal to noise ratio (SNR) value of the EEG signal, which illustrates in the quantitative analysis. The projected method used Verilog HDL and MATLAB software for both formation and authorization of results to yield improved results. Since from the achieved results, it is initiated that 32% enhancement in SNR, 14% in mean squared error (MSE) and 65% enhancement in recognition of anomalies, hence design is effectively certified and proved for standard EEG signals data sets on FPGA.
Originality/value
The proposed system can be used in military applications as it is high speed and excellent precise in terms of identification of abnormality, the developed system is portable and very precise. FPGA-based soldier’s health observing and position gratitude system is proposed in this paper. Reliant on heart rate which is centered on EEG signals the soldier health is observed in systematic bases. The proposed system is developed using Verilog HDL programming language and executing on Artix-7 development FPGA board of part name XC7ACSG100t and synthesised using in Vivado Design Suite software tool.
Collapse
|
32
|
Karavaev AS, Skazkina VV, Borovkova EI, Prokhorov MD, Hramkov AN, Ponomarenko VI, Runnova AE, Gridnev VI, Kiselev AR, Kuznetsov NV, Chechurin LS, Penzel T. Synchronization of the Processes of Autonomic Control of Blood Circulation in Humans Is Different in the Awake State and in Sleep Stages. Front Neurosci 2022; 15:791510. [PMID: 35095399 PMCID: PMC8789746 DOI: 10.3389/fnins.2021.791510] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 12/09/2021] [Indexed: 01/09/2023] Open
Abstract
The influence of higher nervous activity on the processes of autonomic control of the cardiovascular system and baroreflex regulation is of considerable interest, both for understanding the fundamental laws of the functioning of the human body and for developing methods for diagnostics and treatment of pathologies. The complexity of the analyzed systems limits the possibilities of research in this area and requires the development of new tools. Earlier we propose a method for studying the collective dynamics of the processes of autonomic control of blood circulation in the awake state and in different stages of sleep. The method is based on estimating a quantitative measure representing the total percentage of phase synchronization between the low-frequency oscillations in heart rate and blood pressure. Analysis of electrocardiogram and invasive blood pressure signals in apnea patients in the awake state and in different sleep stages showed a high sensitivity of the proposed measure. It is shown that in slow-wave sleep the degree of synchronization of the studied rhythms is higher than in the awake state and lower than in sleep with rapid eye movement. The results reflect the modulation of the processes of autonomic control of blood circulation by higher nervous activity and can be used for the quantitative assessment of this modulation.
Collapse
Affiliation(s)
- Anatoly S. Karavaev
- Department of Basic Research in Neurocardiology, Institute of Cardiological Research, Saratov State Medical University, Saratov, Russia
- Smart Sleep Laboratory, Saratov State University, Saratov, Russia
- Laboratory of Nonlinear Dynamics Modeling, Saratov Branch of the Institute of Radio Engineering and Electronics of Russian Academy of Sciences, Saratov, Russia
| | - Viktoriia V. Skazkina
- Smart Sleep Laboratory, Saratov State University, Saratov, Russia
- LUT School of Engineering Science, LUT University, Lappeenranta, Finland
| | - Ekaterina I. Borovkova
- Department of Basic Research in Neurocardiology, Institute of Cardiological Research, Saratov State Medical University, Saratov, Russia
- Smart Sleep Laboratory, Saratov State University, Saratov, Russia
- Laboratory of Nonlinear Dynamics Modeling, Saratov Branch of the Institute of Radio Engineering and Electronics of Russian Academy of Sciences, Saratov, Russia
| | - Mikhail D. Prokhorov
- Smart Sleep Laboratory, Saratov State University, Saratov, Russia
- Laboratory of Nonlinear Dynamics Modeling, Saratov Branch of the Institute of Radio Engineering and Electronics of Russian Academy of Sciences, Saratov, Russia
| | | | - Vladimir I. Ponomarenko
- Laboratory of Nonlinear Dynamics Modeling, Saratov Branch of the Institute of Radio Engineering and Electronics of Russian Academy of Sciences, Saratov, Russia
| | - Anastasiya E. Runnova
- Department of Basic Research in Neurocardiology, Institute of Cardiological Research, Saratov State Medical University, Saratov, Russia
- Smart Sleep Laboratory, Saratov State University, Saratov, Russia
| | - Vladimir I. Gridnev
- Department of Basic Research in Neurocardiology, Institute of Cardiological Research, Saratov State Medical University, Saratov, Russia
| | - Anton R. Kiselev
- Department of Basic Research in Neurocardiology, Institute of Cardiological Research, Saratov State Medical University, Saratov, Russia
- Smart Sleep Laboratory, Saratov State University, Saratov, Russia
- Coordinating Center for Fundamental Research, National Medical Research Center for Therapy and Preventive Medicine, Moscow, Russia
| | - Nikolay V. Kuznetsov
- LUT School of Engineering Science, LUT University, Lappeenranta, Finland
- Faculty of Mathematics and Mechanics, St. Petersburg State University, St. Petersburg, Russia
- Institute for Problems in Mechanical Engineering RAS, St. Petersburg, Russia
| | - Leonid S. Chechurin
- LUT School of Engineering Science, LUT University, Lappeenranta, Finland
- Faculty of Mathematics and Mechanics, St. Petersburg State University, St. Petersburg, Russia
| | - Thomas Penzel
- Smart Sleep Laboratory, Saratov State University, Saratov, Russia
- Interdisciplinary Sleep Medicine Center, Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
33
|
Zhu L, Wang C, He Z, Zhang Y. A lightweight automatic sleep staging method for children using single-channel EEG based on edge artificial intelligence. WORLD WIDE WEB 2021; 25:1883-1903. [PMID: 35002476 PMCID: PMC8717888 DOI: 10.1007/s11280-021-00983-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Revised: 11/08/2021] [Accepted: 11/26/2021] [Indexed: 06/14/2023]
Abstract
With the development of telemedicine and edge computing, edge artificial intelligence (AI) will become a new development trend for smart medicine. On the other hand, nearly one-third of children suffer from sleep disorders. However, all existing sleep staging methods are for adults. Therefore, we adapted edge AI to develop a lightweight automatic sleep staging method for children using single-channel EEG. The trained sleep staging model will be deployed to edge smart devices so that the sleep staging can be implemented on edge devices which will greatly save network resources and improving the performance and privacy of sleep staging application. Then the results and hypnogram will be uploaded to the cloud server for further analysis by the physicians to get sleep disease diagnosis reports and treatment opinions. We utilized 1D convolutional neural networks (1D-CNN) and long short term memory (LSTM) to build our sleep staging model, named CSleepNet. We tested the model on our childrens sleep (CS) dataset and sleep-EDFX dataset. For the CS dataset, we experimented with F4-M1 channel EEG using four different loss functions, and the logcosh performed best with overall accuracy of 83.06% and F1-score of 76.50%. We used Fpz-Cz and Pz-Oz channel EEG to train our model in Sleep-EDFX dataset, and achieved an accuracy of 86.41% without manual feature extraction. The experimental results show that our method has great potential. It not only plays an important role in sleep-related research, but also can be widely used in the classification of other time sequences physiological signals.
Collapse
Affiliation(s)
- Liqiang Zhu
- College of Electronic and Information Engineering, Southwest University, Chongqing, 400715 China
| | - Changming Wang
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, 100053 China
- Brain-inspired Intelligence and Clinical Translational Research Center, Beijing, 100176 China
| | - Zhihui He
- Department of Pediatric Respiration, Chongqing Ninth People’s Hospital, Chongqing, 400700 China
| | - Yuan Zhang
- College of Electronic and Information Engineering, Southwest University, Chongqing, 400715 China
| |
Collapse
|
34
|
Prognosis of automated sleep staging based on two-layer ensemble learning stacking model using single-channel EEG signal. Soft comput 2021. [DOI: 10.1007/s00500-021-06218-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
35
|
Melek M, Melek N. Roza: a new and comprehensive metric for evaluating classification systems. Comput Methods Biomech Biomed Engin 2021; 25:1015-1027. [PMID: 34693834 DOI: 10.1080/10255842.2021.1995721] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Many metrics such as accuracy rate (ACC), area under curve (AUC), Jaccard index (JI), and Cohen's kappa coefficient are available to measure the success of the system in pattern recognition and machine/deep learning systems. However, the superiority of one system to one other cannot be determined based on the mentioned metrics. This is because such a system can be successful using one metric, but not the other ones. Moreover, such metrics are insufficient when the number of samples in the classes is unequal (imbalanced data). In this case, naturally, by using these metrics, a sensible comparison cannot be made between two given systems. In the present study, the comprehensive, fair, and accurate Roza (Roza means rose in Persian. When different permutations of the metrics used are superimposed in a polygon format, it looks like a flower, so we named it Roza.) metric is introduced for evaluating classification systems. This metric, which facilitates the comparison of systems, expresses the summary of many metrics with a single value. To verify the stability and validity of the metric and to conduct a comprehensive, fair, and accurate comparison between the systems, the Roza metric of the systems tested under the same conditions are calculated and comparisons are made. For this, systems tested with three different strategies on three different datasets are considered. The results show that the performance of the system can be summarized by a single value and the Roza metric can be used in all systems that include classification processes, as a powerful metric.
Collapse
Affiliation(s)
- Mesut Melek
- Department of Electronics and Automation, Gumushane University, Gumushane, Turkey
| | - Negin Melek
- Faculty of Engineering, Department of Electrical and Electronics Engineering, Avrasya University, Trabzon, Turkey
| |
Collapse
|
36
|
Automatic detection for epileptic seizure using graph-regularized nonnegative matrix factorization and Bayesian linear discriminate analysis. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.08.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
37
|
Machine learning with ensemble stacking model for automated sleep staging using dual-channel EEG signal. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102898] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
|
38
|
Tuncer T, Dogan S, Subasi A. EEG-based driving fatigue detection using multilevel feature extraction and iterative hybrid feature selection. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102591] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
39
|
Banluesombatkul N, Ouppaphan P, Leelaarporn P, Lakhan P, Chaitusaney B, Jaimchariyatam N, Chuangsuwanich E, Chen W, Phan H, Dilokthanakul N, Wilaiprasitporn T. MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-Signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning. IEEE J Biomed Health Inform 2021; 25:1949-1963. [PMID: 33180737 DOI: 10.1109/jbhi.2020.3037693] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Identifying bio-signals based-sleep stages requires time-consuming and tedious labor of skilled clinicians. Deep learning approaches have been introduced in order to challenge the automatic sleep stage classification conundrum. However, the difficulties can be posed in replacing the clinicians with the automatic system due to the differences in many aspects found in individual bio-signals, causing the inconsistency in the performance of the model on every incoming individual. Thus, we aim to explore the feasibility of using a novel approach, capable of assisting the clinicians and lessening the workload. We propose the transfer learning framework, entitled MetaSleepLearner, based on Model Agnostic Meta-Learning (MAML), in order to transfer the acquired sleep staging knowledge from a large dataset to new individual subjects (source code is available at https://github.com/IoBT-VISTEC/MetaSleepLearner). The framework was demonstrated to require the labelling of only a few sleep epochs by the clinicians and allow the remainder to be handled by the system. Layer-wise Relevance Propagation (LRP) was also applied to understand the learning course of our approach. In all acquired datasets, in comparison to the conventional approach, MetaSleepLearner achieved a range of 5.4% to 17.7% improvement with statistical difference in the mean of both approaches. The illustration of the model interpretation after the adaptation to each subject also confirmed that the performance was directed towards reasonable learning. MetaSleepLearner outperformed the conventional approaches as a result from the fine-tuning using the recordings of both healthy subjects and patients. This is the first work that investigated a non-conventional pre-training method, MAML, resulting in a possibility for human-machine collaboration in sleep stage classification and easing the burden of the clinicians in labelling the sleep stages through only several epochs rather than an entire recording.
Collapse
|
40
|
|
41
|
Tăuţan AM, Rossi AC, de Francisco R, Ionescu B. Dimensionality reduction for EEG-based sleep stage detection: comparison of autoencoders, principal component analysis and factor analysis. BIOMED ENG-BIOMED TE 2021; 66:125-136. [PMID: 33048831 DOI: 10.1515/bmt-2020-0139] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 08/19/2020] [Indexed: 11/15/2022]
Abstract
Methods developed for automatic sleep stage detection make use of large amounts of data in the form of polysomnographic (PSG) recordings to build predictive models. In this study, we investigate the effect of several dimensionality reduction techniques, i.e., principal component analysis (PCA), factor analysis (FA), and autoencoders (AE) on common classifiers, e.g., random forests (RF), multilayer perceptron (MLP), long-short term memory (LSTM) networks, for automated sleep stage detection. Experimental testing is carried out on the MGH Dataset provided in the "You Snooze, You Win: The PhysioNet/Computing in Cardiology Challenge 2018". The signals used as input are the six available (EEG) electoencephalographic channels and combinations with the other PSG signals provided: ECG - electrocardiogram, EMG - electromyogram, respiration based signals - respiratory efforts and airflow. We observe that a similar or improved accuracy is obtained in most cases when using all dimensionality reduction techniques, which is a promising result as it allows to reduce the computational load while maintaining performance and in some cases also improves the accuracy of automated sleep stage detection. In our study, using autoencoders for dimensionality reduction maintains the performance of the model, while using PCA and FA the accuracy of the models is in most cases improved.
Collapse
|
42
|
Satapathy S, Loganathan D, Kondaveeti HK, Rath R. Performance analysis of machine learning algorithms on automated sleep staging feature sets. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2021. [DOI: 10.1049/cit2.12042] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Santosh Satapathy
- Puducherry Research Scholar of Computer Science and Engineering Pondicherry Engineering College, Puducherry India
| | - D Loganathan
- Professor of Computer Science and Engineering Pondicherry Engineering College, Puducherry Puducherry India
| | - Hari Kishan Kondaveeti
- Assistant Professor of Computer Science and Engineering VIT University, Amaravati Andhra Pradesh India
| | - RamaKrushna Rath
- Research Scholar of Computer Science and Engineering, Anna University Chennai India
| |
Collapse
|
43
|
Fu M, Wang Y, Chen Z, Li J, Xu F, Liu X, Hou F. Deep Learning in Automatic Sleep Staging With a Single Channel Electroencephalography. Front Physiol 2021; 12:628502. [PMID: 33746774 PMCID: PMC7965953 DOI: 10.3389/fphys.2021.628502] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 02/01/2021] [Indexed: 11/13/2022] Open
Abstract
This study centers on automatic sleep staging with a single channel electroencephalography (EEG), with some significant findings for sleep staging. In this study, we proposed a deep learning-based network by integrating attention mechanism and bidirectional long short-term memory neural network (AT-BiLSTM) to classify wakefulness, rapid eye movement (REM) sleep and non-REM (NREM) sleep stages N1, N2 and N3. The AT-BiLSTM network outperformed five other networks and achieved an accuracy of 83.78%, a Cohen's kappa coefficient of 0.766 and a macro F1-score of 82.14% on the PhysioNet Sleep-EDF Expanded dataset, and an accuracy of 81.72%, a Cohen's kappa coefficient of 0.751 and a macro F1-score of 80.74% on the DREAMS Subjects dataset. The proposed AT-BiLSTM network even achieved a higher accuracy than the existing methods based on traditional feature extraction. Moreover, better performance was obtained by the AT-BiLSTM network with the frontal EEG derivations than with EEG channels located at the central, occipital or parietal lobe. As EEG signal can be easily acquired using dry electrodes on the forehead, our findings might provide a promising solution for automatic sleep scoring without feature extraction and may prove very useful for the screening of sleep disorders.
Collapse
Affiliation(s)
- Mingyu Fu
- School of Science, China Pharmaceutical University, Nanjing, China
| | - Yitian Wang
- School of Science, China Pharmaceutical University, Nanjing, China
| | - Zixin Chen
- College of Engineering, University of California, Berkeley, Berkeley, CA, United States
| | - Jin Li
- College of Physics and Information Technology, Shaanxi Normal University, Xi’an, China
| | - Fengguo Xu
- Key Laboratory of Drug Quality Control and Pharmacovigilance, China Pharmaceutical University, Nanjing, China
| | - Xinyu Liu
- School of Science, China Pharmaceutical University, Nanjing, China
| | - Fengzhen Hou
- School of Science, China Pharmaceutical University, Nanjing, China
| |
Collapse
|
44
|
Pathak S, Lu C, Nagaraj SB, van Putten M, Seifert C. STQS: Interpretable multi-modal Spatial-Temporal-seQuential model for automatic Sleep scoring. Artif Intell Med 2021; 114:102038. [PMID: 33875157 DOI: 10.1016/j.artmed.2021.102038] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Revised: 01/27/2021] [Accepted: 02/16/2021] [Indexed: 10/22/2022]
Abstract
Sleep scoring is an important step for the detection of sleep disorders and usually performed by visual analysis. Since manual sleep scoring is time consuming, machine-learning based approaches have been proposed. Though efficient, these algorithms are black-box in nature and difficult to interpret by clinicians. In this paper, we propose a deep learning architecture for multi-modal sleep scoring, investigate the model's decision making process, and compare the model's reasoning with the annotation guidelines in the AASM manual. Our architecture, called STQS, uses convolutional neural networks (CNN) to automatically extract spatio-temporal features from 3 modalities (EEG, EOG and EMG), a bidirectional long short-term memory (Bi-LSTM) to extract sequential information, and residual connections to combine spatio-temporal and sequential features. We evaluated our model on two large datasets, obtaining an accuracy of 85% and 77% and a macro F1 score of 79% and 73% on SHHS and an in-house dataset, respectively. We further quantify the contribution of various architectural components and conclude that adding LSTM layers improves performance over a spatio-temporal CNN, while adding residual connections does not. Our interpretability results show that the output of the model is well aligned with AASM guidelines, and therefore, the model's decisions correspond to domain knowledge. We also compare multi-modal models and single-channel models and suggest that future research should focus on improving multi-modal models.
Collapse
Affiliation(s)
| | | | | | - Michel van Putten
- University of Twente, Netherlands; Medisch Spectrum Twente, Netherlands
| | - Christin Seifert
- University of Twente, Netherlands; University of Duisburg-Essen, Germany
| |
Collapse
|
45
|
Rule-Based EEG Classifier Utilizing Local Entropy of Time–Frequency Distributions. MATHEMATICS 2021. [DOI: 10.3390/math9040451] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Electroencephalogram (EEG) signals are known to contain signatures of stimuli that induce brain activities. However, detecting these signatures to classify captured EEG waveforms is one of the most challenging tasks of EEG analysis. This paper proposes a novel time–frequency-based method for EEG analysis and characterization implemented in a computer-aided decision-support system that can be used to assist medical experts in interpreting EEG patterns. The computerized method utilizes EEG spectral non-stationarity, which is clearly revealed in the time–frequency distributions (TFDs) of multicomponent signals. The proposed algorithm, which is based on the modification of the Rényi entropy, called local or short-term Rényi entropy (STRE), was upgraded with a blind component separation procedure and instantaneous frequency (IF) estimation. The method was applied to EEGs of both forward and backward movements of the left and right hands, as well as to EEGs of imagined hand movements, which were captured by a 19-channel EEG recording system. The obtained results show that in a given virtual instrument, the proposed methods efficiently distinguish between real and imagined limb movements by considering their signatures in terms of the dominant EEG component’s IFs at the specified subset of EEG channels (namely, F3, F4, F7, F8, T3, and T4). Furthermore, computing the number of EEG signal components, their extraction, and IF estimation provide important information that shows potential to enhance existing clinical diagnostic techniques for detecting the intensity, location, and type of brain function abnormalities in patients with neurological motor control disorders.
Collapse
|
46
|
Zhang T, Jiang Z, Li D, Wei X, Guo B, Huang W, Xu G. Sleep Staging Using Plausibility Score: A Novel Feature Selection Method Based on Metric Learning. IEEE J Biomed Health Inform 2021; 25:577-590. [PMID: 32396113 DOI: 10.1109/jbhi.2020.2993644] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
As an effective method, feature selection can reduce computational complexity and improve classification performance. A number of criteria exist for feature selection using labeled data, unlabeled data and pairwise constraints, most of which are based on the Euclidean distance. In this paper, we propose a filter method for feature selection with pairwise constraints, aiming to jointly evaluate a feature subset based on metric learning. Two criteria are designed based on the well-known Kullback-Leibler divergence for measuring the difference between must-link constraints and cannot-link constraints that can indicate the feature subset discrimination based on Keep It Simple and Straightforward (KISS) metric learning and Cross-view Quadratic Discriminant Analysis (XQDA) metric learning. To address the challenging feature selection problem, we formulate a sequential search algorithm guided by indicators that are simplified from the proposed criteria. Furthermore, we conducted several experiments on sleep staging based on electroencephalogram (EEG) recordings from the Sleep-EDF Database Expanded. The experimental results demonstrate the effectiveness of the proposed method compared with nine representative feature selection methods. On the data set from healthy volunteers and the data set from volunteers that had mild difficulty falling asleep, the classification average accuracies achieve 97.66% and 93.57% by using the proposed method, respectively.
Collapse
|
47
|
Zhang J, Wu Y. Competition convolutional neural network for sleep stage classification. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102318] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
48
|
Faust O, Barika R, Shenfield A, Ciaccio EJ, Acharya UR. Accurate detection of sleep apnea with long short-term memory network based on RR interval signals. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2020.106591] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
|
49
|
Fu R, Li W, Chen J, Han M. Recognizing single-trial motor imagery EEG based on interpretable clustering method. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
50
|
Huang X, Shirahama K, Li F, Grzegorzek M. Sleep stage classification for child patients using DeConvolutional Neural Network. Artif Intell Med 2020; 110:101981. [PMID: 33250147 DOI: 10.1016/j.artmed.2020.101981] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Revised: 10/08/2020] [Accepted: 10/27/2020] [Indexed: 02/08/2023]
Abstract
Studies from the literature show that the prevalence of sleep disorder in children is far higher than that in adults. Although much research effort has been made on sleep stage classification for adults, children have significantly different characteristics of sleep stages. Therefore, there is an urgent need for sleep stage classification targeting children in particular. Our method focuses on two issues: The first is timestamp-based segmentation (TSS) to deal with the fine-grained annotation of sleep stage labels for each timestamp. Compared to this, popular sliding window approaches unnecessarily aggregate such labels into coarse-grained ones. We utilize DeConvolutional Neural Network (DCNN) that inversely maps features of a hidden layer back to the input space to predict the sleep stage label at each timestamp. Thus, our DCNN can yield better classification performances by considering labels at numerous timestamps. The second issue is the necessity of multiple channels. Different clinical signs, symptoms or other auxiliary examinations could be represented by different Polysomnography (PSG) recordings, so all of them should be analyzed comprehensively. We therefor exploit multivariate time-series of PSG recordings, including 6 electroencephalograms (EEGs) channels, 2 electrooculograms (EOGs) channels (left and right), 1 electromyogram (chin EMG) channel and two leg electromyogram channels. Our DCNN-based method is tested on our SDCP dataset collected from child patients aged from 5 to 10 years old. The results show that our method yields the overall classification accuracy of 84.27% and macro F1-score of 72.51% which are higher than those of existing sliding window-based methods. One of the biggest advantages of our DCNN-based method is that it processes raw PSG recordings and internally extracts features useful for accurate sleep stage classification. We examine whether this is applicable for sleep data of adult patients by testing our method on a well-known public dataset Sleep-EDFX. Our method achieves the average overall accuracy of 90.89% which is comparable to those of state-of-the-art methods without using any hand-crafted features. This result indicates the great potential of our method because it can be generally used for timestamp-level classification on multivariate time-series in various medical fields. Additionally, we provide source codes so that researchers can reproduce the results in this paper and extend our method.
Collapse
Affiliation(s)
- Xinyu Huang
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, Lübeck 23538, Germany.
| | - Kimiaki Shirahama
- Department of Informatics, Kindai University, 3-4-1 Kowakae, Higashiosaka City, Osaka 577-8502, Japan.
| | - Frédéric Li
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, Lübeck 23538, Germany.
| | - Marcin Grzegorzek
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, Lübeck 23538, Germany.
| |
Collapse
|