1
|
Meng Y, Liu Y, Wang G, Song H, Zhang Y, Lu J, Li P, Ma X. M-NIG: mobile network information gain for EEG-based epileptic seizure prediction. Sci Rep 2025; 15:15181. [PMID: 40307310 PMCID: PMC12043844 DOI: 10.1038/s41598-025-97696-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2024] [Accepted: 04/07/2025] [Indexed: 05/02/2025] Open
Abstract
Epilepsy is one of the most common cerebral diseases, the development of which can be divided into four states: interictal state, preictal state, ictal state and postictal state. Hunting for critical states is of great significance to predict seizures. This study seeks to establish a general-purpose method for epileptic seizure prediction by constructing individual-specific correlation networks between multi-channel EEG signals. In this paper, we present the mobile network information gain (M-NIG) method by transforming floating time series datasets into stable network information gain, which reduces the impact of data noise, thereby improving the robustness and effectiveness of the algorithm. The method not only efficiently predicts seizures but also detects their DNB channels. The proposed method attains an average of 97.40% accuracy, 94.32% sensitivity, 97.48% specificity, and FPR = 0.024/h on 22 patients from the public CHB-MIT scalp EEG database, which outperforms most state-of-the-art articles. Additionally, it achieves an average of 95.70% accuracy, 100.00% sensitivity, 95.56% specificity, and FPR = 0.044/h on a dataset collected at Taian Maternity and Child Health Hospital, which outperforms most state-of-the-art articles in terms of sensitivity, accuracy, and FPR. Our experiments show that the parameters of sliding window and the number of nearest neighbor of k-nearest neighbor (KNN) are important factors affecting prediction performance.
Collapse
Affiliation(s)
- Yuting Meng
- School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang, 471003, China
| | - Yi Liu
- Department of Pediatrics, Taian Maternal and Child Health Hospital, Taian, 271000, China
| | - Guanglei Wang
- Department of Pediatrics, Taian Maternal and Child Health Hospital, Taian, 271000, China
| | - Huipeng Song
- School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang, 471003, China
| | - Yiyu Zhang
- Information Engineering College, Henan University of Science and Technology, Luoyang, 471003, China
| | - Jianbo Lu
- National Human Genetics Resource Center, National Research Institute for Family Planning, Beijing, 100081, China.
| | - Peiluan Li
- School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang, 471003, China.
| | - Xu Ma
- National Human Genetics Resource Center, National Research Institute for Family Planning, Beijing, 100081, China.
| |
Collapse
|
2
|
Feng W, Zhao Y, Peng H, Nie C, Lv H, Wang S, Feng H. FusionXNet: enhancing EEG-based seizure prediction with integrated convolutional and Transformer architectures. J Neural Eng 2025; 22:026067. [PMID: 40245880 DOI: 10.1088/1741-2552/adce33] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2024] [Accepted: 04/17/2025] [Indexed: 04/19/2025]
Abstract
Objective. Effective seizure prediction can reduce patient burden, improve clinical treatment accuracy, and lower healthcare costs. However, existing deep learning-based seizure prediction methods primarily rely on single models, which have limitations in feature extraction. This study aims to develop a hybrid model that integrates the advantages of convolutional neural networks (CNNs) and Transformer to enhance seizure prediction performance.Approach. We propose FusionXNet, a hybrid model inspired by CNNs and Transformer architectures, for seizure prediction. Specifically, we design a token synthesis unit to extract local features using convolution operations and capture global electroencephalography (EEG) representations via attention mechanisms. By merging local and global features extracted from the EEG segments, FusionXNet enhances feature representations, which are subsequently fed into a classifier for final seizure prediction.Main results. We evaluate the model on the publicly available Boston Children's Hospital and the Massachusetts Institute of Technology dataset, conducting segment-based and event-based experiments in both patient-specific and cross-patient settings. In event-based patient-specific experiments, FusionXNet achieves a sensitivity of 97.602% and a false positive rate (FPR) of 0.059 h-1. The results demonstrate that the proposed model effectively predicts seizures with high sensitivity and a low FPR, outperforming existing methods.Significance. The proposed FusionXNet model provides a robust and efficient approach for seizure prediction by leveraging both local and global feature extraction. The high sensitivity and low FPR indicate its potential for real-world clinical applications, improving patient management and reducing healthcare costs.
Collapse
Affiliation(s)
- Wenqian Feng
- School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250358, People's Republic of China
| | - Yanna Zhao
- School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250358, People's Republic of China
| | - Hao Peng
- School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250358, People's Republic of China
| | - Chenxi Nie
- School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250358, People's Republic of China
| | - Hongbin Lv
- School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250358, People's Republic of China
| | - Shuai Wang
- School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250358, People's Republic of China
| | - Hailing Feng
- School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250358, People's Republic of China
| |
Collapse
|
3
|
Tan GY, Bakibillah ASM, Chan PY, Tan CP, Nurzaman S. Parkinson's disease tremor prediction towards real-time suppression: A self-attention deep temporal convolutional network approach. Comput Biol Med 2025; 188:109814. [PMID: 39978094 DOI: 10.1016/j.compbiomed.2025.109814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Revised: 02/03/2025] [Accepted: 02/05/2025] [Indexed: 02/22/2025]
Abstract
Accurate prediction of Parkinson's disease tremor (PDT) is crucial for developing assistive technologies; however, this is challenging due to the nonlinear, stochastic, and nonstationary characteristics of PDT, which substantially vary among patients and their activities. Moreover, most models only have one-step prediction capabilities, which causes delays in real-time applications. This paper proposes a self-attention deep temporal convolutional network (SADTCN) model for the real-time prediction of hand-arm PDT signals from different activities and joint angular motions. The SADTCN can capture both short- and long-term dependencies and complex temporal and spatial dynamics of PDT signals and hence, can effectively adapt to varying tremor characteristics. The performance of the proposed model is evaluated using experimental hand-arm PDT data. The results show that the SADTCN outperforms existing deep learning (DL) models by accurately predicting varying tremor amplitudes and frequencies multi-step ahead. Moreover, we performed spectrum analysis on the measured and predicted signal using the short-time Fourier transform (STFT) as a measure of potential active tremor control and found that SADTCN can accurately determine the transience of tremor amplitude in frequency and time. Finally, we run the Wilcoxon signed-rank statistical test and the results show a statistically significant improvement in the proposed model over the other DL models in all conditions. Therefore, the SADTCN can overcome the nonstationary, nonlinear, and stochastic nature of PDT to perform multi-step prediction with high accuracy, robustness, and generalizability in unseen testing data.
Collapse
Affiliation(s)
- Guan Yuan Tan
- School of Engineering, Monash University, Bandar Sunway 47500, Malaysia; School of Information Technology, Monash University, Bandar Sunway 47500, Malaysia
| | - A S M Bakibillah
- School of Engineering, Monash University, Bandar Sunway 47500, Malaysia; Department of Systems and Control Engineering, School of Engineering, Institute of Science Tokyo, Tokyo 152-8552, Japan
| | - Ping Yi Chan
- School of Engineering, Monash University, Bandar Sunway 47500, Malaysia.
| | - Chee Pin Tan
- School of Engineering, Monash University, Bandar Sunway 47500, Malaysia
| | - Surya Nurzaman
- School of Engineering, Monash University, Bandar Sunway 47500, Malaysia
| |
Collapse
|
4
|
Yu CF, Peng JW, Hsiao CC, Wang CH, Lo WC. Development of GUI-Driven AI Deep Learning Platform for Predicting Warpage Behavior of Fan-Out Wafer-Level Packaging. MICROMACHINES 2025; 16:342. [PMID: 40141953 PMCID: PMC11945037 DOI: 10.3390/mi16030342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2025] [Accepted: 03/11/2025] [Indexed: 03/28/2025]
Abstract
This study presents an artificial intelligence (AI) prediction platform driven by deep learning technologies, designed specifically to address the challenges associated with predicting warpage behavior in fan-out wafer-level packaging (FOWLP). Traditional electronic engineers often face difficulties in implementing AI-driven models due to the specialized programming and algorithmic expertise required. To overcome this, the platform incorporates a graphical user interface (GUI) that simplifies the design, training, and operation of deep learning models. It enables users to configure and run AI predictions without needing extensive coding knowledge, thereby enhancing accessibility for non-expert users. The platform efficiently processes large datasets, automating feature extraction, data cleansing, and model training, ensuring accurate and reliable predictions. The effectiveness of the AI platform is demonstrated through case studies involving FOWLP architectures, highlighting its ability to provide quick and precise warpage predictions. Additionally, the platform is available in both uniform resource locator (URL)-based and standalone versions, offering flexibility in usage. This innovation significantly improves design efficiency, enabling engineers to optimize electronic packaging designs, reduce errors, and enhance the overall system performance. The study concludes by showcasing the structure and functionality of the GUI platform, positioning it as a valuable tool for fostering further advancements in electronic packaging.
Collapse
Affiliation(s)
- Ching-Feng Yu
- Department of Mechanical Engineering, National United University, Miaoli 360302, Taiwan
| | - Jr-Wei Peng
- Electronic and Optoelectronic System Research Laboratories, Industrial Technology Research Institute (ITRI), Hsinchu 30010, Taiwan; (J.-W.P.); (C.-C.H.); (C.-H.W.); (W.-C.L.)
| | - Chih-Cheng Hsiao
- Electronic and Optoelectronic System Research Laboratories, Industrial Technology Research Institute (ITRI), Hsinchu 30010, Taiwan; (J.-W.P.); (C.-C.H.); (C.-H.W.); (W.-C.L.)
| | - Chin-Hung Wang
- Electronic and Optoelectronic System Research Laboratories, Industrial Technology Research Institute (ITRI), Hsinchu 30010, Taiwan; (J.-W.P.); (C.-C.H.); (C.-H.W.); (W.-C.L.)
| | - Wei-Chung Lo
- Electronic and Optoelectronic System Research Laboratories, Industrial Technology Research Institute (ITRI), Hsinchu 30010, Taiwan; (J.-W.P.); (C.-C.H.); (C.-H.W.); (W.-C.L.)
| |
Collapse
|
5
|
Jacob JE, Chandrasekharan S, Iype T, Cherian A. Unveiling encephalopathy signatures: A deep learning approach with locality-preserving features and hybrid neural network for EEG analysis. Neurosci Lett 2025; 849:138146. [PMID: 39894198 DOI: 10.1016/j.neulet.2025.138146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2024] [Revised: 12/16/2024] [Accepted: 01/30/2025] [Indexed: 02/04/2025]
Abstract
EEG signals exhibit spatio-temporal characteristics due to the neural activity dispersion in space over the brain and the dynamic temporal patterns of electrical activity in neurons. This study tries to effectively utilize the spatio-temporal nature of EEG signals for diagnosing encephalopathy using a combination of novel locality preserving feature extraction using Local Binary Patterns (LBP) and a custom fine-tuned Long Short-Term Memory (LSTM) neural network. A carefully curated primary EEG dataset is used to assess the effectiveness of the technique for treatment of encephalopathies. EEG signals of all electrodes are mapped onto a spatial matrix from which the custom feature extraction method isolates spatial features of the signals. These spatial features are further given to the neural network, which learns to combine the spatial information with temporal dynamics summarizing pertinent details from the raw EEG data. Such a unified representation is key to perform reliable disease classification at the output layer of the neural network, leading to a robust classification system, potentially providing improved diagnosis and treatment. The proposed method shows promising potential for enhancing the automated diagnosis of encephalopathy, with a remarkable accuracy rate of 90.5%. To the best of our knowledge, this is the first attempt to compress and represent both spatial and temporal features into a single vector for encephalopathy detection, simplifying visual diagnosis and providing a robust feature for automated predictions. This advancement holds significant promise for ensuring early detection and intervention strategies in the clinical environment, which in turn enhances patient care.
Collapse
Affiliation(s)
- Jisu Elsa Jacob
- Assistant Professor, Department of Electronics and Communication Engineering, Sree Chitra Thirunal College of Engineering Thiruvananthapuram, Kerala, India.
| | | | - Thomas Iype
- Emeritus Professor & Former Head of the Department, Department of Neurology, Government Medical College Thiruvananthapuram Kerala India
| | - Ajith Cherian
- Department of Neurology, SCTIMST Thiruvananthapuram Kerala India
| |
Collapse
|
6
|
Shang H, Yu S, Wu Y, Liu X, He J, Ma M, Zeng X, Jiang N. A noninvasive hyperkalemia monitoring system for dialysis patients based on a 1D-CNN model and single-lead ECG from wearable devices. Sci Rep 2025; 15:2950. [PMID: 39848991 PMCID: PMC11758389 DOI: 10.1038/s41598-025-85722-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2024] [Accepted: 01/06/2025] [Indexed: 01/25/2025] Open
Abstract
This study aimed to develop a real-time, noninvasive hyperkalemia monitoring system for dialysis patients with chronic kidney disease. Hyperkalemia, common in dialysis patients, can lead to life-threatening arrhythmias or sudden death if untreated. Therefore, real-time monitoring of hyperkalemia in this population is crucial. We propose a wearable single-lead ECG monitoring system, offering enhanced comfort and feasibility for extended use. The key innovation of this system is the design of a compact, multi-channel convolutional neural network. This model offers high stability, strong performance, and exceptional computational efficiency, making it ideal for seamless integration into wearable devices for real-time monitoring applications. The model automatically extracts features from ECG signals at different frequencies through multiple convolutional channels, eliminating the need for manual feature extraction before data input. Data is input using a non-overlapping sliding window approach, reducing preprocessing complexity while maintaining model performance. We investigated the optimal window length and the number of convolution channels for ECG signal input. Experimental results indicate that the model achieves optimal performance with a 1200 ms window length and four parallel convolutional branches, yielding an accuracy of 98.25% (4.52%), F1-score of 98.31% (3.26%), sensitivity of 98.63% (2.41%), and specificity of 97.88% (5.13%). This system holds significant potential for improving patient monitoring comfort and real-time responsiveness.
Collapse
Affiliation(s)
- Haijie Shang
- National Clinical Research Center for Geriatrics, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China
- Medical Equipment Innovation Research Center, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China
- The Med-X Center for Manufacturing, Sichuan University, Chengdu, Sichuan Province, China
| | - Shaobin Yu
- Department of Nephrology, Kidney Research Institute, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China
- The Med-X Center for Information, Sichuan University, Chengdu, Sichuan Province, China
- Biomedical Data Center, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China
| | - Yihan Wu
- National Clinical Research Center for Geriatrics, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China
- The Med-X Center for Manufacturing, Sichuan University, Chengdu, Sichuan Province, China
| | - Xu Liu
- National Clinical Research Center for Geriatrics, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China
- The Med-X Center for Manufacturing, Sichuan University, Chengdu, Sichuan Province, China
| | - Jiayuan He
- National Clinical Research Center for Geriatrics, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China.
- Medical Equipment Innovation Research Center, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China.
- The Med-X Center for Manufacturing, Sichuan University, Chengdu, Sichuan Province, China.
| | - Min Ma
- School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan Province, China.
| | - Xiaoxi Zeng
- Department of Nephrology, Kidney Research Institute, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China.
- The Med-X Center for Information, Sichuan University, Chengdu, Sichuan Province, China.
- Biomedical Data Center, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China.
| | - Ning Jiang
- National Clinical Research Center for Geriatrics, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China.
- Medical Equipment Innovation Research Center, West China Hospital of Sichuan University, Chengdu, Sichuan Province, China.
- The Med-X Center for Manufacturing, Sichuan University, Chengdu, Sichuan Province, China.
| |
Collapse
|
7
|
Cao X, Zheng S, Zhang J, Chen W, Du G. A hybrid CNN-Bi-LSTM model with feature fusion for accurate epilepsy seizure detection. BMC Med Inform Decis Mak 2025; 25:6. [PMID: 39762881 PMCID: PMC11706039 DOI: 10.1186/s12911-024-02845-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2024] [Accepted: 12/27/2024] [Indexed: 01/11/2025] Open
Abstract
BACKGROUND The diagnosis and treatment of epilepsy continue to face numerous challenges, highlighting the urgent need for the development of rapid, accurate, and non-invasive methods for seizure detection. In recent years, advancements in the analysis of electroencephalogram (EEG) signals have garnered widespread attention, particularly in the area of seizure recognition. METHODS A novel hybrid deep learning approach that combines feature fusion for efficient seizure detection is proposed in this study. First, the Discrete Wavelet Transform (DWT) is applied to perform a five-level decomposition of the raw EEG signals, from which time-frequency and nonlinear features are extracted from the decomposed sub-bands. To eliminate redundant features, Support Vector Machine-Recursive Feature Elimination (SVM-RFE) is employed to select the most distinctive features for fusion. Finally, seizure states are classified using Convolutional Neural Network-Bidirectional Long Short-Term Memory (CNN-Bi-LSTM). RESULTS The method was rigorously validated on the Bonn and New Delhi datasets. In the binary classification tasks, both the D-E group (Bonn dataset) and the Interictal-Ictal group (New Delhi dataset) achieved 100% accuracy, 100% sensitivity, 100% specificity, 100% precision, and 100% F1-score. In the three-class classification task A-D-E on the Bonn dataset, the model performed excellently, achieving 96.19% accuracy, 95.08% sensitivity, 97.34% specificity, 97.49% precision, and 96.18% F1-score. In addition, the proposed method was further validated on the larger and more clinically relevant CHB-MIT dataset, achieving average metrics of 98.43% accuracy, 97.84% sensitivity, 99.21% specificity, 99.14% precision, and an F1 score of 98.39%. Compared to existing literature, our method outperformed several recent studies in similar classification tasks, underscoring the effectiveness and advancement of the approach presented in this research. CONCLUSION The findings indicate that the proposed method demonstrates a high level of effectiveness in detecting seizures, which is a crucial aspect of managing epilepsy. By improving the accuracy of seizure detection, this method has the potential to significantly enhance the process of diagnosing and treating individuals affected by epilepsy. This advancement could lead to more tailored treatment plans, timely interventions, and ultimately, better quality of life for patients.
Collapse
Affiliation(s)
- Xiaoshuai Cao
- The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, China
| | - Shaojie Zheng
- College of Information Engineering, Henan University of Science and Technology, Luoyang, China
| | - Jincan Zhang
- College of Information Engineering, Henan University of Science and Technology, Luoyang, China
| | - Wenna Chen
- The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, China.
| | - Ganqin Du
- The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, China.
| |
Collapse
|
8
|
Shan B, Yu H, Huang Y, Xu M, Ming D. Interpretable Multi-Branch Architecture for Spatiotemporal Neural Networks and Its Application in Seizure Prediction. IEEE J Biomed Health Inform 2025; 29:235-247. [PMID: 39405148 DOI: 10.1109/jbhi.2024.3481005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2024]
Abstract
Currently, spatiotemporal convolutional neural networks (CNNs) for electroencephalogram (EEG) signals have emerged as promising tools for seizure prediction (SP), which explore the spatiotemporal biomarkers in an epileptic brain. Generally, these CNNs capture spatiotemporal features at single spectral resolution. However, epileptiform EEG signals contain irregular neural oscillations of different frequencies in different brain regions. Therefore, it may be underperforming and uninterpretable for the CNNs without capturing complex spectral properties sufficiently. This study proposed a novel interpretable multi-branch architecture for spatiotemporal CNNs, namely MultiSincNet. On the one hand, the MultiSincNet could directly show the frequency boundaries using the interpretable sinc-convolution layers. On the other hand, it could extract and integrate multiple spatiotemporal features across varying spectral resolutions using parallel branches. Moreover, we also constructed a post-hoc explanation technique for multi-branch CNNs, using the first- order Taylor expansion and chain rule based on the multivariate composite function, which demonstrates the crucial spatiotemporal features learned by the proposed multi-branch spatiotemporal CNN. When combined with the optimal MultiSincNet, ShallowConvNet, DeepConvNet, and EEGWaveNet had significantly improved the subject-specific performance on most metrics. Specifically, the optimal MultiSincNet significantly increased the average accuracy, sensitivity, specificity, binary F1-score, weighted F1-score, and AUC of EEGWaveNet by about 7%, 8%, 7%, 8%, 7%, and 7%, respectively. Besides, the visualization results showed that the optimal model mainly extracts the spectral energy difference from the high gamma band focalized to specific spatial areas as the dominant spatiotemporal EEG feature.
Collapse
|
9
|
Lai W, Sha L, Li R, Yu S, Jin L, Yang R, Yang C, Chen L. Urine multi-omics markers to predict seizure one day in advance. Sci Bull (Beijing) 2024; 69:3844-3848. [PMID: 39537459 DOI: 10.1016/j.scib.2024.10.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2024] [Revised: 09/05/2024] [Accepted: 10/21/2024] [Indexed: 11/16/2024]
Affiliation(s)
- Wanlin Lai
- Department of Neurology, West China Hospital, Sichuan University, Chengdu 610041, China; Sichuan Provincial Engineering Research Center of Brain-Machine Interface, and Sichuan Provincial Engineering Research Center of Neuromodulation, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Leihao Sha
- Department of Neurology, West China Hospital, Sichuan University, Chengdu 610041, China; Sichuan Provincial Engineering Research Center of Brain-Machine Interface, and Sichuan Provincial Engineering Research Center of Neuromodulation, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Rui Li
- Department of Neurology, West China Hospital, Sichuan University, Chengdu 610041, China; Sichuan Provincial Engineering Research Center of Brain-Machine Interface, and Sichuan Provincial Engineering Research Center of Neuromodulation, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Shan Yu
- Key Laboratory of Digital Technology in Medical Diagnostics of Zhejiang Province, Hangzhou 310000, China
| | - Ling Jin
- Department of Neurology, West China Hospital, Sichuan University, Chengdu 610041, China; Sichuan Provincial Engineering Research Center of Brain-Machine Interface, and Sichuan Provincial Engineering Research Center of Neuromodulation, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Ruiqi Yang
- Department of Neurology, West China Hospital, Sichuan University, Chengdu 610041, China; Sichuan Provincial Engineering Research Center of Brain-Machine Interface, and Sichuan Provincial Engineering Research Center of Neuromodulation, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Chao Yang
- Department of Neurology, West China Hospital, Sichuan University, Chengdu 610041, China; Sichuan Provincial Engineering Research Center of Brain-Machine Interface, and Sichuan Provincial Engineering Research Center of Neuromodulation, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Lei Chen
- Department of Neurology, West China Hospital, Sichuan University, Chengdu 610041, China; Sichuan Provincial Engineering Research Center of Brain-Machine Interface, and Sichuan Provincial Engineering Research Center of Neuromodulation, West China Hospital, Sichuan University, Chengdu 610041, China.
| |
Collapse
|
10
|
Li R, Zhao G, Muir DR, Ling Y, Burelo K, Khoe M, Wang D, Xing Y, Qiao N. Real-time sub-milliwatt epilepsy detection implemented on a spiking neural network edge inference processor. Comput Biol Med 2024; 183:109225. [PMID: 39413626 DOI: 10.1016/j.compbiomed.2024.109225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 06/05/2024] [Accepted: 09/26/2024] [Indexed: 10/18/2024]
Abstract
Analyzing electroencephalogram (EEG) signals to detect the epileptic seizure status of a subject presents a challenge to existing technologies aimed at providing timely and efficient diagnosis. In this study, we aimed to detect interictal and ictal periods of epileptic seizures using a spiking neural network (SNN). Our proposed approach provides an online and real-time preliminary diagnosis of epileptic seizures and helps to detect possible pathological conditions. To validate our approach, we conducted experiments using multiple datasets. We utilized a trained SNN to identify the presence of epileptic seizures and compared our results with those of related studies. The SNN model was deployed on Xylo, a digital SNN neuromorphic processor designed to process temporal signals. Xylo efficiently simulates spiking leaky integrate-and-fire neurons with exponential input synapses. Xylo has much lower energy requirements than traditional approaches to signal processing, making it an ideal platform for developing low-power seizure detection systems. Our proposed method has a high test accuracy of 93.3% and 92.9% when classifying ictal and interictal periods. At the same time, the application has an average power consumption of 87.4 μW (IO power) + 287.9 μW (compute power) when deployed to Xylo. Our method demonstrates excellent low-latency performance when tested on multiple datasets. Our work provides a new solution for seizure detection, and it is expected to be widely used in portable and wearable devices in the future.
Collapse
Affiliation(s)
- Ruixin Li
- State Key Laboratory of Digital Medical Engineering, Key Laboratory of Biomedical Engineering of Hainan Province, School of Biomedical Engineering, Hainan University, Sanya, 572025, China; Chengdu SynSense Tech. Co. Ltd., 1577 Tianfu Road, Chengdu, 610041, Sichuan, China
| | - Guoxu Zhao
- State Key Laboratory of Digital Medical Engineering, Key Laboratory of Biomedical Engineering of Hainan Province, School of Biomedical Engineering, Hainan University, Sanya, 572025, China
| | | | - Yuya Ling
- Chengdu SynSense Tech. Co. Ltd., 1577 Tianfu Road, Chengdu, 610041, Sichuan, China
| | - Karla Burelo
- Synsense, Thurgauerstrasse 60, Zürich, 8050, Switzerland
| | - Mina Khoe
- Synsense, Thurgauerstrasse 60, Zürich, 8050, Switzerland
| | - Dong Wang
- State Key Laboratory of Digital Medical Engineering, Key Laboratory of Biomedical Engineering of Hainan Province, School of Biomedical Engineering, Hainan University, Sanya, 572025, China.
| | - Yannan Xing
- Chengdu SynSense Tech. Co. Ltd., 1577 Tianfu Road, Chengdu, 610041, Sichuan, China.
| | - Ning Qiao
- Chengdu SynSense Tech. Co. Ltd., 1577 Tianfu Road, Chengdu, 610041, Sichuan, China; Synsense, Thurgauerstrasse 60, Zürich, 8050, Switzerland
| |
Collapse
|
11
|
Hu W, Wang J, Li F, Ge D, Wang Y, Jia Q, Yuan S. A Modified Transformer Network for Seizure Detection Using EEG Signals. Int J Neural Syst 2024:2550003. [PMID: 39560448 DOI: 10.1142/s0129065725500030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2024]
Abstract
Seizures have a serious impact on the physical function and daily life of epileptic patients. The automated detection of seizures can assist clinicians in taking preventive measures for patients during the diagnosis process. The combination of deep learning (DL) model with convolutional neural network (CNN) and transformer network can effectively extract both local and global features, resulting in improved seizure detection performance. In this study, an enhanced transformer network named Inresformer is proposed for seizure detection, which is combined with Inception and Residual network extracting different scale features of electroencephalography (EEG) signals to enrich the feature representation. In addition, the improved transformer network replaces the existing Feedforward layers with two half-step Feedforward layers to enhance the nonlinear representation of the model. The proposed architecture utilizes discrete wavelet transform (DWT) to decompose the original EEG signals, and the three sub-bands are selected for signal reconstruction. Then, the Co-MixUp method is adopted to solve the problem of data imbalance, and the processed signals are sent to the Inresformer network for seizure information capture and recognition. Finally, discriminant fusion is performed on the results of three-scale EEG sub-signals to achieve final seizure recognition. The proposed network achieves the best accuracy of 100% on Bonn dataset and the average accuracy of 98.03%, sensitivity of 95.65%, and specificity of 98.57% on the long-term CHB-MIT dataset. Compared to the existing DL networks, the proposed method holds significant potential for clinical research and diagnosis applications with competitive performance.
Collapse
Affiliation(s)
- Wenrong Hu
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Juan Wang
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Feng Li
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Daohui Ge
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Yuxia Wang
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Qingwei Jia
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Shasha Yuan
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| |
Collapse
|
12
|
Qureshi S, Iqbal SMZ, Ameer A, Karrila S, Ghadi YY, Shah SA. Enhancing drug-target interaction predictions in context of neurodegenerative diseases using bidirectional long short-term memory in male Swiss albino mice pharmaco-EEG analysis. Heliyon 2024; 10:e39279. [PMID: 39524776 PMCID: PMC11550650 DOI: 10.1016/j.heliyon.2024.e39279] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 10/10/2024] [Accepted: 10/10/2024] [Indexed: 11/16/2024] Open
Abstract
Background and Objective Emerging diseases like Parkinson or Alzheimer's, which are not curable, endanger human mental health and are challenging to research. Drug target interactions (DTI) are pivotal in the screening of candidate drugs and focus on a small pool of drug targets. Electroencephalogram shows the responses to psychotropic medicines in the brain bioelectric activity. Synaptic activity can be analyzed by using Local Field Potential recordings obtained from micro-electrodes implanted in the brain. The aim is to evaluate the effects of drug on brain bioelectric activity and increase the drug classification accuracy. The ultimate goal is to advance our understanding of how drugs affect synaptic activity and open the door to more focused treatment for neurodegenerative diseases. Methods In this study, Pharmaco-EEG recordings are processed using Advanced neural network models, particularly Convolutional Neural Networks, to assess the effects of medications. The five different medicines used in this study are Ephedrine, Fluoxetine, Kratom, Morphine, and Saline. The signals observed are local field potential signals. To overcome some limits of DTI prediction, we propose Bidirectional Long Short-Term Memory (LSTM) for the categorization of intracranial EEG (i-EEG) data, departing from standard approaches. Similar EEG patterns are presumably caused by drugs that work by homologous pharmacological pathways, producing similar psychotropic effects. To improve accuracy and reduce training loss, our study introduces a bidirectional LSTM model for classification along with Bayesian optimization. Results High recall, precision, and F1-Scores, particularly a 95% F1-Score for morphine, ephedrine, fluoxetine, and saline, suggest good performance in predicting these drug classes. Kratom produces a somewhat lower recall of 94%, but a high F1-Score of 97% and perfect precision of 1.00. The weighted average F1-Score, macro average, and overall accuracy are all consistently high (around 97%), indicating that the model works well throughout the spectrum of drugs. Conclusions Improved model performance was demonstrated by using a diversified dataset with five drug categories and bidirectional LSTM boosted with Bayesian optimization for hyperparameter tuning. From earlier limited-category models, it represents a substantial advancement.
Collapse
Affiliation(s)
- Shahnawaz Qureshi
- Intelligent Biomedical Application Lab, Sino-Pak center for Artificial Intelligence, School of Computing, Pak-Austria Fachhochschule: Institute of Applied Sciences and Technology, Mang Haripur, 22620, Pakistan
| | | | - Asif Ameer
- Department of Computer Science, National University of Computing and Emerging Sciences, Faisalabad, 38000, Pakistan
| | - Seppo Karrila
- Faculty of Science and Industrial Technology, Prince of Songkla University, Surat Thani Campus, Muang, Surat Thani, 84000, Thailand
| | - Yazeed Yasin Ghadi
- Department of Computer Science, Al Ain University Abu Dhab, Al Ain, United Arab Emirates
| | - Syed Aziz Shah
- Healthcare Sensing Technology, Faculty Research Centre for Intelligent Healthcare, Coventry University, Coventry, United Kingdom
| |
Collapse
|
13
|
Shang S, Shi Y, Zhang Y, Liu M, Zhang H, Wang P, Zhuang L. Artificial intelligence for brain disease diagnosis using electroencephalogram signals. J Zhejiang Univ Sci B 2024; 25:914-940. [PMID: 39420525 PMCID: PMC11494159 DOI: 10.1631/jzus.b2400103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 08/27/2024] [Indexed: 10/19/2024]
Abstract
Brain signals refer to electrical signals or metabolic changes that occur as a consequence of brain cell activity. Among the various non-invasive measurement methods, electroencephalogram (EEG) stands out as a widely employed technique, providing valuable insights into brain patterns. The deviations observed in EEG reading serve as indicators of abnormal brain activity, which is associated with neurological diseases. Brain‒computer interface (BCI) systems enable the direct extraction and transmission of information from the human brain, facilitating interaction with external devices. Notably, the emergence of artificial intelligence (AI) has had a profound impact on the enhancement of precision and accuracy in BCI technology, thereby broadening the scope of research in this field. AI techniques, encompassing machine learning (ML) and deep learning (DL) models, have demonstrated remarkable success in classifying and predicting various brain diseases. This comprehensive review investigates the application of AI in EEG-based brain disease diagnosis, highlighting advancements in AI algorithms.
Collapse
Affiliation(s)
- Shunuo Shang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
- The MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou 310027, China
| | - Yingqian Shi
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Yajie Zhang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Mengxue Liu
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Hong Zhang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Ping Wang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China.
- The MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou 310027, China.
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 310027, China.
| | - Liujing Zhuang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China.
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 310027, China.
| |
Collapse
|
14
|
Varnosfaderani SM, McNulty I, Sarhan NJ, Abood W, Alhawari M. An Efficient Epilepsy Prediction Model on European Dataset With Model Evaluation Considering Seizure Types. IEEE J Biomed Health Inform 2024; 28:5842-5854. [PMID: 38968012 DOI: 10.1109/jbhi.2024.3423766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/07/2024]
Abstract
This paper develops a computationally efficient model for automatic patient-specific seizure prediction using a two-layer LSTM from multichannel intracranial electroencephalogram time-series data. We decrease the number of parameters by employing a smaller input size and fewer electrodes, thereby making the model a viable option for wearable and implantable devices. We test the proposed prediction model on 26 patients from the European iEEG dataset, which is the largest epileptic seizure dataset. We also apply an automatic preprocessing technique based on a common average reference to remove artifacts from this dataset. The simulation results show that the model with its simple structure in conjunction with the mean post-processing procedure performed the best, with an average AUC of 0.885. This study is the first that utilizes the European database for epilepsy prediction application and the first that analyzes the effect of the seizure type on the system performance and demonstrates that the seizure type has a considerable impact.
Collapse
|
15
|
Wang Z, Song X, Chen L, Nan J, Sun Y, Pang M, Zhang K, Liu X, Ming D. Research progress of epileptic seizure prediction methods based on EEG. Cogn Neurodyn 2024; 18:2731-2750. [PMID: 39555266 PMCID: PMC11564528 DOI: 10.1007/s11571-024-10109-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 03/09/2024] [Accepted: 03/14/2024] [Indexed: 11/19/2024] Open
Abstract
At present, at least 30% of refractory epilepsy patients in the world cannot be effectively controlled and treated. The suddenness and unpredictability of seizures greatly affect the physical and mental health and even the life safety of patients, and the realization of early prediction of seizures and the adoption of interventions are of great significance to the improvement of patients' quality of life. In this paper, we firstly introduce the design process of EEG-based seizure prediction methods, introduce several databases commonly used in the research, and summarize the commonly used methods in pre-processing, feature extraction, classification and identification, and post-processing. Then, based on scalp EEG and intracranial EEG respectively, we reviewed the current status of epileptic seizure prediction research from five commonly used feature analysis methods, and make a comprehensive evaluation of both. Finally, this paper describes the reasons why the current algorithms cannot be applied to the clinic, summarizes their limitations, and gives corresponding suggestions, aiming to provide improvement directions for subsequent research. In addition, deep learning algorithms have emerged in recent years, and this paper also compares the advantages and disadvantages of deep learning algorithms with traditional machine learning methods, in the hope of providing researchers with new technologies and new ideas and making significant breakthroughs in the field of epileptic seizure prediction.
Collapse
Affiliation(s)
- Zhongpeng Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392 China
| | - Xiaoxin Song
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
| | - Long Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392 China
| | - Jinxiang Nan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
| | - Yulin Sun
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
| | - Meijun Pang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392 China
| | - Kuo Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392 China
| | - Xiuyun Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392 China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392 China
| |
Collapse
|
16
|
An J, Cai Q, Sun X, Li M, Ma C, Gao Z. Attention-based cross-frequency graph convolutional network for driver fatigue estimation. Cogn Neurodyn 2024; 18:3181-3194. [PMID: 39555279 PMCID: PMC11564598 DOI: 10.1007/s11571-024-10141-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 05/14/2024] [Accepted: 06/05/2024] [Indexed: 11/19/2024] Open
Abstract
Fatigue driving significantly contributes to global vehicle accidents and fatalities, making driver fatigue level estimation crucial. Electroencephalography (EEG) is a proven reliable predictor of brain states. With Deep Learning (DL) advancements, brain state estimation algorithms have improved significantly. Nonetheless, EEG's multi-domain nature and the intricate spatial-temporal-frequency correlations among EEG channels present challenges in developing precise DL models. In this work, we introduce an innovative Attention-based Cross-Frequency Graph Convolutional Network (ACF-GCN) for estimating drivers' reaction times using EEG signals from theta, alpha, and beta bands. This method utilizes a multi-head attention mechanism to detect long-range dependencies between EEG channels across frequencies. Concurrently, the transformer's encoder module learns node-level feature maps from the attention-score matrix. Subsequently, the Graph Convolutional Network (GCN) integrates this matrix with feature maps to estimate driver reaction time. Our validation on a publicly available dataset shows that ACF-GCN outperforms several state-of-the-art methods. We also explore the brain dynamics within the cross-frequency attention-score matrix, identifying theta and alpha bands as key influencers in fatigue estimating performance. The ACF-GCN method advances brain state estimation and provides insights into the brain dynamics underlying multi-channel EEG signals.
Collapse
Affiliation(s)
- Jianpeng An
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072 China
| | - Qing Cai
- School of Artificial Intelligence, Tiangong University, Tianjin, 300387 China
| | - Xinlin Sun
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072 China
| | - Mengyu Li
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072 China
| | - Chao Ma
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072 China
| | - Zhongke Gao
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072 China
| |
Collapse
|
17
|
Hu Y, Liu J, Sun R, Yu Y, Sui Y. Classification of epileptic seizures in EEG data based on iterative gated graph convolution network. Front Comput Neurosci 2024; 18:1454529. [PMID: 39268152 PMCID: PMC11390464 DOI: 10.3389/fncom.2024.1454529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 08/09/2024] [Indexed: 09/15/2024] Open
Abstract
Introduction The automatic and precise classification of epilepsy types using electroencephalogram (EEG) data promises significant advancements in diagnosing patients with epilepsy. However, the intricate interplay among multiple electrode signals in EEG data poses challenges. Recently, Graph Convolutional Neural Networks (GCN) have shown strength in analyzing EEG data due to their capability to describe complex relationships among different EEG regions. Nevertheless, several challenges remain: (1) GCN typically rely on predefined or prior graph topologies, which may not accurately reflect the complex correlations between brain regions. (2) GCN struggle to capture the long-temporal dependencies inherent in EEG signals, limiting their ability to effectively extract temporal features. Methods To address these challenges, we propose an innovative epileptic seizure classification model based on an Iterative Gated Graph Convolutional Network (IGGCN). For the epileptic seizure classification task, the original EEG graph structure is iteratively optimized using a multi-head attention mechanism during training, rather than relying on a static, predefined prior graph. We introduce Gated Graph Neural Networks (GGNN) to enhance the model's capacity to capture long-term dependencies in EEG series between brain regions. Additionally, Focal Loss is employed to alleviate the imbalance caused by the scarcity of epileptic EEG data. Results Our model was evaluated on the Temple University Hospital EEG Seizure Corpus (TUSZ) for classifying four types of epileptic seizures. The results are outstanding, achieving an average F1 score of 91.5% and an average Recall of 91.8%, showing a substantial improvement over current state-of-the-art models. Discussion Ablation experiments verified the efficacy of iterative graph optimization and gated graph convolution. The optimized graph structure significantly differs from the predefined EEG topology. Gated graph convolutions demonstrate superior performance in capturing the long-term dependencies in EEG series. Additionally, Focal Loss outperforms other commonly used loss functions in the TUSZ classification task.
Collapse
Affiliation(s)
- Yue Hu
- College of Computer Science and Technology, University of Qingdao, Qingdao, China
| | - Jian Liu
- Yunxiao Road Outpatient Department, Qingdao Stomatological Hospital, Qingdao, China
| | - Rencheng Sun
- College of Computer Science and Technology, University of Qingdao, Qingdao, China
| | - Yongqiang Yu
- College of Computer Science and Technology, University of Qingdao, Qingdao, China
| | - Yi Sui
- College of Computer Science and Technology, University of Qingdao, Qingdao, China
| |
Collapse
|
18
|
Yuan S, Yan K, Wang S, Liu JX, Wang J. EEG-Based Seizure Prediction Using Hybrid DenseNet-ViT Network with Attention Fusion. Brain Sci 2024; 14:839. [PMID: 39199530 PMCID: PMC11352294 DOI: 10.3390/brainsci14080839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Revised: 08/13/2024] [Accepted: 08/19/2024] [Indexed: 09/01/2024] Open
Abstract
Epilepsy seizure prediction is vital for enhancing the quality of life for individuals with epilepsy. In this study, we introduce a novel hybrid deep learning architecture, merging DenseNet and Vision Transformer (ViT) with an attention fusion layer for seizure prediction. DenseNet captures hierarchical features and ensures efficient parameter usage, while ViT offers self-attention mechanisms and global feature representation. The attention fusion layer effectively amalgamates features from both networks, guaranteeing the most relevant information is harnessed for seizure prediction. The raw EEG signals were preprocessed using the short-time Fourier transform (STFT) to implement time-frequency analysis and convert EEG signals into time-frequency matrices. Then, they were fed into the proposed hybrid DenseNet-ViT network model to achieve end-to-end seizure prediction. The CHB-MIT dataset, including data from 24 patients, was used for evaluation and the leave-one-out cross-validation method was utilized to evaluate the performance of the proposed model. Our results demonstrate superior performance in seizure prediction, exhibiting high accuracy and low redundancy, which suggests that combining DenseNet, ViT, and the attention mechanism can significantly enhance prediction capabilities and facilitate more precise therapeutic interventions.
Collapse
Affiliation(s)
- Shasha Yuan
- School of Computer Science, Qufu Normal University, Rizhao 276826, China; (K.Y.); (S.W.); (J.W.)
| | - Kuiting Yan
- School of Computer Science, Qufu Normal University, Rizhao 276826, China; (K.Y.); (S.W.); (J.W.)
| | - Shihan Wang
- School of Computer Science, Qufu Normal University, Rizhao 276826, China; (K.Y.); (S.W.); (J.W.)
| | - Jin-Xing Liu
- School of Health and Life Sciences, University of Health and Rehabilitation Sciences, Qingdao 266114, China;
| | - Juan Wang
- School of Computer Science, Qufu Normal University, Rizhao 276826, China; (K.Y.); (S.W.); (J.W.)
| |
Collapse
|
19
|
Mi J, Feng T, Wang H, Pei Z, Tang H. Beat-by-Beat Estimation of Hemodynamic Parameters in Left Ventricle Based on Phonocardiogram and Photoplethysmography Signals Using a Deep Learning Model: Preliminary Study. Bioengineering (Basel) 2024; 11:842. [PMID: 39199800 PMCID: PMC11351883 DOI: 10.3390/bioengineering11080842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Revised: 07/26/2024] [Accepted: 07/30/2024] [Indexed: 09/01/2024] Open
Abstract
Beat-by-beat monitoring of hemodynamic parameters in the left ventricle contributes to the early diagnosis and treatment of heart failure, valvular heart disease, and other cardiovascular diseases. Current accurate measurement methods for ventricular hemodynamic parameters are inconvenient for monitoring hemodynamic indexes in daily life. The objective of this study is to propose a method for estimating intraventricular hemodynamic parameters in a beat-to-beat style based on non-invasive PCG (phonocardiogram) and PPG (photoplethysmography) signals. Three beagle dogs were used as subjects. PCG, PPG, electrocardiogram (ECG), and invasive blood pressure signals in the left ventricle were synchronously collected while epinephrine medicine was injected into the veins to produce hemodynamic variations. Various doses of epinephrine were used to produce hemodynamic variations. A total of 40 records (over 12,000 cardiac cycles) were obtained. A deep neural network was built to simultaneously estimate four hemodynamic parameters of one cardiac cycle by inputting the PCGs and PPGs of the cardiac cycle. The outputs of the network were four hemodynamic parameters: left ventricular systolic blood pressure (SBP), left ventricular diastolic blood pressure (DBP), maximum rate of left ventricular pressure rise (MRR), and maximum rate of left ventricular pressure decline (MRD). The model built in this study consisted of a residual convolutional module and a bidirectional recurrent neural network module which learnt the local features and context relations, respectively. The training mode of the network followed a regression model, and the loss function was set as mean square error. When the network was trained and tested on one subject using a five-fold validation scheme, the performances were very good. The average correlation coefficients (CCs) between the estimated values and measured values were generally greater than 0.90 for SBP, DBP, MRR, and MRD. However, when the network was trained with one subject's data and tested with another subject's data, the performance degraded somewhat. The average CCs reduced from over 0.9 to 0.7 for SBP, DBP, and MRD; however, MRR had higher consistency, with the average CC reducing from over 0.9 to about 0.85 only. The generalizability across subjects could be improved if individual differences were considered. The performance indicates the possibility that hemodynamic parameters could be estimated by PCG and PPG signals collected on the body surface. With the rapid development of wearable devices, it has up-and-coming applications for self-monitoring in home healthcare environments.
Collapse
Affiliation(s)
- Jiachen Mi
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
| | - Tengfei Feng
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
| | - Hongkai Wang
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
- Liaoning Key Lab of Integrated Circuit and Biomedical Electronic System, Dalian University of Technology, Dalian 116024, China
- Dalian Key Laboratory of Digital Medicine for Critical Diseases, Dalian 116024, China
| | - Zuowei Pei
- Department of Cardiology, Central Hospital of Dalian University of Technology, No.826 Xinan Road, Dalian 116033, China;
| | - Hong Tang
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
- Liaoning Key Lab of Integrated Circuit and Biomedical Electronic System, Dalian University of Technology, Dalian 116024, China
- Dalian Key Laboratory of Digital Medicine for Critical Diseases, Dalian 116024, China
| |
Collapse
|
20
|
Ji D, He L, Dong X, Li H, Zhong X, Liu G, Zhou W. Epileptic Seizure Prediction Using Spatiotemporal Feature Fusion on EEG. Int J Neural Syst 2024; 34:2450041. [PMID: 38770650 DOI: 10.1142/s0129065724500412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Electroencephalography (EEG) plays a crucial role in epilepsy analysis, and epileptic seizure prediction has significant value for clinical treatment of epilepsy. Currently, prediction methods using Convolutional Neural Network (CNN) primarily focus on local features of EEG, making it challenging to simultaneously capture the spatial and temporal features from multi-channel EEGs to identify the preictal state effectively. In order to extract inherent spatial relationships among multi-channel EEGs while obtaining their temporal correlations, this study proposed an end-to-end model for the prediction of epileptic seizures by incorporating Graph Attention Network (GAT) and Temporal Convolutional Network (TCN). Low-pass filtered EEG signals were fed into the GAT module for EEG spatial feature extraction, and followed by TCN to capture temporal features, allowing the end-to-end model to acquire the spatiotemporal correlations of multi-channel EEGs. The system was evaluated on the publicly available CHB-MIT database, yielding segment-based accuracy of 98.71%, specificity of 98.35%, sensitivity of 99.07%, and F1-score of 98.71%, respectively. Event-based sensitivity of 97.03% and False Positive Rate (FPR) of 0.03/h was also achieved. Experimental results demonstrated this system can achieve superior performance for seizure prediction by leveraging the fusion of EEG spatiotemporal features without the need of feature engineering.
Collapse
Affiliation(s)
- Dezan Ji
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Landi He
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Xingchen Dong
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Haotian Li
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Xiangwen Zhong
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Guoyang Liu
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Weidong Zhou
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| |
Collapse
|
21
|
Zhu L, Wang W, Huang A, Ying N, Xu P, Zhang J. An efficient channel recurrent Criss-cross attention network for epileptic seizure prediction. Med Eng Phys 2024; 130:104213. [PMID: 39160021 DOI: 10.1016/j.medengphy.2024.104213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 07/08/2024] [Accepted: 07/31/2024] [Indexed: 08/21/2024]
Abstract
Epilepsy is a chronic disease caused by repeated abnormal discharge of neurons in the brain. Accurately predicting the onset of epilepsy can effectively improve the quality of life for patients with the condition. While there are many methods for detecting epilepsy, EEG is currently considered one of the most effective analytical tools due to the abundant information it provides about brain activity. The aim of this study is to explore potential time-frequency and channel features from multi-channel epileptic EEG signals and to develop a patient-specific seizure prediction network. In this paper, an epilepsy EEG signal classification algorithm called Channel Recurrent Criss-cross Attention Network (CRCANet) is proposed. Firstly, the spectrograms processed by the short-time fourier transform is input into a Convolutional Neural Network (CNN). Then, the spectrogram feature map obtained in the previous step is input into the channel attention module to establish correlations between channels. Subsequently, the feature diagram containing channel attention characteristics is input into the recurrent criss-cross attention module to enhance the information content of each pixel. Finally, two fully connected layers are used for classification. We validated the method on 13 patients in the public CHB-MIT scalp EEG dataset, achieving an average accuracy of 93.8 %, sensitivity of 94.3 %, and specificity of 93.5 %. The experimental results indicate that CRCANet can effectively capture the time-frequency and channel characteristics of EEG signals while improving training efficiency.
Collapse
Affiliation(s)
- Lei Zhu
- School of Automation, Hangzhou Dianzi University, Hangzhou 310000, PR China.
| | - Wentao Wang
- School of Automation, Hangzhou Dianzi University, Hangzhou 310000, PR China
| | - Aiai Huang
- School of Automation, Hangzhou Dianzi University, Hangzhou 310000, PR China
| | - Nanjiao Ying
- School of Automation, Hangzhou Dianzi University, Hangzhou 310000, PR China
| | - Ping Xu
- School of Automation, Hangzhou Dianzi University, Hangzhou 310000, PR China
| | - Jianhai Zhang
- School of Computer Science, Hangzhou Dianzi University, Hangzhou 310000, PR China; Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province, Hangzhou 310018, PR China
| |
Collapse
|
22
|
Nie J, Shu H, Wu F. An epilepsy classification based on FFT and fully convolutional neural network nested LSTM. Front Neurosci 2024; 18:1436619. [PMID: 39139499 PMCID: PMC11319253 DOI: 10.3389/fnins.2024.1436619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 07/16/2024] [Indexed: 08/15/2024] Open
Abstract
Background and objective Epilepsy, which is associated with neuronal damage and functional decline, typically presents patients with numerous challenges in their daily lives. An early diagnosis plays a crucial role in managing the condition and alleviating the patients' suffering. Electroencephalogram (EEG)-based approaches are commonly employed for diagnosing epilepsy due to their effectiveness and non-invasiveness. In this study, a classification method is proposed that use fast Fourier Transform (FFT) extraction in conjunction with convolutional neural networks (CNN) and long short-term memory (LSTM) models. Methods Most methods use traditional frameworks to classify epilepsy, we propose a new approach to this problem by extracting features from the source data and then feeding them into a network for training and recognition. It preprocesses the source data into training and validation data and then uses CNN and LSTM to classify the style of the data. Results Upon analyzing a public test dataset, the top-performing features in the fully CNN nested LSTM model for epilepsy classification are FFT features among three types of features. Notably, all conducted experiments yielded high accuracy rates, with values exceeding 96% for accuracy, 93% for sensitivity, and 96% for specificity. These results are further benchmarked against current methodologies, showcasing consistent and robust performance across all trials. Our approach consistently achieves an accuracy rate surpassing 97.00%, with values ranging from 97.95 to 99.83% in individual experiments. Particularly noteworthy is the superior accuracy of our method in the AB versus (vs.) CDE comparison, registering at 99.06%. Conclusion Our method exhibits precise classification abilities distinguishing between epileptic and non-epileptic individuals, irrespective of whether the participant's eyes are closed or open. Furthermore, our technique shows remarkable performance in effectively categorizing epilepsy type, distinguishing between epileptic ictal and interictal states versus non-epileptic conditions. An inherent advantage of our automated classification approach is its capability to disregard EEG data acquired during states of eye closure or eye-opening. Such innovation holds promise for real-world applications, potentially aiding medical professionals in diagnosing epilepsy more efficiently.
Collapse
Affiliation(s)
| | - Huazhong Shu
- Laboratory of Image Science and Technology, Key Laboratory of Computer Network and Information Integration, Ministry of Education, Southeast University, Nanjing, China
| | | |
Collapse
|
23
|
Wu M, Peng H, Liu Z, Wang J. Seizure Detection of EEG Signals Based on Multi-Channel Long- and Short-Term Memory-Like Spiking Neural Model. Int J Neural Syst 2024:2450051. [PMID: 39004932 DOI: 10.1142/s0129065724500515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/16/2024]
Abstract
Seizure is a common neurological disorder that usually manifests itself in recurring seizure, and these seizures can have a serious impact on a person's life and health. Therefore, early detection and diagnosis of seizure is crucial. In order to improve the efficiency of early detection and diagnosis of seizure, this paper proposes a new seizure detection method, which is based on discrete wavelet transform (DWT) and multi-channel long- and short-term memory-like spiking neural P (LSTM-SNP) model. First, the signal is decomposed into 5 levels by using DWT transform to obtain the features of the components at different frequencies, and a series of time-frequency features in wavelet coefficients are extracted. Then, these different features are used to train a multi-channel LSTM-SNP model and perform seizure detection. The proposed method achieves a high seizure detection accuracy on the CHB-MIT dataset: 98.25% accuracy, 98.22% specificity and 97.59% sensitivity. This indicates that the proposed epilepsy detection method can show competitive detection performance.
Collapse
Affiliation(s)
- Min Wu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Zhicai Liu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu 610039, P. R. China
| |
Collapse
|
24
|
Ahuja C, Sethia D. Harnessing Few-Shot Learning for EEG signal classification: a survey of state-of-the-art techniques and future directions. Front Hum Neurosci 2024; 18:1421922. [PMID: 39050382 PMCID: PMC11266297 DOI: 10.3389/fnhum.2024.1421922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 05/31/2024] [Indexed: 07/27/2024] Open
Abstract
This paper presents a systematic literature review, providing a comprehensive taxonomy of Data Augmentation (DA), Transfer Learning (TL), and Self-Supervised Learning (SSL) techniques within the context of Few-Shot Learning (FSL) for EEG signal classification. EEG signals have shown significant potential in various paradigms, including Motor Imagery, Emotion Recognition, Visual Evoked Potentials, Steady-State Visually Evoked Potentials, Rapid Serial Visual Presentation, Event-Related Potentials, and Mental Workload. However, challenges such as limited labeled data, noise, and inter/intra-subject variability have impeded the effectiveness of traditional machine learning (ML) and deep learning (DL) models. This review methodically explores how FSL approaches, incorporating DA, TL, and SSL, can address these challenges and enhance classification performance in specific EEG paradigms. It also delves into the open research challenges related to these techniques in EEG signal classification. Specifically, the review examines the identification of DA strategies tailored to various EEG paradigms, the creation of TL architectures for efficient knowledge transfer, and the formulation of SSL methods for unsupervised representation learning from EEG data. Addressing these challenges is crucial for enhancing the efficacy and robustness of FSL-based EEG signal classification. By presenting a structured taxonomy of FSL techniques and discussing the associated research challenges, this systematic review offers valuable insights for future investigations in EEG signal classification. The findings aim to guide and inspire researchers, promoting advancements in applying FSL methodologies for improved EEG signal analysis and classification in real-world settings.
Collapse
Affiliation(s)
- Chirag Ahuja
- Department of Computer Science and Engineering, Delhi Technological University, New Delhi, India
| | - Divyashikha Sethia
- Department of Software Engineering, Delhi Technology University, New Delhi, India
| |
Collapse
|
25
|
Awais M, Belhaouari SB, Kassoul K. Graphical Insight: Revolutionizing Seizure Detection with EEG Representation. Biomedicines 2024; 12:1283. [PMID: 38927490 PMCID: PMC11201274 DOI: 10.3390/biomedicines12061283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 05/28/2024] [Accepted: 05/31/2024] [Indexed: 06/28/2024] Open
Abstract
Epilepsy is characterized by recurring seizures that result from abnormal electrical activity in the brain. These seizures manifest as various symptoms including muscle contractions and loss of consciousness. The challenging task of detecting epileptic seizures involves classifying electroencephalography (EEG) signals into ictal (seizure) and interictal (non-seizure) classes. This classification is crucial because it distinguishes between the states of seizure and seizure-free periods in patients with epilepsy. Our study presents an innovative approach for detecting seizures and neurological diseases using EEG signals by leveraging graph neural networks. This method effectively addresses EEG data processing challenges. We construct a graph representation of EEG signals by extracting features such as frequency-based, statistical-based, and Daubechies wavelet transform features. This graph representation allows for potential differentiation between seizure and non-seizure signals through visual inspection of the extracted features. To enhance seizure detection accuracy, we employ two models: one combining a graph convolutional network (GCN) with long short-term memory (LSTM) and the other combining a GCN with balanced random forest (BRF). Our experimental results reveal that both models significantly improve seizure detection accuracy, surpassing previous methods. Despite simplifying our approach by reducing channels, our research reveals a consistent performance, showing a significant advancement in neurodegenerative disease detection. Our models accurately identify seizures in EEG signals, underscoring the potential of graph neural networks. The streamlined method not only maintains effectiveness with fewer channels but also offers a visually distinguishable approach for discerning seizure classes. This research opens avenues for EEG analysis, emphasizing the impact of graph representations in advancing our understanding of neurodegenerative diseases.
Collapse
Affiliation(s)
- Muhammad Awais
- Department of Creative Technologies, Air University, Islamabad 44000, Pakistan;
| | - Samir Brahim Belhaouari
- Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha 5825, Qatar
| | - Khelil Kassoul
- Geneva School of Business Administration, University of Applied Sciences Western Switzerland, HES-SO, 1227 Geneva, Switzerland
| |
Collapse
|
26
|
Georgis-Yap Z, Popovic MR, Khan SS. Supervised and Unsupervised Deep Learning Approaches for EEG Seizure Prediction. JOURNAL OF HEALTHCARE INFORMATICS RESEARCH 2024; 8:286-312. [PMID: 38681760 PMCID: PMC11052752 DOI: 10.1007/s41666-024-00160-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 01/04/2024] [Accepted: 01/18/2024] [Indexed: 05/01/2024]
Abstract
Epilepsy affects more than 50 million people worldwide, making it one of the world's most prevalent neurological diseases. The main symptom of epilepsy is seizures, which occur abruptly and can cause serious injury or death. The ability to predict the occurrence of an epileptic seizure could alleviate many risks and stresses people with epilepsy face. We formulate the problem of detecting preictal (or pre-seizure) with reference to normal EEG as a precursor to incoming seizure. To this end, we developed several supervised deep learning approaches model to identify preictal EEG from normal EEG. We further develop novel unsupervised deep learning approaches to train the models on only normal EEG, and detecting pre-seizure EEG as an anomalous event. These deep learning models were trained and evaluated on two large EEG seizure datasets in a person-specific manner. We found that both supervised and unsupervised approaches are feasible; however, their performance varies depending on the patient, approach and architecture. This new line of research has the potential to develop therapeutic interventions and save human lives.
Collapse
Affiliation(s)
- Zakary Georgis-Yap
- KITE Research Institute, Toronto Rehabilitation Institute - University Health Network, 550, University Avenue, Toronto, M5G 2A2 Ontario Canada
- Institute of Biomedical Engineering, University of Toronto, 64 College St., Toronto, M5S 3G9 Ontario Canada
| | - Milos R. Popovic
- KITE Research Institute, Toronto Rehabilitation Institute - University Health Network, 550, University Avenue, Toronto, M5G 2A2 Ontario Canada
- Institute of Biomedical Engineering, University of Toronto, 64 College St., Toronto, M5S 3G9 Ontario Canada
| | - Shehroz S. Khan
- KITE Research Institute, Toronto Rehabilitation Institute - University Health Network, 550, University Avenue, Toronto, M5G 2A2 Ontario Canada
- Institute of Biomedical Engineering, University of Toronto, 64 College St., Toronto, M5S 3G9 Ontario Canada
| |
Collapse
|
27
|
Li H, Liao J, Wang H, Zhan CA, Yang F. EEG power spectra parameterization and adaptive channel selection towards semi-supervised seizure prediction. Comput Biol Med 2024; 175:108510. [PMID: 38691913 DOI: 10.1016/j.compbiomed.2024.108510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 03/27/2024] [Accepted: 04/21/2024] [Indexed: 05/03/2024]
Abstract
BACKGROUND The seizure prediction algorithms have demonstrated their potential in mitigating epilepsy risks by detecting the pre-ictal state using ongoing electroencephalogram (EEG) signals. However, most of them require high-density EEG, which is burdensome to the patients for daily monitoring. Moreover, prevailing seizure models require extensive training with significant labeled data which is very time-consuming and demanding for the epileptologists. METHOD To address these challenges, here we propose an adaptive channel selection strategy and a semi-supervised deep learning model respectively to reduce the number of EEG channels and to limit the amount of labeled data required for accurate seizure prediction. Our channel selection module is centered on features from EEG power spectra parameterization that precisely characterize the epileptic activities to identify the seizure-associated channels for each patient. The semi-supervised model integrates generative adversarial networks and bidirectional long short-term memory networks to enhance seizure prediction. RESULTS Our approach is evaluated on the CHB-MIT and Siena epilepsy datasets. With utilizing only 4 channels, the method demonstrates outstanding performance with an AUC of 93.15% on the CHB-MIT dataset and an AUC of 88.98% on the Siena dataset. Experimental results also demonstrate that our selection approach reduces the model parameters and training time. CONCLUSIONS Adaptive channel selection coupled with semi-supervised learning can offer the possible bases for a light weight and computationally efficient seizure prediction system, making the daily monitoring practical to improve patients' quality of life.
Collapse
Affiliation(s)
- Hanyi Li
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China
| | - Jiahui Liao
- School of Electronics and Information Engineering, Harbin Institute of Technology at Shenzhen, Shenzhen, 518055, China
| | - Hongxiao Wang
- Department of Neurosurgery, Nanfang Hospital, Southern Medical University, Guangzhou, 510515, China
| | - Chang'an A Zhan
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, 510280, China.
| | - Feng Yang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China.
| |
Collapse
|
28
|
Lin PJ, Li W, Zhai X, Sun J, Pan Y, Ji L, Li C. AM-EEGNet: An advanced multi-input deep learning framework for classifying stroke patient EEG task states. Neurocomputing 2024; 585:127622. [DOI: 10.1016/j.neucom.2024.127622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/24/2024]
|
29
|
Ma H, Wu Y, Tang Y, Chen R, Xu T, Zhang W. Parallel Dual-Branch Fusion Network for Epileptic Seizure Prediction. Comput Biol Med 2024; 176:108565. [PMID: 38744007 DOI: 10.1016/j.compbiomed.2024.108565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 04/09/2024] [Accepted: 05/05/2024] [Indexed: 05/16/2024]
Abstract
Epilepsy is a prevalent chronic disorder of the central nervous system. The timely and accurate seizure prediction using the scalp Electroencephalography (EEG) signal can make patients adopt reasonable preventive measures before seizures occur and thus reduce harm to patients. In recent years, deep learning-based methods have made significant progress in solving the problem of epileptic seizure prediction. However, most current methods mainly focus on modeling short- or long-term dependence in EEG, while neglecting to consider both. In this study, we propose a Parallel Dual-Branch Fusion Network (PDBFusNet) which aims to combine the complementary advantages of Convolutional Neural Network (CNN) and Transformer. Specifically, the features of the EEG signal are first extracted using Mel Frequency Cepstral Coefficients (MFCC). Then, the extracted features are delivered into the parallel dual-branches to simultaneously capture the short- and long-term dependencies of EEG signal. Further, regarding the Transformer branch, a novel feature fusion module is developed to enhance the ability of utilizing time, frequency, and channel information. To evaluate our proposal, we perform sufficient experiments on the public epileptic EEG dataset CHB-MIT, where the accuracy, sensitivity, specificity and precision are 95.76%, 95.81%, 95.71% and 95.71%, respectively. PDBFusNet shows superior performance compared to state-of-the-art competitors, which confirms the effectiveness of our proposal.
Collapse
Affiliation(s)
- Hongcheng Ma
- School of Information and Communication Engineering, Hainan University, Haikou, China; State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Yajing Wu
- State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Yongqiang Tang
- State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Rui Chen
- School of Information and Communication Engineering, Hainan University, Haikou, China; State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Tao Xu
- Shanxi Key Laboratory of Big Data Analysis and Parallel Computing, Taiyuan University of Science and Technology, Taiyuan, China.
| | - Wensheng Zhang
- School of Information and Communication Engineering, Hainan University, Haikou, China; State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Computer Science and Cyber Engineering, Guangzhou University, Guangzhou, China.
| |
Collapse
|
30
|
Zhang S, Wu L, Yu S, Shi E, Qiang N, Gao H, Zhao J, Zhao S. An Explainable and Generalizable Recurrent Neural Network Approach for Differentiating Human Brain States on EEG Dataset. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:7339-7350. [PMID: 36331650 DOI: 10.1109/tnnls.2022.3214225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Electroencephalogram (EEG) is one of the most widely used brain computer interface (BCI) approaches. Despite the success of existing EEG approaches in brain state recognition studies, it is still challenging to differentiate brain states via explainable and generalizable deep learning approaches. In other words, how to explore meaningful and distinguishing features and how to overcome the huge variability and overfitting problem still need to be further studied. To alleviate these challenges, in this work, a multiple random fragment search-based multilayer recurrent neural network (MRFS-MRNN) is proposed to improve the differentiating performance and explore meaningful patterns. Specifically, an explainable MRNN module is proposed to capture the temporal dependences preserved in EEG time series. Besides, a MRFS module is designed to cut multiple random fragments from the entire EEG signal time course to improve the effectiveness of brain state differentiating ability. MRFS-MRNN is concatenatedto effectively overcome the huge variabilities and overfitting problems. Experiment results demonstrate that the proposed MRFS-MRNN model not only has excellent differentiating performance, but also has good explanation and generalization ability. The classification accuracies reach as high as 95.18% for binary classification and 89.19% for four-category classification on the individual level. Similarly, 95.53% and 85.84% classification accuracies are obtained for the binary and four-category classification on the group level. What's more, 94.28% and 85.43% classification accuracies of binary and four-category classifications are achieved for predicting brand new subjects. The experiment results showed that the proposed method outperformed other state-of-the-art (SOTA) models on the same underlying data and improved the explanation and generalization ability.
Collapse
|
31
|
Du Y, Li G, Wu M, Chen F. Unsupervised Multivariate Feature-Based Adaptive Clustering Analysis of Epileptic EEG Signals. Brain Sci 2024; 14:342. [PMID: 38671994 PMCID: PMC11047875 DOI: 10.3390/brainsci14040342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 03/22/2024] [Accepted: 03/28/2024] [Indexed: 04/28/2024] Open
Abstract
Supervised classification algorithms for processing epileptic EEG signals rely heavily on the label information of the data, and existing supervised methods cannot effectively solve the problem of analyzing unlabeled epileptic EEG signals. In the traditional unsupervised clustering algorithm, the number of clusters and the global parameters must be predetermined, and the algorithm's analytical results are combined with a huge number of subjective errors, which affects the detection accuracy. For this reason, this paper proposes an unsupervised multivariate feature adaptive clustering analysis algorithm based on epileptic EEG signals. First, CEEMDAN and CWT are introduced into the epileptic EEG signal after preprocessing for joint denoising to further improve the signal quality. Then, the multivariate feature set of the signal is extracted and constructed, which includes nonlinear, time, frequency, and time-frequency characteristics. To reveal the hidden structures and correlations in the high-dimensional feature data, t-SNE dimensionality reduction is introduced. Finally, the DBSCAN clustering algorithm is optimized using the SSA algorithm to achieve adaptive selection of cluster number and global parameters.It not only enhances the clustering performance and reliability of the clustering results, but also avoids subjective errors in the analysis results. It provides a pre-theoretical foundation for the successful development of future seizure prediction devices and has good application prospects in clinical diagnosis and daily monitoring of patients.
Collapse
Affiliation(s)
- Yuxiao Du
- School of Automation, Guangdong University of Technology, Guangzhou 510006, China; (Y.D.); (G.L.)
| | - Gaoming Li
- School of Automation, Guangdong University of Technology, Guangzhou 510006, China; (Y.D.); (G.L.)
| | - Min Wu
- School of Automation, China University of Geosciences, Wuhan 430074, China;
| | - Feng Chen
- School of Automation, Guangdong University of Technology, Guangzhou 510006, China; (Y.D.); (G.L.)
| |
Collapse
|
32
|
Ellis CA, Sancho ML, Miller RL, Calhoun VD. Identifying EEG Biomarkers of Depression with Novel Explainable Deep Learning Architectures. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.19.585728. [PMID: 38562835 PMCID: PMC10983917 DOI: 10.1101/2024.03.19.585728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Deep learning methods are increasingly being applied to raw electroencephalogram (EEG) data. However, if these models are to be used in clinical or research contexts, methods to explain them must be developed, and if these models are to be used in research contexts, methods for combining explanations across large numbers of models must be developed to counteract the inherent randomness of existing training approaches. Model visualization-based explainability methods for EEG involve structuring a model architecture such that its extracted features can be characterized and have the potential to offer highly useful insights into the patterns that they uncover. Nevertheless, model visualization-based explainability methods have been underexplored within the context of multichannel EEG, and methods to combine their explanations across folds have not yet been developed. In this study, we present two novel convolutional neural network-based architectures and apply them for automated major depressive disorder diagnosis. Our models obtain slightly lower classification performance than a baseline architecture. However, across 50 training folds, they find that individuals with MDD exhibit higher β power, potentially higher δ power, and higher brain-wide correlation that is most strongly represented within the right hemisphere. This study provides multiple key insights into MDD and represents a significant step forward for the domain of explainable deep learning applied to raw EEG. We hope that it will inspire future efforts that will eventually enable the development of explainable EEG deep learning models that can contribute both to clinical care and novel medical research discoveries.
Collapse
Affiliation(s)
- Charles A Ellis
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
| | - Martina Lapera Sancho
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
| | - Robyn L Miller
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
| | - Vince D Calhoun
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
- Department of Computer Science, Georgia State University, Atlanta GA 30303, USA
| |
Collapse
|
33
|
Lucasius C, Grigorovsky V, Nariai H, Galanopoulou AS, Gursky J, Moshe SL, Bardakjian BL. Biomimetic Deep Learning Networks With Applications to Epileptic Spasms and Seizure Prediction. IEEE Trans Biomed Eng 2024; 71:1056-1067. [PMID: 37851549 PMCID: PMC10979638 DOI: 10.1109/tbme.2023.3325762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2023]
Abstract
OBJECTIVE In this study, we present a novel biomimetic deep learning network for epileptic spasms and seizure prediction and compare its performance with state-of-the-art conventional machine learning models. METHODS Our proposed model incorporates modular Volterra kernel convolutional networks and bidirectional recurrent networks in combination with the phase amplitude cross-frequency coupling features derived from scalp EEG. They are applied to the standard CHB-MIT dataset containing focal epilepsy episodes as well as two other datasets from the Montefiore Medical Center and the University of California Los Angeles that provide data of patients experiencing infantile spasm (IS) syndrome. RESULTS Overall, in this study, the networks can produce accurate predictions (100%) and significant detection latencies (10 min). Furthermore, the biomimetic network outperforms conventional ones by producing no false positives. SIGNIFICANCE Biomimetic neural networks utilize extensive knowledge about processing and learning in the electrical networks of the brain. Predicting seizures in adults can improve their quality of life. Epileptic spasms in infants are part of a particular seizure type that needs identifying when suspicious behaviors are noticed in babies. Predicting epileptic spasms within a given time frame (the prediction horizon) suggests their existence and allows an epileptologist to flag an EEG trace for future review.
Collapse
|
34
|
Jemal I, Abou-Abbas L, Henni K, Mitiche A, Mezghani N. Domain adaptation for EEG-based, cross-subject epileptic seizure prediction. Front Neuroinform 2024; 18:1303380. [PMID: 38371495 PMCID: PMC10869477 DOI: 10.3389/fninf.2024.1303380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Accepted: 01/09/2024] [Indexed: 02/20/2024] Open
Abstract
The ability to predict the occurrence of an epileptic seizure is a safeguard against patient injury and health complications. However, a major challenge in seizure prediction arises from the significant variability observed in patient data. Common patient-specific approaches, which apply to each patient independently, often perform poorly for other patients due to the data variability. The aim of this study is to propose deep learning models which can handle this variability and generalize across various patients. This study addresses this challenge by introducing a novel cross-subject and multi-subject prediction models. Multiple-subject modeling broadens the scope of patient-specific modeling to account for the data from a dedicated ensemble of patients, thereby providing some useful, though relatively modest, level of generalization. The basic neural network architecture of this model is then adapted to cross-subject prediction, thereby providing a broader, more realistic, context of application. For accrued performance, and generalization ability, cross-subject modeling is enhanced by domain adaptation. Experimental evaluation using the publicly available CHB-MIT and SIENA data datasets shows that our multiple-subject model achieved better performance compared to existing works. However, the cross-subject faces challenges when applied to different patients. Finally, through investigating three domain adaptation methods, the model accuracy has been notably improved by 10.30% and 7.4% for the CHB-MIT and SIENA datasets, respectively.
Collapse
Affiliation(s)
- Imene Jemal
- Centre EMT, Institut National de la Recherche Scientifique, Montréal, QC, Canada
- Institute of Applied Artificial Intelligence (I2A), Université TÉLUQ, Montréal, QC, Canada
- Laboratoire de Recherche en Imagerie et Orthopédie, Centre de recherche du CHUM, Montréal, QC, Canada
| | - Lina Abou-Abbas
- Institute of Applied Artificial Intelligence (I2A), Université TÉLUQ, Montréal, QC, Canada
- Laboratoire de Recherche en Imagerie et Orthopédie, Centre de recherche du CHUM, Montréal, QC, Canada
| | - Khadidja Henni
- Institute of Applied Artificial Intelligence (I2A), Université TÉLUQ, Montréal, QC, Canada
- Laboratoire de Recherche en Imagerie et Orthopédie, Centre de recherche du CHUM, Montréal, QC, Canada
| | - Amar Mitiche
- Centre EMT, Institut National de la Recherche Scientifique, Montréal, QC, Canada
| | - Neila Mezghani
- Institute of Applied Artificial Intelligence (I2A), Université TÉLUQ, Montréal, QC, Canada
- Laboratoire de Recherche en Imagerie et Orthopédie, Centre de recherche du CHUM, Montréal, QC, Canada
| |
Collapse
|
35
|
Lee D, Kim B, Kim T, Joe I, Chong J, Min K, Jung K. A ResNet-LSTM hybrid model for predicting epileptic seizures using a pretrained model with supervised contrastive learning. Sci Rep 2024; 14:1319. [PMID: 38225340 PMCID: PMC10789752 DOI: 10.1038/s41598-023-43328-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 09/22/2023] [Indexed: 01/17/2024] Open
Abstract
In this paper, we propose a method for predicting epileptic seizures using a pre-trained model utilizing supervised contrastive learning and a hybrid model combining residual networks (ResNet) and long short-term memory (LSTM). The proposed training approach encompasses three key phases: pre-processing, pre-training as a pretext task, and training as a downstream task. In the pre-processing phase, the data is transformed into a spectrogram image using short time Fourier transform (STFT), which extracts both time and frequency information. This step compensates for the inherent complexity and irregularity of electroencephalography (EEG) data, which often hampers effective data analysis. During the pre-training phase, augmented data is generated from the original dataset using techniques such as band-stop filtering and temporal cutout. Subsequently, a ResNet model is pre-trained alongside a supervised contrastive loss model, learning the representation of the spectrogram image. In the training phase, a hybrid model is constructed by combining ResNet, initialized with weight values from the pre-trained model, and LSTM. This hybrid model extracts image features and time information to enhance prediction accuracy. The proposed method's effectiveness is validated using datasets from CHB-MIT and Seoul National University Hospital (SNUH). The method's generalization ability is confirmed through Leave-one-out cross-validation. From the experimental results measuring accuracy, sensitivity, and false positive rate (FPR), CHB-MIT was 91.90%, 89.64%, 0.058 and SNUH was 83.37%, 79.89%, and 0.131. The experimental results demonstrate that the proposed method outperforms the conventional methods.
Collapse
Affiliation(s)
- Dohyun Lee
- Department of Computer Science, Hanyang University, Seoul, 04763, South Korea
| | - Byunghyun Kim
- Department of Computer Science, Hanyang University, Seoul, 04763, South Korea
| | - Taejoon Kim
- Department of Neurology, Ajou University School of Medicine, Suwon, 16499, South Korea
| | - Inwhee Joe
- Department of Computer Science, Hanyang University, Seoul, 04763, South Korea
| | - Jongwha Chong
- Department of Computer Science, State University of New York Korea, Incheon, 21985, South Korea
| | - Kyeongyuk Min
- Department of Electronics Engineering, Hanyang University, Seoul, 04763, South Korea.
| | - Kiyoung Jung
- Department of Neurology, Seoul National University College of Medicine, Seoul, 03080, South Korea.
| |
Collapse
|
36
|
Shi S, Liu W. B2-ViT Net: Broad Vision Transformer Network With Broad Attention for Seizure Prediction. IEEE Trans Neural Syst Rehabil Eng 2024; 32:178-188. [PMID: 38145523 DOI: 10.1109/tnsre.2023.3346955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2023]
Abstract
Seizure prediction are necessary for epileptic patients. The global spatial interactions among channels, and long-range temporal dependencies play a crucial role in seizure onset prediction. In addition, it is necessary to search for seizure prediction features in a vast space to learn new generalized feature representations. Many previous deep learning algorithms have achieved some results in automatic seizure prediction. However, most of them do not consider global spatial interactions among channels and long-range temporal dependencies together, and only learn the feature representation in the deep space. To tackle these issues, in this study, an novel bi-level programming seizure prediction model, B2-ViT Net, is proposed for learning the new generalized spatio-temporal long-range correlation features, which can characterize the global interactions among channels in spatial, and long-range dependencies in temporal required for seizure prediction. In addition, the proposed model can comprehensively learn generalized seizure prediction features in a vast space due to its strong deep and broad feature search capabilities. Sufficient experiments are conducted on two public datasets, CHB-MIT and Kaggle datasets. Compared with other existing methods, our proposed model has shown promising results in automatic seizure prediction tasks, and provides a certain degree of interpretability.
Collapse
|
37
|
Wu G, Yu K, Zhou H, Wu X, Su S. Time-Series Anomaly Detection Based on Dynamic Temporal Graph Convolutional Network for Epilepsy Diagnosis. Bioengineering (Basel) 2024; 11:53. [PMID: 38247930 PMCID: PMC11154349 DOI: 10.3390/bioengineering11010053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 11/28/2023] [Accepted: 12/28/2023] [Indexed: 01/23/2024] Open
Abstract
Electroencephalography (EEG) is typical time-series data. Designing an automatic detection model for EEG is of great significance for disease diagnosis. For example, EEG stands as one of the most potent diagnostic tools for epilepsy detection. A myriad of studies have employed EEG to detect and classify epilepsy, yet these investigations harbor certain limitations. Firstly, most existing research concentrates on the labels of sliced EEG signals, neglecting epilepsy labels associated with each time step in the original EEG signal-what we term fine-grained labels. Secondly, a majority of these studies utilize static graphs to depict EEG's spatial characteristics, thereby disregarding the dynamic interplay among EEG channels. Consequently, the efficient nature of EEG structures may not be captured. In response to these challenges, we propose a novel seizure detection and classification framework-the dynamic temporal graph convolutional network (DTGCN). This method is specifically designed to model the interdependencies in temporal and spatial dimensions within EEG signals. The proposed DTGCN model includes a unique seizure attention layer conceived to capture the distribution and diffusion patterns of epilepsy. Additionally, the model incorporates a graph structure learning layer to represent the dynamically evolving graph structure inherent in the data. We rigorously evaluated the proposed DTGCN model using a substantial publicly available dataset, TUSZ, consisting of 5499 EEGs. The subsequent experimental results convincingly demonstrated that the DTGCN model outperformed the existing state-of-the-art methods in terms of efficiency and accuracy for both seizure detection and classification tasks.
Collapse
Affiliation(s)
| | - Ke Yu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (G.W.); (H.Z.); (X.W.); (S.S.)
| | | | | | | |
Collapse
|
38
|
Zhong X, Liu G, Dong X, Li C, Li H, Cui H, Zhou W. Automatic Seizure Detection Based on Stockwell Transform and Transformer. SENSORS (BASEL, SWITZERLAND) 2023; 24:77. [PMID: 38202939 PMCID: PMC10781173 DOI: 10.3390/s24010077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 12/15/2023] [Accepted: 12/20/2023] [Indexed: 01/12/2024]
Abstract
Epilepsy is a chronic neurological disease associated with abnormal neuronal activity in the brain. Seizure detection algorithms are essential in reducing the workload of medical staff reviewing electroencephalogram (EEG) records. In this work, we propose a novel automatic epileptic EEG detection method based on Stockwell transform and Transformer. First, the S-transform is applied to the original EEG segments, acquiring accurate time-frequency representations. Subsequently, the obtained time-frequency matrices are grouped into different EEG rhythm blocks and compressed as vectors in these EEG sub-bands. After that, these feature vectors are fed into the Transformer network for feature selection and classification. Moreover, a series of post-processing methods were introduced to enhance the efficiency of the system. When evaluating the public CHB-MIT database, the proposed algorithm achieved an accuracy of 96.15%, a sensitivity of 96.11%, a specificity of 96.38%, a precision of 96.33%, and an area under the curve (AUC) of 0.98 in segment-based experiments, along with a sensitivity of 96.57%, a false detection rate of 0.38/h, and a delay of 20.62 s in event-based experiments. These outstanding results demonstrate the feasibility of implementing this seizure detection method in future clinical applications.
Collapse
Affiliation(s)
- Xiangwen Zhong
- School of Integrated Circuits, Shandong University, Jinan 260100, China
| | - Guoyang Liu
- School of Integrated Circuits, Shandong University, Jinan 260100, China
| | - Xingchen Dong
- School of Integrated Circuits, Shandong University, Jinan 260100, China
| | - Chuanyu Li
- School of Integrated Circuits, Shandong University, Jinan 260100, China
| | - Haotian Li
- School of Integrated Circuits, Shandong University, Jinan 260100, China
| | - Haozhou Cui
- School of Integrated Circuits, Shandong University, Jinan 260100, China
| | - Weidong Zhou
- School of Integrated Circuits, Shandong University, Jinan 260100, China
- Shenzhen Institute, Shandong University, Shenzhen 518057, China
| |
Collapse
|
39
|
Wang B, Yang X, Li S, Wang W, Ouyang Y, Zhou J, Wang C. Automatic epileptic seizure detection based on EEG using a moth-flame optimization of one-dimensional convolutional neural networks. Front Neurosci 2023; 17:1291608. [PMID: 38161793 PMCID: PMC10755885 DOI: 10.3389/fnins.2023.1291608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2023] [Accepted: 11/20/2023] [Indexed: 01/03/2024] Open
Abstract
Introduction Frequent epileptic seizures can cause irreversible damage to the brains of patients. A potential therapeutic approach is to detect epileptic seizures early and provide artificial intervention to the patient. Currently, extracting electroencephalogram (EEG) features to detect epileptic seizures often requires tedious methods or the repeated adjustment of neural network hyperparameters, which can be time- consuming and demanding for researchers. Methods This study proposes an automatic detection model for an EEG based on moth-flame optimization (MFO) optimized one-dimensional convolutional neural networks (1D-CNN). First, according to the characteristics and need for early epileptic seizure detection, a data augmentation method for dividing an EEG into small samples is proposed. Second, the hyperparameters are tuned based on MFO and trained for an EEG. Finally, the softmax classifier is used to output EEG classification from a small-sample and single channel. Results The proposed model is evaluated with the Bonn EEG dataset, which verifies the feasibility of EEG classification problems that involve up to five classes, including healthy, preictal, and ictal EEG from various brain regions and individuals. Discussion Compared with existing advanced optimization algorithms, such as particle swarm optimization, genetic algorithm, and grey wolf optimizer, the superiority of the proposed model is further verified. The proposed model can be implemented into an automatic epileptic seizure detection system to detect seizures in clinical applications.
Collapse
Affiliation(s)
- Baozeng Wang
- Beijing Institute of Basic Medical Sciences, Beijing, China
| | - Xingyi Yang
- Beijing Institute of Basic Medical Sciences, Beijing, China
- State Key Laboratory of Intelligent Manufacturing System Technology, Beijing Institute of Electronic System Engineering, Beijing, China
| | - Siwei Li
- Beijing Institute of Basic Medical Sciences, Beijing, China
| | - Wenbo Wang
- Beijing Institute of Basic Medical Sciences, Beijing, China
| | - Yichen Ouyang
- Beijing Institute of Basic Medical Sciences, Beijing, China
| | - Jin Zhou
- Beijing Institute of Basic Medical Sciences, Beijing, China
- Chinese Institute for Brain Research, Beijing, China
| | - Changyong Wang
- Beijing Institute of Basic Medical Sciences, Beijing, China
| |
Collapse
|
40
|
Zurdo-Tabernero M, Canal-Alonso Á, de la Prieta F, Rodríguez S, Prieto J, Corchado JM. An overview of machine learning and deep learning techniques for predicting epileptic seizures. J Integr Bioinform 2023; 20:jib-2023-0002. [PMID: 38099461 PMCID: PMC10777364 DOI: 10.1515/jib-2023-0002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 08/01/2023] [Indexed: 01/11/2024] Open
Abstract
Epilepsy is a neurological disorder (the third most common, following stroke and migraines). A key aspect of its diagnosis is the presence of seizures that occur without a known cause and the potential for new seizures to occur. Machine learning has shown potential as a cost-effective alternative for rapid diagnosis. In this study, we review the current state of machine learning in the detection and prediction of epileptic seizures. The objective of this study is to portray the existing machine learning methods for seizure prediction. Internet bibliographical searches were conducted to identify relevant literature on the topic. Through cross-referencing from key articles, additional references were obtained to provide a comprehensive overview of the techniques. As the aim of this paper aims is not a pure bibliographical review of the subject, the publications here cited have been selected among many others based on their number of citations. To implement accurate diagnostic and treatment tools, it is necessary to achieve a balance between prediction time, sensitivity, and specificity. This balance can be achieved using deep learning algorithms. The best performance and results are often achieved by combining multiple techniques and features, but this approach can also increase computational requirements.
Collapse
Affiliation(s)
| | | | | | - Sara Rodríguez
- BISITE Research Group, University of Salamanca, Salamanca, Spain
| | - Javier Prieto
- BISITE Research Group, University of Salamanca, Salamanca, Spain
| | | |
Collapse
|
41
|
Wang Y, Cui W, Yu T, Li X, Liao X, Li Y. Dynamic Multi-Graph Convolution-Based Channel-Weighted Transformer Feature Fusion Network for Epileptic Seizure Prediction. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4266-4277. [PMID: 37782584 DOI: 10.1109/tnsre.2023.3321414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/04/2023]
Abstract
Electroencephalogram (EEG) based seizure prediction plays an important role in the closed-loop neuromodulation system. However, most existing seizure prediction methods based on graph convolution network only focused on constructing the static graph, ignoring multi-domain dynamic changes in deep graph structure. Moreover, the existing feature fusion strategies generally concatenated coarse-grained epileptic EEG features directly, leading to the suboptimal seizure prediction performance. To address these issues, we propose a novel multi-branch dynamic multi-graph convolution based channel-weighted transformer feature fusion network (MB-dMGC-CWTFFNet) for the patient-specific seizure prediction with the superior performance. Specifically, a multi-branch (MB) feature extractor is first applied to capture the temporal, spatial and spectral representations fromthe epileptic EEG jointly. Then, we design a point-wise dynamic multi-graph convolution network (dMGCN) to dynamically learn deep graph structures, which can effectively extract high-level features from the multi-domain graph. Finally, by integrating the local and global channel-weighted strategies with the multi-head self-attention mechanism, a channel-weighted transformer feature fusion network (CWTFFNet) is adopted to efficiently fuse the multi-domain graph features. The proposed MB-dMGC-CWTFFNet is evaluated on the public CHB-MIT EEG and a private intracranial sEEG datasets, and the experimental results demonstrate that our proposed method achieves outstanding prediction performance compared with the state-of-the-art methods, indicating an effective tool for patient-specific seizure warning. Our code will be available at: https://github.com/Rockingsnow/MB-dMGC-CWTFFNet.
Collapse
|
42
|
Liu D, Dong X, Bian D, Zhou W. Epileptic Seizure Prediction Using Attention Augmented Convolutional Network. Int J Neural Syst 2023; 33:2350054. [PMID: 37675593 DOI: 10.1142/s0129065723500545] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/08/2023]
Abstract
Early seizure prediction is crucial for epilepsy patients to reduce accidental injuries and improve their quality of life. Identifying pre-ictal EEG from the inter-ictal state is particularly challenging due to their nonictal nature and remarkable similarities. In this study, a novel epileptic seizure prediction method is proposed based on multi-head attention (MHA) augmented convolutional neural network (CNN) to address the issue of CNN's limit of capturing global information of input signals. First, data enhancement is performed on original EEG recordings to balance the pre-ictal and inter-ictal EEG data, and the EEG recordings are sliced into 6-second-long EEG segments. Subsequently, EEG time-frequency distribution is obtained using Stockwell transform (ST), and the attention augmented convolutional network is employed for feature extraction and classification. Finally, post-processing is utilized to reduce the false prediction rate (FPR). The CHB-MIT EEG database was used to evaluate the system. The validation results showed a segment-based sensitivity of 98.24% and an event-based sensitivity of 94.78% with a FPR of 0.05/h were yielded, respectively. The satisfying results of the proposed method demonstrate its possible potential for clinical applications.
Collapse
Affiliation(s)
- Dongsheng Liu
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| | - Xingchen Dong
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| | - Dong Bian
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| | - Weidong Zhou
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| |
Collapse
|
43
|
Li Y, Zhao X. Patient-specific warning of epileptic seizure upon shapelets features. Heliyon 2023; 9:e22431. [PMID: 38034613 PMCID: PMC10687046 DOI: 10.1016/j.heliyon.2023.e22431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 11/09/2023] [Accepted: 11/13/2023] [Indexed: 12/02/2023] Open
Abstract
Epilepsy is an intractable chronic neurological disease attached to extensive attention. Due to the fact that unpredictable seizure attacks result in serious physical injuries, early warning before seizure occurrence can help patients to get timely treatment and intervention. This paper presents a novel patient-specific method to predict epileptic seizures by learning shapelets of scalp electroencephalogram (EEG) signals recorded from different channels. In the proposed method, EEG signals are preprocessed to raise the Signal to Noise Rate (SNR). Multichannel shapelets space is constructed by the learning-near-to-optimal shapelets method. EEG signals are converted to distance matrices by projecting them on the shapelets' space. Bi-LSTM, SVM, CNN, and an ensemble of them are used to classify the feature set. Based on the prediction results then raise alarms. The proposed methodology is applied to the CHB-MIT scalp EEG dataset of 10 cases. The proposed method achieves a sensitivity of 91.33% and a false prediction rate of 0.16 h-1.
Collapse
Affiliation(s)
- Yingxiang Li
- School of Mathematics and Statistics, Lanzhou University, Lanzhou, PR China
| | - Xuejing Zhao
- School of Mathematics and Statistics, Lanzhou University, Lanzhou, PR China
| |
Collapse
|
44
|
Wang Q, Li Y, Su H, Zhong N, Xu Q, Li X. Deep neural network to differentiate internet gaming disorder from healthy controls during stop-signal task: a multichannel near-infrared spectroscopy study. BIOMED ENG-BIOMED TE 2023; 68:457-468. [PMID: 37099486 DOI: 10.1515/bmt-2023-0030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Accepted: 03/27/2023] [Indexed: 04/27/2023]
Abstract
Internet Gaming Disorder (IGD), as one of worldwide mental health issues, leads to negative effects on physical and mental health and has attracted public attention. Most studies on IGD are based on screening scales and subjective judgments of doctors, without objective quantitative assessment. However, public understanding of internet gaming disorder lacks objectivity. Therefore, the researches on internet gaming disorder still have many limitations. In this paper, a stop-signal task (SST) was designed to assess inhibitory control in patients with IGD based on prefrontal functional near-infrared spectroscopy (fNIRS). According to the scale, the subjects were divided into health and gaming disorder. A total of 40 subjects (24 internet gaming disorders; 16 healthy controls) signals were used for deep learning-based classification. The seven algorithms used for classification and comparison were deep learning algorithms (DL) and machine learning algorithms (ML), with four and three algorithms in each category, respectively. After applying hold-out method, the performance of the model was verified by accuracy. DL models outperformed traditional ML algorithms. Furthermore, the classification accuracy of the two-dimensional convolution neural network (2D-CNN) was 87.5% among all models. This was the highest accuracy out of all models that were tested. The 2D-CNN was able to outperform the other models due to its ability to learn complex patterns in data. This makes it well-suited for image classification tasks. The findings suggested that a 2D-CNN model is an effective approach for predicting internet gaming disorder. The results show that this is a reliable method with high accuracy to identify patients with IGD and demonstrate that the use of fNIRS to facilitate the development of IGD diagnosis has great potential.
Collapse
Affiliation(s)
- Qiwen Wang
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, China
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Yongkang Li
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, China
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Hang Su
- Shanghai Mental health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Na Zhong
- Shanghai Mental health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qi Xu
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, China
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Xiaoou Li
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, China
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| |
Collapse
|
45
|
Zhang Y, Li X, Wang S, Shen H, Huang K. A robust seizure detection and prediction method with feature selection and spatio-temporal casual neural network model. J Neural Eng 2023; 20:056036. [PMID: 37793368 DOI: 10.1088/1741-2552/acfff5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 10/04/2023] [Indexed: 10/06/2023]
Abstract
Objective.Epilepsy is a fairly common condition that affects the brain and causes frequent seizures. The sudden and recurring epilepsy brings a series of safety hazards to patients, which seriously affects the quality of their life. Therefore, real-time diagnosis of electroencephalogram (EEG) in epilepsy patients is of great significance. However, the conventional methods take in a tremendous amount of features to train the models, resulting in high computation cost and low portability. Our objective is to propose an efficient, light and robust seizure detecting and predicting algorithm.Approach.The algorithm is based on an interpretative feature selection method and spatial-temporal causal neural network (STCNN). The feature selection method eliminates the interference factors between different features and reduces the model size and training difficulties. The STCNN model takes both temporal and spatial information to accurately and dynamically track and diagnose the changing of the features. Considering the differences between medical application scenarios and patients, leave-one-out cross validation (LOOCV) and cross-patient validation (CPV) methods are used to conduct experiments on the dataset collected at the Children's Hospital Boston (CHB-MIT), Siena and Kaggle competition datasets.Main results.In LOOCV-based method, the detection accuracy and prediction sensitivity have been improved. A significant improvement is also achieved in the CPV-based method.Significance.The experimental results show that our proposed algorithm exhibits superior performance and robustness in seizure detection and prediction, which indicates it has higher capability to deal with different and complicated clinical situations.
Collapse
Affiliation(s)
- Yuanming Zhang
- Zhejiang University, 38 Zheda Road, Hangzhou, People's Republic of China
| | - Xin Li
- Zhejiang University, 38 Zheda Road, Hangzhou, People's Republic of China
| | - Shuang Wang
- Zhejiang University, 38 Zheda Road, Hangzhou, People's Republic of China
| | - Haibin Shen
- Zhejiang University, 38 Zheda Road, Hangzhou, People's Republic of China
| | - Kejie Huang
- Zhejiang University, 38 Zheda Road, Hangzhou, People's Republic of China
| |
Collapse
|
46
|
Liu S, Wang J, Li S, Cai L. Epileptic Seizure Detection and Prediction in EEGs Using Power Spectra Density Parameterization. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3884-3894. [PMID: 37725738 DOI: 10.1109/tnsre.2023.3317093] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/21/2023]
Abstract
Power spectrum analysis is one of the effective tools for classifying epileptic signals based on electroencephalography (EEG) recordings. However, the conflation of periodic and aperiodic components within the EEG may presents an obstacle to epilepsy detection or prediction. In this paper, we explored the significance of the periodic and aperiodic components of the EEG power spectrum for the detection and prediction of epilepsy respectively. We use a power spectrum density parameterization method to separate the periodic and aperiodic components of the signals, and validate their roles in epilepsy detection and prediction on two public datasets. The average classification accuracy of the periodic and aperiodic components for 10 clinical tasks on the Bonn EEG database were 73.9% and 96.68%, respectively, and increases to 98.88% when combined. For 22 patients on the CHB-MIT Long-term EEG database, the combined features achieve an average detection accuracy of 99.95% and successfully predict all seizures with low false prediction rates. We conclude that both the periodic and aperiodic components of the EEG power spectrum contributed to discriminating different stages of epilepsy, but the aperiodic neural activity played a decisive role in classification. This discovery has significant implications for diagnosing epileptic seizures and providing personalized brain activity information to improve the accuracy and efficiency of epilepsy detection.
Collapse
|
47
|
Guo L, Yu T, Zhao S, Li X, Liao X, Li Y. CLEP: Contrastive Learning for Epileptic Seizure Prediction Using a Spatio-Temporal-Spectral Network. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3915-3926. [PMID: 37796668 DOI: 10.1109/tnsre.2023.3322275] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/07/2023]
Abstract
Seizure prediction of epileptic preictal period through electroencephalogram (EEG) signals is important for clinical epilepsy diagnosis. However, recent deep learning-based methods commonly employ intra-subject training strategy and need sufficient data, which are laborious and time-consuming for a practical system and pose a great challenge for seizure predicting. Besides, multi-domain characterizations, including spatio-temporal-spectral dependencies in an epileptic brain are generally neglected or not considered simultaneously in current approaches, and this insufficiency commonly leads to suboptimal seizure prediction performance. To tackle the above issues, in this paper, we propose Contrastive Learning for Epileptic seizure Prediction (CLEP) using a Spatio-Temporal-Spectral Network (STS-Net). Specifically, the CLEP learns intrinsic epileptic EEG patterns across subjects by contrastive learning. The STS-Net extracts multi-scale temporal and spectral representations under different rhythms from raw EEG signals. Then, a novel triple attention layer (TAL) is employed to construct inter-dimensional interaction among multi-domain features. Moreover, a spatio dynamic graph convolution network (sdGCN) is proposed to dynamically model the spatial relationships between electrodes and aggregate spatial information. The proposed CLEP-STS-Net achieves a sensitivity of 96.7% and a false prediction rate of 0.072/h on the CHB-MIT scalp EEG database. We also validate the proposed method on clinical intracranial EEG (iEEG) database from our Xuanwu Hospital of Capital Medical University, and the predicting system yielded a sensitivity of 95%, a false prediction rate of 0.087/h. The experimental results outperform the state-of-the-art studies which validate the efficacy of our method. Our code is available at https://github.com/LianghuiGuo/CLEP-STS-Net.
Collapse
|
48
|
Lee HT, Cheon HR, Lee SH, Shim M, Hwang HJ. Risk of data leakage in estimating the diagnostic performance of a deep-learning-based computer-aided system for psychiatric disorders. Sci Rep 2023; 13:16633. [PMID: 37789047 PMCID: PMC10547830 DOI: 10.1038/s41598-023-43542-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 09/25/2023] [Indexed: 10/05/2023] Open
Abstract
Deep-learning approaches with data augmentation have been widely used when developing neuroimaging-based computer-aided diagnosis (CAD) systems. To prevent the inflated diagnostic performance caused by data leakage, a correct cross-validation (CV) method should be employed, but this has been still overlooked in recent deep-learning-based CAD studies. The goal of this study was to investigate the impact of correct and incorrect CV methods on the diagnostic performance of deep-learning-based CAD systems after data augmentation. To this end, resting-state electroencephalogram (EEG) data recorded from post-traumatic stress disorder patients and healthy controls were augmented using a cropping method with different window sizes, respectively. Four different CV approaches were used to estimate the diagnostic performance of the CAD system, i.e., subject-wise CV (sCV), overlapped sCV (oSCV), trial-wise CV (tCV), and overlapped tCV (otCV). Diagnostic performances were evaluated using two deep-learning models based on convolutional neural network. Data augmentation can increase the performance with all CVs, but inflated diagnostic performances were observed when using incorrect CVs (tCV and otCV) due to data leakage. Therefore, the correct CV (sCV and osCV) should be used to develop a deep-learning-based CAD system. We expect that our investigation can provide deep-insight for researchers who plan to develop neuroimaging-based CAD systems for psychiatric disorders using deep-learning algorithms with data augmentation.
Collapse
Affiliation(s)
- Hyung-Tak Lee
- Department of Electronics and Information Engineering, Korea University, Sejong, Republic of Korea
- Interdisciplinary Graduate Program for Artificial Intelligence Smart Convergence Technology, Korea University, Sejong, Republic of Korea
| | - Hye-Ran Cheon
- Department of Electronics and Information Engineering, Korea University, Sejong, Republic of Korea
- Interdisciplinary Graduate Program for Artificial Intelligence Smart Convergence Technology, Korea University, Sejong, Republic of Korea
| | - Seung-Hwan Lee
- Psychiatry Department, Ilsan Paik Hospital, Inje University, Goyang, Republic of Korea
- Clinical Emotion and Cognition Research Laboratory, Goyang, Republic of Korea
| | - Miseon Shim
- Department of Artificial Intelligence, Tech University of Korea, Siheung, Republic of Korea.
| | - Han-Jeong Hwang
- Department of Electronics and Information Engineering, Korea University, Sejong, Republic of Korea.
- Interdisciplinary Graduate Program for Artificial Intelligence Smart Convergence Technology, Korea University, Sejong, Republic of Korea.
| |
Collapse
|
49
|
Mao S, Sejdic E. A Review of Recurrent Neural Network-Based Methods in Computational Physiology. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:6983-7003. [PMID: 35130174 PMCID: PMC10589904 DOI: 10.1109/tnnls.2022.3145365] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Artificial intelligence and machine learning techniques have progressed dramatically and become powerful tools required to solve complicated tasks, such as computer vision, speech recognition, and natural language processing. Since these techniques have provided promising and evident results in these fields, they emerged as valuable methods for applications in human physiology and healthcare. General physiological recordings are time-related expressions of bodily processes associated with health or morbidity. Sequence classification, anomaly detection, decision making, and future status prediction drive the learning algorithms to focus on the temporal pattern and model the nonstationary dynamics of the human body. These practical requirements give birth to the use of recurrent neural networks (RNNs), which offer a tractable solution in dealing with physiological time series and provide a way to understand complex time variations and dependencies. The primary objective of this article is to provide an overview of current applications of RNNs in the area of human physiology for automated prediction and diagnosis within different fields. Finally, we highlight some pathways of future RNN developments for human physiology.
Collapse
|
50
|
Briden M, Norouzi N. Toward metacognition: subject-aware contrastive deep fusion representation learning for EEG analysis. BIOLOGICAL CYBERNETICS 2023; 117:363-372. [PMID: 37402000 PMCID: PMC10600301 DOI: 10.1007/s00422-023-00967-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 05/26/2023] [Indexed: 07/05/2023]
Abstract
We propose a subject-aware contrastive learning deep fusion neural network framework for effectively classifying subjects' confidence levels in the perception of visual stimuli. The framework, called WaveFusion, is composed of lightweight convolutional neural networks for per-lead time-frequency analysis and an attention network for integrating the lightweight modalities for final prediction. To facilitate the training of WaveFusion, we incorporate a subject-aware contrastive learning approach by taking advantage of the heterogeneity within a multi-subject electroencephalogram dataset to boost representation learning and classification accuracy. The WaveFusion framework demonstrates high accuracy in classifying confidence levels by achieving a classification accuracy of 95.7% while also identifying influential brain regions.
Collapse
Affiliation(s)
- Michael Briden
- Baskin Engineering, UC Santa Cruz, 1156 High Street, Santa Cruz, CA 95064 USA
| | - Narges Norouzi
- Electrical Engineering and Computer Sciences Department, UC Berkeley, Soda Hall, Berkeley, CA 94709 USA
| |
Collapse
|