1
|
Herbozo Contreras LF, Cui J, Yu L, Huang Z, Nikpour A, Kavehei O. KAN-EEG: towards replacing backbone-MLP for an effective seizure detection system. ROYAL SOCIETY OPEN SCIENCE 2025; 12:240999. [PMID: 40078924 PMCID: PMC11898101 DOI: 10.1098/rsos.240999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Revised: 10/25/2024] [Accepted: 01/24/2025] [Indexed: 03/14/2025]
Abstract
The landscape of artificial intelligence (AI) research is witnessing a transformative shift with the emergence of the Kolmogorov-Arnold network (KAN), presenting a novel architectural paradigm aimed to redefine the structural foundations of AI models, which are based on multilayer perceptron (MLP). Through rigorous experimentation and evaluation, we introduce the KAN-electroencephalogram (EEG) model, a tailored design for efficient seizure detection. Our proposed network is tested and successfully generalized on three different datasets, one from the USA, one from Europe, and one from Oceania, recorded with different front-end hardware. All datasets are scalp EEG in adults and are from patients living with epilepsy. Our empirical findings reveal that while both architectures demonstrate commendable performance in seizure detection, the KAN model exhibits high-level out-of-sample generalization across datasets from diverse geographical regions, underscoring its inherent efficacy and adaptability at the backbone level. Furthermore, we demonstrate the resilience of the KAN architecture to model size reduction and shallow network configurations, highlighting its versatility and efficiency by preventing over-fitting in-sample datasets. This study advances our understanding of innovative neural network architectures and underscores the pioneering potential of KANs in critical domains such as medical diagnostics.
Collapse
Affiliation(s)
| | - Jiashuo Cui
- School of Biomedical Engineering, Faculty of Engineering, The University of Sydney, Sydney, NSW2006, Australia
| | - Leping Yu
- School of Biomedical Engineering, Faculty of Engineering, The University of Sydney, Sydney, NSW2006, Australia
| | - Zhaojing Huang
- School of Biomedical Engineering, Faculty of Engineering, The University of Sydney, Sydney, NSW2006, Australia
| | - Armin Nikpour
- Comprehensive Epilepsy Service and Department of Neurology, Royal Prince Alfred Hospital, Sydney, NSW2050, Australia
- Faculty of Medicine and Health, Central Clinical School, The University of Sydney, Sydney, NSW2006, Australia
| | - Omid Kavehei
- School of Biomedical Engineering, Faculty of Engineering, The University of Sydney, Sydney, NSW2006, Australia
- The University of Sydney Nano Institute, Sydney, NSW2006, Australia
| |
Collapse
|
2
|
Wei L, Mooney C. An Explainable Transfer Learning Method for EEG-based Seizure Type Classification. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-4. [PMID: 40039604 DOI: 10.1109/embc53108.2024.10782701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
Epilepsy, traditionally conceptualized as a neurological disorder characterized by a persistent inclination toward epileptic seizures, is commonly diagnosed and monitored through EEGs. However, manual analysis of EEG data can be exceedingly time-consuming. The integration of automated seizure classification methods represents a valuable resource for clinicians engaged in epilepsy analysis. In this study, we introduce an explainable transfer learning method designed to classify seizure types within EEG recordings. Our method relies on the utilization of spectrograms derived from EEGs that capture seizure events, enabling the discrimination between normal EEG patterns and focal or generalized seizures. To achieve this, we employed four pre-trained transfer learning models, namely Inception, ResNet, DenseNet, and VGG16, using spectrogram data from 19 EEG channels as inputs. The model demonstrated high accuracy when assessed on an independent test dataset. To enhance clinician trust, we leveraged the LIME technique to elucidate model predictions, creating heatmap visualizations that emphasize explanation weights. The incorporation of a colorbar further facilitates clinician comprehension of predictions and aids in the identification of EEG seizure events. This method holds great promise for the effective classification of epilepsy types, providing support to neurologists in their comprehensive analysis of epilepsy cases.
Collapse
|
3
|
Hajisafi A, Lin H, Chiang YY, Shahabi C. Dynamic GNNs for Precise Seizure Detection and Classification from EEG Data. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING : ... PACIFIC-ASIA CONFERENCE, PAKDD ..., PROCEEDINGS. PACIFIC-ASIA CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING 2024; 14648:207-220. [PMID: 39507500 PMCID: PMC11535098 DOI: 10.1007/978-981-97-2238-9_16] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2024]
Abstract
Diagnosing epilepsy requires accurate seizure detection and classification, but traditional manual EEG signal analysis is resource-intensive. Meanwhile, automated algorithms often overlook EEG's geometric and semantic properties critical for interpreting brain activity. This paper introduces NeuroGNN, a dynamic Graph Neural Network (GNN) framework that captures the dynamic interplay between the EEG electrode locations and the semantics of their corresponding brain regions. The specific brain region where an electrode is placed critically shapes the nature of captured EEG signals. Each brain region governs distinct cognitive functions, emotions, and sensory processing, influencing both the semantic and spatial relationships within the EEG data. Understanding and modeling these intricate brain relationships are essential for accurate and meaningful insights into brain activity. This is precisely where the proposed NeuroGNN framework excels by dynamically constructing a graph that encapsulates these evolving spatial, temporal, semantic, and taxonomic correlations to improve precision in seizure detection and classification. Our extensive experiments with real-world data demonstrate that NeuroGNN significantly outperforms existing state-of-the-art models.
Collapse
Affiliation(s)
| | - Haowen Lin
- University of Southern California, Los Angeles, CA, USA
| | | | - Cyrus Shahabi
- University of Southern California, Los Angeles, CA, USA
| |
Collapse
|
4
|
Saab K, Tang S, Taha M, Lee-Messer C, Ré C, Rubin DL. Towards trustworthy seizure onset detection using workflow notes. NPJ Digit Med 2024; 7:42. [PMID: 38383884 PMCID: PMC10881468 DOI: 10.1038/s41746-024-01008-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 01/10/2024] [Indexed: 02/23/2024] Open
Abstract
A major barrier to deploying healthcare AI is trustworthiness. One form of trustworthiness is a model's robustness across subgroups: while models may exhibit expert-level performance on aggregate metrics, they often rely on non-causal features, leading to errors in hidden subgroups. To take a step closer towards trustworthy seizure onset detection from EEG, we propose to leverage annotations that are produced by healthcare personnel in routine clinical workflows-which we refer to as workflow notes-that include multiple event descriptions beyond seizures. Using workflow notes, we first show that by scaling training data to 68,920 EEG hours, seizure onset detection performance significantly improves by 12.3 AUROC (Area Under the Receiver Operating Characteristic) points compared to relying on smaller training sets with gold-standard labels. Second, we reveal that our binary seizure onset detection model underperforms on clinically relevant subgroups (e.g., up to a margin of 6.5 AUROC points between pediatrics and adults), while having significantly higher FPRs (False Positive Rates) on EEG clips showing non-epileptiform abnormalities (+19 FPR points). To improve model robustness to hidden subgroups, we train a multilabel model that classifies 26 attributes other than seizures (e.g., spikes and movement artifacts) and significantly improve overall performance (+5.9 AUROC points) while greatly improving performance among subgroups (up to +8.3 AUROC points) and decreasing false positives on non-epileptiform abnormalities (by 8 FPR points). Finally, we find that our multilabel model improves clinical utility (false positives per 24 EEG hours) by a factor of 2×.
Collapse
Affiliation(s)
- Khaled Saab
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA.
| | - Siyi Tang
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Mohamed Taha
- Department of Neurology, Stanford University, Stanford, CA, USA
| | | | - Christopher Ré
- Department of Computer Science, Stanford University, Stanford, CA, USA
| | - Daniel L Rubin
- Department of Biomedical Data Science, Radiology, and Medicine, Stanford University, Stanford, CA, USA.
| |
Collapse
|
5
|
Zhuang Z, Wang YK, Chang YC, Liu J, Lin CT. A Connectivity-Aware Graph Neural Network for Real-Time Drowsiness Classification. IEEE Trans Neural Syst Rehabil Eng 2024; 32:83-93. [PMID: 38010936 DOI: 10.1109/tnsre.2023.3336897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
Drowsy driving is one of the primary causes of driving fatalities. Electroencephalography (EEG), a method for detecting drowsiness directly from brain activity, has been widely used for detecting driver drowsiness in real-time. Recent studies have revealed the great potential of using brain connectivity graphs constructed based on EEG data for drowsy state predictions. However, traditional brain connectivity networks are irrelevant to the downstream prediction tasks. This article proposes a connectivity-aware graph neural network (CAGNN) using a self-attention mechanism that can generate task-relevant connectivity networks via end-to-end training. Our method achieved an accuracy of 72.6% and outperformed other convolutional neural networks (CNNs) and graph generation methods based on a drowsy driving dataset. In addition, we introduced a squeeze-and-excitation (SE) block to capture important features and demonstrated that the SE attention score can reveal the most important feature band. We compared our generated connectivity graphs in the drowsy and alert states and found drowsiness connectivity patterns, including significantly reduced occipital connectivity and interregional connectivity. Additionally, we performed a post hoc interpretability analysis and found that our method could identify drowsiness features such as alpha spindles. Our code is available online at https://github.com/ALEX95GOGO/CAGNN.
Collapse
|
6
|
Wu G, Yu K, Zhou H, Wu X, Su S. Time-Series Anomaly Detection Based on Dynamic Temporal Graph Convolutional Network for Epilepsy Diagnosis. Bioengineering (Basel) 2024; 11:53. [PMID: 38247930 PMCID: PMC11154349 DOI: 10.3390/bioengineering11010053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 11/28/2023] [Accepted: 12/28/2023] [Indexed: 01/23/2024] Open
Abstract
Electroencephalography (EEG) is typical time-series data. Designing an automatic detection model for EEG is of great significance for disease diagnosis. For example, EEG stands as one of the most potent diagnostic tools for epilepsy detection. A myriad of studies have employed EEG to detect and classify epilepsy, yet these investigations harbor certain limitations. Firstly, most existing research concentrates on the labels of sliced EEG signals, neglecting epilepsy labels associated with each time step in the original EEG signal-what we term fine-grained labels. Secondly, a majority of these studies utilize static graphs to depict EEG's spatial characteristics, thereby disregarding the dynamic interplay among EEG channels. Consequently, the efficient nature of EEG structures may not be captured. In response to these challenges, we propose a novel seizure detection and classification framework-the dynamic temporal graph convolutional network (DTGCN). This method is specifically designed to model the interdependencies in temporal and spatial dimensions within EEG signals. The proposed DTGCN model includes a unique seizure attention layer conceived to capture the distribution and diffusion patterns of epilepsy. Additionally, the model incorporates a graph structure learning layer to represent the dynamically evolving graph structure inherent in the data. We rigorously evaluated the proposed DTGCN model using a substantial publicly available dataset, TUSZ, consisting of 5499 EEGs. The subsequent experimental results convincingly demonstrated that the DTGCN model outperformed the existing state-of-the-art methods in terms of efficiency and accuracy for both seizure detection and classification tasks.
Collapse
Affiliation(s)
| | - Ke Yu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (G.W.); (H.Z.); (X.W.); (S.S.)
| | | | | | | |
Collapse
|
7
|
Khuat TT, Gabrys B. Random Hyperboxes. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:1008-1022. [PMID: 34424848 DOI: 10.1109/tnnls.2021.3104896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
This article proposes a simple yet powerful ensemble classifier, called Random Hyperboxes, constructed from individual hyperbox-based classifiers trained on the random subsets of sample and feature spaces of the training set. We also show a generalization error bound of the proposed classifier based on the strength of the individual hyperbox-based classifiers as well as the correlation among them. The effectiveness of the proposed classifier is analyzed using a carefully selected illustrative example and compared empirically with other popular single and ensemble classifiers via 20 datasets using statistical testing methods. The experimental results confirmed that our proposed method outperformed other fuzzy min-max neural networks (FMNNs), popular learning algorithms, and is competitive with other ensemble methods. Finally, we identify the existing issues related to the generalization error bounds of the real datasets and inform the potential research directions.
Collapse
|
8
|
Wu D, Li J, Dong F, Liu J, Jiang L, Cao J, Wu X, Zhang X. Classification of seizure types based on multi-class specific bands common spatial pattern and penalized ensemble model. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
|
9
|
Nandakumar N, Hsu D, Ahmed R, Venkataraman A. DeepEZ: A Graph Convolutional Network for Automated Epileptogenic Zone Localization From Resting-State fMRI Connectivity. IEEE Trans Biomed Eng 2023; 70:216-227. [PMID: 35776823 PMCID: PMC9841829 DOI: 10.1109/tbme.2022.3187942] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
OBJECTIVE Epileptogenic zone (EZ) localization is a crucial step during diagnostic work up and therapeutic planning in medication refractory epilepsy. In this paper, we present the first deep learning approach to localize the EZ based on resting-state fMRI (rs-fMRI) data. METHODS Our network, called DeepEZ, uses a cascade of graph convolutions that emphasize signal propagation along expected anatomical pathways. We also integrate domain-specific information, such as an asymmetry term on the predicted EZ and a learned subject-specific bias to mitigate environmental confounds. RESULTS We validate DeepEZ on rs-fMRI collected from 14 patients with focal epilepsy at the University of Wisconsin Madison. Using cross validation, we demonstrate that DeepEZ achieves consistently high EZ localization performance (Accuracy: 0.88 ± 0.03; AUC: 0.73 ± 0.03) that far outstripped any of the baseline methods. This performance is notable given the variability in EZ locations and scanner type across the cohort. CONCLUSION Our results highlight the promise of using DeepEZ as an accurate and noninvasive therapeutic planning tool for medication refractory epilepsy. SIGNIFICANCE While prior work in EZ localization focused on identifying localized aberrant signatures, there is growing evidence that epileptic seizures affect inter-regional connectivity in the brain. DeepEZ allows clinicians to harness this information from noninvasive imaging that can easily be integrated into the existing clinical workflow.
Collapse
|
10
|
Graph-generative neural network for EEG-based epileptic seizure detection via discovery of dynamic brain functional connectivity. Sci Rep 2022; 12:18998. [PMID: 36348082 PMCID: PMC9643358 DOI: 10.1038/s41598-022-23656-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 11/03/2022] [Indexed: 11/09/2022] Open
Abstract
Dynamic complexity in brain functional connectivity has hindered the effective use of signal processing or machine learning methods to diagnose neurological disorders such as epilepsy. This paper proposed a new graph-generative neural network (GGN) model for the dynamic discovery of brain functional connectivity via deep analysis of scalp electroencephalogram (EEG) signals recorded from various regions of a patient's scalp. Brain functional connectivity graphs are generated for the extraction of spatial-temporal resolution of various onset epilepsy seizure patterns. Our supervised GGN model was substantiated by seizure detection and classification experiments. We train the GGN model using a clinically proven dataset of over 3047 epileptic seizure cases. The GGN model achieved a 91% accuracy in classifying seven types of epileptic seizure attacks, which outperformed the 65%, 74%, and 82% accuracy in using the convolutional neural network (CNN), graph neural networks (GNN), and transformer models, respectively. We present the GGN model architecture and operational steps to assist neuroscientists or brain specialists in using dynamic functional connectivity information to detect neurological disorders. Furthermore, we suggest to merge our spatial-temporal graph generator design in upgrading the conventional CNN and GNN models with dynamic convolutional kernels for accuracy enhancement.
Collapse
|
11
|
Asif U, Roy S, Tang J, Harrer S. SeizureNet: Multi-Spectral Deep Feature Learning for Seizure Type Classification. MACHINE LEARNING IN CLINICAL NEUROIMAGING AND RADIOGENOMICS IN NEURO-ONCOLOGY 2020. [DOI: 10.1007/978-3-030-66843-3_8] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|