Epileptic EEG Classification by Using Time-Frequency Images for Deep Learning

Application of deconvolutional networks for feature interpretability in epilepsy detection

Introduction

Scalp electroencephalography (EEG) is commonly used to assist in epilepsy detection. Even automated detection algorithms are already available to assist clinicians in reviewing EEG data, many algorithms used for seizure detection in epilepsy fail to account for the contributions of different channels. The Fully Convolutional Network (FCN) can provide the model's interpretability but has not been applied in seizure detection.

Methods

To address these challenges, a novel convolutional neural network (CNN) model, combining SE (Squeeze-and-Excitation) modules, was proposed on top of the FCN. The epilepsy detection performance for patient-independent was evaluated on the CHB-MIT dataset. Then, the SE module was removed from the model and integrated the model with Inception, ResNet, and CBAM modules separately.

Results

The method showed superior advancement, stability, and reliability compared to the other three methods. The method demonstrated a G-Mean of 82.7% for sensitivity (SEN) and specificity (SPE) on the CHB-MIT dataset. In addition, The contributions of each channel to the seizure detection task have also been quantified, which led us to find that the FZ, CZ, PZ, FT9, FT10, and T8 brain regions have a more pronounced impact on epileptic seizures.

Discussion

This article presents a novel algorithm for epilepsy detection that accurately identifies seizures in different patients and enhances the model's interpretability.

Deep Learning Recognition of Paroxysmal Kinesigenic Dyskinesia Based on EEG Functional Connectivity

Paroxysmal kinesigenic dyskinesia (PKD) is a rare neurological disorder marked by transient involuntary movements triggered by sudden actions. Current diagnostic approaches, including genetic screening, face challenges in identifying secondary cases due to symptom overlap with other disorders. This study introduces a novel PKD recognition method utilizing a resting-state electroencephalogram (EEG) functional connectivity matrix and a deep learning architecture (AT-1CBL). Resting-state EEG data from 44 PKD patients and 44 healthy controls (HCs) were collected using a 128-channel EEG system. Functional connectivity matrices were computed and transformed into graph data to examine brain network property differences between PKD patients and controls through graph theory. Source localization was conducted to explore neural circuit differences in patients. The AT-1CBL model, integrating 1D-CNN and Bi-LSTM with attentional mechanisms, achieved a classification accuracy of 93.77% on phase lag index (PLI) features in the Theta band. Graph theoretic analysis revealed significant phase synchronization impairments in the Theta band of the functional brain network in PKD patients, particularly in the distribution of weak connections compared to HCs. Source localization analyses indicated greater differences in functional connectivity in sensorimotor regions and the frontal-limbic system in PKD patients, suggesting abnormalities in motor integration related to clinical symptoms. This study highlights the potential of deep learning models based on EEG functional connectivity for accurate and cost-effective PKD diagnosis, supporting the development of portable EEG devices for clinical monitoring and diagnosis. However, the limited dataset size may affect generalizability, and further exploration of multimodal data integration and advanced deep learning architectures is necessary to enhance the robustness of PKD diagnostic models.

A Lightweight Convolutional Neural Network-Reformer Model for Efficient Epileptic Seizure Detection

A real-time and reliable automatic detection system for epileptic seizures holds significant value in assisting physicians with rapid diagnosis and treatment of epilepsy. Aiming to address this issue, a novel lightweight model called Convolutional Neural Network-Reformer (CNN-Reformer) is proposed for seizure detection on long-term EEG. The CNN-Reformer consists of two main parts: the Data Reshaping (DR) module and the Efficient Attention and Concentration (EAC) module. This framework reduces network parameters while retaining effective feature extraction of multi-channel EEGs, thereby improving model computational efficiency and real-time performance. Initially, the raw EEG signals undergo Discrete Wavelet Transform (DWT) for signal filtering, and then fed into the DR module for data compression and reshaping while preserving local features. Subsequently, these local features are sent to the EAC module to extract global features and perform categorization. Post-processing involving sliding window averaging, thresholding, and collar techniques is further deployed to reduce the false detection rate (FDR) and improve detection performance. On the CHB-MIT scalp EEG dataset, our method achieves an average sensitivity of 97.57%, accuracy of 98.09%, and specificity of 98.11% at segment-based level, and a sensitivity of 96.81%, along with FDR of 0.27/h, and latency of 17.81 s at the event-based level. On the SH-SDU dataset we collected, our method yielded segment-based sensitivity of 94.51%, specificity of 92.83%, and accuracy of 92.81%, along with event-based sensitivity of 94.11%. The average testing time for 1[Formula: see text]h of multi-channel EEG signals is 1.92[Formula: see text]s. The excellent results and fast computational speed of the CNN-Reformer model demonstrate its potential for efficient seizure detection.

A Feature Fusion Model Based on Temporal Convolutional Network for Automatic Sleep Staging Using Single-Channel EEG

Sleep staging is a crucial task in sleep monitoring and diagnosis, but clinical sleep staging is both time-consuming and subjective. In this study, we proposed a novel deep learning algorithm named feature fusion temporal convolutional network (FFTCN) for automatic sleep staging using single-channel EEG data. This algorithm employed a one-dimensional convolutional neural network (1D-CNN) to extract temporal features from raw EEG, and a two-dimensional CNN (2D-CNN) to extract time-frequency features from spectrograms generated through continuous wavelet transform (CWT) at the epoch level. These features were subsequently fused and further fed into a temporal convolutional network (TCN) to classify sleep stages at the sequence level. Moreover, a two-step training strategy was used to enhance the model's performance on an imbalanced dataset. Our proposed method exhibits superior performance in the 5-class classification task for healthy subjects, as evaluated on the SHHS-1, Sleep-EDF-153, and ISRUC-S1 datasets. This work provided a straightforward and promising method for improving the accuracy of automatic sleep staging using only single-channel EEG, and the proposed method exhibited great potential for future applications in professional sleep monitoring, which could effectively alleviate the workload of sleep technicians.

An epilepsy classification based on FFT and fully convolutional neural network nested LSTM

Background and objective

Epilepsy, which is associated with neuronal damage and functional decline, typically presents patients with numerous challenges in their daily lives. An early diagnosis plays a crucial role in managing the condition and alleviating the patients' suffering. Electroencephalogram (EEG)-based approaches are commonly employed for diagnosing epilepsy due to their effectiveness and non-invasiveness. In this study, a classification method is proposed that use fast Fourier Transform (FFT) extraction in conjunction with convolutional neural networks (CNN) and long short-term memory (LSTM) models.

Methods

Most methods use traditional frameworks to classify epilepsy, we propose a new approach to this problem by extracting features from the source data and then feeding them into a network for training and recognition. It preprocesses the source data into training and validation data and then uses CNN and LSTM to classify the style of the data.

Results

Upon analyzing a public test dataset, the top-performing features in the fully CNN nested LSTM model for epilepsy classification are FFT features among three types of features. Notably, all conducted experiments yielded high accuracy rates, with values exceeding 96% for accuracy, 93% for sensitivity, and 96% for specificity. These results are further benchmarked against current methodologies, showcasing consistent and robust performance across all trials. Our approach consistently achieves an accuracy rate surpassing 97.00%, with values ranging from 97.95 to 99.83% in individual experiments. Particularly noteworthy is the superior accuracy of our method in the AB versus (vs.) CDE comparison, registering at 99.06%.

Conclusion

Our method exhibits precise classification abilities distinguishing between epileptic and non-epileptic individuals, irrespective of whether the participant's eyes are closed or open. Furthermore, our technique shows remarkable performance in effectively categorizing epilepsy type, distinguishing between epileptic ictal and interictal states versus non-epileptic conditions. An inherent advantage of our automated classification approach is its capability to disregard EEG data acquired during states of eye closure or eye-opening. Such innovation holds promise for real-world applications, potentially aiding medical professionals in diagnosing epilepsy more efficiently.

A Stage-Wise Residual Attention Generation Adversarial Network for Mandibular Defect Repairing and Reconstruction

Surgical reconstruction of mandibular defects is a clinical routine manner for the rehabilitation of patients with deformities. The mandible plays a crucial role in maintaining the facial contour and ensuring the speech and mastication functions. The repairing and reconstruction of mandible defects is a significant yet challenging task in oral-maxillofacial surgery. Currently, the mainly available methods are traditional digitalized design methods that suffer from substantial artificial operations, limited applicability and high reconstruction error rates. An automated, precise, and individualized method is imperative for maxillofacial surgeons. In this paper, we propose a Stage-wise Residual Attention Generative Adversarial Network (SRA-GAN) for mandibular defect reconstruction. Specifically, we design a stage-wise residual attention mechanism for generator to enhance the extraction capability of mandibular remote spatial information, making it adaptable to various defects. For the discriminator, we propose a multi-field perceptual network, consisting of two parallel discriminators with different perceptual fields, to reduce the cumulative reconstruction errors. Furthermore, we design a self-encoder perceptual loss function to ensure the correctness of mandibular anatomical structures. The experimental results on a novel custom-built mandibular defect dataset demonstrate that our method has a promising prospect in clinical application, achieving the best Dice Similarity Coefficient (DSC) of 94.238% and 95% Hausdorff Distance (HD95) of 4.787.

Cosine convolutional neural network and its application for seizure detection

Traditional convolutional neural networks (CNNs) often suffer from high memory consumption and redundancy in their kernel representations, leading to overfitting problems and limiting their application in real-time, low-power scenarios such as seizure detection systems. In this work, a novel cosine convolutional neural network (CosCNN), which replaces traditional kernels with the robust cosine kernel modulated by only two learnable factors, is presented, and its effectiveness is validated on the tasks of seizure detection. Meanwhile, based on the cosine lookup table and KL-divergence, an effective post-training quantization algorithm is proposed for CosCNN hardware implementation. With quantization, CosCNN can achieve a nearly 75% reduction in the memory cost with almost no accuracy loss. Moreover, we design a configurable cosine convolution accelerator on Field Programmable Gate Array (FPGA) and deploy the quantized CosCNN on Zedboard, proving the proposed seizure detection system can operate in real-time and low-power scenarios. Extensive experiments and comparisons were conducted using two publicly available epileptic EEG databases, the Bonn database and the CHB-MIT database. The results highlight the performance superiority of the CosCNN over traditional CNNs as well as other seizure detection methods.

Single-channel seizure detection with clinical confirmation of seizure locations using CHB-MIT dataset

Introduction

Long-term electroencephalography (EEG) monitoring is advised to patients with refractory epilepsy who have a failure of anti-seizure medication and therapy. However, its real-life application is limited mainly due to the use of multiple EEG channels. We proposed a patient-specific deep learning-based single-channel seizure detection approach using the long-term scalp EEG recordings of the Children's Hospital Boston-Massachusetts Institute of Technology (CHB-MIT) dataset, in conjunction with neurologists' confirmation of spatial seizure characteristics of individual patients.

Methods

We constructed 18-, 4-, and single-channel seizure detectors for 13 patients. Neurologists selected a specific channel among four channels, two close to the behind-the-ear and two at the forehead for each patient, after reviewing the patient's distinctive seizure locations with seizure re-annotation.

Results

Our multi- and single-channel detectors achieved an average sensitivity of 97.05-100%, false alarm rate of 0.22-0.40/h, and latency of 2.1-3.4 s for identification of seizures in continuous EEG recordings. The results demonstrated that seizure detection performance of our single-channel approach was comparable to that of our multi-channel ones.

Discussion

We suggest that our single-channel approach in conjunction with clinical designation of the most prominent seizure locations has a high potential for wearable seizure detection on long-term EEG recordings for patients with refractory epilepsy.

Performance investigation of epilepsy detection from noisy EEG signals using base-2-meta stacking classifier

Epilepsy is a chronic neurological disease, characterized by spontaneous, unprovoked, recurrent seizures that may lead to long-term disability and premature death. Despite significant efforts made to improve epilepsy detection clinically and pre-clinically, the pervasive presence of noise in EEG signals continues to pose substantial challenges to their effective application. In addition, discriminant features for epilepsy detection have not been investigated yet. The objective of this study is to develop a hybrid model for epilepsy detection from noisy and fragmented EEG signals. We hypothesized that a hybrid model could surpass existing single models in epilepsy detection. Our approach involves manual noise rejection and a novel statistical channel selection technique to detect epilepsy even from noisy EEG signals. Our proposed Base-2-Meta stacking classifier achieved notable accuracy (0.98 ± 0.05), precision (0.98 ± 0.07), recall (0.98 ± 0.05), and F1 score (0.98 ± 0.04) even with noisy 5-s segmented EEG signals. Application of our approach to the specific problem like detection of epilepsy from noisy and fragmented EEG data reveals a performance that is not only superior to others, but also is translationally relevant, highlighting its potential application in a clinic setting, where EEG signals are often noisy or scanty. Our proposed metric DF-A (Discriminant feature-accuracy), for the first time, identified the most discriminant feature with models that give A accuracy or above (A = 95 used in this study). This groundbreaking approach allows for detecting discriminant features and can be used as potential electrographic biomarkers in epilepsy detection research. Moreover, our study introduces innovative insights into the understanding of these features, epilepsy detection, and cross-validation, markedly improving epilepsy detection in ways previously unavailable.

Exploring new horizons in neuroscience disease detection through innovative visual signal analysis

Brain disorders pose a substantial global health challenge, persisting as a leading cause of mortality worldwide. Electroencephalogram (EEG) analysis is crucial for diagnosing brain disorders, but it can be challenging for medical practitioners to interpret complex EEG signals and make accurate diagnoses. To address this, our study focuses on visualizing complex EEG signals in a format easily understandable by medical professionals and deep learning algorithms. We propose a novel time-frequency (TF) transform called the Forward-Backward Fourier transform (FBFT) and utilize convolutional neural networks (CNNs) to extract meaningful features from TF images and classify brain disorders. We introduce the concept of eye-naked classification, which integrates domain-specific knowledge and clinical expertise into the classification process. Our study demonstrates the effectiveness of the FBFT method, achieving impressive accuracies across multiple brain disorders using CNN-based classification. Specifically, we achieve accuracies of 99.82% for epilepsy, 95.91% for Alzheimer's disease (AD), 85.1% for murmur, and 100% for mental stress using CNN-based classification. Furthermore, in the context of naked-eye classification, we achieve accuracies of 78.6%, 71.9%, 82.7%, and 91.0% for epilepsy, AD, murmur, and mental stress, respectively. Additionally, we incorporate a mean correlation coefficient (mCC) based channel selection method to enhance the accuracy of our classification further. By combining these innovative approaches, our study enhances the visualization of EEG signals, providing medical professionals with a deeper understanding of TF medical images. This research has the potential to bridge the gap between image classification and visual medical interpretation, leading to better disease detection and improved patient care in the field of neuroscience.

Self-Supervised Learning for Electroencephalography

Decades of research have shown machine learning superiority in discovering highly nonlinear patterns embedded in electroencephalography (EEG) records compared with conventional statistical techniques. However, even the most advanced machine learning techniques require relatively large, labeled EEG repositories. EEG data collection and labeling are costly. Moreover, combining available datasets to achieve a large data volume is usually infeasible due to inconsistent experimental paradigms across trials. Self-supervised learning (SSL) solves these challenges because it enables learning from EEG records across trials with variable experimental paradigms, even when the trials explore different phenomena. It aggregates multiple EEG repositories to increase accuracy, reduce bias, and mitigate overfitting in machine learning training. In addition, SSL could be employed in situations where there is limited labeled training data, and manual labeling is costly. This article: 1) provides a brief introduction to SSL; 2) describes some SSL techniques employed in recent studies, including EEG; 3) proposes current and potential SSL techniques for future investigations in EEG studies; 4) discusses the cons and pros of different SSL techniques; and 5) proposes holistic implementation tips and potential future directions for EEG SSL practices.

Advanced framework for epilepsy detection through image-based EEG signal analysis

Background

Recurrent and unpredictable seizures characterize epilepsy, a neurological disorder affecting millions worldwide. Epilepsy diagnosis is crucial for timely treatment and better outcomes. Electroencephalography (EEG) time-series data analysis is essential for epilepsy diagnosis and surveillance. Complex signal processing methods used in traditional EEG analysis are computationally demanding and difficult to generalize across patients. Researchers are using machine learning to improve epilepsy detection, particularly visual feature extraction from EEG time-series data.

Objective

This study examines the application of a Gramian Angular Summation Field (GASF) approach for the analysis of EEG signals. Additionally, it explores the utilization of image features, specifically the Scale-Invariant Feature Transform (SIFT) and Oriented FAST and Rotated BRIEF (ORB) techniques, for the purpose of epilepsy detection in EEG data.

Methods

The proposed methodology encompasses the transformation of EEG signals into images based on GASF, followed by the extraction of features utilizing SIFT and ORB techniques, and ultimately, the selection of relevant features. A state-of-the-art machine learning classifier is employed to classify GASF images into two categories: normal EEG patterns and focal EEG patterns. Bern-Barcelona EEG recordings were used to test the proposed method.

Results

This method classifies EEG signals with 96% accuracy using SIFT features and 94% using ORB features. The Random Forest (RF) classifier surpasses state-of-the-art approaches in precision, recall, F1-score, specificity, and Area Under Curve (AUC). The Receiver Operating Characteristic (ROC) curve shows that Random Forest outperforms Support Vector Machine (SVM) and k-Nearest Neighbors (k-NN) classifiers.

Significance

The suggested method has many advantages over time-series EEG data analysis and machine learning classifiers used in epilepsy detection studies. A novel image-based preprocessing pipeline using GASF for robust image synthesis and SIFT and ORB for feature extraction is presented here. The study found that the suggested method can accurately discriminate between normal and focal EEG signals, improving patient outcomes through early and accurate epilepsy diagnosis.

Multiple Classification of Brain MRI Autism Spectrum Disorder by Age and Gender Using Deep Learning

The fact that the rapid and definitive diagnosis of autism cannot be made today and that autism cannot be treated provides an impetus to look into novel technological solutions. To contribute to the resolution of this problem through multiple classifications by considering age and gender factors, in this study, two quadruple and one octal classifications were performed using a deep learning (DL) approach. Gender in one of the four classifications and age groups in the other were considered. In the octal classification, classes were created considering gender and age groups. In addition to the diagnosis of ASD (Autism Spectrum Disorders), another goal of this study is to find out the contribution of gender and age factors to the diagnosis of ASD by making multiple classifications based on age and gender for the first time. Brain structural MRI (sMRI) scans of participators with ASD and TD (Typical Development) were pre-processed in the system originally designed for this purpose. Using the Canny Edge Detection (CED) algorithm, the sMRI image data was cropped in the data pre-processing stage, and the data set was enlarged five times with the data augmentation (DA) techniques. The most optimal convolutional neural network (CNN) models were developed using the grid search optimization (GSO) algorism. The proposed DL prediction system was tested with the five-fold cross-validation technique. Three CNN models were designed to be used in the system. The first of these models is the quadruple classification model created by taking gender into account (model 1), the second is the quadruple classification model created by taking into account age (model 2), and the third is the eightfold classification model created by taking into account both gender and age (model 3). ). The accuracy rates obtained for all three designed models are 80.94, 85.42 and 67.94, respectively. These obtained accuracy rates were compared with pre-trained models by using the transfer learning approach. As a result, it was revealed that age and gender factors were effective in the diagnosis of ASD with the system developed for ASD multiple classifications, and higher accuracy rates were achieved compared to pre-trained models.

Prediction of the synergistic effect of antimicrobial peptides and antimicrobial agents via supervised machine learning

BACKGROUND

Infectious diseases not only cause severe health problems but also burden the healthcare system. Therefore, the effective treatment of those diseases is crucial. Both conventional approaches, such as antimicrobial agents, and novel approaches, like antimicrobial peptides (AMPs), are used to treat infections. However, due to the drawbacks of current approaches, new solutions are still being investigated. One recent approach is the use of AMPs and antimicrobial agents in combination, but determining synergism is with a huge variety of AMPs time-consuming and requires multiple experimental studies. Machine learning (ML) algorithms are widely used to predict biological outcomes, particularly in the field of AMPs, but no previous research reported on predicting the synergistic effects of AMPs and antimicrobial agents.

RESULTS

Several supervised ML models were implemented to accurately predict the synergistic effect of AMPs and antimicrobial agents. The results demonstrated that the hyperparameter-optimized Light Gradient Boosted Machine Classifier (oLGBMC) yielded the best test accuracy of 76.92% for predicting the synergistic effect. Besides, the feature importance analysis reveals that the target microbial species, the minimum inhibitory concentrations (MICs) of the AMP and the antimicrobial agents, and the used antimicrobial agent were the most important features for the prediction of synergistic effect, which aligns with recent experimental studies in the literature.

CONCLUSION

This study reveals that ML algorithms can predict the synergistic activity of two different antimicrobial agents without the need for complex and time-consuming experimental procedures. The implications support that the ML models may not only reduce the experimental cost but also provide validation of experimental procedures.

A review of signal processing and machine learning techniques for interictal epileptiform discharge detection

Brain interictal epileptiform discharges (IEDs), as one of the hallmarks of epileptic brain, are transient events captured by electroencephalogram (EEG). IEDs are generated by seizure networks, and they occur between seizures (interictal periods). The development of a robust method for IED detection could be highly informative for clinical treatment procedures and epileptic patient management. Since 1972, different machine learning techniques, from template matching to deep learning, have been developed to automatically detect IEDs from scalp EEG (scEEG) and intracranial EEG (iEEG). While the scEEG signals suffer from low information details and high attenuation of IEDs due to the high skull electrical impedance, the iEEG signals recorded using implanted electrodes enjoy higher details and are more suitable for identifying the IEDs. In this review paper, we group IED detection techniques into six categories: (1) template matching, (2) feature representation (mimetic, time-frequency, and nonlinear features), (3) matrix decomposition, (4) tensor factorization, (5) neural networks, and (6) estimation of the iEEG from the concurrent scEEG followed by detection and classification. The methods are compared quantitatively (e.g., in terms of accuracy, sensitivity, and specificity), and their general advantages and limitations are described. Finally, current limitations and possible future research paths related to this field are mentioned.

Deep Learning-Based Classification of Epileptic Electroencephalography Signals Using a Concentrated Time-Frequency Approach

ConceFT (concentration of frequency and time) is a new time-frequency (TF) analysis method which combines multitaper technique and synchrosqueezing transform (SST). This combination produces highly concentrated TF representations with approximately perfect time and frequency resolutions. In this paper, it is aimed to show the TF representation performance and robustness of ConceFT by using it for the classification of the epileptic electroencephalography (EEG) signals. Therefore, a signal classification algorithm which uses TF images obtained with ConceFT to feed the transfer learning structure has been presented. Epilepsy is a common neurological disorder that millions of people suffer worldwide. Daily lives of the patients are quite difficult because of the unpredictable time of seizures. EEG signals monitoring the electrical activity of the brain can be used to detect approaching seizures and make possible to warn the patient before the attack. GoogLeNet which is a well-known deep learning model has been preferred to classify TF images. Classification performance is directly related to the TF representation accuracy of the ConceFT. The proposed method has been tested for various classification scenarios and obtained accuracies between 95.83% and 99.58% for two and three-class classification scenarios. High results show that ConceFT is a successful and promising TF analysis method for non-stationary biomedical signals.

Investigating population-specific epilepsy detection from noisy EEG signals using deep-learning models

"Epilepsy is a chronic brain disorder that affects people of all ages. The cause of epilepsy is often unknown and its effect in different age groups is not yet investigated. The main objective of this study is to introduce a novel approach that successfully detects epilepsy even from noisy EEG signals. In addition, this study also investigates population specific epilepsy detection for providing novel insights. Correspondingly, we utilized the TUH EEG corpus database, publicly available challenging multi-channel EEG database containing detailed patient information. We applied a band-pass filter and manual noise rejection to remove noise and artifacts from EEG signals. We then utilized statistical features and correlation to select channels, and applied different transform analysis methods such as continuous wavelet transform, spectrogram, and Wigner-Ville distribution, with and without ensemble averaging, to construct an image dataset. Afterwards, we used various deep-learning models for general analysis. Our findings suggest that different models such as DenseNet201, DenseNet169, DenseNet121, VGG16, VGG19, Xception, InceptionV3, and MobileNetV2 performed better while using images generated from different approaches in general analysis. Furthermore, we split the dataset into two sections according to age for population analysis. All the models that performed well in the general analysis were used for population analysis, which provided novel insights in epilepsy detection from EEG. Our proposed framework for epilepsy detection achieved 100% accuracy, which outperforms other concurrent methods."

O’Brien T, Perucca P, Ge Z, Anderson A. Applications for Deep Learning in Epilepsy Genetic Research

Epilepsy is a group of brain disorders characterised by an enduring predisposition to generate unprovoked seizures. Fuelled by advances in sequencing technologies and computational approaches, more than 900 genes have now been implicated in epilepsy. The development and optimisation of tools and methods for analysing the vast quantity of genomic data is a rapidly evolving area of research. Deep learning (DL) is a subset of machine learning (ML) that brings opportunity for novel investigative strategies that can be harnessed to gain new insights into the genomic risk of people with epilepsy. DL is being harnessed to address limitations in accuracy of long-read sequencing technologies, which improve on short-read methods. Tools that predict the functional consequence of genetic variation can represent breaking ground in addressing critical knowledge gaps, while methods that integrate independent but complimentary data enhance the predictive power of genetic data. We provide an overview of these DL tools and discuss how they may be applied to the analysis of genetic data for epilepsy research.

A Class-Imbalance Aware and Explainable Spatio-Temporal Graph Attention Network for Neonatal Seizure Detection

Seizures are the most prevalent clinical indication of neurological disorders in neonates. In this study, a class-imbalance aware and explainable deep learning approach based on Convolutional Neural Networks (CNNs) and Graph Attention Networks (GATs) is proposed for the accurate automated detection of neonatal seizures. The proposed model integrates the temporal information of EEG signals with the spatial information on the EEG channels through the graph representation of the multi-channel EEG segments. One-dimensional CNNs are used to automatically develop a feature set that accurately represents the differences between seizure and nonseizure epochs in the time domain. By employing GAT, the attention mechanism is utilized to emphasize the critical channel pairs and information flow among brain regions. GAT coefficients were then used to empirically visualize the important regions during the seizure and nonseizure epochs, which can provide valuable insight into the location of seizures in the neonatal brain. Additionally, to tackle the severe class imbalance in the neonatal seizure dataset using under-sampling and focal loss techniques are used. Overall, the final Spatio-Temporal Graph Attention Network (ST-GAT) outperformed previous benchmarked methods with a mean AUC of 96.6% and Kappa of 0.88, demonstrating its high accuracy and potential for clinical applications.

Classification of Epileptic and Psychogenic Nonepileptic Seizures via Time-Frequency Features of EEG Data

The majority of psychogenic nonepileptic seizures (PNESs) are brought on by psychogenic causes, but because their symptoms resemble those of epilepsy, they are frequently misdiagnosed. Although EEG signals are normal in PNES cases, electroencephalography (EEG) recordings alone are not sufficient to identify the illness. Hence, accurate diagnosis and effective treatment depend on long-term video EEG data and a complete patient history. Video EEG setup, however, is more expensive than using standard EEG equipment. To distinguish PNES signals from conventional epileptic seizure (ES) signals, it is crucial to develop methods solely based on EEG recordings. The proposed study presents a technique utilizing short-term EEG data for the classification of inter-PNES, PNES, and ES segments using time-frequency methods such as the Continuous Wavelet transform (CWT), Short-Time Fourier transform (STFT), CWT-based synchrosqueezed transform (WSST), and STFT-based SST (FSST), which provide high-resolution time-frequency representations (TFRs). TFRs of EEG segments are utilized to generate 13 joint TF (J-TF)-based features, four gray-level co-occurrence matrix (GLCM)-based features, and 16 higher-order joint TF moment (HOJ-Mom)-based features. These features are then employed in the classification procedure. Both three-class (inter-PNES versus PNES versus ES: ACC: 80.9%, SEN: 81.8%, and PRE: 84.7%) and two-class (Inter-PNES versus PNES: ACC: 88.2%, SEN: 87.2%, and PRE: 86.1%; PNES versus ES: ACC: 98.5%, SEN: 99.3%, and PRE: 98.9%) classification algorithms performed well, according to the experimental results. The STFT and FSST strategies surpass the CWT and WSST strategies in terms of classification accuracy, sensitivity, and precision. Moreover, the J-TF-based feature sets often perform better than the other two.

An Evolutionary Attention-Based Network for Medical Image Classification

Deep learning has become a primary choice in medical image analysis due to its powerful representation capability. However, most existing deep learning models designed for medical image classification can only perform well on a specific disease. The performance drops dramatically when it comes to other diseases. Generalizability remains a challenging problem. In this paper, we propose an evolutionary attention-based network (EDCA-Net), which is an effective and robust network for medical image classification tasks. To extract task-related features from a given medical dataset, we first propose the densely connected attentional network (DCA-Net) where feature maps are automatically channel-wise weighted, and the dense connectivity pattern is introduced to improve the efficiency of information flow. To improve the model capability and generalizability, we introduce two types of evolution: intra- and inter-evolution. The intra-evolution optimizes the weights of DCA-Net, while the inter-evolution allows two instances of DCA-Net to exchange training experience during training. The evolutionary DCA-Net is referred to as EDCA-Net. The EDCA-Net is evaluated on four publicly accessible medical datasets of different diseases. Experiments showed that the EDCA-Net outperforms the state-of-the-art methods on three datasets and achieves comparable performance on the last dataset, demonstrating good generalizability for medical image classification.

The performance evaluation of the state-of-the-art EEG-based seizure prediction models

The recurrent and unpredictable nature of seizures can lead to unintentional injuries and even death. The rapid development of electroencephalogram (EEG) and Artificial Intelligence (AI) technologies has made it possible to predict seizures in real-time through brain-machine interfaces (BCI), allowing advanced intervention. To date, there is still much room for improvement in predictive seizure models constructed by EEG using machine learning (ML) and deep learning (DL). But, the most critical issue is how to improve the performance and generalization of the model, which involves some confusing conceptual and methodological issues. This review focuses on analyzing several factors affecting the performance of seizure prediction models, focusing on the aspects of post-processing, seizure occurrence period (SOP), seizure prediction horizon (SPH), and algorithms. Furthermore, this study presents some new directions and suggestions for building high-performance prediction models in the future. We aimed to clarify the concept for future research in related fields and improve the performance of prediction models to provide a theoretical basis for future applications of wearable seizure detection devices.

A Novel Epilepsy Detection Method Based on Feature Extraction by Deep Autoencoder on EEG Signal

Electroencephalogram (EEG) signals are the gold standard tool for detecting epileptic seizures. Long-term EEG signal monitoring is a promising method to realize real-time and automatic epilepsy detection with the assistance of computer-aided techniques and the Internet of Medical Things (IoMT) devices. Machine learning (ML) algorithms combined with advanced feature extraction methods have been widely explored to precisely recognize EEG signals, while among which, little attention has been paid to high computing costs and severe information losses. The lack of model interpretability also impedes the wider application and deeper understanding of ML methods in epilepsy detection. In this research, a novel feature extraction method based on an autoencoder (AE) is proposed in the time domain. The architecture and mechanism are elaborated. In this method, specified features are defined and calculated on the basis of signal reconstruction quantification of the AE. The EEG recognition is performed to validate the effectiveness of the proposed detection method, and the prediction accuracy reached 97%. To further investigate the superiority of the proposed AE-based feature extraction method, a widely used feature extraction method, PCA, is allocated for comparison. In order to understand the underlying working mechanism, permutation importance and SHapley Additive exPlanations (SHAP) are conducted for model interpretability, and the results further confirm the reasonability and effectiveness of the extracted features by AE reconstruction. With high computing efficiency in the time domain and an extensively satisfactory accuracy, the proposed epilepsy detection method exhibits great superiority and potential in almost real-time and automatic epilepsy monitoring.

Electrocardiogram classification using TSST-based spectrogram and ConViT

As an important auxiliary tool of arrhythmia diagnosis, Electrocardiogram (ECG) is frequently utilized to detect a variety of cardiovascular diseases caused by arrhythmia, such as cardiac mechanical infarction. In the past few years, the classification of ECG has always been a challenging problem. This paper presents a novel deep learning model called convolutional vision transformer (ConViT), which combines vision transformer (ViT) with convolutional neural network (CNN), for ECG arrhythmia classification, in which the unique soft convolutional inductive bias of gated positional self-attention (GPSA) layers integrates the superiorities of attention mechanism and convolutional architecture. Moreover, the time-reassigned synchrosqueezing transform (TSST), a newly developed time-frequency analysis (TFA) method where the time-frequency coefficients are reassigned in the time direction, is employed to sharpen pulse traits for feature extraction. Aiming at the class imbalance phenomena in the traditional ECG database, the smote algorithm and focal loss (FL) are used for data augmentation and minority-class weighting, respectively. The experiment using MIT-BIH arrhythmia database indicates that the overall accuracy of the proposed model is as high as 99.5%. Furthermore, the specificity (Spe), F1-Score and positive Matthews Correlation Coefficient (MCC) of supra ventricular ectopic beat (S) and ventricular ectopic beat (V) are all more than 94%. These results demonstrate that the proposed method is superior to most of the existing methods.

An Intelligent Epileptic Prediction System Based on Synchrosqueezed Wavelet Transform and Multi-Level Feature CNN for Smart Healthcare IoT

Epilepsy is a common neurological disease worldwide, characterized by recurrent seizures. There is currently no cure for epilepsy. However, seizures can be controlled by drugs and surgeries in about 70% of epileptic patients. A timely and accurate prediction of seizures can prevent injuries during seizures and improve the patients' quality of life. In this paper, we proposed an intelligent epileptic prediction system based on Synchrosqueezed Wavelet Transform (SWT) and Multi-Level Feature Convolutional Neural Network (MLF-CNN) for smart healthcare IoT network. In this system, we used SWT to map EEG signals to the frequency domain, which was able to measure the energy changes in EEG signals caused by seizures within a well-defined Time-Frequency (TF) plane. MLF-CNN was then applied to extract multi-level features from the processed EEG signals and classify the different seizure segments. The performance of our proposed system was evaluated with the publicly available CHB-MIT dataset and our private ZJU4H dataset. The system achieved an accuracy of 96.99% and 94.25%, a sensitivity of 96.48% and 97.76%, a specificity of 97.46% and 94.07% and a false prediction rate (FPR/h) of 0.031 and 0.049 FPR/h on the CHB-MIT dataset and the ZJU4H dataset, respectively.

Efficient graph convolutional networks for seizure prediction using scalp EEG

Epilepsy is a chronic brain disease that causes persistent and severe damage to the physical and mental health of patients. Daily effective prediction of epileptic seizures is crucial for epilepsy patients especially those with refractory epilepsy. At present, a large number of deep learning algorithms such as Convolutional Neural Networks and Recurrent Neural Networks have been used to predict epileptic seizures and have obtained better performance than traditional machine learning methods. However, these methods usually transform the Electroencephalogram (EEG) signal into a Euclidean grid structure. The conversion suffers from loss of adjacent spatial information, which results in deep learning models requiring more storage and computational consumption in the process of information fusion after information extraction. This study proposes a general Graph Convolutional Networks (GCN) model architecture for predicting seizures to solve the problem of oversized seizure prediction models based on exploring the graph structure of EEG signals. As a graph classification task, the network architecture includes graph convolution layers that extract node features with one-hop neighbors, pooling layers that summarize abstract node features; and fully connected layers that implement classification, resulting in superior prediction performance and smaller network size. The experiment shows that the model has an average sensitivity of 96.51%, an average AUC of 0.92, and a model size of 15.5 k on 18 patients in the CHB-MIT scalp EEG dataset. Compared with traditional deep learning methods, which require a large number of parameters and computational effort and are demanding in terms of storage space and energy consumption, this method is more suitable for implementation on compact, low-power wearable devices as a standard process for building a generic low-consumption graph network model on similar biomedical signals. Furthermore, the edge features of graphs can be used to make a preliminary determination of locations and types of discharge, making it more clinically interpretable.

Patient-Independent Seizure Detection Based on Channel-Perturbation Convolutional Neural Network and Bidirectional Long Short-Term Memory

Automatic seizure detection is of great significance for epilepsy diagnosis and alleviating the massive burden caused by manual inspection of long-term EEG. At present, most seizure detection methods are highly patient-dependent and have poor generalization performance. In this study, a novel patient-independent approach is proposed to effectively detect seizure onsets. First, the multi-channel EEG recordings are preprocessed by wavelet decomposition. Then, the Convolutional Neural Network (CNN) with proper depth works as an EEG feature extractor. Next, the obtained features are fed into a Bidirectional Long Short-Term Memory (BiLSTM) network to further capture the temporal variation characteristics. Finally, aiming to reduce the false detection rate (FDR) and improve the sensitivity, the postprocessing, including smoothing and collar, is performed on the outputs of the model. During the training stage, a novel channel perturbation technique is introduced to enhance the model generalization ability. The proposed approach is comprehensively evaluated on the CHB-MIT public scalp EEG database as well as a more challenging SH-SDU scalp EEG database we collected. Segment-based average accuracies of 97.51% and 93.70%, event-based average sensitivities of 86.51% and 89.89%, and average AUC-ROC of 90.82% and 90.75% are yielded on the CHB-MIT database and SH-SDU database, respectively.

Multiview Feature Fusion Representation for Interictal Epileptiform Spikes Detection

Interictal epileptiform spikes (IES) of scalp electroencephalogram (EEG) signals have a strong relation with the epileptogenic region. Since IES are highly unlikely to be detected in scalp EEG signals, the primary diagnosis depends heavily on the visual evaluation of IES. However, visual inspection of EEG signals, the standard IES detection procedure is time-consuming, highly subjective, and error-prone. Furthermore, the highly complex, nonlinear, and nonstationary characteristics of EEG signals lead to the incomplete representation of EEG signals in existing computer-aided methods and consequently unsatisfactory detection performance. Therefore, a novel multiview feature fusion representation (MVFFR) method was developed and combined with a robustness classifier to detect EEG signals with/without IES. MVFFR comprises two steps: First, temporal, frequency, temporal-frequency, spatial, and nonlinear domain features are transformed by the IES to express the latent information effectively. Second, the unsupervised infinite feature-selection method determines the most distinct feature fusion representations. Experimental results using a balanced dataset of six patients showed that MVFFR achieved the optimal detection performance (accuracy: 89.27%, sensitivity: 89.01%, specificity: 89.54%, and precision: 89.82%) compared with other feature ranking methods, and the MVFFR-related method were complementary and indispensable. Additionally, in an independent test, MVFFR maintained excellent generalization capacity with a false detection rate per minute of 0.15 on the unbalanced dataset of one patient.

Tiled Sparse Coding in Eigenspaces for Image Classification

The automation in the diagnosis of medical images is currently a challenging task. The use of Computer Aided Diagnosis (CAD) systems can be a powerful tool for clinicians, especially in situations when hospitals are overflowed. These tools are usually based on artificial intelligence (AI), a field that has been recently revolutionized by deep learning approaches. blackThese alternatives usually obtain a large performance based on complex solutions, leading to a high computational cost and the need of having large databases. In this work, we propose a classification framework based on sparse coding. Images are blackfirst partitioned into different tiles, and a dictionary is built after applying PCA to these tiles. The original signals are then transformed as a linear combination of the elements of the dictionary. blackThen, they are reconstructed by iteratively deactivating the elements associated with each component. Classification is finally performed employing as features the subsequent reconstruction errors. Performance is evaluated in a real context where distinguishing between four different pathologies: control versus bacterial pneumonia versus viral pneumonia versus COVID-19. blackOur system differentiates between pneumonia patients and controls with an accuracy of 97.74%, whereas in the 4-class context the accuracy is 86.73%. The excellent results and the pioneering use of sparse coding in this scenario evidence that our proposal can assist clinicians when their workload is high.

A Study on Seizure Detection of EEG Signals Represented in 2D

A seizure is a neurological disorder caused by abnormal neuronal discharges in the brain, which severely reduces the quality of life of patients and often endangers their lives. Automatic seizure detection is an important research area in the treatment of seizure and is a prerequisite for seizure intervention. Deep learning has been widely used for automatic detection of seizures, and many related research works decomposed the electroencephalogram (EEG) raw signal with a time window to obtain EEG signal slices, then performed feature extraction on the slices, and represented the obtained features as input data for neural networks. There are various methods for EEG signal decomposition, feature extraction, and representation, and most of the studies have been based on fixed hardware resources for the design of the scheme, which reduces the adaptability of the scheme in different application scenarios and makes it difficult to optimize the algorithms in the scheme. To address the above issues, this paper proposes a deep learning-based model for seizure detection, mainly characterized by the two-dimensional representation of EEG features and the scalability of neural networks. The model modularizes the main steps of seizure detection and improves the adaptability of the model to different hardware resource constraints, in order to increase the convenience of the algorithm optimization or the replacement of each module. The proposed model consists of five parts, and the model was tested using two epilepsy datasets separately. The experimental results showed that the proposed model has strong generality and good classification accuracy for seizure detection.

Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning

BACKGROUND

Coronavirus disease 2019 (COVID-19) has become a pandemic since its first appearance in late 2019. Deaths caused by COVID-19 are still increasing day by day and early diagnosis has become crucial. Since current diagnostic methods have many disadvantages, new investigations are needed to improve the performance of diagnosis.

METHODS

A novel method is proposed to automatically diagnose COVID-19 by using Electrocardiogram (ECG) data with deep learning for the first time. Moreover, a new and effective method called hexaxial feature mapping is proposed to represent 12-lead ECG to 2D colorful images. Gray-Level Co-Occurrence Matrix (GLCM) method is used to extract features and generate hexaxial mapping images. These generated images are then fed into a new Convolutional Neural Network (CNN) architecture to diagnose COVID-19.

RESULTS

Two different classification scenarios are conducted on a publicly available paper-based ECG image dataset to reveal the diagnostic capability and performance of the proposed approach. In the first scenario, ECG data labeled as COVID-19 and No-Findings (normal) are classified to evaluate COVID-19 classification ability. According to results, the proposed approach provides encouraging COVID-19 detection performance with an accuracy of 96.20% and F1-Score of 96.30%. In the second scenario, ECG data labeled as Negative (normal, abnormal, and myocardial infarction) and Positive (COVID-19) are classified to evaluate COVID-19 diagnostic ability. The experimental results demonstrated that the proposed approach provides satisfactory COVID-19 prediction performance with an accuracy of 93.00% and F1-Score of 93.20%. Furthermore, different experimental studies are conducted to evaluate the robustness of the proposed approach.

CONCLUSION

Automatic detection of cardiovascular changes caused by COVID-19 can be possible with a deep learning framework through ECG data. This not only proves the presence of cardiovascular changes caused by COVID-19 but also reveals that ECG can potentially be used in the diagnosis of COVID-19. We believe the proposed study may provide a crucial decision-making system for healthcare professionals.

SOURCE CODE

All source codes are made publicly available at: https://github.com/mkfzdmr/COVID-19-ECG-Classification.