Is it possible to detect cerebral dominance via EEG signals by using deep learning?

Automatic prediction of epileptic seizure using hybrid deep ResNet-LSTM model

Numerous advanced data processing and machine learning techniques for identifying epileptic seizures have been developed in the last two decades. Nonetheless, many of these solutions need massive data sets and intricate computations. Our approach transforms electroencephalogram (EEG) data into the time-frequency domain by utilizing a short-time fourier transform (STFT) and the spectrogram (t-f) images as the input stage of the deep learning model. Using EEG data, we have constructed a hybrid model comprising of a Deep Convolution Network (ResNet50) and a Long Short-Term Memory (LSTM) for predicting epileptic seizures. Spectrogram images are used to train the proposed hybrid model for feature extraction and classification. We analyzed the CHB-MIT scalp EEG dataset. For each preictal period of 5, 15, and 30 minutes, experiments are conducted to evaluate the performance of the proposed model. The experimental results indicate that the proposed model produced the optimum performance with a 5-minute preictal duration. We achieved an average accuracy of 94.5%, the average sensitivity of 93.7%, the f1-score of 0.9376, and the average false positive rate (FPR) of 0.055. Our proposed technique surpassed the random predictor and other current algorithms used for seizure prediction for all patients’ data in the dataset. One can use the effectiveness of our proposed model to help in the early diagnosis of epilepsy and provide early treatment.

The convolutional neural network as a tool to classify electroencephalography data resulting from the consumption of juice sweetened with caloric or non-caloric sweeteners

Sweetener type can influence sensory properties and consumer's acceptance and preference for low-calorie products. An ideal sweetener does not exist, and each sweetener must be used in situations to which it is best suited. Aspartame and sucralose can be good substitutes for sucrose in passion fruit juice. Despite the interest in artificial sweeteners, little is known about how artificial sweeteners are processed in the human brain. Here, we applied the convolutional neural network (CNN) to evaluate brain signals of 11 healthy subjects when they tasted passion fruit juice equivalently sweetened with sucrose (9.4 g/100 g), sucralose (0.01593 g/100 g), or aspartame (0.05477 g/100 g). Electroencephalograms were recorded for two sites in the gustatory cortex (i.e., C3 and C4). Data with artifacts were disregarded, and the artifact-free data were used to feed a Deep Neural Network with tree branches that applied a Convolutions and pooling for different feature filtering and selection. The CNN received raw signal as input for multiclass classification and with supervised training was able to extract underling features and patterns from the signal with better performance than handcrafted filters like FFT. Our results indicated that CNN is an useful tool for electroencephalography (EEG) analyses and classification of perceptually similar tastes.

Advanced Fusion-Based Speech Emotion Recognition System Using a Dual-Attention Mechanism with Conv-Caps and Bi-GRU Features

Recognizing the speaker’s emotional state from speech signals plays a very crucial role in human–computer interaction (HCI). Nowadays, numerous linguistic resources are available, but most of them contain samples of a discrete length. In this article, we address the leading challenge in Speech Emotion Recognition (SER), which is how to extract the essential emotional features from utterances of a variable length. To obtain better emotional information from the speech signals and increase the diversity of the information, we present an advanced fusion-based dual-channel self-attention mechanism using convolutional capsule (Conv-Cap) and bi-directional gated recurrent unit (Bi-GRU) networks. We extracted six spectral features (Mel-spectrograms, Mel-frequency cepstral coefficients, chromagrams, the contrast, the zero-crossing rate, and the root mean square). The Conv-Cap module was used to obtain Mel-spectrograms, while the Bi-GRU was used to obtain the rest of the spectral features from the input tensor. The self-attention layer was employed in each module to selectively focus on optimal cues and determine the attention weight to yield high-level features. Finally, we utilized a confidence-based fusion method to fuse all high-level features and pass them through the fully connected layers to classify the emotional states. The proposed model was evaluated on the Berlin (EMO-DB), Interactive Emotional Dyadic Motion Capture (IEMOCAP), and Odia (SITB-OSED) datasets to improve the recognition rate. During experiments, we found that our proposed model achieved high weighted accuracy (WA) and unweighted accuracy (UA) values, i.e., 90.31% and 87.61%, 76.84% and 70.34%, and 87.52% and 86.19%, respectively, demonstrating that the proposed model outperformed the state-of-the-art models using the same datasets.

Brain Tumor Segmentation of MRI Images Using Processed Image Driven U-Net Architecture

Brain tumor segmentation seeks to separate healthy tissue from tumorous regions. This is an essential step in diagnosis and treatment planning to maximize the likelihood of successful treatment. Magnetic resonance imaging (MRI) provides detailed information about brain tumor anatomy, making it an important tool for effective diagnosis which is requisite to replace the existing manual detection system where patients rely on the skills and expertise of a human. In order to solve this problem, a brain tumor segmentation & detection system is proposed where experiments are tested on the collected BraTS 2018 dataset. This dataset contains four different MRI modalities for each patient as T1, T2, T1Gd, and FLAIR, and as an outcome, a segmented image and ground truth of tumor segmentation, i.e., class label, is provided. A fully automatic methodology to handle the task of segmentation of gliomas in pre-operative MRI scans is developed using a U-Net-based deep learning model. The first step is to transform input image data, which is further processed through various techniques—subset division, narrow object region, category brain slicing, watershed algorithm, and feature scaling was done. All these steps are implied before entering data into the U-Net Deep learning model. The U-Net Deep learning model is used to perform pixel label segmentation on the segment tumor region. The algorithm reached high-performance accuracy on the BraTS 2018 training, validation, as well as testing dataset. The proposed model achieved a dice coefficient of 0.9815, 0.9844, 0.9804, and 0.9954 on the testing dataset for sets HGG-1, HGG-2, HGG-3, and LGG-1, respectively.

Machine-Learning-Based Elderly Stroke Monitoring System Using Electroencephalography Vital Signals

Stroke is the third highest cause of death worldwide after cancer and heart disease, and the number of stroke diseases due to aging is set to at least triple by 2030. As the top three causes of death worldwide are all related to chronic disease, the importance of healthcare is increasing even more. Models that can predict real-time health conditions and diseases using various healthcare services are attracting increasing attention. Most diagnosis and prediction methods of stroke for the elderly involve imaging techniques such as magnetic resonance imaging (MRI). It is difficult to rapidly and accurately diagnose and predict stroke diseases due to the long testing times and high costs associated with MRI. Thus, in this paper, we design and implement a health monitoring system that can predict the precursors of stroke diseases in the elderly in real time during daily walking. First, raw electroencephalography (EEG) data from six channels were preprocessed via Fast Fourier Transform (FFT). The raw EEG power values were then extracted from the raw spectra: alpha (α), beta (β), gamma (γ), delta (δ), and theta (θ) as well as the low β, high β, and θ to β ratio, respectively. The experiments in this paper confirm that the important features of EEG biometric signals alone during walking can accurately determine stroke precursors and occurrence in the elderly with more than 90% accuracy. Further, the Random Forest algorithm with quartiles and Z-score normalization validates the clinical significance and performance of the system proposed in this paper with a 92.51% stroke prediction accuracy. The proposed system can be implemented at a low cost, and it can be applied for early disease detection and prediction using the precursor symptoms of real-time stroke. Furthermore, it is expected that it will be able to detect other diseases such as cancer and heart disease in the future.

A novelty route for smartphone-based artificial intelligence approach to ophthalmic screening

Artificial intelligence (AI) has been widely applied in the medical field and achieved enormous milestones in helping specialists to make diagnosis and remedy decisions, particularly in the field of eye diseases and ophthalmic screening. With the development of AI-based systems, the enormous hardware and software resources are required for optimal performance. In reality, there are many places on the planet where such resources are highly limited. Hence, the smartphone-based AI systems can be used to provide a remote control route to quickly screen eye diseases such as diabetic-related retinopathy or diabetic macular edema. However, the performance of such mobile-based AI systems is still uncharted territory. In this article, we discuss the issues of computing resource consumption and performance of the mobile device-based AI systems and highlight recent research on the feasibility and future potential of application of the mobile device-based AI systems in telemedicine.

Classification of normal sinus rhythm, abnormal arrhythmia and congestive heart failure ECG signals using LSTM and hybrid CNN-SVM deep neural networks

Effective monitoring of heart patients according to heart signals can save a huge amount of life. In the last decade, the classification and prediction of heart diseases according to ECG signals has gained great importance for patients and doctors. In this paper, the deep learning architecture with high accuracy and popularity has been proposed in recent years for the classification of Normal Sinus Rhythm, (NSR) Abnormal Arrhythmia (ARR) and Congestive Heart Failure (CHF) ECG signals. The proposed architecture is based on Hybrid Alexnet-SVM (Support Vector Machine). 96 Arrhythmia, 30 CHF, 36 NSR signals are available in a total of 192 ECG signals. In order to demonstrate the classification performance of deep learning architectures, ARR, CHR and NSR signals are firstly classified by SVM, KNN algorithm, achieving 68.75% and 65.63% accuracy. The signals are then classified in their raw form with LSTM (Long Short Time Memory) with 90.67% accuracy. By obtaining the spectrograms of the signals, Hybrid Alexnet-SVM algorithm is applied to the images and 96.77% accuracy is obtained. The results show that with the proposed deep learning architecture, it classifies ECG signals with higher accuracy than conventional machine learning classifiers.

Deep Learning in Physiological Signal Data: A Survey

Deep Learning (DL), a successful promising approach for discriminative and generative tasks, has recently proved its high potential in 2D medical imaging analysis; however, physiological data in the form of 1D signals have yet to be beneficially exploited from this novel approach to fulfil the desired medical tasks. Therefore, in this paper we survey the latest scientific research on deep learning in physiological signal data such as electromyogram (EMG), electrocardiogram (ECG), electroencephalogram (EEG), and electrooculogram (EOG). We found 147 papers published between January 2018 and October 2019 inclusive from various journals and publishers. The objective of this paper is to conduct a detailed study to comprehend, categorize, and compare the key parameters of the deep-learning approaches that have been used in physiological signal analysis for various medical applications. The key parameters of deep-learning approach that we review are the input data type, deep-learning task, deep-learning model, training architecture, and dataset sources. Those are the main key parameters that affect system performance. We taxonomize the research works using deep-learning method in physiological signal analysis based on: (1) physiological signal data perspective, such as data modality and medical application; and (2) deep-learning concept perspective such as training architecture and dataset sources.