DepHNN: A novel hybrid neural network for electroencephalogram (EEG)-based screening of depression

Depression assessment using integrated multi-featured EEG bands deep neural network models: Leveraging ensemble learning techniques

Mental Status Assessment (MSA) holds significant importance in psychiatry. In recent years, several studies have leveraged Electroencephalogram (EEG) technology to gauge an individual's mental state or level of depression. This study introduces a novel multi-tier ensemble learning approach to integrate multiple EEG bands for conducting mental state or depression assessments. Initially, the EEG signal is divided into eight sub-bands, and then a Long Short-Term Memory (LSTM)-based Deep Neural Network (DNN) model is trained for each band. Subsequently, the integration of multi-band EEG frequency models and the evaluation of mental state or depression level are facilitated through a two-tier ensemble learning approach based on Multiple Linear Regression (MLR). The authors conducted numerous experiments to validate the performance of the proposed method under different evaluation metrics. For clarity and conciseness, the research employs the simplest commercialized one-channel EEG sensor, positioned at FP1, to collect data from 57 subjects (49 depressed and 18 healthy subjects). The obtained results, including an accuracy of 0.897, F1-score of 0.921, precision of 0.935, negative predictive value of 0.829, recall of 0.908, specificity of 0.875, and AUC of 0.8917, provide evidence of the superior performance of the proposed method compared to other ensemble learning techniques. This method not only proves effective but also holds the potential to significantly enhance the accuracy of depression assessment.

Empirical comparison of deep learning models for fNIRS pain decoding

Introduction

Pain assessment is extremely important in patients unable to communicate and it is often done by clinical judgement. However, assessing pain using observable indicators can be challenging for clinicians due to the subjective perceptions, individual differences in pain expression, and potential confounding factors. Therefore, the need for an objective pain assessment method that can assist medical practitioners. Functional near-infrared spectroscopy (fNIRS) has shown promising results to assess the neural function in response of nociception and pain. Previous studies have explored the use of machine learning with hand-crafted features in the assessment of pain.

Methods

In this study, we aim to expand previous studies by exploring the use of deep learning models Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and (CNN-LSTM) to automatically extract features from fNIRS data and by comparing these with classical machine learning models using hand-crafted features.

Results

The results showed that the deep learning models exhibited favourable results in the identification of different types of pain in our experiment using only fNIRS input data. The combination of CNN and LSTM in a hybrid model (CNN-LSTM) exhibited the highest performance (accuracy = 91.2%) in our problem setting. Statistical analysis using one-way ANOVA with Tukey's (post-hoc) test performed on accuracies showed that the deep learning models significantly improved accuracy performance as compared to the baseline models.

Discussion

Overall, deep learning models showed their potential to learn features automatically without relying on manually-extracted features and the CNN-LSTM model could be used as a possible method of assessment of pain in non-verbal patients. Future research is needed to evaluate the generalisation of this method of pain assessment on independent populations and in real-life scenarios.

The Hybrid Deep Learning Model for Identification of Attention-Deficit/Hyperactivity Disorder Using EEG

Common misbehavior among children that prevents them from paying attention to tasks and interacting with their surroundings appropriately is attention-deficit/hyperactivity disorder (ADHD). Studies of children's behavior presently face a significant problem in the early and timely diagnosis of this disease. To diagnose this disease, doctors often use the patient's description and questionnaires, psychological tests, and the patient's behavior in which reliability is questionable. Convolutional neural network (CNN) is one deep learning technique that has been used for the diagnosis of ADHD. CNN, however, does not account for how signals change over time, which leads to low classification performances and ambiguous findings. In this study, the authors designed a hybrid deep learning model that combines long-short-term memory (LSTM) and CNN to simultaneously extract and learn the spatial features and long-term dependencies of the electroencephalography (EEG) data. The effectiveness of the proposed hybrid deep learning model was assessed using 2 publicly available EEG datasets. The suggested model achieves a classification accuracy of 98.86% on the ADHD dataset and 98.28% on the FOCUS dataset, respectively. The experimental findings show that the proposed hybrid CNN-LSTM model outperforms the state-of-the-art methods to diagnose ADHD using EEG. Hence, the proposed hybrid CNN-LSTM model could therefore be utilized to help with the clinical diagnosis of ADHD patients.

The Three-Lead EEG Sensor: Introducing an EEG-Assisted Depression Diagnosis System Based on Ant Lion Optimization

For depression diagnosis, traditional methods such as interviews and clinical scales have been widely leveraged in the past few decades, but they are subjective, time-consuming, and labor-consuming. With the development of affective computing and Artificial Intelligence (AI) technologies, Electroencephalogram (EEG)-based depression detection methods have emerged. However, previous research has virtually neglected practical application scenarios, as most studies have focused on analyzing and modeling EEG data. Furthermore, EEG data is typically obtained from specialized devices that are large, complex to operate, and poorly ubiquitous. To address these challenges, a wearable three-lead EEG sensor with flexible electrodes was developed to obtain prefrontal-lobe EEG data. Experimental measurements show that the EEG sensor achieves promising performance (background noise of no more than 0.91 μVpp, Signal-to-Noise Ratio (SNR) of 26--48 dB, and electrode-skin contact impedance of less than 1 K Ω). In addition, EEG data from 70 depressed patients and 108 healthy controls were collected using the EEG sensor, and the linear and nonlinear features were extracted. The features were then weighted and selected using the Ant Lion Optimization (ALO) algorithm to improve classification performance. The experimental results show that the k-NN classifier achieves a classification accuracy of 90.70%, specificity of 96.53%, and sensitivity of 81.79%, indicating the promising potential of the three-lead EEG sensor combined with the ALO algorithm and the k-NN classifier for EEG-assisted depression diagnosis.

Efficacy of novel attention-based gated recurrent units transformer for depression detection using electroencephalogram signals

Purpose

Depression is a global challenge causing psychological and intellectual problems that require efficient diagnosis. Electroencephalogram (EEG) signals represent the functional state of the human brain and can help build an accurate and viable technique for the early prediction and treatment of depression.

Methods

An attention-based gated recurrent units transformer (AttGRUT) time-series model is proposed to efficiently identify EEG perturbations in depressive patients. Statistical, spectral and wavelet features were first extracted from the 60-channel EEG signal data. Then, two feature selection techniques, recursive feature elimination and the Boruta algorithm, both with Shapley additive explanations, were utilised for selecting essential features.

Results

The proposed model outperformed the two baseline and two hybrid time-series models-long short-term memory (LSTM), gated recurrent units (GRU), convolutional neural network-LSTM (CNN-LSTM), and CNN-GRU-achieving an accuracy of up to 98.67%. Feature selection considerably increased the performance across all time-series models.

Conclusion

Based on the obtained results, novel feature selection greatly affected the results of the baseline and hybrid time-series models. The proposed AttGRUT can be implemented and tested in other domains by using different modalities for prediction.

Supplementary Information

The online version contains supplementary material available at 10.1007/s13755-022-00205-8.

AMGCN-L: an adaptive multi-time-window graph convolutional network with long-short-term memory for depression detection

Objective.Depression is a common chronic mental disorder characterized by high rates of prevalence, recurrence, suicide, and disability as well as heavy disease burden. An accurate diagnosis of depression is a prerequisite for treatment. However, existing questionnaire-based diagnostic methods are limited by the innate subjectivity of medical practitioners and subjects. In the search for a more objective diagnostic methods for depression, researchers have recently started to use deep learning approaches.Approach.In this work, a deep-learning network, named adaptively multi-time-window graph convolutional network (GCN) with long-short-term memory (LSTM) (i.e. AMGCN-L), is proposed. This network can automatically categorize depressed and non-depressed people by testing for the existence of inherent brain functional connectivity and spatiotemporal features contained in electroencephalogram (EEG) signals. AMGCN-L is mainly composed of two sub-networks: the first sub-network is an adaptive multi-time-window graph generation block with which adjacency matrices that contain brain functional connectivity on different time periods are adaptively designed. The second sub-network consists of GCN and LSTM, which are used to fully extract the innate spatial and temporal features of EEG signals, respectively.Main results.Two public datasets, namely the patient repository for EEG data and computational tools, and the multi-modal open dataset for mental-disorder analysis, were used to test the performance of the proposed network; the depression recognition accuracies achieved in both datasets (using tenfold cross-validation) were 90.38% and 90.57%, respectively.Significance.This work demonstrates that GCN and LSTM have eminent effects on spatial and temporal feature extraction, respectively, suggesting that the exploration of brain connectivity and the exploitation of spatiotemporal features benefit the detection of depression. Moreover, the proposed method provides effective support and supplement for the detection of clinical depression and later treatment procedures.

Depressive Disorder Recognition Based on Frontal EEG Signals and Deep Learning

Depressive disorder (DD) has become one of the most common mental diseases, seriously endangering both the affected person's psychological and physical health. Nowadays, a DD diagnosis mainly relies on the experience of clinical psychiatrists and subjective scales, lacking objective, accurate, practical, and automatic diagnosis technologies. Recently, electroencephalogram (EEG) signals have been widely applied for DD diagnosis, but mainly with high-density EEG, which can severely limit the efficiency of the EEG data acquisition and reduce the practicability of diagnostic techniques. The current study attempts to achieve accurate and practical DD diagnoses based on combining frontal six-channel electroencephalogram (EEG) signals and deep learning models. To this end, 10 min clinical resting-state EEG signals were collected from 41 DD patients and 34 healthy controls (HCs). Two deep learning models, multi-resolution convolutional neural network (MRCNN) combined with long short-term memory (LSTM) (named MRCNN-LSTM) and MRCNN combined with residual squeeze and excitation (RSE) (named MRCNN-RSE), were proposed for DD recognition. The results of this study showed that the higher EEG frequency band obtained the better classification performance for DD diagnosis. The MRCNN-RSE model achieved the highest classification accuracy of 98.48 ± 0.22% with 8-30 Hz EEG signals. These findings indicated that the proposed analytical framework can provide an accurate and practical strategy for DD diagnosis, as well as essential theoretical and technical support for the treatment and efficacy evaluation of DD.

Exploring Adaptive Graph Topologies and Temporal Graph Networks for EEG-Based Depression Detection

In recent years, Graph Neural Networks (GNNs) based on deep learning techniques have achieved promising results in EEG-based depression detection tasks but still have some limitations. Firstly, most existing GNN-based methods use pre-computed graph adjacency matrices, which ignore the differences in brain networks between individuals. Additionally, methods based on graph-structured data do not consider the temporal dependency information of brain networks. To address these issues, we propose a deep learning algorithm that explores adaptive graph topologies and temporal graph networks for EEG-based depression detection. Specifically, we designed an Adaptive Graph Topology Generation (AGTG) module that can adaptively model the real-time connectivity of the brain networks, revealing differences between individuals. In addition, we designed a Graph Convolutional Gated Recurrent Unit (GCGRU) module to capture the temporal dynamical changes of brain networks. To further explore the differential features between depressed and healthy individuals, we adopt Graph Topology-based Max-Pooling (GTMP) module to extract graph representation vectors accurately. We conduct a comparative analysis with several advanced algorithms on both public and our own datasets. The results reveal that our final model achieves the highest Area Under the Receiver Operating Characteristic Curve (AUROC) on both datasets, with values of 83% and 99%, respectively. Furthermore, we perform extensive validation experiments demonstrating our proposed method's effectiveness and advantages. Finally, we present a comprehensive discussion on the differences in brain networks between healthy and depressed individuals based on the outputs of our final model's AGTG and GTMP modules.

Neuroimaging Study of Brain Functional Differences in Generalized Anxiety Disorder and Depressive Disorder

Generalized anxiety disorder (GAD) and depressive disorder (DD) are distinct mental disorders, which are characterized by complex and unique neuroelectrophysiological mechanisms in psychiatric neurosciences. The understanding of the brain functional differences between GAD and DD is crucial for the accurate diagnosis and clinical efficacy evaluation. The aim of this study was to reveal the differences in functional brain imaging between GAD and DD based on multidimensional electroencephalogram (EEG) characteristics. To this end, 10 min resting-state EEG signals were recorded from 38 GAD and 34 DD individuals. Multidimensional EEG features were subsequently extracted, which include power spectrum density (PSD), fuzzy entropy (FE), and phase lag index (PLI). Then, a direct statistical analysis (i.e., ANOVA) and three ensemble learning models (i.e., Random Forest (RF), Light Gradient Boosting Machine (LightGBM), eXtreme Gradient Boosting (XGBoost)) were used on these EEG features for the differential recognitions. Our results showed that DD has significantly higher PSD values in the alpha1 and beta band, and a higher FE in the beta band, in comparison with GAD, along with the aberrant functional connections in all four bands between GAD and DD. Moreover, machine learning analysis further revealed that the distinct features predominantly occurred in the beta band and functional connections. Here, we show that DD has higher power and more complex brain activity patterns in the beta band and reorganized brain functional network structures in all bands compared to GAD. In sum, these findings move towards the practical identification of brain functional differences between GAD and DD.

Prediction of response to repetitive transcranial magnetic stimulation for major depressive disorder using hybrid Convolutional recurrent neural networks and raw Electroencephalogram Signal

Major Depressive Disorder (MDD) is a high prevalence disease that needs an effective and timely treatment to prevent its progress and additional costs. Repetitive Transcranial Magnetic Stimulation (rTMS) is an effective treatment option for MDD patients which uses strong magnetic pulses to stimulate specific regions of the brain. However, some patients do not respond to this treatment which causes the waste of multiple weeks as treatment time and clinical resources. Therefore developing an effective way for the prediction of response to the rTMS treatment of depression is necessary. In this work, we proposed a hybrid model created by pre-trained Convolutional Neural Networks (CNN) models and Bidirectional Long Short-Term Memory (BLSTM) cells to predict response to rTMS treatment from raw EEG signal. Three pre-trained CNN models named VGG16, InceptionResNetV2, and EffecientNetB0 were utilized as Transfer Learning (TL) models to construct hybrid TL-BLSTM models. Then an ensemble of these models was created using weighted majority voting which the weights were optimized by Differential Evolution (DE) optimization algorithm. Evaluation of these models shows the superior performance of the ensemble model by the accuracy of 98.51%, sensitivity of 98.64%, specificity of 98.36%, F1-score of 98.6%, and AUC of 98.5%. Therefore, the ensemble of the proposed hybrid convolutional recurrent networks can efficiently predict the treatment outcome of rTMS using raw EEG data.

Electroencephalography-Based Depression Detection Using Multiple Machine Learning Techniques

The growth of biomedical engineering has made depression diagnosis via electroencephalography (EEG) a trendy issue. The two significant challenges to this application are EEG signals' complexity and non-stationarity. Additionally, the effects caused by individual variances may hamper the generalization of detection systems. Given the association between EEG signals and particular demographics, such as gender and age, and the influences of these demographic characteristics on the incidence of depression, it would be preferable to include demographic factors during EEG modeling and depression detection. The main objective of this work is to develop an algorithm that can recognize depression patterns by studying EEG data. Following a multiband analysis of such signals, machine learning and deep learning techniques were used to detect depression patients automatically. EEG signal data are collected from the multi-modal open dataset MODMA and employed in studying mental diseases. The EEG dataset contains information from a traditional 128-electrode elastic cap and a cutting-edge wearable 3-electrode EEG collector for widespread applications. In this project, resting EEG readings of 128 channels are considered. According to CNN, training with 25 epoch iterations had a 97% accuracy rate. The patient's status has to be divided into two basic categories: major depressive disorder (MDD) and healthy control. Additional MDD include the following six classes: obsessive-compulsive disorders, addiction disorders, conditions brought on by trauma and stress, mood disorders, schizophrenia, and the anxiety disorders discussed in this paper are a few examples of mental illnesses. According to the study, a natural combination of EEG signals and demographic data is promising for the diagnosis of depression.

Depression screening using hybrid neural network

Depression is a common cause of increased suicides worldwide, and studies have shown that the number of patients suffering from major depressive disorder (MDD) increased several-fold during the COVID-19 pandemic, highlighting the importance of disease detection and depression management, while increasing the need for effective diagnostic tools. In recent years, machine learning and deep learning methods based on electroencephalography (EEG) have achieved significant results in the field of automatic depression detection. However, most current studies have focused on a small number of EEG signal channels, and experimental data require special processing by professionals. In this study, 128 channels of EEG signals were simply filtered and 24-fold leave-one-out cross-validation experiments were performed using 2DCNN-LSTM classifier, support vector machine, K-nearest neighbor and decision tree. The current results show that the proposed 2DCNN-LSTM model has an average classification accuracy of 95.1% with an AUC of 0.98 for depression detection of 6-second participant EEG signals, and the model is much better than 72.05%, 79.7% and 79.49% for support vector machine, K nearest neighbor and decision tree. In addition, we found that the model achieved a 100% probability of correctly classifying the EEG signals of 300-second participants.

Modern Methods of Diagnostics and Treatment of Neurodegenerative Diseases and Depression

This paper discusses the promising areas of research into machine learning applications for the prevention and correction of neurodegenerative and depressive disorders. These two groups of disorders are among the leading causes of decline in the quality of life in the world when estimated using disability-adjusted years. Despite decades of research, the development of new approaches for the assessment (especially pre-clinical) and correction of neurodegenerative diseases and depressive disorders remains among the priority areas of research in neurophysiology, psychology, genetics, and interdisciplinary medicine. Contemporary machine learning technologies and medical data infrastructure create new research opportunities. However, reaching a consensus on the application of new machine learning methods and their integration with the existing standards of care and assessment is still a challenge to overcome before the innovations could be widely introduced to clinics. The research on the development of clinical predictions and classification algorithms contributes towards creating a unified approach to the use of growing clinical data. This unified approach should integrate the requirements of medical professionals, researchers, and governmental regulators. In the current paper, the current state of research into neurodegenerative and depressive disorders is presented.

Artificial intelligence assisted tools for the detection of anxiety and depression leading to suicidal ideation in adolescents: a review

Epidemiological studies report high levels of anxiety and depression amongst adolescents. These psychiatric conditions and complex interplays of biological, social and environmental factors are important risk factors for suicidal behaviours and suicide, which show a peak in late adolescence and early adulthood. Although deaths by suicide have fallen globally in recent years, suicide deaths are increasing in some countries, such as the US. Suicide prevention is a challenging global public health problem. Currently, there aren't any validated clinical biomarkers for suicidal diagnosis, and traditional methods exhibit limitations. Artificial intelligence (AI) is budding in many fields, including in the diagnosis of medical conditions. This review paper summarizes recent studies (past 8 years) that employed AI tools for the automated detection of depression and/or anxiety disorder and discusses the limitations and effects of some modalities. The studies assert that AI tools produce promising results and could overcome the limitations of traditional diagnostic methods. Although using AI tools for suicidal ideation exhibits limitations, these are outweighed by the advantages. Thus, this review article also proposes extracting a fusion of features such as facial images, speech signals, and visual and clinical history features from deep models for the automated detection of depression and/or anxiety disorder in individuals, for future work. This may pave the way for the identification of individuals with suicidal thoughts.

RNN and BiLSTM Fusion for Accurate Automatic Epileptic Seizure Diagnosis Using EEG Signals

Epilepsy is a common neurological condition. The effects of epilepsy are not restricted to seizures alone. They comprise a wide spectrum of problems that might impair and reduce quality of life. Even with medication, 30% of epilepsy patients still have recurring seizures. An epileptic seizure is caused by significant neuronal electrical activity, which affects brain activity. EEG shows these changes as high-amplitude spiky and sluggish waves. Recognizing seizures on an electroencephalogram (EEG) manually by a professional neurologist is a time-consuming and labor-intensive process, hence an efficient automated approach is necessary for the identification of epileptic seizure. One technique to increase the speed and accuracy with which a diagnosis of epileptic seizures could be made is by utilizing computer-aided diagnosis systems that are built on deep neural networks, or DNN. This study introduces a fusion of recurrent neural networks (RNNs) and bi-directional long short-term memories (BiLSTMs) for automatic epileptic seizure identification via EEG signal processing in order to tackle the aforementioned informational challenges. An electroencephalogram's (EEG) raw data were first normalized after undergoing pre-processing. A RNN model was fed the normalized EEG sequence data and trained to accurately extract features from the data. Afterwards, the features were passed to the BiLSTM layers for processing so that further temporal information could be retrieved. In addition, the proposed RNN-BiLSTM model was tested in an experimental setting using the freely accessible UCI epileptic seizure dataset. Experimental findings of the suggested model have achieved avg values of 98.90%, 98.50%, 98. 20%, and 98.60%, respectively, for accuracy, sensitivity, precision, and specificity. To further verify the new model's efficacy, it is compared to other models, such as the RNN-LSTM and the RNN-GRU learning models, and is shown to have improved the same metrics by 1.8%, 1.69%, 1.95%, and 2.2% on using 5-fold. Additionally, the proposed method was compared to state-of-the-art approaches and proved to be a more accurate categorization of such techniques.

A novel EEG-based major depressive disorder detection framework with two-stage feature selection

Background

Major depressive disorder (MDD) is a common mental illness, characterized by persistent depression, sadness, despair, etc., troubling people’s daily life and work seriously.

Methods

In this work, we present a novel automatic MDD detection framework based on EEG signals. First of all, we derive highly MDD-correlated features, calculating the ratio of extracted features from EEG signals at frequency bands between \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta$$\end{document}β and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha$$\end{document}α. Then, a two-stage feature selection method named PAR is presented with the sequential combination of Pearson correlation coefficient (PCC) and recursive feature elimination (RFE), where the advantages lie in minimizing the feature searching space. Finally, we employ widely used machine learning methods of support vector machine (SVM), logistic regression (LR), and linear regression (LNR) for MDD detection with the merit of feature interpretability.

Results

Experiment results show that our proposed MDD detection framework achieves competitive results. The accuracy and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F_{1}$$\end{document}F1 score are up to 0.9895 and 0.9846, respectively. Meanwhile, the regression determination coefficient \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$R^2$$\end{document}R2 for MDD severity assessment is up to 0.9479. Compared with existing MDD detection methods with the best accuracy of 0.9840 and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$F_1$$\end{document}F1 score of 0.97, our proposed framework achieves the state-of-the-art MDD detection performance.

Conclusions

Development of this MDD detection framework can be potentially deployed into a medical system to aid physicians to screen out MDD patients.

Behavioral Analysis of EEG Signals in Loss-Gain Decision-Making Experiments

Extraction and analysis of the EEG (electroencephalograph) information features generated during behavioral decision-making can provide a better understanding of the state of mind. Previous studies have focused more on the brainwave features after behavioral decision-making. In fact, the EEG before decision-making is more worthy of our attention. In this study, we introduce a new index based on the reaction time of subjects before decision-making, called the Prestimulus Time (PT), which have important reference value for the study of cognitive function, neurological diseases, and other fields. In our experiments, we use a wearable EEG feature signal acquisition device and a systematic reward and punishment experiment to obtain the EEG features before and after behavioral decision-making. The experimental results show that the EEG generated after behavioral decision due to loss is more intense than that generated by gain in the medial frontal cortex (MFC). In addition, different characteristics of EEG signals are generated prior to behavioral decisions because people have different expectations of the outcome. It will produce more significant negative-polarity event-related potential (ERP) in the forebrain area when the humans are optimistic about the outcomes.

Infusing Expert Knowledge Into a Deep Neural Network Using Attention Mechanism for Personalized Learning Environments

Machine learning models are biased toward data seen during the training steps. The models will tend to give good results in classes where there are many examples and poor results in those with few examples. This problem generally occurs when the classes to predict are imbalanced and this is frequent in educational data where for example, there are skills that are very difficult or very easy to master. There will be less data on students that correctly answered questions related to difficult skills and who incorrectly answered those related to skills easy to master. In this paper, we tackled this problem by proposing a hybrid architecture combining Deep Neural Network architectures— especially Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN)—with expert knowledge for user modeling. The proposed solution uses attention mechanism to infuse expert knowledge into the Deep Neural Network. It has been tested in two contexts: knowledge tracing in an intelligent tutoring system (ITS) called Logic-Muse and prediction of socio-moral reasoning in a serious game called MorALERT. The proposed solution is compared to state-of-the-art machine learning solutions and experiments show that the resulting model can accurately predict the current student's knowledge state (in Logic-Muse) and thus enable an accurate personalization of the learning process. Other experiments show that the model can also be used to predict the level of socio-moral reasoning skills (in MorALERT). Our findings suggest the need for hybrid neural networks that integrate prior expert knowledge (especially when it is necessary to compensate for the strong dependency—of deep learning methods—on data size or the possible unbalanced datasets). Many domains can benefit from such an approach to building models that allow generalization even when there are small training data.

SparNet: A Convolutional Neural Network for EEG Space-Frequency Feature Learning and Depression Discrimination

Depression affects many people around the world today and is considered a global problem. Electroencephalogram (EEG) measurement is an appropriate way to understand the underlying mechanisms of major depressive disorder (MDD) to distinguish depression from normal control. With the development of deep learning methods, many researchers have adopted deep learning models to improve the classification accuracy of depression recognition. However, there are few studies on designing convolution filters for spatial and frequency domain feature learning in different brain regions. In this study, SparNet, a convolutional neural network composed of five parallel convolutional filters and the SENet, is proposed to learn EEG space-frequency domain characteristics and distinguish between depressive and normal control. The model is trained and tested by the cross-validation method of subject division. The results show that SparNet achieves a sensitivity of 95.07%, a specificity of 93.66%, and an accuracy of 94.37% in classification. Therefore, our results can conclude that the proposed SparNet model is effective in detecting depression using EEG signals. It also indicates that the combination of spatial information and frequency domain information is an effective way to identify patients with depression.

A Depression Prediction Algorithm Based on Spatiotemporal Feature of EEG Signal

Depression has gradually become the most common mental disorder in the world. The accuracy of its diagnosis may be affected by many factors, while the primary diagnosis seems to be difficult to define. Finding a way to identify depression by satisfying both objective and effective conditions is an urgent issue. In this paper, a strategy for predicting depression based on spatiotemporal features is proposed, and is expected to be used in the auxiliary diagnosis of depression. Firstly, electroencephalogram (EEG) signals were denoised through the filter to obtain the power spectra of the three corresponding frequency ranges, Theta, Alpha and Beta. Using orthogonal projection, the spatial positions of the electrodes were mapped to the brainpower spectrum, thereby obtaining three brain maps with spatial information. Then, the three brain maps were superimposed on a new brain map with frequency domain and spatial characteristics. A Convolutional Neural Network (CNN) and Gated Recurrent Unit (GRU) were applied to extract the sequential feature. The proposed strategy was validated with a public EEG dataset, achieving an accuracy of 89.63% and an accuracy of 88.56% with the private dataset. The network had less complexity with only six layers. The results show that our strategy is credible, less complex and useful in predicting depression using EEG signals.

Computer-aided Recognition Based on Decision-level Multimodal Fusion for Depression

Aiming at the problem of depression recognition, this paper proposes a computer-aided recognition framework based on decision-level multimodal fusion. In Song Dynasty of China, the idea of multimodal fusion was contained in "one gets different impressions of a mountain when viewing it from the front or sideways, at a close range or from afar" poetry. Objective and comprehensive analysis of depression can more accurately restore its essence, and multimodal can represent more information about depression compared to single modal. Linear electroencephalography (EEG) features based on adaptive auto regression (AR) model and typical nonlinear EEG features are extracted. EEG features related to depression and graph metric features in depression related brain regions are selected as the data basis of multimodal fusion to ensure data diversity. Based on the theory of multi-agent cooperation, the computer-aided depression recognition model of decision-level is realized. The experimental data comes from 24 depressed patients and 29 healthy controls (HC). The results of multi-group controlled trials show that compared with single modal or independent classifiers, the decision-level multimodal fusion method has a stronger ability to recognize depression, and the highest accuracy rate 92.13% was obtained. In addition, our results suggest that improving the brain region associated with information processing can help alleviate and treat depression. In the field of classification and recognition, our results clarify that there is no universal classifier suitable for any condition.

Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Models

Schizophrenia (SZ) is a mental disorder whereby due to the secretion of specific chemicals in the brain, the function of some brain regions is out of balance, leading to the lack of coordination between thoughts, actions, and emotions. This study provides various intelligent deep learning (DL)-based methods for automated SZ diagnosis via electroencephalography (EEG) signals. The obtained results are compared with those of conventional intelligent methods. To implement the proposed methods, the dataset of the Institute of Psychiatry and Neurology in Warsaw, Poland, has been used. First, EEG signals were divided into 25 s time frames and then were normalized by z-score or norm L2. In the classification step, two different approaches were considered for SZ diagnosis via EEG signals. In this step, the classification of EEG signals was first carried out by conventional machine learning methods, e.g., support vector machine, k-nearest neighbors, decision tree, naïve Bayes, random forest, extremely randomized trees, and bagging. Various proposed DL models, namely, long short-term memories (LSTMs), one-dimensional convolutional networks (1D-CNNs), and 1D-CNN-LSTMs, were used in the following. In this step, the DL models were implemented and compared with different activation functions. Among the proposed DL models, the CNN-LSTM architecture has had the best performance. In this architecture, the ReLU activation function with the z-score and L2-combined normalization was used. The proposed CNN-LSTM model has achieved an accuracy percentage of 99.25%, better than the results of most former studies in this field. It is worth mentioning that to perform all simulations, the k-fold cross-validation method with k = 5 has been used.

Suppressing of Power Line Artifact From Electroencephalogram Measurements Using Sparsity in Frequency Domain

Electroencephalogram (EEG) plays an important role in brain disease diagnosis and research of brain-computer interface (BCI). However, the measurements of EEG are often exposed to strong interference of power line artifact (PLA). Digital notch filters (DNFs) can be applied to remove the PLA effectively, but it also results in severe signal distortions in the time domain. To address this problem, spectrum correction (SC) based methods can be utilized. These methods estimate harmonic parameters of the PLA such that compensation signals are produced to remove the noise. In order to ensure high accuracy during harmonic parameter estimations, a novel approach is proposed in this paper. This novel approach is based on the combination of sparse representation (SR) and SC. It can deeply mine the information of PLA in the frequency domain. Firstly, a ratio-based spectrum correction (RBSC) using rectangular window is employed to make rough estimation of the harmonic parameters of PLA. Secondly, the two spectral line closest to the estimated frequency are calculated. Thirdly, the two spectral lines with high amplitudes can be utilized as input of RBSC to make finer estimations of the harmonic parameters. Finally, a compensation signal, based on the extracted harmonic parameters, is generated to suppress PLA. Numerical simulations and actual EEG signals with PLA were used to evaluate the effectiveness of the improved approach. It is verified that this approach can effectively suppress the PLA without distorting the time-domain waveform of the EEG signal.

AutoDep: automatic depression detection using facial expressions based on linear binary pattern descriptor

The psychological health of a person plays an important role in their daily life activities. The paper addresses depression issues with the machine learning model using facial expressions of the patient. Some research has already been done on visual based on depression detection methods, but those are illumination variant. The paper uses feature extraction using LBP (Local Binary Pattern) descriptor, which is illumination invariant. The Viola-Jones algorithm is used for face detection and SVM (support vector machine) is considered for classification along with the LBP descriptor to make a complete model for depression level detection. The proposed method captures frontal face from the videos of subjects and their facial features are extracted from each frame. Subsequently, the facial features are analyzed to detect depression levels with the post-processing model. The performance of the proposed system is evaluated using machine learning algorithms in MATLAB. For the real-time system design, it is necessary to test it on the hardware platform. The LBP descriptor has been implemented on FPGA using Xilinx VIVADO 16.4. The results of the proposed method show satisfactory performance and accuracy for depression detection comparison with similar previous work.