Automated EEG-based screening of depression using deep convolutional neural network

Electroencephalography Decoding with Conditional Identification Generator

Decoding Electroencephalography (EEG) signals are extremely useful for advancing and understanding human-artificial intelligence (AI) interaction systems. Recent advancements in deep neural networks (DNNs) have demonstrated significant promise in this respect due to their ability to model complex nonlinear relationships. However, DNNs face persistent challenges in addressing the inter-person variability inherent in EEG signals, which limits their generalizability. To tackle this limitation, we propose a novel framework that integrates conditional identification information, leveraging the interaction between EEG signals and individual traits to enhance the model's internal representation and improve decoding accuracy. Building on this foundation, we further introduce a privacy-preserving conditional information generator - a generative model that derives embedding knowledge directly from raw EEG signals. This approach eliminates the need for personal identification via individual tests, ensuring both efficiency and privacy. Experimental evaluations conducted on WithMe dataset confirm that this framework outperforms baseline network architectures. Notably, our approach achieves substantial improvements in decoding accuracy for both familiar and unseen subjects, paving the way for efficient, robust, and privacy-conscious human-computer interface systems.

Multimodal fusion of magnetoencephalography and photoacoustic imaging based on optical pump: Trends for wearable and noninvasive Brain-Computer interface

Wearable noninvasive brain-computer interface (BCI) technologies, such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), have experienced significant progress since their inception. However, these technologies have not achieved revolutionary advancements, largely because of their inherently low signal-to-noise ratio and limited penetration depth. In recent years, the application of quantum-theory-based optically pumped (OP) technologies, particularly optical pumped magnetometers (OPMs) for magnetoencephalography (MEG) and photoacoustic imaging (PAI) utilizing OP pulsed laser sources, has opened new avenues for development in noninvasive BCIs. These advanced technologies have garnered considerable attention owing to their high sensitivity in tracking neural activity and detecting blood oxygen saturation. This paper represents the first attempt to discuss and compare technologies grounded in OP theory by examining the technical advantages of OPM-MEG and PAI over traditional EEG and fNIRS. Furthermore, the paper investigates the theoretical and structural feasibility of hardware reuse in OPM-MEG and PAI applications.

Eigenhearts: Cardiac diseases classification using eigenfaces approach

In the realm of cardiovascular medicine, medical imaging plays a crucial role in accurately classifying cardiac diseases and making precise diagnoses. However, the integration of data science techniques in this field presents significant challenges, as it requires a large volume of images, while ethical constraints, high costs, and variability in imaging protocols limit data acquisition. As a consequence, it is necessary to investigate different avenues to overcome this challenge. In this contribution, we offer an innovative tool to conquer this limitation. In particular, we delve into the application of a well recognized method known as the eigenfaces approach to classify cardiac diseases. This approach was originally motivated for efficiently representing pictures of faces using principal component analysis, which provides a set of eigenvectors (aka eigenfaces), explaining the variation between face images. Given its effectiveness in face recognition, we sought to evaluate its applicability to more complex medical imaging datasets. In particular, we integrate this approach with convolutional neural networks to classify echocardiography images taken from mice in five distinct cardiac conditions (healthy, diabetic cardiomyopathy, myocardial infarction, obesity and TAC hypertension). The results show a substantial and noteworthy enhancement when employing the singular value decomposition for pre-processing, with classification accuracy increasing by approximately 50%.

Graph convolution network-based eeg signal analysis: a review

With the advancement of artificial intelligence technology, more and more effective methods are being used to identify and classify Electroencephalography (EEG) signals to address challenges in healthcare and brain-computer interface fields. The applications and major achievements of Graph Convolution Network (GCN) techniques in EEG signal analysis are reviewed in this paper. Through an exhaustive search of the published literature, a module-by-module discussion is carried out for the first time to address the current research status of GCN. An exhaustive classification of methods and a systematic analysis of key modules, such as brain map construction, node feature extraction, and GCN architecture design, are presented. In addition, we pay special attention to several key research issues related to GCN. This review enhances the understanding of the future potential of GCN in the field of EEG signal analysis. At the same time, several valuable development directions are sorted out for researchers in related fields, such as analysing the applicability of different GCN layers, building task-oriented GCN models, and improving adaptation to limited data.

Automated depression detection via cloud based EEG analysis with transfer learning and synchrosqueezed wavelet transform

Post-COVID-19, depression rates have risen sharply, increasing the need for early diagnosis using electroencephalogram (EEG) and deep learning. To tackle this, we developed a cloud-based computer-aided depression diagnostic (CCADD) system that utilizes EEG signals from local databases. This system was optimized through a series of experiments to identify the most accurate model. The experiments employed a pre-trained convolutional neural network, ResNet18, fine-tuned on time-frequency synchrosqueezed wavelet transform (SSWT) images derived from EEG signals. Various data augmentation methods, including image processing techniques and noises, were applied to identify the best model for CCADD. To offer this device with minimal electrodes, we aimed to balance high accuracy with fewer electrodes. Two publicly databases were evaluated using this approach. Dataset I included 31 individuals detected with major depressive disorder and a control class of 27 age-matched healthy subjects. Dataset II comprised 90 participants, with 45 diagnosed with depression and 45 healthy controls. The leave-subjects-out cross-validation method with 20 subjects was used to validate the proposed method. The highest average accuracies for the selected model are 98%, 97%, 91%, and 88% for the parietal and central lobes in Databases I and II, respectively. The corresponding highest f-scores are 96.27%, 94.87%, 90.56%, and 89.65%. The highest intra-database accuracy and F1-score are 75.10% and 73.56% when training with SSWT images from Database II and testing with parietal images from Database I. This study introduces a novel cloud-based model for depression detection, paving the way for effective diagnostic tools and potentially revolutionizing depression management.

A depression detection approach leveraging transfer learning with single-channel EEG

Objective.Major depressive disorder (MDD) is a widespread mental disorder that affects health. Many methods combining electroencephalography (EEG) with machine learning or deep learning have been proposed to objectively distinguish between MDD and healthy individuals. However, most current methods detect depression based on multichannel EEG signals, which constrains its application in daily life. The context in which EEG is obtained can vary in terms of study designs and EEG equipment settings, and the available depression EEG data is limited, which could also potentially lessen the efficacy of the model in differentiating between MDD and healthy subjects. To solve the above challenges, a depression detection model leveraging transfer learning with the single-channel EEG is advanced.Approach.We utilized a pretrained ResNet152V2 network to which a flattening layer and dense layer were appended. The method of feature extraction was applied, meaning that all layers within ResNet152V2 were frozen and only the parameters of the newly added layers were adjustable during training. Given the superiority of deep neural networks in image processing, the temporal sequences of EEG signals are first converted into images, transforming the problem of EEG signal categorization into an image classification task. Subsequently, a cross-subject experimental strategy was adopted for model training and performance evaluation.Main results.The model was capable of precisely (approaching 100% accuracy) identifying depression in other individuals by employing single-channel EEG samples obtained from a limited number of subjects. Furthermore, the model exhibited superior performance across four publicly available depression EEG datasets, thereby demonstrating good adaptability in response to variations in EEG caused by the context.Significance.This research not only highlights the impressive potential of deep transfer learning techniques in EEG signal analysis but also paves the way for innovative technical approaches to facilitate early diagnosis of associated mental disorders in the future.

Depression level prediction via textual and acoustic analysis

Extensive research on automatic depression diagnosis has utilized video data to capture related cues, but data collection is challenging because of privacy concerns. By contrast, voice data offer a less-intrusive assessment method and can be analyzed for features such as simple tones, the expression of negative emotions, and a focus on oneself. Recent advancements in multimodal depression-level prediction using speech and text data have gained traction, but most studies overlook the temporal alignment of these modalities, limiting their analysis of the interaction between speech content and intonation. To overcome these limitations, this study introduces timestamp-integrated multimodal encoding for depression (TIMEX-D) which synchronizes the acoustic features of human speech with corresponding text data to predict depression levels on the basis of their relationship. TIMEX-D comprises three main components: a timestamp extraction block that extracts timestamps from speech and text, a multimodal encoding block that extends positional encoding from transformers to mimic human speech recognition, and a depression analysis block that predicts depression levels while reducing model complexity compared with existing transformers. In experiments using the DAIC-WOZ and EDAIC datasets, TIMEX-D achieved accuracies of 99.17 % and 99.81 %, respectively, outperforming previous methods by approximately 13 %. The effectiveness of TIMEX-D in predicting depression levels can enhance mental health diagnostics and monitoring across various contexts.

Application of the Random Forest Algorithm for Accurate Bipolar Disorder Classification

Bipolar disorder (BD) is a complex psychiatric condition characterized by alternating episodes of mania and depression, posing significant challenges for accurate and timely diagnosis. This study explores the use of the Random Forest (RF) algorithm as a machine learning approach to classify patients with BD and healthy controls based on electroencephalogram (EEG) data. A total of 330 participants, including euthymic BD patients and healthy controls, were analyzed. EEG recordings were processed to extract key features, including power in frequency bands and complexity metrics such as the Hurst Exponent, which measures the persistence or randomness of a time series, and the Higuchi's Fractal Dimension, which is used to quantify the irregularity of brain signals. The RF model demonstrated robust performance, achieving an average accuracy of 93.41%, with recall and specificity exceeding 93%. These results highlight the algorithm's capacity to handle complex, noisy datasets while identifying key features relevant for classification. Importantly, the model provided interpretable insights into the physiological markers associated with BD, reinforcing the clinical value of EEG as a diagnostic tool. The findings suggest that RF is a reliable and accessible method for supporting the diagnosis of BD, complementing traditional clinical practices. Its ability to reduce diagnostic delays, improve classification accuracy, and optimize resource allocation make it a promising tool for integrating artificial intelligence into psychiatric care. This study represents a significant step toward precision psychiatry, leveraging technology to improve the understanding and management of complex mental health disorders.

Deep Learning-Based Artificial Intelligence Can Differentiate Treatment-Resistant and Responsive Depression Cases with High Accuracy

Background: Although there are many treatment options available for depression, a large portion of patients with depression are diagnosed with treatment-resistant depression (TRD), which is characterized by an inadequate response to antidepressant treatment. Identifying the TRD population is crucial in terms of saving time and resources in depression treatment. Recently several studies employed various methods on EEG datasets for automatic depression detection or treatment outcome prediction. However, no previous study has used the deep learning (DL) approach and EEG signals for detecting treatment resistance. Method: 77 patients with TRD, 43 patients with non-TRD, and 40 healthy controls were compared using GoogleNet convolutional neural network and DL on EEG data. Additionally, Class Activation Maps (CAMs) acquired from the TRD and non-TRD groups were used to obtain distinctive regions for classification. Results: GoogleNet classified the healthy controls and non-TRD group with 88.43%, the healthy controls and TRD subjects with 89.73%, and the TRD and non-TRD group with 90.05% accuracy. The external validation accuracy for the TRD-non-TRD classification was 73.33%. Finally, the CAM analysis revealed that the TRD group contained dominant features in class detection of deep learning architecture in almost all electrodes. Limitations: Our study is limited by the moderate sample size of clinical groups and the retrospective nature of the study. Conclusion: These findings suggest that EEG-based deep learning can be used to classify treatment resistance in depression and may in the future prove to be a useful tool in psychiatry practice to identify patients who need more vigorous intervention.

Depression diagnosis: EEG-based cognitive biomarkers and machine learning

Depression is a complex mental illness that has significant effects on people as well as society. The traditional techniques for the diagnosis of depression, along with the potential of nascent biomarkers especially EEG-based biomarkers, are studied. This review explores the significance of cognitive biomarkers, offering a comprehensive understanding of their role in the overall assessment of depression. It also investigates the effects of depression on various brain regions, outlines promising areas for future research, and emphasizes the importance of understanding the neurophysiological roots of depression. Furthermore, it elucidates how machine learning and deep learning models are integrated into EEG-based depression diagnosis, emphasizing their importance in optimizing personalized therapeutic protocols and improving diagnostic accuracy with EEG data analysis.

MDD-SSTNet: detecting major depressive disorder by exploring spectral-spatial-temporal information on resting-state electroencephalography data based on deep neural network

Major depressive disorder (MDD) is a psychiatric disorder characterized by persistent lethargy that can lead to suicide in severe cases. Hence, timely and accurate diagnosis and treatment are crucial. Previous neuroscience studies have demonstrated that major depressive disorder subjects exhibit topological brain network changes and different temporal electroencephalography (EEG) characteristics compared to healthy controls. Based on these phenomena, we proposed a novel model, termed as MDD-SSTNet, for detecting major depressive disorder by exploring spectral-spatial-temporal information from resting-state EEG with deep convolutional neural network. Firstly, MDD-SSTNet used the Sinc filter to obtain specific frequency band features from pre-processed EEG data. Secondly, two parallel branches were used to extract temporal and spatial features through convolution and other operations. Finally, the model was trained with a combined loss function of center loss and Binary Cross-Entropy Loss. Using leave-one-subject-out cross-validation on the HUSM dataset and MODMA dataset, the MDD-SSTNet model outperformed six baseline models, achieving average classification accuracies of 93.85% and 65.08%, respectively. These results indicate that MDD-SSTNet could effectively mine spatial-temporal difference information between major depressive disorder subjects and healthy control subjects, and it holds promise to provide an efficient approach for MDD detection with EEG data.

Depression Detection and Diagnosis Based on Electroencephalogram (EEG) Analysis: A Systematic Review

Background: Mental disorders are disturbances of brain functions that cause cognitive, affective, volitional, and behavioral functions to be disrupted to varying degrees. One of these disorders is depression, a significant factor contributing to the increase in suicide cases worldwide. Consequently, depression has become a significant public health issue globally. Electroencephalogram (EEG) data can be utilized to diagnose mild depression disorder (MDD), offering valuable insights into the pathophysiological mechanisms underlying mental disorders and enhancing the understanding of MDD. Methods: This survey emphasizes the critical role of EEG in advancing artificial intelligence (AI)-driven approaches for depression diagnosis. By focusing on studies that integrate EEG with machine learning (ML) and deep learning (DL) techniques, we systematically analyze methods utilizing EEG signals to identify depression biomarkers. The survey highlights advancements in EEG preprocessing, feature extraction, and model development, showcasing how these approaches enhance the diagnostic precision, scalability, and automation of depression detection. Results: This survey is distinguished from prior reviews by addressing their limitations and providing researchers with valuable insights for future studies. It offers a comprehensive comparison of ML and DL approaches utilizing EEG and an overview of the five key steps in depression detection. The survey also presents existing datasets for depression diagnosis and critically analyzes their limitations. Furthermore, it explores future directions and challenges, such as enhancing diagnostic robustness with data augmentation techniques and optimizing EEG channel selection for improved accuracy. The potential of transfer learning and encoder-decoder architectures to leverage pre-trained models and enhance diagnostic performance is also discussed. Advancements in feature extraction methods for automated depression diagnosis are highlighted as avenues for improving ML and DL model performance. Additionally, integrating Internet of Things (IoT) devices with EEG for continuous mental health monitoring and distinguishing between different types of depression are identified as critical research areas. Finally, the review emphasizes improving the reliability and predictability of computational intelligence-based models to advance depression diagnosis. Conclusions: This study will serve as a well-organized and helpful reference for researchers working on detecting depression using EEG signals and provide insights into the future directions outlined above, guiding further advancements in the field.

Opportunities and Challenges for Clinical Practice in Detecting Depression Using EEG and Machine Learning

Major depressive disorder (MDD) is associated with substantial morbidity and mortality, yet its diagnosis and treatment rates remain low due to its diverse and often overlapping clinical manifestations. In this context, electroencephalography (EEG) has gained attention as a potential objective tool for diagnosing depression. This study aimed to evaluate the effectiveness of EEG in identifying MDD by analyzing 140 EEG recordings from patients diagnosed with depression and healthy volunteers. Using various machine learning (ML) classification models, we achieved up to 80% accuracy in distinguishing individuals with MDD from healthy controls. Despite its promise, this approach has limitations. The variability in the clinical and biological presentations of depression, as well as patient-specific confounding factors, must be carefully considered when integrating ML technologies into clinical practice. Nevertheless, our findings suggest that an EEG-based ML model holds potential as a diagnostic aid for MDD, paving the way for further refinement and clinical application.

Application of machine learning in depression risk prediction for connective tissue diseases

This study retrospectively collected clinical data from 480 patients with connective tissue diseases (CTDs) at Nanjing First Hospital between August 2019 and December 2023 to develop and validate a multi-classification machine learning (ML) model for assessing depression risk. Addressing the limitations of traditional assessment tools, six ML models were constructed using univariate analysis and the LASSO algorithm, with the categorical boosting (Catboost) model emerging as the best performer, demonstrating strong predictive ability across different depression severity levels (none_F1 = 0.879, mild_F1 = 0.627, moderate and severe_F1 = 0.588). Additionally, the study provided an interpretation of the best-performing model using SHAP and developed a user-friendly R Shiny application ( https://macnomogram.shinyapps.io/Catboost/ ) to facilitate clinical use. The findings suggest that the Catboost model represents a significant advancement in assessing depression risk among CTD patients, highlighting the potential of ML in enhancing mental health management for this patient population.

Individualized Spectral Features in First-Episode and Drug-Naïve Major Depressive Disorder: Insights From Periodic and Aperiodic Electroencephalography Analysis

BACKGROUND

The detection of abnormal brain activity plays an important role in the early diagnosis and treatment of major depressive disorder (MDD). Recent studies have shown that the decomposition of the electroencephalography (EEG) spectrum into periodic and aperiodic components is useful for identifying the drivers of electrophysiologic abnormalities and avoiding individual differences.

METHODS

In this study, we aimed to elucidate the pathological changes in individualized periodic and aperiodic activities and their relationships with the symptoms of MDD. EEG data in the eyes-closed resting state were continuously recorded from 97 first-episode and drug-naïve patients with MDD and 90 healthy control participants. Both periodic oscillations and aperiodic components were obtained via the fitting oscillations and one-over f (FOOOF) algorithm and then used to compute individualized spectral features.

RESULTS

Patients with MDD presented higher canonical alpha and beta band power but lower aperiodic-adjusted alpha and beta power. Furthermore, we found that alpha power was strongly correlated with the age of patients but not with disease symptoms. The aperiodic intercept was lower in the parieto-occipital region and was positively correlated with Hamilton Depression Rating Scale scores after accounting for age and sex. In the asymmetry analysis, alpha activity appeared asymmetrical only in the healthy control group, whereas aperiodic activity was symmetrical in both groups.

CONCLUSIONS

The findings of this study provide insights into the role of abnormal neural spiking activity and impaired neuroplasticity in MDD progression and suggest that the aperiodic intercept in resting-state EEG may be a potential biomarker of MDD.

EEG Signals Classification Related to Visual Objects Using Long Short-Term Memory Network and Nonlinear Interval Type-2 Fuzzy Regression

By gaining insights into how brain activity is encoded and decoded, we enhance our understanding of brain function. This study introduces a method for classifying EEG signals related to visual objects, employing a combination of an LSTM network and nonlinear interval type-2 fuzzy regression (NIT2FR). Here, ResNet is utilized for feature extraction from images, the LSTM network for feature extraction from EEG signals, and NIT2FR for mapping image features to EEG signal features. The application of type-2 fuzzy logic addresses uncertainties arising from EEG signal nonlinearity, noise, limited data sample size, and diverse mental states among participants. The Stanford database was used for implementation, evaluating effectiveness through metrics like classification accuracy, precision, recall, and F1 score. According to the findings, the LSTM network achieved an accuracy of 55.83% in categorizing images using raw EEG data. When compared to other methods like linear type-2, linear/nonlinear type-1 fuzzy, neural network, and polynomial regression, NIT2FR coupled with an SVM classifier outperformed with a 68.05% accuracy. Thus, NIT2FR demonstrates superiority in handling high uncertainty environments. Moreover, the 6.03% improvement in accuracy over the best previous study using the same dataset underscores its effectiveness. Precision, recall, and F1 score results for NIT2FR were 68.93%, 68.08%, and 68.49% respectively, surpassing outcomes from linear type-2, linear/nonlinear type-1 fuzzy regression methods.

The application of artificial intelligence in insomnia, anxiety, and depression: A bibliometric analysis

Background

Mental health issues like insomnia, anxiety, and depression have increased significantly. Artificial intelligence (AI) has shown promise in diagnosing and providing personalized treatment.

Objective

This study aims to systematically review the application of AI in addressing insomnia, anxiety, and depression, identifying key research hotspots, and forecasting future trends through bibliometric analysis.

Methods

We analyzed a total of 875 articles from the Web of Science Core Collection (2000-2024) using bibliometric tools such as VOSviewer and CiteSpace. These tools were used to map research trends, highlight international collaboration, and examine the contributions of leading countries, institutions, and authors in the field.

Results

The United States and China lead the field in terms of research output and collaborations. Key research areas include "neural networks," "machine learning," "deep learning," and "human-robot interaction," particularly in relation to personalized treatment approaches. However, challenges around data privacy, ethical concerns, and the interpretability of AI models need to be addressed.

Conclusions

This study highlights the growing role of AI in mental health research and identifies future priorities, such as improving data quality, addressing ethical challenges, and integrating AI more seamlessly into clinical practice. These advancements will be crucial in addressing the global mental health crisis.

Depression assessment using integrated multi-featured EEG bands deep neural network models: Leveraging ensemble learning techniques

Mental Status Assessment (MSA) holds significant importance in psychiatry. In recent years, several studies have leveraged Electroencephalogram (EEG) technology to gauge an individual's mental state or level of depression. This study introduces a novel multi-tier ensemble learning approach to integrate multiple EEG bands for conducting mental state or depression assessments. Initially, the EEG signal is divided into eight sub-bands, and then a Long Short-Term Memory (LSTM)-based Deep Neural Network (DNN) model is trained for each band. Subsequently, the integration of multi-band EEG frequency models and the evaluation of mental state or depression level are facilitated through a two-tier ensemble learning approach based on Multiple Linear Regression (MLR). The authors conducted numerous experiments to validate the performance of the proposed method under different evaluation metrics. For clarity and conciseness, the research employs the simplest commercialized one-channel EEG sensor, positioned at FP1, to collect data from 57 subjects (49 depressed and 18 healthy subjects). The obtained results, including an accuracy of 0.897, F1-score of 0.921, precision of 0.935, negative predictive value of 0.829, recall of 0.908, specificity of 0.875, and AUC of 0.8917, provide evidence of the superior performance of the proposed method compared to other ensemble learning techniques. This method not only proves effective but also holds the potential to significantly enhance the accuracy of depression assessment.

An historical overview of artificial intelligence for diagnosis of major depressive disorder

The Artificial Intelligence (AI) technology holds immense potential in the realm of automated diagnosis for Major Depressive Disorder (MDD), yet it is not without potential shortcomings. This paper systematically reviews the research progresses of integrating AI technology with depression diagnosis and provides a comprehensive analysis of existing research findings. In this context, we observe that the knowledge-driven first-generation of depression diagnosis methods could only address deterministic issues in structured information, with the selection of depression-related features directly influencing identification outcomes. The data-driven second-generation of depression diagnosis methods achieved automatic learning of features but required substantial high-quality clinical data, and the results were often obtained solely from the black-box models which lack sufficient explainability. In an effort to overcome the limitations of the preceding approaches, the third-generation of depression diagnosis methods combined the strengths of knowledge-driven and data-driven approaches. Through the fusion of information, the diagnostic accuracy is greatly enhanced, but the interpretability remains relatively weak. In order to enhance interpretability and introduce diagnostic criteria, this paper offers a new approach using Large Language Models (LLMs) as AI agents for assisting the depression diagnosis. Finally, we also discuss the potential advantages and challenges associated with this approach. This newly proposed innovative approach has the potential to offer new perspectives and solutions in the diagnosis of depression.

Explainable Multi-Layer Dynamic Ensemble Framework Optimized for Depression Detection and Severity Assessment

BACKGROUND

Depression is a pervasive mental health condition, particularly affecting older adults, where early detection and intervention are essential to mitigate its impact. This study presents an explainable multi-layer dynamic ensemble framework designed to detect depression and assess its severity, aiming to improve diagnostic precision and provide insights into contributing health factors.

METHODS

Using data from the National Social Life, Health, and Aging Project (NSHAP), this framework combines classical machine learning models, static ensemble methods, and dynamic ensemble selection (DES) approaches across two stages: detection and severity prediction. The depression detection stage classifies individuals as normal or depressed, while the severity prediction stage further classifies depressed cases as mild or moderate-severe. Finally, a confirmation depression scale prediction model estimates depression severity scores to support the two stages. Explainable AI (XAI) techniques are applied to improve model interpretability, making the framework more suitable for clinical applications.

RESULTS

The framework's FIRE-KNOP DES algorithm demonstrated high efficacy, achieving 88.33% accuracy in depression detection and 83.68% in severity prediction. XAI analysis identified mental and non-mental health indicators as significant factors in the framework's performance, emphasizing the value of these features for accurate depression assessment.

CONCLUSIONS

This study emphasizes the potential of dynamic ensemble learning in mental health assessments, particularly in detecting and evaluating depression severity. The findings provide a strong foundation for future use of dynamic ensemble frameworks in mental health assessments, demonstrating their potential for practical clinical applications.

Resting-State Electroencephalogram Depression Diagnosis Based on Traditional Machine Learning and Deep Learning: A Comparative Analysis

The global prevalence of Major Depressive Disorder (MDD) is increasing at an alarming rate, underscoring the urgent need for timely and accurate diagnoses to facilitate effective interventions and treatments. Electroencephalography remains a widely used neuroimaging technique in psychiatry, due to its non-invasive nature and cost-effectiveness. With the rise of computational psychiatry, the integration of EEG with artificial intelligence has yielded remarkable results in diagnosing depression. This review offers a comparative analysis of two predominant methodologies in research: traditional machine learning and deep learning methods. Furthermore, this review addresses key challenges in current research and suggests potential solutions. These insights aim to enhance diagnostic accuracy for depression and also foster further development in the area of computational psychiatry.

Multimodal Fusion of EEG and Audio Spectrogram for Major Depressive Disorder Recognition Using Modified DenseNet121

BACKGROUND/OBJECTIVES

This study investigates the classification of Major Depressive Disorder (MDD) using electroencephalography (EEG) Short-Time Fourier-Transform (STFT) spectrograms and audio Mel-spectrogram data of 52 subjects. The objective is to develop a multimodal classification model that integrates audio and EEG data to accurately identify depressive tendencies.

METHODS

We utilized the Multimodal open dataset for Mental Disorder Analysis (MODMA) and trained a pre-trained Densenet121 model using transfer learning. Features from both the EEG and audio modalities were extracted and concatenated before being passed through the final classification layer. Additionally, an ablation study was conducted on both datasets separately.

RESULTS

The proposed multimodal classification model demonstrated superior performance compared to existing methods, achieving an Accuracy of 97.53%, Precision of 98.20%, F1 Score of 97.76%, and Recall of 97.32%. A confusion matrix was also used to evaluate the model's effectiveness.

CONCLUSIONS

The paper presents a robust multimodal classification approach that outperforms state-of-the-art methods with potential application in clinical diagnostics for depression assessment.

Artificial intelligence for brain disease diagnosis using electroencephalogram signals

Brain signals refer to electrical signals or metabolic changes that occur as a consequence of brain cell activity. Among the various non-invasive measurement methods, electroencephalogram (EEG) stands out as a widely employed technique, providing valuable insights into brain patterns. The deviations observed in EEG reading serve as indicators of abnormal brain activity, which is associated with neurological diseases. Brain‒computer interface (BCI) systems enable the direct extraction and transmission of information from the human brain, facilitating interaction with external devices. Notably, the emergence of artificial intelligence (AI) has had a profound impact on the enhancement of precision and accuracy in BCI technology, thereby broadening the scope of research in this field. AI techniques, encompassing machine learning (ML) and deep learning (DL) models, have demonstrated remarkable success in classifying and predicting various brain diseases. This comprehensive review investigates the application of AI in EEG-based brain disease diagnosis, highlighting advancements in AI algorithms.

Multimodal insights into granger causality connectivity: Integrating physiological signals and gated eye-tracking data for emotion recognition using convolutional neural network

This study introduces a groundbreaking method to enhance the accuracy and reliability of emotion recognition systems by combining electrocardiogram (ECG) with electroencephalogram (EEG) data, using an eye-tracking gated strategy. Initially, we propose a technique to filter out irrelevant portions of emotional data by employing pupil diameter metrics from eye-tracking data. Subsequently, we introduce an innovative approach for estimating effective connectivity to capture the dynamic interaction between the brain and the heart during emotional states of happiness and sadness. Granger causality (GC) is estimated and utilized to optimize input for a highly effective pre-trained convolutional neural network (CNN), specifically ResNet-18. To assess this methodology, we employed EEG and ECG data from the publicly available MAHNOB-HCI database, using a 5-fold cross-validation approach. Our method achieved an impressive average accuracy and area under the curve (AUC) of 91.00 % and 0.97, respectively, for GC-EEG-ECG images processed with ResNet-18. Comparative analysis with state-of-the-art studies clearly shows that augmenting ECG with EEG and refining data with an eye-tracking strategy significantly enhances emotion recognition performance across various emotions.

Adaptive node feature extraction in graph-based neural networks for brain diseases diagnosis using self-supervised learning

Electroencephalography (EEG) has demonstrated significant value in diagnosing brain diseases. In particular, brain networks have gained prominence as they offer additional valuable insights by establishing connections between EEG signal channels. While brain connections are typically delineated by channel signal similarity, there lacks a consistent and reliable strategy for ascertaining node characteristics. Conventional node features such as temporal and frequency domain properties of EEG signals prove inadequate for capturing the extensive EEG information. In our investigation, we introduce a novel adaptive method for extracting node features from EEG signals utilizing a distinctive task-induced self-supervised learning technique. By amalgamating these extracted node features with fundamental edge features constructed using Pearson correlation coefficients, we showed that the proposed approach can function as a plug-in module that can be integrated to many common GNN networks (e.g., GCN, GraphSAGE, GAT) as a replacement of node feature selections module. Comprehensive experiments are then conducted to demonstrate the consistently superior performance and high generality of the proposed method over other feature selection methods in various of brain disorder prediction tasks, such as depression, schizophrenia, and Parkinson's disease. Furthermore, compared to other node features, our approach unveils profound spatial patterns through graph pooling and structural learning, shedding light on pivotal brain regions influencing various brain disorder prediction based on derived features.

Employing Siamese Networks as Quantitative Biomarker for Assessing the Effect of Dolphin-Assisted Therapy on Pediatric Cerebral Palsy

This study explores the potential of using a Siamese Network as a biomarker for assessing the effectiveness of Dolphin-Assisted Therapy (DAT) in children with Spastic Cerebral Palsy (SCP). The problem statement revolves around the need for objective measures to evaluate the impact of DAT on patients with SCP, considering the subjective nature of traditional assessment methods. The methodology involves training a Siamese network, a type of neural network designed to compare similarities between inputs, using data collected from SCP patients undergoing DAT sessions. The study employed Event-Related Potential (ERP) and Fast Fourier Transform (FFT) analyses to examine cerebral activity and brain rhythms, proposing the use of SNN to compare electroencephalographic (EEG) signals of children with cerebral palsy before and after Dolphin-Assisted Therapy. Testing on samples from four children yielded a high average similarity index of 0.9150, indicating consistent similarity metrics before and after therapy. The network is trained to learn patterns and similarities between pre- and post-therapy evaluations, in order to identify biomarkers indicative of therapy effectiveness. Notably, the Siamese Network's architecture ensures that comparisons are made within the same feature space, allowing for more accurate assessments. The results of the study demonstrate promising findings, indicating different patterns in the output of the Siamese Network that correlate with improvements in symptoms of SCP post-DAT. Confirming these observations will require large, longitudinal studies but such findings would suggest that the Siamese Network could have utility as a biomarker in monitoring treatment responses for children with SCP who undergo DAT and offer them more objective as well as quantifiable manners of assessing therapeutic interventions. Great discrepancies in neuronal voltage perturbations, 7.9825 dB on average at the specific samples compared to the whole dataset (6.2838 dB), imply a noted deviation from resting activity. These findings indicate that Dolphin-Assisted Therapy activates particular brain regions specifically during the intervention.

Spatial-Temporal Dynamic Hypergraph Information Bottleneck for Brain Network Classification

Recently, Graph Neural Networks (GNNs) have gained widespread application in automatic brain network classification tasks, owing to their ability to directly capture crucial information in non-Euclidean structures. However, two primary challenges persist in this domain. First, within the realm of clinical neuro-medicine, signals from cerebral regions are inevitably contaminated with noise stemming from physiological or external factors. The construction of brain networks heavily relies on set thresholds and feature information within brain regions, making it susceptible to the incorporation of such noises into the brain topology. Additionally, the static nature of the artificially constructed brain network's adjacent structure restricts real-time changes in brain topology. Second, mainstream GNN-based approaches tend to focus solely on capturing information interactions of nearest neighbor nodes, overlooking high-order topology features. In response to these challenges, we propose an adaptive unsupervised Spatial-Temporal Dynamic Hypergraph Information Bottleneck (ST-DHIB) framework for dynamically optimizing brain networks. Specifically, adopting an information theory perspective, Graph Information Bottleneck (GIB) is employed for purifying graph structure, and dynamically updating the processed input brain signals. From a graph theory standpoint, we utilize the designed Hypergraph Neural Network (HGNN) and Bi-LSTM to capture higher-order spatial-temporal context associations among brain channels. Comprehensive patient-specific and cross-patient experiments have been conducted on two available datasets. The results demonstrate the advancement and generalization of the proposed framework.

Simultaneous EEG-fMRI Investigation of Rhythm-Dependent Thalamo-Cortical Circuits Alteration in Schizophrenia

Schizophrenia is accompanied by aberrant interactions of intrinsic brain networks. However, the modulatory effect of electroencephalography (EEG) rhythms on the functional connectivity (FC) in schizophrenia remains unclear. This study aims to provide new insight into network communication in schizophrenia by integrating FC and EEG rhythm information. After collecting simultaneous resting-state EEG-functional magnetic resonance imaging data, the effect of rhythm modulations on FC was explored using what we term "dynamic rhythm information." We also investigated the synergistic relationships among three networks under rhythm modulation conditions, where this relationship presents the coupling between two brain networks with other networks as the center by the rhythm modulation. This study found FC between the thalamus and cortical network regions was rhythm-specific. Further, the effects of the thalamus on the default mode network (DMN) and salience network (SN) were less similar under alpha rhythm modulation in schizophrenia patients than in controls ([Formula: see text]). However, the similarity between the effects of the central executive network (CEN) on the DMN and SN under gamma modulation was greater ([Formula: see text]), and the degree of coupling was negatively correlated with the duration of disease ([Formula: see text], [Formula: see text]). Moreover, schizophrenia patients exhibited less coupling with the thalamus as the center and greater coupling with the CEN as the center. These results indicate that modulations in dynamic rhythms might contribute to the disordered functional interactions seen in schizophrenia.

An automated approach for predicting HAMD-17 scores via divergent selective focused multi-heads self-attention network

This study introduces the Divergent Selective Focused Multi-heads Self-Attention Network (DSFMANet), an innovative deep learning model devised to automatically predict Hamilton Depression Rating Scale-17 (HAMD-17) scores in patients with depression. This model introduces a multi-branch structure for sub-bands and artificially configures attention focus factors on various branches, resulting in distinct attention distributions for different sub-bands. Experimental results demonstrate that when DSFMANet processes sub-band data, its performance surpasses current benchmarks in key metrics such as mean square error (MSE), mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R2). This success is particularly evident in terms of MSE and MAE, where the performance of sub-band data is significantly superior, highlighting the model's potential in accurately predicting HAMD-17 scores. Concurrently, the experiment also compared the model's performance with sub-band and full-band data, affirming the superiority of the selective focus attention mechanism in electroencephalography (EEG) signal processing. DSFMANet, when utilizing sub-band data, exhibits higher data processing efficiency and reduced model complexity. The findings of this study underscore the significance of employing deep learning models based on sub-band analysis in depression diagnosis. The DSFMANet model not only effectively enhances the accuracy of depression diagnosis but also offers valuable research directions for similar applications in the future. This deep learning-based automated approach can effectively ascertain the HAMD-17 scores of patients with depression, thus offering more accurate and reliable support for clinical decision-making.

SMARTSeiz: Deep Learning With Attention Mechanism for Accurate Seizure Recognition in IoT Healthcare Devices

The Internet of Things (IoT) is capable of controlling the healthcare monitoring system for remote-based patients. Epilepsy, a chronic brain syndrome characterized by recurrent, unpredictable attacks, affects individuals of all ages. IoT-based seizure monitoring can greatly enhance seizure patients' quality of life. IoT device acquires patient data and transmits it to a computer program so that doctors can examine it. Currently, doctors invest significant manual effort in inspecting Electroencephalograph (EEG) signals to identify seizure activity. However, EEG-based seizure detection algorithms face challenges in real-world scenarios due to non-stationary EEG data and variable seizure patterns among patients and recording sessions. Therefore, a sophisticated computer-based approach is necessary to analyze complex EEG records. In this work, the authors proposed a hybrid approach by combining traditional convolution neural (CN) and recurrent neural networks (RNN) along with an attention mechanism for the automatic recognition of epileptic seizures through EEG signal analysis. This attention mechanism focuses on significant subsets of EEG data for class recognition, resulting in improved model performance. The proposed methods are evaluated using a publicly available UCI epileptic seizure recognition dataset, which consists of five classes: four normal conditions and one abnormal seizure condition. Experimental results demonstrate that the suggested approach achieves an overall accuracy of 97.05% for the five-class EEG recognition data, with an accuracy of 99.52% for binary classification distinguishing seizure cases from normal instances. Furthermore, the proposed intelligent seizure recognition model is compatible with an IoMT (Internet of Medical Things) cloud-based smart healthcare framework.

GCTNet: a graph convolutional transformer network for major depressive disorder detection based on EEG signals

Objective.Identifying major depressive disorder (MDD) using objective physiological signals has become a pressing challenge.Approach.Hence, this paper proposes a graph convolutional transformer network (GCTNet) for accurate and reliable MDD detection using electroencephalogram (EEG) signals. The developed framework integrates a residual graph convolutional network block to capture spatial information and a Transformer block to extract global temporal dynamics. Additionally, we introduce the contrastive cross-entropy (CCE) loss that combines contrastive learning to enhance the stability and discriminability of the extracted features, thereby improving classification performance.Main results. The effectiveness of the GCTNet model and CCE loss was assessed using EEG data from 41 MDD patients and 44 normal controls, in addition to a publicly available dataset. Utilizing a subject-independent data partitioning method and 10-fold cross-validation, the proposed method demonstrated significant performance, achieving an average Area Under the Curve of 0.7693 and 0.9755 across both datasets, respectively. Comparative analyses demonstrated the superiority of the GCTNet framework with CCE loss over state-of-the-art algorithms in MDD detection tasks.Significance. The proposed method offers an objective and effective approach to MDD detection, providing valuable support for clinical-assisted diagnosis.

TanhReLU -based convolutional neural networks for MDD classification

Major Depression Disorder (MDD), a complex mental health disorder, poses significant challenges in accurate diagnosis. In addressing the issue of gradient vanishing in the classification of MDD using current data-driven electroencephalogram (EEG) data, this study introduces a TanhReLU-based Convolutional Neural Network (CNN). By integrating the TanhReLU activation function, which combines the characteristics of the hyperbolic tangent (Tanh) and rectified linear unit (ReLU) activations, the model aims to improve performance in identifying patterns associated with MDD while alleviating the issue of model overfitting and gradient vanishing. Experimental results demonstrate promising outcomes in the task of MDD classification upon the publicly available EEG data, suggesting potential clinical applications.

Data leakage in deep learning studies of translational EEG

A growing number of studies apply deep neural networks (DNNs) to recordings of human electroencephalography (EEG) to identify a range of disorders. In many studies, EEG recordings are split into segments, and each segment is randomly assigned to the training or test set. As a consequence, data from individual subjects appears in both the training and the test set. Could high test-set accuracy reflect data leakage from subject-specific patterns in the data, rather than patterns that identify a disease? We address this question by testing the performance of DNN classifiers using segment-based holdout (in which segments from one subject can appear in both the training and test set), and comparing this to their performance using subject-based holdout (where all segments from one subject appear exclusively in either the training set or the test set). In two datasets (one classifying Alzheimer's disease, and the other classifying epileptic seizures), we find that performance on previously-unseen subjects is strongly overestimated when models are trained using segment-based holdout. Finally, we survey the literature and find that the majority of translational DNN-EEG studies use segment-based holdout. Most published DNN-EEG studies may dramatically overestimate their classification performance on new subjects.

Teachers and educators' experiences and perceptions of artificial-powered interventions for autism groups

BACKGROUND

Artificial intelligence-powered interventions have emerged as promising tools to support autistic individuals. However, more research must examine how teachers and educators perceive and experience these AI systems when implemented.

OBJECTIVES

The first objective was to investigate informants' perceptions and experiences of AI-empowered interventions for children with autism. Mainly, it explores the informants' perceived benefits and challenges of using AI-empowered interventions and their recommendations for avoiding the perceived challenges.

METHODOLOGY

A qualitative phenomenological approach was used. Twenty educators and parents with experience implementing AI interventions for autism were recruited through purposive sampling. Semi-structured and focus group interviews conducted, transcribed verbatim, and analyzed using thematic analysis.

FINDINGS

The analysis identified four major themes: perceived benefits of AI interventions, implementation challenges, needed support, and recommendations for improvement. Benefits included increased engagement and personalized learning. Challenges included technology issues, training needs, and data privacy concerns.

CONCLUSIONS

AI-powered interventions show potential to improve autism support, but significant challenges must be addressed to ensure effective implementation from an educator's perspective. The benefits of personalized learning and student engagement demonstrate the potential value of these technologies. However, with adequate training, technical support, and measures to ensure data privacy, many educators will likely find integrating AI systems into their daily practices easier.

IMPLICATIONS

To realize the full benefits of AI for autism, developers must work closely with educators to understand their needs, optimize implementation, and build trust through transparent privacy policies and procedures. With proper support, AI interventions can transform how autistic individuals are educated by tailoring instruction to each student's unique profile and needs.

Unified Convolutional Sparse Transformer for Disease Diagnosis, Monitoring, Drug Development, and Therapeutic Effect Prediction from EEG Raw Data

Electroencephalogram (EEG) analysis plays an indispensable role across contemporary medical applications, which encompasses diagnosis, monitoring, drug discovery, and therapeutic assessment. This work puts forth an end-to-end deep learning framework that is uniquely tailored for versatile EEG analysis tasks by directly operating on raw waveform inputs. It aims to address the challenges of manual feature engineering and the neglect of spatial interrelationships in existing methodologies. Specifically, a spatial channel attention module is introduced to emphasize the critical inter-channel dependencies in EEG signals through channel statistics aggregation and multi-layer perceptron operations. Furthermore, a sparse transformer encoder is used to leverage selective sparse attention in order to efficiently process long EEG sequences while reducing computational complexity. Distilling convolutional layers further concatenates the temporal features and retains only the salient patterns. As it was rigorously evaluated on key EEG datasets, our model consistently accomplished a superior performance over the current approaches in detection and classification assignments. By accounting for both spatial and temporal relationships in an end-to-end paradigm, this work facilitates a versatile, automated EEG understanding across diseases, subjects, and objectives through a singular yet customizable architecture. Extensive empirical validation and further architectural refinement may promote broader clinical adoption prospects.

Identifying EEG Biomarkers of Depression with Novel Explainable Deep Learning Architectures

Deep learning methods are increasingly being applied to raw electroencephalogram (EEG) data. However, if these models are to be used in clinical or research contexts, methods to explain them must be developed, and if these models are to be used in research contexts, methods for combining explanations across large numbers of models must be developed to counteract the inherent randomness of existing training approaches. Model visualization-based explainability methods for EEG involve structuring a model architecture such that its extracted features can be characterized and have the potential to offer highly useful insights into the patterns that they uncover. Nevertheless, model visualization-based explainability methods have been underexplored within the context of multichannel EEG, and methods to combine their explanations across folds have not yet been developed. In this study, we present two novel convolutional neural network-based architectures and apply them for automated major depressive disorder diagnosis. Our models obtain slightly lower classification performance than a baseline architecture. However, across 50 training folds, they find that individuals with MDD exhibit higher β power, potentially higher δ power, and higher brain-wide correlation that is most strongly represented within the right hemisphere. This study provides multiple key insights into MDD and represents a significant step forward for the domain of explainable deep learning applied to raw EEG. We hope that it will inspire future efforts that will eventually enable the development of explainable EEG deep learning models that can contribute both to clinical care and novel medical research discoveries.

Diagnosing and tracking depression based on eye movement in response to virtual reality

Introduction

Depression is a prevalent mental illness that is primarily diagnosed using psychological and behavioral assessments. However, these assessments lack objective and quantitative indices, making rapid and objective detection challenging. In this study, we propose a novel method for depression detection based on eye movement data captured in response to virtual reality (VR).

Methods

Eye movement data was collected and used to establish high-performance classification and prediction models. Four machine learning algorithms, namely eXtreme Gradient Boosting (XGBoost), multilayer perceptron (MLP), Support Vector Machine (SVM), and Random Forest, were employed. The models were evaluated using five-fold cross-validation, and performance metrics including accuracy, precision, recall, area under the curve (AUC), and F1-score were assessed. The predicted error for the Patient Health Questionnaire-9 (PHQ-9) score was also determined.

Results

The XGBoost model achieved a mean accuracy of 76%, precision of 94%, recall of 73%, and AUC of 82%, with an F1-score of 78%. The MLP model achieved a classification accuracy of 86%, precision of 96%, recall of 91%, and AUC of 86%, with an F1-score of 92%. The predicted error for the PHQ-9 score ranged from -0.6 to 0.6.To investigate the role of computerized cognitive behavioral therapy (CCBT) in treating depression, participants were divided into intervention and control groups. The intervention group received CCBT, while the control group received no treatment. After five CCBT sessions, significant changes were observed in the eye movement indices of fixation and saccade, as well as in the PHQ-9 scores. These two indices played significant roles in the predictive model, indicating their potential as biomarkers for detecting depression symptoms.

Discussion

The results suggest that eye movement indices obtained using a VR eye tracker can serve as useful biomarkers for detecting depression symptoms. Specifically, the fixation and saccade indices showed promise in predicting depression. Furthermore, CCBT demonstrated effectiveness in treating depression, as evidenced by the observed changes in eye movement indices and PHQ-9 scores. In conclusion, this study presents a novel approach for depression detection using eye movement data captured in VR. The findings highlight the potential of eye movement indices as biomarkers and underscore the effectiveness of CCBT in treating depression.

Automated detection of depression using wavelet scattering networks

Today, depression is a common problem that affects many people all over the world. It can impact a person's mood and quality of life unless identified and treated immediately. Due to the hectic and stressful modern life seems to be, depression has become a leading cause of mental health illnesses. Signals from electroencephalograms (EEG) are frequently used to detect depression. It is difficult, time-consuming, and highly skilled to manually detect depression using EEG data analysis. Hence, in the proposed study, an automated depression detection system using EEG signals is proposed. The proposed study uses a clinically available dataset and dataset provided by the Department of Psychiatry at the Government Medical College (GMC) in Kozhikode, Kerala, India which consisted of 15 depressed patients and 15 healthy subjects and a publically available Multi-modal Open Dataset (MODMA) for Mental-disorder Analysis available at UK Data service reshare that consisted of 24 depressed patients and 29 healthy subjects. In this study, we have developed a novel Deep Wavelet Scattering Network (DWSN) for the automated detection of depression EEG signals. The best-performing classifier is then chosen by feeding the features into several machine-learning algorithms. For the clinically available GMC dataset, Medium Neural Network (MNN) achieved the highest accuracy of 99.95% with a Kappa value of 0.999. Using the suggested methods, the precision, recall, and F1-score are all 1. For the MODMA dataset, Wide Neural Network (WNN) achieved the highest accuracy of 99.3% with a Kappa value of 0.987. Using the suggested methods, the precision, recall, and F1-score are all 0.99. In comparison to all current methodologies, the performance of the suggested research is superior. The proposed method can be used to automatically diagnose depression both at home and in clinical settings.

Discriminative Power of Handwriting and Drawing Features in Depression

This study contributes knowledge on the detection of depression through handwriting/drawing features, to identify quantitative and noninvasive indicators of the disorder for implementing algorithms for its automatic detection. For this purpose, an original online approach was adopted to provide a dynamic evaluation of handwriting/drawing performance of healthy participants with no history of any psychiatric disorders ([Formula: see text]), and patients with a clinical diagnosis of depression ([Formula: see text]). Both groups were asked to complete seven tasks requiring either the writing or drawing on a paper while five handwriting/drawing features' categories (i.e. pressure on the paper, time, ductus, space among characters, and pen inclination) were recorded by using a digitalized tablet. The collected records were statistically analyzed. Results showed that, except for pressure, all the considered features, successfully discriminate between depressed and nondepressed subjects. In addition, it was observed that depression affects different writing/drawing functionalities. These findings suggest the adoption of writing/drawing tasks in the clinical practice as tools to support the current depression detection methods. This would have important repercussions on reducing the diagnostic times and treatment formulation.

SFTNet: A microexpression-based method for depression detection

BACKGROUND AND OBJECTIVES

Depression is a typical mental illness, and early screening can effectively prevent exacerbation of the condition. Many studies have found that the expressions of depressed patients are different from those of other subjects, and microexpressions have been used in the clinical detection of mental illness. However, there are few methods for the automatic detection of depression based on microexpressions.

METHODS

A new dataset of 156 participants (76 in the case group and 80 in the control group) was created. All data were collected in the context of a new emotional stimulation experiment and doctor-patient conversation. We first analyzed the Average Number of Occurrences (ANO) and Average Duration (AD) of facial expressions in the case group and the control group. Then, we proposed a two-stream model SFTNet for identifying depression based on microexpressions, which consists of a single-temporal network (STNet) and a full-temporal network (FTNet). STNet is used to extract features from facial images at a single time node, FTNet is used to extract features from all-time nodes, and the decision network combines the two features to identify depression through decision fusion. The code for SFTNet is available at https://github.com/muzixingyun/SFTNet.

RESULTS

We found that the AD of all subjects was less than 20 frames (2/3 seconds) and that the facial expressions of the control group were richer. SFTNet achieved excellent results on the emotional stimulus experimental dataset, with Accuracy, Precision and Recall of 0.873, 0.888 and 0.846, respectively. We also conducted experiments on the doctor-patient conversation dataset, and the Accuracy, Precision and Recall were 0.829, 0.817 and 0.837, respectively. SFTNet can also be applied to microexpression detection task with more accuracy than SOTA models.

CONCLUSIONS

In the emotional stimulation experiment, the subjects in the case group are more likely to show negative emotions. Compared to SOTA models, our depression detection method is more accurate and can assist doctors in the diagnosis of depression.

Recent Progress in Wearable Brain-Computer Interface (BCI) Devices Based on Electroencephalogram (EEG) for Medical Applications: A Review

Importance: Brain-computer interface (BCI) decodes and converts brain signals into machine instructions to interoperate with the external world. However, limited by the implantation risks of invasive BCIs and the operational complexity of conventional noninvasive BCIs, applications of BCIs are mainly used in laboratory or clinical environments, which are not conducive to the daily use of BCI devices. With the increasing demand for intelligent medical care, the development of wearable BCI systems is necessary. Highlights: Based on the scalp-electroencephalogram (EEG), forehead-EEG, and ear-EEG, the state-of-the-art wearable BCI devices for disease management and patient assistance are reviewed. This paper focuses on the EEG acquisition equipment of the novel wearable BCI devices and summarizes the development direction of wearable EEG-based BCI devices. Conclusions: BCI devices play an essential role in the medical field. This review briefly summarizes novel wearable EEG-based BCIs applied in the medical field and the latest progress in related technologies, emphasizing its potential to help doctors, patients, and caregivers better understand and utilize BCI devices.

Three-Stream Convolutional Neural Network for Depression Detection With Ocular Imaging

Depression is a prevalent and severe mental disorder that significantly affects both mind and body, leading to persistent feelings of sadness, despair, and impaired functionality. Diagnosis of depression primarily relies on clinical assessment and observation of symptoms. However, due to the lack of objective indicators, the experience and skills of doctor may lead to misdiagnosis. Current researches indicate that eye movement patterns and pupil dilation can serve as potential biomarkers for emotional and cognitive dysregulation in individuals with depression. However, most studies are based on manually extracted eye movement features, overlooking a significant portion of information available in ocular imaging. This paper proposes Three-Stream Convolutional Neural Network (TSCNN) for detecting depression, leveraging both spatio-temporal information of raw ocular imaging and paradigmatic semantic features. We suggest using optical flow with different sampling intervals to capture temporal features. In the third stream, we employ an encoder to learn semantic information from paradigm images and use it as prior knowledge. Finally, we utilize a fully connected network for classification, achieving an accuracy of 79.3% on our self-collected dataset. The proposed method may demonstrate significant clinical utility in the future.

Depression Identification Using EEG Signals via a Hybrid of LSTM and Spiking Neural Networks

Depression severity can be classified into distinct phases based on the Beck depression inventory (BDI) test scores, a subjective questionnaire. However, quantitative assessment of depression may be attained through the examination and categorization of electroencephalography (EEG) signals. Spiking neural networks (SNNs), as the third generation of neural networks, incorporate biologically realistic algorithms, making them ideal for mimicking internal brain activities while processing EEG signals. This study introduces a novel framework that for the first time, combines an SNN architecture and a long short-term memory (LSTM) structure to model the brain's underlying structures during different stages of depression and effectively classify individual depression levels using raw EEG signals. By employing a brain-inspired SNN model, our research provides fresh perspectives and advances knowledge of the neurological mechanisms underlying different levels of depression. The methodology employed in this study includes the utilization of the synaptic time dependent plasticity (STDP) learning rule within a 3-dimensional brain-template structured SNN model. Furthermore, it encompasses the tasks of classifying and predicting individual outcomes, visually representing the structural alterations in the brain linked to the anticipated outcomes, and offering interpretations of the findings. Notably, our method achieves exceptional accuracy in classification, with average rates of 98% and 96% for eyes-closed and eyes-open states, respectively. These results significantly outperform state-of-the-art deep learning methods.

The Three-Lead EEG Sensor: Introducing an EEG-Assisted Depression Diagnosis System Based on Ant Lion Optimization

For depression diagnosis, traditional methods such as interviews and clinical scales have been widely leveraged in the past few decades, but they are subjective, time-consuming, and labor-consuming. With the development of affective computing and Artificial Intelligence (AI) technologies, Electroencephalogram (EEG)-based depression detection methods have emerged. However, previous research has virtually neglected practical application scenarios, as most studies have focused on analyzing and modeling EEG data. Furthermore, EEG data is typically obtained from specialized devices that are large, complex to operate, and poorly ubiquitous. To address these challenges, a wearable three-lead EEG sensor with flexible electrodes was developed to obtain prefrontal-lobe EEG data. Experimental measurements show that the EEG sensor achieves promising performance (background noise of no more than 0.91 μVpp, Signal-to-Noise Ratio (SNR) of 26--48 dB, and electrode-skin contact impedance of less than 1 K Ω). In addition, EEG data from 70 depressed patients and 108 healthy controls were collected using the EEG sensor, and the linear and nonlinear features were extracted. The features were then weighted and selected using the Ant Lion Optimization (ALO) algorithm to improve classification performance. The experimental results show that the k-NN classifier achieves a classification accuracy of 90.70%, specificity of 96.53%, and sensitivity of 81.79%, indicating the promising potential of the three-lead EEG sensor combined with the ALO algorithm and the k-NN classifier for EEG-assisted depression diagnosis.

Spatial-Temporal EEG Fusion Based on Neural Network for Major Depressive Disorder Detection

In view of the major depressive disorder characteristics such as high mortality as well as high recurrence, it is important to explore an objective and effective detection method for major depressive disorder. Considering the advantages complementary of different machine learning algorithms in information mining process, as well as the fusion complementary of different information, in this study, the spatial-temporal electroencephalography fusion framework using neural network is proposed for major depressive disorder detection. Since electroencephalography is a typical time series signal, we introduce recurrent neural network embedded in long short-term memory unit for extract temporal domain features to solve the problem of long-distance information dependence. To reduce the volume conductor effect, the temporal electroencephalography data are mapping into a spatial brain functional network using phase lag index, then the spatial domain features were extracted from brain functional network using 2D convolutional neural networks. Considering the complementarity between different types of features, the spatial-temporal electroencephalography features are fused to achieve data diversity. The experimental results show that spatial-temporal features fusion can improve the detection accuracy of major depressive disorder with a highest of 96.33%. In addition, our research also found that theta, alpha, and full frequency band in brain regions of left frontal, left central, right temporal are closely related to MDD detection, especially theta frequency band in left frontal region. Only using single-dimension EEG data as decision basis, it is difficult to fully explore the valuable information hidden in the data, which affects the overall detection performance of MDD. Meanwhile, different algorithms have their own advantages for different application scenarios. Ideally, different algorithms should use their respective advantages to jointly address complex problems in engineering fields. To this end, we propose a computer-aided MDD detection framework based on spatial-temporal EEG fusion using neural network, as shown in Fig. 1. The simplified process is as follows: (1) Raw EEG data acquisition and preprocessing. (2) The time series EEG data of each channel are input as recurrent neural network (RNN), and RNN is used to process and extract temporal domain (TD) features. (3) The BFN among different EEG channels is constructed, and CNN is used to process and extract the spatial domain (SD) features of the BFN. (4) Based on the theory of information complementarity, the spatial-temporal information is fused to realize efficient MDD detection. Fig. 1 MDD detection framework based on spatial-temporal EEG fusion.

A systematic review on automated clinical depression diagnosis

Assessing mental health disorders and determining treatment can be difficult for a number of reasons, including access to healthcare providers. Assessments and treatments may not be continuous and can be limited by the unpredictable nature of psychiatric symptoms. Machine-learning models using data collected in a clinical setting can improve diagnosis and treatment. Studies have used speech, text, and facial expression analysis to identify depression. Still, more research is needed to address challenges such as the need for multimodality machine-learning models for clinical use. We conducted a review of studies from the past decade that utilized speech, text, and facial expression analysis to detect depression, as defined by the Diagnostic and Statistical Manual of Mental Disorders (DSM-5), using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guideline. We provide information on the number of participants, techniques used to assess clinical outcomes, speech-eliciting tasks, machine-learning algorithms, metrics, and other important discoveries for each study. A total of 544 studies were examined, 264 of which satisfied the inclusion criteria. A database has been created containing the query results and a summary of how different features are used to detect depression. While machine learning shows its potential to enhance mental health disorder evaluations, some obstacles must be overcome, especially the requirement for more transparent machine-learning models for clinical purposes. Considering the variety of datasets, feature extraction techniques, and metrics used in this field, guidelines have been provided to collect data and train machine-learning models to guarantee reproducibility and generalizability across different contexts.

Multi-View Graph Contrastive Learning via Adaptive Channel Optimization for Depression Detection in EEG Signals

Automated detection of depression using Electroencephalogram (EEG) signals has become a promising application in advanced bioinformatics technology. Although current methods have achieved high detection performance, several challenges still need to be addressed: (1) Previous studies do not consider data redundancy when modeling multi-channel EEG signals, resulting in some unrecognized noise channels remaining. (2) Most works focus on the functional connection of EEG signals, ignoring their spatial proximity. The spatial topological structure of EEG signals has not been fully utilized to capture more fine-grained features. (3) Prior depression detection models fail to provide interpretability. To address these challenges, this paper proposes a new model, Multi-view Graph Contrastive Learning via Adaptive Channel Optimization (MGCL-ACO) for depression detection in EEG signals. Specifically, the proposed model first selects the critical channels by maximizing the mutual information between tracks and labels of EEG signals to eliminate data redundancy. Then, the MGCL-ACO model builds two similarity metric views based on functional connectivity and spatial proximity. MGCL-ACO constructs the feature extraction module by graph convolutions and contrastive learning to capture more fine-grained features of different perspectives. Finally, our model provides interpretability by visualizing a brain map related to the significance scores of the selected channels. Extensive experiments have been performed on public datasets, and the results show that our proposed model outperforms the most advanced baselines. Our proposed model not only provides a promising approach for automated depression detection using optimal EEG signals but also has the potential to improve the accuracy and interpretability of depression diagnosis in clinical practice.

A review of emergent intelligent systems for the detection of Parkinson's disease

Parkinson's disease (PD) is a neurodegenerative disorder affecting people worldwide. The PD symptoms are divided into motor and non-motor symptoms. Detection of PD is very crucial and essential. Such challenges can be overcome by applying artificial intelligence to diagnose PD. Many studies have also proposed the implementation of computer-aided diagnosis for the detection of PD. This systematic review comprehensively analyzed all appropriate algorithms for detecting and assessing PD based on the literature from 2012 to 2023 which are conducted as per PRISMA model. This review focused on motor symptoms, namely handwriting dynamics, voice impairments and gait, multimodal features, and brain observation using single photon emission computed tomography, magnetic resonance and electroencephalogram signals. The significant challenges are critically analyzed, and appropriate recommendations are provided. The critical discussion of this review article can be helpful in today's PD community in such a way that it allows clinicians to provide proper treatment and timely medication.

Technical and clinical considerations for electroencephalography-based biomarkers for major depressive disorder

Major depressive disorder (MDD) is a prevalent and debilitating psychiatric disease that leads to substantial loss of quality of life. There has been little progress in developing new MDD therapeutics due to a poor understanding of disease heterogeneity and individuals' responses to treatments. Electroencephalography (EEG) is poised to improve this, owing to the ease of large-scale data collection and the advancement of computational methods to address artifacts. This review summarizes the viability of EEG for developing brain-based biomarkers in MDD. We examine the properties of well-established EEG preprocessing pipelines and consider factors leading to the discovery of sensitive and reliable biomarkers.

Frequency-Dependent Microstate Characteristics for Mild Cognitive Impairment in Parkinson's Disease

Cognitive impairment is typically reflected in the time and frequency variations of electroencephalography (EEG). Integrating time-domain and frequency-domain analysis methods is essential to better understand and assess cognitive ability. Timely identification of cognitive levels in early Parkinson's disease (ePD) patients can help mitigate the risk of future dementia. For the investigation of the brain activity and states related to cognitive levels, this study recruited forty ePD patients for EEG microstate analysis, including 13 with mild cognitive impairment (MCI) and 27 without MCI (control group). To determine the specific frequency band on which the microstate analysis relies, a deep learning framework was employed to discern the frequency dependence of the cognitive level in ePD patients. The input to the convolutional neural network consisted of the power spectral density of multi-channel multi-point EEG signals. The visualization technique of gradient-weighted class activation mapping was utilized to extract the optimal frequency band for identifying MCI samples. Within this frequency band, microstate analysis was conducted and correlated with the Montreal Cognitive Assessment (MoCA) Scale. The deep neural network revealed significant differences in the 1-11.5Hz spectrum of the ePD-MCI group compared to the control group. In this characteristic frequency band, ePD-MCI patients exhibited a pattern of global microstate disorder. The coverage rate and occurrence frequency of microstate A and D increased significantly and were both negatively correlated with the MoCA scale. Meanwhile, the coverage, frequency and duration of microstate C decreased significantly and were positively correlated with the MoCA scale. Our work unveils abnormal microstate characteristics in ePD-MCI based on time-frequency fusion, enhancing our understanding of cognitively related brain dynamics and providing electrophysiological markers for ePD-MCI recognition.