Graph analysis of functional brain network topology using minimum spanning tree in driver drowsiness

From Micro to Meso: A Data-Driven Mesoscopic Region Division Method Based on Functional Connectivity for EEG-Based Driver Fatigue Detection

The integration of EEG signals and deep learning methods is emerging as an effective approach for brain fatigue detection, particularly utilizing Graph Neural Networks(GNNs) that excel in capturing complex electrode relationships. A significant challenge within GNNs is the construction of an effective adjacency matrix that enhances spatial information learning. Concurrently, electrode aggregation in EEG has emerged as a pivotal area of research. However, conventional partitioning methods depend on task-specific prior knowledge, limiting their generalizability across diverse tasks. To Address this issue, we propose a novel mesoscopic region division approach for EEG-based driver fatigue detection, leveraging inherent data characteristics and functional connectivity-based GNN. This method adopts a two-stage approach: initially, micro-electrodes exhibiting similar functional connectivity relationships are grouped as "mesoscopic region"; subsequently, all micro-electrodes in the same group are aggregated into virtual meso-electrodes, and the fatigue state classification is subsequently based on the functional connectivity between them. Applied to a public driver fatigue detection dataset, our approach surpasses existing state-of-the-art methods in performance. Additionally, interpretive analysis provides micro and mesoscopic insights into brain regions and neuronal connections associated with alert and fatigued states.

Fatigue Characterization of EEG Brain Networks Under Mixed Reality Stereo Vision

Mixed Reality (MR) technology possesses profound and extensive potential across a multitude of domains, including, but not limited to industry, healthcare, and education. However, prolonged use of MR devices to watch stereoscopic content may lead to visual fatigue. Since visual fatigue involves multiple brain regions, our study aims to explore the topological characteristics of brain networks derived from electroencephalogram (EEG) data. Because the Phase-Locked Value (PLV) is capable of effectively measuring the phase synchronization relationship between brain regions, it was calculated between all pairs of channels in both comfort and fatigue states. Subsequently, a sparse brain network was constructed based on PLV by applying an appropriate threshold. The node properties (betweenness centrality, clustering coefficient, node efficiency) and edge properties (characteristic path length) were calculated based on the corresponding brain network within specific frequency bands for both comfort and fatigue states. In analyzing the PLV of brain connectivity in comfort and fatigue states, a notable enhancement in brain connectivity is observed within the alpha, theta, and delta frequency bands during fatigue status. By analyzing the node and edge properties of brain networks, it is evident that the mean values of these properties in the fatigue state were higher than those in the comfort state. By analyzing the node and edge properties at a local level, the average difference in betweenness centrality, clustering coefficients, and nodal efficiency across the three EEG frequency bands was computed to find significant brain regions. The main findings are as follows: Betweenness centrality primarily differs in frontal and parietal regions, with minor involvement in temporal and central regions. The clustering Coefficient mainly varies in the frontal region, with slight differences being seen in the temporal and occipital regions. Nodal efficiency primarily varies in the frontal, temporal, and central regions, with minor differences being seen in the parietal and occipital regions. Edge property analysis indicates that there is a higher occurrence of long-distance connections among brain regions during the fatigue state, which reflects a loss of synaptic transmission efficiency on a global level. Our study plays a crucial role in understanding the neural mechanisms underlying visual fatigue, potentially providing insights that could be applied to high-demand cognitive fields where prolonged use of MR devices leads to visual fatigue.

EEG Functional Connectivity Analysis for the Study of the Brain Maturation in the First Year of Life

Brain networks are hypothesized to undergo significant changes over development, particularly during infancy. Thus, the aim of this study is to evaluate brain maturation in the first year of life in terms of electrophysiological (EEG) functional connectivity (FC). Whole-brain FC metrics (i.e., magnitude-squared coherence, phase lag index, and parameters derived from graph theory) were extracted, for multiple frequency bands, from baseline EEG data recorded from 146 typically developing infants at 6 (T6) and 12 (T12) months of age. Generalized linear mixed models were used to test for significant differences in the computed metrics considering time point and sex as fixed effects. Correlational analyses were performed to ascertain the potential relationship between FC and subjects' cognitive and language level, assessed with the Bayley-III scale at 24 (T24) months of age. The results obtained highlighted an increased FC, for all the analyzed frequency bands, at T12 with respect to T6. Correlational analyses yielded evidence of the relationship between FC metrics at T12 and cognition. Despite some limitations, our study represents one of the first attempts to evaluate brain network evolution during the first year of life while accounting for correspondence between functional maturation and cognitive improvement.

Utilizing EEG and fNIRS for the detection of sleep-deprivation-induced fatigue and its inhibition using colored light stimulation

Drowsy driving is a common, but underestimated phenomenon in terms of associated risks as it often results in crashes causing fatalities and serious injuries. It is a challenging task to alert or reduce the driver's drowsy state using non-invasive techniques. In this study, a drowsiness reduction strategy has been developed and analyzed using exposure to different light colors and recording the corresponding electrical and biological brain activities. 31 subjects were examined by dividing them into 2 classes, a control group, and a healthy group. Fourteen EEG and 42 fNIRS channels were used to gather neurological data from two brain regions (prefrontal and visual cortices). Experiments shining 3 different colored lights have been carried out on them at certain times when there is a high probability to get drowsy. The results of this study show that there is a significant increase in HbO of a sleep-deprived participant when he is exposed to blue light. Similarly, the beta band of EEG also showed an increased response. However, the study found that there is no considerable increase in HbO and beta band power in the case of red and green light exposures. In addition to that, values of other physiological signals acquired such as heart rate, eye blinking, and self-reported Karolinska Sleepiness Scale scores validated the findings predicted by the electrical and biological signals. The statistical significance of the signals achieved has been tested using repeated measures ANOVA and t-tests. Correlation scores were also calculated to find the association between the changes in the data signals with the corresponding changes in the alertness level.

Fusion Graph Representation of EEG for Emotion Recognition

Various relations existing in Electroencephalogram (EEG) data are significant for EEG feature representation. Thus, studies on the graph-based method focus on extracting relevancy between EEG channels. The shortcoming of existing graph studies is that they only consider a single relationship of EEG electrodes, which results an incomprehensive representation of EEG data and relatively low accuracy of emotion recognition. In this paper, we propose a fusion graph convolutional network (FGCN) to extract various relations existing in EEG data and fuse these extracted relations to represent EEG data more comprehensively for emotion recognition. First, the FGCN mines brain connection features on topology, causality, and function. Then, we propose a local fusion strategy to fuse these three graphs to fully utilize the valuable channels with strong topological, causal, and functional relations. Finally, the graph convolutional neural network is adopted to represent EEG data for emotion recognition better. Experiments on SEED and SEED-IV demonstrate that fusing different relation graphs are effective for improving the ability in emotion recognition. Furthermore, the emotion recognition accuracy of 3-class and 4-class is higher than that of other state-of-the-art methods.

Directed Brain Network Analysis for Fatigue Driving Based on EEG Source Signals

Fatigue driving is one of the major factors that leads to traffic accidents. Long-term monotonous driving can easily cause a decrease in the driver's attention and vigilance, manifesting a fatigue effect. This paper proposes a means of revealing the effects of driving fatigue on the brain's information processing abilities, from the aspect of a directed brain network based on electroencephalogram (EEG) source signals. Based on current source density (CSD) data derived from EEG signals using source analysis, a directed brain network for fatigue driving was constructed by using a directed transfer function. As driving time increased, the average clustering coefficient as well as the average path length gradually increased; meanwhile, global efficiency gradually decreased for most rhythms, suggesting that deep driving fatigue enhances the brain's local information integration abilities while weakening its global abilities. Furthermore, causal flow analysis showed electrodes with significant differences between the awake state and the driving fatigue state, which were mainly distributed in several areas of the anterior and posterior regions, especially under the theta rhythm. It was also found that the ability of the anterior regions to receive information from the posterior regions became significantly worse in the driving fatigue state. These findings may provide a theoretical basis for revealing the underlying neural mechanisms of driving fatigue.

Effect of Shift Work on Cognitive Function in Chinese Coal Mine Workers: A Resting-State fNIRS Study

Aim: Pilot study to examine the impact of shift work on cognitive function in Chinese coal mine workers. Background: Shift work is commonly used in modern industries such as the coal industry, and there is growing concern over the impact that shift work has on miners’ work performance and personal well-being. Method: A total of 54 miners working three shifts (17 in morning shift, 18 in afternoon, and 19 in night shift) participated in this exploratory study. A resting-state fNIRS functional connectivity method was conducted to assess the cognitive ability before and after the work shift. Results: Results showed significant differences in cognitive ability between before and after the work shifts among the three-shift workers. The brain functional connectivity was reduced ranking as the night, afternoon, and morning shifts. Decreased brain functional connectivity at the end of the working shift was found compared with before in the morning and afternoon shifts. Opposite results were obtained during the night shift. The resting-state functional brain networks in the prefrontal cortex of all groups exhibited small-world properties. Significant differences in betweenness centrality and nodal local efficiency were found in the prefrontal cortex in the morning and night shifts. Conclusions: The current findings provide new insights regarding the effect of shift work on the cognitive ability of Chinese coal mine workers from the view of brain science.

EEG-based brain functional connectivity representation using amplitude locking value for fatigue-driving recognition

It has been shown that brain functional networks constructed from electroencephalographic signals (EEG) continuously change topology as brain fatigue increases, and extracting the topological properties of the network can characterize the degree of brain fatigue. However, the traditional brain function network construction process often selects only the amplitude or phase components of the signal to measure the relationship between brain regions, and the use of a single component of the signal to construct a brain function network for analysis is rather one-sided. Therefore, we propose a method of functional synchronization analysis of brain regions. This method takes the EEG signal based on empirical modal decomposition (EMD) to obtain multiple intrinsic modal components (IMF) and inputs them into the Hilbert transform to obtain the instantaneous amplitude, and then calculates the amplitude locking value (ALV) to measure the synchronization relationship between all pairs of channels. The topological properties of the brain functional network are extracted to classify awake and fatigue states. The brain functional network is constructed based on the adjacency matrix of each waveform obtained from the ALV between all pairs of channels to realize the synchronization analysis between brain regions. Moreover, we achieved a satisfactory classification accuracy (82.84%) using the discriminative connection features in the Alpha band. In this study, we analyzed the functional network of ALV brain in fatigue and awake state, and the results showed that the connections between brain regions in fatigue state were significantly increased, and the connections between brain regions in the awake state were significantly decreased, and the information interaction between brain regions was more orderly and efficient.

Global and localized network characteristics of the resting brain predict and adapt to foreign language learning in older adults

Resting brain (rs) activity has been shown to be a reliable predictor of the level of foreign language (L2) proficiency younger adults can achieve in a given time-period. Since rs properties change over the lifespan, we investigated whether L2 attainment in older adults (aged 64-74 years) is also predicted by individual differences in rs activity, and to what extent rs activity itself changes as a function of L2 proficiency. To assess how neuronal assemblies communicate at specific frequencies to facilitate L2 development, we examined localized and global measures (Minimum Spanning Trees) of connectivity. Results showed that central organization within the beta band (~ 13-29.5 Hz) predicted measures of L2 complexity, fluency and accuracy, with the latter additionally predicted by a left-lateralized centro-parietal beta network. In contrast, reduced connectivity in a right-lateralized alpha (~ 7.5-12.5 Hz) network predicted development of L2 complexity. As accuracy improved, so did central organization in beta, whereas fluency improvements were reflected in localized changes within an interhemispheric beta network. Our findings highlight the importance of global and localized network efficiency and the role of beta oscillations for L2 learning and suggest plasticity even in the ageing brain. We interpret the findings against the background of networks identified in socio-cognitive processes.

A survey of brain network analysis by electroencephalographic signals

Brain network analysis is one efficient tool in exploring human brain diseases and can differentiate the alterations from comparative networks. The alterations account for time, mental states, tasks, individuals, and so forth. Furthermore, the changes determine the segregation and integration of functional networks that lead to network reorganization (or reconfiguration) to extend the neuroplasticity of the brain. Exploring related brain networks should be of interest that may provide roadmaps for brain research and clinical diagnosis. Recent electroencephalogram (EEG) studies have revealed the secrets of the brain networks and diseases (or disorders) within and between subjects and have provided instructive and promising suggestions and methods. This review summarized the corresponding algorithms that had been used to construct functional or effective networks on the scalp and cerebral cortex. We reviewed EEG network analysis that unveils more cognitive functions and neural disorders of the human and then explored the relationship between brain science and artificial intelligence which may fuel each other to accelerate their advances, and also discussed some innovations and future challenges in the end.

Complex networks and deep learning for EEG signal analysis

Electroencephalogram (EEG) signals acquired from brain can provide an effective representation of the human's physiological and pathological states. Up to now, much work has been conducted to study and analyze the EEG signals, aiming at spying the current states or the evolution characteristics of the complex brain system. Considering the complex interactions between different structural and functional brain regions, brain network has received a lot of attention and has made great progress in brain mechanism research. In addition, characterized by autonomous, multi-layer and diversified feature extraction, deep learning has provided an effective and feasible solution for solving complex classification problems in many fields, including brain state research. Both of them show strong ability in EEG signal analysis, but the combination of these two theories to solve the difficult classification problems based on EEG signals is still in its infancy. We here review the application of these two theories in EEG signal research, mainly involving brain-computer interface, neurological disorders and cognitive analysis. Furthermore, we also develop a framework combining recurrence plots and convolutional neural network to achieve fatigue driving recognition. The results demonstrate that complex networks and deep learning can effectively implement functional complementarity for better feature extraction and classification, especially in EEG signal analysis.

A Review of EEG Signal Features and their Application in Driver Drowsiness Detection Systems

Detecting drowsiness in drivers, especially multi-level drowsiness, is a difficult problem that is often approached using neurophysiological signals as the basis for building a reliable system. In this context, electroencephalogram (EEG) signals are the most important source of data to achieve successful detection. In this paper, we first review EEG signal features used in the literature for a variety of tasks, then we focus on reviewing the applications of EEG features and deep learning approaches in driver drowsiness detection, and finally we discuss the open challenges and opportunities in improving driver drowsiness detection based on EEG. We show that the number of studies on driver drowsiness detection systems has increased in recent years and that future systems need to consider the wide variety of EEG signal features and deep learning approaches to increase the accuracy of detection.

A dynamic center and multi threshold point based stable feature extraction network for driver fatigue detection utilizing EEG signals

Driver fatigue is the one of the main reasons of the traffic accidents. The human brain is a complex structure, whose function can be evaluated with electroencephalogram (EEG). Automated driver fatigue detection utilizing EEG decreases the incidence probability of related traffic accidents. Therefore, devising an appropriate feature extraction technique and selecting a competent classification method can be considered as the crucial part of the effective driver fatigue detection. Therefore, in this study, an EEG-based intelligent system was devised for driver fatigue detection. The proposed framework includes a new feature generation network, which is implemented by using texture descriptors, for fatigue detection. The proposed scheme contains pre-processing, feature generation, informative features selection and classification with shallow classifiers phases. In the pre-processing, discrete cosine transform and fast Fourier transform are used together. Moreover, dynamic center based binary pattern and multi threshold ternary pattern are utilized together to create a new feature generation network. To improve the detection performance, we utilized discrete wavelet transform as a pooling method, in which the functional brain network-based feature describing the relationship between fatigue and brain network organization. In the feature selection phase, a hybrid three layered feature selection method is presented, and benchmark classifiers are used in the classification phase to demonstrate the strength of the proposed method. In the experiments, the proposed framework achieved 97.29% classification accuracy for fatigue detection using EEG signals. This result reveals that the proposed framework can be utilized effectively for driver fatigue detection.

Mental Fatigue Has Great Impact on the Fractal Dimension of Brain Functional Network

Mental fatigue has serious negative impacts on the brain cognitive functions and has been widely explored by the means of brain functional networks with the neuroimaging technique of electroencephalogram (EEG). Recently, several researchers reported that brain functional network constructed from EEG signals has fractal feature, raising an important question: what are the effects of mental fatigue on the fractal dimension of brain functional network? In the present study, the EEG data of alpha1 rhythm (8-10 Hz) at task state obtained by a mental fatigue model were chosen to construct brain functional networks. A modified greedy colouring algorithm was proposed for fractal dimension calculation in both binary and weighted brain functional networks. The results indicate that brain functional networks still maintain fractal structures even when the brain is at fatigue state; fractal dimension presented an increasing trend along with the deepening of mental fatigue fractal dimension of the weighted network was more sensitive to mental fatigue than that of binary network. Our current results suggested that mental fatigue has great regular impacts on the fractal dimension in both binary and weighted brain functional networks.

The impact of mental fatigue on brain activity: a comparative study both in resting state and task state using EEG

BACKGROUND

Mental fatigue is usually caused by long-term cognitive activities, mainly manifested as drowsiness, difficulty in concentrating, decreased alertness, disordered thinking, slow reaction, lethargy, reduced work efficiency, error-prone and so on. Mental fatigue has become a widespread sub-health condition, and has a serious impact on the cognitive function of the brain. However, seldom studies investigate the differences of mental fatigue on electrophysiological activity both in resting state and task state at the same time. Here, twenty healthy male participants were recruited to do a consecutive mental arithmetic tasks for mental fatigue induction, and electroencephalogram (EEG) data were collected before and after each tasks. The power and relative power of five EEG rhythms both in resting state and task state were analyzed statistically.

RESULTS

The results of brain topographies and statistical analysis indicated that mental arithmetic task can successfully induce mental fatigue in the enrolled subjects. The relative power index was more sensitive than the power index in response to mental fatigue, and the relative power for assessing mental fatigue was better in resting state than in task state. Furthermore, we found that it is of great physiological significance to divide alpha frequency band into alpha1 band and alpha2 band in fatigue related studies, and at the same time improve the statistical differences of sub-bands.

CONCLUSIONS

Our current results suggested that the brain activity in mental fatigue state has great differences in resting state and task state, and it is imperative to select the appropriate state in EEG data acquisition and divide alpha band into alpha1 and alpha2 bands in mental fatigue related researches.

Automatic Detection of Epileptic Seizures in EEG Using Sparse CSP and Fisher Linear Discrimination Analysis Algorithm

In order to realize the automatic epileptic seizure detection, feature extraction and classification of electroencephalogram (EEG) signals are performed on the interictal, the pre-ictal, and the ictal status of epilepsy patients. There is no effective strategy for selecting the number of channels and spatial filters in feature extraction of multichannel EEG data. Therefore, this paper combined sparse idea and greedy search algorithm to improve the feature extraction of common space pattern. The feature extraction can effectively overcome the repeating selection problem of feature pattern in the eigenvector space by the traditional method. Then we used the Fisher linear discriminant analysis to realize the classification. The results show that the proposed method can get high classification accuracy using fewer data. For 10 subjects, the averaged accuracy of epilepsy detection is more than 99%. So, the detection of an epileptic seizure based on sparse features using Fisher linear discriminant analysis classifiers is more suitable for a reliable, automatic epileptic seizure detection system to enhance the patient's care and the quality of life.

A recurrence network-based convolutional neural network for fatigue driving detection from EEG

Driver fatigue is an important cause of traffic accidents, which has triggered great concern for detecting drivers' fatigue. Numerous methods have been proposed to fulfill this challenging task, including feature methods and machine learning methods. Recently, with the development of deep learning techniques, many studies achieved better results than traditional feature methods, and the combination of traditional methods and deep learning techniques gradually received attention. In this paper, we propose a recurrence network-based convolutional neural network (RN-CNN) method to detect fatigue driving. To be specific, we first conduct a simulated driving experiment to collect electroencephalogram (EEG) signals of subjects under alert state and fatigue state. Then, we construct the multiplex recurrence network (RN) from EEG signals to fuse information from the original time series. Finally, CNN is employed to extract and learn the features of a multiplex RN for realizing a classification task. The results indicate that the proposed RN-CNN method can achieve an average accuracy of 92.95%. To verify the effectiveness of our method, some existing competitive methods are compared with ours. The results show that our method outperforms the existing methods, which demonstrate the effect of the RN-CNN method.

A cognitive brain-computer interface monitoring sustained attentional variations during a continuous task

We introduce a cognitive brain–computer interface based on a continuous performance task for the monitoring of variations of visual sustained attention, i.e. the self-directed maintenance of cognitive focus in non-arousing conditions while possibly ignoring distractors and avoiding mind wandering. We introduce a visual sustained attention continuous performance task with three levels of task difficulty. Pairwise discrimination of these task difficulties from electroencephalographic features was performed using a leave-one-subject-out cross validation approach. Features were selected using the orthogonal forward regression supervised feature selection method. Cognitive load was best predicted using a combination of prefrontal theta power, broad spatial range gamma power, fronto-central beta power, and fronto-central alpha power. Generalization performance estimates for pairwise classification of task difficulty using these features reached 75% for 5 s epochs, and 85% for 30 s epochs.