On the role of generative artificial intelligence in the development of brain-computer interfaces

Since their inception more than 50 years ago, Brain-Computer Interfaces (BCIs) have held promise to compensate for functions lost by people with disabilities through allowing direct communication between the brain and external devices. While research throughout the past decades has demonstrated the feasibility of BCI to act as a successful assistive technology, the widespread use of BCI outside the lab is still beyond reach. This can be attributed to a number of challenges that need to be addressed for BCI to be of practical use including limited data availability, limited temporal and spatial resolutions of brain signals recorded non-invasively and inter-subject variability. In addition, for a very long time, BCI development has been mainly confined to specific simple brain patterns, while developing other BCI applications relying on complex brain patterns has been proven infeasible. Generative Artificial Intelligence (GAI) has recently emerged as an artificial intelligence domain in which trained models can be used to generate new data with properties resembling that of available data. Given the enhancements observed in other domains that possess similar challenges to BCI development, GAI has been recently employed in a multitude of BCI development applications to generate synthetic brain activity; thereby, augmenting the recorded brain activity. Here, a brief review of the recent adoption of GAI techniques to overcome the aforementioned BCI challenges is provided demonstrating the enhancements achieved using GAI techniques in augmenting limited EEG data, enhancing the spatiotemporal resolution of recorded EEG data, enhancing cross-subject performance of BCI systems and implementing end-to-end BCI applications. GAI could represent the means by which BCI would be transformed into a prevalent assistive technology, thereby improving the quality of life of people with disabilities, and helping in adopting BCI as an emerging human-computer interaction technology for general use.

BCI-controlled wheelchairs: end-users' perceptions, needs, and expectations, an interview-based study

PURPOSE

Brain-computer interface (BCI)-controlled wheelchairs have the potential to improve the independence of people with mobility impairments. The low uptake of BCI devices has been linked to a lack of knowledge among researchers of the needs of end-users that should influence BCI development.

MATERIALS AND METHODS

This study used semi-structured interviews to learn about the perceptions, needs, and expectations of spinal cord injury (SCI) patients with regards to a BCI-controlled wheelchair. Topics discussed in the interview include: paradigms, shared control, safety, robustness, channel selection, hardware, and experimental design. The interviews were recorded and then transcribed. Analysis was carried out using coding based on grounded theory principles.

RESULTS

The majority of participants had a positive view of BCI-controlled wheelchair technology and were willing to use the technology. Core issues were raised regarding safety, cost and aesthetics. Interview discussions were linked to state-of-the-art BCI technology. The results challenge the current reliance of researchers on the motor-imagery paradigm by suggesting end-users expect highly intuitive paradigms. There also needs to be a stronger focus on obstacle avoidance and safety features in BCI wheelchairs. Finally, the development of control approaches that can be personalized for individual users may be instrumental for widespread adoption of these devices.

CONCLUSIONS

This study, based on interviews with SCI patients, indicates that BCI-controlled wheelchairs are a promising assistive technology that would be well received by end-users. Recommendations for a more person-centered design of BCI controlled wheelchairs are made and clear avenues for future research are identified.

A robust multi-branch multi-attention-mechanism EEGNet for motor imagery BCI decoding

BACKGROUND

Motor-Imagery-based Brain-Computer Interface (MI-BCI) is a promising technology to assist communication, movement, and neurological rehabilitation for motor-impaired individuals. Electroencephalography (EEG) decoding techniques using deep learning (DL) possess noteworthy advantages due to automatic feature extraction and end-to-end learning. However, the DL-based EEG decoding models tend to show large variations due to intersubject variability of EEG, which results from inconsistencies of different subjects' optimal hyperparameters.

NEW METHODS

This study proposes a multi-branch multi-attention mechanism EEGNet model (MBMANet) for robust decoding. It applies the multi-branch EEGNet structure to achieve various feature extractions. Further, the different attention mechanisms introduced in each branch attain diverse adaptive weight adjustments. This combination of multi-branch and multi-attention mechanisms allows for multi-level feature fusion to provide robust decoding for different subjects.

RESULTS

The MBMANet model has a four-classification accuracy of 83.18% and kappa of 0.776 on the BCI Competition IV-2a dataset, which outperforms other eight CNN-based decoding models. This consistently satisfactory performance across all nine subjects indicates that the proposed model is robust.

CONCLUSIONS

The combine of multi-branch and multi-attention mechanisms empowers the DL-based models to adaptively learn different EEG features, which provides a feasible solution for dealing with data variability. It also gives the MBMANet model more accurate decoding of motion intentions and lower training costs, thus improving the MI-BCI's utility and robustness.

[A review on electroencephalogram based channel selection]

The electroencephalogram (EEG) signal is the key signal carrier of the brain-computer interface (BCI) system. The EEG data collected by the whole-brain electrode arrangement is conducive to obtaining higher information representation. Personalized electrode layout, while ensuring the accuracy of EEG signal decoding, can also shorten the calibration time of BCI and has become an important research direction. This paper reviews the EEG signal channel selection methods in recent years, conducts a comparative analysis of the combined effects of different channel selection methods and different classification algorithms, obtains the commonly used channel combinations in motor imagery, P300 and other paradigms in BCI, and explains the application scenarios of the channel selection method in different paradigms are discussed, in order to provide stronger support for a more accurate and portable BCI system.

Fatigue in children using motor imagery and P300 brain-computer interfaces

BACKGROUND

Brain-computer interface (BCI) technology offers children with quadriplegic cerebral palsy unique opportunities for communication, environmental exploration, learning, and game play. Research in adults demonstrates a negative impact of fatigue on BCI enjoyment, while effects on BCI performance are variable. To date, there have been no pediatric studies of BCI fatigue. The purpose of this study was to assess the effects of two different BCI paradigms, motor imagery and visual P300, on the development of self-reported fatigue and an electroencephalography (EEG) biomarker of fatigue in typically developing children.

METHODS

Thirty-seven typically-developing school-aged children were recruited to a prospective, crossover study. Participants attended three sessions: (A) motor imagery-BCI, (B) visual P300-BCI, and (C) video viewing (control). The motor imagery task involved an imagined left- or right-hand squeeze. The P300 task involved attending to one square on a 3 × 3 grid during a random single flash sequence. Each paradigm had respective calibration periods and a similar visual counting game. Primary outcomes were self-reported fatigue and the power of the EEG alpha band both collected during resting-state periods pre- and post-task. Self-reported fatigue was measured using a 10-point visual analog scale. EEG alpha band power was calculated as the integrated power spectral density from 8 to 12 Hz of the EEG spectrum.

RESULTS

Thirty-two children completed the protocol (age range 7-16, 63% female). Self-reported fatigue and EEG alpha band power increased across all sessions (F(1,155) = 33.9, p < 0.001; F = 5.0(1,149), p = 0.027 respectively). No differences in fatigue development were observed between session types. There was no correlation between self-reported fatigue and EEG alpha band power change. BCI performance varied between participants and paradigms as expected but was not associated with self-reported fatigue or EEG alpha band power.

CONCLUSION

Short periods (30-mintues) of BCI use can increase self-reported fatigue and EEG alpha band power to a similar degree in children performing motor imagery and P300 BCI paradigms. Performance was not associated with our measures of fatigue; the impact of fatigue on useability and enjoyment is unclear. Our results reflect the variability of fatigue and the BCI experience more broadly in children and warrant further investigation.

Ethical Considerations of Neuralink and Brain-Computer Interfaces

Neuralink is a neurotechnology company founded by Elon Musk in 2016, which has been quietly developing revolutionary technology allowing for ultra-high precision bidirectional communication between external devices and the brain. In this paper, we explore the multifaceted ethical considerations surrounding neural interfaces, analyzing potential societal impacts, risks, and call for a need for responsible innovation. Despite the technological, medical, medicolegal, and ethical challenges ahead, neural interface technology remains extremely promising and has the potential to create a new era of medicine.

Ethical issues raised by incorporating personalized language models into brain-computer interface communication technologies: a qualitative study of individuals with neurological disease

PURPOSE

To examine the views of individuals with neurodegenerative diseases about ethical issues related to incorporating personalized language models into brain-computer interface (BCI) communication technologies.

METHODS

Fifteen semi-structured interviews and 51 online free response surveys were completed with individuals diagnosed with neurodegenerative disease that could lead to loss of speech and motor skills. Each participant responded to questions after six hypothetical ethics vignettes were presented that address the possibility of building language models with personal words and phrases in BCI communication technologies. Data were analyzed with consensus coding, using modified grounded theory.

RESULTS

Four themes were identified. (1) The experience of a neurodegenerative disease shapes preferences for personalized language models. (2) An individual's identity will be affected by the ability to personalize the language model. (3) The motivation for personalization is tied to how relationships can be helped or harmed. (4) Privacy is important to people who may need BCI communication technologies. Responses suggest that the inclusion of personal lexica raises ethical issues. Stakeholders want their values to be considered during development of BCI communication technologies.

CONCLUSIONS

With the rapid development of BCI communication technologies, it is critical to incorporate feedback from individuals regarding their ethical concerns about the storage and use of personalized language models. Stakeholder values and preferences about disability, privacy, identity and relationships should drive design, innovation and implementation.IMPLICATIONS FOR REHABILITATIONIndividuals with neurodegenerative diseases are important stakeholders to consider in development of natural language processing within brain-computer interface (BCI) communication technologies.The incorporation of personalized language models raises issues related to disability, identity, relationships, and privacy.People who may one day rely on BCI communication technologies care not just about usability of communication technology but about technology that supports their values and priorities.Qualitative ethics-focused research is a valuable tool for exploring stakeholder perspectives on new capabilities of BCI communication technologies, such as the storage and use of personalized language models.

Subject-independent meta-learning framework towards optimal training of EEG-based classifiers

Advances in deep learning have shown great promise towards the application of performing high-accuracy Electroencephalography (EEG) signal classification in a variety of tasks. However, many EEG-based datasets are often plagued by the issue of high inter-subject signal variability. Robust deep learning models are notoriously difficult to train under such scenarios, often leading to subpar or widely varying performance across subjects under the leave-one-subject-out paradigm. Recently, the model agnostic meta-learning framework was introduced as a way to increase the model's ability to generalize towards new tasks. While the original framework focused on task-based meta-learning, this research aims to show that the meta-learning methodology can be modified towards subject-based signal classification while maintaining the same task objectives and achieve state-of-the-art performance. Namely, we propose the novel implementation of a few/zero-shot subject-independent meta-learning framework towards multi-class inner speech and binary class motor imagery classification. Compared to current subject-adaptive methods which utilize large number of labels from the target, the proposed framework shows its effectiveness in training zero-calibration and few-shot models for subject-independent EEG classification. The proposed few/zero-shot subject-independent meta-learning mechanism performs well on both small and large datasets and achieves robust, generalized performance across subjects. The results obtained shows a significant improvement over the current state-of-the-art, with the binary class motor imagery achieving 88.70% and the accuracy of multi-class inner speech achieving an average of 31.15%. Codes will be made available to public upon publication.

The evolution of neuromodulation for chronic stroke: From neuroplasticity mechanisms to brain-computer interfaces

Stroke is one of the most common and debilitating neurological conditions worldwide. Those who survive experience motor, sensory, speech, vision, and/or cognitive deficits that severely limit remaining quality of life. While rehabilitation programs can help improve patients' symptoms, recovery is often limited, and patients frequently continue to experience impairments in functional status. In this review, invasive neuromodulation techniques to augment the effects of conventional rehabilitation methods are described, including vagus nerve stimulation (VNS), deep brain stimulation (DBS) and brain-computer interfaces (BCIs). In addition, the evidence base for each of these techniques, pivotal trials, and future directions are explored. Finally, emerging technologies such as functional near-infrared spectroscopy (fNIRS) and the shift to artificial intelligence-enabled implants and wearables are examined. While the field of implantable devices for chronic stroke recovery is still in a nascent stage, the data reviewed are suggestive of immense potential for reducing the impact and impairment from this globally prevalent disorder.

The role of eye movement signals in non-invasive brain-computer interface typing system

Brain-Computer Interfaces (BCIs) have shown great potential in providing communication and control for individuals with severe motor disabilities. However, traditional BCIs that rely on electroencephalography (EEG) signals suffer from low information transfer rates and high variability across users. Recently, eye movement signals have emerged as a promising alternative due to their high accuracy and robustness. Eye movement signals are the electrical or mechanical signals generated by the movements and behaviors of the eyes, serving to denote the diverse forms of eye movements, such as fixations, smooth pursuit, and other oculomotor activities like blinking. This article presents a review of recent studies on the development of BCI typing systems that incorporate eye movement signals. We first discuss the basic principles of BCI and the recent advancements in text entry. Then, we provide a comprehensive summary of the latest advancements in BCI typing systems that leverage eye movement signals. This includes an in-depth analysis of hybrid BCIs that are built upon the integration of electrooculography (EOG) and eye tracking technology, aiming to enhance the performance and functionality of the system. Moreover, we highlight the advantages and limitations of different approaches, as well as potential future directions. Overall, eye movement signals hold great potential for enhancing the usability and accessibility of BCI typing systems, and further research in this area could lead to more effective communication and control for individuals with motor disabilities.

A novel brain-controlled prosthetic hand method integrating AR-SSVEP augmentation, asynchronous control, and machine vision assistance

Background and objective

The brain-computer interface (BCI) system based on steady-state visual evoked potentials (SSVEP) is expected to help disabled patients achieve alternative prosthetic hand assistance. However, the existing study still has some shortcomings in interaction aspects such as stimulus paradigm and control logic. The purpose of this study is to innovate the visual stimulus paradigm and asynchronous decoding/control strategy by integrating augmented reality technology, and propose an asynchronous pattern recognition algorithm, thereby improving the interaction logic and practical application capabilities of the prosthetic hand with the BCI system.

Methods

An asynchronous visual stimulus paradigm based on an augmented reality (AR) interface was proposed in this paper, in which there were 8 control modes, including Grasp, Put down, Pinch, Point, Fist, Palm push, Hold pen, and Initial. According to the attentional orienting characteristics of the paradigm, a novel asynchronous pattern recognition algorithm that combines center extended canonical correlation analysis and support vector machine (Center-ECCA-SVM) was proposed. Then, this study proposed an intelligent BCI system switch based on a deep learning object detection algorithm (YOLOv4) to improve the level of user interaction. Finally, two experiments were designed to test the performance of the brain-controlled prosthetic hand system and its practical performance in real scenarios.

Results

Under the AR paradigm of this study, compared with the liquid crystal display (LCD) paradigm, the average SSVEP spectrum amplitude of multiple subjects increased by 17.41%, and the signal-noise ratio (SNR) increased by 3.52%. The average stimulus pattern recognition accuracy was 96.71 ± 3.91%, which was 2.62% higher than the LCD paradigm. Under the data analysis time of 2s, the Center-ECCA-SVM classifier obtained 94.66 ± 3.87% and 97.40 ± 2.78% asynchronous pattern recognition accuracy under the Normal metric and the Tolerant metric, respectively. And the YOLOv4-tiny model achieves a speed of 25.29fps and a 96.4% confidence in the prosthetic hand in real-time detection. Finally, the brain-controlled prosthetic hand helped the subjects to complete 4 kinds of daily life tasks in the real scene, and the time-consuming were all within an acceptable range, which verified the effectiveness and practicability of the system.

Conclusion

This research is based on improving the user interaction level of the prosthetic hand with the BCI system, and has made improvements in the SSVEP paradigm, asynchronous pattern recognition, interaction, and control logic. Furthermore, it also provides support for BCI areas for alternative prosthetic control, and movement disorder rehabilitation programs.

EEGNet-based multi-source domain filter for BCI transfer learning

Deep learning has great potential on decoding EEG in brain-computer interface. While common deep learning algorithms cannot directly train models with data from multiple individuals because of the inter-individual differences in EEG. Collecting enough data for each subject to satisfy the training of deep learning would result in an increase in training cost. This study proposes a novel transfer learning, EEGNet-based multi-source domain filter for transfer learning (EEGNet-MDFTL), to reduce the amount of training data and improve the performance of BCI. The EEGNet-MDFTL uses bagging ensemble learning to learn domain-invariant features from the multi-source domain and utilizes model loss value to filter the multi-source domain. Compared with baseline methods, the accuracy of the EEGNet-MDFTL reaches 91.96%, higher than two state-of-the-art methods, which demonstrates source domain filter can select similar source domains to improve the accuracy of the model, and remains a high level even when the data amount is reduced to 1/8, proving that ensemble learning learns enough domain invariant features from the multi-source domain to make the model insensitive to data amount. The proposed EEGNet-MDFTL is effective in improving the decoding performance with a small amount of data, which is helpful to save the BCI training cost.

Decoding the Debate: A Comparative Study of Brain-Computer Interface and Neurofeedback

Brain-Computer Interface (BCI) and Neurofeedback (NF) both rely on the technology to capture brain activity. However, the literature lacks a clear distinction between the two, with some scholars categorizing NF as a special case of BCI while others view BCI as a natural extension of NF, or classify them as fundamentally different entities. This ambiguity hinders the flow of information and expertise among scholars and can cause confusion. To address this issue, we conducted a study comparing BCI and NF from two perspectives: the background and context within which BCI and NF developed, and their system design. We utilized Functional Flow Block Diagram (FFBD) as a system modelling approach to visualize inputs, functions, and outputs to compare BCI and NF at a conceptual level. Our analysis revealed that while NF is a subset of the biofeedback method that requires data from the brain to be extracted and processed, the device performing these tasks is a BCI system by definition. Therefore, we conclude that NF should be considered a specific application of BCI technology. By clarifying the relationship between BCI and NF, we hope to facilitate better communication and collaboration among scholars in these fields.

Effect of the period of EEG signals on the decoding of motor information

Decoding movement information from electroencephalogram to construct brain-computer interface has promising applications. The EEG data during the entire motor imagery (MI) period or movement execution (ME) period is generally decoded, and calculation of numerous information and massive dataset is time-consuming. In order to improve decoding efficiency, the joint topographic maps of the brain activation state of 15 subjects were studied during different periods. The results showed that the activation intensity of the preparation period in the motor imagery experiment was higher than during the exercise period, while during the exercise period, the activation intensity was higher than in the preparation period in the movement execution experiment. Hence, the wavelet neural network was used to decode the six-class movements including elbow flexion/extension, forearm pronation/supination and hand open/close in periods of MI/ME. The experimental results show that the accuracy obtained in the preparation period is the highest in the motor imagery experiment, which is 80.77%. On the other hand, the highest accuracy obtained in the exercise period of the movement execution experiment is 79.26%. It further proves that the optimized period is a key decoding factor to reduce the cost of calculation, and this new decoding method is effective to build a more intelligent brain-computer interface system.

Cortical activation and BCI performance during brief tactile imagery: A comparative study with motor imagery

Brain-computer interfaces (BCIs) rely heavily on motor imagery (MI) for operation, yet tactile imagery (TI) presents a novel approach that may be advantageous in situations where visual feedback is impractical. The current study aimed to compare the cortical activity and digit classification performance induced by TI and MI to assess the viability of TI for use in BCIs. Twelve right-handed participants engaged in trials of TI and MI, focusing on their left and right index digits. Event-related desynchronization (ERD) in the mu and beta bands was analyzed, and classification accuracy was determined through an artificial neural network (ANN). Comparable ERD patterns were observed in both TI and MI, with significant decreases in ERD during imagery tasks. The ANN demonstrated high classification accuracy, with TI achieving a mean±SD of 79.30 ± 3.91 % and MI achieving 81.10 ± 2.96 %, with no significant difference between the two (p = 0.11). The study found that TI induces substantial ERD comparable to MI and maintains high classification accuracy, supporting its potential as an effective mental strategy for BCIs. This suggests that TI could be a valuable alternative in BCI applications, particularly for individuals unable to rely on visual cues.

Fractal Dimension as a discriminative feature for high accuracy classification in motor imagery EEG-based brain-computer interface

BACKGROUND AND OBJECTIVE

The brain-computer interface (BCI) technology acquires human brain electrical signals, which can be effectively and successfully used to control external devices, potentially supporting subjects suffering from motor impairments in the interaction with the environment. To this aim, BCI systems must correctly decode and interpret neurophysiological signals reflecting the intention of the subjects to move. Therefore, the accurate classification of single events in motor tasks represents a fundamental challenge in ensuring efficient communication and control between users and BCIs. Movement-associated changes in electroencephalographic (EEG) sensorimotor rhythms, such as event-related desynchronization (ERD), are well-known features of discriminating motor tasks. Fractal dimension (FD) can be used to evaluate the complexity and self-similarity in brain signals, potentially providing complementary information to frequency-based signal features.

METHODS

In the present work, we introduce FD as a novel feature for subject-independent event classification, and we test several machine learning (ML) models in behavioural tasks of motor imagery (MI) and motor execution (ME).

RESULTS

Our results show that FD improves the classification accuracy of ML compared to ERD. Furthermore, unilateral hand movements have higher classification accuracy than bilateral movements in both MI and ME tasks.

CONCLUSIONS

These results provide further insights into subject-independent event classification in BCI systems and demonstrate the potential of FD as a discriminative feature for EEG signals.

EEG dataset for energy data visualizations

User behavior plays a substantial role in shaping household energy use. Nevertheless, the methodologies employed by researchers to examine user behavior exhibit certain limitations in terms of their reach. The present article introduces an openly accessible collection of electroencephalography (EEG) recordings, comprising EEG data collected from individuals who were subjected to energy data visualizations. The dataset comprises EEG recordings obtained from 28 individuals who were in good health. The EEG recordings were collected using a 32-channel EMOTIV EEG device, and the international 10-20 electrode system was employed for precise electrode placement. The energy data visualizations were generated and showcased utilizing the PsychoPy software. To ascertain the participants' affective state, they were requested to rate the valence and arousal of each stimulus through the utilization of a self-assessment manikin (SAM). Additionally, three inquiries were posed for every stimulation. The dataset includes both original data visualizations and ratings. Additionally, the raw EEG data has been divided into segments consisting of data visualizations and neutral images, with the use of event markers, in order to assist analysis. The EEG recordings were recorded and stored utilizing the EMOTIVPro application, whereas the subjective reactions were captured and preserved using the PsychoPy application. Furthermore, the generation of synthetic EEG data is accomplished by employing the Generative Adversarial Network (GAN) architecture on the acquired EEG dataset. The synthetic EEG data created is integrated with empirical EEG data, and afterwards subjected to qualitative and quantitative analysis in order to improve performance. The dataset presented herein showcases a pioneering utilization of EEG investigation and offers a valuable foundation for scholars in the domains of computer science, energy conservation, artificial intelligence, brain-computer interfaces, and human-computer interaction.

Ongoing EEG artifact correction using blind source separation

OBJECTIVE

Analysis of the electroencephalogram (EEG) for epileptic spike and seizure detection or brain-computer interfaces can be severely hampered by the presence of artifacts. The aim of this study is to describe and evaluate a fast automatic algorithm for ongoing correction of artifacts in continuous EEG recordings, which can be applied offline and online.

METHODS

The automatic algorithm for ongoing correction of artifacts is based on fast blind source separation. It uses a sliding window technique with overlapping epochs and features in the spatial, temporal and frequency domain to detect and correct ocular, cardiac, muscle and powerline artifacts.

RESULTS

The approach was validated in an independent evaluation study on publicly available continuous EEG data with 2035 marked artifacts. Validation confirmed that 88% of the artifacts could be removed successfully (ocular: 81%, cardiac: 84%, muscle: 98%, powerline: 100%). It outperformed state-of-the-art algorithms both in terms of artifact reduction rates and computation time.

CONCLUSIONS

Fast ongoing artifact correction successfully removed a good proportion of artifacts, while preserving most of the EEG signals.

SIGNIFICANCE

The presented algorithm may be useful for ongoing correction of artifacts, e.g., in online systems for epileptic spike and seizure detection or brain-computer interfaces.

ETCNet: An EEG-based motor imagery classification model combining efficient channel attention and temporal convolutional network

Brain-computer interface (BCI) enables the control of external devices using signals from the brain, offering immense potential in assisting individuals with neuromuscular disabilities. Among the different paradigms of BCI systems, the motor imagery (MI) based electroencephalogram (EEG) signal is widely recognized as exceptionally promising. Deep learning (DL) has found extensive applications in the processing of MI signals, wherein convolutional neural networks (CNN) have demonstrated superior performance compared to conventional machine learning (ML) approaches. Nevertheless, challenges related to subject independence and subject dependence persist, while the inherent low signal-to-noise ratio of EEG signals remains a critical aspect that demands attention. Accurately deciphering intentions from EEG signals continues to present a formidable challenge. This paper introduces an advanced end-to-end network that effectively combines the efficient channel attention (ECA) and temporal convolutional network (TCN) components for the classification of motor imagination signals. We incorporated an ECA module prior to feature extraction in order to enhance the extraction of channel-specific features. A compact convolutional network model uses for feature extraction in the middle part. Finally, the time characteristic information is obtained by using TCN. The results show that our network is a lightweight network that is characterized by few parameters and fast speed. Our network achieves an average accuracy of 80.71% on the BCI Competition IV-2a dataset.

A time segment adaptive optimization method based on separability criterion and correlation analysis for motor imagery BCIs

Motor imagery (MI) plays a crucial role in brain-computer interface (BCI), and the classification of MI tasks using electroencephalogram (EEG) is currently under extensive investigation. During MI classification, individual differences among subjects in terms of response and time latency need to be considered. Optimizing the time segment for different subjects can enhance subsequent classification performance. In view of the individual differences of subjects in motor imagery tasks, this article proposes a Time Segment Adaptive Optimization method based on Separability criterion and Correlation analysis (TSAOSC). The fundamental principle of this method involves applying the separability criterion to various sizes of time windows within the training data, identifying the optimal raw reference signal, and adaptively adjusting the time segment position for each trial's data by analyzing its relationship with the optimal reference signal. We evaluated our method on three BCI competition datasets, respectively. The utilization of the TSAOSC method in the experiments resulted in an enhancement of 4.90% in average classification accuracy compared to its absence. Additionally, building upon the TSAOSC approach, this study proposes a Nonlinear-TSAOSC method (N-TSAOSC) for analyzing EEG signals with nonlinearity, which shows improvements in the classification accuracy of certain subjects. The results of the experiments demonstrate that the proposed method is an effective time segment optimization method, and it can be integrated into other algorithms to further improve their accuracy.

Effect of motion state variability on error-related potentials during continuous feedback paradigms and their consequences for classification

BACKGROUND

An erroneous motion would elicit the error-related potential (ErrP) when humans monitor the behavior of the external devices. This EEG modality has been largely applied to brain-computer interface in an active or passive manner with discrete visual feedback. However, the effect of variable motion state on ErrP morphology and classification performance raises concerns when the interaction is conducted with continuous visual feedback.

NEW METHOD

In the present study, we designed a cursor control experiment. Participants monitored a continuously moving cursor to reach the target on one side of the screen. Motion state varied multiple times with two factors: (1) motion direction and (2) motion speed. The effects of these two factors on the morphological characteristics and classification performance of ErrP were analyzed. Furthermore, an offline simulation was performed to evaluate the effectiveness of the proposed extended ErrP-decoder in resolving the interference by motion direction changes.

RESULTS

The statistical analyses revealed that motion direction and motion speed significantly influenced the amplitude of feedback-ERN and frontal-Pe components, while only motion direction significantly affected the classification performance.

COMPARISON WITH EXISTING METHODS

Significant deviation was found in ErrP detection utilizing classical correct-versus-erroneous event training. However, this bias can be alleviated by 16% by the extended ErrP-decoder.

CONCLUSION

The morphology and classification performance of ErrP signal can be affected by motion state variability during continuous feedback paradigms. The results enhance the comprehension of ErrP morphological components and shed light on the detection of BCI's error behavior in practical continuous control.

Exploring the effects of different BCI-based attention training games on the brain: A functional near-infrared spectroscopy study

BCI games have been widely employed as non-invasive therapeutic interventions for conditions, but their efficacy remains a subject of debate. This study explores the efficacy of two prevalent forms of Brain-Computer Interface (BCI)-based attention training games: video games (VG) and physical games (PG). The effectiveness of these games has been examined through the lens of neuroscience, using functional Near-Infrared Spectroscopy (fNIRS) to monitor cortical activation. After the fNIRS test, subjects completed an Intrinsic Motivation Inventory (IMI) questionnaire. PG tasks activated six channels (L-PFC, R-PFC and R-TL), while VG tasks activated only one (R-PFC). Furthermore, females exhibited stronger activation during PG tasks, while males had none in either. Our findings suggest that under equivalent game rules and themes, PG may prove more effective for cognitive rehabilitation than VG, with stronger intrinsic motivation. We also found this result may exhibit gender differences. Finally, this research offers valuable insights for the future design of BCI-based games from a neuroscience perspective.

TSANet: multibranch attention deep neural network for classifying tactile selective attention in brain-computer interfaces

Brain-computer interfaces (BCIs) enable communication between the brain and a computer and electroencephalography (EEG) has been widely used to implement BCIs because of its high temporal resolution and noninvasiveness. Recently, a tactile-based EEG task was introduced to overcome the current limitations of visual-based tasks, such as visual fatigue from sustained attention. However, the classification performance of tactile-based BCIs as control signals is unsatisfactory. Therefore, a novel classification approach is required for this purpose. Here, we propose TSANet, a deep neural network, that uses multibranch convolutional neural networks and a feature-attention mechanism to classify tactile selective attention (TSA) in a tactile-based BCI system. We tested TSANet under three evaluation conditions, namely, within-subject, leave-one-out, and cross-subject. We found that TSANet achieved the highest classification performance compared with conventional deep neural network models under all evaluation conditions. Additionally, we show that TSANet extracts reasonable features for TSA by investigating the weights of spatial filters. Our results demonstrate that TSANet has the potential to be used as an efficient end-to-end learning approach in tactile-based BCIs.

Supplementary Information

The online version contains supplementary material available at 10.1007/s13534-023-00309-4.

Conversion of a medical implant into a versatile computer-brain interface

BACKGROUND

Information transmission into the human nervous system is the basis for a variety of prosthetic applications. Spinal cord stimulation (SCS) systems are widely available, have a well documented safety record, can be implanted minimally invasively, and are known to stimulate afferent pathways. Nonetheless, SCS devices are not yet used for computer-brain-interfacing applications.

OBJECTIVE

Here we aimed to establish computer-to-brain communication via medical SCS implants in a group of 20 individuals who had been operated for the treatment of chronic neuropathic pain.

METHODS

In the initial phase, we conducted interface calibration with the aim of determining personalized stimulation settings that yielded distinct and reproducible sensations. These settings were subsequently utilized to generate inputs for a range of behavioral tasks. We evaluated the required calibration time, task training duration, and the subsequent performance in each task.

RESULTS

We could establish a stable spinal computer-brain interface in 18 of the 20 participants. Each of the 18 then performed one or more of the following tasks: A rhythm-discrimination task (n = 13), a Morse-decoding task (n = 3), and/or two different balance/body-posture tasks (n = 18; n = 5). The median calibration time was 79 min. The median training time for learning to use the interface in a subsequent task was 1:40 min. In each task, every participant demonstrated successful performance, surpassing chance levels.

CONCLUSION

The results constitute the first proof-of-concept of a general purpose computer-brain interface paradigm that could be deployed on present-day medical SCS platforms.

[Research progress of brain-computer interface application paradigms based on rapid serial visual presentation]

Rapid serial visual presentation (RSVP) is a type of psychological visual stimulation experimental paradigm that requires participants to identify target stimuli presented continuously in a stream of stimuli composed of numbers, letters, words, images, and so on at the same spatial location, allowing them to discern a large amount of information in a short period of time. The RSVP-based brain-computer interface (BCI) can not only be widely used in scenarios such as assistive interaction and information reading, but also has the advantages of stability and high efficiency, which has become one of the common techniques for human-machine intelligence fusion. In recent years, brain-controlled spellers, image recognition and mind games are the most popular fields of RSVP-BCI research. Therefore, aiming to provide reference and new ideas for RSVP-BCI related research, this paper reviewed the paradigm design and system performance optimization of RSVP-BCI in these three fields. It also looks ahead to its potential applications in cutting-edge fields such as entertainment, clinical medicine, and special military operations.

[Recognition of motor imagery electroencephalogram based on flicker noise spectroscopy and weighted filter bank common spatial pattern]

Due to the high complexity and subject variability of motor imagery electroencephalogram, its decoding is limited by the inadequate accuracy of traditional recognition models. To resolve this problem, a recognition model for motor imagery electroencephalogram based on flicker noise spectrum (FNS) and weighted filter bank common spatial pattern ( wFBCSP) was proposed. First, the FNS method was used to analyze the motor imagery electroencephalogram. Using the second derivative moment as structure function, the ensued precursor time series were generated by using a sliding window strategy, so that hidden dynamic information of transition phase could be captured. Then, based on the characteristic of signal frequency band, the feature of the transition phase precursor time series and reaction phase series were extracted by wFBCSP, generating features representing relevant transition and reaction phase. To make the selected features adapt to subject variability and realize better generalization, algorithm of minimum redundancy maximum relevance was further used to select features. Finally, support vector machine as the classifier was used for the classification. In the motor imagery electroencephalogram recognition, the method proposed in this study yielded an average accuracy of 86.34%, which is higher than the comparison methods. Thus, our proposed method provides a new idea for decoding motor imagery electroencephalogram.

Development of hybrid feature learner model integrating FDOSM for golden subject identification in motor imagery

Brain-computer interfaces (BCIs) based on motor imagery (MI) face challenges due to the complex nature of brain activity, nonstationary and high-dimensional properties, and individual variations in motor behaviour. The identification of a consistent "golden subject" in MI-based BCIs remains an open challenge, complicated by multiple evaluation metrics and conflicting trade-offs, presenting complex Multi-Criteria Decision Making (MCDM) problems. This study proposes a hybrid brain signal decoding model called Hybrid Adaboost Feature Learner (HAFL), which combines feature extraction and classification using VGG-19, STFT, and Adaboost classifier. The model is validated using a pre-recorded MI-EEG dataset from the BCI competition at Graz University. The fuzzy decision-making framework is integrated with HAFL to allocate a golden subject for MI-BCI applications through the Golden Subject Decision Matrix (GSDM) and the Fuzzy Decision by Opinion Score Method (FDOSM). The effectiveness of the HAFL model in addressing inter-subject variability in EEG-based MI-BCI is evaluated using an MI-EEG dataset involving nine subjects. Comparing subject performance fairly is challenging due to complexity variations, but the FDOSM method provides valuable insights. Through FDOSM-based External Group Aggregation (EGA), subject S5 achieves the highest score of 2.900, identified as the most promising golden subject for subject-to-subject transfer learning. The proposed methodology is compared against other benchmark studies from various key perspectives and exhibits significant novelty in several aspects. The findings contribute to the development of more robust and effective BCI systems, paving the way for advancements in subject-to-subject transfer learning for BCI-MI applications.

Evidence That Brain-Controlled Functional Electrical Stimulation Could Elicit Targeted Corticospinal Facilitation of Hand Muscles in Healthy Young Adults

OBJECTIVES

Brain-computer interface (BCI)-controlled functional electrical stimulation (FES) has been used in rehabilitation for improving hand motor function. However, mechanisms of improvements are still not well understood. The objective of this study was to investigate how BCI-controlled FES affects hand muscle corticospinal excitability.

MATERIALS AND METHODS

A total of 12 healthy young adults were recruited in the study. During BCI calibration, a single electroencephalography channel from the motor cortex and a frequency band were chosen to detect event-related desynchronization (ERD) of cortical oscillatory activity during kinesthetic wrist motor imagery (MI). The MI-based BCI system was used to detect active states on the basis of ERD activity in real time and produce contralateral wrist extension movements through FES of the extensor carpi radialis (ECR) muscle. As a control condition, FES was used to generate wrist extension at random intervals. The two interventions were performed on separate days and lasted 25 minutes. Motor evoked potentials (MEPs) in ECR (intervention target) and flexor carpi radialis (FCR) muscles were elicited through single-pulse transcranial magnetic stimulation of the motor cortex to compare corticospinal excitability before (pre), immediately after (post0), and 30 minutes after (post30) the interventions.

RESULTS

After the BCI-FES intervention, ECR muscle MEPs were significantly facilitated at post0 and post30 time points compared with before the intervention (pre), whereas there were no changes in the FCR muscle corticospinal excitability. Conversely, after the random FES intervention, both ECR and FCR muscle MEPs were unaffected compared with before the intervention (pre).

CONCLUSIONS

Our results demonstrated evidence that BCI-FES intervention could elicit muscle-specific short-term corticospinal excitability facilitation of the intervention targeted (ECR) muscle only, whereas randomly applied FES was ineffective in eliciting any changes. Notably, these findings suggest that associative cortical and peripheral activations during BCI-FES can effectively elicit targeted muscle corticospinal excitability facilitation, implying possible rehabilitation mechanisms.

CAMBA framework: Unveiling the brain asymmetry alterations and longitudinal changes after stroke using resting-state EEG

Hemispheric asymmetry or lateralization is a fundamental principle of brain organization. However, it is poorly understood to what extent the brain asymmetries across different levels of functional organizations are evident in health or altered in brain diseases. Here, we propose a framework that integrates three degrees of brain interactions (isolated nodes, node-node, and edge-edge) into a unified analysis pipeline to capture the sliding window-based asymmetry dynamics at both the node and hemisphere levels. We apply this framework to resting-state EEG in healthy and stroke populations and investigate the stroke-induced abnormal alterations in brain asymmetries and longitudinal asymmetry changes during poststroke rehabilitation. We observe that the mean asymmetry in patients was abnormally enhanced across different frequency bands and levels of brain interactions, with these abnormal patterns strongly associated with the side of the stroke lesion. Compared to healthy controls, patients displayed significant alterations in asymmetry fluctuations, disrupting and reconfiguring the balance of inter-hemispheric integration and segregation. Additionally, analyses reveal that specific abnormal asymmetry metrics in patients tend to move towards those observed in healthy controls after short-term brain-computer interface rehabilitation. Furthermore, preliminary evidence suggests that baseline clinical and asymmetry features can predict poststroke improvements in the Fugl-Meyer assessment of the lower extremity (mean absolute error of about 2). Overall, these findings advance our understanding of hemispheric asymmetry. Our framework offers new insights into the mechanisms underlying brain alterations and recovery after a brain lesion, may help identify prognostic biomarkers, and can be easily extended to different functional modalities.

Detecting passive and active response in patients with behaviourally diagnosed unresponsive wakefulness syndrome

The diagnosis of unresponsive wakefulness syndrome depends mostly on the motor response following verbal commands. However, there is a potential for misdiagnosis in patients who understand verbal commands (passive response) but cannot perform voluntary movements (active response). To evaluate passive and active responses in such patients, this study used an approach combining functional magnetic resonance imaging and passive listening tasks to evaluate the level of speech comprehension, with portable brain-computer interface modalities that were applied to elicit an active response to attentional modulation tasks at the bedside. We included ten patients who were clinically diagnosed as unresponsive wakefulness syndrome. Two of ten patients showed no significant activation, while limited activation in the auditory cortex was found in six patients. The remaining two patients showed significant activation in language areas, and were able to control the brain-computer interface with reliable accuracy. Using a combined passive/active approach, we identified unresponsive wakefulness syndrome patients who showed both active and passive neural responses. This suggests that some patients with unresponsive wakefulness syndrome diagnosed behaviourally are both wakeful and responsive, and the combined approach is useful for distinguishing a minimally conscious state from unresponsive wakefulness syndrome physiologically.

Using fMRI to localize target regions for implanted brain-computer interfaces in locked-in syndrome

OBJECTIVE

Electrocorticography (ECoG)-based brain-computer interface (BCI) systems have the potential to improve quality of life of people with locked-in syndrome (LIS) by restoring their ability to communicate independently. Before implantation of such a system, it is important to localize ECoG electrode target regions. Here, we assessed the predictive value of functional magnetic resonance imaging (fMRI) for the localization of suitable target regions on the sensorimotor cortex for ECoG-based BCI in people with locked-in syndrome.

METHODS

Three people with locked-in syndrome were implanted with a chronic, fully implantable ECoG-BCI system. We compared pre-surgical fMRI activity with post-implantation ECoG activity from areas known to be active and inactive during attempted hand movement (sensorimotor hand region and dorsolateral prefrontal cortex, respectively).

RESULTS

Results showed a spatial match between fMRI activity and changes in ECoG low and high frequency band power (10 - 30 and 65 - 95 Hz, respectively) during attempted movement. Also, we found that fMRI can be used to select a sub-set of electrodes that show strong task-related signal changes that are therefore likely to generate adequate BCI control.

CONCLUSIONS

Our findings indicate that fMRI is a useful non-invasive tool for the pre-surgical workup of BCI implant candidates.

SIGNIFICANCE

If these results are confirmed in more BCI studies, fMRI might be used for more efficient surgical BCI procedures with focused cortical coverage and lower participant burden.

Humans and robots: Friends of the future? A bird's eye view of biomanufacturing industry 5.0

The evolution of industries have introduced versatile technologies, motivating limitless possibilities of tackling pivotal global predicaments in the arenas of medicine, environment, defence, and national security. In this direction, ardently emerges the new era of Industry 5.0 through the eyes of biomanufacturing, which integrates the most advanced systems 21st century has to offer by means of integrating artificial systems to mimic and nativize the natural milieu to substitute the deficits of nature, thence leading to a new meta world. Albeit, it questions the natural order of the living world, which necessitates certain paramount stipulations to be addressed for a successful expansion of biomanufacturing Industry 5.0. Can humans live in synergism with artificial beings? How can humans establish dominance of hierarchy with artificial counterparts? This perspective provides a bird's eye view on the plausible direction of a new meta world inquisitively. For this purpose, we propose the influence of internet of things (IoT) via new generation interfacial systems, such as, human-machine interface (HMI) and brain-computer interface (BCI) in the domain of tissue engineering and regenerative medicine, which can be extended to target modern warfare and smart healthcare.

Cell-specific alterations in autophagy-lysosomal activity near the chronically implanted microelectrodes

Intracortical microelectrodes that can record and stimulate brain activity have become a valuable technique for basic science research and clinical applications. However, long-term implantation of these microelectrodes can lead to progressive neurodegeneration in the surrounding microenvironment, characterized by elevation in disease-associated markers. Dysregulation of autophagy-lysosomal degradation, a major intracellular waste removal process, is considered a key factor in the onset and progression of neurodegenerative diseases. It is plausible that similar dysfunctions in autophagy-lysosomal degradation contribute to tissue degeneration following implantation-induced focal brain injury, ultimately impacting recording performance. To understand how the focal, persistent brain injury caused by long-term microelectrode implantation impairs autophagy-lysosomal pathway, we employed two-photon microscopy and immunohistology. This investigation focused on the spatiotemporal characterization of autophagy-lysosomal activity near the chronically implanted microelectrode. We observed an aberrant accumulation of immature autophagy vesicles near the microelectrode over the chronic implantation period. Additionally, we found deficits in autophagy-lysosomal clearance proximal to the chronic implant, which was associated with an accumulation of autophagy cargo and a reduction in lysosomal protease level during the chronic period. Furthermore, our evidence demonstrates reactive astrocytes have myelin-containing lysosomes near the microelectrode, suggesting its role of myelin engulfment during acute implantation period. Together, this study sheds light on the process of brain tissue degeneration caused by long-term microelectrode implantation, with a specific focus on impaired intracellular waste degradation.

Real-time assessment of hypnotic depth, using an EEG-based brain-computer interface: a preliminary study

OBJECTIVE

Hypnosis can be an effective treatment for many conditions, and there have been attempts to develop instrumental approaches to continuously monitor hypnotic state level ("depth"). However, there is no method that addresses the individual variability of electrophysiological hypnotic correlates. We explore the possibility of using an EEG-based passive brain-computer interface (pBCI) for real-time, individualised estimation of the hypnosis deepening process.

RESULTS

The wakefulness and deep hypnosis intervals were manually defined and labelled in 27 electroencephalographic (EEG) recordings obtained from eight outpatients after hypnosis sessions. Spectral analysis showed that EEG correlates of deep hypnosis were relatively stable in each patient throughout the treatment but varied between patients. Data from each first session was used to train classification models to continuously assess deep hypnosis probability in subsequent sessions. Models trained using four frequency bands (1.5-45, 1.5-8, 1.5-14, and 4-15 Hz) showed accuracy mostly exceeding 85% in a 10-fold cross-validation. Real-time classification accuracy was also acceptable, so at least one of the four bands yielded results exceeding 74% in any session. The best results averaged across all sessions were obtained using 1.5-14 and 4-15 Hz, with an accuracy of 82%. The revealed issues are also discussed.

Pro-myelinating clemastine administration improves recording performance of chronically implanted microelectrodes and nearby neuronal health

Intracortical microelectrodes have become a useful tool in neuroprosthetic applications in the clinic and to understand neurological disorders in basic neurosciences. Many of these brain-machine interface technology applications require successful long-term implantation with high stability and sensitivity. However, the intrinsic tissue reaction caused by implantation remains a major failure mechanism causing loss of recorded signal quality over time. Oligodendrocytes remain an underappreciated intervention target to improve chronic recording performance. These cells can accelerate action potential propagation and provides direct metabolic support for neuronal health and functionality. However, implantation injury causes oligodendrocyte degeneration and leads to progressive demyelination in surrounding brain tissue. Previous work highlighted that healthy oligodendrocytes are necessary for greater electrophysiological recording performance and the prevention of neuronal silencing around implanted microelectrodes over the chronic implantation period. Thus, we hypothesize that enhancing oligodendrocyte activity with a pharmaceutical drug, Clemastine, will prevent the chronic decline of microelectrode recording performance. Electrophysiological evaluation showed that the promyelination Clemastine treatment significantly elevated the signal detectability and quality, rescued the loss of multi-unit activity, and increased functional interlaminar connectivity over 16-weeks of implantation. Additionally, post-mortem immunohistochemistry showed that increased oligodendrocyte density and myelination coincided with increased survival of both excitatory and inhibitory neurons near the implant. Overall, we showed a positive relationship between enhanced oligodendrocyte activity and neuronal health and functionality near the chronically implanted microelectrode. This study shows that therapeutic strategy that enhance oligodendrocyte activity is effective for integrating the functional device interface with brain tissue over chronic implantation period.

Self-attention-based convolutional neural network and time-frequency common spatial pattern for enhanced motor imagery classification

BACKGROUND

Motor imagery (MI) based brain-computer interfaces (BCIs) have promising potentials in the field of neuro-rehabilitation. However, due to individual variations in active brain regions during MI tasks, the challenge of decoding MI EEG signals necessitates improved classification performance for practical application.

NEW METHOD

This study proposes a self-attention-based Convolutional Neural Network (CNN) in conjunction with a time-frequency common spatial pattern (TFCSP) for enhanced MI classification. Due to the limited availability of training data, a data augmentation strategy is employed to expand the scale of MI EEG datasets. The self-attention-based CNN is trained to automatically extract the temporal and spatial information from EEG signals, allowing the self-attention module to select active channels by calculating EEG channel weights. TFCSP is further implemented to extract multiscale time-frequency-space features from EEG data. Finally, the EEG features derived from TFCSP are concatenated with those from the self-attention-based CNN for MI classification.

RESULTS

The proposed method is evaluated on two publicly accessible datasets, BCI Competition IV IIa and BCI Competition III IIIa, yielding mean accuracies of 79.28 % and 86.39 %, respectively.

CONCLUSIONS

Compared with state-of-the-art methods, our approach achieves superior classification results in accuracy. Self-attention-based CNN combining with TFCSP can make full use of the time-frequency-space information of EEG, and enhance the classification performance.

Online semi-supervised learning for motor imagery EEG classification

OBJECTIVE

Time-consuming data labeling in brain-computer interfaces (BCIs) raises many problems such as mental fatigue and is one key factor that hinders the real-world adoption of motor imagery (MI)-based BCIs. An alternative approach is to integrate readily available, as well as informative, unlabeled data online, whereas this approach is less investigated.

APPROACH

We proposed an online semi-supervised learning scheme to improve the classification performance of MI-based BCI. This scheme uses regularized weighted online sequential extreme learning machine (RWOS-ELM) as the base classifier and updates its model parameters with incoming balanced data chunk-by-chunk. In the initial stage, we designed a technique that combines the synthetic minority oversampling with the edited nearest neighbor rule for data augmentation to construct more discriminative initial classifiers. When used online, the incoming chunk of data is first pseudo-labeled by RWOS-ELM as well as an auxiliary classifier, and then balanced again by the above-mentioned technique. Initial classifiers are further updated based on these class-balanced data.

MAIN RESULTS

Offline experimental results on two publicly available MI datasets demonstrate the superiority of the proposed scheme over its counterparts. Further online experiments on six subjects show that their BCI performance gradually improved by learning from incoming unlabeled data.

SIGNIFICANCE

Our proposed online semi-supervised learning scheme has higher computation and memory usage efficiency, which is promising for online MI-based BCIs, especially in the case of insufficient labeled training data.

Review on brain-computer interface technologies in healthcare

Brain-computer interface (BCI) technologies have developed as a game changer, altering how humans interact with computers and opening up new avenues for understanding and utilizing the power of the human brain. The goal of this research study is to assess recent breakthroughs in BCI technologies and their future prospects. The paper starts with an outline of the fundamental concepts and principles that underpin BCI technologies. It examines the many forms of BCIs, including as invasive, partially invasive, and non-invasive interfaces, emphasizing their advantages and disadvantages. The progress of BCI hardware and signal processing techniques is investigated, with a focus on the shift from bulky and invasive systems to more portable and user-friendly options. Following that, the article delves into the important advances in BCI applications across several fields. It investigates the use of BCIs in healthcare, particularly in neurorehabilitation, assistive technology, and cognitive enhancement. BCIs' potential for boosting human capacities such as communication, motor control, and sensory perception is being thoroughly researched. Furthermore, the article investigates developing BCI applications in gaming, entertainment, and virtual reality, demonstrating how BCI technologies are growing outside medical and therapeutic settings. The study also gives light on the problems and limits that prevent BCIs from being widely adopted. Ethical concerns about privacy, data security, and informed permission are addressed, highlighting the importance of strong legislative frameworks to enable responsible and ethical usage of BCI technologies. Furthermore, the study delves into technological issues such as increasing signal resolution and precision, increasing system reliability, and enabling smooth connection with existing technology. Finally, this study paper gives an in-depth examination of the advances and future possibilities of BCI technologies. It emphasizes the transformative influence of BCIs on human-computer interaction and their potential to alter healthcare, gaming, and other industries. This research intends to stimulate further innovation and progress in the field of brain-computer interfaces by addressing problems and imagining future possibilities.

[Recognition of high-frequency steady-state visual evoked potential for brain-computer interface]

Coding with high-frequency stimuli could alleviate the visual fatigue of users generated by the brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP). It would improve the comfort and safety of the system and has promising applications. However, most of the current advanced SSVEP decoding algorithms were compared and verified on low-frequency SSVEP datasets, and their recognition performance on high-frequency SSVEPs was still unknown. To address the aforementioned issue, electroencephalogram (EEG) data from 20 subjects were collected utilizing a high-frequency SSVEP paradigm. Then, the state-of-the-art SSVEP algorithms were compared, including 2 canonical correlation analysis algorithms, 3 task-related component analysis algorithms, and 1 task discriminant component analysis algorithm. The results indicated that they all could effectively decode high-frequency SSVEPs. Besides, there were differences in the classification performance and algorithms' speed under different conditions. This paper provides a basis for the selection of algorithms for high-frequency SSVEP-BCI, demonstrating its potential utility in developing user-friendly BCI.

[A design and evaluation of wearable p300 brain-computer interface system based on Hololens2]

Patients with amyotrophic lateral sclerosis ( ALS ) often have difficulty in expressing their intentions through language and behavior, which prevents them from communicating properly with the outside world and seriously affects their quality of life. The brain-computer interface (BCI) has received much attention as an aid for ALS patients to communicate with the outside world, but the heavy device causes inconvenience to patients in the application process. To improve the portability of the BCI system, this paper proposed a wearable P300-speller brain-computer interface system based on the augmented reality (MR-BCI). This system used Hololens2 augmented reality device to present the paradigm, an OpenBCI device to capture EEG signals, and Jetson Nano embedded computer to process the data. Meanwhile, to optimize the system's performance for character recognition, this paper proposed a convolutional neural network classification method with low computational complexity applied to the embedded system for real-time classification. The results showed that compared with the P300-speller brain-computer interface system based on the computer screen (CS-BCI), MR-BCI induced an increase in the amplitude of the P300 component, an increase in accuracy of 1.7% and 1.4% in offline and online experiments, respectively, and an increase in the information transfer rate of 0.7 bit/min. The MR-BCI proposed in this paper achieves a wearable BCI system based on guaranteed system performance. It has a positive effect on the realization of the clinical application of BCI.

[Research on phase modulation to enhance the feature of high-frequency steady-state asymmetric visual evoked potentials]

High-frequency steady-state asymmetric visual evoked potential (SSaVEP) provides a new paradigm for designing comfortable and practical brain-computer interface (BCI) systems. However, due to the weak amplitude and strong noise of high-frequency signals, it is of great significance to study how to enhance their signal features. In this study, a 30 Hz high-frequency visual stimulus was used, and the peripheral visual field was equally divided into eight annular sectors. Eight kinds of annular sector pairs were selected based on the mapping relationship of visual space onto the primary visual cortex (V1), and three phases (in-phase[0º, 0º], anti-phase [0º, 180º], and anti-phase [180º, 0º]) were designed for each annular sector pair to explore response intensity and signal-to-noise ratio under phase modulation. A total of 8 healthy subjects were recruited in the experiment. The results showed that three annular sector pairs exhibited significant differences in SSaVEP features under phase modulation at 30 Hz high-frequency stimulation. And the spatial feature analysis showed that the two types of features of the annular sector pair in the lower visual field were significantly higher than those in the upper visual field. This study further used the filter bank and ensemble task-related component analysis to calculate the classification accuracy of annular sector pairs under three-phase modulations, and the average accuracy was up to 91.5%, which proved that the phase-modulated SSaVEP features could be used to encode high- frequency SSaVEP. In summary, the results of this study provide new ideas for enhancing the features of high-frequency SSaVEP signals and expanding the instruction set of the traditional steady state visual evoked potential paradigm.

[Multi-scale feature extraction and classification of motor imagery electroencephalography based on time series data enhancement]

The brain-computer interface (BCI) based on motor imagery electroencephalography (MI-EEG) enables direct information interaction between the human brain and external devices. In this paper, a multi-scale EEG feature extraction convolutional neural network model based on time series data enhancement is proposed for decoding MI-EEG signals. First, an EEG signals augmentation method was proposed that could increase the information content of training samples without changing the length of the time series, while retaining its original features completely. Then, multiple holistic and detailed features of the EEG data were adaptively extracted by multi-scale convolution module, and the features were fused and filtered by parallel residual module and channel attention. Finally, classification results were output by a fully connected network. The application experimental results on the BCI Competition IV 2a and 2b datasets showed that the proposed model achieved an average classification accuracy of 91.87% and 87.85% for the motor imagery task, respectively, which had high accuracy and strong robustness compared with existing baseline models. The proposed model does not require complex signals pre-processing operations and has the advantage of multi-scale feature extraction, which has high practical application value.

Effects of motor imagery based brain-computer interface on upper limb function and attention in stroke patients with hemiplegia: a randomized controlled trial

BACKGROUND

Seeking positive and comprehensive rehabilitation methods after stroke is an urgent problem to be solved, which is very important to improve the dysfunction of stroke. The aim of this study was to investigate the effects of motor imagery-based brain-computer interface training (MI-BCI) on upper limb function and attention in stroke patients with hemiplegia.

METHODS

Sixty stroke patients with impairment of upper extremity function and decreased attention were randomly assigned to the control group (CR group) or the experimental group (BCI group) in a 1:1 ratio. Patients in the CR group received conventional rehabilitation. Patients in the BCI group received 20 min of MI-BCI training five times a week for 3 weeks (15 sessions) in addition to conventional rehabilitation. The primary outcome measures were the changes in Fugl-Meyer Motor Function Assessment of Upper Extremities (FMA-UE) and Attention Network Test (ANT) from baseline to 3 weeks.

RESULTS

About 93% of the patients completed the allocated training. Compared with the CR group, among those in the BCI group, FMA-UE was increased by 8.0 points (95%CI, 5.0 to 10.0; P < 0.001). Alert network response time (32.4ms; 95%CI, 58.4 to 85.6; P < 0.001), orienting network response (5.6ms; 95%CI, 29.8 to 55.8; P = 0.010), and corrects number (8.0; 95%CI, 17.0 to 28.0; P < 0.001) also increased in the BCI group compared with the CR group. Additionally, the executive control network response time (- 105.9ms; 95%CI, - 68.3 to - 23.6; P = 0.002), the total average response time (- 244.8ms; 95%CI, - 155.8 to - 66.2; P = 0.002), and total time (- 122.0ms; 95%CI, - 80.0 to - 35.0; P = 0.001) were reduced in the BCI group compared with the CR group.

CONCLUSION

MI-BCI combined with conventional rehabilitation training could better enhance upper limb motor function and attention in stroke patients. This training method may be feasible and suitable for individuals with stroke.

TRIAL REGISTRATION

This study was registered in the Chinese Clinical Trial Registry with Portal Number ChiCTR2100050430(27/08/2021).

Comparison of subject-independent and subject-specific EEG-based BCI using LDA and SVM classifiers

Motor imagery brain-computer interface (MI-BCI) is one of the most used paradigms in EEG-based brain-computer interface (BCI). The current state-of-the-art in BCI involves tuning classifiers to subject-specific training data, acquired over several sessions, in order to perform calibration prior to actual use of the so-called subject-specific BCI system (SS-BCI). Herein, the goal is to provide a ready-to-use system requiring minimal effort for setup. Thus, our challenge was to design a subject-independent BCI (SI-BCI) to be used by any new user without the constraint of individual calibration. Outcomes from other studies with the same purpose were used to undertake comparisons and validate our findings. For the EEG signal processing, we used a combination of the delta (0.5-4 Hz), alpha (8-13 Hz), and beta+gamma (13-40 Hz) bands at a stage prior to feature extraction. Next, we extracted features from the 27-channel EEG using common spatial pattern (CSP) and performed binary classification (MI of right- and left-hand) with linear discriminant analysis (LDA) and support vector machine (SVM) classifiers. These analyses were done for both the SS-BCI and SI-BCI models. We employed "leave-one-subject-out" (LOSO) arrangement and 10-fold cross-validation to evaluate our SI-BCI and SS-BCI systems, respectively. Compared with other two studies, our work was the only one that showed higher accuracy for the LDA classifier in SI-BCI as compared to SS-BCI. On the other hand, LDA accuracy was lower than accuracy achieved with SVM in both conditions (SI-BCI and SS-BCI). Our SS-BCI accuracy reached 76.85% using LDA and 94.20% using SVM and for SI-BCI we got 80.30% with LDA and 83.23% with SVM. We conclude that SI-BCI may be a feasible and relevant option, which can be used in scenarios where subjects are not able to submit themselves to long training sessions or to fast evaluation of the so called "BCI illiteracy." Comparatively, our strategy proved to be more efficient, giving us the best result for SI-BCI when faced against the classification performances of other three studies, even considering the caveat that different datasets were used in the comparison of the four studies.

[Advances in brain-computer interface based on high-frequency steady-state visual evoked potential]

Steady-state visual evoked potential (SSVEP) has been widely used in the research of brain-computer interface (BCI) system in recent years. The advantages of SSVEP-BCI system include high classification accuracy, fast information transform rate and strong anti-interference ability. Most of the traditional researches induce SSVEP responses in low and middle frequency bands as control signals. However, SSVEP in this frequency band may cause visual fatigue and even induce epilepsy in subjects. In contrast, high-frequency SSVEP-BCI provides a more comfortable and natural interaction despite its lower amplitude and weaker response. Therefore, it has been widely concerned by researchers in recent years. This paper summarized and analyzed the related research of high-frequency SSVEP-BCI in the past ten years from the aspects of paradigm and algorithm. Finally, the application prospect and development direction of high-frequency SSVEP were discussed and prospected.

Oscillatory neurofeedback networks and poststroke rehabilitative potential in severely impaired stroke patients

Motor restoration after severe stroke is often limited. However, some of the severely impaired stroke patients may still have a rehabilitative potential. Biomarkers that identify these patients are sparse. Eighteen severely impaired chronic stroke patients with a lack of volitional finger extension participated in an EEG study. During sixty-six trials of kinesthetic motor imagery, a brain-machine interface turned event-related beta-band desynchronization of the ipsilesional sensorimotor cortex into opening of the paralyzed hand by a robotic orthosis. A subgroup of eight patients participated in a subsequent four-week rehabilitation training. Changes of the movement extent were captured with sensors which objectively quantified even discrete improvements of wrist movement. Albeit with the same motor impairment level, patients could be differentiated into two groups, i.e., with and without task-related increase of bilateral cortico-cortical phase synchronization between frontal/premotor and parietal areas. This fronto-parietal integration (FPI) was associated with a significantly higher volitional beta modulation range in the ipsilesional sensorimotor cortex. Following the four-week training, patients with FPI showed significantly higher improvement in wrist movement than those without FPI. Moreover, only the former group improved significantly in the upper extremity Fugl-Meyer-Assessment score. Neurofeedback-related long-range oscillatory coherence may differentiate severely impaired stroke patients with regard to their rehabilitative potential, a finding that needs to be confirmed in larger patient cohorts.

[Multi-task motor imagery electroencephalogram classification based on adaptive time-frequency common spatial pattern combined with convolutional neural network]

The effective classification of multi-task motor imagery electroencephalogram (EEG) is helpful to achieve accurate multi-dimensional human-computer interaction, and the high frequency domain specificity between subjects can improve the classification accuracy and robustness. Therefore, this paper proposed a multi-task EEG signal classification method based on adaptive time-frequency common spatial pattern (CSP) combined with convolutional neural network (CNN). The characteristics of subjects' personalized rhythm were extracted by adaptive spectrum awareness, and the spatial characteristics were calculated by using the one-versus-rest CSP, and then the composite time-domain characteristics were characterized to construct the spatial-temporal frequency multi-level fusion features. Finally, the CNN was used to perform high-precision and high-robust four-task classification. The algorithm in this paper was verified by the self-test dataset containing 10 subjects (33 ± 3 years old, inexperienced) and the dataset of the 4th 2018 Brain-Computer Interface Competition (BCI competition Ⅳ-2a). The average accuracy of the proposed algorithm for the four-task classification reached 93.96% and 84.04%, respectively. Compared with other advanced algorithms, the average classification accuracy of the proposed algorithm was significantly improved, and the accuracy range error between subjects was significantly reduced in the public dataset. The results show that the proposed algorithm has good performance in multi-task classification, and can effectively improve the classification accuracy and robustness.

[Design and preliminary application of outdoor flying pigeon-robot]

Control at beyond-visual ranges is of great significance to animal-robots with wide range motion capability. For pigeon-robots, such control can be done by the way of onboard preprogram, but not constitute a closed-loop yet. This study designed a new control system for pigeon-robots, which integrated the function of trajectory monitoring to that of brain stimulation. It achieved the closed-loop control in turning or circling by estimating pigeons' flight state instantaneously and the corresponding logical regulation. The stimulation targets located at the formation reticularis medialis mesencephali (FRM) in the left and right brain, for the purposes of left- and right-turn control, respectively. The stimulus was characterized by the waveform mimicking the nerve cell membrane potential, and was activated intermittently. The wearable control unit weighted 11.8 g totally. The results showed a 90% success rate by the closed-loop control in pigeon-robots. It was convenient to obtain the wing shape during flight maneuver, by equipping a pigeon-robot with a vivo camera. It was also feasible to regulate the evolution of pigeon flocks by the pigeon-robots at different hierarchical level. All of these lay the groundwork for the application of pigeon-robots in scientific researches.

[Research on the feature representation of motor imagery electroencephalogram signal based on individual adaptation]

Aiming at the problem of low recognition accuracy of motor imagery electroencephalogram signal due to individual differences of subjects, an individual adaptive feature representation method of motor imagery electroencephalogram signal is proposed in this paper. Firstly, based on the individual differences and signal characteristics in different frequency bands, an adaptive channel selection method based on expansive relevant features with label F (ReliefF) was proposed. By extracting five time-frequency domain observation features of each frequency band signal, ReliefF algorithm was employed to evaluate the effectiveness of the frequency band signal in each channel, and then the corresponding signal channel was selected for each frequency band. Secondly, a feature representation method of common space pattern (CSP) based on fast correlation-based filter (FCBF) was proposed (CSP-FCBF). The features of electroencephalogram signal were extracted by CSP, and the best feature sets were obtained by using FCBF to optimize the features, so as to realize the effective state representation of motor imagery electroencephalogram signal. Finally, support vector machine (SVM) was adopted as a classifier to realize identification. Experimental results show that the proposed method in this research can effectively represent the states of motor imagery electroencephalogram signal, with an average identification accuracy of (83.0±5.5)% for four types of states, which is 6.6% higher than the traditional CSP feature representation method. The research results obtained in the feature representation of motor imagery electroencephalogram signal lay the foundation for the realization of adaptive electroencephalogram signal decoding and its application.