1
|
Marissens Cueva V, Bougrain L, Lotte F, Rimbert S. Reliable predictor of BCI motor imagery performance using median nerve stimulation. J Neural Eng 2025; 22:026039. [PMID: 40127541 DOI: 10.1088/1741-2552/adc48d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2024] [Accepted: 03/24/2025] [Indexed: 03/26/2025]
Abstract
Objective.Predicting performance in brain-computer interfaces (BCIs) is crucial for enhancing user experience, optimizing training and identifying the most efficient BCI approach for each individual.Approach.This study explores the use of median nerve stimulation (MNS) as a predictor of motor imagery (MI)-BCI performance. MNS induces event related (de)synchronization (ERD/ERS) patterns in the brain that are similar to those generated during MI tasks, providing a non-invasive, user-independent, and easy-to-setup method for performance prediction.Main results.Our proposed predictor, based on the minimum value of the ERD induced by the MNS, not only exhibits a robust correlation with the MI-BCI performance accuracy (rho = -0.71,p<0.001), but also effectively predicts this performance with a significant correlation (rho = 0.61, mean absolute error = 9.0,p<0.01). These results demonstrate its validity as a reliable predictor of MI-BCI performance.Significance.By systematically analyzing patterns induced by MNS and correlating them with subsequent MI-BCI task performance, we aim to establish a robust predictive method of motor activity to each individual only based on MNS, making it possible, among other things, to passively predict BCI deficiency or proficiency, and to potentially adapt BCI parameters for an efficient BCI experience or BCI-based recovery.
Collapse
Affiliation(s)
- Valérie Marissens Cueva
- Inria Center at the University of Bordeaux / LaBRI, Talence, France
- Université de Lorraine, CNRS, LORIA, F-54000 Nancy, France
| | | | - Fabien Lotte
- Inria Center at the University of Bordeaux / LaBRI, Talence, France
| | | |
Collapse
|
2
|
H Liu D, Kumar S, Alawieh H, Samuel Racz F, Del R Millán J. Personalized µ-transcranial alternating current stimulation improves online brain-computer interface control. J Neural Eng 2025; 22:016037. [PMID: 39819671 DOI: 10.1088/1741-2552/ada980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Accepted: 01/13/2025] [Indexed: 01/19/2025]
Abstract
Objective.A motor imagery (MI)-based brain-computer interface (BCI) enables users to engage with external environments by capturing and decoding electroencephalography (EEG) signals associated with the imagined movement of specific limbs. Despite significant advancements in BCI technologies over the past 40 years, a notable challenge remains: many users lack BCI proficiency, unable to produce sufficiently distinct and reliable MI brain patterns, hence leading to low classification rates in their BCIs. The objective of this study is to enhance the online performance of MI-BCIs in a personalized, biomarker-driven approach using transcranial alternating current stimulation (tACS).Approach.Previous studies have identified that the peak power spectral density value in sensorimotor idling rhythms is a neural correlate of participants' upper limb MI-BCI performances. In this active-controlled, single-blind study, we applied 20 min of tACS at the participant-specific, peakµfrequency in resting-state sensorimotor rhythms (SMRs), with the goal of enhancing resting-stateµSMRs.Main results.After tACS, we observed significant improvements in event-related desynchronizations (ERDs) ofµSMRs, and in the performance of an online MI-BCI that decodes left versus right hand commands in healthy participants (N= 10)-but not in an active control-stimulation control group (N= 10). Lastly, we showed a significant correlation between the resting-stateµSMRs andµERD, offering a mechanistic interpretation behind the observed changes in online BCI performances.Significance.Our research lays the groundwork for future non-invasive interventions designed to enhance BCI performances, thereby improving the independence and interactions of individuals who rely on these systems.
Collapse
Affiliation(s)
- Deland H Liu
- Chandra Department of Electrical and Computer Engineering, Cockrell School of Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
| | - Satyam Kumar
- Chandra Department of Electrical and Computer Engineering, Cockrell School of Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
| | - Hussein Alawieh
- Chandra Department of Electrical and Computer Engineering, Cockrell School of Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
| | - Frigyes Samuel Racz
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX 78712, United States of America
| | - José Del R Millán
- Chandra Department of Electrical and Computer Engineering, Cockrell School of Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX 78712, United States of America
- Department of Biomedical Engineering, Cockrell School of Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
- Mulva Clinic for the Neurosciences, The University of Texas at Austin, Austin, TX 78712, United States of America
| |
Collapse
|
3
|
Wu C, Yao B, Zhang X, Li T, Wang J, Pu J. The Application of Entropy in Motor Imagery Paradigms of Brain-Computer Interfaces. Brain Sci 2025; 15:168. [PMID: 40002501 PMCID: PMC11853529 DOI: 10.3390/brainsci15020168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2024] [Revised: 02/05/2025] [Accepted: 02/06/2025] [Indexed: 02/27/2025] Open
Abstract
Background: In motor imagery brain-computer interface (MI-BCI) research, electroencephalogram (EEG) signals are complex and nonlinear. This complexity and nonlinearity render signal processing and classification challenging when employing traditional linear methods. Information entropy, with its intrinsic nonlinear characteristics, effectively captures the dynamic behavior of EEG signals, thereby addressing the limitations of traditional methods in capturing linear features. However, the multitude of entropy types leads to unclear application scenarios, with a lack of systematic descriptions. Methods: This study conducted a review of 63 high-quality research articles focused on the application of entropy in MI-BCI, published between 2019 and 2023. It summarizes the names, functions, and application scopes of 13 commonly used entropy measures. Results: The findings indicate that sample entropy (16.3%), Shannon entropy (13%), fuzzy entropy (12%), permutation entropy (9.8%), and approximate entropy (7.6%) are the most frequently utilized entropy features in MI-BCI. The majority of studies employ a single entropy feature (79.7%), with dual entropy (9.4%) and triple entropy (4.7%) being the most prevalent combinations in multiple entropy applications. The incorporation of entropy features can significantly enhance pattern classification accuracy (by 8-10%). Most studies (67%) utilize public datasets for classification verification, while a minority design and conduct experiments (28%), and only 5% combine both methods. Conclusions: Future research should delve into the effects of various entropy features on specific problems to clarify their application scenarios. As research methodologies continue to evolve and advance, entropy features are poised to play a significant role in a wide array of fields and contexts.
Collapse
Affiliation(s)
- Chengzhen Wu
- School of Life Sciences, Tiangong University, Tianjin 300387, China;
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China; (B.Y.); (X.Z.); (T.L.)
| | - Bo Yao
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China; (B.Y.); (X.Z.); (T.L.)
- Tianjin Key Laboratory of Neuromodulation and Neurorepair, Tianjin 300192, China
| | - Xin Zhang
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China; (B.Y.); (X.Z.); (T.L.)
| | - Ting Li
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China; (B.Y.); (X.Z.); (T.L.)
| | - Jinhai Wang
- School of Life Sciences, Tiangong University, Tianjin 300387, China;
| | - Jiangbo Pu
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China; (B.Y.); (X.Z.); (T.L.)
- Tianjin Key Laboratory of Neuromodulation and Neurorepair, Tianjin 300192, China
| |
Collapse
|
4
|
Park H, Jun SC. Connectivity study on resting-state EEG between motor imagery BCI-literate and BCI-illiterate groups. J Neural Eng 2024; 21:046042. [PMID: 38986469 DOI: 10.1088/1741-2552/ad6187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 07/10/2024] [Indexed: 07/12/2024]
Abstract
Objective.Although motor imagery-based brain-computer interface (MI-BCI) holds significant potential, its practical application faces challenges such as BCI-illiteracy. To mitigate this issue, researchers have attempted to predict BCI-illiteracy by using the resting state, as this was found to be associated with BCI performance. As connectivity's significance in neuroscience has grown, BCI researchers have applied connectivity to it. However, the issues of connectivity have not been considered fully. First, although various connectivity metrics exist, only some have been used to predict BCI-illiteracy. This is problematic because each metric has a distinct hypothesis and perspective to estimate connectivity, resulting in different outcomes according to the metric. Second, the frequency range affects the connectivity estimation. In addition, it is still unknown whether each metric has its own optimal frequency range. Third, the way that estimating connectivity may vary depending upon the dataset has not been investigated. Meanwhile, we still do not know a great deal about how the resting state electroencephalography (EEG) network differs between BCI-literacy and -illiteracy.Approach.To address the issues above, we analyzed three large public EEG datasets using three functional connectivity and three effective connectivity metrics by employing diverse graph theory measures. Our analysis revealed that the appropriate frequency range to predict BCI-illiteracy varies depending upon the metric. The alpha range was found to be suitable for the metrics of the frequency domain, while alpha + theta were found to be appropriate for multivariate Granger causality. The difference in network efficiency between BCI-literate and -illiterate groups was constant regardless of the metrics and datasets used. Although we observed that BCI-literacy had stronger connectivity, no other significant constructional differences were found.Significance.Based upon our findings, we predicted MI-BCI performance for the entire dataset. We discovered that combining several graph features could improve the prediction's accuracy.
Collapse
Affiliation(s)
- Hanjin Park
- AI Graduate School, Gwangju Institute of Science and Technology, Gwangju, Republic of Korea
| | - Sung Chan Jun
- AI Graduate School, Gwangju Institute of Science and Technology, Gwangju, Republic of Korea
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, Republic of Korea
| |
Collapse
|
5
|
Gancio J, Masoller C, Tirabassi G. Permutation entropy analysis of EEG signals for distinguishing eyes-open and eyes-closed brain states: Comparison of different approaches. CHAOS (WOODBURY, N.Y.) 2024; 34:043130. [PMID: 38598676 DOI: 10.1063/5.0200029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Accepted: 03/27/2024] [Indexed: 04/12/2024]
Abstract
Developing reliable methodologies to decode brain state information from electroencephalogram (EEG) signals is an open challenge, crucial to implementing EEG-based brain-computer interfaces (BCIs). For example, signal processing methods that identify brain states could allow motor-impaired patients to communicate via non-invasive, EEG-based BCIs. In this work, we focus on the problem of distinguishing between the states of eyes closed (EC) and eyes open (EO), employing quantities based on permutation entropy (PE). An advantage of PE analysis is that it uses symbols (ordinal patterns) defined by the ordering of the data points (disregarding the actual values), hence providing robustness to noise and outliers due to motion artifacts. However, we show that for the analysis of multichannel EEG recordings, the performance of PE in discriminating the EO and EC states depends on the symbols' definition and how their probabilities are estimated. Here, we study the performance of PE-based features for EC/EO state classification in a dataset of N=107 subjects with one-minute 64-channel EEG recordings in each state. We analyze features obtained from patterns encoding temporal or spatial information, and we compare different approaches to estimate their probabilities (by averaging over time, over channels, or by "pooling"). We find that some PE-based features provide about 75% classification accuracy, comparable to the performance of features extracted with other statistical analysis techniques. Our work highlights the limitations of PE methods in distinguishing the eyes' state, but, at the same time, it points to the possibility that subject-specific training could overcome these limitations.
Collapse
Affiliation(s)
- Juan Gancio
- Universitat Politècnica de Catalunya, Departament de Fisica, Rambla Sant Nebridi 22, Terrassa, Barcelona 08222, Spain
| | - Cristina Masoller
- Universitat Politècnica de Catalunya, Departament de Fisica, Rambla Sant Nebridi 22, Terrassa, Barcelona 08222, Spain
| | - Giulio Tirabassi
- Universitat Politècnica de Catalunya, Departament de Fisica, Rambla Sant Nebridi 22, Terrassa, Barcelona 08222, Spain
- Universitat de Girona, Departament de Informàtica, Matemàtica Aplicada i Estadística, Universitat de Girona, Carrer de la Universitat de Girona 6, Girona 17003, Spain
| |
Collapse
|
6
|
Herbert C. Analyzing and computing humans by means of the brain using Brain-Computer Interfaces - understanding the user - previous evidence, self-relevance and the user's self-concept as potential superordinate human factors of relevance. Front Hum Neurosci 2024; 17:1286895. [PMID: 38435127 PMCID: PMC10904616 DOI: 10.3389/fnhum.2023.1286895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 12/11/2023] [Indexed: 03/05/2024] Open
Abstract
Brain-computer interfaces (BCIs) are well-known instances of how technology can convert a user's brain activity taken from non-invasive electroencephalography (EEG) into computer commands for the purpose of computer-assisted communication and interaction. However, not all users are attaining the accuracy required to use a BCI consistently, despite advancements in technology. Accordingly, previous research suggests that human factors could be responsible for the variance in BCI performance among users. Therefore, the user's internal mental states and traits including motivation, affect or cognition, personality traits, or the user's satisfaction, beliefs or trust in the technology have been investigated. Going a step further, this manuscript aims to discuss which human factors could be potential superordinate factors that influence BCI performance, implicitly, explicitly as well as inter- and intraindividually. Based on the results of previous studies that used comparable protocols to examine the motivational, affective, cognitive state or personality traits of healthy and vulnerable EEG-BCI users within and across well-investigated BCIs (P300-BCIs or SMR-BCIs, respectively), it is proposed that the self-relevance of tasks and stimuli and the user's self-concept provide a huge potential for BCI applications. As potential key human factors self-relevance and the user's self-concept (self-referential knowledge and beliefs about one's self) guide information processing and modulate the user's motivation, attention, or feelings of ownership, agency, and autonomy. Changes in the self-relevance of tasks and stimuli as well as self-referential processing related to one's self (self-concept) trigger changes in neurophysiological activity in specific brain networks relevant to BCI. Accordingly, concrete examples will be provided to discuss how past and future research could incorporate self-relevance and the user's self-concept in the BCI setting - including paradigms, user instructions, and training sessions.
Collapse
Affiliation(s)
- Cornelia Herbert
- Department of Applied Emotion and Motivation Psychology, Institute of Psychology and Education, Ulm University, Ulm, Germany
| |
Collapse
|
7
|
Jorajuria T, Nikulin VV, Kapralov N, Gomez M, Vidaurre C. MEAN SP: How Many Channels are Needed to Predict the Performance of a SMR-Based BCI? IEEE Trans Neural Syst Rehabil Eng 2023; 31:4931-4941. [PMID: 38051627 DOI: 10.1109/tnsre.2023.3339612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2023]
Abstract
Predicting whether a particular individual would reach an adequate control of a Brain-Computer Interface (BCI) has many practical advantages. On the one hand, participants with low predicted performance could be trained with specifically designed sessions and avoid frustrating experiments; on the other hand, planning time and resources would be more efficient; and finally, the variables related to an accurate prediction could be manipulated to improve the prospective BCI performance. To this end, several predictors have been proposed in the literature, most of them based on the power estimation of EEG signals at the specific frequency bands. Many of these studies evaluate their predictors in relatively small datasets and/or using a relatively high number of channels. In this manuscript, we propose a novel predictor called [Formula: see text] to predict the performance of participants using BCIs that are based on the modulation of sensorimotor rhythms. This novel predictor has been positively evaluated using only 2, 3, 4 or 5 channels. [Formula: see text] has shown to perform as well as or better than other state-of-the-art predictors. The best sets of different number of channels are also provided, which have been tested in two different settings to prove their robustness. The proposed predictor has been successfully evaluated using two large-scale datasets containing 150 and 80 participants, respectively. We also discuss predictor thresholds for users to expect good performance in feedback experiments and show the advantages in comparison to a competing algorithm.
Collapse
|
8
|
Saha S, Baumert M, McEwan A. Can Inter-Subject Associativity Predict Data-Driven BCI Performance? ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38082677 DOI: 10.1109/embc40787.2023.10340490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Intra- and inter-subject variability causes covariate shifts in training and testing feature spaces, resulting in low sensorimotor (SMR) brain-computer interface (BCI) performance for practical implementation. Studies involving data-driven transfer learning strategies demonstrated improving BCI performance by covariate shift adaptation. In this study, we aim to illustrate if inter-subject associativity (e.g., subjects having similar SMR brain dynamics) can predict data-driven inter-subject BCI performance. We implemented a BCI classification pipeline with a common spatial pattern, principal component analysis and linear discriminant analysis for performance evaluation. Both intra- and inter-subject BCI were evaluated in 5-Fold Validation settings. We further proposed a Bhattacharyya distance-based covariate shift score (CSS) for assessing the difference between training and testing feature domains. We performed Pearson correlation analysis to draw the relation-ship between BCI performance and CSS. Intra-subject BCI performances were significantly and negatively correlated with CSS (r = -0.94, p < 0.05). For the inter-subject experiment, BCI performances were also highly and negatively associated with CSS (r = -0.61, p < 0.05). However, this data-driven BCI evaluation framework does not necessarily manifest inter-subject associativity in BCI performance, requiring further investigations for a conclusion.Clinical relevance- If it predicts BCI performance successfully, inter-subject associativity could reduce time-consuming and annoying subject-specific calibration for the users.
Collapse
|
9
|
Zhou Q, Cheng R, Yao L, Ye X, Xu K. Neurofeedback Training of Alpha Relative Power Improves the Performance of Motor Imagery Brain-Computer Interface. Front Hum Neurosci 2022; 16:831995. [PMID: 35463935 PMCID: PMC9026187 DOI: 10.3389/fnhum.2022.831995] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Accepted: 03/16/2022] [Indexed: 01/03/2023] Open
Abstract
Significant variation in performance in motor imagery (MI) tasks impedes their wide adoption for brain-computer interface (BCI) applications. Previous researchers have found that resting-state alpha-band power is positively correlated with MI-BCI performance. In this study, we designed a neurofeedback training (NFT) protocol based on the up-regulation of the alpha band relative power (RP) to investigate its effect on MI-BCI performance. The principal finding of this study is that alpha NFT could successfully help subjects increase alpha-rhythm power and improve their MI-BCI performance. An individual difference was also found in this study in that subjects who increased alpha power more had a better performance improvement. Additionally, the functional connectivity (FC) of the frontal-parietal (FP) network was found to be enhanced after alpha NFT. However, the enhancement failed to reach a significant level after multiple comparisons correction. These findings contribute to a better understanding of the neurophysiological mechanism of cognitive control through alpha regulation.
Collapse
Affiliation(s)
- Qing Zhou
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China
- Zhejiang Lab, Hangzhou, China
- Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Zhejiang University, Hangzhou, China
| | - Ruidong Cheng
- Center for Rehabilitation Medicine, Rehabilitation and Sports Medicine Research Institute of Zhejiang Province, Department of Rehabilitation Medicine, Zhejiang Provincial People’s Hospital (Affiliated People’s Hospital, Hangzhou Medical College), Hangzhou, China
| | - Lin Yao
- MOE Frontiers Science Center for Brain and Brain-Machine Integration, Zhejiang University, Hangzhou, China
- Department of Neurobiology, Affiliated Mental Health Center and Hangzhou Seventh People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
- The College of Computer Science, Zhejiang University, Hangzhou, China
| | - Xiangming Ye
- Center for Rehabilitation Medicine, Rehabilitation and Sports Medicine Research Institute of Zhejiang Province, Department of Rehabilitation Medicine, Zhejiang Provincial People’s Hospital (Affiliated People’s Hospital, Hangzhou Medical College), Hangzhou, China
- Xiangming Ye,
| | - Kedi Xu
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China
- Zhejiang Lab, Hangzhou, China
- Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Zhejiang University, Hangzhou, China
- MOE Frontiers Science Center for Brain and Brain-Machine Integration, Zhejiang University, Hangzhou, China
- *Correspondence: Kedi Xu,
| |
Collapse
|
10
|
Kang JH, Youn J, Kim SH, Kim J. Effects of Frontal Theta Rhythms in a Prior Resting State on the Subsequent Motor Imagery Brain-Computer Interface Performance. Front Neurosci 2021; 15:663101. [PMID: 34483816 PMCID: PMC8414888 DOI: 10.3389/fnins.2021.663101] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Accepted: 07/27/2021] [Indexed: 12/01/2022] Open
Abstract
Dealing with subjects who are unable to attain a proper level of performance, that is, those with brain–computer interface (BCI) illiteracy or BCI inefficients, is still a major issue in human electroencephalography (EEG) BCI systems. The most suitable approach to address this issue is to analyze the EEG signals of individual subjects independently recorded before the main BCI tasks, to evaluate their performance on these tasks. This study mainly focused on non-linear analyses and deep learning techniques to investigate the significant relationship between the intrinsic characteristics of a prior idle resting state and the subsequent BCI performance. To achieve this main objective, a public EEG motor/movement imagery dataset that constituted two individual EEG signals recorded from an idle resting state and a motor imagery BCI task was used in this study. For the EEG processing in the prior resting state, spectral analysis but also non-linear analyses, such as sample entropy, permutation entropy, and recurrent quantification analyses (RQA), were performed to obtain individual groups of EEG features to represent intrinsic EEG characteristics in the subject. For the EEG signals in the BCI tasks, four individual decoding methods, as a filter-bank common spatial pattern-based classifier and three types of convolution neural network-based classifiers, quantified the subsequent BCI performance in the subject. Statistical linear regression and ANOVA with post hoc analyses verified the significant relationship between non-linear EEG features in the prior resting state and three types of BCI performance as low-, intermediate-, and high-performance groups that were statistically discriminated by the subsequent BCI performance. As a result, we found that the frontal theta rhythm ranging from 4 to 8 Hz during the eyes open condition was highly associated with the subsequent BCI performance. The RQA findings that higher determinism and lower mean recurrent time were mainly observed in higher-performance groups indicate that more regular and stable properties in the EEG signals over the frontal regions during the prior resting state would provide a critical clue to assess an individual BCI ability in the following motor imagery task.
Collapse
Affiliation(s)
- Jae-Hwan Kang
- AI Grand ICT Research Center, Dong-eui University, Busan, South Korea
| | - Joosang Youn
- Department of Industrial ICT Engineering, Dong-eui University, Busan, South Korea
| | - Sung-Hee Kim
- Department of Industrial ICT Engineering, Dong-eui University, Busan, South Korea
| | - Junsuk Kim
- Department of Industrial ICT Engineering, Dong-eui University, Busan, South Korea
| |
Collapse
|
11
|
Zhou Q, Lin J, Yao L, Wang Y, Han Y, Xu K. Relative Power Correlates With the Decoding Performance of Motor Imagery Both Across Time and Subjects. Front Hum Neurosci 2021; 15:701091. [PMID: 34483866 PMCID: PMC8414415 DOI: 10.3389/fnhum.2021.701091] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Accepted: 07/15/2021] [Indexed: 11/23/2022] Open
Abstract
One of the most significant challenges in the application of brain-computer interfaces (BCI) is the large performance variation, which often occurs over time or across users. Recent evidence suggests that the physiological states may explain this performance variation in BCI, however, the underlying neurophysiological mechanism is unclear. In this study, we conducted a seven-session motor-imagery (MI) experiment on 20 healthy subjects to investigate the neurophysiological mechanism on the performance variation. The classification accuracy was calculated offline by common spatial pattern (CSP) and support vector machine (SVM) algorithms to measure the MI performance of each subject and session. Relative Power (RP) values from different rhythms and task stages were used to reflect the physiological states and their correlation with the BCI performance was investigated. Results showed that the alpha band RP from the supplementary motor area (SMA) within a few seconds before MI was positively correlated with performance. Besides, the changes of RP between task and pre-task stage from theta, alpha, and gamma band were also found to be correlated with performance both across time and subjects. These findings reveal a neurophysiological manifestation of the performance variations, and would further provide a way to improve the BCI performance.
Collapse
Affiliation(s)
- Qing Zhou
- Zhejiang Lab, Hangzhou, China.,Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China
| | - Jiafan Lin
- Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China
| | - Lin Yao
- Frontiers Science Center for Brain and Brain-Machine Integration, Zhejiang University, Hangzhou, China.,The College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Yueming Wang
- Zhejiang Lab, Hangzhou, China.,Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China.,Frontiers Science Center for Brain and Brain-Machine Integration, Zhejiang University, Hangzhou, China.,The College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Yan Han
- Zhejiang Key Laboratory of Neuroelectronics and Brain Computer Interface Technology, Hangzhou, China
| | - Kedi Xu
- Zhejiang Lab, Hangzhou, China.,Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China.,Frontiers Science Center for Brain and Brain-Machine Integration, Zhejiang University, Hangzhou, China.,The College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| |
Collapse
|
12
|
Abstract
The prospect and potentiality of interfacing minds with machines has long captured human imagination. Recent advances in biomedical engineering, computer science, and neuroscience are making brain–computer interfaces a reality, paving the way to restoring and potentially augmenting human physical and mental capabilities. Applications of brain–computer interfaces are being explored in applications as diverse as security, lie detection, alertness monitoring, gaming, education, art, and human cognition augmentation. The present tutorial aims to survey the principal features and challenges of brain–computer interfaces (such as reliable acquisition of brain signals, filtering and processing of the acquired brainwaves, ethical and legal issues related to brain–computer interface (BCI), data privacy, and performance assessment) with special emphasis to biomedical engineering and automation engineering applications. The content of this paper is aimed at students, researchers, and practitioners to glimpse the multifaceted world of brain–computer interfacing.
Collapse
|
13
|
Velasquez-Martinez L, Caicedo-Acosta J, Acosta-Medina C, Alvarez-Meza A, Castellanos-Dominguez G. Regression Networks for Neurophysiological Indicator Evaluation in Practicing Motor Imagery Tasks. Brain Sci 2020; 10:E707. [PMID: 33020435 PMCID: PMC7600302 DOI: 10.3390/brainsci10100707] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 09/21/2020] [Accepted: 09/25/2020] [Indexed: 11/21/2022] Open
Abstract
Motor Imagery (MI) promotes motor learning in activities, like developing professional motor skills, sports gestures, and patient rehabilitation. However, up to 30% of users may not develop enough coordination skills after training sessions because of inter and intra-subject variability. Here, we develop a data-driven estimator, termed Deep Regression Network (DRN), which jointly extracts and performs the regression analysis in order to assess the efficiency of the individual brain networks in practicing MI tasks. The proposed double-stage estimator initially learns a pool of deep patterns, extracted from the input data, in order to feed a neural regression model, allowing for infering the distinctiveness between subject assemblies having similar variability. The results, which were obtained on real-world MI data, prove that the DRN estimator fosters pre-training neural desynchronization and initial training synchronization to predict the bi-class accuracy response, thus providing a better understanding of the Brain-Computer Interface inefficiency of subjects.
Collapse
Affiliation(s)
- Luisa Velasquez-Martinez
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170004, Colombia; (J.C.-A.); (C.A.-M.); (A.A.-M.); (G.C.-D.)
| | | | | | | | | |
Collapse
|
14
|
Lee M, Yoon JG, Lee SW. Predicting Motor Imagery Performance From Resting-State EEG Using Dynamic Causal Modeling. Front Hum Neurosci 2020; 14:321. [PMID: 32903663 PMCID: PMC7438792 DOI: 10.3389/fnhum.2020.00321] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2020] [Accepted: 07/20/2020] [Indexed: 11/22/2022] Open
Abstract
Motor imagery-based brain–computer interfaces (MI-BCIs) send commands to a computer using the brain activity registered when a subject imagines—but does not perform—a given movement. However, inconsistent MI-BCI performance occurs in variations of brain signals across subjects and experiments; this is considered to be a significant problem in practical BCI. Moreover, some subjects exhibit a phenomenon referred to as “BCI-inefficiency,” in which they are unable to generate brain signals for BCI control. These subjects have significant difficulties in using BCI. The primary goal of this study is to identify the connections of the resting-state network that affect MI performance and predict MI performance using these connections. We used a public database of MI, which includes the results of psychological questionnaires and pre-experimental resting-state taken over two sessions on different days. A dynamic causal model was used to calculate the coupling strengths between brain regions with directionality. Specifically, we investigated the motor network in resting-state, including the dorsolateral prefrontal cortex, which performs motor planning. As a result, we observed a significant difference in the connectivity strength from the supplementary motor area to the right dorsolateral prefrontal cortex between the low- and high-MI performance groups. This coupling, measured in the resting-state, is significantly stronger in the high-MI performance group than the low-MI performance group. The connection strength is positively correlated with MI-BCI performance (Session 1: r = 0.54; Session 2: r = 0.42). We also predicted MI performance using linear regression based on this connection (r-squared = 0.31). The proposed predictors, based on dynamic causal modeling, can develop new strategies for improving BCI performance. These findings can further our understanding of BCI-inefficiency and help BCI users to lower costs and save time.
Collapse
Affiliation(s)
- Minji Lee
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - Jae-Geun Yoon
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - Seong-Whan Lee
- Department of Artificial Intelligence, Korea University, Seoul, South Korea
| |
Collapse
|