1
|
Gómez-Morales ÓW, Collazos-Huertas DF, Álvarez-Meza AM, Castellanos-Dominguez CG. EEG Signal Prediction for Motor Imagery Classification in Brain-Computer Interfaces. SENSORS (BASEL, SWITZERLAND) 2025; 25:2259. [PMID: 40218770 PMCID: PMC11991189 DOI: 10.3390/s25072259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/19/2025] [Revised: 03/17/2025] [Accepted: 03/31/2025] [Indexed: 04/14/2025]
Abstract
Brain-computer interfaces (BCIs) based on motor imagery (MI) generally require EEG signals recorded from a large number of electrodes distributed across the cranial surface to achieve accurate MI classification. Not only does this entail long preparation times and high costs, but it also carries the risk of losing valuable information when an electrode is damaged, further limiting its practical applicability. In this study, a signal prediction-based method is proposed to achieve high accuracy in MI classification using EEG signals recorded from only a small number of electrodes. The signal prediction model was constructed using the elastic net regression technique, allowing for the estimation of EEG signals from 22 complete channels based on just 8 centrally located channels. The predicted EEG signals from the complete channels were used for feature extraction and MI classification. The results obtained indicate a notable efficacy of the proposed prediction method, showing an average performance of 78.16% in classification accuracy. The proposed method demonstrated superior performance compared to the traditional approach that used few-channel EEG and also achieved better results than the traditional method based on full-channel EEG. Although accuracy varies among subjects, from 62.30% to an impressive 95.24%, these data indicate the capability of the method to provide accurate estimates from a reduced set of electrodes. This performance highlights its potential to be implemented in practical MI-based BCI applications, thereby mitigating the time and cost constraints associated with systems that require a high density of electrodes.
Collapse
Affiliation(s)
- Óscar Wladimir Gómez-Morales
- TECED—Research Group, Faculty of Systems and Telecommunications, Universidad Estatal Península de Santa Elena, Avda. La Libertad, La Libertad, Santa Elena 7047, Ecuador
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170003, Colombia; (D.F.C.-H.); (A.M.Á.-M.); (C.G.C.-D.)
| | - Diego Fabian Collazos-Huertas
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170003, Colombia; (D.F.C.-H.); (A.M.Á.-M.); (C.G.C.-D.)
| | - Andrés Marino Álvarez-Meza
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170003, Colombia; (D.F.C.-H.); (A.M.Á.-M.); (C.G.C.-D.)
| | - Cesar German Castellanos-Dominguez
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170003, Colombia; (D.F.C.-H.); (A.M.Á.-M.); (C.G.C.-D.)
| |
Collapse
|
2
|
Klein F, Kohl SH, Lührs M, Mehler DMA, Sorger B. From lab to life: challenges and perspectives of fNIRS for haemodynamic-based neurofeedback in real-world environments. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230087. [PMID: 39428887 PMCID: PMC11513164 DOI: 10.1098/rstb.2023.0087] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 02/09/2024] [Accepted: 02/26/2024] [Indexed: 10/22/2024] Open
Abstract
Neurofeedback allows individuals to monitor and self-regulate their brain activity, potentially improving human brain function. Beyond the traditional electrophysiological approach using primarily electroencephalography, brain haemodynamics measured with functional magnetic resonance imaging (fMRI) and more recently, functional near-infrared spectroscopy (fNIRS) have been used (haemodynamic-based neurofeedback), particularly to improve the spatial specificity of neurofeedback. Over recent years, especially fNIRS has attracted great attention because it offers several advantages over fMRI such as increased user accessibility, cost-effectiveness and mobility-the latter being the most distinct feature of fNIRS. The next logical step would be to transfer haemodynamic-based neurofeedback protocols that have already been proven and validated by fMRI to mobile fNIRS. However, this undertaking is not always easy, especially since fNIRS novices may miss important fNIRS-specific methodological challenges. This review is aimed at researchers from different fields who seek to exploit the unique capabilities of fNIRS for neurofeedback. It carefully addresses fNIRS-specific challenges and offers suggestions for possible solutions. If the challenges raised are addressed and further developed, fNIRS could emerge as a useful neurofeedback technique with its own unique application potential-the targeted training of brain activity in real-world environments, thereby significantly expanding the scope and scalability of haemodynamic-based neurofeedback applications.This article is part of the theme issue 'Neurofeedback: new territories and neurocognitive mechanisms of endogenous neuromodulation'.
Collapse
Affiliation(s)
- Franziska Klein
- Biomedical Devices and Systems Group, R&D Division Health, OFFIS—Institute for Information Technology, Oldenburg, Germany
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany
| | - Simon H. Kohl
- JARA-Institute Molecular Neuroscience and Neuroimaging (INM-11), Forschungszentrum Jülich, Jülich, Germany
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
| | - Michael Lührs
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
- Brain Innovation B.V., Research Department, Maastricht, The Netherlands
| | - David M. A. Mehler
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany
- Institute of Translational Psychiatry, Medical Faculty, University of Münster, Münster, Germany
- Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, UK
| | - Bettina Sorger
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
3
|
Liu L, Li J, Ouyang R, Zhou D, Fan C, Liang W, Li F, Lv Z, Wu X. Multimodal brain-controlled system for rehabilitation training: Combining asynchronous online brain-computer interface and exoskeleton. J Neurosci Methods 2024; 406:110132. [PMID: 38604523 DOI: 10.1016/j.jneumeth.2024.110132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 03/11/2024] [Accepted: 04/03/2024] [Indexed: 04/13/2024]
Abstract
BACKGROUND Traditional therapist-based rehabilitation training for patients with movement impairment is laborious and expensive. In order to reduce the cost and improve the treatment effect of rehabilitation, many methods based on human-computer interaction (HCI) technology have been proposed, such as robot-assisted therapy and functional electrical stimulation (FES). However, due to the lack of active participation of brain, these methods have limited effects on the promotion of damaged nerve remodeling. NEW METHOD Based on the neurofeedback training provided by the combination of brain-computer interface (BCI) and exoskeleton, this paper proposes a multimodal brain-controlled active rehabilitation system to help improve limb function. The joint control mode of steady-state visual evoked potential (SSVEP) and motor imagery (MI) is adopted to achieve self-paced control and thus maximize the degree of brain involvement, and a requirement selection function based on SSVEP design is added to facilitate communication with aphasia patients. COMPARISON WITH EXISTING METHODS In addition, the Transformer is introduced as the MI decoder in the asynchronous online BCI to improve the global perception of electroencephalogram (EEG) signals and maintain the sensitivity and efficiency of the system. RESULTS In two multi-task online experiments for left hand, right hand, foot and idle states, subject achieves 91.25% and 92.50% best accuracy, respectively. CONCLUSION Compared with previous studies, this paper aims to establish a high-performance and low-latency brain-controlled rehabilitation system, and provide an independent and autonomous control mode of the brain, so as to improve the effect of neural remodeling. The performance of the proposed method is evaluated through offline and online experiments.
Collapse
Affiliation(s)
- Lei Liu
- School of Computer Science and Technology, Anhui University, Hefei 230601, China; Anhui Province Key Laboratory of Multimodal Cognitive Computation, Anhui University, Hefei 230601, China
| | - Jian Li
- School of Computer Science and Technology, Anhui University, Hefei 230601, China; Anhui Province Key Laboratory of Multimodal Cognitive Computation, Anhui University, Hefei 230601, China
| | - Rui Ouyang
- School of Computer Science and Technology, Anhui University, Hefei 230601, China; Anhui Province Key Laboratory of Multimodal Cognitive Computation, Anhui University, Hefei 230601, China
| | - Danya Zhou
- National Centre for International Research in Cell and Gene Therapy, School of Basic Medical Sciences, Academy of Medical Sciences, Zhengzhou University, Zhengzhou, China
| | - Cunhang Fan
- School of Computer Science and Technology, Anhui University, Hefei 230601, China; Anhui Province Key Laboratory of Multimodal Cognitive Computation, Anhui University, Hefei 230601, China.
| | - Wen Liang
- Google Inc, United States of America
| | - Fan Li
- Civil Aviation Flight University of China, China
| | - Zhao Lv
- Anhui Province Key Laboratory of Multimodal Cognitive Computation, Anhui University, Hefei 230601, China; Civil Aviation Flight University of China, China
| | - Xiaopei Wu
- School of Computer Science and Technology, Anhui University, Hefei 230601, China; Anhui Province Key Laboratory of Multimodal Cognitive Computation, Anhui University, Hefei 230601, China.
| |
Collapse
|
4
|
Sawai S, Fujikawa S, Ohsumi C, Ushio R, Tamura K, Yamamoto R, Kai Y, Murata S, Shima K, Nakano H. Effects of neurofeedback on standing postural control task with combined imagined and executed movements. Front Neurosci 2023; 17:1199398. [PMID: 37483338 PMCID: PMC10360181 DOI: 10.3389/fnins.2023.1199398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 06/16/2023] [Indexed: 07/25/2023] Open
Abstract
Introduction Motor imagery (MI) is a method of imagining movement without actual movement, and its use in combination with motor execution (ME) enhances the effects of motor learning. Neurofeedback (NFB) is another method that promotes the effects of MI. This study aimed to investigate the effects of NFB on combined MI and ME (MIME) training in a standing postural control task. Methods Sixteen participants were randomly divided into MIME and MIME + NFB groups and performed 10 trials of a postural control task on an unstable board, with nine trials of MI in between. Electroencephalogram was assessed during MI, and the MIME + NFB group received neurofeedback on the degree of MI via auditory stimulation. A postural control task using an unstable board was performed before and after the MIME task, during which postural instability was evaluated. Results Postural instability was reduced after the MIME task in both groups. In addition, the root mean square, which indicates the sway of the unstable board, was significantly reduced in the MIME + NFB group compared to that in the MIME group. Conclusion Our results indicate that MIME training is effective for motor learning of standing postural control. Furthermore, when MI and ME are combined, the feedback on the degree of MI enhances the learning effect.
Collapse
Affiliation(s)
- Shun Sawai
- Graduate School of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- Department of Rehabilitation, Kyoto Kuno Hospital, Kyoto, Japan
| | - Shoya Fujikawa
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Chihiro Ohsumi
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Ryu Ushio
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Kosuke Tamura
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Ryosuke Yamamoto
- Department of Rehabilitation, Tesseikai Neurosurgical Hospital, Shijonawate, Japan
| | - Yoshihiro Kai
- Graduate School of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Shin Murata
- Graduate School of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Keisuke Shima
- Graduate School of Environment and Information Sciences, Yokohama National University, Yokohama, Japan
| | - Hideki Nakano
- Graduate School of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| |
Collapse
|
5
|
Ma J, Yang B, Qiu W, Zhang J, Yan L, Wang W. Recognizable Rehabilitation Movements of Multiple Unilateral Upper Limb: an fMRI Study of Motor Execution and Motor Imagery. J Neurosci Methods 2023; 392:109861. [PMID: 37075914 DOI: 10.1016/j.jneumeth.2023.109861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 02/18/2023] [Accepted: 04/15/2023] [Indexed: 04/21/2023]
Abstract
BACKGROUND This paper presents a study investigating the recognizability of multiple unilateral upper limb movements in stroke rehabilitation. METHODS A functional magnetic experiment is employed to study motor execution (ME) and motor imagery (MI) of four movements for the unilateral upper limb: hand-grasping, hand-handling, arm-reaching, and wrist-twisting. The functional magnetic resonance imaging (fMRI) images of ME and MI tasks are statistically analyzed to delineate the region of interest (ROI). Then parameter estimation associated with ROIs for each ME and MI task are evaluated, where differences in ROIs for different movements are compared using analysis of covariance (ANCOVA). RESULTS All movements of ME and MI tasks activate motor areas of the brain, and there are significant differences (p<0.05) in ROIs evoked by different movements. The activation area is larger when executing the hand-grasping task instead of the others. CONCLUSION The four movements we propose can be adopted as MI tasks, especially for stroke rehabilitation, since they are highly recognizable and capable of activating more brain areas during MI and ME.
Collapse
Affiliation(s)
- Jun Ma
- School of Mechatronic Engineering and Automation, School of Medicine, Research Center of Brain Computer Engineering, Shanghai University, Shanghai, 200441, China
| | - Banghua Yang
- School of Mechatronic Engineering and Automation, School of Medicine, Research Center of Brain Computer Engineering, Shanghai University, Shanghai, 200441, China; Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, 201203, Shanghai, China.
| | - Wenzheng Qiu
- School of Mechatronic Engineering and Automation, School of Medicine, Research Center of Brain Computer Engineering, Shanghai University, Shanghai, 200441, China
| | - Jian Zhang
- Shanghai Universal Medical Imaging Diagnostic Center, Shanghai University, 200441, Shanghai China
| | - Linfeng Yan
- Department of Radiology & Functional and Molecular Imaging Key Lab of Shaanxi Province, Tangdu Hospital, Fourth Military Medical University, 710038, Shaanxi, China
| | - Wen Wang
- Department of Radiology & Functional and Molecular Imaging Key Lab of Shaanxi Province, Tangdu Hospital, Fourth Military Medical University, 710038, Shaanxi, China.
| |
Collapse
|
6
|
Orth L, Meeh J, Gur RC, Neuner I, Sarkheil P. Frontostriatal circuitry as a target for fMRI-based neurofeedback interventions: A systematic review. Front Hum Neurosci 2022; 16:933718. [PMID: 36092647 PMCID: PMC9449529 DOI: 10.3389/fnhum.2022.933718] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2022] [Accepted: 08/08/2022] [Indexed: 11/19/2022] Open
Abstract
Dysregulated frontostriatal circuitries are viewed as a common target for the treatment of aberrant behaviors in various psychiatric and neurological disorders. Accordingly, experimental neurofeedback paradigms have been applied to modify the frontostriatal circuitry. The human frontostriatal circuitry is topographically and functionally organized into the "limbic," the "associative," and the "motor" subsystems underlying a variety of affective, cognitive, and motor functions. We conducted a systematic review of the literature regarding functional magnetic resonance imaging-based neurofeedback studies that targeted brain activations within the frontostriatal circuitry. Seventy-nine published studies were included in our survey. We assessed the efficacy of these studies in terms of imaging findings of neurofeedback intervention as well as behavioral and clinical outcomes. Furthermore, we evaluated whether the neurofeedback targets of the studies could be assigned to the identifiable frontostriatal subsystems. The majority of studies that targeted frontostriatal circuitry functions focused on the anterior cingulate cortex, the dorsolateral prefrontal cortex, and the supplementary motor area. Only a few studies (n = 14) targeted the connectivity of the frontostriatal regions. However, post-hoc analyses of connectivity changes were reported in more cases (n = 32). Neurofeedback has been frequently used to modify brain activations within the frontostriatal circuitry. Given the regulatory mechanisms within the closed loop of the frontostriatal circuitry, the connectivity-based neurofeedback paradigms should be primarily considered for modifications of this system. The anatomical and functional organization of the frontostriatal system needs to be considered in decisions pertaining to the neurofeedback targets.
Collapse
Affiliation(s)
- Linda Orth
- Department of Psychiatry, Psychotherapy and Psychosomatics, RWTH Aachen University, Aachen, Germany
| | - Johanna Meeh
- Department of Psychiatry and Psychotherapy, University of Münster, Münster, Germany
| | - Ruben C. Gur
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Irene Neuner
- Department of Psychiatry, Psychotherapy and Psychosomatics, RWTH Aachen University, Aachen, Germany
- Institute of Neuroscience and Medicine 4, Forschungszentrum Jülich, Jülich, Germany
| | - Pegah Sarkheil
- Department of Psychiatry and Psychotherapy, University of Münster, Münster, Germany
| |
Collapse
|
7
|
Single-Trial Kernel-Based Functional Connectivity for Enhanced Feature Extraction in Motor-Related Tasks. SENSORS 2021; 21:s21082750. [PMID: 33924672 PMCID: PMC8069819 DOI: 10.3390/s21082750] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 04/01/2021] [Accepted: 04/08/2021] [Indexed: 02/06/2023]
Abstract
Motor learning is associated with functional brain plasticity, involving specific functional connectivity changes in the neural networks. However, the degree of learning new motor skills varies among individuals, which is mainly due to the between-subject variability in brain structure and function captured by electroencephalographic (EEG) recordings. Here, we propose a kernel-based functional connectivity measure to deal with inter/intra-subject variability in motor-related tasks. To this end, from spatio-temporal-frequency patterns, we extract the functional connectivity between EEG channels through their Gaussian kernel cross-spectral distribution. Further, we optimize the spectral combination weights within a sparse-based ℓ2-norm feature selection framework matching the motor-related labels that perform the dimensionality reduction of the extracted connectivity features. From the validation results in three databases with motor imagery and motor execution tasks, we conclude that the single-trial Gaussian functional connectivity measure provides very competitive classifier performance values, being less affected by feature extraction parameters, like the sliding time window, and avoiding the use of prior linear spatial filtering. We also provide interpretability for the clustered functional connectivity patterns and hypothesize that the proposed kernel-based metric is promising for evaluating motor skills.
Collapse
|