1
|
Sengupta P, Lakshminarayanan K. Cortical activation and BCI performance during brief tactile imagery: A comparative study with motor imagery. Behav Brain Res 2024; 459:114760. [PMID: 37979923 DOI: 10.1016/j.bbr.2023.114760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 11/06/2023] [Accepted: 11/11/2023] [Indexed: 11/20/2023]
Abstract
Brain-computer interfaces (BCIs) rely heavily on motor imagery (MI) for operation, yet tactile imagery (TI) presents a novel approach that may be advantageous in situations where visual feedback is impractical. The current study aimed to compare the cortical activity and digit classification performance induced by TI and MI to assess the viability of TI for use in BCIs. Twelve right-handed participants engaged in trials of TI and MI, focusing on their left and right index digits. Event-related desynchronization (ERD) in the mu and beta bands was analyzed, and classification accuracy was determined through an artificial neural network (ANN). Comparable ERD patterns were observed in both TI and MI, with significant decreases in ERD during imagery tasks. The ANN demonstrated high classification accuracy, with TI achieving a mean±SD of 79.30 ± 3.91 % and MI achieving 81.10 ± 2.96 %, with no significant difference between the two (p = 0.11). The study found that TI induces substantial ERD comparable to MI and maintains high classification accuracy, supporting its potential as an effective mental strategy for BCIs. This suggests that TI could be a valuable alternative in BCI applications, particularly for individuals unable to rely on visual cues.
Collapse
Affiliation(s)
- Puja Sengupta
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Technology, School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Kishor Lakshminarayanan
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Technology, School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India.
| |
Collapse
|
2
|
Wang W, Shi B, Wang D, Wang J, Liu G. Enhanced lower-limb motor imagery by kinesthetic illusion. Front Neurosci 2023; 17:1077479. [PMID: 37409102 PMCID: PMC10319417 DOI: 10.3389/fnins.2023.1077479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Accepted: 05/30/2023] [Indexed: 07/07/2023] Open
Abstract
Brain-computer interface (BCI) based on lower-limb motor imagery (LMI) enables hemiplegic patients to stand and walk independently. However, LMI ability is usually poor for BCI-illiterate (e.g., some stroke patients), limiting BCI performance. This study proposed a novel LMI-BCI paradigm with kinesthetic illusion(KI) induced by vibratory stimulation on Achilles tendon to enhance LMI ability. Sixteen healthy subjects were recruited to carry out two research contents: (1) To verify the feasibility of induced KI by vibrating Achilles tendon and analyze the EEG features produced by KI, research 1 compared the subjective feeling and brain activity of participants during rest task with and without vibratory stimulation (V-rest, rest). (2) Research 2 compared the LMI-BCI performance with and without KI (KI-LMI, no-LMI) to explore whether KI enhances LMI ability. The analysis methods of both experiments included classification accuracy (V-rest vs. rest, no-LMI vs. rest, KI-LMI vs. rest, KI-LMI vs. V-rest), time-domain features, oral questionnaire, statistic analysis and brain functional connectivity analysis. Research 1 verified that induced KI by vibrating Achilles tendon might be feasible, and provided a theoretical basis for applying KI to LMI-BCI paradigm, evidenced by oral questionnaire (Q1) and the independent effect of vibratory stimulation during rest task. The results of research 2 that KI enhanced mesial cortex activation and induced more intensive EEG features, evidenced by ERD power, topographical distribution, oral questionnaire (Q2 and Q3), and brain functional connectivity map. Additionally, the KI increased the offline accuracy of no-LMI/rest task by 6.88 to 82.19% (p < 0.001). The simulated online accuracy was also improved for most subjects (average accuracy for all subjects: 77.23% > 75.31%, and average F1_score for all subjects: 76.4% > 74.3%). The LMI-BCI paradigm of this study provides a novel approach to enhance LMI ability and accelerates the practical applications of the LMI-BCI system.
Collapse
Affiliation(s)
- Weizhen Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Bin Shi
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Dong Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Jing Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Gang Liu
- Henan Key Laboratory of Brain Science and Brain-Computer Interface Technology, School of Electrical Engineering, Zhengzhou University, Zhengzhou, China
| |
Collapse
|
3
|
Kurkin S, Gordleeva S, Savosenkov A, Grigorev N, Smirnov N, Grubov VV, Udoratina A, Maksimenko V, Kazantsev V, Hramov AE. Transcranial Magnetic Stimulation of the Dorsolateral Prefrontal Cortex Increases Posterior Theta Rhythm and Reduces Latency of Motor Imagery. SENSORS (BASEL, SWITZERLAND) 2023; 23:4661. [PMID: 37430576 DOI: 10.3390/s23104661] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 05/09/2023] [Accepted: 05/09/2023] [Indexed: 07/12/2023]
Abstract
Experiments show activation of the left dorsolateral prefrontal cortex (DLPFC) in motor imagery (MI) tasks, but its functional role requires further investigation. Here, we address this issue by applying repetitive transcranial magnetic stimulation (rTMS) to the left DLPFC and evaluating its effect on brain activity and the latency of MI response. This is a randomized, sham-controlled EEG study. Participants were randomly assigned to receive sham (15 subjects) or real high-frequency rTMS (15 subjects). We performed EEG sensor-level, source-level, and connectivity analyses to evaluate the rTMS effects. We revealed that excitatory stimulation of the left DLPFC increases theta-band power in the right precuneus (PrecuneusR) via the functional connectivity between them. The precuneus theta-band power negatively correlates with the latency of the MI response, so the rTMS speeds up the responses in 50% of participants. We suppose that posterior theta-band power reflects attention modulation of sensory processing; therefore, high power may indicate attentive processing and cause faster responses.
Collapse
Affiliation(s)
- Semen Kurkin
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
| | - Susanna Gordleeva
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Andrey Savosenkov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Nikita Grigorev
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Nikita Smirnov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
| | - Vadim V Grubov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
| | - Anna Udoratina
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Vladimir Maksimenko
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Victor Kazantsev
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Alexander E Hramov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| |
Collapse
|
4
|
Inamoto T, Ueda M, Ueno K, Shiroma C, Morita R, Naito Y, Ishii R. Motor-Related Mu/Beta Rhythm in Older Adults: A Comprehensive Review. Brain Sci 2023; 13:brainsci13050751. [PMID: 37239223 DOI: 10.3390/brainsci13050751] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2023] [Revised: 04/23/2023] [Accepted: 04/28/2023] [Indexed: 05/28/2023] Open
Abstract
Mu rhythm, also known as the mu wave, occurs on sensorimotor cortex activity at rest, and the frequency range is defined as 8-13Hz, the same frequency as the alpha band. Mu rhythm is a cortical oscillation that can be recorded from the scalp over the primary sensorimotor cortex by electroencephalogram (EEG) and magnetoencephalography (MEG). The subjects of previous mu/beta rhythm studies ranged widely from infants to young and older adults. Furthermore, these subjects were not only healthy people but also patients with various neurological and psychiatric diseases. However, very few studies have referred to the effect of mu/beta rhythm with aging, and there was no literature review about this theme. It is important to review the details of the characteristics of mu/beta rhythm activity in older adults compared with young adults, focusing on age-related mu rhythm changes. By comprehensive review, we found that, compared with young adults, older adults showed mu/beta activity change in four characteristics during voluntary movement, increased event-related desynchronization (ERD), earlier beginning and later end, symmetric pattern of ERD and increased recruitment of cortical areas, and substantially reduced beta event-related desynchronization (ERS). It was also found that mu/beta rhythm patterns of action observation were changing with aging. Future work is needed in order to investigate not only the localization but also the network of mu/beta rhythm in older adults.
Collapse
Affiliation(s)
- Takashi Inamoto
- Graduate School of Comprehensive Rehabilitation, Osaka Prefecture University, Osaka 583-8555, Japan
- Faculty of Health Sciences, Kansai University of Health Sciences, Osaka 590-0482, Japan
| | - Masaya Ueda
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, Osaka 583-8555, Japan
| | - Keita Ueno
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, Osaka 583-8555, Japan
| | - China Shiroma
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, Osaka 583-8555, Japan
| | - Rin Morita
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, Osaka 583-8555, Japan
| | - Yasuo Naito
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, Osaka 583-8555, Japan
| | - Ryouhei Ishii
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, Osaka 583-8555, Japan
- Department of Psychiatry, Osaka University Graduate School of Medicine, Suita 565-0871, Japan
| |
Collapse
|
5
|
García-Murillo DG, Álvarez-Meza AM, Castellanos-Dominguez CG. KCS-FCnet: Kernel Cross-Spectral Functional Connectivity Network for EEG-Based Motor Imagery Classification. Diagnostics (Basel) 2023; 13:diagnostics13061122. [PMID: 36980430 PMCID: PMC10046910 DOI: 10.3390/diagnostics13061122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 02/25/2023] [Accepted: 03/02/2023] [Indexed: 03/18/2023] Open
Abstract
This paper uses EEG data to introduce an approach for classifying right and left-hand classes in Motor Imagery (MI) tasks. The Kernel Cross-Spectral Functional Connectivity Network (KCS-FCnet) method addresses these limitations by providing richer spatial-temporal-spectral feature maps, a simpler architecture, and a more interpretable approach for EEG-driven MI discrimination. In particular, KCS-FCnet uses a single 1D-convolutional-based neural network to extract temporal-frequency features from raw EEG data and a cross-spectral Gaussian kernel connectivity layer to model channel functional relationships. As a result, the functional connectivity feature map reduces the number of parameters, improving interpretability by extracting meaningful patterns related to MI tasks. These patterns can be adapted to the subject’s unique characteristics. The validation results prove that introducing KCS-FCnet shallow architecture is a promising approach for EEG-based MI classification with the potential for real-world use in brain–computer interface systems.
Collapse
|
6
|
Duan X, Xie S, Lv Y, Xie X, Obermayer K, Yan H. A transfer learning-based feedback training motivates the performance of SMR-BCI. J Neural Eng 2023; 20. [PMID: 36577144 DOI: 10.1088/1741-2552/acaee7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 12/28/2022] [Indexed: 12/29/2022]
Abstract
Objective. Feedback training is a practical approach to brain-computer interface (BCI) end-users learning to modulate their sensorimotor rhythms (SMRs). BCI self-regulation learning has been shown to be influenced by subjective psychological factors, such as motivation. However, few studies have taken into account the users' self-motivation as additional guidance for the cognitive process involved in BCI learning. In this study we tested a transfer learning (TL) feedback method designed to increase self-motivation by providing information about past performance.Approach. Electroencephalography (EEG) signals from the previous runs were affine transformed and displayed as points on the screen, along with the newly recorded EEG signals in the current run, giving the subjects a context for self-motivation. Subjects were asked to separate the feedback points for the current run under the display of the separability of prior training. We conducted a between-subject feedback training experiment, in which 24 healthy SMR-BCI naive subjects were trained to imagine left- and right-hand movements. The participants were provided with either TL feedback or typical cursor-bar (CB) feedback (control condition), for three sessions on separate days.Main results. The behavioral results showed an increased challenge and stable mastery confidence, suggesting that subjects' motivation grew as the feedback training went on. The EEG results showed favorable overall training effects with TL feedback in terms of the class distinctiveness and EEG discriminancy. Performance was 28.5% higher in the third session than in the first. About 41.7% of the subjects were 'learners' including not only low-performance subjects, but also good-performance subjects who might be affected by the ceiling effect. Subjects were able to control BCI with TL feedback with a higher performance of 60.5% during the last session compared to CB feedback.Significance. The present study demonstrated that the proposed TL feedback method boosted psychological engagement through the self-motivated context, and further allowed subjects to modulate SMR effectively. The proposed TL feedback method also provided an alternative to typical CB feedback.
Collapse
Affiliation(s)
- Xu Duan
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China.,Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Wenyuan South Road, Xi'an 710128, People's Republic of China
| | - Songyun Xie
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Yanxia Lv
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Xinzhou Xie
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Klaus Obermayer
- Faculty of Electrical Engineering and Computer Science, Technical University Berlin, Marchstraße 23, Berlin 10587, Germany
| | - Hao Yan
- Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Wenyuan South Road, Xi'an 710128, People's Republic of China
| |
Collapse
|
7
|
Sawai S, Murata S, Fujikawa S, Yamamoto R, Shima K, Nakano H. Effects of neurofeedback training combined with transcranial direct current stimulation on motor imagery: A randomized controlled trial. Front Neurosci 2023; 17:1148336. [PMID: 36937688 PMCID: PMC10017549 DOI: 10.3389/fnins.2023.1148336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 02/16/2023] [Indexed: 03/06/2023] Open
Abstract
Introduction Neurofeedback (NFB) training and transcranial direct current stimulation (tDCS) have been shown to individually improve motor imagery (MI) abilities. However, the effect of combining both of them with MI has not been verified. Therefore, the aim of this study was to examine the effect of applying tDCS directly before MI with NFB. Methods Participants were divided into an NFB group (n = 10) that performed MI with NFB and an NFB + tDCS group (n = 10) that received tDCS for 10 min before MI with NFB. Both groups performed 60 MI trials with NFB. The MI task was performed 20 times without NFB before and after training, and μ-event-related desynchronization (ERD) and vividness MI were evaluated. Results μ-ERD increased significantly in the NFB + tDCS group compared to the NFB group. MI vividness significantly increased before and after training. Discussion Transcranial direct current stimulation and NFB modulate different processes with respect to MI ability improvement; hence, their combination might further improve MI performance. The results of this study indicate that the combination of NFB and tDCS for MI is more effective in improving MI abilities than applying them individually.
Collapse
Affiliation(s)
- Shun Sawai
- Graduate School of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- Department of Rehabilitation, Kyoto Kuno Hospital, Kyoto, Japan
| | - Shin Murata
- Graduate School of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Shoya Fujikawa
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
| | - Ryosuke Yamamoto
- Department of Rehabilitation, Tesseikai Neurosurgical Hospital, Shijonawate, Japan
| | - Keisuke Shima
- Graduate School of Environment and Information Sciences, Yokohama National University, Yokohama, Japan
| | - Hideki Nakano
- Graduate School of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- Department of Physical Therapy, Faculty of Health Sciences, Kyoto Tachibana University, Kyoto, Japan
- *Correspondence: Hideki Nakano,
| |
Collapse
|
8
|
Belkacem AN, Jamil N, Khalid S, Alnajjar F. On closed-loop brain stimulation systems for improving the quality of life of patients with neurological disorders. Front Hum Neurosci 2023; 17:1085173. [PMID: 37033911 PMCID: PMC10076878 DOI: 10.3389/fnhum.2023.1085173] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 03/06/2023] [Indexed: 04/11/2023] Open
Abstract
Emerging brain technologies have significantly transformed human life in recent decades. For instance, the closed-loop brain-computer interface (BCI) is an advanced software-hardware system that interprets electrical signals from neurons, allowing communication with and control of the environment. The system then transmits these signals as controlled commands and provides feedback to the brain to execute specific tasks. This paper analyzes and presents the latest research on closed-loop BCI that utilizes electric/magnetic stimulation, optogenetic, and sonogenetic techniques. These techniques have demonstrated great potential in improving the quality of life for patients suffering from neurodegenerative or psychiatric diseases. We provide a comprehensive and systematic review of research on the modalities of closed-loop BCI in recent decades. To achieve this, the authors used a set of defined criteria to shortlist studies from well-known research databases into categories of brain stimulation techniques. These categories include deep brain stimulation, transcranial magnetic stimulation, transcranial direct-current stimulation, transcranial alternating-current stimulation, and optogenetics. These techniques have been useful in treating a wide range of disorders, such as Alzheimer's and Parkinson's disease, dementia, and depression. In total, 76 studies were shortlisted and analyzed to illustrate how closed-loop BCI can considerably improve, enhance, and restore specific brain functions. The analysis revealed that literature in the area has not adequately covered closed-loop BCI in the context of cognitive neural prosthetics and implanted neural devices. However, the authors demonstrate that the applications of closed-loop BCI are highly beneficial, and the technology is continually evolving to improve the lives of individuals with various ailments, including those with sensory-motor issues or cognitive deficiencies. By utilizing emerging techniques of stimulation, closed-loop BCI can safely improve patients' cognitive and affective skills, resulting in better healthcare outcomes.
Collapse
Affiliation(s)
- Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
- *Correspondence: Abdelkader Nasreddine Belkacem
| | - Nuraini Jamil
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
| | - Sumayya Khalid
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
| | - Fady Alnajjar
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
- Center for Brain Science, RIKEN, Saitama, Japan
- Fady Alnajjar
| |
Collapse
|
9
|
Motor Imagery: How to Assess, Improve Its Performance, and Apply It for Psychosis Diagnostics. Diagnostics (Basel) 2022; 12:diagnostics12040949. [PMID: 35453997 PMCID: PMC9025310 DOI: 10.3390/diagnostics12040949] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 04/03/2022] [Accepted: 04/07/2022] [Indexed: 11/16/2022] Open
Abstract
With this review, we summarize the state-of-the-art of scientific studies in the field of motor imagery (MI) and motor execution (ME). We composed the brain map and description that correlate different brain areas with the type of movements it is responsible for. That gives a more complete and systematic picture of human brain functionality in the case of ME and MI. We systematized the most popular methods for assessing the quality of MI performance and discussed their advantages and disadvantages. We also reviewed the main directions for the use of transcranial magnetic stimulation (TMS) in MI research and considered the principal effects of TMS on MI performance. In addition, we discuss the main applications of MI, emphasizing its use in the diagnostics of various neurodegenerative disorders and psychoses. Finally, we discuss the research gap and possible improvements for further research in the field.
Collapse
|
10
|
Kuc A, Korchagin S, Maksimenko VA, Shusharina N, Hramov AE. Combining Statistical Analysis and Machine Learning for EEG Scalp Topograms Classification. Front Syst Neurosci 2021; 15:716897. [PMID: 34867218 PMCID: PMC8635058 DOI: 10.3389/fnsys.2021.716897] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 10/05/2021] [Indexed: 11/13/2022] Open
Abstract
Incorporating brain-computer interfaces (BCIs) into daily life requires reducing the reliance of decoding algorithms on the calibration or enabling calibration with the minimal burden on the user. A potential solution could be a pre-trained decoder demonstrating a reasonable accuracy on the naive operators. Addressing this issue, we considered ambiguous stimuli classification tasks and trained an artificial neural network to classify brain responses to the stimuli of low and high ambiguity. We built a pre-trained classifier utilizing time-frequency features corresponding to the fundamental neurophysiological processes shared between subjects. To extract these features, we statistically contrasted electroencephalographic (EEG) spectral power between the classes in the representative group of subjects. As a result, the pre-trained classifier achieved 74% accuracy on the data of newly recruited subjects. Analysis of the literature suggested that a pre-trained classifier could help naive users to start using BCI bypassing training and further increased accuracy during the feedback session. Thus, our results contribute to using BCI during paralysis or limb amputation when there is no explicit user-generated kinematic output to properly train a decoder. In machine learning, our approach may facilitate the development of transfer learning (TL) methods for addressing the cross-subject problem. It allows extracting the interpretable feature subspace from the source data (the representative group of subjects) related to the target data (a naive user), preventing the negative transfer in the cross-subject tasks.
Collapse
Affiliation(s)
- Alexander Kuc
- Center for Neurotechnology and Machine Learning, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
| | - Sergey Korchagin
- Department of Data Analysis and Machine Learning, Financial University Under the Government of the Russian Federation, Moscow, Russia
| | - Vladimir A Maksimenko
- Center for Neurotechnology and Machine Learning, Immanuel Kant Baltic Federal University, Kaliningrad, Russia.,Institute of Information Technologies, Mathematics and Mechanics, Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia.,Neuroscience and Cognitive Technology Laboratory, Innopolis University, Innopolis, Russia
| | - Natalia Shusharina
- Center for Neurotechnology and Machine Learning, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
| | - Alexander E Hramov
- Center for Neurotechnology and Machine Learning, Immanuel Kant Baltic Federal University, Kaliningrad, Russia.,Institute of Information Technologies, Mathematics and Mechanics, Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia.,Neuroscience and Cognitive Technology Laboratory, Innopolis University, Innopolis, Russia
| |
Collapse
|
11
|
Park S, Ha J, Kim DH, Kim L. Improving Motor Imagery-Based Brain-Computer Interface Performance Based on Sensory Stimulation Training: An Approach Focused on Poorly Performing Users. Front Neurosci 2021; 15:732545. [PMID: 34803582 PMCID: PMC8602688 DOI: 10.3389/fnins.2021.732545] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 10/20/2021] [Indexed: 11/13/2022] Open
Abstract
The motor imagery (MI)-based brain-computer interface (BCI) is an intuitive interface that provides control over computer applications directly from brain activity. However, it has shown poor performance compared to other BCI systems such as P300 and SSVEP BCI. Thus, this study aimed to improve MI-BCI performance by training participants in MI with the help of sensory inputs from tangible objects (i.e., hard and rough balls), with a focus on poorly performing users. The proposed method is a hybrid of training and imagery, combining motor execution and somatosensory sensation from a ball-type stimulus. Fourteen healthy participants participated in the somatosensory-motor imagery (SMI) experiments (within-subject design) involving EEG data classification with a three-class system (signaling with left hand, right hand, or right foot). In the scenario of controlling a remote robot to move it to the target point, the participants performed MI when faced with a three-way intersection. The SMI condition had a better classification performance than did the MI condition, achieving a 68.88% classification performance averaged over all participants, which was 6.59% larger than that in the MI condition (p < 0.05). In poor performers, the classification performance in SMI was 10.73% larger than in the MI condition (62.18% vs. 51.45%). However, good performers showed a slight performance decrement (0.86%) in the SMI condition compared to the MI condition (80.93% vs. 81.79%). Combining the brain signals from the motor and somatosensory cortex, the proposed hybrid MI-BCI system demonstrated improved classification performance, this phenomenon was predominant in poor performers (eight out of nine subjects). Hybrid MI-BCI systems may significantly contribute to reducing the proportion of BCI-inefficiency users and closing the performance gap with other BCI systems.
Collapse
Affiliation(s)
- Sangin Park
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
| | - Jihyeon Ha
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| | - Da-Hye Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
| | - Laehyun Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
- Department of HY-KIST Bio-Convergence, Hanyang University, Seoul, South Korea
| |
Collapse
|
12
|
BCI-Based Control for Ankle Exoskeleton T-FLEX: Comparison of Visual and Haptic Stimuli with Stroke Survivors. SENSORS 2021; 21:s21196431. [PMID: 34640750 PMCID: PMC8512904 DOI: 10.3390/s21196431] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 08/31/2021] [Accepted: 09/15/2021] [Indexed: 11/16/2022]
Abstract
Brain–computer interface (BCI) remains an emerging tool that seeks to improve the patient interaction with the therapeutic mechanisms and to generate neuroplasticity progressively through neuromotor abilities. Motor imagery (MI) analysis is the most used paradigm based on the motor cortex’s electrical activity to detect movement intention. It has been shown that motor imagery mental practice with movement-associated stimuli may offer an effective strategy to facilitate motor recovery in brain injury patients. In this sense, this study aims to present the BCI associated with visual and haptic stimuli to facilitate MI generation and control the T-FLEX ankle exoskeleton. To achieve this, five post-stroke patients (55–63 years) were subjected to three different strategies using T-FLEX: stationary therapy (ST) without motor imagination, motor imagination with visual stimulation (MIV), and motor imagination with visual-haptic inducement (MIVH). The quantitative characterization of both BCI stimuli strategies was made through the motor imagery accuracy rate, the electroencephalographic (EEG) analysis during the MI active periods, the statistical analysis, and a subjective patient’s perception. The preliminary results demonstrated the viability of the BCI-controlled ankle exoskeleton system with the beta rebound, in terms of patient’s performance during MI active periods and satisfaction outcomes. Accuracy differences employing haptic stimulus were detected with an average of 68% compared with the 50.7% over only visual stimulus. However, the power spectral density (PSD) did not present changes in prominent activation of the MI band but presented significant variations in terms of laterality. In this way, visual and haptic stimuli improved the subject’s MI accuracy but did not generate differential brain activity over the affected hemisphere. Hence, long-term sessions with a more extensive sample and a more robust algorithm should be carried out to evaluate the impact of the proposed system on neuronal and motor evolution after stroke.
Collapse
|