1
|
de Melo GC, Castellano G, Forner-Cordero A. Identification and analysis of reference-independent movement event-related desynchronization. Biomed Phys Eng Express 2025; 11:025001. [PMID: 39705724 DOI: 10.1088/2057-1976/ada1dc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2024] [Accepted: 12/20/2024] [Indexed: 12/22/2024]
Abstract
Characterization of the electroencephalography (EEG) signals related to motor activity, such as alpha- and beta-band motor event-related desynchronizations (ERDs), is essential for Brain Computer Interface (BCI) development. Determining the best electrode combination to detect the ERD is crucial for the success of the BCI. Considering that the EEG signals are bipolar, this involves the choice of the main and reference electrodes. So far, no strategy to guarantee signals free of the activity from the reference electrode has achieved consensus among the scientific community. Therefore, mapping the ERD in terms of the spatial distribution of the main and reference electrodes can provide additional perspectives for the BCI field. The goal of this work is to identify subject-specific channels where ERD is temporally coupled to the initiation of an upper-limb motor task. We defined a criterion to determine the presence of the ERD linked to the movement onset and searched, separately for each subject, for the single channel with the most prominent ERD. The search was conducted over all available channels composed by a pair of electrodes, and the selected signals were analyzed according to their temporal and spatial characteristics. We found that alpha- and beta-band ERD temporarily linked to movement onset can be detected in atypical channels (pairs of electrodes) across the scalp. The selected channels were different across subjects. Four ERD temporal patterns were observed in terms of the initiation instant of the ERD. These patterns revealed that the M1 cortex seems to be related to later ERDs. Moreover, they were also associated to different cortical processes related to the motor task. To the best of our knowledge, this is the first time these findings are reported. Aiming at BCI development, further experiments with more subjects and with motor-imagery tasks are desirable for more robustness and applicability of these findings.
Collapse
Affiliation(s)
- Gabriel Chaves de Melo
- Biomechatronics Laboratory, Department of Mechatronics and Mechanical Systems of the Escola Politécnica, Universidade de São Paulo (USP), São Paulo, SP, Brazil
- Institute of Physics Gleb Wataghin, Universidade Estadual de Campinas (UNICAMP), Campinas, SP, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology (BRAINN), Campinas, SP, Brazil
| | - Gabriela Castellano
- Institute of Physics Gleb Wataghin, Universidade Estadual de Campinas (UNICAMP), Campinas, SP, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology (BRAINN), Campinas, SP, Brazil
| | - Arturo Forner-Cordero
- Biomechatronics Laboratory, Department of Mechatronics and Mechanical Systems of the Escola Politécnica, Universidade de São Paulo (USP), São Paulo, SP, Brazil
| |
Collapse
|
2
|
Marques LM, Castellani A, Barbosa SP, Imamura M, Battistella LR, Simis M, Fregni F. Neuroplasticity changes in knee osteoarthritis (KOA) indexed by event-related desynchronization/synchronization during a motor inhibition task. Somatosens Mot Res 2024; 41:149-158. [PMID: 36921090 DOI: 10.1080/08990220.2023.2188926] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 03/06/2023] [Indexed: 03/17/2023]
Abstract
PURPOSE Event-related desynchronisation (ERD) and event-related synchronisation (ERS) reflect pain perception and integration of the nociceptive sensory inputs. This may contribute to the understanding of how neurophysiological markers of Knee Osteoarthritis (KOA) patients can differ from control individuals, which would improve aspects such as prediction and prognosis. We performed a cross-sectional analysis of our cohort study (DEFINE cohort), KOA arm, with 71 patients, compared with 65 control participants. The study aimed to examine possible differences between ERD and ERS in control participants compared to Knee Osteoarthritis (KOA) patients when adjusting for important covariates. MATERIALS AND METHODS We performed independent multivariate regression models considering as dependent variables the power value related to ERD and ERS for four different sensorimotor tasks (Motor Execution, Motor Imagery, Active Observation and Passive Observation) and four sensorimotor oscillations (Alpha, Beta, Low Beta, and High Beta), each model, controlled by age and sex. RESULTS We demonstrate that the differences between KOA and healthy subjects are frequency specific, as most differences are in the beta bandwidth range. Also, we observed that subjects in the KOA group had significantly higher ERD and ERS. This may be correlated to the amount of lack of brain organisation and a subsequent attempt at compensation induced by KOA. CONCLUSIONS Our findings strengthen the notion that subjects with KOA have a higher degree of brain plasticity changes that are also likely correlated to the degree of compensation and behavioural dysfunction.
Collapse
Affiliation(s)
- Lucas M Marques
- Instituto de Medicina Fisica e Reabilitacao, Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, SP, Brazil
| | - Ana Castellani
- Instituto de Medicina Fisica e Reabilitacao, Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, SP, Brazil
| | - Sara P Barbosa
- Instituto de Medicina Fisica e Reabilitacao, Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, SP, Brazil
| | - Marta Imamura
- Instituto de Medicina Fisica e Reabilitacao, Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, SP, Brazil
- Departamento de Medicina Legal, Bioética, Medicina do Trabalho e Medicina Física e Reabilitação, Faculdade de Medicina da Universidade de São Paulo, São Paulo, Brazil
| | - Linamara R Battistella
- Instituto de Medicina Fisica e Reabilitacao, Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, SP, Brazil
- Departamento de Medicina Legal, Bioética, Medicina do Trabalho e Medicina Física e Reabilitação, Faculdade de Medicina da Universidade de São Paulo, São Paulo, Brazil
| | - Marcel Simis
- Instituto de Medicina Fisica e Reabilitacao, Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, SP, Brazil
- Departamento de Medicina Legal, Bioética, Medicina do Trabalho e Medicina Física e Reabilitação, Faculdade de Medicina da Universidade de São Paulo, São Paulo, Brazil
| | - Felipe Fregni
- Neuromodulation Center and Center for Clinical Research Learning, Spaulding Rehabilitation Hospital and Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
3
|
Furuta T, Morita T, Miura G, Naito E. Structural and functional features characterizing the brains of individuals with higher controllability of motor imagery. Sci Rep 2024; 14:17243. [PMID: 39060339 PMCID: PMC11282224 DOI: 10.1038/s41598-024-68425-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 07/23/2024] [Indexed: 07/28/2024] Open
Abstract
Motor imagery is a higher-order cognitive brain function that mentally simulates movements without performing the actual physical one. Although motor imagery has attracted the interest of many researchers, and mental practice utilizing motor imagery has been widely used in sports training and post-stroke rehabilitation, neural bases that determine individual differences in motor imagery ability are not well understood. In this study, using controllability of motor imagery (CMI) test that can objectively evaluate individual ability to manipulate one's imaginary postures, we examined structural and functional features characterizing the brains of individuals with higher controllability of motor imagery, by analyzing T1-weighted structural MRI data obtained from 89 participants and functional MRI data obtained from 28 of 89 participants. The higher CMI test scorers had larger volume in the bilateral superior frontoparietal white matter regions. The CMI test activated the bilateral dorsal premotor cortex (PMD) and superior parietal lobule (SPL); specifically, the left PMD and/or the right SPL enhanced functional coupling with the visual body, somatosensory, and motor/kinesthetic areas in the higher scorers. Hence, controllability of motor imagery is higher for those who well-develop superior frontoparietal network, and for those whose this network accesses these sensory areas to predict the expected multisensory experiences during motor imagery. This study elucidated for the first time the structural and functional features characterizing the brains of individuals with higher controllability of motor imagery, and advanced understanding of individual differences in motor imagery ability.
Collapse
Affiliation(s)
- Tomoya Furuta
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Graduate School of Frontier Biosciences, Osaka University, 1-3 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Tomoyo Morita
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Graduate School of Frontier Biosciences, Osaka University, 1-3 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Gen Miura
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Graduate School of Frontier Biosciences, Osaka University, 1-3 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Eiichi Naito
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan.
- Graduate School of Frontier Biosciences, Osaka University, 1-3 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| |
Collapse
|
4
|
Camargo L, Pacheco-Barrios K, Marques LM, Caumo W, Fregni F. Adaptive and Compensatory Neural Signatures in Fibromyalgia: An Analysis of Resting-State and Stimulus-Evoked EEG Oscillations. Biomedicines 2024; 12:1428. [PMID: 39062001 PMCID: PMC11274211 DOI: 10.3390/biomedicines12071428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 06/22/2024] [Accepted: 06/26/2024] [Indexed: 07/28/2024] Open
Abstract
This study aimed to investigate clinical and physiological predictors of brain oscillatory activity in patients with fibromyalgia (FM), assessing resting-state power, event-related desynchronization (ERD), and event-related synchronization (ERS) during tasks. We performed a cross-sectional analysis, including clinical and neurophysiological data from 78 subjects with FM. Multivariate regression models were built to explore predictors of electroencephalography bands. Our findings show a negative correlation between beta oscillations and pain intensity; fibromyalgia duration is positively associated with increased oscillatory power at low frequencies and in the beta band; ERS oscillations in the theta and alpha bands seem to be correlated with better symptoms of FM; fatigue has a signature in the alpha band-a positive relationship in resting-state and a negative relationship in ERS oscillations. Specific neural signatures lead to potential clusters of neural adaptation, in which beta oscillatory activity in the resting state represents a more adaptive activity when pain levels are low and stimulus-evoked oscillations at lower frequencies are likely brain compensatory mechanisms. These neurophysiological changes may help to understand the impact of long-term chronic pain in the central nervous system and the descending inhibitory system in fibromyalgia subjects.
Collapse
Affiliation(s)
- Lucas Camargo
- Neuromodulation Center and Center for Clinical Research Learning, Spaulding Rehabilitation Hospital and Massachusetts General Hospital, Harvard Medical School, Boston, MA 02115, USA; (L.C.); (K.P.-B.)
| | - Kevin Pacheco-Barrios
- Neuromodulation Center and Center for Clinical Research Learning, Spaulding Rehabilitation Hospital and Massachusetts General Hospital, Harvard Medical School, Boston, MA 02115, USA; (L.C.); (K.P.-B.)
- Unidad de Investigación para la Generación y Síntesis de Evidencias en Salud, Universidad San Ignacio de Loyola, Lima 15024, Peru
| | - Lucas M. Marques
- Mental Health Department, Santa Casa de São Paulo School of Medical Sciences, São Paulo 01238-010, Brazil;
| | - Wolnei Caumo
- School of Medicine, Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre 90010-150, Brazil;
- Laboratory of Pain and Neuromodulation, Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre 90035-903, Brazil
| | - Felipe Fregni
- Neuromodulation Center and Center for Clinical Research Learning, Spaulding Rehabilitation Hospital and Massachusetts General Hospital, Harvard Medical School, Boston, MA 02115, USA; (L.C.); (K.P.-B.)
| |
Collapse
|
5
|
Tien HP, Chang EC. Inequivalent and uncorrelated response priming in motor imagery and execution. Front Psychol 2024; 15:1363495. [PMID: 38860046 PMCID: PMC11163096 DOI: 10.3389/fpsyg.2024.1363495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Accepted: 05/13/2024] [Indexed: 06/12/2024] Open
Abstract
Introduction Theoretical considerations on motor imagery and motor execution have long been dominated by the functional equivalence view. Previous empirical works comparing these two modes of actions, however, have largely relied on subjective judgments on the imagery process, which may be exposed to various biases. The current study aims to re-examine the commonality and distinguishable aspects of motor imagery and execution via a response repetition paradigm. This framework aims to offer an alternative approach devoid of self-reporting, opening the opportunity for less subjective evaluation of the disparities and correlations between motor imagery and motor execution. Methods Participants performed manual speeded-choice on prime-probe pairs in each trial under three conditions distinguished by the modes of response on the prime: mere observation (Perceptual), imagining response (Imagery), and actual responses (Execution). Responses to the following probe were all actual execution of button press. While Experiment 1 compared the basic repetition effects in the three prime conditions, Experiment 2 extended the prime duration to enhance the quality of MI and monitored electromyography (EMG) for excluding prime imagery with muscle activities to enhance specificity of the underlying mechanism. Results In Experiment 1, there was no significant repetition effect after mere observation. However, significant repetition effects were observed in both imagery and execution conditions, respectively, which were also significantly correlated. In Experiment 2, trials with excessive EMG activities were excluded before further statistical analysis. A consistent repetition effect pattern in both Imagery and Execution but not the Perception condition. Now the correlation between Imagery and Execution conditions were not significant. Conclusion Findings from the current study provide a novel application of a classical paradigm, aiming to minimize the subjectivity inherent in imagery assessments while examining the relationship between motor imagery and motor execution. By highlighting differences and the absence of correlation in repetition effects, the study challenges the functional equivalence hypothesis of imagery and execution. Motor representations of imagery and execution, when measured without subjective judgments, appear to be more distinguishable than traditionally thought. Future studies may examine the neural underpinnings of the response repetition paradigm to further elucidating the common and separable aspects of these two modes of action.
Collapse
Affiliation(s)
- Hsin-Ping Tien
- Action and Cognition Laboratory, Institute of Cognitive Neuroscience, College of Health Sciences and Technology, National Central University, Taoyuan, Taiwan
- Taiwan International Graduate Program in Interdisciplinary Neuroscience, National Central University and Academia Sinica, Taipei, Taiwan
| | - Erik C. Chang
- Action and Cognition Laboratory, Institute of Cognitive Neuroscience, College of Health Sciences and Technology, National Central University, Taoyuan, Taiwan
| |
Collapse
|
6
|
Xu X, Fan X, Dong J, Zhang X, Song Z, Li W, Pu F. Event-Related EEG Desynchronization Reveals Enhanced Motor Imagery From the Third Person Perspective by Manipulating Sense of Body Ownership With Virtual Reality for Stroke Patients. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1055-1067. [PMID: 38349835 DOI: 10.1109/tnsre.2024.3365587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/15/2024]
Abstract
Virtual reality (VR)-based rehabilitation training holds great potential for post-stroke motor recovery. Existing VR-based motor imagery (MI) paradigms mostly focus on the first-person perspective, and the benefit of the third-person perspective (3PP) remains to be further exploited. The 3PP is advantageous for movements involving the back or those with a large range because of its field coverage. Some movements are easier to imagine from the 3PP. However, the 3PP training efficiency may be unsatisfactory, which may be attributed to the difficulty encountered when generating a strong sense of ownership (SOO). In this work, we attempt to enhance a visual-guided 3PP MI in stroke patients by eliciting the SOO over a virtual avatar with VR. We propose to achieve this by inducing the so-called out-of-body experience (OBE), which is a full-body illusion (FBI) that people misperceive a 3PP virtual body as his/her own (i.e., generating the SOO to the virtual body). Electroencephalography signals of 13 stroke patients are recorded while MI of the affected upper limb is being performed. The proposed paradigm is evaluated by comparing event-related desynchronization (ERD) with a control paradigm without FBI induction. The results show that the proposed paradigm leads to a significantly larger ERD during MI, indicating a bilateral activation pattern consistent with that in previous studies. In conclusion, 3PP MI can be enhanced in stroke patients by eliciting the SOO through induction of the "OBE" FBI. This study offers more possibilities for virtual rehabilitation in stroke patients and can further facilitate VR application in rehabilitation.
Collapse
|
7
|
Lei Y, Wang D, Wang W, Qu H, Wang J, Shi B. Improving single-hand open/close motor imagery classification by error-related potentials correction. Heliyon 2023; 9:e18452. [PMID: 37520987 PMCID: PMC10382287 DOI: 10.1016/j.heliyon.2023.e18452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 07/15/2023] [Accepted: 07/18/2023] [Indexed: 08/01/2023] Open
Abstract
Objective The ability of a brain-computer interface (BCI) to classify brain activity in electroencephalograms (EEG) during motor imagery (MI) tasks is an important performance indicator. Because the cortical regions that drive the single-handed open and closed tasks overlap, it is difficult to classify the EEG signals during executing both tasks. Approach The addition of special EEG features can improve the accuracy of classifying single-hand open and closed tasks. In this work, we designed a hybrid BCI paradigm based on error-related potentials (ErrP) and motor imagery (MI) and proposed a strategy to correct the classification results of MI by using ErrP information. The ErrP and MI features of EEG data from 11 subjects were superimposed. Main results The corrected strategy improved the classification accuracy of single-hand open/close MI tasks from 52.3% to 73.7%, an increase of approximately 21%. Significance Our hybrid BCI paradigm improves the classification accuracy of single-hand MI by adding ErrP information, which provides a new approach for improving the classification performance of BCI.
Collapse
Affiliation(s)
- Yanghao Lei
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi'an Jiaotong University, Xi' an,710049, China
- Research Institute of NRR-Neurorehabilitation Robot, Xi' an Jiaotong University, Xi' an,710049, China
| | - Dong Wang
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi'an Jiaotong University, Xi' an,710049, China
- Research Institute of NRR-Neurorehabilitation Robot, Xi' an Jiaotong University, Xi' an,710049, China
| | - Weizhen Wang
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi'an Jiaotong University, Xi' an,710049, China
- Research Institute of NRR-Neurorehabilitation Robot, Xi' an Jiaotong University, Xi' an,710049, China
| | - Hao Qu
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi'an Jiaotong University, Xi' an,710049, China
- Research Institute of NRR-Neurorehabilitation Robot, Xi' an Jiaotong University, Xi' an,710049, China
| | - Jing Wang
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi'an Jiaotong University, Xi' an,710049, China
- Research Institute of NRR-Neurorehabilitation Robot, Xi' an Jiaotong University, Xi' an,710049, China
| | - Bin Shi
- PLA Rocket Force University of Engineering Xi'an, Xi' an, 710025, China
| |
Collapse
|
8
|
Russo JS, Chodhary M, Strik M, Shiels TA, Lin CHS, John SE, Grayden DB. Feasibility of Using Source-Level Brain Computer Interface for People with Multiple Sclerosis. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083693 DOI: 10.1109/embc40787.2023.10340364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
This work evaluates the feasibility of using a source level Brain-Computer Interface (BCI) for people with Multiple Sclerosis (MS). Data used was previously collected EEG of eight participants (one participant with MS and seven neurotypical participants) who performed imagined movement of the right and left hand. Equivalent current dipole cluster fitting was used to assess related brain activity at the source level and assessed using dipole location and power spectrum analysis. Dipole clusters were resolved within the motor cortices with some notable spatial difference between the MS and control participants. Neural sources that generate motor imagery originated from similar motor areas in the participant with MS compared to the neurotypical participants. Power spectral analysis indicated a reduced level of alpha power in the participant with MS during imagery tasks compared to neurotypical participants. Power in the beta band may be used to distinguish between left and right imagined movement for users with MS in BCI applications.Clinical Relevance- This paper demonstrates the cortical areas activated during imagined BCI-type tasks in a participant with Multiple Sclerosis (MS), and is a proof of concept for translating BCI research to potential users with MS.
Collapse
|
9
|
Wang W, Shi B, Wang D, Wang J, Liu G. Enhanced lower-limb motor imagery by kinesthetic illusion. Front Neurosci 2023; 17:1077479. [PMID: 37409102 PMCID: PMC10319417 DOI: 10.3389/fnins.2023.1077479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Accepted: 05/30/2023] [Indexed: 07/07/2023] Open
Abstract
Brain-computer interface (BCI) based on lower-limb motor imagery (LMI) enables hemiplegic patients to stand and walk independently. However, LMI ability is usually poor for BCI-illiterate (e.g., some stroke patients), limiting BCI performance. This study proposed a novel LMI-BCI paradigm with kinesthetic illusion(KI) induced by vibratory stimulation on Achilles tendon to enhance LMI ability. Sixteen healthy subjects were recruited to carry out two research contents: (1) To verify the feasibility of induced KI by vibrating Achilles tendon and analyze the EEG features produced by KI, research 1 compared the subjective feeling and brain activity of participants during rest task with and without vibratory stimulation (V-rest, rest). (2) Research 2 compared the LMI-BCI performance with and without KI (KI-LMI, no-LMI) to explore whether KI enhances LMI ability. The analysis methods of both experiments included classification accuracy (V-rest vs. rest, no-LMI vs. rest, KI-LMI vs. rest, KI-LMI vs. V-rest), time-domain features, oral questionnaire, statistic analysis and brain functional connectivity analysis. Research 1 verified that induced KI by vibrating Achilles tendon might be feasible, and provided a theoretical basis for applying KI to LMI-BCI paradigm, evidenced by oral questionnaire (Q1) and the independent effect of vibratory stimulation during rest task. The results of research 2 that KI enhanced mesial cortex activation and induced more intensive EEG features, evidenced by ERD power, topographical distribution, oral questionnaire (Q2 and Q3), and brain functional connectivity map. Additionally, the KI increased the offline accuracy of no-LMI/rest task by 6.88 to 82.19% (p < 0.001). The simulated online accuracy was also improved for most subjects (average accuracy for all subjects: 77.23% > 75.31%, and average F1_score for all subjects: 76.4% > 74.3%). The LMI-BCI paradigm of this study provides a novel approach to enhance LMI ability and accelerates the practical applications of the LMI-BCI system.
Collapse
Affiliation(s)
- Weizhen Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Bin Shi
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Dong Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Jing Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Gang Liu
- Henan Key Laboratory of Brain Science and Brain-Computer Interface Technology, School of Electrical Engineering, Zhengzhou University, Zhengzhou, China
| |
Collapse
|
10
|
Su WC, Dashtestani H, Miguel HO, Condy E, Buckley A, Park S, Perreault JB, Nguyen T, Zeytinoglu S, Millerhagen J, Fox N, Gandjbakhche A. Simultaneous multimodal fNIRS-EEG recordings reveal new insights in neural activity during motor execution, observation, and imagery. Sci Rep 2023; 13:5151. [PMID: 36991003 PMCID: PMC10060581 DOI: 10.1038/s41598-023-31609-5] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 03/14/2023] [Indexed: 03/31/2023] Open
Abstract
Motor execution, observation, and imagery are important skills used in motor learning and rehabilitation. The neural mechanisms underlying these cognitive-motor processes are still poorly understood. We used a simultaneous recording of functional near-infrared spectroscopy (fNIRS) and electroencephalogram (EEG) to elucidate the differences in neural activity across three conditions requiring these processes. Additionally, we used a new method called structured sparse multiset Canonical Correlation Analysis (ssmCCA) to fuse the fNIRS and EEG data and determine the brain regions of neural activity consistently detected by both modalities. Unimodal analyses revealed differentiated activation between conditions; however, the activated regions did not fully overlap across the two modalities (fNIRS: left angular gyrus, right supramarginal gyrus, as well as right superior and inferior parietal lobes; EEG: bilateral central, right frontal, and parietal). These discrepancies might be because fNIRS and EEG detect different signals. Using fused fNIRS-EEG data, we consistently found activation over the left inferior parietal lobe, superior marginal gyrus, and post-central gyrus during all three conditions, suggesting that our multimodal approach identifies a shared neural region associated with the Action Observation Network (AON). This study highlights the strengths of using the multimodal fNIRS-EEG fusion technique for studying AON. Neural researchers should consider using the multimodal approach to validate their findings.
Collapse
Affiliation(s)
- Wan-Chun Su
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Hadis Dashtestani
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Helga O Miguel
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Emma Condy
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Aaron Buckley
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Soongho Park
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - John B Perreault
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Thien Nguyen
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Selin Zeytinoglu
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD, USA
| | - John Millerhagen
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA
| | - Nathan Fox
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD, USA
| | - Amir Gandjbakhche
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|
11
|
Rizzo M, Petrini L, Del Percio C, Lopez S, Arendt‐Nielsen L, Babiloni C. Mirror visual feedback during unilateral finger movements is related to the desynchronization of cortical electroencephalographic somatomotor alpha rhythms. Psychophysiology 2022; 59:e14116. [PMID: 35657095 PMCID: PMC9788070 DOI: 10.1111/psyp.14116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Revised: 04/21/2022] [Accepted: 05/04/2022] [Indexed: 12/30/2022]
Abstract
Using a mirror adequately oriented, the motion of just one hand induces the illusion of the movement with the other hand. Here, we tested the hypothesis that such a mirror phenomenon may be underpinned by an electroencephalographic (EEG) event-related desynchronization/synchronization (ERD/ERS) of central alpha rhythms (around 10 Hz) as a neurophysiological measure of the interactions among cerebral cortex, basal ganglia, and thalamus during movement preparation and execution. Eighteen healthy right-handed male participants performed standard auditory-triggered unilateral (right) or bilateral finger movements in the No Mirror (M-) conditions. In the Mirror (M+) condition, the unilateral right finger movements were performed in front of a mirror oriented to induce the illusion of simultaneous left finger movements. EEG activity was recorded from 64 scalp electrodes, and the artifact-free event-related EEG epochs were used to compute alpha ERD. In the M- conditions, a bilateral prominent central alpha ERD was observed during the bilateral movements, while left central alpha ERD and right alpha ERS were seen during unilateral right movements. In contrast, the M+ condition showed significant bilateral and widespread alpha ERD during the unilateral right movements. These results suggest that the above illusion of the left movements may be related to alpha ERD measures reflecting excitatory desynchronizing signals in right lateral premotor and primary somatomotor areas possibly in relation to basal ganglia-thalamic loops.
Collapse
Affiliation(s)
- Marco Rizzo
- Center for Neuroplasticity and Pain (CNAP), SMIDepartment of Health Science and TechnologyAalborg UniversityAalborgDenmark
| | - Laura Petrini
- Center for Neuroplasticity and Pain (CNAP), SMIDepartment of Health Science and TechnologyAalborg UniversityAalborgDenmark
| | - Claudio Del Percio
- Department of Physiology and Pharmacology “V. Erspamer”Sapienza University of RomeRomeItaly
| | - Susanna Lopez
- Department of Physiology and Pharmacology “V. Erspamer”Sapienza University of RomeRomeItaly
| | - Lars Arendt‐Nielsen
- Center for Neuroplasticity and Pain (CNAP), SMIDepartment of Health Science and TechnologyAalborg UniversityAalborgDenmark,Department of Medical Gastroenterology, Mech‐SenseAalborg University HospitalAalborgDenmark
| | - Claudio Babiloni
- Department of Physiology and Pharmacology “V. Erspamer”Sapienza University of RomeRomeItaly
| |
Collapse
|
12
|
Marques LM, Barbosa SP, Pacheco-Barrios K, Goncalves FT, Imamura M, Battistella LR, Simis M, Fregni F. Motor event-related synchronization as an inhibitory biomarker of pain severity, sensitivity, and chronicity in patients with knee osteoarthritis. Neurophysiol Clin 2022; 52:413-426. [DOI: 10.1016/j.neucli.2022.09.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 09/20/2022] [Accepted: 09/26/2022] [Indexed: 11/06/2022] Open
|
13
|
Wang TC, Huang YY, Duann JR. Sources of independent mu components reveal different brain areas involved in motor imagery, motor execution, and movement observation. Brain Res 2022; 1796:148075. [PMID: 36084693 DOI: 10.1016/j.brainres.2022.148075] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2022] [Revised: 08/30/2022] [Accepted: 09/02/2022] [Indexed: 11/02/2022]
Abstract
To answer the question of whether the same brain circuit(s) facilitates motor imagery (MI), motor execution (ME), and movement observation (MO), we conducted electroencephalography (EEG) experiment combining the three motor conditions in the same experimental runs. The EEG data were analyzed using two different independent component analysis (ICA) decomposition approaches: a single ICA decomposition on all EEG data combined and separate ICA decomposition on the EEG data obtained from the separate conditions. The results indicated that the separate ICA approach may provide a better fit to the EEG data obtained from the separate conditions to deliver specific independent right mu components with distinct topographies for each of the motor conditions. The topography of the MI condition covered the brain regions posterior to the central sulcus (P4 EEG channel); the ME condition covered the brain regions anterior to the central sulcus (C4 EEG channel), and the MO condition had broader coverage with the main activation in the premotor region (CP4 EEG channel). The source localization results also exhibited significant differences among the motor conditions. In addition, the result of single ICA decomposition resembled the result of separate ICA decomposition on the EEG data of ME with similar topographies and closely located EEG sources. This finding may further indicate that the result of single ICA decomposition may be dominated by the ME motor condition because it manifests higher data variance than the other two motor conditions.
Collapse
Affiliation(s)
- Tien-Ching Wang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan 32010, Taiwan
| | - Yu-Yu Huang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan 32010, Taiwan
| | - Jeng-Ren Duann
- Institute of Education, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan; Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, United States.
| |
Collapse
|
14
|
Xie J, Zhang J, Sun J, Ma Z, Qin L, Li G, Zhou H, Zhan Y. A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2126-2136. [PMID: 35914032 DOI: 10.1109/tnsre.2022.3194600] [Citation(s) in RCA: 58] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The attention mechanism of the Transformer has the advantage of extracting feature correlation in the long-sequence data and visualizing the model. As time-series data, the spatial and temporal dependencies of the EEG signals between the time points and the different channels contain important information for accurate classification. So far, Transformer-based approaches have not been widely explored in motor-imagery EEG classification and visualization, especially lacking general models based on cross-individual validation. Taking advantage of the Transformer model and the spatial-temporal characteristics of the EEG signals, we designed Transformer-based models for classifications of motor imagery EEG based on the PhysioNet dataset. With 3s EEG data, our models obtained the best classification accuracy of 83.31%, 74.44%, and 64.22% on two-, three-, and four-class motor-imagery tasks in cross-individual validation, which outperformed other state-of-the-art models by 0.88%, 2.11%, and 1.06%. The inclusion of the positional embedding modules in the Transformer could improve the EEG classification performance. Furthermore, the visualization results of attention weights provided insights into the working mechanism of the Transformer-based networks during motor imagery tasks. The topography of the attention weights revealed a pattern of event-related desynchronization (ERD) which was consistent with the results from the spectral analysis of Mu and beta rhythm over the sensorimotor areas. Together, our deep learning methods not only provide novel and powerful tools for classifying and understanding EEG data but also have broad applications for brain-computer interface (BCI) systems.
Collapse
|
15
|
Chi X, Wan C, Wang C, Zhang Y, Chen X, Cui H. A Novel Hybrid Brain-Computer Interface Combining Motor Imagery and Intermodulation Steady-State Visual Evoked Potential. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1525-1535. [PMID: 35657833 DOI: 10.1109/tnsre.2022.3179971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The hybrid brain-computer interface (hBCI) combining motor imagery (MI) and steady-state visual evoked potential (SSVEP) has been proven to have better performance than a pure MI- or SSVEP-based brain-computer interface (BCI). In most studies on hBCIs, subjects have been required to focus their attention on flickering light-emitting diodes (LEDs) or blocks while imagining body movements. However, these two classical tasks performed concurrently have a poor correlation. Therefore, it is necessary to reduce the task complexity of such a system and improve its user-friendliness. Aiming to achieve this goal, this study proposes a novel hybrid BCI that combines MI and intermodulation SSVEPs. In the proposed system, images of both hands flicker at the same frequency (i.e., 30 Hz) but at different grasp frequencies (i.e., 1 Hz for the left hand, and 1.5 Hz for the right hand), resulting in different intermodulation frequencies for encoding targets. Additionally, movement observation for subjects can help to perform the MI task better. In this study, two types of brain signals are classified independently and then fused by a scoring mechanism based on the probability distribution of relevant parameters. The online verification results showed that the average accuracies of 12 healthy subjects and 11 stroke patients were 92.40 ± 7.45% and 73.07 ± 9.07%, respectively. The average accuracies of 10 healthy subjects in the MI, SSVEP, and hybrid tasks were 84.00 ± 12.81%, 80.75 ± 8.08%, and 89.00 ± 9.94%, respectively. The high recognition accuracy verifies the feasibility and robustness of the proposed system. This study provides a novel and natural paradigm for a hybrid BCI based on MI and SSVEP.
Collapse
|
16
|
Kumari R, Janković M, Costa A, Savić A, Konstantinović L, Djordjević O, Vucković A. Short term priming effect of brain-actuated muscle stimulation using bimanual movements in stroke. Clin Neurophysiol 2022; 138:108-121. [DOI: 10.1016/j.clinph.2022.03.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 02/26/2022] [Accepted: 03/01/2022] [Indexed: 11/03/2022]
|
17
|
Zhou L, Zhu Q, Wu B, Qin B, Hu H, Qian Z. A comparison of directed functional connectivity among fist-related brain activities during movement imagery, movement execution, and movement observation. Brain Res 2021; 1777:147769. [PMID: 34971597 DOI: 10.1016/j.brainres.2021.147769] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 12/03/2021] [Accepted: 12/24/2021] [Indexed: 12/22/2022]
Abstract
Brain-computer interface (BCI) has been widely used in sports training and rehabilitation training. It is primarily based on action simulation, including movement imagery (MI) and movement observation (MO). However, the development of BCI technology is limited due to the challenge of getting an in-depth understanding of brain networks involved in MI, MO, and movement execution (ME). To better understand the brain activity changes and the communications across various brain regions under MO, ME, and MI, this study conducted the fist experiment under MO, ME, and MI. We recorded 64-channel electroencephalography (EEG) from 39 healthy subjects (25 males, 14 females, all right-handed) during fist tasks, obtained intensities and locations of sources using EEG source imaging (ESI), computed source activation modes, and finally investigated the brain networks using spectral Granger causality (GC). The brain regions involved in the three motor conditions are similar, but the degree of participation of each brain region and the network connections among the brain regions are different. MO, ME, and MI did not recruit shared brain connectivity networks. In addition, both source activation modes and brain network connectivity had lateralization advantages.
Collapse
Affiliation(s)
- Lu Zhou
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Qiaoqiao Zhu
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Biao Wu
- Electronic Information Department, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Bing Qin
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Haixu Hu
- Sports Training Academy, Nanjing Sport Institute, Nanjing, China
| | - Zhiyu Qian
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China.
| |
Collapse
|
18
|
Leeuwis N, Yoon S, Alimardani M. Functional Connectivity Analysis in Motor-Imagery Brain Computer Interfaces. Front Hum Neurosci 2021; 15:732946. [PMID: 34720907 PMCID: PMC8555469 DOI: 10.3389/fnhum.2021.732946] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 09/03/2021] [Indexed: 11/25/2022] Open
Abstract
Motor Imagery BCI systems have a high rate of users that are not capable of modulating their brain activity accurately enough to communicate with the system. Several studies have identified psychological, cognitive, and neurophysiological measures that might explain this MI-BCI inefficiency. Traditional research had focused on mu suppression in the sensorimotor area in order to classify imagery, but this does not reflect the true dynamics that underlie motor imagery. Functional connectivity reflects the interaction between brain regions during the MI task and resting-state network and is a promising tool in improving MI-BCI classification. In this study, 54 novice MI-BCI users were split into two groups based on their accuracy and their functional connectivity was compared in three network scales (Global, Large and Local scale) during the resting-state, left vs. right-hand motor imagery task, and the transition between the two phases. Our comparison of High and Low BCI performers showed that in the alpha band, functional connectivity in the right hemisphere was increased in High compared to Low aptitude MI-BCI users during motor imagery. These findings contribute to the existing literature that indeed connectivity might be a valuable feature in MI-BCI classification and in solving the MI-BCI inefficiency problem.
Collapse
Affiliation(s)
- Nikki Leeuwis
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, Netherlands
| | | | | |
Collapse
|
19
|
Huang HC, Chen CM, Lu MK, Liu BL, Li CI, Chen JC, Wang GJ, Lin HC, Duann JR, Tsai CH. Gait-Related Brain Activation During Motor Imagery of Complex and Simple Ambulation in Parkinson's Disease With Freezing of Gait. Front Aging Neurosci 2021; 13:731332. [PMID: 34630069 PMCID: PMC8492994 DOI: 10.3389/fnagi.2021.731332] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Accepted: 08/23/2021] [Indexed: 11/13/2022] Open
Abstract
Background: Freezing of gait (FOG) in Parkinson's disease (PD) is a devastating clinical phenomenon that has a detrimental impact on patients. It tends to be triggered more often during turning (complex) than during forwarding straight (simple) walking. The neural mechanism underlying this phenomenon remains unclear and requires further elucidation. Objective: To investigate the differences in cerebral functional magnetic resonance imaging responses between PD patients with and without FOG during explicitly video-guided motor imagery (MI) of various complex (normal, freezing) and simple (normal, freezing) walking conditions. Methods: We recruited 34 PD patients, namely, 20 with FOG and 14 without FOG, and 15 normal controls. Participants underwent video-guided MI of turning and straight walking, with and without freezing, while their brain blood oxygen level-dependent (BOLD) activities were measured. Gait analysis was performed. Results: While comparing FOG turning with FOG straight walking, freezers showed higher activation of the superior occipital gyrus, left precentral gyrus, and right postcentral gyrus compared with non-freezers. Normal controls also manifest similar findings compared with non-freezers, except no difference was noted in occipital gyrus activity between the two groups. Freezers also displayed a higher effect size in the locomotor regions than non-freezers during imagery of normal turning. Conclusions: Our findings suggest that freezers require a higher drive of cortical and locomotion regions to overcome the overinhibition of the pathways in freezers than in non-freezers. Compared with simple walking, increased dorsal visual pathway and deep locomotion region activities might play pivotal roles in tackling FOG in freezers during complex walking.
Collapse
Affiliation(s)
- Hui-Chun Huang
- Graduate Institute of Clinical Medical Science, China Medical University, Taichung, Taiwan.,Division of Parkinson's Disease and Movement Disorders, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,Neuroscience Laboratory, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,School of Medicine, College of Medicine, China Medical University, Taichung, Taiwan.,Graduate Institute of Biomedical Sciences, China Medical University, Taichung, Taiwan
| | - Chun-Ming Chen
- Department of Medical Imaging, China Medical University Hospital, Taichung, Taiwan.,Neuroscience and Brain Disease Center, College of Medicine, China Medical University, Taichung, Taiwan
| | - Ming-Kuei Lu
- Division of Parkinson's Disease and Movement Disorders, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,Neuroscience Laboratory, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,Graduate Institute of Biomedical Sciences, China Medical University, Taichung, Taiwan.,Neuroscience and Brain Disease Center, College of Medicine, China Medical University, Taichung, Taiwan
| | - Bey-Ling Liu
- Neuroscience Laboratory, Department of Neurology, China Medical University Hospital, Taichung, Taiwan
| | - Chia-Ing Li
- Department of Medical Research, China Medical University Hospital, Taichung, Taiwan
| | - Jui-Cheng Chen
- Division of Parkinson's Disease and Movement Disorders, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,Neuroscience Laboratory, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,School of Medicine, College of Medicine, China Medical University, Taichung, Taiwan.,Neuroscience and Brain Disease Center, College of Medicine, China Medical University, Taichung, Taiwan.,Department of Neurology, China Medical University Hsinchu Hospital, Hsinchu, Taiwan
| | - Guei-Jane Wang
- Graduate Institute of Clinical Medical Science, China Medical University, Taichung, Taiwan.,Graduate Institute of Biomedical Sciences, China Medical University, Taichung, Taiwan.,Department of Medical Research, China Medical University Hospital, Taichung, Taiwan.,Department of Health and Nutrition Biotechnology, Asia University, Taichung, Taiwan
| | - Hsiu-Chen Lin
- Department of Physical Therapy, China Medical University, Taichung, Taiwan
| | - Jeng-Ren Duann
- Institute of Education, National Yang Ming Chiao Tung University, Hsinchu, Taiwan.,Institute for Neural Computation, University of California, San Diego, La Jolla, CA, United States
| | - Chon-Haw Tsai
- Division of Parkinson's Disease and Movement Disorders, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,Neuroscience Laboratory, Department of Neurology, China Medical University Hospital, Taichung, Taiwan.,School of Medicine, College of Medicine, China Medical University, Taichung, Taiwan.,Neuroscience and Brain Disease Center, College of Medicine, China Medical University, Taichung, Taiwan
| |
Collapse
|
20
|
Jeong H, Kim J. Development of a Guidance System for Motor Imagery Enhancement Using the Virtual Hand Illusion. SENSORS 2021; 21:s21062197. [PMID: 33801070 PMCID: PMC8003913 DOI: 10.3390/s21062197] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Revised: 03/09/2021] [Accepted: 03/18/2021] [Indexed: 01/09/2023]
Abstract
Motor imagery (MI) is widely used to produce input signals for brain-computer interfaces (BCI) due to the similarities between MI-BCI and the planning-execution cycle. Despite its usefulness, MI tasks can be ambiguous to users and MI produces weaker cortical signals than motor execution. Existing MI guidance systems, which have been reported to provide visual guidance for MI and enhance MI, still have limitations: insufficient immersion for MI or poor expandability to MI for another body parts. We propose a guidance system for MI enhancement that can immerse users in MI and will be easy to extend to other body parts and target motions with few physical constraints. To make easily extendable MI guidance system, the virtual hand illusion is applied to the MI guidance system with a motion tracking sensor. MI enhancement was evaluated in 11 healthy people by comparison with another guidance system and conventional motor commands for BCI. The results showed that the proposed MI guidance system produced an amplified cortical signal compared to pure MI (p < 0.017), and a similar cortical signal as those produced by both actual execution (p > 0.534) and an MI guidance system with the rubber hand illusion (p > 0.722) in the contralateral region. Therefore, we believe that the proposed MI guidance system with the virtual hand illusion is a viable alternative to existing MI guidance systems in various applications with MI-BCI.
Collapse
|
21
|
Kraeutner SN, McArthur JL, Kraeutner PH, Westwood DA, Boe SG. Leveraging the effector independent nature of motor imagery when it is paired with physical practice. Sci Rep 2020; 10:21335. [PMID: 33288785 PMCID: PMC7721807 DOI: 10.1038/s41598-020-78120-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Accepted: 11/18/2020] [Indexed: 12/04/2022] Open
Abstract
While considered analogous to physical practice, the nature of imagery-based skill acquisition—specifically whether or not both effector independent and dependent encoding occurs through motor imagery—is not well understood. Here, motor imagery-based training was applied prior to or after physical practice-based training to probe the nature of imagery-based skill acquisition. Three groups of participants (N = 38) engaged in 10 days of training of a dart throwing task: 5 days of motor imagery prior to physical practice (MIP-PP), motor imagery following physical practice (PP-MIP), or physical practice only (PP-PP). Performance-related outcomes were assessed throughout. Brain activity was measured at three time points using fMRI (pre/mid/post-training; MIP-PP and PP-MIP groups). In contrast with physical practice, motor imagery led to changes in global versus specific aspects of the movement. Following 10 days of training, performance was greater when motor imagery preceded physical practice, although remained inferior to performance resulting from physical practice alone. Greater activation of regions that support effector dependent encoding was observed mid-, but not post-training for the PP-MIP group. Findings indicate that changes driven by motor imagery reflect effector independent encoding, providing new information regarding how motor imagery may be leveraged for skill acquisition.
Collapse
Affiliation(s)
- Sarah N Kraeutner
- Brain Behaviour Laboratory, University of British Columbia, Vancouver, BC, V6T1Z3, Canada.,Department of Physical Therapy, University of British Columbia, Vancouver, BC, V6T1Z3, Canada
| | - Jennifer L McArthur
- Laboratory for Brain Recovery and Function, Dalhousie University, Halifax, NS, B3H4R1, Canada
| | - Paul H Kraeutner
- Laboratory for Brain Recovery and Function, Dalhousie University, Halifax, NS, B3H4R1, Canada
| | - David A Westwood
- Department of Psychology and Neuroscience, Dalhousie University, Halifax, NS, B3H4R2, Canada.,School of Health and Human Performance, Dalhousie University, Halifax, NS, B3H4R2, Canada
| | - Shaun G Boe
- Laboratory for Brain Recovery and Function, Dalhousie University, Halifax, NS, B3H4R1, Canada. .,Department of Psychology and Neuroscience, Dalhousie University, Halifax, NS, B3H4R2, Canada. .,School of Health and Human Performance, Dalhousie University, Halifax, NS, B3H4R2, Canada. .,School of Physiotherapy, Dalhousie University, Rm 407, 4th Floor Forrest Building, 5869 University Avenue, PO Box 15000, Halifax, NS, B3H4R2, Canada.
| |
Collapse
|
22
|
Kraeutner SN, Stratas A, McArthur JL, Helmick CA, Westwood DA, Boe SG. Neural and Behavioral Outcomes Differ Following Equivalent Bouts of Motor Imagery or Physical Practice. J Cogn Neurosci 2020; 32:1590-1606. [PMID: 32420839 DOI: 10.1162/jocn_a_01575] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
Despite its reported effectiveness for the acquisition of motor skills, we know little about how motor imagery (MI)-based brain activation and performance evolves when MI (the imagined performance of a motor task) is used to learn a complex motor skill compared to physical practice (PP). The current study examined changes in MI-related brain activity and performance driven by an equivalent bout of MI- or PP-based training. Participants engaged in 5 days of either MI or PP of a dart-throwing task. Brain activity (via fMRI) and performance-related outcomes were obtained using a pre/post/retention design. Relative to PP, MI-based training did not drive robust changes in brain activation and was inferior for realizing improvements in performance: Greater activation in regions critical to refining the motor program was observed in the PP versus MI group posttraining, and relative to those driven via PP, MI led only to marginal improvements in performance. Findings indicate that the modality of practice (i.e., MI vs. PP) used to learn a complex motor skill manifests as differences in both resultant patterns of brain activity and performance. Ultimately, by directly comparing brain activity and behavioral outcomes after equivalent training through MI versus PP, this work provides unique knowledge regarding the neural mechanisms underlying learning through MI.
Collapse
|
23
|
Frenkel-Toledo S, Einat M, Kozol Z. The Effects of Instruction Manipulation on Motor Performance Following Action Observation. Front Hum Neurosci 2020; 14:33. [PMID: 32210778 PMCID: PMC7073404 DOI: 10.3389/fnhum.2020.00033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2019] [Accepted: 01/23/2020] [Indexed: 11/13/2022] Open
Abstract
The effects of action observation (AO) on motor performance can be modulated by instruction. The effects of two top-down aspects of the instruction on motor performance have not been fully resolved: those related to attention to the observed task and the incorporation of motor imagery (MI) during AO. In addition, the immediate vs. 24-h retention test effects of those instruction’s aspects are yet to be elucidated. Forty-eight healthy subjects were randomly instructed to: (1) observe reaching movement (RM) sequences toward five lighted units with the intention of reproducing the same sequence as fast and as accurate as possible (Intentional + Attentional group; AO+At); (2) observe the RMs sequence with the intention of reproducing the same sequence as fast and as accurate as possible and simultaneously to the observation to imagine performing the RMs (Intentional + attentional + MI group; AO+At+MI); and (3) observe the RMs sequence (Passive AO group). Subjects’ performance was tested before and immediately after the AO and retested after 24 h. During each of the pretest, posttest, and retest, the subject performed RMs toward the units that were activated in the same order as the observed sequence. Occasionally, the sequence order was changed by beginning the sequence with a different activated unit. The outcome measures were: averaged response time of the RMs during the sequences, difference between the response time of the unexpected and expected RMs and percent of failures to reach the target within 1 s. The averaged response time and the difference between the response time of the unexpected and expected RMs were improved in all groups at posttest compared to pretest, regardless of instruction. Averaged response time was improved in the retest compared to the posttest only in the Passive AO group. The percent of failures across groups was higher in pretest compared to retest. Our findings suggest that manipulating top-down aspects of instruction by adding attention and MI to AO in an RM sequence task does not improve subsequent performance more than passive observation. Off-line learning of the sequence in the retention test was improved in comparison to posttest following passive observation only.
Collapse
Affiliation(s)
- Silvi Frenkel-Toledo
- Department of Physical Therapy, School of Health Sciences, Ariel University, Ariel, Israel.,Department of Neurological Rehabilitation, Loewenstein Hospital, Raanana, Israel
| | - Moshe Einat
- Department of Electrical and Electronic Engineering, Ariel University, Ariel, Israel
| | - Zvi Kozol
- Department of Physical Therapy, School of Health Sciences, Ariel University, Ariel, Israel
| |
Collapse
|
24
|
The effects of handedness on sensorimotor rhythm desynchronization and motor-imagery BCI control. Sci Rep 2020; 10:2087. [PMID: 32034277 PMCID: PMC7005877 DOI: 10.1038/s41598-020-59222-w] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Accepted: 01/27/2020] [Indexed: 11/17/2022] Open
Abstract
Brain–computer interfaces (BCIs) allow control of various applications or external devices solely by brain activity, e.g., measured by electroencephalography during motor imagery. Many users are unable to modulate their brain activity sufficiently in order to control a BCI. Most of the studies have been focusing on improving the accuracy of BCI control through advances in signal processing and BCI protocol modification. However, some research suggests that motor skills and physiological factors may affect BCI performance as well. Previous studies have indicated that there is differential lateralization of hand movements’ neural representation in right- and left-handed individuals. However, the effects of handedness on sensorimotor rhythm (SMR) distribution and BCI control have not been investigated in detail yet. Our study aims to fill this gap, by comparing the SMR patterns during motor imagery and real-feedback BCI control in right- (N = 20) and left-handers (N = 20). The results of our study show that the lateralization of SMR during a motor imagery task differs according to handedness. Left-handers present lower accuracy during BCI performance (single session) and weaker SMR suppression in the alpha band (8–13 Hz) during mental simulation of left-hand movements. Consequently, to improve BCI control, the user’s training should take into account individual differences in hand dominance.
Collapse
|
25
|
Shafer RL, Solomon EM, Newell KM, Lewis MH, Bodfish JW. Visual feedback during motor performance is associated with increased complexity and adaptability of motor and neural output. Behav Brain Res 2019; 376:112214. [PMID: 31494179 PMCID: PMC6876558 DOI: 10.1016/j.bbr.2019.112214] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 08/30/2019] [Accepted: 09/04/2019] [Indexed: 11/19/2022]
Abstract
Complex motor behavior is believed to be dependent on sensorimotor integration - the neural process of using sensory input to plan, guide, and correct movements. Previous studies have shown that the complexity of motor output is low when sensory feedback is withheld during precision motor tasks. However, much of this research has focused on motor behavior rather than neural processing, and therefore, has not specifically assessed the role of sensorimotor neural functioning in the execution of complex motor behavior. The present study uses a stimulus-tracking task with simultaneous electroencephalography (EEG) recording to assess the effect of visual feedback on motor performance, motor complexity, and sensorimotor neural processing in healthy adults. The complexity of the EEG signal was analyzed to capture the information content in frequency bands (alpha and beta) and scalp regions (central, parietal, and occipital) that are associated with sensorimotor processing. Consistent with previous literature, motor performance and its complexity were higher when visual feedback was provided relative to when it was withheld. The complexity of the neural signal was also higher when visual feedback was provided. This was most robust at frequency bands (alpha and beta) and scalp regions (parietal and occipital) associated with sensorimotor processing. The findings show that visual feedback increases the information available to the brain when generating complex, adaptive motor output.
Collapse
Affiliation(s)
- Robin L Shafer
- Vanderbilt Brain Institute, Vanderbilt University, 6133 Medical Research Building III, 465 21st Avenue South, Nashville, TN, 37232, USA.
| | - Eli M Solomon
- Neuroscience and Behavior Program, Wesleyan University Rm 257 Hall-Atwater, Wesleyan University, Middletown, CT, 06459, USA.
| | - Karl M Newell
- Department of Kinesiology, University of Georgia, G3 Aderhold Hall, 110 Carlton Street, Athens, GA, 30602, USA.
| | - Mark H Lewis
- Department of Psychiatry, University of Florida College of Medicine, PO Box 100256, L4-100 McKnight Brain Institute, 1149 Newell Drive, Gainesville, FL, 32611, USA.
| | - James W Bodfish
- Vanderbilt Brain Institute, Vanderbilt University, 6133 Medical Research Building III, 465 21st Avenue South, Nashville, TN, 37232, USA; Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, 8310 Medical Center East, 1215 21st Avenue South, Nashville, TN, 37232, USA.
| |
Collapse
|
26
|
Chang CS, Lo YY, Chen CL, Lee HM, Chiang WC, Li PC. Alternative Motor Task-Based Pattern Training With a Digital Mirror Therapy System Enhances Sensorimotor Signal Rhythms Post-stroke. Front Neurol 2019; 10:1227. [PMID: 31824406 PMCID: PMC6882999 DOI: 10.3389/fneur.2019.01227] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2019] [Accepted: 11/04/2019] [Indexed: 12/16/2022] Open
Abstract
Mirror therapy (MT) facilitates motor learning and induces cortical reorganization and motor recovery from stroke. We applied the new digital mirror therapy (DMT) system to compare the cortical activation under the three visual feedback conditions: (1) no mirror visual feedback (NoMVF), (2) bilateral synchronized task-based mirror visual feedback training (BMVF), and (3) reciprocal task-based mirror visual feedback training (RMVF). During DMT, EEG recordings, including time-dependent event-related desynchronization (ERD) signal amplitude in both mu and beta bands, were obtained from the standard C3 (ispilesional hemisphere, IH), C4 (contralesional hemisphere, CH), and Cz scalp sites (supplementary motor area, SMA). The entire ERD curve was separated into three time-phases: P0 (-2 to 0 s), P1 (0 to 2 s), and P2 (2 to 4 s). Four-way and subsequent repeated-measures analyses of variance were used to examine the effects of group (stroke vs. control group), test condition (NoMVF, BMVF, and RMVF), time-phase (P0, P1, and P2), and brain area (IH, CH, SMA) on the ERD areas (%) in mu and beta bands. For the mu band, generally, ERD areas (%) were larger in the control than in the stroke group. The ERD areas (%) were largest under the RMVF condition, followed by BMVF and NoMVF conditions. Similar results were found in the beta bands. The main effects of group, time-phase, and test condition on the ERD areas (%) were significant for the three brain areas, except the main effect of group in the SMA (Cz) and CH (C4) brain area. The ERD areas (%) were larger in the control than in the stroke group. The ERD area (%) was significantly larger during P1 than during P0 and P2 (ps < 0.02), and during P2 than during P0 (ps < 0.01). The ERD area (%) under the RMVF condition was significantly larger than that under the BMVF condition and NoMVF condition (ps < 0.05). The present study suggests that cortical activation particularly in the SMA (Cz) of the brain increases in the RMVF condition in both healthy subjects and stroke patients. This result supports the hypothesis that stroke patients may benefit from RMVF training.
Collapse
Affiliation(s)
- Chao-Sheng Chang
- Department of Healthcare Administration, I-Shou University, Kaohsiung, Taiwan.,Department of Emergency Medicine, E-Da Hospital, Kaohsiung, Taiwan
| | - Ying-Ying Lo
- Department of Healthcare Administration, I-Shou University, Kaohsiung, Taiwan
| | - Chien-Liang Chen
- Department of Physical Therapy, I-Shou University, Kaohsiung, Taiwan
| | - Hsin-Min Lee
- Department of Physical Therapy, I-Shou University, Kaohsiung, Taiwan
| | - Wei-Chi Chiang
- Department of Occupational Therapy, I-Shou University, Kaohsiung, Taiwan
| | - Ping-Chia Li
- Department of Occupational Therapy, I-Shou University, Kaohsiung, Taiwan
| |
Collapse
|
27
|
Castelo-Branco L, Uygur Kucukseymen E, Duarte D, El-Hagrassy MM, Bonin Pinto C, Gunduz ME, Cardenas-Rojas A, Pacheco-Barrios K, Yang Y, Gonzalez-Mego P, Estudillo-Guerra A, Candido-Santos L, Mesia-Toledo I, Rafferty H, Caumo W, Fregni F. Optimised transcranial direct current stimulation (tDCS) for fibromyalgia-targeting the endogenous pain control system: a randomised, double-blind, factorial clinical trial protocol. BMJ Open 2019; 9:e032710. [PMID: 31672712 PMCID: PMC6830717 DOI: 10.1136/bmjopen-2019-032710] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
INTRODUCTION Fibromyalgia (FM) is a common debilitating condition with limited therapeutic options. Medications have low efficacy and are often associated with adverse effects. Given that FM is associated with a defective endogenous pain control system and central sensitisation, combining interventions such as transcranial direct current stimulation (tDCS) and aerobic exercise (AE) to modulate pain-processing circuits may enhance pain control. METHODS AND ANALYSIS A prospective, randomised (1:1:1:1), placebo-controlled, double-blind, factorial clinical trial will test the hypothesis that optimised tDCS (16 anodal tDCS sessions combined with AE) can restore of the pain endogenous control system. Participants with FM (n=148) will undergo a conditioning exercise period and be randomly allocated to one of four groups: (1) active tDCS and AE, (2) sham tDCS and AE, (3) active tDCS and non-aerobic exercise (nAE) or (4) sham tDCS and nAE. Pain inhibitory activity will be assessed using conditioned pain modulation (CPM) and temporal slow pain summation (TSPS)-primary outcomes. Secondary outcomes will include the following assessments: Transcranial magnetic stimulation and electroencephalography as cortical markers of pain inhibitory control and thalamocortical circuits; secondary clinical outcomes on pain, FM, quality of life, sleep and depression. Finally, the relationship between the two main mechanistic targets in this study-CPM and TSPS-and changes in secondary clinical outcomes will be tested. The change in the primary efficacy endpoint, CPM and TSPS, from baseline to week 4 of stimulation will be tested with a mixed linear model and adjusted for important demographic variables. ETHICS AND DISSEMINATION This study obeys the Declaration of Helsinki and was approved by the Institutional Review Board (IRB) of Partners Healthcare under the protocol number 2017P002524. Informed consent will be obtained from participants. Study findings will be reported in conferences and peer-reviewed journal publications. TRIAL REGISTRATION NUMBER NCT03371225.
Collapse
Affiliation(s)
- Luis Castelo-Branco
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Elif Uygur Kucukseymen
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Dante Duarte
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Mirret M El-Hagrassy
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Camila Bonin Pinto
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Muhammed Enes Gunduz
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Alejandra Cardenas-Rojas
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Kevin Pacheco-Barrios
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Yiling Yang
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Paola Gonzalez-Mego
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Anayali Estudillo-Guerra
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Ludmilla Candido-Santos
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Ines Mesia-Toledo
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Haley Rafferty
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Wolnei Caumo
- Laboratory of Pain & Neuromodulation, Hospital de Clinicas de Porto Alegre da Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | - Felipe Fregni
- Neuromodulation Center/Spaulding Rehabilitation Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
28
|
Xu K, Huang YY, Duann JR. The Sensitivity of Single-Trial Mu-Suppression Detection for Motor Imagery Performance as Compared to Motor Execution and Motor Observation Performance. Front Hum Neurosci 2019; 13:302. [PMID: 31543766 PMCID: PMC6728805 DOI: 10.3389/fnhum.2019.00302] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2019] [Accepted: 08/14/2019] [Indexed: 11/13/2022] Open
Abstract
Motor imagery (MI) has been widely used to operate brain-computer interface (BCI) systems for rehabilitation and some life assistive devices. However, the current performance of an MI-based BCI cannot fully meet the needs of its in-field applications. Most of the BCIs utilizing a generalized feature for all participants have been found to greatly hamper the efficacy of the BCI system. Hence, some attempts have made on the exploration of subject-dependent parameters, but it remains challenging to enhance BCI performance as expected. To this end, in this study, we used the independent component analysis (ICA), which has been proved capable of isolating the pure motor-related component from non-motor-related brain processes and artifacts and extracting the common motor-related component across MI, motor execution (ME), and motor observation (MO) conditions. Then, a sliding window approach was used to detect significant mu-suppression from the baseline using the electroencephalographic (EEG) alpha power time course and, thus, the success rate of the mu-suppression detection could be assessed on a single-trial basis. By comparing the success rates using different parameters, we further quantified the extent of the improvement in each motor condition to evaluate the effectiveness of both generalized and individualized parameters. The results showed that in ME condition, the success rate under individualized latency and that under generalized latency was 90.0% and 77.75%, respectively; in MI condition, the success rate was 74.14% for individual latency and 58.47% for generalized latency, and in MO condition, the success rate was 67.89% and 61.26% for individual and generalized latency, respectively. As can be seen, the success rate in each motor condition was significantly improved by utilizing an individualized latency compared to that using the generalized latency. Moreover, the comparison of the individualized window latencies for the mu-suppression detection across different runs of the same participant as well as across different participants showed that the window latency was significantly more consistent in the intra-subject than in the inter-subject settings. As a result, we proposed that individualizing the latency for detecting the mu-suppression feature for each participant might be a promising attempt to improve the MI-based BCI performance.
Collapse
Affiliation(s)
- Kunyu Xu
- Institute of Cognitive Neuroscience, National Central University, Taoyuan, Taiwan
| | - Yu-Yu Huang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan, Taiwan
| | - Jeng-Ren Duann
- Institute of Cognitive Neuroscience, National Central University, Taoyuan, Taiwan.,Institute for Neural Computation, University of California, San Diego, San Diego, CA, United States
| |
Collapse
|
29
|
Nagai H, Tanaka T. Action Observation of Own Hand Movement Enhances Event-Related Desynchronization. IEEE Trans Neural Syst Rehabil Eng 2019; 27:1407-1415. [DOI: 10.1109/tnsre.2019.2919194] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
30
|
Song M, Kim J. A Paradigm to Enhance Motor Imagery Using Rubber Hand Illusion Induced by Visuo-Tactile Stimulus. IEEE Trans Neural Syst Rehabil Eng 2019; 27:477-486. [PMID: 30703031 DOI: 10.1109/tnsre.2019.2895029] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Enhancing motor imagery (MI) results in amplified event-related desynchronization (ERD) and is important for MI-based rehabilitation and brain-computer interface (BCI) applications. Many attempts to enhance the MI by providing a visual guidance have been reported. We believe that the rubber hand illusion (RHI), which induces body ownership over an external object, can provide better guidance to enhance MI; thus, an RHI-based paradigm with motorized moving rubber hand was proposed. To validate the proposed MI enhancing paradigm, we conducted an experimental comparison among paradigms with 20 healthy subjects. The peak amplitude and arrival times of ERD were compared at contralateral and ipsilateral electroencephalogram channels. We found significantly amplified ERD caused by the proposed paradigm, which is similar to the ERD caused by motor execution. In addition, the arrival time suggests that the proposed paradigm is applicable for BCI. In conclusion, the proposed paradigm can significantly enhance the MI with better characteristics for use with BCI.
Collapse
|
31
|
Hong J, Qin X, Li J, Niu J, Wang W. Signal processing algorithms for motor imagery brain-computer interface: State of the art. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2018. [DOI: 10.3233/jifs-181309] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Jie Hong
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Xiansheng Qin
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Jing Li
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Junlong Niu
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Wenjie Wang
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| |
Collapse
|
32
|
Toriyama H, Ushiba J, Ushiyama J. Subjective Vividness of Kinesthetic Motor Imagery Is Associated With the Similarity in Magnitude of Sensorimotor Event-Related Desynchronization Between Motor Execution and Motor Imagery. Front Hum Neurosci 2018; 12:295. [PMID: 30108492 PMCID: PMC6079198 DOI: 10.3389/fnhum.2018.00295] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2018] [Accepted: 07/05/2018] [Indexed: 11/26/2022] Open
Abstract
In the field of psychology, it has been well established that there are two types of motor imagery such as kinesthetic motor imagery (KMI) and visual motor imagery (VMI), and the subjective evaluation for vividness of motor imagery each differs across individuals. This study aimed to examine how the motor imagery ability assessed by the psychological scores is associated with the physiological measure using electroencephalogram (EEG) sensorimotor rhythm during KMI task. First, 20 healthy young individuals evaluated subjectively how vividly they can perform each of KMI and VMI by using the Kinesthetic and Visual Imagery Questionnaire (KVIQ). We assessed their motor imagery abilities by summing each of KMI and VMI scores in KVIQ (KMItotal and VMItotal). Second, in physiological experiments, they repeated two strengths (10 and 40% of maximal effort) of isometric voluntary wrist-dorsiflexion. Right after each contraction, they also performed its KMI. The scalp EEGs over the sensorimotor cortex were recorded during the tasks. The EEG power is known to decrease in the alpha-and-beta band (7–35 Hz) from resting state to performing state of voluntary contraction (VC) or motor imagery. This phenomenon is referred to as event-related desynchronization (ERD). For each strength of the tasks, we calculated the maximal peak of ERD during VC, and that during its KMI, and measured the degree of similarity (ERDsim) between them. The results showed significant negative correlations between KMItotal and ERDsim for both strengths (p < 0.05) (i.e., the higher the KMItotal, the smaller the ERDsim). These findings suggest that in healthy individuals with higher motor imagery ability from a first-person perspective, KMI efficiently engages the shared cortical circuits corresponding with motor execution, including the sensorimotor cortex, with high compliance.
Collapse
Affiliation(s)
- Hisato Toriyama
- Graduate School of Media and Governance, Keio University, Fujisawa, Japan
| | - Junichi Ushiba
- Department of Biosciences and Informatics, Faculty of Science and Technology, Keio University, Yokohama, Japan.,Keio Institute of Pure and Applied Sciences, Yokohama, Japan
| | - Junichi Ushiyama
- Faculty of Environment and Information Studies, Keio University, Fujisawa, Japan.,Department of Rehabilitation Medicine, Keio University School of Medicine, Keio University, Tokyo, Japan
| |
Collapse
|
33
|
Motor imagery enhancement paradigm using moving rubber hand illusion system. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2017:1146-1149. [PMID: 29060078 DOI: 10.1109/embc.2017.8037032] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Motor imagery (MI) has been widely used in neurorehabilitation and brain computer interface. The size of event-related desynchronization (ERD) is a key parameter for successful motor imaginary rehabilitation and BCI adaptation. Many studies have used visual guidance for enhancement/ amplification of motor imagery ERD amplitude, but their enhancements were not significant. We propose a novel ERD enhancing paradigm using body-ownership illusion, or also known as rubber hand illusion (RHI). The system was made by motorized, moving rubber hand which can simulate wrist extension. The amplifying effects of the proposed RHI paradigm were evaluated by comparing ERD sizes of the proposed paradigm with motor imagery and actual motor execution paradigms. The comparison result shows that the improvement of ERD size due to the proposed paradigm was statistically significant (p<;0.05) compared with the other paradigms.
Collapse
|
34
|
Jenson D, Reilly KJ, Harkrider AW, Thornton D, Saltuklaroglu T. Trait related sensorimotor deficits in people who stutter: An EEG investigation of μ rhythm dynamics during spontaneous fluency. Neuroimage Clin 2018; 19:690-702. [PMID: 29872634 PMCID: PMC5986168 DOI: 10.1016/j.nicl.2018.05.026] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2017] [Revised: 03/28/2018] [Accepted: 05/20/2018] [Indexed: 01/09/2023]
Abstract
Stuttering is associated with compromised sensorimotor control (i.e., internal modeling) across the dorsal stream and oscillations of EEG mu (μ) rhythms have been proposed as reliable indices of anterior dorsal stream processing. The purpose of this study was to compare μ rhythm oscillatory activity between (PWS) and matched typically fluent speakers (TFS) during spontaneously fluent overt and covert speech production tasks. Independent component analysis identified bilateral μ components from 24/27 PWS and matched TFS that localized over premotor cortex. Time-frequency analysis of the left hemisphere μ clusters demonstrated significantly reduced μ-α and μ-β ERD (pCLUSTER < 0.05) in PWS across the time course of overt and covert speech production, while no group differences were found in the right hemisphere in any condition. Results were interpreted through the framework of State Feedback Control. They suggest that weak forward modeling and evaluation of sensory feedback across the time course of speech production characterizes the trait related sensorimotor impairment in PWS. This weakness is proposed to represent an underlying sensorimotor instability that may predispose the speech of PWS to breakdown.
Collapse
Affiliation(s)
- David Jenson
- University of Tennessee Health Science Center, Dept. of Audiology and Speech Pathology, United States.
| | - Kevin J Reilly
- University of Tennessee Health Science Center, Dept. of Audiology and Speech Pathology, United States
| | - Ashley W Harkrider
- University of Tennessee Health Science Center, Dept. of Audiology and Speech Pathology, United States
| | - David Thornton
- University of Tennessee Health Science Center, Dept. of Audiology and Speech Pathology, United States
| | - Tim Saltuklaroglu
- University of Tennessee Health Science Center, Dept. of Audiology and Speech Pathology, United States
| |
Collapse
|
35
|
Chiu YC, Huang JT, Duann JR, Lin CH. Editorial: Twenty Years After the Iowa Gambling Task: Rationality, Emotion, and Decision-Making. Front Psychol 2018; 8:2353. [PMID: 29422876 PMCID: PMC5788943 DOI: 10.3389/fpsyg.2017.02353] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2017] [Accepted: 12/22/2017] [Indexed: 01/01/2023] Open
Affiliation(s)
- Yao-Chu Chiu
- Department of Psychology, Soochow University, Taipei, Taiwan
| | - Jong-Tsun Huang
- Graduate Institute of Biomedical Sciences, China Medical University, Taichung, Taiwan
| | - Jeng-Ren Duann
- Institute of Cognitive Neuroscience, National Central University, Taoyuan, Taiwan
| | - Ching-Hung Lin
- Department of Psychology, Kaohsiung Medical University, Kaohsiung, Taiwan.,Research Center for Nonlinear Analysis and Optimization, Kaohsiung Medical University, Kaohsiung, Taiwan
| |
Collapse
|
36
|
Development of Single-Channel Hybrid BCI System Using Motor Imagery and SSVEP. JOURNAL OF HEALTHCARE ENGINEERING 2017; 2017:3789386. [PMID: 29065590 PMCID: PMC5564129 DOI: 10.1155/2017/3789386] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Revised: 05/17/2017] [Accepted: 06/22/2017] [Indexed: 11/29/2022]
Abstract
Numerous EEG-based brain-computer interface (BCI) systems that are being developed focus on novel feature extraction algorithms, classification methods and combining existing approaches to create hybrid BCIs. Several recent studies demonstrated various advantages of hybrid BCI systems in terms of an improved accuracy or number of commands available for the user. But still, BCI systems are far from realization for daily use. Having high performance with less number of channels is one of the challenging issues that persists, especially with hybrid BCI systems, where multiple channels are necessary to record information from two or more EEG signal components. Therefore, this work proposes a single-channel (C3 or C4) hybrid BCI system that combines motor imagery (MI) and steady-state visually evoked potential (SSVEP) approaches. This study demonstrates that besides MI features, SSVEP features can also be captured from C3 or C4 channel. The results show that due to rich feature information (MI and SSVEP) at these channels, the proposed hybrid BCI system outperforms both MI- and SSVEP-based systems having an average classification accuracy of 85.6 ± 7.7% in a two-class task.
Collapse
|