1
|
Zhang X, Zhang S, Zhang H, Wang H, Long J. Post-Movement Beta Synchronization Induced by Speed Effects IHI from Ipsilateral to Contralateral Motor Cortex. eNeuro 2025; 12:ENEURO.0370-24.2025. [PMID: 40068876 PMCID: PMC11927053 DOI: 10.1523/eneuro.0370-24.2025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2024] [Revised: 02/03/2025] [Accepted: 02/21/2025] [Indexed: 03/23/2025] Open
Abstract
Beta event-related spectral perturbation (ERSP), including bilateral movement-related beta desynchronization (MRBD) and post-movement beta synchronization (PMBS), can be evoked by unilateral speed movement. A potential correlation might exist between power (de)synchronization and interhemispheric coherence during movement execution. However, during the PMBS phase, the existence of interhemispheric coupling and the effect of speed on it are largely undiscovered. This study aimed to answer this question. In the present study, we investigated eight healthy, right-handed volunteers using a combination of electroencephalography (EEG), transcranial magnetic stimulation (TMS), and electromyography (EMG). We explored interhemispheric (directed) coherence during isotonic right index finger abduction movements at two speeds: ballistic and self-paced. We discovered that: (i) Compared to the MRBD period, interhemispheric coherence was greater during the PMBS period. Furthermore, ballistic movement induced a larger coherence during the PMBS period, but not during the MRBD period. (ii) In the MRBD phase, directed coherence from the contralateral motor cortex (CM1) to the ipsilateral motor cortex (IM1) was larger, with a reverse tendency observed during the PMBS period. Additionally, in ballistic movement, directed coherence from IM1 to CM1 was stronger and positively correlated with coherence, with no effect of speed on directed coherence detected in the MRBD phase. To advance the understanding of neural mechanisms and the causality of interhemispheric coherence during the PMBS period, we investigated the interhemispheric inhibition (IHI) from IM1 to CM1 at different speeds. A stronger IHI from IM1 to CM1 at PMBS peak time was demonstrated, which was enhanced during ballistic movement. Additionally, IHI was negatively correlated with PMBS, and movement speed was positively associated with interhemispheric coupling during the PMBS period and IHI from IM1 to CM1.Significance Statement The present study explored interhemispheric (directed)coherence during isotonic right index finger abduction movements at two speeds: ballistic and self-paced. We discovered a dominance of interhemispheric coherence during the PMBS period of ballistic movement. Furthermore, directed coherence from the CM1 to the IM1 was more predominant in the MRBD phase, with a reverse tendency observed during the PMBS period. Additionally, directed coherence from IM1 to CM1 was stronger and positively correlated with coherence in ballistic movement. Advanced exploration revealed a stronger IHI from IM1 to CM1 at PMBS peak time, which was enhanced during ballistic movement. Additionally, IHI was negatively correlated with PMBS, and movement speed was positively associated with interhemispheric coupling during the PMBS period and IHI.
Collapse
Affiliation(s)
- Xiangzi Zhang
- School of Psychology, Northwest Normal University, Lanzhou, Gansu, China,730070
| | - Shengyao Zhang
- College of Basic Medicine, Jinzhou Medical University, Jinzhou, Liaoning, China, 121001
| | - Haoyuan Zhang
- School of Psychology, Northwest Normal University, Lanzhou, Gansu, China,730070
| | - Houmin Wang
- School of Computer Science and Engineering, Guangdong Ocean University, Yangjiang, Guangdong, China, 529500
| | - Jinyi Long
- College of Information Science and Technology, Jinan University, Guangzhou, Guangdong, China, 510632.
| |
Collapse
|
2
|
Kuo CH, Liu GT, Lee CE, Wu J, Casimo K, Weaver KE, Lo YC, Chen YY, Huang WC, Ojemann JG. Decoding micro-electrocorticographic signals by using explainable 3D convolutional neural network to predict finger movements. J Neurosci Methods 2024; 411:110251. [PMID: 39151656 DOI: 10.1016/j.jneumeth.2024.110251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 08/05/2024] [Accepted: 08/13/2024] [Indexed: 08/19/2024]
Abstract
BACKGROUND Electroencephalography (EEG) and electrocorticography (ECoG) recordings have been used to decode finger movements by analyzing brain activity. Traditional methods focused on single bandpass power changes for movement decoding, utilizing machine learning models requiring manual feature extraction. NEW METHOD This study introduces a 3D convolutional neural network (3D-CNN) model to decode finger movements using ECoG data. The model employs adaptive, explainable AI (xAI) techniques to interpret the physiological relevance of brain signals. ECoG signals from epilepsy patients during awake craniotomy were processed to extract power spectral density across multiple frequency bands. These data formed a 3D matrix used to train the 3D-CNN to predict finger trajectories. RESULTS The 3D-CNN model showed significant accuracy in predicting finger movements, with root-mean-square error (RMSE) values of 0.26-0.38 for single finger movements and 0.20-0.24 for combined movements. Explainable AI techniques, Grad-CAM and SHAP, identified the high gamma (HG) band as crucial for movement prediction, showing specific cortical regions involved in different finger movements. These findings highlighted the physiological significance of the HG band in motor control. COMPARISON WITH EXISTING METHODS The 3D-CNN model outperformed traditional machine learning approaches by effectively capturing spatial and temporal patterns in ECoG data. The use of xAI techniques provided clearer insights into the model's decision-making process, unlike the "black box" nature of standard deep learning models. CONCLUSIONS The proposed 3D-CNN model, combined with xAI methods, enhances the decoding accuracy of finger movements from ECoG data. This approach offers a more efficient and interpretable solution for brain-computer interface (BCI) applications, emphasizing the HG band's role in motor control.
Collapse
Affiliation(s)
- Chao-Hung Kuo
- Department of Neurosurgery, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan; Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan; Department of Neurological Surgery, University of Washington, Seattle, WA, USA; The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan.
| | - Guan-Tze Liu
- Department of Neurosurgery, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chi-En Lee
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Jing Wu
- Department of Bioengineering, University of Washington, Seattle, WA, USA; Center for Neurotechnology, University of Washington, Seattle, WA, USA
| | - Kaitlyn Casimo
- Center for Neurotechnology, University of Washington, Seattle, WA, USA
| | - Kurt E Weaver
- Center for Neurotechnology, University of Washington, Seattle, WA, USA; Department of Radiology, and Integrated Brain Imaging Center, University of Washington, Seattle, WA, USA
| | - Yu-Chun Lo
- The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
| | - You-Yin Chen
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan; The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan.
| | - Wen-Cheng Huang
- Department of Neurosurgery, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Jeffrey G Ojemann
- Department of Neurological Surgery, University of Washington, Seattle, WA, USA; Center for Neurotechnology, University of Washington, Seattle, WA, USA; Departments of Surgery, Seattle Children's Hospital, Seattle, WA, USA
| |
Collapse
|
3
|
Iwama S, Tsuchimoto S, Mizuguchi N, Ushiba J. EEG decoding with spatiotemporal convolutional neural network for visualization and closed-loop control of sensorimotor activities: A simultaneous EEG-fMRI study. Hum Brain Mapp 2024; 45:e26767. [PMID: 38923184 PMCID: PMC11199199 DOI: 10.1002/hbm.26767] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 06/06/2024] [Accepted: 06/10/2024] [Indexed: 06/28/2024] Open
Abstract
Closed-loop neurofeedback training utilizes neural signals such as scalp electroencephalograms (EEG) to manipulate specific neural activities and the associated behavioral performance. A spatiotemporal filter for high-density whole-head scalp EEG using a convolutional neural network can overcome the ambiguity of the signaling source because each EEG signal includes information on the remote regions. We simultaneously acquired EEG and functional magnetic resonance images in humans during the brain-computer interface (BCI) based neurofeedback training and compared the reconstructed and modeled hemodynamic responses of the sensorimotor network. Filters constructed with a convolutional neural network captured activities in the targeted network with spatial precision and specificity superior to those of the EEG signals preprocessed with standard pipelines used in BCI-based neurofeedback paradigms. The middle layers of the trained model were examined to characterize the neuronal oscillatory features that contributed to the reconstruction. Analysis of the layers for spatial convolution revealed the contribution of distributed cortical circuitries to reconstruction, including the frontoparietal and sensorimotor areas, and those of temporal convolution layers that successfully reconstructed the hemodynamic response function. Employing a spatiotemporal filter and leveraging the electrophysiological signatures of the sensorimotor excitability identified in our middle layer analysis would contribute to the development of a further effective neurofeedback intervention.
Collapse
Affiliation(s)
- Seitaro Iwama
- Department of Biosciences and Informatics, Faculty of Science and TechnologyKeio UniversityYokohamaJapan
| | - Shohei Tsuchimoto
- School of Fundamental Science and TechnologyGraduate School of Keio UniversityYokohamaJapan
- Department of System NeuroscienceNational Institute for Physiological SciencesOkazakiJapan
| | - Nobuaki Mizuguchi
- Research Organization of Science and TechnologyRitsumeikan UniversityKusatsuJapan
- Institute of Advanced Research for Sport and Health ScienceRitsumeikan UniversityKusatsuJapan
| | - Junichi Ushiba
- Department of Biosciences and Informatics, Faculty of Science and TechnologyKeio UniversityYokohamaJapan
| |
Collapse
|
4
|
Iwama S, Takemi M, Eguchi R, Hirose R, Morishige M, Ushiba J. Two common issues in synchronized multimodal recordings with EEG: Jitter and latency. Neurosci Res 2024; 203:1-7. [PMID: 38141782 DOI: 10.1016/j.neures.2023.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 11/19/2023] [Accepted: 12/13/2023] [Indexed: 12/25/2023]
Abstract
Multimodal recording using electroencephalogram (EEG) and other biological signals (e.g., muscle activities, eye movement, pupil diameters, or body kinematics data) is ubiquitous in human neuroscience research. However, the precise time alignment of multiple data from heterogeneous sources (i.e., devices) is often arduous due to variable recording parameters of commercially available research devices and complex experimental setups. In this review, we introduced the versatility of a Lab Streaming Layer (LSL)-based application that can overcome two common issues in measuring multimodal data: jitter and latency. We discussed the issues of jitter and latency in multimodal recordings and the benefits of time-synchronization when recording with multiple devices. In addition, a computer simulation was performed to highlight how the millisecond-order jitter readily affects the signal-to-noise ratio of the electrophysiological outcome. Together, we argue that the LSL-based system can be used for research requiring precise time-alignment of datasets. Studies that detect stimulus-induced transient neural responses or test hypotheses regarding temporal relationships of different functional aspects with multimodal data would benefit most from LSL-based systems.
Collapse
Affiliation(s)
- Seitaro Iwama
- Department of Biosciences and Informatics, Faculty of Science and Technology, Keio University, Japan
| | - Mitsuaki Takemi
- Graduate School of Science and Technology, Keio University, Japan; Japan Science and Technology Agency PRESTO, Japan
| | - Ryo Eguchi
- Graduate School of Science and Technology, Keio University, Japan
| | - Ryotaro Hirose
- Graduate School of Science and Technology, Keio University, Japan
| | - Masumi Morishige
- Graduate School of Science and Technology, Keio University, Japan
| | - Junichi Ushiba
- Department of Biosciences and Informatics, Faculty of Science and Technology, Keio University, Japan.
| |
Collapse
|
5
|
Iwama S, Morishige M, Kodama M, Takahashi Y, Hirose R, Ushiba J. High-density scalp electroencephalogram dataset during sensorimotor rhythm-based brain-computer interfacing. Sci Data 2023; 10:385. [PMID: 37322080 PMCID: PMC10272177 DOI: 10.1038/s41597-023-02260-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 05/22/2023] [Indexed: 06/17/2023] Open
Abstract
Real-time functional imaging of human neural activity and its closed-loop feedback enable voluntary control of targeted brain regions. In particular, a brain-computer interface (BCI), a direct bridge of neural activities and machine actuation is one promising clinical application of neurofeedback. Although a variety of studies reported successful self-regulation of motor cortical activities probed by scalp electroencephalogram (EEG), it remains unclear how neurophysiological, experimental conditions or BCI designs influence variability in BCI learning. Here, we provide the EEG data during using BCIs based on sensorimotor rhythm (SMR), consisting of 4 separate datasets. All EEG data were acquired with a high-density scalp EEG setup containing 128 channels covering the whole head. All participants were instructed to perform motor imagery of right-hand movement as the strategy to control BCIs based on the task-related power attenuation of SMR magnitude, that is event-related desynchronization. This dataset would allow researchers to explore the potential source of variability in BCI learning efficiency and facilitate follow-up studies to test the explicit hypotheses explored by the dataset.
Collapse
Affiliation(s)
- Seitaro Iwama
- Department of Biosciences and Informatics, Faculty of Science and Technology, Keio University, Tokyo, Kanagawa, Japan
| | - Masumi Morishige
- Graduate School of Science and Technology, Keio University, Tokyo, Kanagawa, Japan
| | - Midori Kodama
- Graduate School of Science and Technology, Keio University, Tokyo, Kanagawa, Japan
| | - Yoshikazu Takahashi
- Graduate School of Science and Technology, Keio University, Tokyo, Kanagawa, Japan
| | - Ryotaro Hirose
- Graduate School of Science and Technology, Keio University, Tokyo, Kanagawa, Japan
| | - Junichi Ushiba
- Department of Biosciences and Informatics, Faculty of Science and Technology, Keio University, Tokyo, Kanagawa, Japan.
| |
Collapse
|
6
|
Abstract
Because recovery from upper limb paralysis after stroke is challenging, compensatory approaches have been the main focus of upper limb rehabilitation. However, based on fundamental and clinical research indicating that the brain has a far greater potential for plastic change than previously thought, functional restorative approaches have become increasingly common. Among such interventions, constraint-induced movement therapy, task-specific training, robotic therapy, neuromuscular electrical stimulation (NMES), mental practice, mirror therapy, and bilateral arm training are recommended in recently published stroke guidelines. For severe upper limb paralysis, however, no effective therapy has yet been established. Against this background, there is growing interest in applying brain-machine interface (BMI) technologies to upper limb rehabilitation. Increasing numbers of randomized controlled trials have demonstrated the effectiveness of BMI neurorehabilitation, and several meta-analyses have shown medium to large effect sizes with BMI therapy. Subgroup analyses indicate higher intervention effects in the subacute group than the chronic group, when using movement attempts as the BMI-training trigger task rather than using motor imagery, and using NMES as the external device compared with using other devices. The Keio BMI team has developed an electroencephalography-based neurorehabilitation system and has published clinical and basic studies demonstrating its effectiveness and neurophysiological mechanisms. For its wider clinical application, the positioning of BMI therapy in upper limb rehabilitation needs to be clarified, BMI needs to be commercialized as an easy-to-use and cost-effective medical device, and training systems for rehabilitation professionals need to be developed. A technological breakthrough enabling selective modulation of neural circuits is also needed.
Collapse
|
7
|
Beta rhythmicity in human motor cortex reflects neural population coupling that modulates subsequent finger coordination stability. Commun Biol 2022; 5:1375. [PMID: 36522455 PMCID: PMC9755311 DOI: 10.1038/s42003-022-04326-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 11/30/2022] [Indexed: 12/23/2022] Open
Abstract
Human behavior is not performed completely as desired, but is influenced by the inherent rhythmicity of the brain. Here we show that anti-phase bimanual coordination stability is regulated by the dynamics of pre-movement neural oscillations in bi-hemispheric primary motor cortices (M1) and supplementary motor area (SMA). In experiment 1, pre-movement bi-hemispheric M1 phase synchrony in beta-band (M1-M1 phase synchrony) was online estimated from 129-channel scalp electroencephalograms. Anti-phase bimanual tapping preceded by lower M1-M1 phase synchrony exhibited significantly longer duration than tapping preceded by higher M1-M1 phase synchrony. Further, the inter-individual variability of duration was explained by the interaction of pre-movement activities within the motor network; lower M1-M1 phase synchrony and spectral power at SMA were associated with longer duration. The necessity of cortical interaction for anti-phase maintenance was revealed by sham-controlled repetitive transcranial magnetic stimulation over SMA in another experiment. Our results demonstrate that pre-movement cortical oscillatory coupling within the motor network unknowingly influences bimanual coordination performance in humans after consolidation, suggesting the feasibility of augmenting human motor ability by covertly monitoring preparatory neural dynamics.
Collapse
|
8
|
Uehara K, Togo H, Hanakawa T. Precise motor rhythmicity relies on motor network responsivity. Cereb Cortex 2022; 33:4432-4447. [PMID: 36218995 DOI: 10.1093/cercor/bhac353] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 08/14/2022] [Accepted: 08/15/2022] [Indexed: 11/14/2022] Open
Abstract
Rhythmic movements are the building blocks of human behavior. However, given that rhythmic movements are achieved through complex interactions between neural modules, it remains difficult to clarify how the central nervous system controls motor rhythmicity. Here, using a novel tempo-precision trade-off paradigm, we first modeled interindividual behavioral differences in tempo-dependent rhythmicity for various external tempi. We identified 2 behavioral extremes: conventional and paradoxical tempo-precision trade-off types. We then explored the neural substrates of these behavioral differences using task and resting-state functional magnetic resonance imaging. We found that the responsibility of interhemispheric motor network connectivity to tempi was a key to the behavioral repertoire. In the paradoxical trade-off type, interhemispheric connectivity was low at baseline but increased in response to increasing tempo; in the conventional trade-off type, strong baseline connectivity was coupled with low responsivity. These findings suggest that tunable interhemispheric connectivity underlies tempo-dependent rhythmicity control.
Collapse
Affiliation(s)
- Kazumasa Uehara
- Department of Advanced Neuroimaging, Integrative Brain Imaging Center, National Center of Neurology and Psychiatry, Kodaira, Tokyo 1878551, Japan.,Division of Neural Dynamics, Department of System Neuroscience, National Institute for Physiological Sciences, Okazaki, Aichi 4448585, Japan.,Department of Physiological Sciences, School of Life Sciences, SOKENDAI (The Graduate University for Advanced Studies), Okazaki, Aichi 4448585, Japan
| | - Hiroki Togo
- Department of Advanced Neuroimaging, Integrative Brain Imaging Center, National Center of Neurology and Psychiatry, Kodaira, Tokyo 1878551, Japan.,Department of Integrated Neuroanatomy and Neuroimaging, Kyoto University Graduate School of Medicine, Kyoto 6068501, Japan
| | - Takashi Hanakawa
- Department of Advanced Neuroimaging, Integrative Brain Imaging Center, National Center of Neurology and Psychiatry, Kodaira, Tokyo 1878551, Japan.,Department of Integrated Neuroanatomy and Neuroimaging, Kyoto University Graduate School of Medicine, Kyoto 6068501, Japan
| |
Collapse
|
9
|
Hayashi M, Okuyama K, Mizuguchi N, Hirose R, Okamoto T, Kawakami M, Ushiba J. Spatially bivariate EEG-neurofeedback can manipulate interhemispheric inhibition. eLife 2022; 11:76411. [PMID: 35796537 PMCID: PMC9302968 DOI: 10.7554/elife.76411] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Accepted: 07/06/2022] [Indexed: 11/19/2022] Open
Abstract
Human behavior requires inter-regional crosstalk to employ the sensorimotor processes in the brain. Although external neuromodulation techniques have been used to manipulate interhemispheric sensorimotor activity, a central controversy concerns whether this activity can be volitionally controlled. Experimental tools lack the power to up- or down-regulate the state of the targeted hemisphere over a large dynamic range and, therefore, cannot evaluate the possible volitional control of the activity. We addressed this difficulty by using the recently developed method of spatially bivariate electroencephalography (EEG)-neurofeedback to systematically enable the participants to modulate their bilateral sensorimotor activities. Here, we report that participants learn to up- and down-regulate the ipsilateral excitability to the imagined hand while maintaining constant contralateral excitability; this modulates the magnitude of interhemispheric inhibition (IHI) assessed by the paired-pulse transcranial magnetic stimulation (TMS) paradigm. Further physiological analyses revealed that the manipulation capability of IHI magnitude reflected interhemispheric connectivity in EEG and TMS, which was accompanied by intrinsic bilateral cortical oscillatory activities. Our results show an interesting approach for neuromodulation, which might identify new treatment opportunities, e.g., in patients suffering from a stroke.
Collapse
Affiliation(s)
- Masaaki Hayashi
- Graduate School of Science and Technology, Keio University, Kanagawa, Japan
| | - Kohei Okuyama
- Department of Rehabilitation Medicine, Keio University, Tokyo, Japan
| | - Nobuaki Mizuguchi
- Research Organization of Science and Technology, Ritsumeikan University, Shiga, Japan
| | - Ryotaro Hirose
- Graduate School of Science and Technology, Keio University, Kanagawa, Japan
| | - Taisuke Okamoto
- Graduate School of Science and Technology, Keio University, Kanagawa, Japan
| | | | - Junichi Ushiba
- Faculty of Science and Technology, Keio University, Kanagawa, Japan
| |
Collapse
|
10
|
Shan L, Huang H, Zhang Z, Wang Y, Gu F, Lu M, Zhou W, Jiang Y, Dai J. Mapping the emergence of visual consciousness in the human brain via brain-wide intracranial electrophysiology. Innovation (N Y) 2022; 3:100243. [PMID: 35519511 PMCID: PMC9065914 DOI: 10.1016/j.xinn.2022.100243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 04/12/2022] [Indexed: 10/25/2022] Open
|