1
|
Huang S, Liu Y, Wang Z, Wu W, Guo J, Xu W, Ming D. Enhanced Brain Functional Interaction Following BCI-Guided Supernumerary Robotic Finger Training Based on Sixth-Finger Motor Imagery. IEEE Trans Neural Syst Rehabil Eng 2025; 33:1519-1528. [PMID: 40257872 DOI: 10.1109/tnsre.2025.3562700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/23/2025]
Abstract
Supernumerary robotic finger (SRF) has shown unique advantages in the field of motor augmentation and rehabilitation, while the development of brain computer interface (BCI) technology has provided the possibility for direct control of SRF. However, the neuroplasticity effects of BCI-actuated SRF (BCI-SRF) training based on the "six finger" motor imagery paradigm are still unclear. This study recruited 20 healthy right-handed participants and randomly assigned them to either a BCI-SRF training group or a sham SRF training group. During the testing phase before and after 4 weeks of training, all participants were tested for SRF-finger opposition sequence behavior, resting state fMRI (rs-fMRI), and task-based fMRI (tb-fMRI). The results showed that compared with the Sham group, the BCI-SRF group improved the accuracy rate of the SRF-finger opposition sequence by 132%. The activation analysis of tb-fMRI before and after training revealed a significant increase in left middle frontal gyrus only in the BCI-SRF group. In addition, the BCI-SRF group showed an increase in FC between the right primary motor cortex and left cerebellum inferior lobe, as well as between the left middle frontal gyrus and the right precuneus lobe after training, while there was no significant change in the Sham group. In addition, only the BCI-SRF group showed a significant increase in clustering coefficients after training. Moreover, the increase in the clustering coefficients of the two groups is positively correlated with the improvement of the accuracy of the SRF-finger opposition sequences. These results indicate that the integration of BCI and SRF significantly regulates the functional interaction between motor learning and cognitive imagery brain regions, enhances the integration and processing ability of brain networks for local information, and improves human-machine interaction behavioral performance.
Collapse
|
2
|
Liu Y, Huang S, Xu W, Wang Z, Ming D. An fMRI study on the generalization of motor learning after brain actuated supernumerary robot training. NPJ SCIENCE OF LEARNING 2024; 9:80. [PMID: 39738213 DOI: 10.1038/s41539-024-00294-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Accepted: 12/20/2024] [Indexed: 01/01/2025]
Abstract
Generalization is central to motor learning. However, few studies are on the learning generalization of BCI-actuated supernumerary robotic finger (BCI-SRF) for human-machine interaction training, and no studies have explored its longitudinal neuroplasticity mechanisms. Here, 20 healthy right-handed participants were recruited and randomly assigned to BCI-SRF group or inborn finger group (Finger) for 4-week training and measured by novel SRF-finger opposition sequences and multimodal MRI. After training, the BCI-SRF group showed 350% times compared to the Finger group in the improvement of sequence opposition accuracy before and after training, and accompanied by significant functional connectivity increases in the sensorimotor region and prefrontal cortex, as well as in the intra- and inter-hemisphere of the sensorimotor network. Moreover, Granger Causality Analysis identified causal effect main transfer within the sensorimotor cortex-cerebellar-thalamus loop and frontal-parietal loop. The findings suggest that BCI-SRF training enhances motor sequence learning ability by influencing the functional reorganization of sensorimotor network.
Collapse
Affiliation(s)
- Yuan Liu
- Academy of Medical Engineering and Translational Medicine (AMT), Tianjin University, Tianjin, China.
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, Tianjin, China.
- State Key Laboratory of Advanced Medical Materials and Devices, Tianjin, Tianjin, China.
| | - Shuaifei Huang
- Academy of Medical Engineering and Translational Medicine (AMT), Tianjin University, Tianjin, China
| | - Weiguo Xu
- Tianjin Hospital, Tianjin University, Tianjin, China
| | - Zhuang Wang
- Academy of Medical Engineering and Translational Medicine (AMT), Tianjin University, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine (AMT), Tianjin University, Tianjin, China.
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, Tianjin, China.
- State Key Laboratory of Advanced Medical Materials and Devices, Tianjin, Tianjin, China.
| |
Collapse
|
3
|
Huang S, Liu Y, Xu W, Wang Z, Ming D. Enhancement of Functional Connectivity in Frontal-Parietal Regions After BCI-Actuated Supernumerary Robotic Finger Training. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-4. [PMID: 40040056 DOI: 10.1109/embc53108.2024.10781807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
The supernumerary robotic finger (SRF) can expand human hand abilities to achieve motor augmentation, and integrate with brain computer interface (BCI) to free the occupation of inherent body degrees of freedom. However, the neuro remodeling mechanisms of brain-actuated SRF training is not clear. In this study, a BCI-actuated SRF was used to investigate the concurrent changes in behavior and brain activity. After 4 weeks BCI-SRF training, the novel sequence operation accuracy rate enhanced by more than 350% compared with innate finger training (IFT). Task-based fMRI showed a significant increase in lateral activation of sensorimotor cortex and found a significant activation change in S1M1_L area. Moreover, BCI-SRF training significantly increase functional connectivity (FC) between S1M1_L and Frontal_Mid_L compared with IFT at post stage. And this FC increase in frontal-parietal is also significant at post vs pre in BCI-SRF group and significantly correlated with the improvement of motor sequence accuracy rate. Our findings provide useful insights into the enhanced human-machine interaction and this efficacy exhibited significant potential for clinical rehabilitation application.
Collapse
|
4
|
Marucci M, Maddaluno O, Ryan CP, Perciballi C, Vasta S, Ciotti S, Moscatelli A, Betti V. Rewiring the evolution of the human hand: How the embodiment of a virtual bionic tool improves behavior. iScience 2024; 27:109937. [PMID: 39055602 PMCID: PMC11270032 DOI: 10.1016/j.isci.2024.109937] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 11/02/2023] [Accepted: 05/06/2024] [Indexed: 07/27/2024] Open
Abstract
Humans are the most versatile tool users among animals. Accordingly, our manual skills evolved alongside the shape of the hand. In the future, further evolution may take place: humans may merge with their tools, and technology may integrate into our biology in a way that blurs the line between the two. So, the question is whether humans can embody a bionic tool (i.e., experience it as part of their body) and thus if this would affect behavior. We investigated in virtual reality how the substitution of the hand with a virtual grafting of an end-effector, either non-naturalistic (a bionic tool) or naturalistic (a hand), impacts embodiment and behavior. Across four experiments, we show that the virtual grafting of a bionic tool elicits a sense of embodiment similar to or even stronger than its natural counterpart. In conclusion, the natural usage of bionic tools can rewire the evolution of human behavior.
Collapse
Affiliation(s)
- Matteo Marucci
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Laboratory of Neuroscience and Applied Technology, Santa Lucia Foundation IRCCS, Rome, Italy
| | - Ottavia Maddaluno
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Laboratory of Neuroscience and Applied Technology, Santa Lucia Foundation IRCCS, Rome, Italy
| | - Colleen Patricia Ryan
- Department of Systems Medicine, University of Rome Tor Vergata, Rome, Italy
- Laboratory of Neuromotor Physiology, Santa Lucia Foundation IRCCS, Rome, Italy
| | - Cristina Perciballi
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Laboratory of Neuroscience and Applied Technology, Santa Lucia Foundation IRCCS, Rome, Italy
| | - Simona Vasta
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Laboratory of Neuroscience and Applied Technology, Santa Lucia Foundation IRCCS, Rome, Italy
| | - Simone Ciotti
- Information Engineering Department and the Research Center “E. Piaggio”, University of Pisa, Pisa, Italy
| | - Alessandro Moscatelli
- Department of Systems Medicine, University of Rome Tor Vergata, Rome, Italy
- Laboratory of Neuromotor Physiology, Santa Lucia Foundation IRCCS, Rome, Italy
| | - Viviana Betti
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Laboratory of Neuroscience and Applied Technology, Santa Lucia Foundation IRCCS, Rome, Italy
| |
Collapse
|
5
|
Pinardi M, Longo MR, Formica D, Strbac M, Mehring C, Burdet E, Di Pino G. Impact of supplementary sensory feedback on the control and embodiment in human movement augmentation. COMMUNICATIONS ENGINEERING 2023; 2:64. [PMCID: PMC10955865 DOI: 10.1038/s44172-023-00111-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 08/23/2023] [Indexed: 01/28/2025]
Abstract
In human movement augmentation, the number of controlled degrees of freedom could be enhanced by the simultaneous and independent use of supernumerary robotic limbs (SRL) and natural ones. However, this poses several challenges, that could be mitigated by encoding and relaying the SRL status. Here, we review the impact of supplementary sensory feedback on the control and embodiment of SRLs. We classify the main feedback features and analyse how they improve control performance. We report the feasibility of pushing body representation beyond natural human morphology and suggest that gradual SRL embodiment could make multisensory incongruencies less disruptive. We also highlight shared computational bases between SRL motor control and embodiment and suggest contextualizing them within the same theoretical framework. Finally, we argue that a shift towards long term experimental paradigms is necessary for successfully integrating motor control and embodiment. Supernumerary robotic limbs are robotic devices providing additional limbs to the user. Mattia Pinardi and colleagues review the impact of supplementary sensory feedback on the control performance and embodiment of supernumerary robotic limbs.
Collapse
Affiliation(s)
- Mattia Pinardi
- NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Matthew R. Longo
- Department of Psychological Sciences, Birkbeck, University of London, London, UK
| | - Domenico Formica
- NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
- School of Engineering, Newcastle University, Newcastle upon Tyne, UK
| | - Matija Strbac
- Tecnalia Serbia Ltd, Belgrade, Serbia. University of Belgrade-School of Electrical Engineering, Belgrade, Serbia
| | - Carsten Mehring
- Bernstein Center and Faculty of Biology, University of Freiburg, Freiburg, Germany
| | - Etienne Burdet
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Giovanni Di Pino
- NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| |
Collapse
|
6
|
Targeting neural correlates of placebo effects. COGNITIVE, AFFECTIVE, & BEHAVIORAL NEUROSCIENCE 2022; 23:217-236. [PMID: 36517733 DOI: 10.3758/s13415-022-01039-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 09/26/2022] [Indexed: 12/15/2022]
Abstract
Harnessing the placebo effects would prompt critical ramifications for research and clinical practice. Noninvasive brain stimulation (NIBS) techniques, such as transcranial magnetic stimulation and multifocal transcranial electric stimulation, could manipulate the placebo response by modulating the activity and excitability of its neural correlates. To identify potential stimulation targets, we conducted a meta-analysis to investigate placebo-associated regions in healthy volunteers, including studies with emotional components and painful stimuli. Using biophysical modeling, we identified NIBS solutions to manipulate placebo effects by targeting either a single key region or multiple connected areas. Moving to a network-oriented approach, we then ran a quantitative network mapping analysis on the functional connectivity profile of clusters emerging from the meta-analysis. As a result, we suggest a multielectrode optimized montage engaging the connectivity patterns of placebo-associated functional brain networks. These NIBS solutions hope to provide a starting point to actively control, modulate or enhance placebo effects in future clinical studies and cognitive enhancement studies.
Collapse
|
7
|
De Novo Brain-Computer Interfacing Deforms Manifold of Populational Neural Activity Patterns in Human Cerebral Cortex. eNeuro 2022; 9:ENEURO.0145-22.2022. [PMID: 36376067 PMCID: PMC9721308 DOI: 10.1523/eneuro.0145-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Revised: 10/27/2022] [Accepted: 11/02/2022] [Indexed: 11/15/2022] Open
Abstract
Human brains are capable of modulating innate activities to adapt to novel environments and tasks; for sensorimotor neural system this means acquisition of a rich repertoire of activity patterns that improve behavioral performance. To directly map the process of acquiring the neural repertoire during tasks onto performance improvement, we analyzed net neural populational activity during the learning of its voluntary modulation by brain-computer interface (BCI) operation in female and male humans. The recorded whole-head high-density scalp electroencephalograms (EEGs) were subjected to dimensionality reduction algorithm to capture changes in cortical activity patterns represented by the synchronization of neuronal oscillations during adaptation. Although the preserved variance of targeted features in the reduced dimensions was 20%, we found systematic interactions between the activity patterns and BCI classifiers that detected motor attempt; the neural manifold derived in the embedded space was stretched along with motor-related features of EEG by model-based fixed classifiers but not with adaptive classifiers that were constantly recalibrated to user activity. Moreover, the manifold was deformed to be orthogonal to the boundary by de novo classifiers with a fixed decision boundary based on biologically unnatural features. Collectively, the flexibility of human cortical signaling patterns (i.e., neural plasticity) is only induced by operation of a BCI whose classifier required fixed activities, and the adaptation could be induced even the requirement is not consistent with biologically natural responses. These principles of neural adaptation at a macroscopic level may underlie the ability of humans to learn wide-ranging behavioral repertoires and adapt to novel environments.
Collapse
|
8
|
Eden J, Bräcklein M, Ibáñez J, Barsakcioglu DY, Di Pino G, Farina D, Burdet E, Mehring C. Principles of human movement augmentation and the challenges in making it a reality. Nat Commun 2022; 13:1345. [PMID: 35292665 PMCID: PMC8924218 DOI: 10.1038/s41467-022-28725-7] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 02/04/2022] [Indexed: 12/23/2022] Open
Abstract
Augmenting the body with artificial limbs controlled concurrently to one's natural limbs has long appeared in science fiction, but recent technological and neuroscientific advances have begun to make this possible. By allowing individuals to achieve otherwise impossible actions, movement augmentation could revolutionize medical and industrial applications and profoundly change the way humans interact with the environment. Here, we construct a movement augmentation taxonomy through what is augmented and how it is achieved. With this framework, we analyze augmentation that extends the number of degrees-of-freedom, discuss critical features of effective augmentation such as physiological control signals, sensory feedback and learning as well as application scenarios, and propose a vision for the field.
Collapse
Affiliation(s)
- Jonathan Eden
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Mario Bräcklein
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Jaime Ibáñez
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
- BSICoS, IIS Aragón, Universidad de Zaragoza, Zaragoza, Spain
- Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, London, UK
| | | | - Giovanni Di Pino
- NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Dario Farina
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Etienne Burdet
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK.
| | - Carsten Mehring
- Bernstein Center Freiburg, University of Freiburg, Freiburg im Breisgau, 79104, Germany
- Faculty of Biology, University of Freiburg, Freiburg im Breisgau, 79104, Germany
| |
Collapse
|
9
|
Liu Y, Huang S, Wang Z, Ji F, Ming D. Functional Reorganization After Four-Week Brain-Computer Interface-Controlled Supernumerary Robotic Finger Training: A Pilot Study of Longitudinal Resting-State fMRI. Front Neurosci 2022; 15:766648. [PMID: 35221886 PMCID: PMC8873384 DOI: 10.3389/fnins.2021.766648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Accepted: 12/21/2021] [Indexed: 11/13/2022] Open
Abstract
Humans have long been fascinated by the opportunities afforded through motor augmentation provided by the supernumerary robotic fingers (SRFs) and limbs (SRLs). However, the neuroplasticity mechanism induced by the motor augmentation equipment still needs further investigation. This study focused on the resting-state brain functional reorganization during longitudinal brain-computer interface (BCI)-controlled SRF training in using the fractional amplitude of low-frequency fluctuation (fALFF), regional homogeneity (ReHo), and degree centrality (DC) metrics. Ten right-handed subjects were enrolled for 4 weeks of BCI-controlled SRF training. The behavioral data and the neurological changes were recorded at baseline, training for 2 weeks, training for 4 weeks immediately after, and 2 weeks after the end of training. One-way repeated-measure ANOVA was used to investigate long-term motor improvement [F(2.805,25.24) = 43.94, p < 0.0001] and neurological changes. The fALFF values were significantly modulated in Cerebelum_6_R and correlated with motor function improvement (r = 0.6887, p < 0.0402) from t0 to t2. Besides, Cerebelum_9_R and Vermis_3 were also significantly modulated and showed different trends in longitudinal SRF training in using ReHo metric. At the same time, ReHo values that changed from t0 to t1 in Vermis_3 was significantly correlated with motor function improvement (r = 0.7038, p < 0.0344). We conclude that the compensation and suppression mechanism of the cerebellum existed during BCI-controlled SRF training, and this current result provided evidence to the neuroplasticity mechanism brought by the BCI-controlled motor-augmentation devices.
Collapse
Affiliation(s)
| | | | | | | | - Dong Ming
- Academy of Medical Engineering and Translational Medicine (AMT), Tianjin University, Tianjin, China
| |
Collapse
|