1
|
Darvishi S, Datta Gupta A, Hamilton-Bruce A, Koblar S, Baumert M, Abbott D. Enhancing poststroke hand movement recovery: Efficacy of RehabSwift, a personalized brain-computer interface system. PNAS NEXUS 2024; 3:pgae240. [PMID: 38984151 PMCID: PMC11232286 DOI: 10.1093/pnasnexus/pgae240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 06/06/2024] [Indexed: 07/11/2024]
Abstract
This study explores the efficacy of our novel and personalized brain-computer interface (BCI) therapy, in enhancing hand movement recovery among stroke survivors. Stroke often results in impaired motor function, posing significant challenges in daily activities and leading to considerable societal and economic burdens. Traditional physical and occupational therapies have shown limitations in facilitating satisfactory recovery for many patients. In response, our study investigates the potential of motor imagery-based BCIs (MI-BCIs) as an alternative intervention. In this study, MI-BCIs translate imagined hand movements into actions using a combination of scalp-recorded electrical brain activity and signal processing algorithms. Our prior research on MI-BCIs, which emphasizes the benefits of proprioceptive feedback over traditional visual feedback and the importance of customizing the delay between brain activation and passive hand movement, led to the development of RehabSwift therapy. In this study, we recruited 12 chronic-stage stroke survivors to assess the effectiveness of our solution. The primary outcome measure was the Fugl-Meyer upper extremity (FMA-UE) assessment, complemented by secondary measures including the action research arm test, reaction time, unilateral neglect, spasticity, grip and pinch strength, goal attainment scale, and FMA-UE sensation. Our findings indicate a remarkable improvement in hand movement and a clinically significant reduction in poststroke arm and hand impairment following 18 sessions of neurofeedback training. The effects persisted for at least 4 weeks posttreatment. These results underscore the potential of MI-BCIs, particularly our solution, as a prospective tool in stroke rehabilitation, offering a personalized and adaptable approach to neurofeedback training.
Collapse
Affiliation(s)
- Sam Darvishi
- RehabSwift Pty Ltd, 10 Pulteney Street, The University of Adelaide, Adelaide, SA 5000, Australia
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA 5000, Australia
| | - Anupam Datta Gupta
- Department of Rehabilitation Medicine, The Queen Elizabeth Hospital, Woodville, SA 5011, Australia
- Adelaide Medical School, The University of Adelaide, Adelaide, SA 5000, Australia
| | - Anne Hamilton-Bruce
- Stroke Research Programme, Basil Hetzel Institute, The Queen Elizabeth Hospital, Central Adelaide Local Health Network, Woodville, SA 5011, Australia
| | - Simon Koblar
- Adelaide Medical School, The University of Adelaide, Adelaide, SA 5000, Australia
| | - Mathias Baumert
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA 5000, Australia
| | - Derek Abbott
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA 5000, Australia
| |
Collapse
|
2
|
Saha S, Baumert M, McEwan A. Can Inter-Subject Associativity Predict Data-Driven BCI Performance? ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38082677 DOI: 10.1109/embc40787.2023.10340490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Intra- and inter-subject variability causes covariate shifts in training and testing feature spaces, resulting in low sensorimotor (SMR) brain-computer interface (BCI) performance for practical implementation. Studies involving data-driven transfer learning strategies demonstrated improving BCI performance by covariate shift adaptation. In this study, we aim to illustrate if inter-subject associativity (e.g., subjects having similar SMR brain dynamics) can predict data-driven inter-subject BCI performance. We implemented a BCI classification pipeline with a common spatial pattern, principal component analysis and linear discriminant analysis for performance evaluation. Both intra- and inter-subject BCI were evaluated in 5-Fold Validation settings. We further proposed a Bhattacharyya distance-based covariate shift score (CSS) for assessing the difference between training and testing feature domains. We performed Pearson correlation analysis to draw the relation-ship between BCI performance and CSS. Intra-subject BCI performances were significantly and negatively correlated with CSS (r = -0.94, p < 0.05). For the inter-subject experiment, BCI performances were also highly and negatively associated with CSS (r = -0.61, p < 0.05). However, this data-driven BCI evaluation framework does not necessarily manifest inter-subject associativity in BCI performance, requiring further investigations for a conclusion.Clinical relevance- If it predicts BCI performance successfully, inter-subject associativity could reduce time-consuming and annoying subject-specific calibration for the users.
Collapse
|
3
|
Hu H, Yue K, Guo M, Lu K, Liu Y. Subject Separation Network for Reducing Calibration Time of MI-Based BCI. Brain Sci 2023; 13:brainsci13020221. [PMID: 36831764 PMCID: PMC9954620 DOI: 10.3390/brainsci13020221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 01/11/2023] [Accepted: 01/20/2023] [Indexed: 02/03/2023] Open
Abstract
Motor imagery brain-computer interface (MI-based BCIs) have demonstrated great potential in various applications. However, to well generalize classifiers to new subjects, a time-consuming calibration process is necessary due to high inter-subject variabilities of EEG signals. This process is costly and tedious, hindering the further expansion of MI-based BCIs outside of the laboratory. To reduce the calibration time of MI-based BCIs, we propose a novel domain adaptation framework that adapts multiple source subjects' labeled data to the unseen trials of target subjects. Firstly, we train one Subject Separation Network(SSN) for each of the source subjects in the dataset. Based on adversarial domain adaptation, a shared encoder is constructed to learn similar representations for both domains. Secondly, to model the factors that cause subject variabilities and eliminate the correlated noise existing in common feature space, private feature spaces orthogonal to the shared counterpart are learned for each subject. We use a shared decoder to validate that the model is actually learning from task-relevant neurophysiological information. At last, an ensemble classifier is built by the integration of the SSNs using the information extracted from each subject's task-relevant characteristics. To quantify the efficacy of the framework, we analyze the accuracy-calibration cost trade-off in MI-based BCIs, and theoretically guarantee a generalization bound on the target error. Visualizations of the transformed features illustrate the effectiveness of domain adaptation. The experimental results on the BCI Competition IV-IIa dataset prove the effectiveness of the proposed framework compared with multiple classification methods. We infer from our results that users could learn to control MI-based BCIs without a heavy calibration process. Our study further shows how to design and train Neural Networks to decode task-related information from different subjects and highlights the potential of deep learning methods for inter-subject EEG decoding.
Collapse
Affiliation(s)
- Haochen Hu
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Kang Yue
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
- Institute of Software, Chinese Academy of Sciences, Beijing 100045, China
| | - Mei Guo
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Kai Lu
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Yue Liu
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
- Correspondence:
| |
Collapse
|
4
|
Horowitz AJ, Guger C, Korostenskaja M. What Internal Variables Affect Sensorimotor Rhythm Brain-Computer Interface (SMR-BCI) Performance? HCA HEALTHCARE JOURNAL OF MEDICINE 2021; 2:163-179. [PMID: 37427003 PMCID: PMC10324829 DOI: 10.36518/2689-0216.1196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
Description In this review article, we aimed to create a summary of the effects of internal variables on the performance of sensorimotor rhythm-based brain computer interfaces (SMR-BCIs). SMR-BCIs can be potentially used for interfacing between the brain and devices, bypassing usual central nervous system output, such as muscle activity. The careful consideration of internal factors, affecting SMR-BCI performance, can maximize BCI application in both healthy and disabled people. Internal variables may be generalized as descriptors of the processes mainly dependent on the BCI user and/or originating within the user. The current review aimed to critically evaluate and summarize the currently accumulated body of knowledge regarding the effect of internal variables on SMR-BCI performance. The examples of such internal variables include motor imagery, hand coordination, attention, motivation, quality of life, mood and neurophysiological signals other than SMR. We will conclude our review with the discussion about the future developments regarding the research on the effects of internal variables on SMR-BCI performance. The end-goal of this review paper is to provide current BCI users and researchers with the reference guide that can help them optimize the SMR-BCI performance by accounting for possible influences of various internal factors.
Collapse
Affiliation(s)
- Alex J. Horowitz
- Functional Brain Mapping and Brain Computer Interface Lab, Neuroscience Institute, AdventHealth Orlando, Orlando, FL,
USA
- University of Central Florida/HCA Healthcare GME Consortium, Gainesville, Florida
| | | | - Milena Korostenskaja
- Functional Brain Mapping and Brain Computer Interface Lab, Neuroscience Institute, AdventHealth Orlando, Orlando, FL,
USA
- MEG Lab, AdventHealth for Children, Orlando, FL,
USA
- Department of Psychology, College of Arts and Sciences, University of North Florida, Jacksonville, FL,
USA
- Comprehensive Epilepsy Center, AdventHealth Orlando, Orlando, FL,
USA
| |
Collapse
|
5
|
Leeuwis N, Paas A, Alimardani M. Vividness of Visual Imagery and Personality Impact Motor-Imagery Brain Computer Interfaces. Front Hum Neurosci 2021; 15:634748. [PMID: 33889080 PMCID: PMC8055841 DOI: 10.3389/fnhum.2021.634748] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Accepted: 03/08/2021] [Indexed: 12/19/2022] Open
Abstract
Brain-computer interfaces (BCIs) are communication bridges between a human brain and external world, enabling humans to interact with their environment without muscle intervention. Their functionality, therefore, depends on both the BCI system and the cognitive capacities of the user. Motor-imagery BCIs (MI-BCI) rely on the users' mental imagination of body movements. However, not all users have the ability to sufficiently modulate their brain activity for control of a MI-BCI; a problem known as BCI illiteracy or inefficiency. The underlying mechanism of this phenomenon and the cause of such difference among users is yet not fully understood. In this study, we investigated the impact of several cognitive and psychological measures on MI-BCI performance. Fifty-five novice BCI-users participated in a left- versus right-hand motor imagery task. In addition to their BCI classification error rate and demographics, psychological measures including personality factors, affinity for technology, and motivation during the experiment, as well as cognitive measures including visuospatial memory and spatial ability and Vividness of Visual Imagery were collected. Factors that were found to have a significant impact on MI-BCI performance were Vividness of Visual Imagery, and the personality factors of orderliness and autonomy. These findings shed light on individual traits that lead to difficulty in BCI operation and hence can help with early prediction of inefficiency among users to optimize training for them.
Collapse
Affiliation(s)
- Nikki Leeuwis
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, Netherlands
| | | | | |
Collapse
|
6
|
Singh A, Hussain AA, Lal S, Guesgen HW. A Comprehensive Review on Critical Issues and Possible Solutions of Motor Imagery Based Electroencephalography Brain-Computer Interface. SENSORS 2021; 21:s21062173. [PMID: 33804611 PMCID: PMC8003721 DOI: 10.3390/s21062173] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Revised: 03/15/2021] [Accepted: 03/16/2021] [Indexed: 01/16/2023]
Abstract
Motor imagery (MI) based brain–computer interface (BCI) aims to provide a means of communication through the utilization of neural activity generated due to kinesthetic imagination of limbs. Every year, a significant number of publications that are related to new improvements, challenges, and breakthrough in MI-BCI are made. This paper provides a comprehensive review of the electroencephalogram (EEG) based MI-BCI system. It describes the current state of the art in different stages of the MI-BCI (data acquisition, MI training, preprocessing, feature extraction, channel and feature selection, and classification) pipeline. Although MI-BCI research has been going for many years, this technology is mostly confined to controlled lab environments. We discuss recent developments and critical algorithmic issues in MI-based BCI for commercial deployment.
Collapse
|
7
|
Saha S, Baumert M. Intra- and Inter-subject Variability in EEG-Based Sensorimotor Brain Computer Interface: A Review. Front Comput Neurosci 2020; 13:87. [PMID: 32038208 PMCID: PMC6985367 DOI: 10.3389/fncom.2019.00087] [Citation(s) in RCA: 94] [Impact Index Per Article: 18.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 12/16/2019] [Indexed: 12/05/2022] Open
Abstract
Brain computer interfaces (BCI) for the rehabilitation of motor impairments exploit sensorimotor rhythms (SMR) in the electroencephalogram (EEG). However, the neurophysiological processes underpinning the SMR often vary over time and across subjects. Inherent intra- and inter-subject variability causes covariate shift in data distributions that impede the transferability of model parameters amongst sessions/subjects. Transfer learning includes machine learning-based methods to compensate for inter-subject and inter-session (intra-subject) variability manifested in EEG-derived feature distributions as a covariate shift for BCI. Besides transfer learning approaches, recent studies have explored psychological and neurophysiological predictors as well as inter-subject associativity assessment, which may augment transfer learning in EEG-based BCI. Here, we highlight the importance of measuring inter-session/subject performance predictors for generalized BCI frameworks for both normal and motor-impaired people, reducing the necessity for tedious and annoying calibration sessions and BCI training.
Collapse
Affiliation(s)
- Simanto Saha
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| | - Mathias Baumert
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
8
|
Caligari M, Godi M, Giardini M, Colombo R. Development of a new high sensitivity mechanical switch for augmentative and alternative communication access in people with amyotrophic lateral sclerosis. J Neuroeng Rehabil 2019; 16:152. [PMID: 31783763 PMCID: PMC6884866 DOI: 10.1186/s12984-019-0626-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2019] [Accepted: 10/10/2019] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND People with Amyotrophic Lateral Sclerosis (PwALS) in the advanced phase are critically affected by an almost total loss of mobility and severe communication problems. Scanning access based on the patient's interaction with a sensor (or switch) that intercepts even a weak body movement is a valid communication aid. However, its use becomes limited with the progressive decline of residual movements. To overcome this problem, we designed a new sensor, the Lever Magnetic-spring Mechanical Switch (LeMMS), allowing repeated activation/release cycles requiring a very small activation force. METHODS The LeMMS was applied and validated in a group of 20 PwALS in an advanced stage of disease. All subjects were regular users of communication aids employing other sensors, but which they could no longer operate their sensors (different from LeMMS). Patients were assessed at baseline (t0) and after one (t1), 6 (t2) and 12 (t3) months. Assessment at t0 included administration of standardized clinical scales, the Click-Test-30 counting the maximum number of LeMMS activations in 30 s, and thumb/fingers strength assessment with the Kendall scale. The QUEST 2.0-Dev questionnaire was administered at t1. Some use-related information and the Click-Test-30 were collected at t1, t2 and t3. RESULTS After one training session, all patients could operate the LeMMS with minimal residual movement of one finger. At t1, they used it on average 5.45 h/day. The mean score of the QUEST 2.0-Dev was 4.63, suggesting strong satisfaction with the LeMMS. Regarding Click-Test-30 scores, no significant difference was found between t0 and t1, but performance at t2 and t3 declined significantly (p < 0.005 vs. t0). At t3, 9/20 patients were still able to use their communication aid. CONCLUSIONS This new switch sensor can enable PwALS to use their communication aids for a prolonged time even in the advanced phase of disease. It is easy to use, reliable and cheap, thus representing an intermediate alternative to more sophisticated and costly devices.
Collapse
Affiliation(s)
- M Caligari
- Istituti Clinici Scientifici Maugeri Spa SB (IRCCS), Institute of Pavia, 27100, Pavia (PV), Italy
| | - M Godi
- Istituti Clinici Scientifici Maugeri Spa SB (IRCCS), Institute of Pavia, 27100, Pavia (PV), Italy.
| | - M Giardini
- Istituti Clinici Scientifici Maugeri Spa SB (IRCCS), Institute of Veruno, 28013, Gattico-Veruno (NO), Italy
| | - R Colombo
- Istituti Clinici Scientifici Maugeri Spa SB (IRCCS), Institute of Veruno, 28013, Gattico-Veruno (NO), Italy
| |
Collapse
|
9
|
Affiliation(s)
- Sam E John
- Department of Biomedical Engineering, The University of Melbourne , Melbourne , Australia
| | - David B Grayden
- Department of Biomedical Engineering, The University of Melbourne , Melbourne , Australia
| | | |
Collapse
|