1
|
Penna MF, Giordano L, Tortora S, Astarita D, Amato L, Dell’Agnello F, Menegatti E, Gruppioni E, Vitiello N, Crea S, Trigili E. A muscle synergies-based controller to drive a powered upper-limb exoskeleton in reaching tasks. WEARABLE TECHNOLOGIES 2024; 5:e14. [PMID: 39575326 PMCID: PMC11579892 DOI: 10.1017/wtc.2024.16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 06/21/2024] [Accepted: 07/09/2024] [Indexed: 11/24/2024]
Abstract
This work introduces a real-time intention decoding algorithm grounded in muscle synergies (Syn-ID). The algorithm detects the electromyographic (EMG) onset and infers the direction of the movement during reaching tasks to control a powered shoulder-elbow exoskeleton. Features related to muscle synergies are used in a Gaussian Mixture Model and probability accumulation-based logic to infer the user's movement direction. The performance of the algorithm was verified by a feasibility study including eight healthy participants. The experiments comprised a transparent session, during which the exoskeleton did not provide any assistance, and an assistive session in which the Syn-ID strategy was employed. Participants were asked to reach eight targets equally spaced on a circumference of 25 cm radius (adjusted chance level: 18.1%). The results showed an average accuracy of 48.7% after 0.6 s from the EMG onset. Most of the confusion of the estimate was found along directions adjacent to the actual one (type 1 error: 33.4%). Effects of the assistance were observed in a statistically significant reduction in the activation of Posterior Deltoid and Triceps Brachii. The final positions of the movements during the assistive session were on average 1.42 cm far from the expected ones, both when the directions were estimated correctly and when type 1 errors occurred. Therefore, combining accurate estimates with type 1 errors, we computed a modified accuracy of 82.10±6.34%. Results were benchmarked with respect to a purely kinematics-based approach. The Syn-ID showed better performance in the first portion of the movement (0.14 s after EMG onset).
Collapse
Affiliation(s)
- Michele Francesco Penna
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Luca Giordano
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Stefano Tortora
- Department of Information Engineering, University of Padova, Padova, Italy
- Padova Neuroscience Center, University of Padova, Padova, Italy
| | - Davide Astarita
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Lorenzo Amato
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Filippo Dell’Agnello
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Emanuele Menegatti
- Department of Information Engineering, University of Padova, Padova, Italy
- Padova Neuroscience Center, University of Padova, Padova, Italy
| | | | - Nicola Vitiello
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Simona Crea
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Emilio Trigili
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| |
Collapse
|
2
|
Leone F, Mereu F, Gentile C, Cordella F, Gruppioni E, Zollo L. Hierarchical strategy for sEMG classification of the hand/wrist gestures and forces of transradial amputees. Front Neurorobot 2023; 17:1092006. [PMID: 36968301 PMCID: PMC10035594 DOI: 10.3389/fnbot.2023.1092006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 02/17/2023] [Indexed: 03/11/2023] Open
Abstract
IntroductionThe myoelectric control strategy, based on surface electromyographic signals, has long been used for controlling a prosthetic system with multiple degrees of freedom. Several methods classify gestures and force levels but the simultaneous real-time control of hand/wrist gestures and force levels did not yet reach a satisfactory level of effectiveness.MethodsIn this work, the hierarchical classification approach, already validated on 31 healthy subjects, was adapted for the real-time control of a multi-DoFs prosthetic system on 15 trans-radial amputees. The effectiveness of the hierarchical classification approach was assessed by evaluating both offline and real-time performance using three algorithms: Logistic Regression (LR), Non-linear Logistic Regression (NLR), and Linear Discriminant Analysis (LDA).ResultsThe results of this study showed the offline performance of amputees was promising and comparable to healthy subjects, with mean F1 scores of over 90% for the “Hand/wrist gestures classifier” and 95% for the force classifiers, implemented with the three algorithms with features extraction (FE). Another significant finding of this study was the feasibility of using the hierarchical classification strategy for real-time applications, due to its ability to provide a response time of 100 ms while maintaining an average online accuracy of above 90%.DiscussionA possible solution for real-time control of both hand/wrist gestures and force levels is the combined use of the LR algorithm with FE for the "Hand/wrist gestures classifier", and the NLR with FE for the Spherical and Tip force classifiers.
Collapse
Affiliation(s)
- Francesca Leone
- Advanced Robotics and Human-Centred Technologies, Department at University Campus Bio-Medico of Rome, Rome, Italy
- *Correspondence: Francesca Leone
| | - Federico Mereu
- Advanced Robotics and Human-Centred Technologies, Department at University Campus Bio-Medico of Rome, Rome, Italy
- Istituto Nazionale Assicurazione Infortuni sul Lavoro (INAIL) Prosthetic Center, Vigorso, BO, Italy
| | - Cosimo Gentile
- Advanced Robotics and Human-Centred Technologies, Department at University Campus Bio-Medico of Rome, Rome, Italy
- Istituto Nazionale Assicurazione Infortuni sul Lavoro (INAIL) Prosthetic Center, Vigorso, BO, Italy
| | - Francesca Cordella
- Advanced Robotics and Human-Centred Technologies, Department at University Campus Bio-Medico of Rome, Rome, Italy
| | - Emanuele Gruppioni
- Istituto Nazionale Assicurazione Infortuni sul Lavoro (INAIL) Prosthetic Center, Vigorso, BO, Italy
| | - Loredana Zollo
- Advanced Robotics and Human-Centred Technologies, Department at University Campus Bio-Medico of Rome, Rome, Italy
| |
Collapse
|
3
|
Fu J, Choudhury R, Hosseini SM, Simpson R, Park JH. Myoelectric Control Systems for Upper Limb Wearable Robotic Exoskeletons and Exosuits-A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:8134. [PMID: 36365832 PMCID: PMC9655258 DOI: 10.3390/s22218134] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 10/13/2022] [Accepted: 10/21/2022] [Indexed: 06/16/2023]
Abstract
In recent years, myoelectric control systems have emerged for upper limb wearable robotic exoskeletons to provide movement assistance and/or to restore motor functions in people with motor disabilities and to augment human performance in able-bodied individuals. In myoelectric control, electromyographic (EMG) signals from muscles are utilized to implement control strategies in exoskeletons and exosuits, improving adaptability and human-robot interactions during various motion tasks. This paper reviews the state-of-the-art myoelectric control systems designed for upper-limb wearable robotic exoskeletons and exosuits, and highlights the key focus areas for future research directions. Here, different modalities of existing myoelectric control systems were described in detail, and their advantages and disadvantages were summarized. Furthermore, key design aspects (i.e., supported degrees of freedom, portability, and intended application scenario) and the type of experiments conducted to validate the efficacy of the proposed myoelectric controllers were also discussed. Finally, the challenges and limitations of current myoelectric control systems were analyzed, and future research directions were suggested.
Collapse
Affiliation(s)
- Jirui Fu
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Renoa Choudhury
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Saba M. Hosseini
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Rylan Simpson
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Joon-Hyuk Park
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| |
Collapse
|
4
|
A hierarchical classification of gestures under two force levels based on muscle synergy. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
5
|
Loopez-Larraz E, Birbaumer N, Ramos-Murguialday A. A hybrid EEG-EMG BMI improves the detection of movement intention in cortical stroke patients with complete hand paralysis. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2018:2000-2003. [PMID: 30440792 DOI: 10.1109/embc.2018.8512711] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Motor rehabilitation based on brain-machine interfaces (BMI) has been shown as a feasible option for stroke patients with complete paralysis. However, the pathologic EEG activity after a stroke makes the detection of movement intentions in these patients challenging, especially in those with damages involving the motor cortex. Residual electromyographic activity in those patients has been shown to be decodable, even in cases when the movement is not possible. Hybrid BMIs combining EEG and EMG activity have been recently proposed, although there is little evidence about how they work for completely paralyzed stroke patients. In this study we propose a neural interface, relying on EEG, EMG or EEG+EMG features, to detect movement attempts. Twenty patients with a chronic stroke affecting their motor cortex were recruited, and asked to open and close their paralyzed hand while their electrophysiological signals were recorded. We show how EEG and EMG activities provide complementary information for detecting the movement intentions, being the accuracy of the hybrid BMI significantly higher than the EEG-based system. The obtained results encourage the integration of hybrid BMI systems for motor rehabilitation of patients with paralysis due to stroke.
Collapse
|
6
|
Lyu M, Chen WH, Ding X, Wang J, Pei Z, Zhang B. Development of an EMG-Controlled Knee Exoskeleton to Assist Home Rehabilitation in a Game Context. Front Neurorobot 2019; 13:67. [PMID: 31507400 PMCID: PMC6718718 DOI: 10.3389/fnbot.2019.00067] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Accepted: 08/06/2019] [Indexed: 12/13/2022] Open
Abstract
As a leading cause of loss of functional movement, stroke often makes it difficult for patients to walk. Interventions to aid motor recovery in stroke patients should be carried out as a matter of urgency. However, muscle activity in the knee is usually too weak to generate overt movements, which poses a challenge for early post-stroke rehabilitation training. Although electromyography (EMG)-controlled exoskeletons have the potential to solve this problem, most existing robotic devices in rehabilitation centers are expensive, technologically complex, and allow only low training intensity. To address these problems, we have developed an EMG-controlled knee exoskeleton for use at home to assist stroke patients in their rehabilitation. EMG signals of the subject are acquired by an easy-to-don EMG sensor and then processed by a Kalman filter to control the exoskeleton autonomously. A newly-designed game is introduced to improve rehabilitation by encouraging patients' involvement in the training process. Six healthy subjects took part in an initial test of this new training tool. The test showed that subjects could use their EMG signals to control the exoskeleton to assist them in playing the game. Subjects found the rehabilitation process interesting, and they improved their control performance through 20-block training, with game scores increasing from 41.3 ± 15.19 to 78.5 ± 25.2. The setup process was simplified compared to traditional studies and took only 72 s according to test on one healthy subject. The time lag of EMG signal processing, which is an important aspect for real-time control, was significantly reduced to about 64 ms by employing a Kalman filter, while the delay caused by the exoskeleton was about 110 ms. This easy-to-use rehabilitation tool has a greatly simplified training process and allows patients to undergo rehabilitation in a home environment without the need for a therapist to be present. It has the potential to improve the intensity of rehabilitation and the outcomes for stroke patients in the initial phase of rehabilitation.
Collapse
Affiliation(s)
- Mingxing Lyu
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
- Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Wei-Hai Chen
- College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao, China
| | - Xilun Ding
- School of Mechanical Engineering and Automation, Beihang University, Beijing, China
| | - Jianhua Wang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| | - Zhongcai Pei
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| | - Baochang Zhang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| |
Collapse
|
7
|
Sarasola-Sanz A, Irastorza-Landa N, López-Larraz E, Shiman F, Spüler M, Birbaumer N, Ramos-Murguialday A. Design and effectiveness evaluation of mirror myoelectric interfaces: a novel method to restore movement in hemiplegic patients. Sci Rep 2018; 8:16688. [PMID: 30420779 PMCID: PMC6232088 DOI: 10.1038/s41598-018-34785-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2018] [Accepted: 10/22/2018] [Indexed: 12/29/2022] Open
Abstract
The motor impairment occurring after a stroke is characterized by pathological muscle activation patterns or synergies. However, while robot-aided myoelectric interfaces have been proposed for stroke rehabilitation, they do not address this issue, which might result in inefficient interventions. Here, we present a novel paradigm that relies on the correction of the pathological muscle activity as a way to elicit rehabilitation, even in patients with complete paralysis. Previous studies demonstrated that there are no substantial inter-limb differences in the muscle synergy organization of healthy individuals. We propose building a subject-specific model of muscle activity from the healthy limb and mirroring it to use it as a learning tool for the patient to reproduce the same healthy myoelectric patterns on the paretic limb during functional task training. Here, we aim at understanding how this myoelectric model, which translates muscle activity into continuous movements of a 7-degree of freedom upper limb exoskeleton, could transfer between sessions, arms and tasks. The experiments with 8 healthy individuals and 2 chronic stroke patients proved the feasibility and effectiveness of such myoelectric interface. We anticipate the proposed method to become an efficient strategy for the correction of maladaptive muscle activity and the rehabilitation of stroke patients.
Collapse
Affiliation(s)
- Andrea Sarasola-Sanz
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany. .,International Max Planck Research School for Cognitive and Systems Neuroscience, Tübingen, Germany. .,Tecnalia, San Sebastián, Spain.
| | - Nerea Irastorza-Landa
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,International Max Planck Research School for Cognitive and Systems Neuroscience, Tübingen, Germany.,IKERBASQUE, Basque Foundation for Science, Bilbao, Spain
| | - Eduardo López-Larraz
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Farid Shiman
- Department of Neurology, Campus Mitte, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Martin Spüler
- Department of Computer Engineering, Wilhelm-Schickard-Institute, University of Tübingen, Tübingen, Germany
| | - Niels Birbaumer
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,Wyss Center, Geneve, Switzerland
| | - Ander Ramos-Murguialday
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,Tecnalia, San Sebastián, Spain
| |
Collapse
|
8
|
López-Larraz E, Sarasola-Sanz A, Irastorza-Landa N, Birbaumer N, Ramos-Murguialday A. Brain-machine interfaces for rehabilitation in stroke: A review. NeuroRehabilitation 2018; 43:77-97. [PMID: 30056435 DOI: 10.3233/nre-172394] [Citation(s) in RCA: 58] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
BACKGROUND Motor paralysis after stroke has devastating consequences for the patients, families and caregivers. Although therapies have improved in the recent years, traditional rehabilitation still fails in patients with severe paralysis. Brain-machine interfaces (BMI) have emerged as a promising tool to guide motor rehabilitation interventions as they can be applied to patients with no residual movement. OBJECTIVE This paper reviews the efficiency of BMI technologies to facilitate neuroplasticity and motor recovery after stroke. METHODS We provide an overview of the existing rehabilitation therapies for stroke, the rationale behind the use of BMIs for motor rehabilitation, the current state of the art and the results achieved so far with BMI-based interventions, as well as the future perspectives of neural-machine interfaces. RESULTS Since the first pilot study by Buch and colleagues in 2008, several controlled clinical studies have been conducted, demonstrating the efficacy of BMIs to facilitate functional recovery in completely paralyzed stroke patients with noninvasive technologies such as the electroencephalogram (EEG). CONCLUSIONS Despite encouraging results, motor rehabilitation based on BMIs is still in a preliminary stage, and further improvements are required to boost its efficacy. Invasive and hybrid approaches are promising and might set the stage for the next generation of stroke rehabilitation therapies.
Collapse
Affiliation(s)
- E López-Larraz
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - A Sarasola-Sanz
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,International Max Planck Research School (IMPRS) for Cognitive and Systems Neuroscience, University of Tübingen, Tübingen, Germany.,Neurotechnology, Tecnalia Research & Innovation, San Sebastián, Spain
| | - N Irastorza-Landa
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,International Max Planck Research School (IMPRS) for Cognitive and Systems Neuroscience, University of Tübingen, Tübingen, Germany.,IKERBASQUE, Basque Foundation for Science, Bilbao, Spain
| | - N Birbaumer
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,Wyss Center for Bio and Neuro Engineering, Geneva, Switzerland
| | - A Ramos-Murguialday
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,Neurotechnology, Tecnalia Research & Innovation, San Sebastián, Spain
| |
Collapse
|