1
|
Park J, Berman J, Dodson A, Liu Y, Armstrong M, Huang H, Kaber D, Ruiz J, Zahabi M. Assessing workload in using electromyography (EMG)-based prostheses. ERGONOMICS 2024; 67:257-273. [PMID: 37264794 DOI: 10.1080/00140139.2023.2221413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Accepted: 05/31/2023] [Indexed: 06/03/2023]
Abstract
Using prosthetic devices requires a substantial cognitive workload. This study investigated classification models for assessing cognitive workload in electromyography (EMG)-based prosthetic devices with various types of input features including eye-tracking measures, task performance, and cognitive performance model (CPM) outcomes. Features selection algorithm, hyperparameter tuning with grid search, and k-fold cross-validation were applied to select the most important features and find the optimal models. Classification accuracy, the area under the receiver operation characteristic curve (AUC), precision, recall, and F1 scores were calculated to compare the models' performance. The findings suggested that task performance measures, pupillometry data, and CPM outcomes, combined with the naïve bayes (NB) and random forest (RF) algorithms, are most promising for classifying cognitive workload. The proposed algorithms can help manufacturers/clinicians predict the cognitive workload of future EMG-based prosthetic devices in early design phases.Practitioner summary: This study investigated the use of machine learning algorithms for classifying the cognitive workload of prosthetic devices. The findings suggested that the models could predict workload with high accuracy and low computational cost and could be used in assessing the usability of prosthetic devices in the early phases of the design process.Abbreviations: 3d: 3 dimensional; ADL: Activities for daily living; ANN: Artificial neural network; AUC: Area under the receiver operation characteristic curve; CC: Continuous control; CPM: Cognitive performance model; CPM-GOMS: Cognitive-Perceptual-Motor GOMS; CRT: Clothespin relocation test; CV: Cross validation; CW: Cognitive workload; DC: Direct control; DOF: Degrees of freedom; ECRL: Extensor carpi radialis longus; ED: Extensor digitorum; EEG: Electroencephalogram; EMG: Electromyography; FCR: Flexor carpi radialis; FD: Flexor digitorum; GOMS: Goals, Operations, Methods, and Selection Rules; LDA: Linear discriminant analysis; MAV: Mean absolute value; MCP: Metacarpophalangeal; ML: Machine learning; NASA-TLX: NASA task load index; NB: Naïve Bayes; PCPS: Percent change in pupil size; PPT: Purdue Pegboard Test; PR: Pattern recognition; PROS-TLX: Prosthesis task load index; RF: Random forest; RFE: Recursive feature selection; SHAP: Southampton hand assessment protocol; SFS: Sequential feature selection; SVC: Support vector classifier.
Collapse
Affiliation(s)
- Junho Park
- Wm Michael Barnes '64 Department of Industrial & Systems Engineering, Texas A&M University, College Station, TX, USA
| | - Joseph Berman
- Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA
| | - Albert Dodson
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC, USA
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, NC, USA
| | - Yunmei Liu
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL, USA
| | - Matthew Armstrong
- Intercollegiate School of Engineering Medicine, Texas A&M University, Houston, TX, USA
| | - He Huang
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC, USA
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, NC, USA
| | - David Kaber
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL, USA
| | - Jaime Ruiz
- Department of Computer & Information Science & Engineering, University of Florida, Gainesville, FL, USA
| | - Maryam Zahabi
- Wm Michael Barnes '64 Department of Industrial & Systems Engineering, Texas A&M University, College Station, TX, USA
| |
Collapse
|
2
|
Maas B, Van Der Sluis CK, Bongers RM. Assessing the effectiveness of serious game training designed to assist in upper limb prothesis rehabilitation. FRONTIERS IN REHABILITATION SCIENCES 2024; 5:1353077. [PMID: 38348457 PMCID: PMC10859406 DOI: 10.3389/fresc.2024.1353077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Accepted: 01/16/2024] [Indexed: 02/15/2024]
Abstract
Introduction Controlling a myoelectric upper limb prosthesis is difficult, therefore training is required. Since training with serious games showed promising results, the current paper focuses on game design and its effectivity for transfer between in-game skill to actual prosthesis use for proportional control of hand opening and control of switching between grips. We also examined training duration and individual differences. Method Thirty-six participants were randomly assigned to one of three groups: a task-specific serious game training group, a non-task-specific serious game training group and a control group. Each group performed a pre-test, mid-test and a post-test with five training sessions between each test moment. Test sessions assessed proportional control using the Cylinder test, a test designed to measure scaling of hand aperture during grabbing actions, and the combined use of proportional and switch control using the Clothespin Relocation Test, part of the Southampton Hand Assessment Procedure and Tray Test. Switch control was assessed during training by measuring amplitude difference and phasing of co-contraction triggers. Results Differences between groups over test sessions were observed for proportional control tasks, however there was lack of structure in these findings. Maximum aperture changed with test moment and some participants adjusted maximum aperture for smaller objects. For proportional and switch control tasks no differences between groups were observed. The effect of test moment suggests a testing effect. For learning switch control, an overall improvement across groups was found in phasing of the co-contraction peaks. Importantly, individual differences were found in all analyses. Conclusion As improvements over test sessions were found, but no relevant differences between groups were revealed, we conclude that transfer effects from game training to actual prosthesis use did not take place. Task specificity nor training duration had effects on outcomes. Our results imply testing effects instead of transfer effects, in which individual differences played a significant role. How transfer from serious game training in upper limb prosthesis use can be enhanced, needs further attention.
Collapse
Affiliation(s)
- Bart Maas
- Department of Human Movement Sciences, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| | - Corry K. Van Der Sluis
- Department of Rehabilitation Medicine, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| | - Raoul M. Bongers
- Department of Human Movement Sciences, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| |
Collapse
|
3
|
Gavette H, McDonald CL, Kostick-Quenet K, Mullen A, Najafi B, Finco MG. Advances in prosthetic technology: a perspective on ethical considerations for development and clinical translation. FRONTIERS IN REHABILITATION SCIENCES 2024; 4:1335966. [PMID: 38293290 PMCID: PMC10824968 DOI: 10.3389/fresc.2023.1335966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Accepted: 12/29/2023] [Indexed: 02/01/2024]
Abstract
Technological advancements of prostheses in recent years, such as haptic feedback, active power, and machine learning for prosthetic control, have opened new doors for improved functioning, satisfaction, and overall quality of life. However, little attention has been paid to ethical considerations surrounding the development and translation of prosthetic technologies into clinical practice. This article, based on current literature, presents perspectives surrounding ethical considerations from the authors' multidisciplinary views as prosthetists (HG, AM, CLM, MGF), as well as combined research experience working directly with people using prostheses (AM, CLM, MGF), wearable technologies for rehabilitation (MGF, BN), machine learning and artificial intelligence (BN, KKQ), and ethics of advanced technologies (KKQ). The target audience for this article includes developers, manufacturers, and researchers of prosthetic devices and related technology. We present several ethical considerations for current advances in prosthetic technology, as well as topics for future research, that may inform product and policy decisions and positively influence the lives of those who can benefit from advances in prosthetic technology.
Collapse
Affiliation(s)
- Hayden Gavette
- Orthotics and Prosthetics Program, School of Health Professions, Baylor College of Medicine, Houston, TX, United States
| | - Cody L. McDonald
- Department of Rehabilitation Medicine, University of Washington, Seattle, WA, United States
| | - Kristin Kostick-Quenet
- Center for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United States
| | - Ashley Mullen
- Orthotics and Prosthetics Program, School of Health Professions, Baylor College of Medicine, Houston, TX, United States
| | - Bijan Najafi
- Interdisciplinary Consortium on Advanced Motion Performance Lab (iCAMP), Department of Surgery, Baylor College of Medicine, Houston, TX, United States
| | - M. G. Finco
- Orthotics and Prosthetics Program, School of Health Professions, Baylor College of Medicine, Houston, TX, United States
- Interdisciplinary Consortium on Advanced Motion Performance Lab (iCAMP), Department of Surgery, Baylor College of Medicine, Houston, TX, United States
| |
Collapse
|
4
|
Resnik LJ, Borgia M, Clark MA, Ni P. Out-of-pocket costs and affordability of upper limb prostheses. Prosthet Orthot Int 2024; 48:108-114. [PMID: 36897203 DOI: 10.1097/pxr.0000000000000223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 01/18/2023] [Indexed: 03/11/2023]
Abstract
BACKGROUND Given the funding policies in the Department of Veterans Affairs, the affordability of prostheses may be less of a concern among Veterans as compared to civilians. OBJECTIVES Compare rates of out-of-pocket prosthesis-related payments for Veterans and non-Veterans with upper limb amputation (ULA), develop and validate a measure of prosthesis affordability, and evaluate the impact of affordability on prosthesis nonuse. STUDY DESIGN Telephone survey of 727 persons with ULA; 76% Veterans and 24% non-Veterans. METHODS Odds of paying out-of-pocket costs for Veterans compared with non-Veterans were computed using logistic regression. Cognitive and pilot testing resulted in a new scale, evaluated using confirmatory factor and Rasch analysis. Proportions of respondents who cited affordability as a reason for never using or abandoning a prosthesis were calculated. RESULTS Twenty percent of those who ever used a prosthesis paid out-of-pocket costs. Veterans had 0.20 odds (95% confidence interval, 0.14-0.30) of paying out-of-pocket costs compared with non-Veterans. Confirmatory factor analysis supported unidimensionality of the 4-item Prosthesis Affordability scale. Rasch person reliability was 0.78. Cronbach alpha was 0.87. Overall, 14% of prosthesis never-users said affordability was a reason for nonuse; 9.6% and 16.5% of former prosthesis users said affordability of repairs or replacement, respectively, was a reason for abandonment. CONCLUSIONS Out-of-pocket prosthesis costs were paid by 20% of those sample, with Veterans less likely to incur costs. The Prosthesis Affordability scale developed in this study was reliable and valid for persons with ULA. Prosthesis affordability was a common reason for never using or abandoning prostheses.
Collapse
Affiliation(s)
- Linda J Resnik
- Research Department, Providence VA Medical Center, Providence, RI
- Department of Health Services, Policy and Practice, School of Public Health, Brown University, Providence, RI
| | - Matthew Borgia
- Research Department, Providence VA Medical Center, Providence, RI
| | - Melissa A Clark
- Department of Health Services, Policy and Practice, School of Public Health, Brown University, Providence, RI
- University of Massachusetts Medical School, Worcester, MA
| | - Pengsheng Ni
- Boston University School of Public Health, Boston, MA
| |
Collapse
|
5
|
Zhang J, Chou CH, Hao M, Li Y, Yu Y, Lan N. Fusion of dual modalities of non-invasive sensory feedback for object profiling with prosthetic hands. Front Neurorobot 2023; 17:1298176. [PMID: 38162892 PMCID: PMC10757719 DOI: 10.3389/fnbot.2023.1298176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Accepted: 11/24/2023] [Indexed: 01/03/2024] Open
Abstract
Introduction Either non-invasive somatotopic or substitute sensory feedback is capable of conveying a single modality of sensory information from prosthetic hands to amputees. However, the neurocognitive ability of amputees to integrate multi-modality sensory information for functional discrimination is unclear. The purpose of this study was to assess the fusion of non-invasive somatotopic tactile and substitute aperture feedbacks for profile perception of multiple physical features during grasping objects. Methods Two left transradial amputees with somatotopic evoked tactile sensation (ETS) of five fingers participated in the study. The tactile information of prosthetic hand was provided to amputees by the ETS feedback elicited on the stump projected finger map. Hand aperture information was conveyed to amputees with substitute electrotactile stimulation on the forearm or upper arm. Two types of sensory feedback were integrated to a commercial prosthetic hand. The efficacy of somatotopic ETS feedback on object length identification task was assessed with or without substitute aperture stimulation. The object size identification task was utilized to assess how ETS stimulation at the stump may affect aperture perception with stimulation on the ipsilateral upper arm or forearm. Finally, the task of identifying combined length and size was conducted to evaluate the ability of amputees to integrate the dual modalities of sensory feedback for perceiving profile features. Results The study revealed that amputee subjects can effectively integrate the ETS feedback with electrotactile substitutive feedback for object profile discrimination. Specifically, ETS was robust to provide object length information with electrotactile stimulation at either the forearm or upper arm. However, electrotactile stimulation at the upper arm for aperture perception was less susceptible to the interference of ETS stimulation than at the forearm. Discussion Amputee subjects are able to combine somatotopic ETS and aperture feedbacks for identifying multi-dimensional features in object profiling. The two sensory streams of information can be fused effectively without mutual interference for functional discrimination.
Collapse
Affiliation(s)
- Jie Zhang
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chih-Hong Chou
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Manzhao Hao
- Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yan Li
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yashuo Yu
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Ning Lan
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
6
|
Abstract
Development and implementation of neuroprosthetic hands is a multidisciplinary field at the interface between humans and artificial robotic systems, which aims at replacing the sensorimotor function of the upper-limb amputees as their own. Although prosthetic hand devices with myoelectric control can be dated back to more than 70 years ago, their applications with anthropomorphic robotic mechanisms and sensory feedback functions are still at a relatively preliminary and laboratory stage. Nevertheless, a recent series of proof-of-concept studies suggest that soft robotics technology may be promising and useful in alleviating the design complexity of the dexterous mechanism and integration difficulty of multifunctional artificial skins, in particular, in the context of personalized applications. Here, we review the evolution of neuroprosthetic hands with the emerging and cutting-edge soft robotics, covering the soft and anthropomorphic prosthetic hand design and relating bidirectional neural interactions with myoelectric control and sensory feedback. We further discuss future opportunities on revolutionized mechanisms, high-performance soft sensors, and compliant neural-interaction interfaces for the next generation of neuroprosthetic hands.
Collapse
Affiliation(s)
- Guoying Gu
- Robotics Institute, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- Meta Robotics Institute, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Ningbin Zhang
- Robotics Institute, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Chen Chen
- Robotics Institute, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Haipeng Xu
- Robotics Institute, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xiangyang Zhu
- Robotics Institute, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- Meta Robotics Institute, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
7
|
Vijayan A, Bhatia V, Arora S, Gupta S. Completely digitally fabricated custom functional finger prosthesis. J Indian Prosthodont Soc 2023; 23:198-202. [PMID: 37102547 PMCID: PMC10262102 DOI: 10.4103/jips.jips_372_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Revised: 03/31/2022] [Accepted: 03/31/2022] [Indexed: 04/28/2023] Open
Abstract
The loss of a finger in any capacity as a result of trauma has a significant influence on the patient's everyday life, as well as their psychological and physical health. Multiple conventional techniques have been reported in the literature, mostly offering psychological and cosmetic benefits to such individuals. However, there is a paucity of literature for functional finger prosthesis. This case report describes rehabilitation of an amputated index finger using an innovative digital workflow, thereby making it impression-free, cast-free, accurate, less time-consuming, and above all functionally viable. Digital technology was used for designing, and fabrication of this prosthesis was done using three-dimensional (3-D) printing. When compared to traditional prostheses, this 3-D-printed prosthesis was functional, allowing the patient to conduct everyday activities and providing the patient's confidence a psychological boost.
Collapse
Affiliation(s)
- Anuraj Vijayan
- Department of Prosthodontics, I.T.S. Dental College, Hospital and Research Centre, Greater Noida, Uttar Pradesh, India
| | | | - Saksham Arora
- Department of Prosthodontics, I.T.S. Dental College, Hospital and Research Centre, Greater Noida, Uttar Pradesh, India
| | - Shubham Gupta
- Department of Prosthodontics, I.T.S. Dental College, Hospital and Research Centre, Greater Noida, Uttar Pradesh, India
| |
Collapse
|
8
|
Lakkireddy M, Taduri G, Kandakatla M, Cherukuri N, Iyengar R, Patnala C, Karra ML. State-sponsored institute-based provision of advanced artificial limbs for rehabilitation of amputees. JOURNAL OF ORTHOPAEDICS, TRAUMA AND REHABILITATION 2022. [DOI: 10.1177/22104917221123340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Introduction: Amputation is a painful functional experience and optimal rehabilitation of an amputee is a team effort. Functional restitution depends on many factors including the type of prosthesis available. We report our experience of providing advanced artificial limbs at free of cost to the underprivileged through a state-sponsored pilot initiative. Material and methods: This is a retrospective cohort study of amputees who have been rehabilitated with advanced artificial limbs through the Department of Orthopaedics at Nizam's Institute of Medical Sciences, Punjagutta, Hyderabad, India from the years 2017 to 2021. Prostheses were procured through rate contract and monitory support was provided by the state. Evaluation, fitment and functional restitution were supervised by the orthopaedic surgeons to the utmost satisfaction of the amputees. Results: A total of 136 subjects received 142 advanced artificial limbs. Out of 136 subjects, 130 received unilateral and 6 subjects received bilateral prosthesis. Ninety-two percent (n = 125) were men and 8% (n = 11) were women. Eighty-eight (n = 125) were lower limb prosthesis and 12% (n = 17) were upper limb prosthesis. All the amputees fitted with advanced artificial limbs were highly satisfied at the end of the procedure and were confident of independent living. Conclusion: Appropriate rehabilitative measures are required for amputees to lead an independent life. Paucity of institutional support and monitory challenges preclude them from advanced prosthesis. State-sponsored, institute-based supply of advanced artificial limbs at free of cost to the beneficiaries is a replicable and feasible option for optimal rehabilitation of amputees with appropriate prosthesis.
Collapse
Affiliation(s)
- Maheshwar Lakkireddy
- Department of Orthopaedics, All India Institute of Medical Sciences, Bibinagar, Hyderabad, Telangana, India
| | - Gangadhar Taduri
- Department of Nephrology, Nizam’s Institute of Medical Sciences, Punjagutta, Hyderabad, Telangana, India
- Department of Health Medical & Family Welfare, Government of Telangana, Hyderabad, Telangana, India
| | - Manohar Kandakatla
- Department of General Medicine, Nizam’s Institute of Medical Sciences, Punjagutta, Hyderabad, Telangana, India
| | - Nagesh Cherukuri
- Department of Orthopaedics, Nizam’s Institute of Medical Sciences, Punjagutta, Hyderabad, Telangana, India
| | - Raju Iyengar
- Department of Orthopaedics, Nizam’s Institute of Medical Sciences, Punjagutta, Hyderabad, Telangana, India
| | - Chandrashekar Patnala
- Department of Orthopaedics, Nizam’s Institute of Medical Sciences, Punjagutta, Hyderabad, Telangana, India
| | - Madhu Latha Karra
- Department of Biochemistry, All India Institute of Medical Sciences, Bibinagar, Hyderabad, Telangana, India
| |
Collapse
|
9
|
Jabban L, Metcalfe BW, Raines J, Zhang D, Ainsworth B. Experience of adults with upper-limb difference and their views on sensory feedback for prostheses: a mixed methods study. J Neuroeng Rehabil 2022; 19:80. [PMID: 35870940 PMCID: PMC9308922 DOI: 10.1186/s12984-022-01054-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2022] [Accepted: 07/06/2022] [Indexed: 11/26/2022] Open
Abstract
Background Upper-limb prostheses are regularly abandoned, in part due to the mismatch between user needs and prostheses performance. Sensory feedback is among several technological advances that have been proposed to reduce device abandonment rates. While it has already been introduced in some high-end commercial prostheses, limited data is available about user expectations in relation to sensory feedback. The aim of this study is thus to use a mixed methods approach to provide a detailed insight of users’ perceptions and expectations of sensory feedback technology, to ensure the addition of sensory feedback is as acceptable, engaging and ultimately as useful as possible for users and, in turn, reduce the reliance on compensatory movements that lead to overuse syndrome. Methods The study involved an online survey (N = 37) and video call interviews (N = 15) where adults with upper-limb differences were asked about their experience with limb difference and prosthesis use (if applicable) and their expectations about sensory feedback to prostheses. The survey data were analysed quantitatively and descriptively to establish the range of sensory feedback needs and their variations across the different demographics. Reflexive thematic analysis was performed on the interview data, and data triangulation was used to understand key behavioural issues to generate actionable guiding principles for the development of sensory feedback systems. Results The survey provided a list of practical examples and suggestions that did not vary with the different causes of limb difference or prosthesis use. The interviews showed that although sensory feedback is a desired feature, it must prove to have more benefits than drawbacks. The key benefit mentioned by participants was increasing trust, which requires a highly reliable system that provides input from several areas of the hand rather than just the fingertips. The feedback system should also complement existing implicit feedback sources without causing confusion or discomfort. Further, the effect sensory feedback has on the users’ psychological wellbeing was highlighted as an important consideration that varies between individuals and should therefore be discussed. The results obtained were used to develop guiding principles for the design and implementation of sensory feedback systems. Conclusions This study provides a mixed-methods research on the sensory feedback needs of adults with upper-limb differences, enabling a deeper understanding of their expectations and worries. Guiding principles were developed based on the results of a survey and interviews to inform the development and assessment of sensory feedback for upper-limb prostheses. Supplementary Information The online version contains supplementary material available at 10.1186/s12984-022-01054-y.
Collapse
|
10
|
Kuroda Y, Yamanoi Y, Togo S, Jiang Y, Yokoi H. Coevolution of Myoelectric Hand Control under the Tactile Interaction among Fingers and Objects. CYBORG AND BIONIC SYSTEMS 2022; 2022:9861875. [DOI: 10.34133/2022/9861875] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 07/11/2022] [Indexed: 11/18/2022] Open
Abstract
The usability of a prosthetic hand differs significantly from that of a real hand. Moreover, the complexity of manipulation increases as the number of degrees of freedom to be controlled increases, making manipulation with biological signals extremely difficult. To overcome this problem, users need to select a grasping posture that is adaptive to the object and a stable grasping method that prevents the object from falling. In previous studies, these have been left to the operating skills of the user, which is extremely difficult to achieve. In this study, we demonstrate how stable and adaptive grasping can be achieved according to the object regardless of the user’s operation technique. The required grasping technique is achieved by determining the correlation between the motor output and each sensor through the interaction between the prosthetic hand and the surrounding stimuli, such as myoelectricity, sense of touch, and grasping objects. The agents of the 16-DOF robot hand were trained with the myoelectric signals of six participants, including one child with a congenital forearm deficiency. Consequently, each agent could open and close the hand in response to the myoelectric stimuli and could accomplish the object pickup task. For the tasks, the agents successfully identified grasping patterns suitable for practical and stable positioning of the objects. In addition, the agents were able to pick up the object in a similar posture regardless of the participant, suggesting that the hand was optimized by evolutionary computation to a posture that prevents the object from being dropped.
Collapse
Affiliation(s)
- Yuki Kuroda
- Joint Doctoral Program for Sustainability Research, Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
| | - Yusuke Yamanoi
- Department of Mechanical and Intelligent System Engineering, Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
- Center for Neuroscience and Biomedical Engineering, The University of Electro-Communications, Tokyo, Japan
| | - Shunta Togo
- Department of Mechanical and Intelligent System Engineering, Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
- Center for Neuroscience and Biomedical Engineering, The University of Electro-Communications, Tokyo, Japan
| | - Yinlai Jiang
- Center for Neuroscience and Biomedical Engineering, The University of Electro-Communications, Tokyo, Japan
- Beijing Innovation Center for Intelligent Robots and Systems, Beijing, China
| | - Hiroshi Yokoi
- Joint Doctoral Program for Sustainability Research, Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
- Department of Mechanical and Intelligent System Engineering, Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
- Center for Neuroscience and Biomedical Engineering, The University of Electro-Communications, Tokyo, Japan
- Beijing Innovation Center for Intelligent Robots and Systems, Beijing, China
| |
Collapse
|
11
|
Zbinden J, Lendaro E, Ortiz-Catalan M. A multi-dimensional framework for prosthetic embodiment: a perspective for translational research. J Neuroeng Rehabil 2022; 19:122. [PMID: 36369004 PMCID: PMC9652836 DOI: 10.1186/s12984-022-01102-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2022] [Accepted: 10/25/2022] [Indexed: 11/13/2022] Open
Abstract
The concept of embodiment has gained widespread popularity within prosthetics research. Embodiment has been claimed to be an indicator of the efficacy of sensory feedback and control strategies. Moreover, it has even been claimed to be necessary for prosthesis acceptance, albeit unfoundedly. Despite the popularity of the term, an actual consensus on how prosthetic embodiment should be used in an experimental framework has yet to be reached. The lack of consensus is in part due to terminological ambiguity and the lack of an exact definition of prosthetic embodiment itself. In a review published parallel to this article, we summarized the definitions of embodiment used in prosthetics literature and concluded that treating prosthetic embodiment as a combination of ownership and agency allows for embodiment to be quantified, and thus useful in translational research. Here, we review the potential mechanisms that give rise to ownership and agency considering temporal, spatial, and anatomical constraints. We then use this to propose a multi-dimensional framework where prosthetic embodiment arises within a spectrum dependent on the integration of volition and multi-sensory information as demanded by the degree of interaction with the environment. This framework allows for the different experimental paradigms on sensory feedback and prosthetic control to be placed in a common perspective. By considering that embodiment lays along a spectrum tied to the interactions with the environment, one can conclude that the embodiment of prosthetic devices should be assessed while operating in environments as close to daily life as possible for it to become relevant.
Collapse
|
12
|
Schlichenmeyer TC, Zellmer ER, Burton H, Ray WZ, Moran DW. Detection and discrimination of electrical stimuli from an upper limb cuff electrode in M. Mulatta. J Neural Eng 2022; 19. [PMID: 36317300 DOI: 10.1088/1741-2552/ac9e76] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 10/28/2022] [Indexed: 11/07/2022]
Abstract
Objective.Peripheral nerve interfaces seek to restore nervous system function through electrical stimulation of peripheral nerves. In clinical use, these devices should function reliably for years or decades. In this study, we assessed evoked sensations from multi-channel cuff electrode stimulation in macaque monkeys up to 711 d post-implantation.Approach.Three trained macaque monkeys received multi-channel cuff electrode implants at the median or ulnar nerves in the upper arm. Electrical stimuli from the cuff interfaces evoked sensations, which we measured via standard psychophysical tasks. We adjusted pulse amplitude or pulse width for each block with various electrode channel configurations to examine the effects of stimulus parameterization on sensation. We measured detection thresholds and just-noticeable differences (JNDs) at irregular, near-daily intervals for several months using Bayesian inferencing from trial data. We examined data trends using classical models such as Weber's Law and the strength-duration relationship using linear regression.Main results.Detection thresholds were similar between blocks with pulse width modulation and blocks with pulse amplitude modulation when represented as charge per pulse, the product of the amplitude and the pulse width. Conversely, Weber fractions-calculated as the slope of the regression between JND charge values and reference stimulus charge-were significantly different between pulse width and pulse amplitude modulation blocks for the discrimination task.Significance.Weber fractions were lower in blocks with amplitude modulation than in blocks with pulse width modulation, suggesting that pulse amplitude modulation allows finer resolution of sensory encoding above threshold. Consequently, amplitude modulation may enable a greater dynamic range for sensory perception with neuroprosthetic devices.
Collapse
Affiliation(s)
- T C Schlichenmeyer
- Washington University in St Louis, 1 Brookings Dr, St Louis, MO 63118, United States of America
| | - E R Zellmer
- Washington University in St Louis, 1 Brookings Dr, St Louis, MO 63118, United States of America
| | - H Burton
- Washington University in St Louis, 1 Brookings Dr, St Louis, MO 63118, United States of America
| | - W Z Ray
- Washington University in St Louis, 1 Brookings Dr, St Louis, MO 63118, United States of America
| | - D W Moran
- Washington University in St Louis, 1 Brookings Dr, St Louis, MO 63118, United States of America
| |
Collapse
|
13
|
Vaskov AK, Vu PP, North N, Davis AJ, Kung TA, Gates DH, Cederna PS, Chestek CA. Surgically Implanted Electrodes Enable Real-Time Finger and Grasp Pattern Recognition for Prosthetic Hands. IEEE T ROBOT 2022; 38:2841-2857. [PMID: 37193351 PMCID: PMC10168021 DOI: 10.1109/tro.2022.3170720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Currently available prosthetic hands are capable of actuating anywhere from five to 30 degrees of freedom (DOF). However, grasp control of these devices remains unintuitive and cumbersome. To address this issue, we propose directly extracting finger commands from the neuromuscular system. Two persons with transradial amputations had bipolar electrodes implanted into regenerative peripheral nerve interfaces (RPNIs) and residual innervated muscles. The implanted electrodes recorded local electromyography with large signal amplitudes. In a series of single-day experiments, participants used a high speed movement classifier to control a virtual prosthetic hand in real-time. Both participants transitioned between 10 pseudo-randomly cued individual finger and wrist postures with an average success rate of 94.7% and trial latency of 255 ms. When the set was reduced to five grasp postures, metrics improved to 100% success and 135 ms trial latency. Performance remained stable across untrained static arm positions while supporting the weight of the prosthesis. Participants also used the high speed classifier to switch between robotic prosthetic grips and complete a functional performance assessment. These results demonstrate that pattern recognition systems can use intramuscular electrodes and RPNIs for fast and accurate prosthetic grasp control.
Collapse
Affiliation(s)
- Alex K Vaskov
- Robotics Institute, University of Michigan, Ann Arbor, MI 48109 USA
| | - Philip P Vu
- Section of Plastic Surgery, University of Michigan, Ann Arbor, MI 48109 USA
| | - Naia North
- Mechanical Engineering department at University of Michigan, Ann Arbor, MI 48109 USA
| | - Alicia J Davis
- Department of Physical Medicine and Rehabilitation at the University of Michigan, Ann Arbor, MI 48109 USA
| | - Theodore A Kung
- Section of Plastic Surgery, University of Michigan, Ann Arbor, MI 48109 USA
| | - Deanna H Gates
- School of Kinesiology, University of Michigan, Ann Arbor, MI 48109 USA
| | - Paul S Cederna
- Section of Plastic Surgery, University of Michigan, Ann Arbor, MI 48109 USA
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109 USA
| |
Collapse
|
14
|
Optimization of Thumb Prosthesis Design by Using Five Performance Criteria. Appl Bionics Biomech 2022; 2022:9647956. [PMID: 36106138 PMCID: PMC9467796 DOI: 10.1155/2022/9647956] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 07/17/2022] [Accepted: 08/03/2022] [Indexed: 11/18/2022] Open
Abstract
The thumb prosthesis mechanism is optimally designed by using five performance criteria including the following: least square structural error, mechanical manufacturing imprecision error, driving optimal torque, mechanical strength reliability, and production cost of the thumb mechanism. This paper was devoted to the optimization of the thumb prosthesis's mechanism by taking into consideration the manufacturing cost model based on machining cost theory which took into detail the shape of the workpieces and the strength reliability of all the parts composing the entire mechanism. Every optimization problem displays a particular set of an independent vector of optimal parameters, showing the impact of each objective function on the configuration of the prosthetic device. The multiobjective optimization showed that the mechanical reliability and the production cost included in any combination of the simultaneous optimization enabled the achievement of the same optimum variables design, though with some exceptions. With the inclusion of the labor charges, the depreciation rate of the equipment, and production assets in the mathematical's manufacturing cost model, the optimal manufacturing cost generated from the numerical simulation was 501.0021 USD. Therefore, the global manufacturing cost and the mechanical strength reliability of the whole prosthesis mechanism have a real impact on the customization of the structure, due to the stochastic nature of the trajectory of the cutting tools during the manufacturing processes.
Collapse
|
15
|
Reimagining Prosthetic Control: A Novel Body-Powered Prosthetic System for Simultaneous Control and Actuation. PROSTHESIS 2022. [DOI: 10.3390/prosthesis4030032] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Globally, the most popular upper-limb prostheses are powered by the human body. For body-powered (BP) upper-limb prostheses, control is provided by changing the tension of (Bowden) cables to open or close the terminal device. This technology has been around for centuries, and very few BP alternatives have been presented since. This paper introduces a new BP paradigm that can overcome certain limitations of the current cabled systems, such as a restricted operation space and user discomfort caused by the harness to which the cables are attached. A new breathing-powered system is introduced to give the user full control of the hand motion anywhere in space. Users can regulate their breathing, and this controllable airflow is then used to power a small Tesla turbine that can accurately control the prosthetic finger movements. The breathing-powered device provides a novel prosthetic option that can be used without limiting any of the user’s body movements. Here we prove that it is feasible to produce a functional breathing-powered prosthetic hand and show the models behind it along with a preliminary demonstration. This work creates a step-change in the potential BP options available to patients in the future.
Collapse
|
16
|
Wu H, Dyson M, Nazarpour K. Internet of Things for beyond-the-laboratory prosthetics research. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2022; 380:20210005. [PMID: 35762812 PMCID: PMC9335889 DOI: 10.1098/rsta.2021.0005] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 12/03/2021] [Indexed: 06/15/2023]
Abstract
Research on upper-limb prostheses is typically laboratory-based. Evidence indicates that research has not yet led to prostheses that meet user needs. Inefficient communication loops between users, clinicians and manufacturers limit the amount of quantitative and qualitative data that researchers can use in refining their innovations. This paper offers a first demonstration of an alternative paradigm by which remote, beyond-the-laboratory prosthesis research according to user needs is feasible. Specifically, the proposed Internet of Things setting allows remote data collection, real-time visualization and prosthesis reprogramming through Wi-Fi and a commercial cloud portal. Via a dashboard, the user can adjust the configuration of the device and append contextual information to the prosthetic data. We evaluated this demonstrator in real-time experiments with three able-bodied participants. Results promise the potential of contextual data collection and system update through the internet, which may provide real-life data for algorithm training and reduce the complexity of send-home trials. This article is part of the theme issue 'Advanced neurotechnologies: translating innovation for health and well-being'.
Collapse
Affiliation(s)
- Hancong Wu
- Edinburgh Neuroprosthetics Laboratory, School of Informatics, The University of Edinburgh, Edinburgh EH8 9AB, UK
| | - Matthew Dyson
- Intelligent Sensing Laboratory, School of Engineering, Newcastle University, Newcastle upon Tyne NE1 7RU, UK
| | - Kianoush Nazarpour
- Edinburgh Neuroprosthetics Laboratory, School of Informatics, The University of Edinburgh, Edinburgh EH8 9AB, UK
| |
Collapse
|
17
|
Hansen TC, Citterman AR, Stone ES, Tully TN, Baschuk CM, Duncan CC, George JA. A Multi-User Transradial Functional-Test Socket for Validation of New Myoelectric Prosthetic Control Strategies. Front Neurorobot 2022; 16:872791. [PMID: 35783364 PMCID: PMC9247306 DOI: 10.3389/fnbot.2022.872791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Accepted: 05/16/2022] [Indexed: 01/09/2023] Open
Abstract
The validation of myoelectric prosthetic control strategies for individuals experiencing upper-limb loss is hindered by the time and cost affiliated with traditional custom-fabricated sockets. Consequently, researchers often rely upon virtual reality or robotic arms to validate novel control strategies, which limits end-user involvement. Prosthetists fabricate diagnostic check sockets to assess and refine socket fit, but these clinical techniques are not readily available to researchers and are not intended to assess functionality for control strategies. Here we present a multi-user, low-cost, transradial, functional-test socket for short-term research use that can be custom-fit and donned rapidly, used in conjunction with various electromyography configurations, and adapted for use with various residual limbs and terminal devices. In this study, participants with upper-limb amputation completed functional tasks in physical and virtual environments both with and without the socket, and they reported on their perceived comfort level over time. The functional-test socket was fabricated prior to participants' arrival, iteratively fitted by the researchers within 10 mins, and donned in under 1 min (excluding electrode placement, which will vary for different use cases). It accommodated multiple individuals and terminal devices and had a total cost of materials under $10 USD. Across all participants, the socket did not significantly impede functional task performance or reduce the electromyography signal-to-noise ratio. The socket was rated as comfortable enough for at least 2 h of use, though it was expectedly perceived as less comfortable than a clinically-prescribed daily-use socket. The development of this multi-user, transradial, functional-test socket constitutes an important step toward increased end-user participation in advanced myoelectric prosthetic research. The socket design has been open-sourced and is available for other researchers.
Collapse
Affiliation(s)
- Taylor C. Hansen
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States,*Correspondence: Taylor C. Hansen
| | - Abigail R. Citterman
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States,Handspring, Salt Lake City, UT, United States
| | - Eric S. Stone
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
| | - Troy N. Tully
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
| | | | - Christopher C. Duncan
- Department of Physical Medicine and Rehabilitation, University of Utah, Salt Lake City, UT, United States
| | - Jacob A. George
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States,Department of Physical Medicine and Rehabilitation, University of Utah, Salt Lake City, UT, United States,Departments of Electrical and Computer Engineering and Mechanical Engineering, University of Utah, Salt Lake City, UT, United States,Jacob A. George
| |
Collapse
|
18
|
Parr JVV, Wright DJ, Uiga L, Marshall B, Mohamed MO, Wood G. A scoping review of the application of motor learning principles to optimize myoelectric prosthetic hand control. Prosthet Orthot Int 2022; 46:274-281. [PMID: 34932512 DOI: 10.1097/pxr.0000000000000083] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Accepted: 11/01/2021] [Indexed: 02/03/2023]
Abstract
Although prosthetic hand rejection rates remain high, evidence suggests that effective training plays a major role in device acceptance. Receiving training early in the rehabilitation process also enhances functional prosthetic use, decreases the likelihood of developing an overreliance on the intact limb, and reduces amputation-related pain. Despite these obvious benefits, there is a current lack of evidence regarding the most effective training techniques to facilitate myoelectric prosthetic hand control, and it remains unknown whether training is effective in facilitating the acquisition and transfer of prosthetic skill. In this scoping review, we introduced and summarized key motor learning principles related to attentional focus, implicit motor learning, training eye-hand coordination, practice variability, motor imagery, and action observation, and virtual training and biofeedback. We then reviewed the existing literature that has applied these principles for training prosthetic hand control before outlining future avenues for further research. The importance of optimizing early and appropriate training cannot be overlooked. While the intuition and experience of clinicians holds enormous value, evidence-based guidelines based on well-established motor learning principles will also be crucial for training effective prosthetic hand control. While it is clear that more research is needed to form the basis of such guidelines, it is hoped that this review highlights the potential avenues for this work.
Collapse
Affiliation(s)
- Johnny V V Parr
- Department of Sport and Exercise Sciences, Manchester Metropolitan University Institute of Sport, Manchester UK
- Research Centre for Musculoskeletal Science and Sports Medicine, Department of Sport and Exercise Sciences, Faculty of Science and Engineering, Manchester Metropolitan University, Manchester, UK
| | - David J Wright
- Department of Sport and Exercise Sciences, Manchester Metropolitan University Institute of Sport, Manchester UK
- Research Centre for Health, Psychology and Communities, Department of Psychology, Faculty of Health, Psychology and Social Care, Manchester Metropolitan University, Manchester, UK
| | - Liis Uiga
- Department of Sport and Exercise Sciences, Manchester Metropolitan University Institute of Sport, Manchester UK
- Research Centre for Musculoskeletal Science and Sports Medicine, Department of Sport and Exercise Sciences, Faculty of Science and Engineering, Manchester Metropolitan University, Manchester, UK
| | - Ben Marshall
- Department of Sport and Exercise Sciences, Manchester Metropolitan University Institute of Sport, Manchester UK
- Research Centre for Musculoskeletal Science and Sports Medicine, Department of Sport and Exercise Sciences, Faculty of Science and Engineering, Manchester Metropolitan University, Manchester, UK
| | - Mohamed Omar Mohamed
- Department of Sport and Exercise Sciences, Manchester Metropolitan University Institute of Sport, Manchester UK
- Research Centre for Musculoskeletal Science and Sports Medicine, Department of Sport and Exercise Sciences, Faculty of Science and Engineering, Manchester Metropolitan University, Manchester, UK
| | - Greg Wood
- Department of Sport and Exercise Sciences, Manchester Metropolitan University Institute of Sport, Manchester UK
- Research Centre for Musculoskeletal Science and Sports Medicine, Department of Sport and Exercise Sciences, Faculty of Science and Engineering, Manchester Metropolitan University, Manchester, UK
| |
Collapse
|
19
|
Li T, Su Y, Chen F, Zheng H, Meng W, Liu Z, Ai Q, Liu Q, Tan Y, Zhou Z. Bioinspired Stretchable Fiber-Based Sensor toward Intelligent Human-Machine Interactions. ACS APPLIED MATERIALS & INTERFACES 2022; 14:22666-22677. [PMID: 35533008 DOI: 10.1021/acsami.2c05823] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Wearable integrated sensing devices with flexible electronic elements exhibit enormous potential in human-machine interfaces (HMI), but they have limitations such as complex structures, poor waterproofness, and electromagnetic interference. Herein, inspired by the profile of Lindernia nummularifolia (LN), a bionic stretchable optical strain (BSOS) sensor composed of an LN-shaped optical fiber incorporated with a stretchable substrate is developed for intelligent HMI. Such a sensor enables large strain and bending angle measurements with temperature self-compensation by the intensity difference of two fiber Bragg gratings' (FBGs') center wavelength. Such configurations enable an excellent tensile strain range of up to 80%, moreover, leading to ultrasensitivity, durability (≥20,000 cycles), and waterproofness. The sensor is also capable of measuring different human activities and achieving HMI control, including immersive virtual reality, robot remote interactive control, and personal hands-free communication. Combined with the machine learning technique, gesture classification can be achieved using muscle activity signals captured from the BSOS sensor, which can be employed to obtain the motion intention of the prosthetic. These merits effectively indicate its potential as a solution for medical care HMI and show promise in smart medical and rehabilitation medicine.
Collapse
Affiliation(s)
- Tianliang Li
- School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Yifei Su
- School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Fayin Chen
- School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Han Zheng
- School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Wei Meng
- School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Zemin Liu
- School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Qingsong Ai
- School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Quan Liu
- School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Yuegang Tan
- School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China
| | - Zude Zhou
- School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China
| |
Collapse
|
20
|
Jabban L, Dupan S, Zhang D, Ainsworth B, Nazarpour K, Metcalfe BW. Sensory Feedback for Upper-Limb Prostheses: Opportunities and Barriers. IEEE Trans Neural Syst Rehabil Eng 2022; 30:738-747. [PMID: 35290188 DOI: 10.1109/tnsre.2022.3159186] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The addition of sensory feedback to upper-limb prostheses has been shown to improve control, increase embodiment, and reduce phantom limb pain. However, most commercial prostheses do not incorporate sensory feedback due to several factors. This paper focuses on the major challenges of a lack of deep understanding of user needs, the unavailability of tailored, realistic outcome measures and the segregation between research on control and sensory feedback. The use of methods such as the Person-Based Approach and co-creation can improve the design and testing process. Stronger collaboration between researchers can integrate different prostheses research areas to accelerate the translation process.
Collapse
|
21
|
Zhou H, Tawk C, Alici G. A 3D Printed Soft Robotic Hand with Embedded Soft Sensors for Direct Transition between Hand Gestures and Improved Grasping Quality and Diversity. IEEE Trans Neural Syst Rehabil Eng 2022; 30:550-558. [PMID: 35235516 DOI: 10.1109/tnsre.2022.3156116] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
In this study, a three-dimensional (3D) printed soft robotic hand with embedded soft sensors, intended for prosthetic applications is designed and developed to efficiently operate with new-generation myoelectric control systems, e.g., pattern recognition control and simultaneous proportional control. The mechanical structure of the whole hand ('ACES-V2') is fabricated as a monolithic structure using a low-cost and open-source 3D printer. It minimizes the post-processing required for the addition of the embedded sensors in the hand. These are significant benefits for the robotic hand that features low cost, low weight (313 grams), and anthropomorphic appearance. With the soft position sensors added to the fingers, the fingers' positions can be monitored to avoid self-collision of the hand. Besides, it allows a robotic prosthetic hand to eliminate the conventional way of returning to the neutral full open position when switching from one type of gesture to another. This makes the transition between the hand gestures much faster, more efficient, and more intuitive as well. Further, initial contact detection of each finger is achieved for the preshaping of multi-finger grasps, e.g., tripod grip and power grasps, to improve the stability and quality of the grasps. Combinations of different gestures allow the hand to perform multi-stage grasps to seize and carry multiple objects simultaneously. It can potentially augment the hand's dexterity and grasping diversity. Providing direct transition between the hand gestures and improved grasping quality and diversity are the primary contributions of this study.
Collapse
|
22
|
Rekant J, Fisher LE, Boninger M, Gaunt RA, Collinger JL. Amputee, clinician, and regulator perspectives on current and prospective upper extremity prosthetic technologies. Assist Technol 2022:1-13. [PMID: 34982647 DOI: 10.1080/10400435.2021.2020935] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022] Open
Abstract
Existing prosthetic technologies for people with upper limb amputation are being adopted at moderate rates. Once fitted for these devices, many upper limb amputees report not using them regularly or at all. The primary aim of this study was to solicit feedback about prosthetic technology and important device design criteria from amputees, clinicians, and device regulators. We compare these perspectives to identify common or divergent priorities. Twenty-one adults with upper limb loss, 35 clinicians, and 3 regulators completed a survey on existing prosthetic technologies and a conceptual sensorimotor prosthesis driven by implanted myoelectric electrodes with sensory feedback via spinal root stimulation. The survey included questions from the Trinity Amputation and Prosthesis Experience Scale, the Disabilities of the Arm, Shoulder, and Hand, and novel questions about technology acceptance and neuroprosthetic design. User and clinician ratings of satisfaction with existing devices were similar. Amputees were most accepting of the proposed sensorimotor prosthesis (75.5% vs clinicians(68.8%), regulators(67.8%)). Stakeholders valued user-centered outcomes like individualized task goals, improved quality of life, device reliability, and user safety; regulators emphasized these last two. The results of this study provide insight into amputee, clinician, and regulator priorities to inform future upper-limb prosthetic design and clinical trial protocol development.
Collapse
Affiliation(s)
- Julie Rekant
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Lee E Fisher
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA.,Center for Neural Basis of Cognition, Pittsburgh, PA, USA
| | - Michael Boninger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA.,Human Engineering Research Labs, VA Center of Excellence, Department of Veteran Affairs, Pittsburgh, PA, USA
| | - Robert A Gaunt
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA.,Center for Neural Basis of Cognition, Pittsburgh, PA, USA
| | - Jennifer L Collinger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA.,Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA.,Center for Neural Basis of Cognition, Pittsburgh, PA, USA.,Human Engineering Research Labs, VA Center of Excellence, Department of Veteran Affairs, Pittsburgh, PA, USA
| |
Collapse
|
23
|
Shafti A, Haar S, Mio R, Guilleminot P, Faisal AA. Playing the piano with a robotic third thumb: assessing constraints of human augmentation. Sci Rep 2021; 11:21375. [PMID: 34725355 PMCID: PMC8560761 DOI: 10.1038/s41598-021-00376-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Accepted: 10/05/2021] [Indexed: 11/16/2022] Open
Abstract
Contemporary robotics gives us mechatronic capabilities for augmenting human bodies with extra limbs. However, how our motor control capabilities pose limits on such augmentation is an open question. We developed a Supernumerary Robotic 3rd Thumbs (SR3T) with two degrees-of-freedom controlled by the user’s body to endow them with an extra contralateral thumb on the hand. We demonstrate that a pianist can learn to play the piano with 11 fingers within an hour. We then evaluate 6 naïve and 6 experienced piano players in their prior motor coordination and their capability in piano playing with the robotic augmentation. We show that individuals’ augmented performance with the SR3T could be explained by our new custom motor coordination assessment, the Human Augmentation Motor Coordination Assessment (HAMCA) performed pre-augmentation. Our work demonstrates how supernumerary robotics can augment humans in skilled tasks and that individual differences in their augmentation capability are explainable by their individual motor coordination abilities.
Collapse
Affiliation(s)
- Ali Shafti
- Brain and Behaviour Laboratory, Department of Bioengineering, Imperial College London, London, SW7 2AZ, UK.,Department of Computing, Imperial College London, London, SW7 2AZ, UK.,Behaviour Analytics Laboratory, Data Science Institute, London, SW7 2AZ, UK
| | - Shlomi Haar
- Brain and Behaviour Laboratory, Department of Bioengineering, Imperial College London, London, SW7 2AZ, UK.,Behaviour Analytics Laboratory, Data Science Institute, London, SW7 2AZ, UK.,Department of Brain Sciences and UK Dementia Research Institute - Care Research and Technology Centre, Imperial College London, London, W12 0BZ, UK
| | - Renato Mio
- Brain and Behaviour Laboratory, Department of Bioengineering, Imperial College London, London, SW7 2AZ, UK
| | - Pierre Guilleminot
- Brain and Behaviour Laboratory, Department of Bioengineering, Imperial College London, London, SW7 2AZ, UK
| | - A Aldo Faisal
- Brain and Behaviour Laboratory, Department of Bioengineering, Imperial College London, London, SW7 2AZ, UK. .,Department of Computing, Imperial College London, London, SW7 2AZ, UK. .,Behaviour Analytics Laboratory, Data Science Institute, London, SW7 2AZ, UK. .,UKRI CDT in AI for Healthcare, Imperial College London, London, SW7 2AZ, UK. .,MRC London Institute of Medical Sciences, London, W12 0NN, UK.
| |
Collapse
|
24
|
Gholinezhad S, Dosen S, Jakob D. Electrotactile feedback outweighs natural feedback in sensory integration during control of grasp force. J Neural Eng 2021; 18. [PMID: 34416740 DOI: 10.1088/1741-2552/ac1fce] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Accepted: 08/20/2021] [Indexed: 11/12/2022]
Abstract
Objective.The nervous system subconsciously estimates the state of the body as a weighted average of the information from various sensory sources, where the weights reflect the perceived reliability of each source. Loss of motor functions can be partially compensated using assistive systems (e.g. prostheses), which may also restore somatosensory feedback through tactile stimulation. Whether such artificial feedback is integrated in the neural state estimation process is not known.Approach.In this study, able-bodied subjects performed a grasp force matching task with supplementary non-invasive electrotactile stimulation with a frequency proportional to grasp force magnitude. Before the task, a brief training session taught the subjects to associate the sensation of electrotactile stimulation with the generated grasp force. In some trials, the force-frequency mapping was biased to introduce an unnoticeable mismatch between natural and electrotactile force feedback, thereby provoking the subject to subconsciously estimate the force as a compromise between the two sources of information.Main results.The outcome of this compromise revealed the weights assigned to each feedback type. The grasp forces were significantly affected by the biased mappings, as indicated by the average estimated relative weights (electrotactile: 0.69 ± 0.29; natural: 0.31 ± 0.29). Across subjects, this weight was correlatedr2=0.75) with the improvement in force matching precision when adding the unbiased electrotactile feedback to the natural force feedback, as predicted by maximum likelihood estimation. This shows that even after minimal training the nervous system adopts electrotactile stimulation as a highly reliable source of information that can improve the precision in the estimation of the grip force.Significance.This result has important implications for the restoration of sensory feedback in upper limb prostheses as it indicates that even non-invasive stimulation can be integrated naturally (i.e. subconsciously and effectively) in the motor controlloop.
Collapse
Affiliation(s)
- Shima Gholinezhad
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Strahinja Dosen
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Dideriksen Jakob
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| |
Collapse
|
25
|
Abstract
Brain-machine interfaces (BMI) are being developed to restore upper limb function for persons with spinal cord injury or other motor degenerative conditions. BMI and implantable sensors for myoelectric prostheses directly extract information from the central or peripheral nervous system to provide users with high fidelity control of their prosthetic device. Control algorithms have been highly transferable between the 2 technologies but also face common issues. In this review of the current state of the art in each field, the authors point out similarities and differences between the 2 technologies that may guide the implementation of common solutions to these challenges.
Collapse
Affiliation(s)
- Alex K Vaskov
- Robotics Institute, University of Michigan, 2505 Hayward St, Ann Arbor, MI 48109, USA
| | - Cynthia A Chestek
- Robotics Institute, University of Michigan, 2505 Hayward St, Ann Arbor, MI 48109, USA; Department of Biomedical Engineering, University of Michigan, 2200 Bonisteel Blvd, Ann Arbor, MI 48109, USA; Department of Electrical Engineering and Computer Science, University of Michigan, 1301 Beal Ave, Ann Arbor, MI 48109, USA; Neuroscience Graduate Program, University of Michigan, 204 Washtenaw Ave, Ann Arbor, MI 48109, USA.
| |
Collapse
|
26
|
Gates DH, Engdahl SM, Davis A. Recommendations for the Successful Implementation of Upper Limb Prosthetic Technology. Hand Clin 2021; 37:457-466. [PMID: 34253318 DOI: 10.1016/j.hcl.2021.05.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
Despite the numerous prosthetic hand designs that are commercially available, people with upper limb loss still frequently report dissatisfaction and abandonment. Over the past decade there have been numerous advances in prosthetic design, control, sensation, and device attachment. Each offers the potential to enhance function and satisfaction, but most come at high costs and involve surgical risks. Here, we discuss potential barriers and solutions to promote the widespread use of novel prosthetic technology. With appropriate reimbursement, multidisciplinary care teams, device-specific rehabilitation, and patient and clinician education, such technology has the potential to revolutionize the field and improve patient outcomes.
Collapse
Affiliation(s)
- Deanna H Gates
- School of Kinesiology, University of Michigan, 830 N. University Avenue, Ann Arbor, MI 48109, USA.
| | - Susannah M Engdahl
- Department of Bioengineering, George Mason University, 4400 University Drive, MS 1J7, Fairfax, VA 22030, USA
| | - Alicia Davis
- University of Michigan Orthotics and Prosthetics Center, 2850 South Industrial Highway, Suite 400, Ann Arbor, MI 48104, USA
| |
Collapse
|
27
|
Karczewski AM, Dingle AM, Poore SO. The Need to Work Arm in Arm: Calling for Collaboration in Delivering Neuroprosthetic Limb Replacements. Front Neurorobot 2021; 15:711028. [PMID: 34366820 PMCID: PMC8334559 DOI: 10.3389/fnbot.2021.711028] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 06/22/2021] [Indexed: 11/21/2022] Open
Abstract
Over the last few decades there has been a push to enhance the use of advanced prosthetics within the fields of biomedical engineering, neuroscience, and surgery. Through the development of peripheral neural interfaces and invasive electrodes, an individual's own nervous system can be used to control a prosthesis. With novel improvements in neural recording and signal decoding, this intimate communication has paved the way for bidirectional and intuitive control of prostheses. While various collaborations between engineers and surgeons have led to considerable success with motor control and pain management, it has been significantly more challenging to restore sensation. Many of the existing peripheral neural interfaces have demonstrated success in one of these modalities; however, none are currently able to fully restore limb function. Though this is in part due to the complexity of the human somatosensory system and stability of bioelectronics, the fragmentary and as-yet uncoordinated nature of the neuroprosthetic industry further complicates this advancement. In this review, we provide a comprehensive overview of the current field of neuroprosthetics and explore potential strategies to address its unique challenges. These include exploration of electrodes, surgical techniques, control methods, and prosthetic technology. Additionally, we propose a new approach to optimizing prosthetic limb function and facilitating clinical application by capitalizing on available resources. It is incumbent upon academia and industry to encourage collaboration and utilization of different peripheral neural interfaces in combination with each other to create versatile limbs that not only improve function but quality of life. Despite the rapidly evolving technology, if the field continues to work in divided "silos," we will delay achieving the critical, valuable outcome: creating a prosthetic limb that is right for the patient and positively affects their life.
Collapse
Affiliation(s)
| | - Aaron M. Dingle
- Division of Plastic Surgery, Department of Surgery, University of Wisconsin–Madison, Madison, WI, United States
| | | |
Collapse
|
28
|
Jones H, Dupan S, Dyson M, Krasoulis A, Kenney LPJ, Donovan-Hall M, Memarzadeh K, Day S, Coutinho M, Nazarpour K. Co-creation and User Perspectives for Upper Limb Prosthetics. Front Neurorobot 2021; 15:689717. [PMID: 34305564 PMCID: PMC8299561 DOI: 10.3389/fnbot.2021.689717] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 06/09/2021] [Indexed: 11/13/2022] Open
Abstract
People who either use an upper limb prosthesis and/or have used services provided by a prosthetic rehabilitation centre, experience limitations of currently available prosthetic devices. Collaboration between academia and a broad range of stakeholders, can lead to the development of solutions that address peoples' needs. By doing so, the rate of prosthetic device abandonment can decrease. Co-creation is an approach that can enable collaboration of this nature to occur throughout the research process. We present findings of a co-creation project that gained user perspectives from a user survey, and a subsequent workshop involving: people who use an upper limb prosthesis and/or have experienced care services (users), academics, industry experts, charity executives, and clinicians. The survey invited users to prioritise six themes, which academia, clinicians, and industry should focus on over the next decade. The prioritisation of the themes concluded in the following order, with the first as the most important: function, psychology, aesthetics, clinical service, collaboration, and media. Within five multi-stakeholder groups, the workshop participants discussed challenges and collaborative opportunities for each theme. Workshop groups prioritised the themes based on their discussions, to highlight opportunities for further development. Two groups chose function, one group chose clinical service, one group chose collaboration, and another group chose media. The identified opportunities are presented within the context of the prioritised themes, including the importance of transparent information flow between all stakeholders; user involvement throughout research studies; and routes to informing healthcare policy through collaboration. As the field of upper limb prosthetics moves toward in-home research, we present co-creation as an approach that can facilitate user involvement throughout the duration of such studies.
Collapse
Affiliation(s)
- Hannah Jones
- Edinburgh Neuroprosthetics Laboratory, School of Informatics, University of Edinburgh, Edinburgh, United Kingdom.,Intelligent Sensing Laboratory, School of Engineering, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Sigrid Dupan
- Edinburgh Neuroprosthetics Laboratory, School of Informatics, University of Edinburgh, Edinburgh, United Kingdom
| | - Matthew Dyson
- Intelligent Sensing Laboratory, School of Engineering, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Agamemnon Krasoulis
- Intelligent Sensing Laboratory, School of Engineering, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Laurence P J Kenney
- School of Health and Society, University of Salford, Manchester, United Kingdom
| | | | | | - Sarah Day
- Department of Biomedical Engineering, University of Strathclyde, Glasgow, United Kingdom
| | - Maxford Coutinho
- Department of Plastic Surgery, Royal Victoria Infirmary, Newcastle upon Tyne, United Kingdom
| | - Kianoush Nazarpour
- Edinburgh Neuroprosthetics Laboratory, School of Informatics, University of Edinburgh, Edinburgh, United Kingdom
| |
Collapse
|
29
|
Machado J, Machado A, Balbinot A. Deep learning for surface electromyography artifact contamination type detection. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102752] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
30
|
Garenfeld MA, Jorgovanovic N, Ilic V, Strbac M, Isakovic M, Dideriksen JL, Dosen S. A compact system for simultaneous stimulation and recording for closed-loop myoelectric control. J Neuroeng Rehabil 2021; 18:87. [PMID: 34034762 PMCID: PMC8146235 DOI: 10.1186/s12984-021-00877-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 05/10/2021] [Indexed: 11/12/2022] Open
Abstract
Background Despite important advancements in control and mechatronics of myoelectric prostheses, the communication between the user and his/her bionic limb is still unidirectional, as these systems do not provide somatosensory feedback. Electrotactile stimulation is an attractive technology to close the control loop since it allows flexible modulation of multiple parameters and compact interface design via multi-pad electrodes. However, the stimulation interferes with the recording of myoelectric signals and this can be detrimental to control. Methods We present a novel compact solution for simultaneous recording and stimulation through dynamic blanking of stimulation artefacts. To test the system, a feedback coding scheme communicating wrist rotation and hand aperture was developed specifically to stress the myoelectric control while still providing meaningful information to the subjects. Ten subjects participated in an experiment, where the quality of closed-loop myoelectric control was assessed by controlling a cursor in a two degrees of freedom target-reaching task. The benchmark performance with visual feedback was compared to that achieved by combining visual feedback and electrotactile stimulation as well as by using electrotactile feedback only. Results There was no significant difference in performance between visual and combined feedback condition with regards to successfully reached targets, time to reach a target, path efficiency and the number of overshoots. Therefore, the quality of myoelectric control was preserved in spite of the stimulation. As expected, the tactile condition was significantly poorer in completion rate (100/4% and 78/25% for combined and tactile condition, respectively) and time to reach a target (9/2 s and 13/4 s for combined and tactile condition, respectively). However, the performance in the tactile condition was still good, with no significant difference in path efficiency (38/8%) and the number of overshoots (0.5/0.4 overshoots), indicating that the stimulation was meaningful for the subjects and useful for closed-loop control. Conclusions Overall, the results demonstrated that the developed system can provide robust closed-loop control using electrotactile stimulation. The system supports different encoding schemes and allows placing the recording and stimulation electrodes next to each other. This is an important step towards an integrated solution where the developed unit will be embedded into a prosthetic socket.
Collapse
Affiliation(s)
- Martin A Garenfeld
- Department of Health Science and Technology, Aalborg University, Frederik Bajers Vej 7D, 9220, Aalborg Ø, Denmark.
| | - Nikola Jorgovanovic
- Department of Computing and Control Engineering, Faculty of Technical Sciences, University of Novi Sad, Trg Dositeja Obradovica 6, 21000, Novi Sad, Serbia
| | - Vojin Ilic
- Department of Computing and Control Engineering, Faculty of Technical Sciences, University of Novi Sad, Trg Dositeja Obradovica 6, 21000, Novi Sad, Serbia
| | - Matija Strbac
- Tecnalia Serbia Ltd., Deligradska 9/39, 11000, Belgrade, Serbia
| | - Milica Isakovic
- Tecnalia Serbia Ltd., Deligradska 9/39, 11000, Belgrade, Serbia
| | - Jakob L Dideriksen
- Department of Health Science and Technology, Aalborg University, Frederik Bajers Vej 7D, 9220, Aalborg Ø, Denmark
| | - Strahinja Dosen
- Department of Health Science and Technology, Aalborg University, Frederik Bajers Vej 7D, 9220, Aalborg Ø, Denmark.
| |
Collapse
|
31
|
Abstract
People who either use an upper limb prosthesis and/or have used services provided by a prosthetic rehabilitation centre, hereafter called users, are yet to benefit from the fast-paced growth in academic knowledge within the field of upper limb prosthetics. Crucially over the past decade, research has acknowledged the limitations of conducting laboratory-based studies for clinical translation. This has led to an increase, albeit rather small, in trials that gather real-world user data. Multi-stakeholder collaboration is critical within such trials, especially between researchers, users, and clinicians, as well as policy makers, charity representatives, and industry specialists. This paper presents a co-creation model that enables researchers to collaborate with multiple stakeholders, including users, throughout the duration of a study. This approach can lead to a transition in defining the roles of stakeholders, such as users, from participants to co-researchers. This presents a scenario whereby the boundaries between research and participation become blurred and ethical considerations may become complex. However, the time and resources that are required to conduct co-creation within academia can lead to greater impact and benefit the people that the research aims to serve.
Collapse
|
32
|
Activities of daily living with bionic arm improved by combination training and latching filter in prosthesis control comparison. J Neuroeng Rehabil 2021; 18:45. [PMID: 33632237 PMCID: PMC7908731 DOI: 10.1186/s12984-021-00839-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Accepted: 02/14/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Advanced prostheses can restore function and improve quality of life for individuals with amputations. Unfortunately, most commercial control strategies do not fully utilize the rich control information from residual nerves and musculature. Continuous decoders can provide more intuitive prosthesis control using multi-channel neural or electromyographic recordings. Three components influence continuous decoder performance: the data used to train the algorithm, the algorithm, and smoothing filters on the algorithm's output. Individual groups often focus on a single decoder, so very few studies compare different decoders using otherwise similar experimental conditions. METHODS We completed a two-phase, head-to-head comparison of 12 continuous decoders using activities of daily living. In phase one, we compared two training types and a smoothing filter with three algorithms (modified Kalman filter, multi-layer perceptron, and convolutional neural network) in a clothespin relocation task. We compared training types that included only individual digit and wrist movements vs. combination movements (e.g., simultaneous grasp and wrist flexion). We also compared raw vs. nonlinearly smoothed algorithm outputs. In phase two, we compared the three algorithms in fragile egg, zipping, pouring, and folding tasks using the combination training and smoothing found beneficial in phase one. In both phases, we collected objective, performance-based (e.g., success rate), and subjective, user-focused (e.g., preference) measures. RESULTS Phase one showed that combination training improved prosthesis control accuracy and speed, and that the nonlinear smoothing improved accuracy but generally reduced speed. Phase one importantly showed simultaneous movements were used in the task, and that the modified Kalman filter and multi-layer perceptron predicted more simultaneous movements than the convolutional neural network. In phase two, user-focused metrics favored the convolutional neural network and modified Kalman filter, whereas performance-based metrics were generally similar among all algorithms. CONCLUSIONS These results confirm that state-of-the-art algorithms, whether linear or nonlinear in nature, functionally benefit from training on more complex data and from output smoothing. These studies will be used to select a decoder for a long-term take-home trial with implanted neuromyoelectric devices. Overall, clinical considerations may favor the mKF as it is similar in performance, faster to train, and computationally less expensive than neural networks.
Collapse
|
33
|
Yuan J, Cline E, Liu M, Huang H, Feng J. Cognitive measures during walking with and without lower-limb prosthesis: protocol for a scoping review. BMJ Open 2021; 11:e039975. [PMID: 33602700 PMCID: PMC7896605 DOI: 10.1136/bmjopen-2020-039975] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
INTRODUCTION Tuning of lower-limb (LL) robotic prosthesis control is necessary to provide personalised assistance to each human wearer during walking. Prostheses wearers' adaptation processes are subjective and the efficiency largely depends on one's mental processes. Therefore, beyond physical motor performance, prosthesis personalisation should consider the wearer's preference and cognitive performance during walking. As a first step, it is necessary to examine the current measures of cognitive performance when a wearer walks with an LL prosthesis, identify the gaps and methodological considerations, and explore additional measures in a walking setting. In this protocol, we outlined a scoping review that will systematically summarise and evaluate the measures of cognitive performance during walking with and without LL prosthesis. METHODS AND ANALYSIS The review process will be guided and documented by CADIMA, an open-access online data management portal for evidence synthesis. Keyword searches will be conducted in seven databases (Web of Science, MEDLINE, BIOSIS, SciELO Citation Index, ProQuest, CINAHL and PsycINFO) up to 2020 supplemented with grey literature searches. Retrieved records will be screened by at least two independent reviewers on the title-and-abstract level and then the full-text level. Selected studies will be evaluated for reporting bias. Data on sample characteristics, type of cognitive function, characteristics of cognitive measures, task prioritisation, experimental design and walking setting will be extracted. ETHICS AND DISSEMINATION This scoping review will evaluate the measures used in previously published studies thus does not require ethical approval. The results will contribute to the advancement of prosthesis tuning processes by reviewing the application status of cognitive measures during walking with and without prosthesis and laying the foundation for developing needed measures for cognitive assessment during walking. The results will be disseminated through conferences and journals.
Collapse
Affiliation(s)
- Jing Yuan
- Department of Psychology, North Carolina State University, Raleigh, North Carolina, USA
| | - Emily Cline
- Department of Psychology, North Carolina State University, Raleigh, North Carolina, USA
| | - Ming Liu
- UNC & NC State Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, North Carolina, USA
| | - He Huang
- UNC & NC State Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, North Carolina, USA
| | - Jing Feng
- Department of Psychology, North Carolina State University, Raleigh, North Carolina, USA
| |
Collapse
|
34
|
Chadwell A, Kenney L, Thies S, Head J, Galpin A, Baker R. Addressing unpredictability may be the key to improving performance with current clinically prescribed myoelectric prostheses. Sci Rep 2021; 11:3300. [PMID: 33558547 PMCID: PMC7870859 DOI: 10.1038/s41598-021-82764-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Accepted: 12/17/2020] [Indexed: 11/29/2022] Open
Abstract
The efferent control chain for an upper-limb myoelectric prosthesis can be separated into 3 key areas: signal generation, signal acquisition, and device response. Data were collected from twenty trans-radial myoelectric prosthesis users using their own clinically prescribed devices, to establish the relative impact of these potential control factors on user performance (user functionality and everyday prosthesis usage). By identifying the key factor(s), we can guide future developments to ensure clinical impact. Skill in generating muscle signals was assessed via reaction times and signal tracking. To assess the predictability of signal acquisition, we inspected reaction time spread and undesired hand activations. As a measure of device response, we recorded the electromechanical delay between electrode stimulation and the onset of hand movement. Results suggest abstract measures of skill in controlling muscle signals are poorly correlated with performance. Undesired activations of the hand or incorrect responses were correlated with almost all kinematics and gaze measures suggesting unpredictability is a key factor. Significant correlations were also found between several measures of performance and the electromechanical delay; however, unexpectedly, longer electromechanical delays correlated with better performance. Future research should focus on exploring causes of unpredictability, their relative impacts on performance and interventions to address this.
Collapse
Affiliation(s)
- A Chadwell
- Centre for Health Sciences Research, University of Salford, Salford, UK.
| | - L Kenney
- Centre for Health Sciences Research, University of Salford, Salford, UK
| | - S Thies
- Centre for Health Sciences Research, University of Salford, Salford, UK
| | - J Head
- Centre for Health Sciences Research, University of Salford, Salford, UK
| | - A Galpin
- Centre for Health Sciences Research, University of Salford, Salford, UK
| | - R Baker
- Salford Business School, University of Salford, Salford, UK
| |
Collapse
|
35
|
Page DM, George JA, Wendelken SM, Davis TS, Kluger DT, Hutchinson DT, Clark GA. Discriminability of multiple cutaneous and proprioceptive hand percepts evoked by intraneural stimulation with Utah slanted electrode arrays in human amputees. J Neuroeng Rehabil 2021; 18:12. [PMID: 33478534 PMCID: PMC7819250 DOI: 10.1186/s12984-021-00808-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2020] [Accepted: 01/11/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Electrical stimulation of residual afferent nerve fibers can evoke sensations from a missing limb after amputation, and bionic arms endowed with artificial sensory feedback have been shown to confer functional and psychological benefits. Here we explore the extent to which artificial sensations can be discriminated based on location, quality, and intensity. METHODS We implanted Utah Slanted Electrode Arrays (USEAs) in the arm nerves of three transradial amputees and delivered electrical stimulation via different electrodes and frequencies to produce sensations on the missing hand with various locations, qualities, and intensities. Participants performed blind discrimination trials to discriminate among these artificial sensations. RESULTS Participants successfully discriminated cutaneous and proprioceptive sensations ranging in location, quality and intensity. Performance was significantly greater than chance for all discrimination tasks, including discrimination among up to ten different cutaneous location-intensity combinations (15/30 successes, p < 0.0001) and seven different proprioceptive location-intensity combinations (21/40 successes, p < 0.0001). Variations in the site of stimulation within the nerve, via electrode selection, enabled discrimination among up to five locations and qualities (35/35 successes, p < 0.0001). Variations in the stimulation frequency enabled discrimination among four different intensities at the same location (13/20 successes, p < 0.0005). One participant also discriminated among individual stimulation of two different USEA electrodes, simultaneous stimulation on both electrodes, and interleaved stimulation on both electrodes (20/24 successes, p < 0.0001). CONCLUSION Electrode location, stimulation frequency, and stimulation pattern can be modulated to evoke functionally discriminable sensations with a range of locations, qualities, and intensities. This rich source of artificial sensory feedback may enhance functional performance and embodiment of bionic arms endowed with a sense of touch.
Collapse
Affiliation(s)
| | - Jacob A George
- Division of Physical Medicine and Rehabilitation, University of Utah, Salt Lake City, UT, 84112, USA.
| | - Suzanne M Wendelken
- Department of Anesthesiology, Maine Medical Center, Portland, ME, 04102, USA
| | - Tyler S Davis
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, 84112, USA
| | | | | | - Gregory A Clark
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, 84112, USA
| |
Collapse
|
36
|
D'Anna E, Valle G, Mazzoni A, Strauss I, Iberite F, Patton J, Petrini FM, Raspopovic S, Granata G, Di Iorio R, Controzzi M, Cipriani C, Stieglitz T, Rossini PM, Micera S. A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback. Sci Robot 2021; 4:4/27/eaau8892. [PMID: 33137741 DOI: 10.1126/scirobotics.aau8892] [Citation(s) in RCA: 127] [Impact Index Per Article: 42.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2018] [Accepted: 12/18/2018] [Indexed: 01/09/2023]
Abstract
Current myoelectric prostheses allow transradial amputees to regain voluntary motor control of their artificial limb by exploiting residual muscle function in the forearm. However, the overreliance on visual cues resulting from a lack of sensory feedback is a common complaint. Recently, several groups have provided tactile feedback in upper limb amputees using implanted electrodes, surface nerve stimulation, or sensory substitution. These approaches have led to improved function and prosthesis embodiment. Nevertheless, the provided information remains limited to a subset of the rich sensory cues available to healthy individuals. More specifically, proprioception, the sense of limb position and movement, is predominantly absent from current systems. Here, we show that sensory substitution based on intraneural stimulation can deliver position feedback in real time and in conjunction with somatotopic tactile feedback. This approach allowed two transradial amputees to regain high and close-to-natural remapped proprioceptive acuity, with a median joint angle reproduction precision of 9.1° and a median threshold to detection of passive movements of 9.5°, which was comparable with results obtained in healthy participants. The simultaneous delivery of position information and somatotopic tactile feedback allowed both amputees to discriminate the size and compliance of four objects with high levels of performance (75.5%). These results demonstrate that tactile information delivered via somatotopic neural stimulation and position information delivered via sensory substitution can be exploited simultaneously and efficiently by transradial amputees. This study paves a way to more sophisticated bidirectional bionic limbs conveying richer, multimodal sensations.
Collapse
Affiliation(s)
- Edoardo D'Anna
- Bertarelli Foundation Chair in Translational Neuroengineering, Centre for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland.
| | - Giacomo Valle
- Bertarelli Foundation Chair in Translational Neuroengineering, Centre for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland.,The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Alberto Mazzoni
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Ivo Strauss
- Bertarelli Foundation Chair in Translational Neuroengineering, Centre for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland.,The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | | | - Jérémy Patton
- Bertarelli Foundation Chair in Translational Neuroengineering, Centre for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Francesco M Petrini
- Bertarelli Foundation Chair in Translational Neuroengineering, Centre for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Stanisa Raspopovic
- Laboratory for Neuroengineering, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
| | | | - Riccardo Di Iorio
- Institute of Neurology, Catholic University of The Sacred Heart, Policlinic A. Gemelli Foundation, Roma, Italy
| | - Marco Controzzi
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | | | - Thomas Stieglitz
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering-IMTEK, University of Freiburg, Freiburg D-79110, Germany
| | - Paolo M Rossini
- Institute of Neurology, Catholic University of The Sacred Heart, Policlinic A. Gemelli Foundation, Roma, Italy.,Brain Connectivity Laboratory, IRCCS San Raffaele Pisana, Roma, Italy
| | - Silvestro Micera
- Bertarelli Foundation Chair in Translational Neuroengineering, Centre for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland. .,The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| |
Collapse
|
37
|
Hu Y, Ursu DC, Sohasky RA, Sando IC, Ambani SLW, French ZP, Mays EA, Nedic A, Moon JD, Kung TA, Cederna PS, Kemp SWP, Urbanchek MG. Regenerative peripheral nerve interface free muscle graft mass and function. Muscle Nerve 2020; 63:421-429. [PMID: 33290586 DOI: 10.1002/mus.27138] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Revised: 11/26/2020] [Accepted: 12/06/2020] [Indexed: 02/02/2023]
Abstract
BACKGROUND Regenerative peripheral nerve interfaces (RPNIs) transduce neural signals to provide high-fidelity control of neuroprosthetic devices. Traditionally, rat RPNIs are constructed with ~150 mg of free skeletal muscle grafts. It is unknown whether larger free muscle grafts allow RPNIs to transduce greater signal. METHODS RPNIs were constructed by securing skeletal muscle grafts of various masses (150, 300, 600, or 1200 mg) to the divided peroneal nerve. In the control group, the peroneal nerve was transected without repair. Endpoint assessments were conducted 3 mo postoperatively. RESULTS Compound muscle action potentials (CMAPs), maximum tetanic isometric force, and specific muscle force were significantly higher for both the 150 and 300 mg RPNI groups compared to the 600 and 1200 mg RPNIs. Larger RPNI muscle groups contained central areas lacking regenerated muscle fibers. CONCLUSIONS Electrical signaling and tissue viability are optimal in smaller as opposed to larger RPNI constructs in a rat model.
Collapse
Affiliation(s)
- Yaxi Hu
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA.,Department of Plastic Surgery, University of Groningen, Groningen, The Netherlands
| | - Daniel C Ursu
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Racquel A Sohasky
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Ian C Sando
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Shoshana L W Ambani
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Zachary P French
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Elizabeth A Mays
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Andrej Nedic
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Jana D Moon
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Theodore A Kung
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Paul S Cederna
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA.,Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan, USA
| | - Stephen W P Kemp
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA.,Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan, USA
| | - Melanie G Urbanchek
- Department of Surgery, Section of Plastic and Reconstructive Surgery, University of Michigan, Ann Arbor, Michigan, USA
| |
Collapse
|
38
|
Vaskov AK, Vu PP, North N, Davis AJ, Kung TA, Gates DH, Cederna PS, Chestek CA. Surgically Implanted Electrodes Enable Real-Time Finger and Grasp Pattern Recognition for Prosthetic Hands. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2020:2020.10.28.20217273. [PMID: 33173910 PMCID: PMC7654906 DOI: 10.1101/2020.10.28.20217273] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Currently available prosthetic hands are capable of actuating anywhere from five to 30 degrees of freedom (DOF). However, grasp control of these devices remains unintuitive and cumbersome. To address this issue, we propose directly extracting finger commands from the neuromuscular system via electrodes implanted in residual innervated muscles and regenerative peripheral nerve interfaces (RPNIs). Two persons with transradial amputations had RPNIs created by suturing autologous free muscle grafts to their transected median, ulnar, and dorsal radial sensory nerves. Bipolar electrodes were surgically implanted into their ulnar and median RPNIs and into their residual innervated muscles. The implanted electrodes recorded local electromyography (EMG) with Signal-to-Noise Ratios ranging from 23 to 350 measured across various movements. In a series of single-day experiments, participants used a high speed pattern recognition system to control a virtual prosthetic hand in real-time. Both participants were able to transition between 10 pseudo-randomly cued individual finger and wrist postures in the virtual environment with an average online accuracy of 86.5% and latency of 255 ms. When the set was reduced to five grasp postures, average metrics improved to 97.9% online accuracy and 135 ms latency. Virtual task performance remained stable across untrained static arm positions while supporting the weight of the prosthesis. Participants also used the high speed classifier to switch between robotic prosthetic grips and complete a functional performance assessment. These results demonstrate that pattern recognition systems can use the high-quality EMG afforded by intramuscular electrodes and RPNIs to provide users with fast and accurate grasp control. SUMMARY Surgically implanted electrodes recorded finger-specific electromyography enabling reliable finger and grasp control of an upper limb prosthesis.
Collapse
|
39
|
Grushko S, Spurný T, Černý M. Control Methods for Transradial Prostheses Based on Remnant Muscle Activity and Its Relationship with Proprioceptive Feedback. SENSORS (BASEL, SWITZERLAND) 2020; 20:E4883. [PMID: 32872291 PMCID: PMC7506660 DOI: 10.3390/s20174883] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 08/24/2020] [Accepted: 08/25/2020] [Indexed: 02/07/2023]
Abstract
The loss of a hand can significantly affect one's work and social life. For many patients, an artificial limb can improve their mobility and ability to manage everyday activities, as well as provide the means to remain independent. This paper provides an extensive review of available biosensing methods to implement the control system for transradial prostheses based on the measured activity in remnant muscles. Covered techniques include electromyography, magnetomyography, electrical impedance tomography, capacitance sensing, near-infrared spectroscopy, sonomyography, optical myography, force myography, phonomyography, myokinetic control, and modern approaches to cineplasty. The paper also covers combinations of these approaches, which, in many cases, achieve better accuracy while mitigating the weaknesses of individual methods. The work is focused on the practical applicability of the approaches, and analyses present challenges associated with each technique along with their relationship with proprioceptive feedback, which is an important factor for intuitive control over the prosthetic device, especially for high dexterity prosthetic hands.
Collapse
Affiliation(s)
- Stefan Grushko
- Department of Robotics, VSB-Technical University of Ostrava, 70800 Ostrava, Czech Republic; (T.S.); (M.Č.)
| | | | | |
Collapse
|
40
|
Maimon-Mor RO, Makin TR. Is an artificial limb embodied as a hand? Brain decoding in prosthetic limb users. PLoS Biol 2020; 18:e3000729. [PMID: 32511238 PMCID: PMC7302856 DOI: 10.1371/journal.pbio.3000729] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2019] [Revised: 06/18/2020] [Accepted: 05/20/2020] [Indexed: 02/07/2023] Open
Abstract
The potential ability of the human brain to represent an artificial limb as a body part (embodiment) has been inspiring engineers, clinicians, and scientists as a means to optimise human-machine interfaces. Using functional MRI (fMRI), we studied whether neural embodiment actually occurs in prosthesis users' occipitotemporal cortex (OTC). Compared with controls, different prostheses types were visually represented more similarly to each other, relative to hands and tools, indicating the emergence of a dissociated prosthesis categorisation. Greater daily life prosthesis usage correlated positively with greater prosthesis categorisation. Moreover, when comparing prosthesis users' representation of their own prosthesis to controls' representation of a similar looking prosthesis, prosthesis users represented their own prosthesis more dissimilarly to hands, challenging current views of visual prosthesis embodiment. Our results reveal a use-dependent neural correlate for wearable technology adoption, demonstrating adaptive use-related plasticity within the OTC. Because these neural correlates were independent of the prostheses' appearance and control, our findings offer new opportunities for prosthesis design by lifting restrictions imposed by the embodiment theory for artificial limbs.
Collapse
Affiliation(s)
- Roni O. Maimon-Mor
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
- WIN Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, United Kingdom
| | - Tamar R. Makin
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
- WIN Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, United Kingdom
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| |
Collapse
|
41
|
Zolfagharian A, Gregory TM, Bodaghi M, Gharaie S, Fay P. Patient-specific 3D-printed Splint for Mallet Finger Injury. Int J Bioprint 2020; 6:259. [PMID: 32782989 PMCID: PMC7415868 DOI: 10.18063/ijb.v6i2.259] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Accepted: 02/28/2020] [Indexed: 11/23/2022] Open
Abstract
Despite the frequency of mallet finger injuries, treatment options can often be costly, time-consuming, and ill-fitted. Three-dimensional (3D) printing allows for the production of highly customized and inexpensive splints, which suggests potential efficacy in the prescription of casts for musculoskeletal injuries. This study explores how the use of engineering concepts such as 3D printing and topology optimization (TO) can improve outcomes for patients. 3D printing enables the direct fabrication of the patient-specific complex shapes while utilizing finite element analysis and TO in the design of the splint allowed for the most efficient distribution of material to achieve mechanical requirements while reducing the amount of material used. The reduction in used material leads to significant improvements in weight reduction and heat dissipation, which would improve breathability and less sweating for the patient, greatly increasing comfort for the duration of their recovery.
Collapse
Affiliation(s)
- Ali Zolfagharian
- School of Engineering, Deakin University, Geelong 3216, Australia
| | | | - Mahdi Bodaghi
- Department of Engineering, School of Science and Technology, Nottingham Trent University, Nottingham NG11 8NS, UK
| | - Saleh Gharaie
- School of Engineering, Deakin University, Geelong 3216, Australia
| | - Pearse Fay
- School of Health and Social Development, Deakin University, Geelong 3220, Australia
| |
Collapse
|
42
|
Nowak M, Eiband T, Ramírez ER, Castellini C. Action interference in simultaneous and proportional myocontrol: comparing force- and electromyography. J Neural Eng 2020; 17:026011. [PMID: 32109906 DOI: 10.1088/1741-2552/ab7b1e] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Myocontrol, that is, control of a prosthesis via muscle signals, is still a surprisingly hard problem. Recent research indicates that surface electromyography (sEMG), the traditional technique used to detect a subject's intent, could proficiently be replaced, or conjoined with, other techniques (multi-modal myocontrol), with the aim to improve both on dexterity and reliability. Objective. In this paper we present an online assessment of multi-modal sEMG and force myography (FMG) targeted at hand and wrist myocontrol. Approach. Twenty sEMG and FMG sensors in total were used to enforce simultaneous and proportional control of hand opening/closing, wrist pronation/supination and wrist flexion/extension of 12 intact subjects. Main results and Significance. We found that FMG yields in general a better performance than sEMG, and that the main drawback of the sEMG array we used is not the inability to perform a desired action, but rather action interference, that is, the undesired concurrent activation of another action. FMG, on the other hand, causes less interference.
Collapse
Affiliation(s)
- Markus Nowak
- Institute of Robotics and Mechatronics, DLR-German Aerospace Center, Wessling, Germany. Author to whom any correspondence should be addressed
| | | | | | | |
Collapse
|
43
|
Smail LC, Neal C, Wilkins C, Packham TL. Comfort and function remain key factors in upper limb prosthetic abandonment: findings of a scoping review. Disabil Rehabil Assist Technol 2020; 16:821-830. [DOI: 10.1080/17483107.2020.1738567] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Affiliation(s)
- Lauren C. Smail
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON, Canada
| | - Chantelle Neal
- School of Rehabilitation Science, McMaster University, Hamilton, ON, Canada
| | - Courtney Wilkins
- School of Rehabilitation Science, McMaster University, Hamilton, ON, Canada
| | - Tara L. Packham
- School of Rehabilitation Science, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
44
|
Heerschop A, van der Sluis CK, Otten E, Bongers RM. Performance among different types of myocontrolled tasks is not related. Hum Mov Sci 2020; 70:102592. [PMID: 32217210 DOI: 10.1016/j.humov.2020.102592] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2019] [Revised: 12/23/2019] [Accepted: 02/08/2020] [Indexed: 01/08/2023]
Abstract
Studies on myocontrolled assistive technology (AT), such as myoelectric prostheses, as well as rehabilitation practice using myoelectric controlled interfaces, commonly assume the existence of a general myocontrol skill. This is the skill to control myosignals in such a way that they are employable in multiple tasks. If this skill exists, training any myocontrolled task using a certain set of muscles would improve the use of myocontrolled AT when the AT is controlled using these muscles. We examined whether a general myocontrol skill exists in myocontrolled tasks with and without a prosthesis. Unimpaired, right-handed adults used the sEMG of wrist flexors and extensors to perform several tasks in two experiments. In Experiment 1, twelve participants trained a myoelectric prosthesis-simulator task and a myocontrolled serious game for five consecutive days. Performance was compared between tasks and over the course of the training period. In Experiment 2, thirty-one participants performed five myocontrolled tasks consisting of two serious games, two prosthesis-simulator tasks and one digital signal matching task. All tasks were based on tasks currently used in clinical practice or research settings. Kendall rank correlation coefficients were computed to analyze correlations between the performance on different tasks. In Experiment 1 performance on the tasks showed no correlation for multiple outcome measures. Rankings within tasks did not change over the training period. In Experiment 2 performance did not correlate between any of the tasks. Since performance between different tasks did not correlate, results suggest that a general myocontrol skill does not exist and that each myocontrolled task requires a specific skill. Generalization of those findings to amputees using AT should be done with caution since in both experiments unimpaired participants were included. Moreover, training duration in Experiment 2 was short. Our findings indicate that training and assessment methods for myocontrolled AT use should focus on tasks frequently performed in daily life by the individual using the AT instead of merely focusing on training myosignals.
Collapse
Affiliation(s)
- Anniek Heerschop
- University of Groningen, University Medical Center Groningen, Center for Human Movement Sciences, Groningen, the Netherlands.
| | - Corry K van der Sluis
- University of Groningen, University Medical Center Groningen, Department of Rehabilitation Medicine, Groningen, the Netherlands.
| | - Egbert Otten
- University of Groningen, University Medical Center Groningen, Center for Human Movement Sciences, Groningen, the Netherlands.
| | - Raoul M Bongers
- University of Groningen, University Medical Center Groningen, Center for Human Movement Sciences, Groningen, the Netherlands.
| |
Collapse
|
45
|
Wolf EJ, Cruz TH, Emondi AA, Langhals NB, Naufel S, Peng GCY, Schulz BW, Wolfson M. Advanced technologies for intuitive control and sensation of prosthetics. Biomed Eng Lett 2020; 10:119-128. [PMID: 32175133 PMCID: PMC7046895 DOI: 10.1007/s13534-019-00127-7] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2019] [Accepted: 07/31/2019] [Indexed: 02/06/2023] Open
Abstract
The Department of Defense, Department of Veterans Affairs and National Institutes of Health have invested significantly in advancing prosthetic technologies over the past 25 years, with the overall intent to improve the function, participation and quality of life of Service Members, Veterans, and all United States Citizens living with limb loss. These investments have contributed to substantial advancements in the control and sensory perception of prosthetic devices over the past decade. While control of motorized prosthetic devices through the use of electromyography has been widely available since the 1980s, this technology is not intuitive. Additionally, these systems do not provide stimulation for sensory perception. Recent research has made significant advancement not only in the intuitive use of electromyography for control but also in the ability to provide relevant meaningful perceptions through various stimulation approaches. While much of this previous work has traditionally focused on those with upper extremity amputation, new developments include advanced bidirectional neuroprostheses that are applicable to both the upper and lower limb amputation. The goal of this review is to examine the state-of-the-science in the areas of intuitive control and sensation of prosthetic devices and to discuss areas of exploration for the future. Current research and development efforts in external systems, implanted systems, surgical approaches, and regenerative approaches will be explored.
Collapse
Affiliation(s)
- Erik J. Wolf
- Clinical and Rehabilitative Medicine Research Program, US Army Medical Research and Development Command, Fort Detrick, MD 21702 USA
| | - Theresa H. Cruz
- National Institute of Child Health and Human Development, National Institute of Health, Bethesda, MD 20817 USA
| | - Alfred A. Emondi
- Defense Advanced Research Projects Agency, Arlington, VA 22203 USA
| | - Nicholas B. Langhals
- National Institute of Neurological Disorders and Stroke, National Institute of Health, Bethesda, MD 20892 USA
| | | | - Grace C. Y. Peng
- National Institute of Biomedical Imaging and Bioengineering, National Institute of Health, Bethesda, MD 20817 USA
| | - Brian W. Schulz
- VA Office of Research and Development, Washington, DC 20002 USA
| | - Michael Wolfson
- National Institute of Biomedical Imaging and Bioengineering, National Institute of Health, Bethesda, MD 20817 USA
| |
Collapse
|
46
|
Shehata AW, Keri MI, Gomez M, Marasco PD, Vette AH, Hebert JS. Skin Stretch Enhances Illusory Movement in Persons with Lower-Limb Amputation. IEEE Int Conf Rehabil Robot 2020; 2019:1233-1238. [PMID: 31374798 DOI: 10.1109/icorr.2019.8779477] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Performance of lower limb prostheses is related not only to the mechanical design and the control scheme, but also to the feedback provided to the user. Proprioceptive feedback, which is the sense of position and movement of one's body parts, can improve the utility as well as facilitate the embodiment of the prosthetic device. Recent studies have shown that proprioceptive kinesthetic (movement) sense can be elicited when non-invasively vibrating a muscle tendon proximal to the targeted joint. However, consistency and quality of the elicited sensation depend on several parameters and muscle tendons after lower limb amputation may not always be accessible. In this study, we developed an experimental protocol to quantitatively and qualitatively assess the elicited proprioceptive kinesthetic illusion when non-invasively vibrating a muscle belly. Furthermore, we explored ways to improve consistency and strength of the illusion by integrating another non-invasive feedback method, namely cutaneous information manipulation via skin stretch. Our preliminary results from tests conducted with a person with transtibial (below knee) amputation show that stretching skin while vibrating a muscle belly on the residual limb provided a stronger and more consistent kinesthetic illusion (90%) than only vibrating the muscle (50%). In addition, we found that stretching skin enhances the range (1.5 times) and speed (3.5 times) of the illusory movement triggered by muscle vibration. These findings may enable the development of mechanisms for controlling feedback parameters in closing the control loop for various walking routines, which may improve performance of lower limb prostheses.
Collapse
|
47
|
Obstacles to Prosthetic Care—Legal and Ethical Aspects of Access to Upper and Lower Limb Prosthetics in Germany and the Improvement of Prosthetic Care from a Social Perspective. SOCIETIES 2020. [DOI: 10.3390/soc10010010] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Prosthetic technology for people with missing limbs has made great progress in recent decades. However, acceptance rates and user satisfaction are not only dependent on technical aspects, but also to a great extent on social and psychological factors. We propose that these factors should receive greater attention in order to improve prosthetic care and give recommendations how to incorporate the findings from social science in research and development (R&D) and in care practice. Limited access due to high costs of new prosthetic technology combined with rising costs in health care systems in general is a further issue we address. Our legal and ethical analysis of the reimbursement process in Germany shows that this issue requires further empirical investigation, a stakeholder dialogue and maybe even policy changes. Social science knowledge and participatory methods are of high relevance to answer questions about the benefit of prosthetics for users, based on individual needs and preferences, which should be at the core of debates on ethical resource allocation.
Collapse
|
48
|
Patwardhan S, Dhawan AS, Mukherjee B, Alzamani M, Joiner WM, Sikdar S. Evaluation of the Role of Proprioception During Proportional Position Control Using Sonomyography: Applications in Prosthetic Control. IEEE Int Conf Rehabil Robot 2020; 2019:830-836. [PMID: 31374733 DOI: 10.1109/icorr.2019.8779559] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Prosthetics need to incorporate the users sense of proprioception into the control paradigm to provide intuitive control, and reduce training times and prosthetic rejection rates. In the absence of functional tasks with a prosthetic, virtual cursor control tasks have been used to train users to control multiple degrees of freedom. In this study, A proportional position signal was derived from the cross-sectional ultrasound images of the users forearm. We designed a virtual cursor control task with one degree of freedom to measure the users ability to repeatably and accurately acquire different levels of muscle flexion, using only their sense of proprioception. The experiment involved a target acquisition task, where the cursors height corresponded to the extent of muscle flexion. Users were asked to acquire targets on a screen. Visual feedback was disabled at certain times during the experiment, to isolate the effect of proprioception. We found that as visual feedback was taken away from the subjects, position error increased but their stability error did not change significantly. This indicates that users are not perfect at using only their proprioceptive sense to reacquire a level of muscle flexion, in the absence of haptic or visual feedback. However, they are adept at retaining an acquired flexion level without drifting. These results could help to quantify the role of proprioception in target acquisition tasks, in the absence of haptic or visual feedback.
Collapse
|
49
|
Heerschop A, van der Sluis CK, Otten E, Bongers RM. Looking beyond proportional control: The relevance of mode switching in learning to operate multi-articulating myoelectric upper-limb prostheses. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101647] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
50
|
Ueyama Y, Kubo T, Shibata M. Robotic hip-disarticulation prosthesis: evaluation of prosthetic gaits in a non-amputee individual. Adv Robot 2019. [DOI: 10.1080/01691864.2019.1705908] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Yuki Ueyama
- Department of Mechanical Engineering, National Defense Academy of Japan, Yokosuka, Japan
- Department of Systems Design Engineering, Seikei University, Musashino, Japan
| | - Tsutomu Kubo
- National Rehabilitation Center for Children with Disabilities, Tokyo, Japan
- Department of Prosthetics and Orthotics, Research Institute of National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Japan
| | - Masaaki Shibata
- Department of Systems Design Engineering, Seikei University, Musashino, Japan
| |
Collapse
|