1
|
Asgari M, Crouch DL. Three-dimensional computational musculoskeletal model for estimating force-impedance control during dynamic upper extremity movements. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-7. [PMID: 40038991 DOI: 10.1109/embc53108.2024.10782003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
The human neuromusculoskeletal system learns and adapts the upper limb impedance to new task dynamics, enhancing task performance and stability. This study aimed to develop and validate a realistic neuromusculoskeletal model of the upper limb capable of predicting stiffness modulation and motor adaptation to newly introduced environments and force fields. We employed an inverse task space dynamics approach with a multipriority task control framework for an existing upper limb model in OpenSim (Stanford, CA, USA). The task space controller was responsible for planning and executing muscle-driven goal-oriented movements for the arm while stabilizing these movements against disturbances. We performed simulations involving longitudinal and transverse reaching movements in a horizontal plane at the shoulder level and used the concept of short-range-stiffness to map the stiffness of muscle-tendon units onto end-limb stiffness. Additionally, we studied motor adaptations for longitudinal reaching movements in presence of three position-based divergent force fields and a velocity-dependent force field. Qualitatively, the proposed model and simulations accurately predicted previously reported, experimental end-limb stiffness properties. Our preliminary results indicated the potential of the proposed computational approach for estimating end-limb stiffness parameters. Future studies are needed to more rigorously validate the model by quantifying the level of agreement between the model and experimental measurements for more upper extremity tasks.
Collapse
|
2
|
Wechsler I, Wolf A, Shanbhag J, Leyendecker S, Eskofier BM, Koelewijn AD, Wartzack S, Miehling J. Bridging the sim2real gap. Investigating deviations between experimental motion measurements and musculoskeletal simulation results-a systematic review. Front Bioeng Biotechnol 2024; 12:1386874. [PMID: 38919383 PMCID: PMC11196827 DOI: 10.3389/fbioe.2024.1386874] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Accepted: 05/21/2024] [Indexed: 06/27/2024] Open
Abstract
Musculoskeletal simulations can be used to estimate biomechanical variables like muscle forces and joint torques from non-invasive experimental data using inverse and forward methods. Inverse kinematics followed by inverse dynamics (ID) uses body motion and external force measurements to compute joint movements and the corresponding joint loads, respectively. ID leads to residual forces and torques (residuals) that are not physically realistic, because of measurement noise and modeling assumptions. Forward dynamic simulations (FD) are found by tracking experimental data. They do not generate residuals but will move away from experimental data to achieve this. Therefore, there is a gap between reality (the experimental measurements) and simulations in both approaches, the sim2real gap. To answer (patho-) physiological research questions, simulation results have to be accurate and reliable; the sim2real gap needs to be handled. Therefore, we reviewed methods to handle the sim2real gap in such musculoskeletal simulations. The review identifies, classifies and analyses existing methods that bridge the sim2real gap, including their strengths and limitations. Using a systematic approach, we conducted an electronic search in the databases Scopus, PubMed and Web of Science. We selected and included 85 relevant papers that were sorted into eight different solution clusters based on three aspects: how the sim2real gap is handled, the mathematical method used, and the parameters/variables of the simulations which were adjusted. Each cluster has a distinctive way of handling the sim2real gap with accompanying strengths and limitations. Ultimately, the method choice largely depends on various factors: available model, input parameters/variables, investigated movement and of course the underlying research aim. Researchers should be aware that the sim2real gap remains for both ID and FD approaches. However, we conclude that multimodal approaches tracking kinematic and dynamic measurements may be one possible solution to handle the sim2real gap as methods tracking multimodal measurements (some combination of sensor position/orientation or EMG measurements), consistently lead to better tracking performances. Initial analyses show that motion analysis performance can be enhanced by using multimodal measurements as different sensor technologies can compensate each other's weaknesses.
Collapse
Affiliation(s)
- Iris Wechsler
- Engineering Design, Department of Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Alexander Wolf
- Engineering Design, Department of Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Julian Shanbhag
- Engineering Design, Department of Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Sigrid Leyendecker
- Institute of Applied Dynamics, Department of Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Anne D. Koelewijn
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- Chair of Autonomous Systems and Mechatronics, Department of Electrical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Sandro Wartzack
- Engineering Design, Department of Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Jörg Miehling
- Engineering Design, Department of Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
3
|
Almanzor E, Sugiyama T, Abdulali A, Hayashibe M, Iida F. Utilising redundancy in musculoskeletal systems for adaptive stiffness and muscle failure compensation: a model-free inverse statics approach. BIOINSPIRATION & BIOMIMETICS 2024; 19:046015. [PMID: 38806049 DOI: 10.1088/1748-3190/ad5129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 05/28/2024] [Indexed: 05/30/2024]
Abstract
Vertebrates possess a biomechanical structure with redundant muscles, enabling adaptability in uncertain and complex environments. Harnessing this inspiration, musculoskeletal systems offer advantages like variable stiffness and resilience to actuator failure and fatigue. Despite their potential, the complex structure presents modelling challenges that are difficult to explicitly formulate and control. This difficulty arises from the need for comprehensive knowledge of the musculoskeletal system, including details such as muscle arrangement, and fully accessible muscle and joint states. Whilst existing model-free methods do not need explicit formulations, they also underutilise the benefits of muscle redundancy. Consequently, they necessitate retraining in the event of muscle failure and require manual tuning of parameters to control joint stiffness limiting their applications under unknown payloads. Presented here is a model-free local inverse statics controller for musculoskeletal systems, employing a feedforward neural network trained on motor babbling data. Experiments with a musculoskeletal leg model showcase the controller's adaptability to complex structures, including mono and bi-articulate muscles. The controller can compensate for changes such as weight variations, muscle failures, and environmental interactions, retaining reasonable accuracy without the need for any additional retraining.
Collapse
Affiliation(s)
- Elijah Almanzor
- Bio-Inspired Robotics Laboratory, Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Taku Sugiyama
- Neuro-Robotics Laboratory, Department of Robotics, Graduate School of Engineering, Tohoku University, Sendai 980-8579, Japan
| | - Arsen Abdulali
- Bio-Inspired Robotics Laboratory, Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Mitsuhiro Hayashibe
- Neuro-Robotics Laboratory, Department of Robotics, Graduate School of Engineering, Tohoku University, Sendai 980-8579, Japan
| | - Fumiya Iida
- Bio-Inspired Robotics Laboratory, Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| |
Collapse
|
4
|
Moustridi E, Risvas K, Moustakas K. Predictive simulation of single-leg landing scenarios for ACL injury risk factors evaluation. PLoS One 2023; 18:e0282186. [PMID: 36893124 PMCID: PMC9997920 DOI: 10.1371/journal.pone.0282186] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 02/08/2023] [Indexed: 03/10/2023] Open
Abstract
The Anterior Cruciate Ligament (ACL) rupture is a very common knee injury during sport activities. Landing after jump is one of the most prominent human body movements that can lead to such an injury. The landing-related ACL injury risk factors have been in the spotlight of research interest. Over the years, researchers and clinicians acquire knowledge about human movement during daily-life activities by organizing complex in vivo studies that feature high complexity, costs and technical and most importantly physical challenges. In an attempt to overcome these limitations, this paper introduces a computational modeling and simulation pipeline that aims to predict and identify key parameters of interest that are related to ACL injury during single-leg landings. We examined the following conditions: a) landing height, b) hip internal and external rotation, c) lumbar forward and backward leaning, d) lumbar medial and lateral bending, e) muscle forces permutations and f) effort goal weight. Identified on related research studies, we evaluated the following risk factors: vertical Ground Reaction Force (vGRF), knee joint Anterior force (AF), Medial force (MF), Compressive force (CF), Abduction moment (AbdM), Internal rotation moment (IRM), quadricep and hamstring muscle forces and Quadriceps/Hamstrings force ratio (Q/H force ratio). Our study clearly demonstrated that ACL injury is a rather complicated mechanism with many associated risk factors which are evidently correlated. Nevertheless, the results were mostly in agreement with other research studies regarding the ACL risk factors. The presented pipeline showcased promising potential of predictive simulations to evaluate different aspects of complicated phenomena, such as the ACL injury.
Collapse
Affiliation(s)
- Evgenia Moustridi
- Department of Electrical and Computer Engineering, University of Patras, Patras, Achaia, Greece
| | - Konstantinos Risvas
- Department of Electrical and Computer Engineering, University of Patras, Patras, Achaia, Greece
| | - Konstantinos Moustakas
- Department of Electrical and Computer Engineering, University of Patras, Patras, Achaia, Greece
| |
Collapse
|
5
|
Zhou J, Zhong S, Wu W. Hierarchical Motion Learning for Goal-Oriented Movements With Speed-Accuracy Tradeoff of a Musculoskeletal System. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:11453-11466. [PMID: 34520384 DOI: 10.1109/tcyb.2021.3109021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Generating various goal-oriented movements via the flexible muscle model of the musculoskeletal system as fast and accurately as possible is a pressing problem, which is also the basis of most human adaptive behaviors, such as reaching, catching, interception, and pointing. This article focuses on the adaptive motion generation of fast goal-oriented motion on the musculoskeletal system by implementing the speed-accuracy tradeoff (SAT) in a hierarchical motion learning framework. First, we introduce Fitts' Law into the modified basal ganglia circuit-inspired iterative decision-making model for achieving dynamic and adaptive decision making. Then, as a time constraint, the decision is decomposed into a series of supervised terms by the proposed striatal FSI-SPN interneuron circuit-inspired velocity modulator to implement the tradeoff smoothly on the musculoskeletal system. Finally, an improved policy gradient algorithm is suggested to generate the muscle excitations of the modulated motion via the proposed muscle co-contraction policy, which promotes general cooperation between flexor and extensor muscles. In experiments, a redundant musculoskeletal arm model is trained to perform the adaptive quick pointing movements. By combining the muscle co-contraction policy with SAT, our algorithm shows the most efficient training and the best performance in the adaptive motion generation among the other three popular reinforcement learning algorithms on the musculoskeletal model.
Collapse
|
6
|
Qiao H, Chen J, Huang X. A Survey of Brain-Inspired Intelligent Robots: Integration of Vision, Decision, Motion Control, and Musculoskeletal Systems. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:11267-11280. [PMID: 33909584 DOI: 10.1109/tcyb.2021.3071312] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Current robotic studies are focused on the performance of specific tasks. However, such tasks cannot be generalized, and some special tasks, such as compliant and precise manipulation, fast and flexible response, and deep collaboration between humans and robots, cannot be realized. Brain-inspired intelligent robots imitate humans and animals, from inner mechanisms to external structures, through an integration of visual cognition, decision making, motion control, and musculoskeletal systems. This kind of robot is more likely to realize the functions that current robots cannot realize and become human friends. With the focus on the development of brain-inspired intelligent robots, this article reviews cutting-edge research in the areas of brain-inspired visual cognition, decision making, musculoskeletal robots, motion control, and their integration. It aims to provide greater insight into brain-inspired intelligent robots and attracts more attention to this field from the global research community.
Collapse
|
7
|
Zhong S, Chen J, Niu X, Fu H, Qiao H. Reducing Redundancy of Musculoskeletal Robot With Convex Hull Vertexes Selection. IEEE Trans Cogn Dev Syst 2020. [DOI: 10.1109/tcds.2019.2953642] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
8
|
Chen J, Qiao H. Motor-Cortex-Like Recurrent Neural Network and Multi-Tasks Learning for the Control of Musculoskeletal Systems. IEEE Trans Cogn Dev Syst 2020. [DOI: 10.1109/tcds.2020.3045574] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
9
|
Sharif Razavian R, Ghannadi B, McPhee J. On the Relationship Between Muscle Synergies and Redundant Degrees of Freedom in Musculoskeletal Systems. Front Comput Neurosci 2019; 13:23. [PMID: 31040776 PMCID: PMC6477041 DOI: 10.3389/fncom.2019.00023] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Accepted: 03/29/2019] [Indexed: 11/20/2022] Open
Abstract
It has been suggested that the human nervous system controls motions in the task (or operational) space. However, little attention has been given to the separation of the control of the task-related and task-irrelevant degrees of freedom. Aim: We investigate how muscle synergies may be used to separately control the task-related and redundant degrees of freedom in a computational model. Approach: We generalize an existing motor control model, and assume that the task and redundant spaces have orthogonal basis vectors. This assumption originates from observations that the human nervous system tightly controls the task-related variables, and leaves the rest uncontrolled. In other words, controlling the variables in one space does not affect the other space; thus, the actuations must be orthogonal in the two spaces. We implemented this assumption in the model by selecting muscle synergies that produce force vectors with orthogonal directions in the task and redundant spaces. Findings: Our experimental results show that the orthogonality assumption performs well in reconstructing the muscle activities from the measured kinematics/dynamics in the task and redundant spaces. Specifically, we found that approximately 70% of the variation in the measured muscle activity can be captured with the orthogonality assumption, while allowing efficient separation of the control in the two spaces. Implications: The developed motor control model is a viable tool in real-time simulations of musculoskeletal systems, as well as model-based control of bio-mechatronic systems, where a computationally efficient representation of the human motion controller is needed.
Collapse
Affiliation(s)
- Reza Sharif Razavian
- Motion Research Group, Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | | | | |
Collapse
|
10
|
Realizing human-like manipulation with a musculoskeletal system and biologically inspired control scheme. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2018.12.069] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
11
|
Stanev D, Moustakas K. Modeling musculoskeletal kinematic and dynamic redundancy using null space projection. PLoS One 2019; 14:e0209171. [PMID: 30601838 PMCID: PMC6314624 DOI: 10.1371/journal.pone.0209171] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2017] [Accepted: 11/30/2018] [Indexed: 01/01/2023] Open
Abstract
The coordination of the human musculoskeletal system is deeply influenced by its redundant structure, in both kinematic and dynamic terms. Noticing a lack of a relevant, thorough treatment in the literature, we formally address the issue in order to understand and quantify factors affecting the motor coordination. We employed well-established techniques from linear algebra and projection operators to extend the underlying kinematic and dynamic relations by modeling the redundancy effects in null space. We distinguish three types of operational spaces, namely task, joint and muscle space, which are directly associated with the physiological factors of the system. A method for consistently quantifying the redundancy on multiple levels in the entire space of feasible solutions is also presented. We evaluate the proposed muscle space projection on segmental level reflexes and the computation of the feasible muscle forces for arbitrary movements. The former proves to be a convenient representation for interfacing with segmental level models or implementing controllers for tendon driven robots, while the latter enables the identification of force variability and correlations between muscle groups, attributed to the system’s redundancy. Furthermore, the usefulness of the proposed framework is demonstrated in the context of estimating the bounds of the joint reaction loads, where we show that misinterpretation of the results is possible if the null space forces are ignored. This work presents a theoretical analysis of the redundancy problem, facilitating application in a broad range of fields related to motor coordination, as it provides the groundwork for null space characterization. The proposed framework rigorously accounts for the effects of kinematic and dynamic redundancy, incorporating it directly into the underlying equations using the notion of null space projection, leading to a complete description of the system.
Collapse
Affiliation(s)
- Dimitar Stanev
- Department of Electrical and Computer Engineering, University of Patras, Patras, Achaia, Greece
- * E-mail:
| | - Konstantinos Moustakas
- Department of Electrical and Computer Engineering, University of Patras, Patras, Achaia, Greece
| |
Collapse
|