Analysis of hand synergies in healthy subjects during bimanual manipulation of various objects

Exploring synergistic patterns in bimanual distal limb movements through low dimensional representations

The human hand is a complex manipulator with many joints that can perform various tasks. Neuroscience research has demonstrated that to perform any posture, the brain does not control the individual joints but relies on coactivation patterns called synergies that simultaneously control a set of joints. A combination of these synergies can then be used to reconstruct a variety of postures. While such a hypothesis has been demonstrated for single-handed tasks, a question that is not well-explored is whether such synergies can simultaneously control the joints of both hands during bimanual tasks. This paper attempted to address this question by exploring synergies obtained by performing Principal Component Analysis (PCA) on the kinematic data recorded from both the dominant and non-dominant hands of the participants as they performed bimanual tasks. The ability of synergies to reconstruct postures from a lower-dimensional subspace was presented, and an analysis of the separability of postures was performed using a classification algorithm. The results showed that the first 3 synergies explained greater than 80% variance in data, indicating that a few bimanual synergies can be utilized to control the fingers of both hands. The first three synergies could reconstruct postures with a Root Mean Square Error (RMSE) of 4° and classify tasks with an accuracy of 90%, demonstrating that the task-related information was retained in the lower dimensional subspace. This could significantly reduce control complexities while designing robotic or prosthetic distal upper limb devices.

Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities

This study introduces a novel system for evaluating hand motor function through synergy-based analysis during object manipulation in virtual and mixed-reality environments. Conventional assessments of hand function are often subjective, relying on visual observation by therapists or patient-reported outcomes. To address these limitations, we developed a system that utilizes the leap motion controller (LMC) to capture finger motion data without the constraints of glove-type devices. Spatial synergies were extracted using principal component analysis (PCA) and Varimax rotation, providing insights into finger motor coordination with the sparse decomposition. Additionally, we incorporated the HoloLens 2 to create a mixed-reality object manipulation task that enhances spatial awareness for the user, improving natural interaction with virtual objects. Our results demonstrate that synergy-based analysis allows for the systematic detection of hand movement abnormalities that are not captured through traditional task performance metrics. This system demonstrates promise in advancing rehabilitation by enabling more objective and detailed evaluations of finger motor function, facilitating personalized therapy, and potentially contributing to the early detection of motor impairments in the future.

Task demands modulate distal limb handedness: A comparative analysis of prehensile synergies of the dominant and non-dominant hand

The dynamic dominance hypothesis of handedness suggests a distinct control strategy for the dominant and the non-dominant limb. The hypothesis demonstrated that the dominant proximal limb is tuned for optimal trajectory control while the non-dominant limb is tuned for a stable grasp. Whether the hypothesis can be extended to distal segments like fingers, especially during a five-fingered grasp, has been studied little. To examine this, an attempt was made to compare the prehensile synergies and force magnitudes of the dominant (DOM) and non-dominant hands (NDOM) during a 5-fingered prehension task. Participants traced a trapezoidal and inverse trapezoidal path with their thumbs on a sliding platform while holding a handle in static equilibrium. The DOM hand performed better only in the inverse trapezoid condition, exhibiting a reduced grip force and increased synergy index aligning with the dynamic dominance hypothesis. No differences were observed for the trapezoid condition, likely due to reduced task demands. The study also explored changes in anticipatory synergy adjustments between the DOM and NDOM hands, but the differences were non-significant. Overall, the DOM hand demonstrated better force coordination than the NDOM hand in challenging conditions. Applications of the study in the objective assessment of handedness were proposed.

Kinematic synergies show good consistency when extracted with a low-cost markerless device and a marker-based motion tracking system

Recently, markerless tracking systems, such as RGB-Depth cameras, have spread to overcome some of the limitations of the gold standard marker-based tracking systems. Although these systems are valuable substitutes for human motion analysis, as they guarantee higher flexibility, faster setup time and lower costs, their tracking accuracy is lower with respect to marker-based systems. Many studies quantified the error made by markerless systems in terms of body segment length estimation, articular angles, and biomechanics, concluding that they are appropriate for many clinical applications related to motion analysis. We propose an innovative approach to compare a markerless tracking system (Kinect V2) with a gold standard marker-based system (Vicon), based on motor control assessment. We quantified kinematic synergies from the tracking data of fifteen participants performing multi-directional upper limb movements. Kinematic synergy analysis decomposes the kinematic data into a reduced set of motor primitives that describe how the central nervous system coordinates motion at spatial and temporal level. Synergies were extracted with the recently released mixed-matrix factorization algorithm. Four synergies were extracted from both marker-based and markerless datasets and synergies were grouped in 6 clusters for each dataset. Cosine similarity in each cluster was ⩾0.60 in both systems, showing good consistency of synergies. Good matching was found between synergies extracted from markerless and from marker-based data, with a cosine similarity between matched synergies ⩾0.60 in 5 out 6 synergies. These results showed that the markerless sensor can be feasible for kinematic synergy analysis for gross movements, as it correctly estimates the number of synergies and in most cases also their spatial and temporal organization.

Comparison of synergy patterns between the right and left hand while performing postures and object grasps

The human hand, with many degrees of freedom, serves as an excellent tool for dexterous manipulation. Previous research has demonstrated that there exists a lower-dimensional subspace that synergistically controls the full hand kinematics. The elements of this subspace, also called synergies, have been viewed as the strategy developed by the CNS in the control of finger movements. Considering that the control of fingers is lateralized to the contralateral hemisphere, how the synergies differ for the control of the dominant and the non-dominant hand has not been widely addressed. In this paper, hand kinematics was recorded using electromagnetic tracking system sensors as participants made various postures and object grasps with their dominant hand and non-dominant hand separately. Synergies that explain 90% of variance in data of both hands were analyzed for similarity at the individual level as well as at the population level. The results showed no differences in synergies between the hands at both these levels. PC scores and cross-reconstruction errors were analyzed to further support the prevalence of similarity between the synergies of the hands. Future work is proposed, and implications of the results to the treatment and diagnosis of neuromotor disorders are discussed.

Decomposition and Reconstruction of Human Palm Movements

OBJECTIVE

The human hand is known to have excellent manipulation ability compared to other primate hands. Without the palm movements, the human hand would lose more than 40% of its functions. However, uncovering the constitution of palm movements is still a challenging problem involving kinesiology, physiology, and engineering science.

METHODS

By recording the palm joint angles during common grasping, gesturing, and manipulation tasks, we built a palm kinematic dataset. Then, a method for extracting the eigen-movements to characterize the common motion correlation relationships of palm joints was proposed to explore the palm movement constitution.

RESULTS

This study revealed a palm kinematic characteristic that we named the joint motion grouping coupling characteristic. During natural palm movements, there are several joint groups with a high degree of motor independence, while the movements of joints within each joint group are interdependent. Based on these characteristics, the palm movements can be decomposed into seven eigen-movements. The linear combinations of these eigen-movements can reconstruct more than 90% of palm movement ability. Moreover, combined with the palm musculoskeletal structures, we found that the revealed eigen-movements are associated with joint groups that are defined by muscular functions, which provided a meaningful context for palm movement decomposition.

CONCLUSION

This paper suggests that some invariable characteristics underlie the variable palm motor behaviors and can be used to simplify palm movement generation.

SIGNIFICANCE

This paper provides important insights into palm kinematics, and helps facilitate motor function assessment and the development of better artificial hands.

The BE-UJI hand function activity set: a reduced set of activities for the evaluation of the healthy and pathological hand

BACKGROUND

Hand kinematics during hand function tests based on the performance of activities of daily living (ADLs) can provide objective data to determine patients' functional loss. However, they are rarely used during clinical assessments because of their long duration. Starting with the 20 Sollerman Hand Function Test (SHFT) tasks, we propose identifying a reduced set of ADLs that provides similar kinematic information to the original full set in terms of synergies, ranges of motion and velocities.

METHODS

We followed an iterative method with the kinematics of 16 hand joints while performing the 20 ADLs of the SHFT. For each subject, ADLs were ordered according to their influence on the synergies obtained by means of a principal component analysis, the minimum number of ADLs that represented the original kinematic synergies (maximum angle of 30° between synergies), and the maintained ranges of joint movements (85% of the original ones) were selected for each subject. The set of the most frequently selected ADLs was verified to be representative of the SHFT ADLs in terms of motion strategies, ranges of motion and joint velocities when considering healthy subjects and Hand Osteoarthritis patients.

RESULTS

A set of 10 tasks, the BE-UJI activity set, was identified by ensuring a certain (minimum) similarity in synergy (maximum mean angle between synergies of 25.5°), functional joint ranges (maximum differences of 10°) and joint velocities (maximum differences of 15°/s). The obtained tasks were: pick up coins from purses, lift wooden cubes, pick up nuts and turn them, write with a pen, cut with a knife, lift a telephone, unscrew jar lids and pour water from a cup, a jar and a Pure-Pak. These activities guarantee using the seven commonest handgrips in ADLs.

CONCLUSION

The BE-UJI activity set for the hand function assessment can be used to obtain quantitative data in clinics as an alternative to the SHFT. It reduces the test time and allows clinicians to obtain objective kinematic data of the motor strategies, ranges of motion and joint velocities used by patients.

EMG space similarity feedback promotes learning of expert-like muscle activation patterns in a complex motor skill

Augmented feedback provided by a coach or augmented reality system can facilitate the acquisition of a motor skill. Verbal instructions and visual aids can be effective in providing feedback about the kinematics of the desired movements. However, many skills require mastering not only kinematic, but also complex kinetic patterns, for which feedback is harder to convey. Here, we propose the electromyography (EMG) space similarity feedback, which may indirectly convey kinematic and kinetic feedback by comparing the muscle activations of the learner and an expert in the task. The EMG space similarity feedback is a score that reflects how well a set of muscle synergies extracted from the expert can reconstruct the learner's EMG when performing the task. We tested the EMG space similarity feedback in a virtual bimanual polishing task that uses a robotic system to simulate the dynamics of a real polishing operation. We measured the expert's and learner's EMG from eight muscles in each arm during the real and virtual polishing tasks, respectively. The goal of the virtual task was to smoothen the surface of a virtual object. Therefore, we defined performance in the task as the smoothness of the object at the end of a trial. We separated learners into real feedback and null feedback groups to assess the effects of the EMG space similarity feedback. The real and null feedback groups received veridic and no EMG space similarity feedback, respectively. Subjects participated in five training sessions on different days, and we evaluated their performance on each day. Subjects in both groups were able to increase smoothness throughout the training sessions, with no significant differences between groups. However, subjects in the real feedback group were able to improve in the EMG space similarity score to a significantly greater extent than the null feedback group. Additionally, subjects in the real feedback group produced muscle activations that became increasingly consistent with an important muscle synergy found in the expert. Our results indicate that the EMG space similarity feedback promotes acquiring expert-like muscle activation patterns, suggesting that it may assist in the acquisition of complex motor skills.

A user-friendly automatic toolbox for hand kinematic analysis, clinical assessment and postural synergies extraction

The clinical assessment of the human hand is typically conducted through questionnaires or tests that include objective (e.g., time) and subjective (e.g., grasp quality) outcome measures. However, there are other important indicators that should be considered to quantify grasp and movement quality in addition to the time needed by a subject to execute a task, and this is essential for human and artificial hands that attempt to replicate the human hand properties. The correct estimation of hand kinematics is fundamental for computing these indicators with high fidelity, and a technical background is typically required to perform this analysis. In addition, to understand human motor control strategies as well as to replicate them on artificial devices, postural synergies were widely explored in recent years. Synergies should be analyzed not only to investigate possible modifications due to musculoskeletal and/or neuromuscular disorders, but also to test biomimetic hands. The aim of this work is to present an open source toolbox to perform all-in-one kinematic analysis and clinical assessment of the hand, as well as to perform postural synergies extraction. In the example provided in this work, the tool takes as input the position of 28 retroreflective markers with a diameter of 6 mm, positioned on specific anatomical landmarks of the hand and recorded with an optoelectronic motion capture system, and automatically performs 1) hand kinematic analysis (i.e., computation of 23 joint angles); 2) clinical assessment, by computing indicators that allow quantifying movement efficiency (Peak Grip Aperture), smoothness (Normalized Dimensionless Jerk Grasp Aperture) and speed (Peak Velocity of Grasp Aperture), planning capabilities (Time to Peak Grip Aperture), spatial posture (Wrist and Finger Joint Angles) and grasp stability (Posture of Hand Finger Joints), and 3) postural synergies extraction and analysis through the Pareto, Scree and Loadings plots. Two examples are described to demonstrate the applicability of the toolbox: the first one aiming at performing a clinical assessment of a volunteer and the second one aiming at extracting and analyzing the volunteer's postural synergies. The tool allows calculating joint angles with high accuracy (reconstruction errors below 4 mm and 3.2 mm for the fingers and wrist respectively) and automatically performing clinical assessment and postural synergies extraction. Results can be visually inspected, and data can be saved for any desired post processing analysis. Custom-made protocols to extract joint angles, based on different markersets, could be also integrated in the toolbox. The tool can be easily exploitable in clinical contexts, as it does not require any particular technical knowledge to be used, as confirmed by the usability evaluation conducted (perceived usability = 94.2 ± 5.4). In addition, it can be integrated with the SynGrasp toolbox to perform grasp analysis of underactuated virtual hands based on postural synergies.

A Survey of Multifingered Robotic Manipulation: Biological Results, Structural Evolvements, and Learning Methods

Multifingered robotic hands (usually referred to as dexterous hands) are designed to achieve human-level or human-like manipulations for robots or as prostheses for the disabled. The research dates back 30 years ago, yet, there remain great challenges to effectively design and control them due to their high dimensionality of configuration, frequently switched interaction modes, and various task generalization requirements. This article aims to give a brief overview of multifingered robotic manipulation from three aspects: a) the biological results, b) the structural evolvements, and c) the learning methods, and discuss potential future directions. First, we investigate the structure and principle of hand-centered visual sensing, tactile sensing, and motor control and related behavioral results. Then, we review several typical multifingered dexterous hands from task scenarios, actuation mechanisms, and in-hand sensors points. Third, we report the recent progress of various learning-based multifingered manipulation methods, including but not limited to reinforcement learning, imitation learning, and other sub-class methods. The article concludes with open issues and our thoughts on future directions.

Reducing Anthropomorphic Hand Degrees of Actuation with Grasp-Function-Dependent and Joint-Element-Sparse Hand Synergies

In this paper, a set of grasp-function-dependent and joint-element-sparse hand synergies was proposed. First, hand synergies were extracted from five basic categories of movements by principal component analysis (PCA). Then, varimax rotation was applied on these synergies, so each sparse synergy only represented a limited number of joints. Next, according to the contribution to these sparse synergies, finger joints were clustered into different joint modules. Finally, integrating the joint modules in different categories of hand movements, the minimum number of actuators and joint synergic modules for anthropomorphic hands were determined. The results showed that using 5 groups of joint modules and 7–9 actuators we can achieve the best performance of grasp function and motion flexibility. Furthermore, through the reasonable design of adaptive and hyperextension functional joint modules, anthropomorphic hands can better meet the requirements of different tasks like power grasping and precision pinching. Comparing with traditional finger-based actuation strategy, the joint coupling scheme achieved better anthropomorphic performance and larger workspace. These above findings will benefit the development of mechanical structure design and control method of anthropomorphic hands.

Quantitative Investigation of Hand Grasp Functionality: Hand Joint Motion Correlation, Independence, and Grasping Behavior

Modeling and understanding human grasp functionality are fundamental in prosthetics, robotics, medicine, and rehabilitation, since they contribute to exploring motor control mechanism, evaluating grasp function, and designing and controlling prosthetic hands or exoskeletons. However, there are still limitations in providing a comprehensive and quantitative understanding of hand grasp functionality. After simultaneously considering three significant and essential influence factors in daily grasping contained relative position, object shape, and size, this paper presents the tolerance grasping to provide a more comprehensive understanding of human grasp functionality. The results of joint angle distribution and variance explained by PCs supported that tolerance grasping can represent hand grasp functionality more comprehensively. Four synergies are found and account for 93% ± 1.5% of the overall variance. The ANOVA confirmed that there was no significant individual difference in the first four postural synergies. The common patterns of grasping behavior were found and characterized by the mean value of postural synergy across 10 subjects. The independence analysis demonstrates that the tolerance grasping results highly correlate with unstructured natural grasping and more accurately correspond to cortical representation size of finger movement. The potential for exploring the neuromuscular control mechanism of human grasping is discussed. The analysis of hand grasp characteristics that contained joint angle distribution, correlation, independence, and postural synergies, presented here, should be more representative to provide a more comprehensive understanding of hand grasp functionality.

Quantitative Investigation of Hand Grasp Functionality: Thumb Grasping Behavior Adapting to Different Object Shapes, Sizes, and Relative Positions

This paper is the first in the two-part series quantitatively modelling human grasp functionality and understanding the way human grasp objects. The aim is to investigate the thumb movement behavior influenced by object shapes, sizes, and relative positions. Ten subjects were requested to grasp six objects (3 shapes × 2 sizes) in 27 different relative positions (3 X deviation × 3 Y deviation × 3 Z deviation). Thumb postures were investigated to each specific joint. The relative position (X, Y, and Z deviation) significantly affects thumb opposition rotation (Rot) and flexion (interphalangeal (IP) and metacarpo-phalangeal (MCP)), while the object property (object shape and size) significantly affects thumb abduction/adduction (ABD) motion. Based on the F value, the Y deviation has the primary effects on thumb motion. When the Y deviation changing from proximal to distal, thumb opposition rotation (Rot) and flexion (IP and MCP joint) angles were increased and decreased, respectively. For principal component analysis (PCA) results, thumb grasp behavior can be accurately reconstructed by first two principal components (PCs) which variance explanation ratio reached 93.8% and described by the inverse and homodromous coordination movement between thumb opposition and IP flexion. This paper provides a more comprehensive understanding of thumb grasp behavior. The postural synergies can reproduce the anthropomorphic motion, reduce the robot hardware, and control dimensionality. All of these provide a more accurate and general basis for the design and control of the bionic thumb and novel wearable assistant robot, thumb function assessment, and rehabilitation.

Learning Grasp Configuration Through Object-Specific Hand Primitives for Posture Planning of Anthropomorphic Hands

The proposal of postural synergy theory has provided a new approach to solve the problem of controlling anthropomorphic hands with multiple degrees of freedom. However, generating the grasp configuration for new tasks in this context remains challenging. This study proposes a method to learn grasp configuration according to the shape of the object by using postural synergy theory. By referring to past research, an experimental paradigm is first designed that enables the grasping of 50 typical objects in grasping and operational tasks. The angles of the finger joints of 10 subjects were then recorded when performing these tasks. Following this, four hand primitives were extracted by using principal component analysis, and a low-dimensional synergy subspace was established. The problem of planning the trajectories of the joints was thus transformed into that of determining the synergy input for trajectory planning in low-dimensional space. The average synergy inputs for the trajectories of each task were obtained through the Gaussian mixture regression, and several Gaussian processes were trained to infer the inputs trajectories of a given shape descriptor for similar tasks. Finally, the feasibility of the proposed method was verified by simulations involving the generation of grasp configurations for a prosthetic hand control. The error in the reconstructed posture was compared with those obtained by using postural synergies in past work. The results show that the proposed method can realize movements similar to those of the human hand during grasping actions, and its range of use can be extended from simple grasping tasks to complex operational tasks.

A Systematic Analysis of Hand Movement Functionality: Qualitative Classification and Quantitative Investigation of Hand Grasp Behavior

Understanding human hand movement functionality is fundamental in neuroscience, robotics, prosthetics, and rehabilitation. People are used to investigate movement functionality separately from qualitative or quantitative perspectives. However, it is still limited to providing an integral framework from both perspectives in a logical manner. In this paper, we provide a systematic framework to qualitatively classify hand movement functionality, build prehensile taxonomy to explore the general influence factors of human prehension, and accordingly design a behavioral experiment to quantitatively understand the hand grasp. In qualitative analysis, two facts are explicitly proposed: (1) the arm and wrist make a vital contribution to hand movement functionality; (2) the relative position (relative position in this paper is defined as the distance between the center of the human wrist and the object center of gravity) is a general influence factor significantly impacting human prehension. In quantitative analysis, the significant influence of three factors, object shape, size, and relative position, is quantitatively demonstrated. Simultaneously considering the impact of relative position, object shape, and size, the prehensile taxonomy and behavioral experiment results presented here should be more representative and complete to understand human grasp functionality. The systematic framework presented here is general and applicable to other body parts, such as wrist, arm, etc. Finally, many potential applications and the limitations are clarified.

A Systematic Review of EMG Applications for the Characterization of Forearm and Hand Muscle Activity during Activities of Daily Living: Results, Challenges, and Open Issues

The role of the hand is crucial for the performance of activities of daily living, thereby ensuring a full and autonomous life. Its motion is controlled by a complex musculoskeletal system of approximately 38 muscles. Therefore, measuring and interpreting the muscle activation signals that drive hand motion is of great importance in many scientific domains, such as neuroscience, rehabilitation, physiotherapy, robotics, prosthetics, and biomechanics. Electromyography (EMG) can be used to carry out the neuromuscular characterization, but it is cumbersome because of the complexity of the musculoskeletal system of the forearm and hand. This paper reviews the main studies in which EMG has been applied to characterize the muscle activity of the forearm and hand during activities of daily living, with special attention to muscle synergies, which are thought to be used by the nervous system to simplify the control of the numerous muscles by actuating them in task-relevant subgroups. The state of the art of the current results are presented, which may help to guide and foster progress in many scientific domains. Furthermore, the most important challenges and open issues are identified in order to achieve a better understanding of human hand behavior, improve rehabilitation protocols, more intuitive control of prostheses, and more realistic biomechanical models.

Synergy-Based Sensor Reduction for Recording the Whole Hand Kinematics

Simultaneous measurement of the kinematics of all hand segments is cumbersome due to sensor placement constraints, occlusions, and environmental disturbances. The aim of this study is to reduce the number of sensors required by using kinematic synergies, which are considered the basic building blocks underlying hand motions. Synergies were identified from the public KIN-MUS UJI database (22 subjects, 26 representative daily activities). Ten synergies per subject were extracted as the principal components explaining at least 95% of the total variance of the angles recorded across all tasks. The 220 resulting synergies were clustered, and candidate angles for estimating the remaining angles were obtained from these groups. Different combinations of candidates were tested and the one providing the lowest error was selected, its goodness being evaluated against kinematic data from another dataset (KINE-ADL BE-UJI). Consequently, the original 16 joint angles were reduced to eight: carpometacarpal flexion and abduction of thumb, metacarpophalangeal and interphalangeal flexion of thumb, proximal interphalangeal flexion of index and ring fingers, metacarpophalangeal flexion of ring finger, and palmar arch. Average estimation errors across joints were below 10% of the range of motion of each joint angle for all the activities. Across activities, errors ranged between 3.1% and 16.8%.

Shared control-based bimanual robot manipulation

Human-centered environments provide affordances for and require the use of two-handed, or bimanual, manipulations. Robots designed to function in, and physically interact with, these environments have not been able to meet these requirements because standard bimanual control approaches have not accommodated the diverse, dynamic, and intricate coordinations between two arms to complete bimanual tasks. In this work, we enabled robots to more effectively perform bimanual tasks by introducing a bimanual shared-control method. The control method moves the robot's arms to mimic the operator's arm movements but provides on-the-fly assistance to help the user complete tasks more easily. Our method used a bimanual action vocabulary, constructed by analyzing how people perform two-hand manipulations, as the core abstraction level for reasoning about how to assist in bimanual shared autonomy. The method inferred which individual action from the bimanual action vocabulary was occurring using a sequence-to-sequence recurrent neural network architecture and turned on a corresponding assistance mode, signals introduced into the shared-control loop designed to make the performance of a particular bimanual action easier or more efficient. We demonstrate the effectiveness of our method through two user studies that show that novice users could control a robot to complete a range of complex manipulation tasks more successfully using our method compared to alternative approaches. We discuss the implications of our findings for real-world robot control scenarios.

Sensing form - finger gaiting as key to tactile object exploration - a data glove analysis of a prototypical daily task

Background

Motor hand skill and associated dexterity is important for meeting the challenges of daily activity and an important resource post-stroke. In this context, the present study investigated the finger movements of right-handed subjects during tactile manipulation of a cuboid, a prototypical task underlying tactile exploration. During one motor act, the thumb and fingers of one hand surround the cuboid in a continuous and regular manner. While the object is moved by the guiding thumb, the opposed supporting fingers are replaced once they reach their joint limits by free fingers, a mechanism termed finger gaiting.

Methods

For both hands of 22 subjects, we acquired the time series of consecutive manipulations of a cuboid at a frequency of 1 Hz, using a digital data glove consisting of 29 sensors. Using principle component analysis, we decomposed the short action into motor patterns related to successive manipulations of the cuboid. The components purport to represent changing grasp configurations involving the stabilizing fingers and guiding thumb. The temporal features of the components permits testing whether the distinct configurations occur at the frequency of 1 Hz, i.e. within the time window of 1 s, and, thus, taxonomic classification of the manipulation as finger gaiting.

Results

The fraction of variance described by the principal components indicated that three components described the salient features of the single motor acts for each hand. Striking in the finger patterns was the prominent and varying roles of the MCP and PIP joints of the fingers, and the CMC joint of the thumb. An important aspect of the three components was their representation of distinct finger configurations within the same motor act. Principal component and graph theory analysis confirmed modular, functionally synchronous action of the involved joints. The computation of finger trajectories in one subject illustrated the workspace of the task, which differed for the right and left hands.

Conclusion

In this task one complex motor act of 1 s duration could be described by three elementary and hierarchically ordered grasp configurations occurring at the prescribed frequency of 1 Hz. Therefore, these configurations represent finger gaiting, described until now only in artificial systems, as the principal mechanism underlying this prototypical task.

Trial registration

clinicaltrials.gov, NCT02865642, registered 12 August 2016.

Hand Kinematics Characterization While Performing Activities of Daily Living Through Kinematics Reduction

Improving the understanding of hand kinematics during the performance of activities of daily living may help improve the control of hand prostheses and hand function assessment. This work identifies sparse synergies (each degree of freedom is present mainly in only one synergy), representative of the global population, with emphasis in unveiling the coordination of joints with small range of motion (palmar arching and fingers abduction). The study is the most complete study described in the literature till now, involving 22 healthy subjects and 26 representative day-to-day life activities. Principal component analysis was used to reduce the original 16 angles recorded with an instrumented glove. Five synergies explained 75% of total variance: closeness (coordinated flexion and abduction of metacarpophalangeal finger joints), digit arching (flexion of proximal interphalangeal joints), palmar-thumb coordination (coordination of palmar arching and thumb carpometacarpal flexion), thumb opposition, and thumb arch. The temporal evolution of these synergies is provided during reaching per intended grasp and during manipulation per specific task, which could be used as normative patterns for the global population. Reaching has been observed to require the modulation of closeness, digit arch and thumb opposition synergies, with different control patterns per grasp. All the synergies are very important during manipulation and need to be modulated for all the tasks. Finally, groups of tasks with similar kinematic requirements in terms of synergies have been identified, which could benefit the selection of tasks for rehabilitation and hand function assessments.

A large calibrated database of hand movements and grasps kinematics

Modelling hand kinematics is a challenging problem, crucial for several domains including robotics, 3D modelling, rehabilitation medicine and neuroscience. Currently available datasets are few and limited in the number of subjects and movements. The objective of this work is to advance the modelling of hand kinematics by releasing and validating a large publicly available kinematic dataset of hand movements and grasp kinematics. The dataset is based on the harmonization and calibration of the kinematics data of three multimodal datasets previously released (Ninapro DB1, DB2 and DB5, that include electromyography, inertial and dynamic data). The novelty of the dataset is related to the high number of subjects (77) and movements (40 movements, each repeated several times) for which we release for the first time calibrated kinematic data, resulting in the largest available kinematic dataset. Differently from the previous datasets, the data are also calibrated to avoid sensor nonlinearities. The validation confirms that the data are not affected by experimental procedures and that they are similar to data acquired in real-life conditions.

Measurement(s)	movement quality • grasps kinematics • muscle electrophysiology trait
Technology Type(s)	sensor • electromyography
Factor Type(s)	type of movement • joint movement repetition • age • sex • left-handed or right-handed • weight • height • body mass index
Sample Characteristic - Organism	Homo sapiens

Machine-accessible metadata file describing the reported data: 10.6084/m9.figshare.11341679

Effect on manual skills of wearing instrumented gloves during manipulation

Instrumented gloves are motion capture systems that are widely used due to the simplicity of the setup required and the absence of occlusion problems when manipulating objects. Nevertheless, the effect of their use on manipulation capabilities has not been studied to date. Therefore, the aim of this work is to quantify the effect of wearing CyberGlove instrumented gloves on these capabilities when different levels of precision are required. Thirty healthy subjects were asked to perform three standardised dexterity tests twice: bare-handed and wearing instrumented gloves. The tests were the Sollerman Hand Function Test (to evaluate capability of performing activities of daily living), the Box and Block Test (to evaluate gross motor skills) and the Purdue Pegboard Test (to evaluate fine motor skills). Scores obtained in the test evaluating fine motor skills decreased by an average of 29% when wearing gloves, while scores obtained on those evaluating gross motor skills and capability to perform activities of daily living were reduced by an average of 8% and 3%, respectively. The use of instrumented gloves to record hand kinematics is only recommended when performing tasks requiring medium and gross motor skills.

A Comprehensive Spatial Mapping of Muscle Synergies in Highly Variable Upper-Limb Movements of Healthy Subjects

BACKGROUND

Recently, muscle synergy analysis has become a standard methodology for extracting coordination patterns from electromyographic (EMG) signals, and for the evaluation of motor control strategies in many contexts. Most previous studies have characterized upper-limb muscle synergies across a limited set of reaching movements. With the aim of future uses in motor control, rehabilitation and other fields, this study provides a comprehensive characterization of muscle synergies in a large set of upper-limb tasks and also considers inter-individual and environmental variability.

METHODS

Sixteen healthy subjects performed upper-limb hand exploration movements for a comprehensive mapping of the upper-limb workspace, which was divided into several sectors (Frontal, Right, Left, Horizontal, and Up). EMGs from representative upper-limb muscles and kinematics were recorded to extract muscle synergies and explore the composition, repeatability and similarity of spatial synergies across subjects and movement directions, in a context of high variability of motion.

RESULTS

Even in a context of high variability, a reduced set of muscle synergies may reconstruct the original EMG envelopes. Composition, repeatability and similarity of synergies were found to be shared across subjects and sectors, even if at a lower extent than previously reported.

CONCLUSION

Extending the results of previous studies, which were performed on a smaller set of conditions, a limited number of muscle synergies underlie the execution of a large variety of upper-limb tasks. However, the considered spatial domain and the variability seem to influence the number and composition of muscle synergies. Such detailed characterization of the modular organization of the muscle patterns for upper-limb control in a large variety of tasks may provide a useful reference for studies on motor control, rehabilitation, industrial applications, and sports.

Kinematic synergies of hand grasps: a comprehensive study on a large publicly available dataset

Background

Hand grasp patterns require complex coordination. The reduction of the kinematic dimensionality is a key process to study the patterns underlying hand usage and grasping. It allows to define metrics for motor assessment and rehabilitation, to develop assistive devices and prosthesis control methods. Several studies were presented in this field but most of them targeted a limited number of subjects, they focused on postures rather than entire grasping movements and they did not perform separate analysis for the tasks and subjects, which can limit the impact on rehabilitation and assistive applications. This paper provides a comprehensive mapping of synergies from hand grasps targeting activities of daily living. It clarifies several current limits of the field and fosters the development of applications in rehabilitation and assistive robotics.

Methods

In this work, hand kinematic data of 77 subjects, performing up to 20 hand grasps, were acquired with a data glove (a 22-sensor CyberGlove II data glove) and analyzed. Principal Component Analysis (PCA) and hierarchical cluster analysis were used to extract and group kinematic synergies that summarize the coordination patterns available for hand grasps.

Results

Twelve synergies were found to account for > 80% of the overall variation. The first three synergies accounted for more than 50% of the total amount of variance and consisted of: the flexion and adduction of the Metacarpophalangeal joint (MCP) of fingers 3 to 5 (synergy #1), palmar arching and flexion of the wrist (synergy #2) and opposition of the thumb (synergy #3). Further synergies refine movements and have higher variability among subjects.

Conclusion

Kinematic synergies are extracted from a large number of subjects (77) and grasps related to activities of daily living (20). The number of motor modules required to perform the motor tasks is higher than what previously described. Twelve synergies are responsible for most of the variation in hand grasping. The first three are used as primary synergies, while the remaining ones target finer movements (e.g. independence of thumb and index finger). The results generalize the description of hand kinematics, better clarifying several limits of the field and fostering the development of applications in rehabilitation and assistive robotics.

Investigation into reducing anthropomorphic hand degrees of freedom while maintaining human hand grasping functions

Underactuation is widely used when designing anthropomorphic hand, which involves fewer degrees of actuation than degrees of freedom. However, the similarities between coordinated joint movements and movement variances across different grasp tasks have not been suitably examined. This work suggests a systematic approach to identify the actuation strategy with the minimum number for degrees of actuation for anthropomorphic hands. This work evaluates the correlations of coordinated movements in human hands during 23 grasp tasks to suggest actuation strategies for anthropomorphic hands. Our approach proceeds as follows: first, we find the best description for each coordinated joint movement in each grasp task by using multiple linear regression; then, based on the similarities between joint movements, we classify hand joints into groups by using hierarchical cluster analysis; finally, we reduce the dimensionality of each group of joints by employing principal components analysis. The metacarpophalangeal joints and proximal interphalangeal joints have the best and most consistent description of their coordinated movements across all grasp tasks. The thumb metacarpophalangeal and abduction/adduction between the ring and little fingers exhibit relatively high independence of movement. The distal interphalangeal joints show a high degree of independent movement but not for all grasp tasks. Analysis of the results indicates that for the distal interphalangeal joints, their coordinated movements are better explained when all fingers wrap around the object. Our approach fails to provide more information for the other joints. We conclude that 19 degrees of freedom for an anthropomorphic hand can be reduced to 13 degrees of actuation distributed between six groups of joints. The number of degrees of actuation can be further reduced to six by relaxing the dimensionality reduction criteria. Other resolutions are as follows: (a) the joint coupling scheme should be joint-based rather than finger-based and (b) hand designs may need to include finger abduction/adduction movements.

Muscle Synergy Analysis of a Hand-Grasp Dataset: A Limited Subset of Motor Modules May Underlie a Large Variety of Grasps

Background: Kinematic and muscle patterns underlying hand grasps have been widely investigated in the literature. However, the identification of a reduced set of motor modules, generalizing across subjects and grasps, may be valuable for increasing the knowledge of hand motor control, and provide methods to be exploited in prosthesis control and hand rehabilitation.

Methods: Motor muscle synergies were extracted from a publicly available database including 28 subjects, executing 20 hand grasps selected for daily-life activities. The spatial synergies and temporal components were analyzed with a clustering algorithm to characterize the patterns underlying hand-grasps.

Results: Motor synergies were successfully extracted on all 28 subjects. Clustering orders ranging from 2 to 50 were tested. A subset of ten clusters, each one represented by a spatial motor module, approximates the original dataset with a mean maximum error of 5% on reconstructed modules; however, each spatial synergy might be employed with different timing and recruited at different grasp stages. Two temporal activation patterns are often recognized, corresponding to the grasp/hold phase, and to the pre-shaping and release phase.

Conclusions: This paper presents one of the biggest analysis of muscle synergies of hand grasps currently available. The results of 28 subjects performing 20 different grasps suggest that a limited number of time dependent motor modules (shared among subjects), correctly elicited by a control activation signal, may underlie the execution of a large variety of hand grasps. However, spatial synergies are not strongly related to specific motor functions but may be recruited at different stages, depending on subject and grasp. This result can lead to applications in rehabilitation and assistive robotics.

Bimanual coordination: A missing piece of arm rehabilitation after stroke

Inability to use the arm in daily actions significantly lowers quality of life after stroke. Most contemporary post-stroke arm rehabilitation strategies that aspire to re-engage the weaker arm in functional activities have been greatly limited in their effectiveness. Most actions of daily life engage the two arms in a highly coordinated manner. In contrast, most rehabilitation approaches predominantly focus on restitution of the impairments and unilateral practice of the weaker hand alone. We present a perspective that this misalignment between real world requirements and intervention strategies may limit the transfer of unimanual capability to spontaneous arm use and functional recovery. We propose that if improving spontaneous engagement and use of the weaker arm in real life is the goal, arm rehabilitation research and treatment need to address the coordinated interaction between arms in targeted theory-guided interventions. Current narrow focus on unimanual deficits alone, difficulty in quantifying bimanual coordination in real-world actions and limited theory-guided focus on control and remediation of different coordination modes are some of the biggest obstacles to successful implementation of effective interventions to improve bimanual coordination in the real world. We present a theory-guided taxonomy of bimanual actions that will facilitate quantification of coordination for different real-world tasks and provide treatment targets for addressing coordination deficits. We then present evidence in the literature that points to bimanual coordination deficits in stroke survivors and demonstrate how current rehabilitation approaches are limited in their impact on bimanual coordination. Importantly, we suggest theory-based areas of future investigation that may assist quantification, identification of neural mechanisms and scientifically-based training/remediation approaches for bimanual coordination deficits post-stroke. Advancing the science and practice of arm rehabilitation to incorporate bimanual coordination will lead to a more complete functional recovery of the weaker arm, thus improving the effectiveness of rehabilitation interventions and augmenting quality of life after stroke.

Analysis of Hand and Wrist Postural Synergies in Tolerance Grasping of Various Objects

Human can successfully grasp various objects in different acceptable relative positions between human hand and objects. This grasp functionality can be described as the grasp tolerance of human hand, which is a significant functionality of human grasp. To understand the motor control of human hand completely, an analysis of hand and wrist postural synergies in tolerance grasping of various objects is needed. Ten healthy right-handed subjects were asked to perform the tolerance grasping with right hand using 6 objects of different shapes, sizes and relative positions between human hand and objects. Subjects were wearing CyberGlove attaching motion tracker on right hand, allowing a measurement of the hand and wrist postures. Correlation analysis of joints and inter-joint/inter-finger modules were carried on to explore the coordination between joints or modules. As the correlation between hand and wrist module is not obvious in tolerance grasping, individual analysis of wrist synergies would be more practical. In this case, postural synergies of hand and wrist were then presented separately through principal component analysis (PCA), expressed through the principal component (PC) information transmitted ratio, PC elements distribution and reconstructed angle error of joints. Results on correlation comparison of different module movements can be well explained by the influence factors of the joint movement correlation. Moreover, correlation analysis of joints and modules showed the wrist module had the lowest correlation among all inter-finger and inter-joint modules. Hand and wrist postures were both sufficient to be described by a few principal components. In terms of the PC elements distribution of hand postures, compared with previous investigations, there was a greater proportion of movement in the thumb joints especially the interphalangeal (IP) and opposition rotation (ROT) joint. The research could serve to a complete understanding of hand grasp, and the design, control of the anthropomorphic hand and wrist.

Decoding of human hand actions to handle missing limbs in neuroprosthetics

The only way we can interact with the world is through movements, and our primary interactions are via the hands, thus any loss of hand function has immediate impact on our quality of life. However, to date it has not been systematically assessed how coordination in the hand's joints affects every day actions. This is important for two fundamental reasons. Firstly, to understand the representations and computations underlying motor control "in-the-wild" situations, and secondly to develop smarter controllers for prosthetic hands that have the same functionality as natural limbs. In this work we exploit the correlation structure of our hand and finger movements in daily-life. The novelty of our idea is that instead of averaging variability out, we take the view that the structure of variability may contain valuable information about the task being performed. We asked seven subjects to interact in 17 daily-life situations, and quantified behavior in a principled manner using CyberGlove body sensor networks that, after accurate calibration, track all major joints of the hand. Our key findings are: (1) We confirmed that hand control in daily-life tasks is very low-dimensional, with four to five dimensions being sufficient to explain 80-90% of the variability in the natural movement data. (2) We established a universally applicable measure of manipulative complexity that allowed us to measure and compare limb movements across tasks. We used Bayesian latent variable models to model the low-dimensional structure of finger joint angles in natural actions. (3) This allowed us to build a naïve classifier that within the first 1000 ms of action initiation (from a flat hand start configuration) predicted which of the 17 actions was going to be executed-enabling us to reliably predict the action intention from very short-time-scale initial data, further revealing the foreseeable nature of hand movements for control of neuroprosthetics and tele operation purposes. (4) Using the Expectation-Maximization algorithm on our latent variable model permitted us to reconstruct with high accuracy (<5-6° MAE) the movement trajectory of missing fingers by simply tracking the remaining fingers. Overall, our results suggest the hypothesis that specific hand actions are orchestrated by the brain in such a way that in the natural tasks of daily-life there is sufficient redundancy and predictability to be directly exploitable for neuroprosthetics.