Soft Exoskeleton Glove with Human Anatomical Architecture: Production of Dexterous Finger Movements and Skillful Piano Performance

Surmounting the ceiling effect of motor expertise by novel sensory experience with a hand exoskeleton

For trained individuals such as athletes and musicians, learning often plateaus after extensive training, known as the "ceiling effect." One bottleneck to overcome it is having no prior physical experience with the skill to be learned. Here, we challenge this issue by exposing expert pianists to fast and complex finger movements that cannot be performed voluntarily, using a hand exoskeleton robot that can move individual fingers quickly and independently. Although the skill of moving the fingers quickly plateaued through weeks of piano practice, passive exposure to otherwise impossible complex finger movements generated by the exoskeleton robot at a speed faster than the pianists' fastest one enabled them to play faster. Neither a training for fast but simple finger movements nor one for slow but complex movements with the exoskeleton enhanced the overtrained motor skill. The exoskeleton training with one hand also improved the motor skill of the untrained contralateral hand, demonstrating the intermanual transfer effect. The training altered patterns of coordinated activities across multiple finger muscles during piano playing but not in general motor and somatosensory functions or in anatomical characteristics of the hand (range of motion). Patterns of the multifinger movements evoked by transcranial magnetic stimulation over the left motor cortex were also changed through passive exposure to fast and complex finger movements, which accompanied increased involvement of constituent movement elements characterizing the individuated finger movements. The results demonstrate evidence that somatosensory exposure to an unexperienced motor skill allows surmounting of the ceiling effect in a task-specific but effector-independent manner.

Design of a Wearable Exoskeleton Piano Practice Aid Based on Multi-Domain Mapping and Top-Down Process Model

This study designs and develops a wearable exoskeleton piano assistance system for individuals recovering from neurological injuries, aiming to help users regain the ability to perform complex tasks such as playing the piano. While soft robotic exoskeletons have proven effective in rehabilitation therapy and daily activity assistance, challenges remain in performing highly dexterous tasks due to structural complexity and insufficient motion accuracy. To address these issues, we developed a modular division method based on multi-domain mapping and a top-down process model. This method integrates the functional domain, structural domain, and user needs domain, and explores the principles and methods for creating functional construction modules, overcoming the limitations of traditional top-down approaches in design flexibility. By closely combining layout constraints with the design model, this method significantly improves the accuracy and efficiency of module configuration, offering a new path for the development of piano practice assistance devices. The results demonstrate that this device innovatively combines piano practice with rehabilitation training and through the introduction of ontological modeling methods, resolves the challenges of multidimensional needs mapping. Based on five user requirements (P), we calculated the corresponding demand weight (K), making the design more aligned with user needs. The device excels in enhancing motion accuracy, interactivity, and comfort, filling the gap in traditional piano assistance devices in terms of multi-functionality and high adaptability, and offering new ideas for the design and promotion of intelligent assistive devices. Simulation analysis, combined with the motion trajectory of the finger's proximal joint, calculates that 60° is the maximum bending angle for the aforementioned joint. Physical validation confirms the device's superior performance in terms of reliability and high-precision motion reproduction, meeting the requirements for piano-assisted training. Through multi-domain mapping, the top-down process model, and modular design, this research effectively breaks through the design flexibility and functional adaptability bottleneck of traditional piano assistance devices while integrating neurological rehabilitation with music education, opening up a new application path for intelligent assistive devices in the fields of rehabilitation medicine and arts education, and providing a solution for cross-disciplinary technology fusion and innovative development.

Design and Verification of Piano Playing Assisted Hand Exoskeleton Robot

Finger technique is a crucial aspect of piano learning, and hand exoskeleton mechanisms effectively assist novice piano players in maintaining correct finger technique consistently. Addressing current issues with exoskeleton robots, such as the inability to provide continuous correction of finger technique and their considerable weight, a novel hand exoskeleton robot has been developed to enhance finger technique through continuous correction and reduced weight. Initial data are gathered using finger joint angle sensors to analyze movements during piano playing, focusing on the trajectory and angular velocity of key strikes. This analysis informs the design of a 6-bar double-closed-loop mechanism with an end equivalent sliding pair, using analytical methods to establish the relationship between motor extension and input rod rotation. Simulation studies assess the exoskeleton's motion space and dynamics, confirming its capability to meet structural and functional demands for accurate key striking. Prototype testing validates the exoskeleton's ability to maintain correct finger positioning and mimic natural strike speeds, thus improving playing technique while ensuring comfort and safety.

Design and Control of a Tendon-Driven Robotic Finger Based on Grasping Task Analysis

To analyze the structural characteristics of a human hand, data collection gloves were worn for typical grasping tasks. The hand manipulation characteristics, finger end pressure, and finger joint bending angle were obtained via an experiment based on the Feix grasping spectrum. Twelve types of tendon rope transmission paths were designed under the N + 1 type tendon drive mode, and the motion performance of these 12 types of paths applied to tendon-driven fingers was evaluated based on the evaluation metric. The experiment shows that the designed tendon path (d) has a good control effect on the fluctuations of tendon tension (within 0.25 N), the tendon path (e) has the best control effect on the joint angle of the tendon-driven finger, and the tendon path (l) has the best effect on reducing the friction between the tendon and the pulley. The obtained tendon-driven finger motion performance model based on 12 types of tendon paths is a good reference value for subsequent tendon-driven finger structure design and control strategies.

Rotational Motion Due to Skin Shear Deformation at Wrist and Elbow

The hanger reflex is an illusion phenomenon that induces strong force perception and rotational motion, and it occurs in multiple parts of the body. A potential application of this phenomenon is in upper limb rehabilitation for patients with upper-limb paralysis involving arm rotation. However, the only upper limb movements that have been confirmed in this phenomenon are the inward and outward movements of the wrist, which limits the applicable tasks. Therefore, we attempted to apply the hanger reflex to the elbow and use it simultaneously with the wrist. This phenomenon occurs due to shear deformation of the skin, so shear deformation was presented to the skin on the elbow. When shear deformation of the skin was presented to the elbow in the same manner as in previous studies applied to the wrist, movement and force perception of pronation and supination of the elbow were confirmed. The results of an experiment in which the hanger reflex was simultaneously presented to the elbow and wrist showed that each region independently perceived motion and force.

Feeling the beat: a smart hand exoskeleton for learning to play musical instruments

Individuals who have suffered neurotrauma like a stroke or brachial plexus injury often experience reduced limb functionality. Soft robotic exoskeletons have been successful in assisting rehabilitative treatment and improving activities of daily life but restoring dexterity for tasks such as playing musical instruments has proven challenging. This research presents a soft robotic hand exoskeleton coupled with machine learning algorithms to aid in relearning how to play the piano by 'feeling' the difference between correct and incorrect versions of the same song. The exoskeleton features piezoresistive sensor arrays with 16 taxels integrated into each fingertip. The hand exoskeleton was created as a single unit, with polyvinyl acid (PVA) used as a stent and later dissolved to construct the internal pressure chambers for the five individually actuated digits. Ten variations of a song were produced, one that was correct and nine containing rhythmic errors. To classify these song variations, Random Forest (RF), K-Nearest Neighbor (KNN), and Artificial Neural Network (ANN) algorithms were trained with data from the 80 taxels combined from the tactile sensors in the fingertips. Feeling the differences between correct and incorrect versions of the song was done with the exoskeleton independently and while the exoskeleton was worn by a person. Results demonstrated that the ANN algorithm had the highest classification accuracy of 97.13% ± 2.00% with the human subject and 94.60% ± 1.26% without. These findings highlight the potential of the smart exoskeleton to aid disabled individuals in relearning dexterous tasks like playing musical instruments.

A Critical Review on Factors Affecting the User Adoption of Wearable and Soft Robotics

In recent years, the advent of soft robotics has changed the landscape of wearable technologies. Soft robots are highly compliant and malleable, thus ensuring safe human-machine interactions. To date, a wide variety of actuation mechanisms have been studied and adopted into a multitude of soft wearables for use in clinical practice, such as assistive devices and rehabilitation modalities. Much research effort has been put into improving their technical performance and establishing the ideal indications for which rigid exoskeletons would play a limited role. However, despite having achieved many feats over the past decade, soft wearable technologies have not been extensively investigated from the perspective of user adoption. Most scholarly reviews of soft wearables have focused on the perspective of service providers such as developers, manufacturers, or clinicians, but few have scrutinized the factors affecting adoption and user experience. Hence, this would pose a good opportunity to gain insight into the current practice of soft robotics from a user's perspective. This review aims to provide a broad overview of the different types of soft wearables and identify the factors that hinder the adoption of soft robotics. In this paper, a systematic literature search using terms such as "soft", "robot", "wearable", and "exoskeleton" was conducted according to PRISMA guidelines to include peer-reviewed publications between 2012 and 2022. The soft robotics were classified according to their actuation mechanisms into motor-driven tendon cables, pneumatics, hydraulics, shape memory alloys, and polyvinyl chloride muscles, and their pros and cons were discussed. The identified factors affecting user adoption include design, availability of materials, durability, modeling and control, artificial intelligence augmentation, standardized evaluation criteria, public perception related to perceived utility, ease of use, and aesthetics. The critical areas for improvement and future research directions to increase adoption of soft wearables have also been highlighted.

Passive somatosensory training enhances piano skill in adolescent and adult pianists: A preliminary study

Sensory afferent information, such as auditory and somatosensory feedback while moving, plays a crucial role in both control and learning of motor performance across the lifespan. Music performance requires skillful integration of multimodal sensory information for the production of dexterous movements. However, it has not been understood what roles somatosensory afferent information plays in the acquisition and sophistication of specialized motor skills of musicians across different stages of development. In the present preliminary study, we addressed this issue by using a novel technique with a hand exoskeleton robot that can externally move the fingers of pianists. Short-term exposure to fast and complex finger movements generated by the exoskeleton (i.e., passive movements) increased the maximum rate of repetitive piano keystrokes by the pianists. This indicates that somatosensory inputs derived from the externally generated motions enhanced the quickness of the sequential finger movements in piano performance, even though the pianists did not voluntarily move the fingers. The enhancement of motor skill through passive somatosensory training using the exoskeleton was more pronounced in adolescent pianists than adult pianists. These preliminary results implicate a sensitive period of neuroplasticity of the somatosensory-motor system of trained pianists, which emphasizes the importance of somatosensory-motor training in professional music education during adolescence.

Self-Psychological Control and Creativity of Music Creation in Multimusic Environment

This study aimed to solve the difficulties in the research of self-psychology, three executive controls, and creativity in multimusic environment. In today's teaching and performance, the study of piano adaptation has practical significance in broadening artistic vision, improving performance technology, and training symphonic music thinking. A research method of self-psychological three executive controls and creativity generation for creation in multimusic environment is proposed. A computer composition algorithm is based on the hidden Markov model and interactive genetic algorithm. By integrating melody elements and rhythm into the traditional Markov model with only notes or rhythm as the unit, a new hidden Markov music prediction model is established, and the interactive genetic algorithm is used to optimize the music segments. Simulation results show that the algorithm can use a small dataset to quickly create music clips with certain melody logic and in line with users' personality. It is proved that the method based on the hidden Markov model and interactive genetic algorithm can meet the research needs of self-psychological three execution control and creativity generation in multimusic environment.

Design and experimental testing of a force-augmenting exoskeleton for the human hand

Background

Many older Americans suffer from long-term upper limb dysfunction, decreased grip strength, and/or a reduced ability to hold objects due to injuries and a variety of age-related illnesses. The objective of this study was to design and build a five-fingered powered assistive exoskeleton for the human hand, and to validate its ability to augment the gripping and pinching efforts of the wearer and assist in performing ADLs.

Methods

The exoskeleton device was designed using CAD software and 3-D printed in ABS. Each finger’s movement efforts were individually monitored by a force sensing resistor at each fingertip, and proportionally augmented via the microcontroller-based control scheme, linear actuators, and rigid exoskeleton structure. The force production of the device and the force augmenting capability were assessed on ten healthy individuals with one 5-digit grasping test, three pinching tests, and two functional tests.

Results

Use of the device significantly decreased the forearm muscle activity necessary to maintain a grasping effort (67%, p < 0.001), the larger of two pinching efforts (30%, p < 0.05), and the palmer pinching effort (67%, p < 0.001); however, no benefit by wearing the device was identified while maintaining a minimal pinching effort or attempting one of the functional tests.

Conclusion

The exoskeleton device allowed subjects to maintain independent control of each digit, and while wearing the exoskeleton, in both the unpowered and powered states, subjects were able to grasp, hold, and move objects such as a water bottle, bag, smartphone, or dry-erase marker.

Design of Wearable Hand Rehabilitation Glove With Bionic Fiber-Reinforced Actuator

Background: The hand motor function is lost and activities in daily life (ADLs) are affected due to some illnesses such as stroke and hemiplegia. As a coping way, we present a wearable rehabilitation glove with the bionic actuator for restoring the hand function and the motor control ability lost by stroke patients. Methods: The soft pneumatic bionic actuator (SPBA) is developed on the basis of the research of human hand bone structure and finger joint characteristics and a series of tests are conducted. Besides, we built the rehabilitation glove system based on the proposed SPBAs to verify the availability due to typical gesture, mirror therapy (MT) and grasping experiment for irregular objects. Result: The bending angle of SPBA can reach 260°. The output force of it can reach 5.1N with 0.25 MPa air pressure input. The maximum variance of the bending angle can be concluded at 5.1° in MT. The grasping experiments of the glove worn on the hand or not shows the proposed glove is flexible, the grip force is large and achieve stable grasping of objects. Conclusion: The designed SPBA is satisfied with the requirements of rehabilitation training and the proposed glove restore the normal hand motion of patients in ADLs.

Development and Usability Testing of a Finger Grip Enhancer for the Elderly

As people age, their finger function deteriorates due to muscle, nerve, and brain degeneration. While exercises might delay this deterioration, an invention that enhances elderly people’s pinching abilities is essential. This study aims to design and develop a finger grip enhancer that facilitates the day-to-day pinching activities of elderly people. This research is an extension of a previous study that conceptualised a finger grip enhancer. The device facilitates finger flexion on the thumb and index finger, and weighs 520 g, allowing for improved portability and sufficient force exertion (13.9 N) for day-to-day pinching. To test for usability, eleven subjects aged 65 years and above performed a pinch-lift-hold test on various household objects. The pinch force before and after utilising the device was measured. Using Minitab 18, the statistical significance of using this device was analysed with a paired-samples t-test. With this device, the elderly people’s pinching abilities significantly improved in both pinch force and pinch force steadiness (p < 0.05). The proposed device has the potential to enhance elderly people’s quality of life by supporting a firm pinch in the handling of everyday objects. This research has applicational value in developing exoskeleton devices for patients who require rehabilitation.

Control of Newly-Designed Wearable Robotic Hand Exoskeleton Based on Surface Electromyographic Signals

The human hand plays a role in a variety of daily activities. This intricate instrument is vulnerable to trauma or neuromuscular disorders. Wearable robotic exoskeletons are an advanced technology with the potential to remarkably promote the recovery of hand function. However, the still face persistent challenges in mechanical and functional integration, with real-time control of the multiactuators in accordance with the motion intentions of the user being a particular sticking point. In this study, we demonstrated a newly-designed wearable robotic hand exoskeleton with multijoints, more degrees of freedom (DOFs), and a larger range of motion (ROM). The exoskeleton hand comprises six linear actuators (two for the thumb and the other four for the fingers) and can realize both independent movements of each digit and coordinative movement involving multiple fingers for grasp and pinch. The kinematic parameters of the hand exoskeleton were analyzed by a motion capture system. The exoskeleton showed higher ROM of the proximal interphalangeal and distal interphalangeal joints compared with the other exoskeletons. Five classifiers including support vector machine (SVM), K-near neighbor (KNN), decision tree (DT), multilayer perceptron (MLP), and multichannel convolutional neural networks (multichannel CNN) were compared for the offline classification. The SVM and KNN had a higher accuracy than the others, reaching up to 99%. For the online classification, three out of the five subjects showed an accuracy of about 80%, and one subject showed an accuracy over 90%. These results suggest that the new wearable exoskeleton could facilitate hand rehabilitation for a larger ROM and higher dexterity and could be controlled according to the motion intention of the subjects.

Remote Actuation Systems for Fully Wearable Assistive Devices: Requirements, Selection, and Optimization for Out-of-the-Lab Application of a Hand Exoskeleton

Wearable robots assist individuals with sensorimotor impairment in daily life, or support industrial workers in physically demanding tasks. In such scenarios, low mass and compact design are crucial factors for device acceptance. Remote actuation systems (RAS) have emerged as a popular approach in wearable robots to reduce perceived weight and increase usability. Different RAS have been presented in the literature to accommodate for a wide range of applications and related design requirements. The push toward use of wearable robotics in out-of-the-lab applications in clinics, home environments, or industry created a shift in requirements for RAS. In this context, high durability, ergonomics, and simple maintenance gain in importance. However, these are only rarely considered and evaluated in research publications, despite being drivers for device abandonment by end-users. In this paper, we summarize existing approaches of RAS for wearable assistive technology in a literature review and compare advantages and disadvantages, focusing on specific evaluation criteria for out-of-the-lab applications to provide guidelines for the selection of RAS. Based on the gained insights, we present the development, optimization, and evaluation of a cable-based RAS for out-of-the-lab applications in a wearable assistive soft hand exoskeleton. The presented RAS features full wearability, high durability, high efficiency, and appealing design while fulfilling ergonomic criteria such as low mass and high wearing comfort. This work aims to support the transfer of RAS for wearable robotics from controlled lab environments to out-of-the-lab applications.