A low-cost instrumented glove for monitoring forces during object manipulation

Effect of extension of the ulnar fingers on force control and muscle activity of the hand during a precision pinch

Some individuals extend the three ulnar fingers when performing a precision pinch. The aim of the present study was to investigate the mechanisms and effect of the extension of the ulnar fingers during a pinch. When performing a pulp pinch task with the ulnar fingers in two positions (extension and flexion), 27 participants maintained 5% of their maximum force. The mean pinch force, force variability and time taken to reach the targeted force (reaching time) were calculated. Muscle activity was simultaneously measured, using surface electromyography, for nine muscles: the flexor pollicis brevis; abductor pollicis brevis; flexor pollicis longus; first lumbrical; first dorsal interosseous; flexor digitorum superficialis of the index finger; extensor indicis; and extensor digitorum of the index and ring fingers. No significant differences in the mean pinch force or force variability were found. However, the reaching time was significantly shorter (approximately 20% reduction) in the extension position and the activities in the flexor pollicis brevis, first lumbrical, extensor indicis and extensor digitorum of the ring finger were significantly higher. These findings suggest that extending the ulnar fingers during pinching enhances the activity of key muscles involved in the movement and allows for more rapid force exertion.

Digitizing abdominal palpation with a pressure measurement and positioning device

An abdominal physical examination is one of the most important tools in evaluating patients with acute abdominal pain. We focused on palpation, in which assessment is made according to the patient’s response and force feedback. Since palpation is performed manually by the examiner, the uniformity of force and location is difficult to achieve during examinations. We propose an integrated system to quantify palpation pressure and location. A force sensor continuously collects pressure data, while a camera locates the precise position of contact. The system recorded, displayed average and maximum pressure by creating a pressure/time curve for computer-aided diagnosis. Compared with previous work on pressure sensors of quantifying abdominal palpation, our proposed system is the integrated approach to measure palpation force and track the corresponding position at the same time, for further diagnosis. In addition, we only make use of a sensing device and a general web camera, rather than commercial algometry and infrared cameras used in the previous work. Based on our clinical trials, the statistics of palpation pressure values and the corresponding findings are also reported. We performed abdominal palpation with our system for twenty-three healthy participants, including fourteen males and nine females. We applied two grades of force on the abdomen (light and deep) by four-quadrant and nine-region schemes, record the value of pressure and location. In the four-quadrant scheme, the average pressures of abdominal palpation with light and deep force levels were 0.506(N) and 0.552(N), respectively. In the nine-region scheme, the average pressures were 0.496(N) and 0.577(N), respectively. Two episodes of contact dermal reaction were identified. According to our experiment statistics, there is no significant difference in the force level between the four-quadrant and nine-region scheme. Our results have the potential to be used as a reference guide while designing digital abdominal palpation devices.

Statistical Prediction of Hand Force Exertion Levels in a Simulated Push Task using Posture Kinematics

This study explored the use of body posture kinematics derived from wearable inertial sensors to estimate force exertion levels in a two-handed isometric pushing and pulling task. A prediction model was developed grounded on the hypothesis that body postures predictably change depending on the magnitude of the exerted force. Five body postural angles, viz., torso flexion, pelvis flexion, lumbar flexion, hip flexion, and upper arm inclination, collected from 15 male participants performing simulated isometric pushing and pulling tasks in the laboratory were used as predictor variables in a statistical model to estimate handle height (shoulder vs. hip) and force intensity level (low vs. high). Individual anthropometric and strength measurements were also included as predictors. A Random Forest algorithm implemented in a two-stage hierarchy correctly classified 77.2% of the handle height and force intensity levels. Results represent early work in coupling unobtrusive, wearable instrumentation with statistical learning techniques to model occupational activities and exposures to biomechanical risk factors in situ.

Development of a disposable force-sensing glove for clinicians and demonstration of its force measurements on patients during rehabilitation following anterior cruciate ligament reconstruction surgery

For many clinicians, their effectiveness is dependent on the magnitude of forces they manually apply to their patients. However, current state-of-the-art care strategies lack quantitative feedback, making it difficult to provide consistent care over time and among multiple clinicians. To provide real-time quantitative feedback to clinicians, we have developed a disposable glove with a force sensor embedded in the fingertips or palm. The sensor is based on the fiber-optic bendloss effect whereby light intensity from an infrared source is attenuated as the fiber is bent between a series of corrugated teeth. The sensor fabricated has a very low profile (10×7×1  mm) and has demonstrated high sensitivity, accuracy, range, and durability. Force feedback up to 90 N with an average force threshold at 0.19 N and average sensor resolution at 0.05 N has been demonstrated. A preliminary clinical study has also been conducted with anterior cruciate ligament reconstruction patients who show significant range of motion improvement when treated with the force-sensing glove.

Optimizing Fingernail Imaging Calibration for 3D Force Magnitude Prediction

This paper discusses the optimization of a fingernail imaging system for predicting fingerpad force. The effects of lighting coloration, calibration grid, and force prediction model on the registration process and force prediction accuracy of fingernail imaging are investigated. White and green LEDs are found to produce statistically similar effects on registration error and force prediction results across all three directions of force. Two calibration grids are implemented, with no statistically significant difference in either registration or force prediction between the Cartesian and cylindrical grid designs. Of the five force prediction models investigated, a principal component regression model based on the pixel intensity eigenvectors estimates the force with the greatest accuracy. This EigenNail Magnitude Model simultaneously estimates force in all three directions with RMS error with 95 percent confidence interval of 0.55 ± 0.02 N (7.6 percent of the full force range). These results indicate a set of optimal parameter choices for the calibration of a fingernail imaging system.

Command and control interfaces for advanced neuroprosthetic applications

Command and control interfaces permit the intention and situation of the user to influence the operation of the neural prosthesis. The wishes of the user are communicated via command interfaces to the neural prosthesis and the situation of the user by feedback control interfaces. Both these interfaces have been reviewed separately and are discussed in light of the current state of the art and projections for the future. It is apparent that as system functional complexity increases, the need for simpler command interfaces will increase. Such systems will demand more information to function effectively in order not to unreasonably increase user attention overhead. This will increase the need for bioelectric and biomechanical signals in a comprehensible form via elegant feedback control interfaces. Implementing such systems will also increase the computational demand on such neural prostheses.

Vibrotactile feedback aids EMG control of object manipulation

We have previously shown that augmentative vibrotactile feedback can improve performance of a virtual object manipulation task using the finger. Here we studied the effects of vibrotactile feedback using instead electromyographic (EMG) control of object manipulation in N=6 healthy participants. Results showed that users were able to increase performance on an object manipulation task via EMG control when given augmentative vibrotactile feedback. Performance showed a strong effect of learning, which indicates further promise for utilization of this method in prosthetic hand users.

A new method of accurate hand- and arm-tracking for small primates

The investigation of grasping movements in cortical motor areas depends heavily on the measurement of hand kinematics. Currently used methods for small primates need either a large number of sensors or provide insufficient accuracy. Here, we present both a novel glove based on electromagnetic tracking sensors that can operate at a rate of 100 Hz and a new modeling method that allows to monitor 27 degrees of freedom (DOF) of the hand and arm using only seven sensors. A rhesus macaque was trained to wear the glove while performing precision and power grips during a delayed grasping task in the dark without noticeable hindrance. During five recording sessions all 27 joint angles and their positions could be tracked reliably. Furthermore, the field generator did not interfere with electrophysiological recordings below 1 kHz and did not affect single-cell separation. Measurements with the glove proved to be accurate during static and dynamic testing (mean absolute error below 2° and 3°, respectively). This makes the glove a suitable solution for characterizing electrophysiological signals with respect to hand grasping and in particular for brain-machine interface applications.

Repeated training with augmentative vibrotactile feedback increases object manipulation performance

Most users of prosthetic hands must rely on visual feedback alone, which requires visual attention and cognitive resources. Providing haptic feedback of variables relevant to manipulation, such as contact force, may thus improve the usability of prosthetic hands for tasks of daily living. Vibrotactile stimulation was explored as a feedback modality in ten unimpaired participants across eight sessions in a two-week period. Participants used their right index finger to perform a virtual object manipulation task with both visual and augmentative vibrotactile feedback related to force. Through repeated training, participants were able to learn to use the vibrotactile feedback to significantly improve object manipulation. Removal of vibrotactile feedback in session 8 significantly reduced task performance. These results suggest that vibrotactile feedback paired with training may enhance the manipulation ability of prosthetic hand users without the need for more invasive strategies.

Design of a lightweight, cost effective thimble-like sensor for haptic applications based on contact force sensors

This paper describes the design and calibration of a thimble that measures the forces applied by a user during manipulation of virtual and real objects. Haptic devices benefit from force measurement capabilities at their end-point. However, the heavy weight and cost of force sensors prevent their widespread incorporation in these applications. The design of a lightweight, user-adaptable, and cost-effective thimble with four contact force sensors is described in this paper. The sensors are calibrated before being placed in the thimble to provide normal and tangential forces. Normal forces are exerted directly by the fingertip and thus can be properly measured. Tangential forces are estimated by sensors strategically placed in the thimble sides. Two applications are provided in order to facilitate an evaluation of sensorized thimble performance. These applications focus on: (i) force signal edge detection, which determines task segmentation of virtual object manipulation, and (ii) the development of complex object manipulation models, wherein the mechanical features of a real object are obtained and these features are then reproduced for training by means of virtual object manipulation.

Vibrotactile sensory substitution for object manipulation: amplitude versus pulse train frequency modulation

Incorporating sensory feedback with prosthetic devices is now possible, but the optimal methods of providing such feedback are still unknown. The relative utility of amplitude and pulse train frequency modulated stimulation paradigms for providing vibrotactile feedback for object manipulation was assessed in 10 participants. The two approaches were studied during virtual object manipulation using a robotic interface as a function of presentation order and a simultaneous cognitive load. Despite the potential pragmatic benefits associated with pulse train frequency modulated vibrotactile stimulation, comparison of the approach with amplitude modulation indicates that amplitude modulation vibrotactile stimulation provides superior feedback for object manipulation.

Object manipulation improvements due to single session training outweigh the differences among stimulation sites during vibrotactile feedback

Most hand prostheses do not provide intentional haptic feedback about movement performance; thus users must rely almost completely on visual feedback. This paper focuses on understanding the effects of learning and different stimulation sites when vibrotactile stimulation is used as the intentional haptic feedback. Eighteen unimpaired individuals participated in this study with a robotic interface to manipulate a virtual object with visual and vibrotactile feedback at four body sites (finger, arm, neck, and foot) presented in a random order. All participants showed improvements in object manipulation performance with the addition of vibrotactile feedback. Specifically, performance showed a strong learning effect across time, with learning transferring across different sites of vibrotactile stimulation. The effects of learning over the experiment overshadowed the effects of different stimulation sites. The addition of a cognitive task slowed participants and increased the subjective difficulty. User preference ratings showed no difference in their preference among vibrotactile stimulation sites. These findings indicate that the stimulation site may not be as critical as ensuring adequate training with vibrotactile feedback during object manipulation. Future research to identify improvements in vibrotactile-based feedback parameters with amputees is warranted.

Detailed study of amplitude nonlinearity in piezoresistive force sensors

This article upgrades the RC linear model presented for piezoresistive force sensors. Amplitude nonlinearity is found in sensor conductance, and a characteristic equation is formulated for modeling its response under DC-driving voltages below 1 V. The feasibility of such equation is tested on four FlexiForce model A201-100 piezoresistive sensors by varying the sourcing voltage and the applied forces. Since the characteristic equation proves to be valid, a method is presented for obtaining a specific sensitivity in sensor response by calculating the appropriate sourcing voltage and feedback resistor in the driving circuit; this provides plug-and-play capabilities to the device and reduces the start-up time of new applications where piezoresistive devices are to be used. Finally, a method for bypassing the amplitude nonlinearity is presented with the aim of reading sensor capacitance.

Distribution of grip force in three different functional prehension patterns

Normative data of the grip force distribution necessary to complete functional tasks are limited. Small force sensors have been specially designed for accurate measurement of the dynamic handgrip force distribution by attaching them to the palmar surface of the hand. Seventeen healthy participants performed three different tasks, each requiring a different functional prehension pattern. When cylindrical objects were manipulated, the highest average grip forces were found at the fingertips and the thumb, followed by the middle finger. In a spherical grasp pattern, the contributions by the thumb, ring and small fingers always exceeded 71% of the total grip force. The highest local forces of 9.9 N were measured when a zip was closed with a tip pinch. Individual finger forces were found to differ by gender, but not by hand dimension and age. The results are useful for biomechanical modelling of the hand, for designing ergonomic tool grips, and for evaluating hand function.

A technique for conditioning and calibrating force-sensing resistors for repeatable and reliable measurement of compressive force

Miniature sensors that could measure forces applied by the fingers and hand without interfering with manual dexterity or range of motion would have considerable practical value in ergonomics and rehabilitation. In this study, techniques have been developed to use inexpensive pressure-sensing resistors (FSRs) to accurately measure compression force. The FSRs are converted from pressure-sensing to force-sensing devices. The effects of nonlinear response properties and dependence on loading history are compensated by signal conditioning and calibration. A fourth-order polynomial relating the applied force to the current voltage output and a linearly weighted sum of prior outputs corrects for sensor hysteresis and drift. It was found that prolonged (>20h) shear force loading caused sensor gain to change by approximately 100%. Shear loading also had the effect of eliminating shear force effects on sensor output, albeit only in the direction of shear loading. By applying prolonged shear loading in two orthogonal directions, the sensors were converted into pure compression sensors. Such preloading of the sensor is, therefore, required prior to calibration. The error in compression force after prolonged shear loading and calibration was consistently <5% from 0 to 30N and <10% from 30 to 40N. This novel method of calibrating FSRs for measuring compression force provides an inexpensive tool for biomedical and industrial design applications where measurements of finger and hand force are needed.

A low cost grip transducer based instrument to quantify fingertip touch force

In this paper, a transducer based instrument for fingertip touch force is developed. As a diagnostic tool, the system was coupled with an EMG analog signal processor, which is considered as the main basis of evaluation for motor function impairment. A software program is developed to analyze EMG signal during fingertips effort to obtain valid characteristic parameters with spectral analysis. These parameters are associated with a low cost grip transducer based on Hall Effect component developed for the improvement of fingertip movement during holding objects or training exercises. Thus, the changes on each sensor signal can be detected and monitored with the software interface. The output signal and the EMG analog processor are feeding a high resolution data acquisition system of National Instrument. Preliminary experimental tests have been carried out for the fingertip force grasping according to the Adductor Pollicis muscle (AdP) for controlling the adductive motion of the thumb. The experimental results show that the changes of dynamic fingertip force affect the muscle.

Measurement system for gesture characterization during chest physiotherapy act on newborn babies suffering from bronchiolitis

Despite the lack of studies, chest physiotherapy (CPT) is widely used for newborn babies suffering from bronchiolitis. The limited data regarding this technique is mainly due to the difficulties making in situ measurements during the act. In the presented study, original instrumented gloves were designed and realized to perform measurements on babies during the CPT act. Custom-designed associated electronics and software were specially developed to monitor and record the forces applied by the physiotherapist's hands on the infant's chest and their trajectories. A prospective study, with babies in real situation, validates the principle measurement. Measurements with the system was led on babies in a referent physiotherapist consulting room between January and March 2007. The results are being analyzed and typical phases of the CPT act are highlighted.

A low cost instrumented glove for extended monitoring and functional hand assessment

A wearable finger flexion monitor developed to measure hand function in individuals with hand dysfunction was evaluated for feasibility, measurement repeatability and reliability, fidelity of wireless transmission, and user acceptance. Configuration of the monitor allows use in situations when a traditional measurement glove cannot be worn. Five healthy individuals participated in the study of repeatability, while 10 healthy individuals and 10 individuals with acquired brain injury participated in trials to assess feasibility and user comfort. Repeatability results showed an overall error of 3.4 degrees , compared to 5.5 degrees and 5.7 degrees reported with other sensor gloves, and to manual measurements (5-8 degrees). Intraclass coefficient of reliability (using coefficient alpha) averaged 0.95. User feedback regarding comfort of the monitor was very high. Loss of data during wireless transmission was no greater than 1.2%. Results demonstrate that the monitor has a strong potential to be used as a tool for objective hand function evaluation in the home and community for both short- and long-term monitoring.

A sensorized thumb for force closed-loop control of hand neuroprostheses

In this paper, we presented a sensorized thumb based on a matrix of piezoresistive force sensors, with an acquisition unit and a special wearing support. The sensor was calibrated and then the device was tested during different tasks simulating activities of daily living performed by seven able-bodied subjects. By means of these experiments, we verified that the device proposed can be used to extract force information during grasp. In fact, the device was able to provide useful force information in the 98% of the trials with a good repeatability during all the different conditions. Moreover, we evaluated the patterns obtained during the different grasping tasks. The palmar grasps were performed in a similar manner, whereas the lateral pinch and the spherical volar grip were more different. This device can provide force information with good performance and acceptability and it can be used for force closed-loop control of hand neuroprostheses.

A. Estimulação elétrica neuromuscular e estimulação eletrotáctil na restauração artificial da preensão e da propriocepção em tetraplégicos

Esse trabalho discute o uso da estimulação elétrica na reabilitação sensoriomotora de membros superiores paralisados. A restauração da função motora de preensão foi obtida pela aplicação da estimulação elétrica neuromuscular, em seqüências de ativação adequadas a realização de atividades do cotidiano como comer, beber, escrever e digitar. Uma luva instrumentalizada com sensores de força possibilitou quantificar o padrão de movimento exercido artificialmente. Esse sistema foi utilizado como alça de realimentação para a restauração de uma propriocepção através da aplicação da estimulação eletrotáctil, possibilitando a evocação de sensações tácteis codificadas, relacionadas ao movimento artificial. A integração sensoriomotora se deu pela aplicação simultânea dos sistemas desenvolvidos, possibilitando desde a restauração de padrões funcionais de preensão, até o reconhecimento do padrão de movimento exercido através das sensações evocadas artificialmente.

Artificial sensorimotor integration in spinal cord injured subjects through neuromuscular and electrotactile stimulation

Spinal cord injured (SCI) subjects lack sensorimotor functions. Neuromuscular electrical stimulation (NMES) systems have been used to artificially restore motor functions, but without proprioceptive feedback, SCI subjects can control NMES systems only when they can see their limbs. In a gait restoration system, the subject looks down to the ground to be aware of where his foot is while in a grasping activity, maximum grip strength is employed regardless of the force that is required to perform tasks. This report focuses on artificial sensorimotor integration. Multichannel stimulation was used to restore motor functions while encoded tactile sensation (moving fused phantom images) relating to artificially generated movements was provided by electrotactile stimulation during walking and grasping activities. The results showed that the sensorimotor integration attained yielded both the recognition of artificial grasp force patterns and a technique to be used by paraplegics allowing spatial awareness of their limb while walking.

Effectiveness of supplemental grasp-force feedback in the presence of vision

Previous studies have shown that supplemental grasp-force feedback can improve control for users of a hand prosthesis or neuroprosthesis under conditions where vision provides little force information. Visual cues of force are widely available in everyday use, however, and may obviate the utility of supplemental force information. The purpose of the present study was to use a video-based hand neuroprosthesis simulator to determine whether grasp-force feedback can improve control in the presence of realistic visual information. Seven able-bodied subjects used the simulator to complete a simple grasp-and-hold task while controlling and viewing pre-recorded, digitised video clips of a neuroprosthesis user's hand squeezing a compliant object. The task was performed with and without supplemental force feedback presented via electrocutaneous stimulation. Subjects had to achieve and maintain the (simulated) grasp force within a target window of variable size (+/- 10-40% of full scale). Force feedback improved the success rate significantly for all target window sizes (8-16%, on average), and improved the success rate at all window sizes for six of the seven subjects. Overall, the improvement was equivalent functionally to a 35% increase in the window size. Feedback also allowed subjects to identify the direction of grasp errors more accurately, on average by 10-15%. In some cases, feedback improved the failure identification rate even if success rates were unchanged. It is thus concluded that supplemental grasp-force feedback can improve grasp control even with access to rich visual information from the hand and object.

An artificial grasping evaluation system for the paralysed hand

Neuromuscular electrical stimulation (NMES) has been used in upper limb rehabilitation towards restoring motor hand function. Quantitative evaluation of the artificially generated movement is necessary to achieve proper muscle activation. Custom-made gloves instrumented with force and position transducers were used to evaluate artificial quadriplegic grasping for a drinking activity. In spite of different sensor position, stimulation parameter dependence and lack of repeatability, grasp patterns achieved with the application of NMES follow the same patterns previously obtained with normal subjects, regarding force distribution among fingers and the shape of force curves. Larger forces were exerted by the thumb (average ranged from 2.8 to 4.5 N) following by index or long finger (average ranged from 1.8 to 3 N). The forces exerted ranged within the same interval as those previously measured and were sufficient to grasp an object of 10 N. Finger position achieved by interphalangeal joint status indicated the opening size of the hand throughout the range of movement. The instrumented gloves offer an alternative force and position feedback system for use in cylindrical grasp evaluation. The gloves can be used in a closed-loop control system, allowing on-line adjustment or in a clinical application to evaluate the results of a rehabilitation programme.