Spatial and temporal influences on discrimination of vibrotactile stimuli on the arm

Utility and Usability of Two Forms of Supplemental Vibrotactile Kinesthetic Feedback for Enhancing Movement Accuracy and Efficiency in Goal-Directed Reaching

Recent advances in wearable sensors and computing have made possible the development of novel sensory augmentation technologies that promise to enhance human motor performance and quality of life in a wide range of applications. We compared the objective utility and subjective user experience for two biologically inspired ways to encode movement-related information into supplemental feedback for the real-time control of goal-directed reaching in healthy, neurologically intact adults. One encoding scheme mimicked visual feedback encoding by converting real-time hand position in a Cartesian frame of reference into supplemental kinesthetic feedback provided by a vibrotactile display attached to the non-moving arm and hand. The other approach mimicked proprioceptive encoding by providing real-time arm joint angle information via the vibrotactile display. We found that both encoding schemes had objective utility in that after a brief training period, both forms of supplemental feedback promoted improved reach accuracy in the absence of concurrent visual feedback over performance levels achieved using proprioception alone. Cartesian encoding promoted greater reductions in target capture errors in the absence of visual feedback (Cartesian: 59% improvement; Joint Angle: 21% improvement). Accuracy gains promoted by both encoding schemes came at a cost in terms of temporal efficiency; target capture times were considerably longer (1.5 s longer) when reaching with supplemental kinesthetic feedback than without. Furthermore, neither encoding scheme yielded movements that were particularly smooth, although movements made with joint angle encoding were smoother than movements with Cartesian encoding. Participant responses on user experience surveys indicate that both encoding schemes were motivating and that both yielded passable user satisfaction scores. However, only Cartesian endpoint encoding was found to have passable usability; participants felt more competent using Cartesian encoding than joint angle encoding. These results are expected to inform future efforts to develop wearable technology to enhance the accuracy and efficiency of goal-directed actions using continuous supplemental kinesthetic feedback.

Extended training improves the accuracy and efficiency of goal-directed reaching guided by supplemental kinesthetic vibrotactile feedback

Prior studies have shown that the accuracy and efficiency of reaching can be improved using novel sensory interfaces to apply task-specific vibrotactile feedback (VTF) during movement. However, those studies have typically evaluated performance after less than 1 h of training using VTF. Here, we tested the effects of extended training using a specific form of vibrotactile cues-supplemental kinesthetic VTF-on the accuracy and temporal efficiency of goal-directed reaching. Healthy young adults performed planar reaching with VTF encoding of the moving hand's instantaneous position, applied to the non-moving arm. We compared target capture errors and movement times before, during, and after approximately 10 h (20 sessions) of training on the VTF-guided reaching task. Initial performance of VTF-guided reaching showed that people were able to use supplemental VTF to improve reaching accuracy. Performance improvements were retained from one training session to the next. After 20 sessions of training, the accuracy and temporal efficiency of VTF-guided reaching were equivalent to or better than reaches performed with only proprioception. However, hand paths during VTF-guided reaching exhibited a persistent strategy where movements were decomposed into discrete sub-movements along the cardinal axes of the VTF display. We also used a dual-task condition to assess the extent to which performance gains in VTF-guided reaching resist dual-task interference. Dual-tasking capability improved over the 20 sessions, such that the primary VTF-guided reaching and a secondary choice reaction time task were performed with increasing concurrency. Thus, VTF-guided reaching is a learnable skill in young adults, who can achieve levels of accuracy and temporal efficiency equaling or exceeding those observed during movements guided only by proprioception. Future studies are warranted to explore learnability in older adults and patients with proprioceptive deficits, who might benefit from using wearable sensory augmentation technologies to enhance control of arm movements.

Anisotropic distortion in the perceived direction of motion on the arm

Skin covers the entire body, and its thickness and distribution of mechanoreceptors vary markedly across body parts. It has been shown that the brain is not able to fully compensate for such anisotropy, and as a result, the representational space of touch differs depending on which parts the stimulus is applied to. Here, by contrasting the hand and arm, we investigated the difference in perceived motion. Using a large-area braille display, we were able to present precisely controlled touchable motion stimuli with randomizing stimulus trajectories and varying the size. We found a new perceptual illusion in which the motion direction of stimuli perceived on the arm is rotated regionally, or even flipped. In particular, obliquely moving stimuli that move toward the distal radial are perceived as move toward the proximal radial, and stimuli that move toward the proximal ulnar are perceived as move toward the distal ulnar. This illusion was not observed on the palm, regardless of compensation for the stimulus size. Current study adds a clear example of how presenting the same motion stimuli to different body parts results in a different perception, emphasizing that the perceived tactile space is not uniform and needs to be examined in detail.

Vibrotactile mapping of the upper extremity: Absolute perceived intensity is location-dependent; perception of relative changes is not

Vibrotactile sensation is an essential part of the sense of touch. In this study, the localized vibrotactile sensation of the arm-shoulder region was quantified in 10 able-bodied subjects. For this analysis, the six relevant dermatomes (C3-T2) and three segments—the lower arm, the upper arm, and the shoulder region were studied. For psychometric evaluation, tasks resulting in the quantification of sensation threshold, just noticeable difference, Weber fraction, and perception of dynamically changing vibrotactile stimuli were performed. We found that healthy subjects could reliably detect vibration in all tested regions at low amplitude (2–6% of the maximal amplitude of commonly used vibrotactors). The detection threshold was significantly lower in the lower arm than that in the shoulder, as well as ventral in comparison with the dorsal. There were no significant differences in Weber fraction (20%) detectable between the studied locations. A compensatory tracking task resulted in a significantly higher average rectified error in the shoulder than that in the upper arm, while delay and correlation coefficient showed no difference between the regions. Here, we presented a conclusive map of the vibrotactile sense of the healthy upper limb. These data give an overview of the sensory bandwidth that can be achieved with vibrotactile stimulation at the arm and may help in the design of vibrotactile feedback interfaces (displays) for the hand/arm/shoulder-region.

Continuous Transition Impairs Discrimination of Electrotactile Frequencies

Just-noticeable difference (JND), indicating the ability to accurately identify small differences in stimulation parameters, can be used to choose more sensitive stimulation methods as well as to calibrate tactile feedback in closed-loop human-machine interfacing. The JND is typically estimated using a forced-choice-discrimination task, in which two stimuli with different intensities are delivered separated by a brief pause. In the applications of tactile feedback, however, the stimulation parameters are typically modulated continuously. It is unclear if the discriminability of stimuli separated in time characterizes the ability to distinguish continuous changes in stimulation intensity. The present study compared the JND when pairs of frequency-modulated electrotactile stimuli were separated in time and presented continuously at two different baseline frequencies (20 and 60 Hz). The results showed that the JND was significantly smaller with time-separation between stimuli, but that the JND obtained with different types of transitions were in most cases linearly associated. In conclusion, the discriminability of time-separated stimuli is systematically better compared to that of the stimuli presented continuously. This can have an impact when calibrating the tactile feedback where the conventional method of the JND assessment might lead to an overly optimistic estimate of detectable changes.

Vibrotactile Perception for Sensorimotor Augmentation: Perceptual Discrimination of Vibrotactile Stimuli Induced by Low-Cost Eccentric Rotating Mass Motors at Different Body Locations in Young, Middle-Aged, and Older Adults

Sensory augmentation technologies are being developed to convey useful supplemental sensory cues to people in comfortable, unobtrusive ways for the purpose of improving the ongoing control of volitional movement. Low-cost vibration motors are strong contenders for providing supplemental cues intended to enhance or augment closed-loop feedback control of limb movements in patients with proprioceptive deficits, but who still retain the ability to generate movement. However, it remains unclear what form such cues should take and where on the body they may be applied to enhance the perception-cognition-action cycle implicit in closed-loop feedback control. As a step toward addressing this knowledge gap, we used low-cost, wearable technology to examine the perceptual acuity of vibrotactile stimulus intensity discrimination at several candidate sites on the body in a sample of participants spanning a wide age range. We also sought to determine the extent to which the acuity of vibrotactile discrimination can improve over several days of discrimination training. Healthy adults performed a series of 2-alternative forced choice experiments that quantified capability to perceive small differences in the intensity of stimuli provided by low-cost eccentric rotating mass vibration motors fixed at various body locations. In one set of experiments, we found that the acuity of intensity discrimination was poorer in older participants than in middle-aged and younger participants, and that stimuli applied to the torso were systematically harder to discriminate than stimuli applied to the forearm, knee, or shoulders, which all had similar acuities. In another set of experiments, we found that older adults could improve intensity discrimination over the course of 3 days of practice on that task such that their final performance did not differ significantly from that of younger adults. These findings may be useful for future development of wearable technologies intended to improve the control of movements through the application of supplemental vibrotactile cues.

Sensory substitution of elbow proprioception to improve myoelectric control of upper limb prosthesis: experiment on healthy subjects and amputees

BACKGROUND

Current myoelectric prostheses lack proprioceptive information and rely on vision for their control. Sensory substitution is increasingly developed with non-invasive vibrotactile or electrotactile feedback, but most systems are designed for grasping or object discriminations, and few were tested for online control in amputees. The objective of this work was evaluate the effect of a novel vibrotactile feedback on the accuracy of myoelectric control of a virtual elbow by healthy subjects and participants with an upper-limb amputation at humeral level.

METHODS

Sixteen, healthy participants and 7 transhumeral amputees performed myoelectric control of a virtual arm under different feedback conditions: vision alone (VIS), vibration alone (VIB), vision plus vibration (VIS + VIB), or no feedback at all (NO). Reach accuracy was evaluated by angular errors during discrete as well as back and forth movements. Healthy participants' workloads were assessed with the NASA-TLX questionnaire, and feedback conditions were ranked according to preference at the end of the experiment.

RESULTS

Reach errors were higher in NO than in VIB, indicating that our vibrotactile feedback improved performance as compared to no feedback. Conditions VIS and VIS+VIB display similar levels of performance and produced lower errors than in VIB. Vision remains therefore critical to maintain good performance, which is not ameliorated nor deteriorated by the addition of vibrotactile feedback. The workload associated with VIB was higher than for VIS and VIS+VIB, which did not differ from each other. 62.5% of healthy subjects preferred the VIS+VIB condition, and ranked VIS and VIB second and third, respectively.

CONCLUSION

Our novel vibrotactile feedback improved myoelectric control of a virtual elbow as compared to no feedback. Although vision remained critical, the addition of vibrotactile feedback did not improve nor deteriorate the control and was preferred by participants. Longer training should improve performances with VIB alone and reduce the need of vision for close-loop prosthesis control.

Electrotactile and Vibrotactile Feedback Enable Similar Performance in Psychometric Tests and Closed-Loop Control

Electro- and vibro-tactile stimulation are commonly employed for feedback in closed-loop human-machine interfacing. Although these feedback systems have been extensively investigated individually, they are rarely objectively compared. In this study, two state-of-the-art stimulation units (concentric electrode and C2-tactor) similar in shape and size were compared in psychometric and online control tests. The just noticeable difference and number of discriminable levels for intensity and frequency modulation were determined across values of carrier frequency and intensity, respectively. Next, subjects performed a compensatory tracking task, in which the feedback encoded the momentary tracking error. In the psychometric tests, intensity modulation outperformed frequency modulation and electrotactile stimulation enabled significantly higher resolution than vibrotactile stimulation, for the same carrier frequency. However, for the best-case settings (eletro-tactile: 100 Hz; vibro-tactile: 200 Hz), the two stimulation modalities were equivalent in the psychometric tests and in the online control tests, where the two stimulation methods resulted in similar correlation and deviation between the target and the generated trajectory. Time delay was slightly but significantly lower for the vibrotactile modality. Overall, the present assessment shows that despite psychometric differences between the two stimulation methods, they enable similar online control performance when parameters are optimally selected for each modality.

Tactile spatial discrimination on the torso using vibrotactile and force stimulation

There is a steadily growing number of mobile communication systems that provide spatially encoded tactile information to the humans' torso. However, the increased use of such hands-off displays is currently not matched with or supported by systematic perceptual characterization of tactile spatial discrimination on the torso. Furthermore, there are currently no data testing spatial discrimination for dynamic force stimuli applied to the torso. In the present study, we measured tactile point localization (LOC) and tactile direction discrimination (DIR) on the thoracic spine using two unisex torso-worn tactile vests realized with arrays of 3 × 3 vibrotactile or force feedback actuators. We aimed to, first, evaluate and compare the spatial discrimination of vibrotactile and force stimulations on the thoracic spine and, second, to investigate the relationship between the LOC and DIR results across stimulations. Thirty-four healthy participants performed both tasks with both vests. Tactile accuracies for vibrotactile and force stimulations were 60.7% and 54.6% for the LOC task; 71.0% and 67.7% for the DIR task, respectively. Performance correlated positively with both stimulations, although accuracies were higher for the vibrotactile than for the force stimulation across tasks, arguably due to specific properties of vibrotactile stimulations. We observed comparable directional anisotropies in the LOC results for both stimulations; however, anisotropies in the DIR task were only observed with vibrotactile stimulations. We discuss our findings with respect to tactile perception research as well as their implications for the design of high-resolution torso-mounted tactile displays for spatial cueing.

Anisotropic distortion in the perceived orientation of stimuli on the arm

Mechanoreceptors on the skin are heterogeneously distributed, and the sampling of neural signals in the brain can vary depending on the part of the body. Therefore, it can be challenging for the brain to consistently represent stimuli applied to different body sites. Here, we report an example of a regional perceptual distortion of the tactile space. We used a piezoelectric braille display to examine shape perception on the volar surface of the arm and to compare it to that on the palm. We found that the orientation of perceived stimuli on the arm was distorted in certain areas. In particular, an inwardly-inclined line shape was perceived as being more inwardly-inclined than it actually was. On the other hand, an outwardly-inclined line was perceived accurately. When the same stimuli were applied to the palm, this anisotropic bias was not observed. We also found that changing the posture of the arm changed the angle at which this anisotropic distortion occurred, suggesting the influence of the skin frame of reference on this illusion. This study showed a clear example of how the representation of even simple stimuli is complexly distinct when the stimuli are applied to different body sites.

Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment

In this article, we present a comprehensive scheme for the quality assessment of compressed vibrotactile signals with human assessors. Inspired by the multiple stimulus test with hidden reference and anchors (MUSHRA) from the audio domain, we designed a method in which each compressed signal is compared to its original signal and rated on a numerical scale. For each signal tested, the hidden reference and two anchor signals are used to validate the results and provide assessor screening criteria. Differing from previous approaches, our method is hierarchically structured and strictly timed in a sequential manner to avoid experimental confounds and provide precise psychophysical assessments. We validated our method in an experiment with 20 human participants in which we compared two state-of-the-art lossy codecs. The results show that, with our approach, the performance of different codecs can be compared effectively. Furthermore, the method also provides a measure of subjective quality at different data compression rates. The proposed procedure can be easily adapted to evaluate other vibrotactile codecs.

Module for Monitoring the Probe-Skin Contact Force in the Study of Vibration Perception on the Wrist

This paper presents a module for monitoring the contact force between a probe for measuring vibration perception on the wrist and the skin. The module was designed for an original measuring stand for the automatic testing of the vibrotactile discrimination thresholds using the psychophysical adaptive method of 1 up-2 down with two or three interval forced choices (2IFC, 3IFC). Measurement methods were implemented in LabVIEW software. The inspiration for the project was the need to check the possibility of building a vibrating interface for transmitting information through vibrations delivered to the wrist via a bracelet. The test procedure on the wrist is not standardized; however, during its development, the recommendations of the Polish Norm-International Organization for Standardization PN-ISO 13091-1, 2006 were adopted. This standard contains methods for measuring vibration sensation thresholds on the fingertips for the assessment of neural dysfunction. The key to the repeatability of measurements seems to be the ability to continuously control the pressure of the measuring probe on the skin. This article compares two solutions for measuring the contact force along with an analysis of their accuracy and the impact of vibrations on the measured values. Moreover, the results of measurements of vibrotactile amplitude and frequency discrimination thresholds obtained on the ventral wrist at five frequencies (25, 32, 63, 125 and 250 Hz) are presented.

Vibrotactile Feedback for Improving Standing Balance

Maintaining balance standing upright is an active process that complements the stabilizing properties of muscle stiffness with feedback control driven by independent sensory channels: proprioceptive, visual, and vestibular. Considering that the contribution of these channels is additive, we investigated to what extent providing an additional channel, based on vibrotactile stimulation, may improve balance control. This study focused only on healthy young participants for evaluating the effects of different encoding methods and the importance of the informational content. We built a device that provides a vibrotactile feedback using two vibration motors placed on the anterior and posterior part of the body, at the L5 level. The vibration was synchronized with an accelerometric measurement encoding a combination of the position and acceleration of the body center of mass in the anterior-posterior direction. The goal was to investigate the efficacy of the information encoded by this feedback in modifying postural patterns, comparing, in particular, two different encoding methods: vibration always on and vibration with a dead zone, i.e., silent in a region around the natural stance posture. We also studied if after the exposure, the participants modified their normal oscillation patterns, i.e., if there were after effects. Finally, we investigated if these effects depended on the informational content of the feedback, introducing trials with vibration unrelated to the actual postural oscillations (sham feedback). Twenty-four participants were asked to stand still with their eyes closed, alternating trials with and without vibrotactile feedback: nine were tested with vibration always on and sham feedback, fifteen with dead zone feedback. The results show that synchronized vibrotactile feedback reduces significantly the sway amplitude while increasing the frequency in anterior-posterior and medial-lateral directions. The two encoding methods had no different effects of reducing the amount of postural sway during exposure to vibration, however only the dead-zone feedback led to short-term after effects. The presence of sham vibration, instead, increased the sway amplitude, highlighting the importance of the encoded information.

Vibration Propagation on the Skin of the Arm

Vibrotactile interfaces are an inexpensive and non-invasive way to provide performance feedback to body-machine interface users. Interfaces for the upper extremity have utilized a multi-channel approach using an array of vibration motors placed on the upper extremity. However, for successful perception of multi-channel vibrotactile feedback on the arm, we need to account for vibration propagation across the skin. If two stimuli are delivered within a small distance, mechanical propagation of vibration can lead to inaccurate perception of the distinct vibrotactile stimuli. This study sought to characterize vibration propagation across the hairy skin of the forearm. We characterized vibration propagation by measuring accelerations at various distances from a source vibration of variable intensities (100–240 Hz). Our results showed that acceleration from the source vibration was present at a distance of 4 cm at intensities >150 Hz. At distances greater than 8 cm from the source, accelerations were reduced to values substantially below vibrotactile discrimination thresholds for all vibration intensities. We conclude that in future applications of vibrotactile interfaces, stimulation sites should be separated by a distance of at least 8 cm to avoid potential interference in vibration perception caused by propagating vibrations.

A two alternative forced choice method for assessing vibrotactile discrimination thresholds in the lower limb

The development of an easy to implement, quantitative measure to examine vibration perception would be useful for future application in clinical settings. Vibration sense in the lower limb of younger and older adults was examined using the method of constant stimuli (MCS) and the two-alternative forced choice paradigm. The focus of this experiment was to determine an appropriate stimulation site on the lower limb (tendon versus bone) to assess vibration threshold and to determine if the left and right legs have varying thresholds. Discrimination thresholds obtained at two stimulation sites in the left and right lower limbs showed differences in vibration threshold across the two ages groups, but not across sides of the body nor between stimulation sites within each limb. Overall, the MCS can be implemented simply, reliably, and with minimal time. It can also easily be implemented with low-cost technology. Therefore, it could be a good candidate method to assess the presence of specific deep sensitivity deficits in clinical practice, particularly in populations likely to show the onset of sensory deficits.

Supplemental vibrotactile feedback of real-time limb position enhances precision of goal-directed reaching

We examined vibrotactile stimulation as a form of supplemental limb state feedback to enhance planning and ongoing control of goal-directed movements. Subjects wore a two-dimensional vibrotactile display on their nondominant arm while performing horizontal planar reaching with the dominant arm. The vibrotactile display provided feedback of hand position such that small hand displacements were more easily discriminable using vibrotactile feedback than with intrinsic proprioceptive feedback. When subjects relied solely on proprioception to capture visuospatial targets, performance was degraded by proprioceptive drift and an expansion of task space. By contrast, reach accuracy was enhanced immediately when subjects were provided vibrotactile feedback and further improved over 2 days of training. Improvements reflected resolution of proprioceptive drift, which occurred only when vibrotactile feedback was active, demonstrating that benefits of vibrotactile feedback are due, in part to its integration into the ongoing control of movement. A partial resolution of task space expansion persisted even when vibrotactile feedback was inactive, demonstrating that training with vibrotactile feedback also induced changes in movement planning. However, the benefits of vibrotactile feedback come at a cognitive cost. All subjects adopted a stereotyped strategy wherein they attempted to capture targets by moving first along one axis of the vibrotactile display and then the other. For most subjects, this inefficient approach did not resolve over two bouts of training performed on separate days, suggesting that additional training is needed to integrate vibrotactile feedback into the planning and online control of goal-directed reaching in a way that promotes smooth and efficient movement. NEW & NOTEWORTHY A two-dimensional vibrotactile display provided state (not error) feedback to enhance control of a moving limb. Subjects learned to use state feedback to perform blind reaches with accuracy and precision exceeding that attained using intrinsic proprioception alone. Feedback utilization incurred substantial cognitive cost: subjects moved first along one axis of the vibrotactile display, then the other. This stereotyped control strategy must be overcome if vibrotactile limb state feedback is to promote naturalistic limb movements.