HyVE-hybrid vibro-electrotactile stimulation-is an efficient approach to multi-channel sensory feedback

Tactile Sensing and Rendering Patch with Dynamic and Static Sensing and Haptic Feedback for Immersive Communication

Wearable human-machine interface (HMI) with bidirectional and multimodal tactile information exchange is of paramount importance in teleoperation by providing more intuitive data interpretation and delivery of tactilely related signals. However, the current sensing and feedback devices still lack enough integration and modalities. Here, we present a Tactile Sensing and Rendering Patch (TSRP) that is made of a customized expandable array which consists of a piezoelectric sensing and feedback unit fused with an elastomeric triboelectric multidimensional sensor and its inner pneumatic feedback structure. The primary functional unit of TSRP is mainly featured with a soft silicone substrate with compact multilayer structure integrating static and dynamic multidimensional tactile sensing capabilities, which synergistically leverage both triboelectric and piezoelectric effects. Additionally, based on the air chamber created by the triboelectric sensor and the converse piezoelectric effect, it provides pneumatic and vibrational haptic feedback simultaneously for both static and dynamic perception regeneration. With the aid of the other variants of this unit, the array shaped TSRP is capable of simulating different terrains, geometries, sliding, collisions, and other critical interactive events during teleoperation via skin perception. Moreover, immediate manipulation can be done on TSRP through the tactile sensors. The preliminary demonstration of TSRP interface with a completed control module in robotic teleoperation is provided, which shows the feasibility of assisting certain tasks in a complex environment by direct tactile communication. The proposed device offers a potential method of enabling bidirectional tactile communication with enriched key information for improving interaction efficiency in the fields of robot teleoperation and training.

A compact solution for vibrotactile proprioceptive feedback of wrist rotation and hand aperture

BACKGROUND

Closing the control loop between users and their prostheses by providing artificial sensory feedback is a fundamental step toward the full restoration of lost sensory-motor functions.

METHODS

We propose a novel approach to provide artificial proprioceptive feedback about two degrees of freedom using a single array of 8 vibration motors (compact solution). The performance afforded by the novel method during an online closed-loop control task was compared to that achieved using the conventional approach, in which the same information was conveyed using two arrays of 8 and 4 vibromotors (one array per degree of freedom), respectively. The new method employed Gaussian interpolation to modulate the intensity profile across a single array of vibration motors (compact feedback) to convey wrist rotation and hand aperture by adjusting the mean and standard deviation of the Gaussian, respectively. Ten able-bodied participants and four transradial amputees performed a target achievement control test by utilizing pattern recognition with compact and conventional vibrotactile feedback to control the Hannes prosthetic hand (test conditions). A second group of ten able-bodied participants performed the same experiment in control conditions with visual and auditory feedback as well as no-feedback.

RESULTS

Conventional and compact approaches resulted in similar positioning accuracy, time and path efficiency, and total trial time. The comparison with control condition revealed that vibrational feedback was intuitive and useful, but also underlined the power of incidental feedback sources. Notably, amputee participants achieved similar performance to that of able-bodied participants.

CONCLUSIONS

The study therefore shows that the novel feedback strategy conveys useful information about prosthesis movements while reducing the number of motors without compromising performance. This is an important step toward the full integration of such an interface into a prosthesis socket for clinical use.

Excitation of natural spinal reflex loops in the sensory-motor control of hand prostheses

Sensory feedback for prosthesis control is typically based on encoding sensory information in specific types of sensory stimuli that the users interpret to adjust the control of the prosthesis. However, in physiological conditions, the afferent feedback received from peripheral nerves is not only processed consciously but also modulates spinal reflex loops that contribute to the neural information driving muscles. Spinal pathways are relevant for sensory-motor integration, but they are commonly not leveraged for prosthesis control. We propose an approach to improve sensory-motor integration for prosthesis control based on modulating the excitability of spinal circuits through the vibration of tendons in a closed loop with muscle activity. We measured muscle signals in healthy participants and amputees during different motor tasks, and we closed the loop by applying vibration on tendons connected to the muscles, which modulated the excitability of motor neurons. The control signals to the prosthesis were thus the combination of voluntary control and additional spinal reflex inputs induced by tendon vibration. Results showed that closed-loop tendon vibration was able to modulate the neural drive to the muscles. When closed-loop tendon vibration was used, participants could achieve similar or better control performance in interfaces using muscle activation than without stimulation. Stimulation could even improve prosthetic grasping in amputees. Overall, our results indicate that closed-loop tendon vibration can integrate spinal reflex pathways in the myocontrol system and open the possibility of incorporating natural feedback loops in prosthesis control.

Scalp-Targeted Haptic Proprioception for Upper-Limb Prosthetics

In this paper, a head-worn wearable haptic feedback device (WHFD) is developed to communicate sensory information from an upper-limb prosthesis. A 14-week, 6-stage, between-subjects study was created to investigate the learning trajectory as participants were stimulated with haptic patterns conveying joint proprioception. Healthy participants were divided into three groups, with each group using a different haptic stimulation methods. 18 participants completed the study within 7-14 weekly sessions, demonstrating that participants were, in fact, learning to interpret the haptic information. Participants in the spatiotemporal stimulation group had some advantages in interpreting the haptic information over the others; however, each stimulation method has advantages that can be exploited and hybridized for future models of the WHFD. Overall, the proposed WHFD is an effective non-invasive device that can promote greater sensory awareness for wearers of prostheses.

Electrotactile Feedback Applications for Hand and Arm Interactions: A Systematic Review, Meta-Analysis, and Future Directions

Haptic feedback is critical in a broad range of human-machine/computer-interaction applications. However, the high cost and low portability/wearability of haptic devices remain unresolved issues, severely limiting the adoption of this otherwise promising technology. Electrotactile interfaces have the advantage of being more portable and wearable due to their reduced actuators' size, as well as their lower power consumption and manufacturing cost. The applications of electrotactile feedback have been explored in human-computer interaction and human-machine-interaction for facilitating hand-based interactions in applications, such as prosthetics, virtual reality, robotic teleoperation, surface haptics, portable devices, and rehabilitation. This article presents a technological overview of electrotactile feedback, as well a systematic review and meta-analysis of its applications for hand-based interactions. We discuss the different electrotactile systems according to the type of application. We also discuss over a quantitative congregation of the findings, to offer a high-level overview into the state-of-art and suggest future directions. Electrotactile feedback systems showed increased portability/wearability, and they were successful in rendering and/or augmenting most tactile sensations, eliciting perceptual processes, and improving performance in many scenarios. However, knowledge gaps (e.g., embodiment), technical (e.g., recurrent calibration, electrodes' durability) and methodological (e.g., sample size) drawbacks were detected, which should be addressed in future studies.

Electrotactile and Vibrotactile Feedback Enable Similar Performance in Psychometric Tests and Closed-Loop Control

Electro- and vibro-tactile stimulation are commonly employed for feedback in closed-loop human-machine interfacing. Although these feedback systems have been extensively investigated individually, they are rarely objectively compared. In this study, two state-of-the-art stimulation units (concentric electrode and C2-tactor) similar in shape and size were compared in psychometric and online control tests. The just noticeable difference and number of discriminable levels for intensity and frequency modulation were determined across values of carrier frequency and intensity, respectively. Next, subjects performed a compensatory tracking task, in which the feedback encoded the momentary tracking error. In the psychometric tests, intensity modulation outperformed frequency modulation and electrotactile stimulation enabled significantly higher resolution than vibrotactile stimulation, for the same carrier frequency. However, for the best-case settings (eletro-tactile: 100 Hz; vibro-tactile: 200 Hz), the two stimulation modalities were equivalent in the psychometric tests and in the online control tests, where the two stimulation methods resulted in similar correlation and deviation between the target and the generated trajectory. Time delay was slightly but significantly lower for the vibrotactile modality. Overall, the present assessment shows that despite psychometric differences between the two stimulation methods, they enable similar online control performance when parameters are optimally selected for each modality.

Psychophysical principles of discrete event-driven vibrotactile feedback for prostheses

Purpose/aim of the study: We aimed to establish psychophysical principles for non-invasive vibrotactile feedback signalling discrete transition events (e.g., extension to flexion) during use of prostheses, especially for the upper limbs.Materials and methods: Two vibrotactile actuators were used on both upper arms of 10 able-bodied human participants. Absolute thresholds, psychometric functions, and magnitude estimates were measured to equalize the sensation magnitudes for the tested vibrotactile frequencies and skin sites. Then, same-different and pattern recognition tasks were run to evaluate, respectfully, the discrimination and closed-set identification of stimuli with varying parameters (2 frequencies, 2 magnitudes, 2 sites). Finally, parameters of the left/right stimuli were mapped to hypothetical prosthesis events representing object/force and movement type. The stimuli were applied sequentially in accordance with the discrete event-driven feedback paradigm.Results: Reliable psychophysical models could be established for individual participants as verified by repetitive threshold measurements and relative adjustment of stimulus levels based on sensation magnitudes. Discrimination accuracy was higher for magnitude versus frequency comparisons; and magnitude discrimination accuracy was correlated with magnitude estimate differences. Pattern recognition recall/precision rates decreased from ∼0.7 to ∼0.5 for sequential delivery of two stimulus patterns to one arm versus to two arms. Using the patterns as two and three consecutive prosthesis events yielded statistically similar performance rates not correlated with magnitude estimate differences.Conclusions: By careful calibration of stimuli based on psychophysical principles, discrete event-driven vibrotactile feedback can be used to signal manipulated object and movement information with moderate identification rates as shown by confusion matrices.

Wearable Dual-Frequency Vibrotactile System for Restoring Force and Stiffness Perception

Recently, there has been substantial progress in the mechatronic design and myoelectric control of active prostheses. However, a significant unmet need is the lack of sensory feedback in commercial prostheses for upper-limb amputees. The lack of sensory perception impacts on the control performance and embodiment, determining relatively high rejection rates. Previous research has been conducted to evaluate various non-invasive substitutional sensory channels, mainly to regenerate haptic perception. However, providing sensory channels for stiffness perception has been much less explored. In this short paper, we propose a non-invasive wearable sensory armband, named vibrotactile frequency modulation (V-FM) system. Using the V-FM, we implement a closed-loop myocontrol system with force and stiffness perception. A user study was conducted based on a repetitive two-forced alternative choice discrimination test in six able-bodied participants. The study was designed according to the method of constant stimuli. Results showed that using the V-FM armband, the participants recovered sensation comparable (in terms of difference threshold) to the natural stiffness perception. This demonstrated the potential of the proposed V-FM armband in restoring haptic and stiffness perception non-invasively.

Effect of vibration characteristics and vibror arrangement on the tactile perception of the upper arm in healthy subjects and upper limb amputees

Background

Vibrotactile stimulation is a promising venue in the field of prosthetics to retrain sensory feedback deficits following amputation. Discrimination is well established at the forearm level but not at the upper arm level. Moreover, the effects of combining vibration characteristics such as duration and intensity has never been investigated.

Method

We conducted experiments on spatial discrimination (experiment 1) and tactile intensity perception (experiment 2), using 9 combinations of 3 intensities and 3 durations of vibror stimulations device. Those combinations were tested under 4 arrangements with an array of 6 vibrors. In both experiments, linear orientation aligned with the upper arm longitudinal axis were compared to circular orientation on the upper arm circumference. For both orientations, vibrors were placed either with 3cm space between the center of 2 vibrors or proportionally to the length or the circumference of the subject upper arm. Eleven heathy subjects underwent the 2 experiments and 7 amputees (humeral level) participated in the spatial discrimination task with the best arrangement found.

Results

Experiment 1 revealed that circular arrangements elicited better scores than the linear ones. Arrangements with vibrors spaced proportionally elicited better scores (up to 75% correct) than those with 3 cm spacing. Experiment 2, showed that the perceived intensity of the vibration increases with the intensity of the vibrors’ activation, but also with their duration of activation. The 7 patients obtained high scores (up to 91.67% correct) with the circular proportional (CP) arrangement.

Discussion

These results highlight that discrete and short vibrations can be well discriminated by healthy subjects and people with an upper limb amputation. These new characteristics of vibrations have great potential for future sensory substitution application in closed-loop prosthetic control.

Skin Stretch Haptic Feedback to Convey Closure Information in Anthropomorphic, Under-Actuated Upper Limb Soft Prostheses

Restoring hand function in individuals with upper limb loss is a challenging task, made difficult by the complexity of human hands from both a functional and sensory point of view. Users of commercial prostheses, even sophisticated devices, must visually attend to the hand to know its state, since in most cases they are not provided with any direct sensory information. Among the different types of haptic feedback that can be delivered, particularly information on hand opening is likely to reduce the requirement of constant visual attention. In recent years, there has been a trend of using underactuated, compliant multi-fingered hands as upper limb prostheses, in part due to their simplicity and ease of use attributed to low degree-of-freedom (d.o.f.) actuation. The trend toward underactuation encourages the design of one d.o.f. haptic devices to provide intuitive sensory feedback from the prosthesis. However, mapping the closure of a multi-d.o.f. prosthetic hand to a simple and intuitive haptic cue is not a trivial task. In this paper, we explore the use of a one d.o.f. skin stretch haptic device, the rice haptic rocker, to provide intuitive proprioceptive feedback indicating overall hand closure of an underactuated prosthesis. The benefits and challenges of the system are assessed in multi-tasking and reduced vision scenarios for an object-size discrimination task, in an effort to simulate challenges in daily life, and are compared against the haptic resolution of the device using the just noticeable difference. Finally, an evaluation done with a prosthesis user, in the form of a truncated version of the Activities Measure for Upper Limb Amputees (AM-ULA), shows possible benefits of the addition of haptic feedback in tasks with reduced visual attention.

Navigation Systems for the Blind and Visually Impaired: Past Work, Challenges, and Open Problems

Over the last decades, the development of navigation devices capable of guiding the blind through indoor and/or outdoor scenarios has remained a challenge. In this context, this paper’s objective is to provide an updated, holistic view of this research, in order to enable developers to exploit the different aspects of its multidisciplinary nature. To that end, previous solutions will be briefly described and analyzed from a historical perspective, from the first “Electronic Travel Aids” and early research on sensory substitution or indoor/outdoor positioning, to recent systems based on artificial vision. Thereafter, user-centered design fundamentals are addressed, including the main points of criticism of previous approaches. Finally, several technological achievements are highlighted as they could underpin future feasible designs. In line with this, smartphones and wearables with built-in cameras will then be indicated as potentially feasible options with which to support state-of-art computer vision solutions, thus allowing for both the positioning and monitoring of the user’s surrounding area. These functionalities could then be further boosted by means of remote resources, leading to cloud computing schemas or even remote sensing via urban infrastructure.

Armband with Soft Robotic Actuators and Vibrotactile Stimulators for Bimodal Haptic Feedback from a Dexterous Artificial Hand

The haptic sense relies upon a plurality of receptors and pathways to produce a complex perceptual experience of contact, pressure, taps, vibrations and flutters. This complexity is yet to be reproduced in haptic feedback interfaces that are used by people controlling a dexterous robotic hand, be it for limb-absence or teleoperation. The goal of the present bimodal haptic armband is to convey both low-frequency pressure changes and high-frequency vibrations from a dexterous robotic hand to a human's upper arm, so as to guide his/her control of the artificial limb. To that end, we design and manufacture four novel soft robotic armbands combining inflatable air chambers and vibrotactile stimulators. We develop control systems for both pathways. We conduct a series of benchtop tests to determine the pneumatic and vibrotactile performance and select from competing designs and materials. We test two of the resulting bimodal haptic armband on human subjects and confirm their ability to use both aspects of this haptic information. Arguing that dexterous artificial hands are presently not used to their fullest capability by the dearth of haptic information in users, this work aims to achieve a more realistic tactile experience for a fluent, more natural usage of robotic artificial hands.

Selectivity and Longevity of Peripheral-Nerve and Machine Interfaces: A Review

For those individuals with upper-extremity amputation, a daily normal living activity is no longer possible or it requires additional effort and time. With the aim of restoring their sensory and motor functions, theoretical and technological investigations have been carried out in the field of neuroprosthetic systems. For transmission of sensory feedback, several interfacing modalities including indirect (non-invasive), direct-to-peripheral-nerve (invasive), and cortical stimulation have been applied. Peripheral nerve interfaces demonstrate an edge over the cortical interfaces due to the sensitivity in attaining cortical brain signals. The peripheral nerve interfaces are highly dependent on interface designs and are required to be biocompatible with the nerves to achieve prolonged stability and longevity. Another criterion is the selection of nerves that allows minimal invasiveness and damages as well as high selectivity for a large number of nerve fascicles. In this paper, we review the nerve-machine interface modalities noted above with more focus on peripheral nerve interfaces, which are responsible for provision of sensory feedback. The invasive interfaces for recording and stimulation of electro-neurographic signals include intra-fascicular, regenerative-type interfaces that provide multiple contact channels to a group of axons inside the nerve and the extra-neural-cuff-type interfaces that enable interaction with many axons around the periphery of the nerve. Section Current Prosthetic Technology summarizes the advancements made to date in the field of neuroprosthetics toward the achievement of a bidirectional nerve-machine interface with more focus on sensory feedback. In the Discussion section, the authors propose a hybrid interface technique for achieving better selectivity and long-term stability using the available nerve interfacing techniques.

Mixed-Modality Stimulation to Evoke Two Modalities Simultaneously in One Channel for Electrocutaneous Sensory Feedback

One of the long-standing challenges in upper limb prosthetics is restoring the sensory feedback that is missing due to amputation. Two approaches have previously been presented to provide various types of sensory information to users, namely, multi-modality sensory feedback and using an array of single-modality stimulators. However, the feedback systems used in these approaches were too bulky to be embedded in prosthesis sockets. In this paper, we propose an electrocutaneous sensory feedback method that is capable of conveying two modalities simultaneously with only one electrode. The stimulation method, which we call mixed-modality stimulation, utilizes the phenomenon in which the superposition of two electric pulse trains of different frequencies is able to evoke two different modalities (i.e., pressure and tapping) at the same time. We conducted psychophysical experiments in which healthy subjects were required to recognize the intensity of pressure or the frequency of tapping from mixed-modality or two-channel stimulations. The results demonstrated that the subjects were able to discriminate the features of the two modalities in one electrode during mixed-modality stimulation and that the accuracies of successful recognitions (mean ± standard deviation) for the two feedback variables were 84.3 ± 7% for mixed-modality stimulation and 89.5 ± 6% for two-channel dual-modality stimulation, showing no statistically significant difference. Therefore, mixed-modality stimulation is an attractive method for modulating two modalities independently with only one electrode, and it could be used for implementing a compact sensory feedback system that is able to provide two different types of sensory information from prosthetics.

Tactile feedback is an effective instrument for the training of grasping with a prosthesis at low- and medium-force levels

Grasping is a complex task routinely performed in an anticipatory (feedforward) manner, where sensory feedback is responsible for learning and updating the internal model of grasp dynamics. This study aims at evaluating whether providing a proportional tactile force feedback during the myoelectric control of a prosthesis facilitates learning a stable internal model of the prosthesis force control. Ten able-bodied subjects controlled a sensorized myoelectric prosthesis performing four blocks of consecutive grasps at three levels of target force (30, 50, and 70%), repeatedly closing the fully opened hand. In the first and third block, the subjects received tactile and visual feedback, respectively, while during the second and fourth block, the feedback was removed. The subjects also performed an additional block with no feedback 1 day after the training (Retest). The median and interquartile range of the generated forces was computed to assess the accuracy and precision of force control. The results demonstrated that the feedback was indeed an effective instrument for the training of prosthesis control. After the training, the subjects were still able to accurately generate the desired force for the low and medium target (30 and 50% of maximum force available in a prosthesis), despite the feedback being removed within the session and during the retest (low target force). However, the training was substantially less successful for high forces (70% of prosthesis maximum force), where subjects exhibited a substantial loss of accuracy as soon as the feedback was removed. The precision of control decreased with higher forces and it was consistent across conditions, determined by an intrinsic variability of repeated myoelectric grasping. This study demonstrated that the subject could rely on the tactile feedback to adjust the motor command to the prosthesis across trials. The subjects adjusted the mean level of muscle activation (accuracy), whereas the precision could not be modulated as it depends on the intrinsic myoelectric variability. They were also able to maintain the feedforward command even after the feedback was removed, demonstrating thereby a stable learning, but the retention depended on the level of the target force. This is an important insight into the role of feedback as an instrument for learning of anticipatory prosthesis force control.

A System for Electrotactile Feedback Using Electronic Skin and Flexible Matrix Electrodes: Experimental Evaluation

Myoelectric prostheses are successfully controlled using muscle electrical activity, thereby restoring lost motor functions. However, the somatosensory feedback from the prosthesis to the user is still missing. The sensory substitution methods described in the literature comprise mostly simple position and force sensors combined with discrete stimulation units. The present study describes a novel system for sophisticated electrotactile feedback integrating advanced distributed sensing (electronic skin) and stimulation (matrix electrodes). The system was tested in eight healthy subjects who were asked to recognize the shape, trajectory, and direction of a set of dynamic movement patterns (single lines, geometrical objects, letters) presented on the electronic skin. The experiments demonstrated that the system successfully translated the mechanical interaction into the moving electrotactile profiles, which the subjects could recognize with a good performance (shape recognition: 86±8% lines, 73±13% geometries, 72±12% letters). In particular, the subjects could identify the movement direction with a high confidence. These results are in accordance with previous studies investigating the recognition of moving stimuli in human subjects. This is an important development towards closed-loop prostheses providing comprehensive and sophisticated tactile feedback to the user, facilitating the control and the embodiment of the artificial device into the user body scheme.

Integrated and flexible multichannel interface for electrotactile stimulation

OBJECTIVE

The aim of the present work was to develop and test a flexible electrotactile stimulation system to provide real-time feedback to the prosthesis user. The system requirements were to accommodate the capabilities of advanced multi-DOF myoelectric hand prostheses and transmit the feedback variables (proprioception and force) using intuitive coding, with high resolution and after minimal training.

APPROACH

We developed a fully-programmable and integrated electrotactile interface supporting time and space distributed stimulation over custom designed flexible array electrodes. The system implements low-level access to individual stimulation channels as well as a set of high-level mapping functions translating the state of a multi-DoF prosthesis (aperture, grasping force, wrist rotation) into a set of predefined dynamic stimulation profiles. The system was evaluated using discrimination tests employing spatial and frequency coding (10 able-bodied subjects) and dynamic patterns (10 able-bodied and 6 amputee subjects). The outcome measure was the success rate (SR) in discrimination.

MAIN RESULTS

The more practical electrode with the common anode configuration performed similarly to the more usual concentric arrangement. The subjects could discriminate six spatial and four frequency levels with SR >90% after a few minutes of training, whereas the performance significantly deteriorated for more levels. The dynamic patterns were intuitive for the subjects, although amputees showed lower SR than able-bodied individuals (86% ± 10% versus 99% ± 3%).

SIGNIFICANCE

The tests demonstrated that the system was easy to setup and apply. The design and resolution of the multipad electrode was evaluated. Importantly, the novel dynamic patterns, which were successfully tested, can be superimposed to transmit multiple feedback variables intuitively and simultaneously. This is especially relevant for closing the loop in modern multifunction prostheses. Therefore, the proposed system is convenient for practical applications and can be used to implement sensory perception training and/or closed-loop control of myoelectric prostheses, providing grasping force and proprioceptive feedback.

Reflections on the present and future of upper limb prostheses

Despite progress in research and media attention on active upper limb prostheses, presently the most common commercial upper limb prosthetic devices are not fundamentally different from solutions offered almost one century ago. Limited information transfer for both control and sensory-motor integration and challenges in socket technology have been major obstacles. By analysing the present state-of-the-art and academic achievements, we provide our opinion on the future of upper limb prostheses. We believe that surgical procedures for muscle reinnervation and osseointegration will become increasingly clinically relevant; muscle electrical signals will remain the main clinical means for prosthetic control; and chronic electrode implants, first in muscles (control), then in nerves (sensory feedback), will become viable clinical solutions. After decades of suspended clinically relevant progress, it is foreseeable that a new generation of upper limb prostheses will enter the market in the near future based on such advances, thereby offering substantial clinical benefit for patients.

Human-Machine Interface for the Control of Multi-Function Systems Based on Electrocutaneous Menu: Application to Multi-Grasp Prosthetic Hands

Modern assistive devices are very sophisticated systems with multiple degrees of freedom. However, an effective and user-friendly control of these systems is still an open problem since conventional human-machine interfaces (HMI) cannot easily accommodate the system’s complexity. In HMIs, the user is responsible for generating unique patterns of command signals directly triggering the device functions. This approach can be difficult to implement when there are many functions (necessitating many command patterns) and/or the user has a considerable impairment (limited number of available signal sources). In this study, we propose a novel concept for a general-purpose HMI where the controller and the user communicate bidirectionally to select the desired function. The system first presents possible choices to the user via electro-tactile stimulation; the user then acknowledges the desired choice by generating a single command signal. Therefore, the proposed approach simplifies the user communication interface (one signal to generate), decoding (one signal to recognize), and allows selecting from a number of options. To demonstrate the new concept the method was used in one particular application, namely, to implement the control of all the relevant functions in a state of the art commercial prosthetic hand without using any myoelectric channels. We performed experiments in healthy subjects and with one amputee to test the feasibility of the novel approach. The results showed that the performance of the novel HMI concept was comparable or, for some outcome measures, better than the classic myoelectric interfaces. The presented approach has a general applicability and the obtained results point out that it could be used to operate various assistive systems (e.g., prosthesis vs. wheelchair), or it could be integrated into other control schemes (e.g., myoelectric control, brain-machine interfaces) in order to improve the usability of existing low-bandwidth HMIs.

Material Roughness Modulation via Electrotactile Augmentation

Tactile exploration of a material's texture using a bare finger pad is a daily human activity. However, modern tactile displays do not allow users to experience the natural sensations of a material when artificial sensations are presented. We propose an electrotactile augmentation technique capable of superimposing vibrotactile sensations in a finger pad, thereby allowing the texture modulation of real materials. Users attach two stimulus electrodes to the middle phalanx of a finger and a grounded electrode at the base of the finger in order to evoke nerve activity. This paper evaluates the proposed electrotactile augmentation for roughness modulation of real materials. First, we introduce the principle of the electrotactile display, which presents artificial sensations at the finger pad. We then confirm that the perceived frequency of mechanical vibration at the finger pad can be shifted using electrotactile augmentation. Finally, we discuss a user study, wherein participants rated the roughness of real materials explored using the proposed system. Experimental results indicate that fine- and macro-roughness perceptions of real materials can be altered using electrotactile augmentation.

Human ability in identification of location and pulse number for electrocutaneous stimulation applied on the forearm

Background

The need of a sensory feedback system that would improve users’ acceptance in prostheses is generally recognized. Feedback of hand opening and position are among the most important concerns of prosthetic users. To address the two concerns, this study investigated the human capability to identify pulse number and location when electrical stimulation applied on the forearm skin. The pulse number may potentially be used to encode the opening of prosthetic hands and stimulation location to encode finger position.

Methods

Ten able-bodied subjects participated in the study. Three electrodes were placed transversely across the ventral forearm spatially encoding three fingers (i.e., thumb, index, and middle finger). Five different pulse numbers (1, 4, 8, 12, and 20) encoded five levels of hand opening. The study consisted of three experiments. In the three experiments, each after a training session, the subjects were required to identify among: (a) five stimulation locations, (b) five pulse numbers, or (c) ten paired combinations of location and pulse number, respectively. The subjects’ performance in the three identification tasks was evaluated.

Results

The main results included: 1) the overall identification rate for stimulation location was 92.2 ± 6.2%, while the success rate in two-site stimulation was lower than one-site stimulation; 2) the overall identification rate for pulse number was 90.8 ± 6.0%, and the subjects showed different performance in identification of the five pulse numbers; 3) the overall identification rate decreased to 80.2 ± 11.7% when the subjects were identifying paired parameters.

Conclusions

The results indicated that the spatial (location) and temporal (pulse number) identification performance are promising in electrocutaneous stimulation on the forearm. The performance degraded when both parameters had to be identified likely due to increased cognitive load resulting from multiple tasks. Utilizing the proposed coding strategy in practical prosthetic hands remains to be investigated for clinical evaluation of its feasibility.