Robo-Psychophysics: Extracting Behaviorally Relevant Features from the Output of Sensors on a Prosthetic Finger

Restoration of sensory information via bionic hands

Individuals who have lost the use of their hands because of amputation or spinal cord injury can use prosthetic hands to restore their independence. A dexterous prosthesis requires the acquisition of control signals that drive the movements of the robotic hand, and the transmission of sensory signals to convey information to the user about the consequences of these movements. In this Review, we describe non-invasive and invasive technologies for conveying artificial sensory feedback through bionic hands, and evaluate the technologies' long-term prospects.

Artificial SA-I and RA-I afferents for tactile sensing of ridges and gratings

For robot touch to reach the capabilities of human touch, artificial tactile sensors may require transduction principles like those of natural tactile afferents. Here we propose that a biomimetic tactile sensor (the TacTip) could provide suitable artificial analogues of the tactile skin dynamics, afferent responses and population encoding. Our three-dimensionally printed sensor skin is based on the physiology of the dermal-epidermal interface with an underlying mesh of biomimetic intermediate ridges and dermal papillae, comprising inner pins tipped with markers. Slowly adapting SA-I activity is modelled by marker displacements and rapidly adapting RA-I activity by marker speeds. We test the biological plausibility of these artificial population codes with three classic experiments used for natural touch: (1a) responses to normal pressure to test adaptation of single afferents and spatial modulation across the population; (1b) responses to bars, edges and gratings to compare with measurements from monkey primary afferents; and (2) discrimination of grating orientation to compare with human perceptual performance. Our results show a match between artificial and natural touch at single afferent, population and perceptual levels. As expected, natural skin is more sensitive, which raises a challenge to fabricate a biomimetic fingertip that demonstrates human sensitivity using the transduction principles of human touch.

The neural mechanisms of manual dexterity

The hand endows us with unparalleled precision and versatility in our interactions with objects, from mundane activities such as grasping to extraordinary ones such as virtuoso pianism. The complex anatomy of the human hand combined with expansive and specialized neuronal control circuits allows a wide range of precise manual behaviours. To support these behaviours, an exquisite sensory apparatus, spanning the modalities of touch and proprioception, conveys detailed and timely information about our interactions with objects and about the objects themselves. The study of manual dexterity provides a unique lens into the sensorimotor mechanisms that endow the nervous system with the ability to flexibly generate complex behaviour.

Computational and Psychophysical Experiments on the Pacinian Corpuscle's Ability to Discriminate Complex Stimuli

Recognizing and discriminating vibrotactile stimuli is an essential function of the Pacinian corpuscle. This function has been studied at length in both a computational and an experimental setting, but the two approaches have rarely been compared, especially when the computational model has a high level of structural detail. In this paper, we explored whether the predictions of a multiscale, multiphysical computational model of the Pacinian corpuscle can predict the outcome of a corresponding psychophysical experiment. The discrimination test involved either two simple stimuli with frequency in the 160-500 Hz range, or two complex stimuli formed by combining the waveforms for a 100-Hz stimulus with a second stimulus in the 160-500 Hz range. The subjects' ability to distinguish between the simple stimuli increased as the frequency increased, a result consistent with the model predictions for the same stimuli. The model also predicted correctly that subjects would find the complex stimuli more difficult to distinguish than the simple ones and also that the discriminability of the complex stimuli would show no trend with frequency difference.

Active Haptic Perception in Robots: A Review

In the past few years a new scenario for robot-based applications has emerged. Service and mobile robots have opened new market niches. Also, new frameworks for shop-floor robot applications have been developed. In all these contexts, robots are requested to perform tasks within open-ended conditions, possibly dynamically varying. These new requirements ask also for a change of paradigm in the design of robots: on-line and safe feedback motion control becomes the core of modern robot systems. Future robots will learn autonomously, interact safely and possess qualities like self-maintenance. Attaining these features would have been relatively easy if a complete model of the environment was available, and if the robot actuators could execute motion commands perfectly relative to this model. Unfortunately, a complete world model is not available and robots have to plan and execute the tasks in the presence of environmental uncertainties which makes sensing an important component of new generation robots. For this reason, today's new generation robots are equipped with more and more sensing components, and consequently they are ready to actively deal with the high complexity of the real world. Complex sensorimotor tasks such as exploration require coordination between the motor system and the sensory feedback. For robot control purposes, sensory feedback should be adequately organized in terms of relevant features and the associated data representation. In this paper, we propose an overall functional picture linking sensing to action in closed-loop sensorimotor control of robots for touch (hands, fingers). Basic qualities of haptic perception in humans inspire the models and categories comprising the proposed classification. The objective is to provide a reasoned, principled perspective on the connections between different taxonomies used in the Robotics and human haptic literature. The specific case of active exploration is chosen to ground interesting use cases. Two reasons motivate this choice. First, in the literature on haptics, exploration has been treated only to a limited extent compared to grasping and manipulation. Second, exploration involves specific robot behaviors that exploit distributed and heterogeneous sensory data.

The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies

Tactile sensing is an essential component in human-robot interaction and object manipulation. Soft sensors allow for safe interaction and improved gripping performance. Here we present the TacTip family of sensors: a range of soft optical tactile sensors with various morphologies fabricated through dual-material 3D printing. All of these sensors are inspired by the same biomimetic design principle: transducing deformation of the sensing surface via movement of pins analogous to the function of intermediate ridges within the human fingertip. The performance of the TacTip, TacTip-GR2, TacTip-M2, and TacCylinder sensors is here evaluated and shown to attain submillimeter accuracy on a rolling cylinder task, representing greater than 10-fold super-resolved acuity. A version of the TacTip sensor has also been open-sourced, enabling other laboratories to adopt it as a platform for tactile sensing and manipulation research. These sensors are suitable for real-world applications in tactile perception, exploration, and manipulation, and will enable further research and innovation in the field of soft tactile sensing.