Contact geometry and mechanics predict friction forces during tactile surface exploration

A review on finite element modelling of finger and hand mechanical behaviour in haptic interactions

Touch perception largely depends on the mechanical properties of the soft tissues of the glabrous skin of fingers and hands. The correct modelling of the stress-strain state of these tissues during the interaction with external objects can provide insights on the exteroceptual mechanisms of human touch, offering design guidelines for artificial haptic systems. However, devising correct models of the finger and hand at contact is a challenging task, due to the biomechanical complexity of human skin. This work presents an overview of the use of Finite Element analysis for studying the stress-strain state in the glabrous skin of the hand, under different loading conditions. We summarize existing approaches for the design and validation of Finite Element models of the soft tissues of the human finger and hand, evaluating their capability to provide results that are valuable in understanding tactile perception. The goal of our work is to serve as a reference and provide guidelines for those approaching this modelling method for the study of human haptic perception.

Bumps and Dents are Not Perceptually Opposite When Exploring With Lateral Force Cues

Virtual tactile bumps and dents are presented by controlling frictional forces on a surface tactile display, a flat touch screen with tactile feedback functions. This technology enables users to touch and feel three-dimensional objects. The resistive force against a sliding finger is increased and then decreased compared to a base level to present a bump. The order of increase and decrease is inverted for a dent. Thus, the difference between bump and dent presentations lies in the change order of the resistive force. However, bumps and dents are not simply opposite when investigating psychophysical functions with only lateral force cues available, without height and depth information. The results demonstrate that bumps are more easily detected with high surface gradients or resultant force changes and small widths. In contrast, these parameters do not influence the detection of dents among different participants. These findings contribute to a deeper understanding of tactile perception of surface shapes.

Normal and tangential forces combine to convey contact pressure during dynamic tactile stimulation

Humans need to accurately process the contact forces that arise as they perform everyday haptic interactions such as sliding the fingers along a surface to feel for bumps, sticky regions, or other irregularities. Several different mechanisms are possible for how the forces on the skin could be represented and integrated in such interactions. In this study, we used a force-controlled robotic platform and simultaneous ultrasonic modulation of the finger-surface friction to independently manipulate the normal and tangential forces during passive haptic stimulation by a flat surface. To assess whether the contact pressure on their finger had briefly increased or decreased during individual trials in this broad stimulus set, participants did not rely solely on either the normal force or the tangential force. Instead, they integrated tactile cues induced by both components. Support-vector-machine analysis classified physical trial data with up to 75% accuracy and suggested a linear perceptual mechanism. In addition, the change in the amplitude of the force vector predicted participants' responses better than the change of the coefficient of dynamic friction, suggesting that intensive tactile cues are meaningful in this task. These results provide novel insights about how normal and tangential forces shape the perception of tactile contact.

Elastohydrodynamic friction of robotic and human fingers on soft micropatterned substrates

Frictional sliding between patterned surfaces is of fundamental and practical importance in the haptic engineering of soft materials. In emerging applications such as remote surgery and soft robotics, thin fluid films between solid surfaces lead to a multiphysics coupling between solid deformation and fluid dissipation. Here, we report a scaling law that governs the peak friction values of elastohydrodynamic lubrication on patterned surfaces. These peaks, absent in smooth tribopairs, arise due to a separation of length scales in the lubricant flow. The framework is generated by varying the geometry, elasticity and fluid properties of soft tribopairs and measuring the lubricated friction with a triborheometer. The model correctly predicts the elastohydrodynamic lubrication friction of a bioinspired robotic fingertip and human fingers. Its broad applicability can inform the future design of robotic hands or grippers in realistic conditions, and open up new ways of encoding friction into haptic signals.

Predicting human touch sensitivity to single atom substitutions in surface monolayers for molecular control in tactile interfaces

The mechanical stimuli generated as a finger interrogates the physical and chemical features of an object form the basis of fine touch. Haptic devices, which are used to control touch, primarily focus on recreating physical features, but the chemical aspects of fine touch may be harnessed to create richer tactile interfaces and reveal fundamental aspects of tactile perception. To connect tactile perception with molecular structure, we systematically varied silane-derived monolayers deposited onto surfaces smoother than the limits of human perception. Through mechanical friction testing and cross-correlation analysis, we made predictions of which pairs of silanes might be distinguishable by humans. We predicted, and demonstrated, that humans can distinguish between two isosteric silanes which differ only by a single nitrogen-for-carbon substitution. The mechanism of tactile contrast originates from a difference in monolayer ordering, as quantified by the Hurst exponent, which was replicated in two alkylsilanes with a three-carbon difference in length. This approach may be generalizable to other materials and lead to new tactile sensations derived from materials chemistry.

Friction sensing mechanisms for perception and motor control: passive touch without sliding may not provide perceivable frictional information

Perception of the frictional properties of a surface contributes to the multidimensional experience of exploring various materials; we slide our fingers over a surface to feel it. In contrast, during object manipulation, we grip objects without such intended exploratory movements. Given that we are aware of the slipperiness of objects or tools that are held in the hand, we investigated whether the initial contact between the fingertip skin and the surface of the object is sufficient to provide this consciously perceived frictional information. Using a two-alternative forced-choice protocol, we examined human capacity to detect frictional differences using touch, when two otherwise structurally identical surfaces were brought in contact with the immobilized finger perpendicularly or under an angle (20° or 30°) to the skin surface (passive touch). An ultrasonic friction reduction device was used to generate three different frictions over each of three flat surfaces with different surface structure: 1) smooth glass, 2) textured surface with dome-shaped features, and 3) surface with sharp asperities (sandpaper). Participants (n = 12) could not reliably indicate which of the two surfaces was more slippery under any of these conditions. In contrast, when slip was induced by moving the surface laterally by a total of 5 mm (passive slip), participants could clearly perceive frictional differences. Thus making contact with the surface, even with moderate tangential forces, was not enough to perceive frictional differences, instead conscious perception required a sufficient size slip.NEW & NOTEWORTHY This study contributes to understanding how frictional information is obtained and used by the brain. When the skin is contacting surfaces of identical topography but varying frictional properties, the deformation pattern is different; however, available sensory cues did not get translated into perception of frictional properties unless a sufficiently large lateral movement was present. These neurophysiological findings may inform how to design and operate haptic devices relying on friction modulation principles.

Information about contact force and surface texture is mixed in the firing rates of cutaneous afferent neurons

Cutaneous mechanoreceptors in our hands gather information about the objects we handle. Tactile fibers encode mixed information about contact events and object properties. Neural coding in tactile afferents is typically studied by varying a single aspect of tactile stimuli, avoiding the confounds of real-world haptic interactions. We instead record responses of small populations of dorsal root ganglia (DRG) neurons to variable tactile stimuli and find that neurons primarily respond to force, though some texture information can be detected. Tactile nerve fibers convey information about many features of haptic interactions, including the force and speed of contact, as well as the texture and shape of the objects being handled. How we perceive these object features is relatively unaffected by the forces and movements we use when interacting with the object. Because signals related to contact events and object properties are mixed in the responses of tactile fibers, our ability to disentangle these different components of our tactile experience implies that they are demultiplexed as they propagate along the neuraxis. To understand how texture and contact mechanics are encoded together by tactile fibers, we studied the activity of multiple neurons recorded simultaneously in the cervical DRG of two anesthetized rhesus monkeys while textured surfaces were applied to the glabrous skin of the fingers and palm using a handheld probe. A transducer at the tip of the textured probe measured contact forces as tactile stimuli were applied at different locations on the finger-pads and palm. We examined how a sample population of DRG neurons encode force and texture and found that firing rates of individual neurons are modulated by both force and texture. In particular, slowly adapting (SA) neurons were more responsive to force than texture, and rapidly adapting (RA) neurons were more responsive to texture than force. Although force could be decoded accurately throughout the entire contact interval, texture signals were most salient during onset and offset phases of the contact interval.NEW & NOTEWORTHY Cutaneous mechanoreceptors in our hands gather information about the objects we handle. Tactile fibers encode mixed information about contact events and object properties. Neural coding in tactile afferents is typically studied by varying a single aspect of tactile stimuli, avoiding the confounds of real-world haptic interactions. We instead record responses of small populations of DRG neurons to variable tactile stimuli and find that neurons primarily respond to force, though some texture information can be detected.

Tactile perception of randomly rough surfaces

Most everyday surfaces are randomly rough and self-similar on sufficiently small scales. We investigated the tactile perception of randomly rough surfaces using 3D-printed samples, where the topographic structure and the statistical properties of scale-dependent roughness were varied independently. We found that the tactile perception of similarity between surfaces was dominated by the statistical micro-scale roughness rather than by their topographic resemblance. Participants were able to notice differences in the Hurst roughness exponent of 0.2, or a difference in surface curvature of 0.8 \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hbox {mm}^{-1}$$\end{document}mm-1 for surfaces with curvatures between 1 and 3 \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hbox {mm}^{-1}$$\end{document}mm-1. In contrast, visual perception of similarity between color-coded images of the surface height was dominated by their topographic resemblance. We conclude that vibration cues from roughness at the length scale of the finger ridge distance distract the participants from including the topography into the judgement of similarity. The interaction between surface asperities and fingertip skin led to higher friction for higher micro-scale roughness. Individual friction data allowed us to construct a psychometric curve which relates similarity decisions to differences in friction. Participants noticed differences in the friction coefficient as small as 0.035 for samples with friction coefficients between 0.34 and 0.45.

Role of indentation depth and contact area on human perception of softness for haptic interfaces

In engineering, the "softness" of an object, as measured by an indenter, manifests as two measurable parameters: (i) indentation depth and (ii) contact area. For humans, softness is not well defined, although it is believed that perception depends on the same two parameters. Decoupling their relative contributions, however, has not been straightforward because most bulk-"off-the-shelf"-materials exhibit the same ratio between the indentation depth and contact area. Here, we decoupled indentation depth and contact area by fabricating elastomeric slabs with precise thicknesses and microstructured surfaces. Human subject experiments using two-alternative forced-choice and magnitude estimation tests showed that the indentation depth and contact area contributed independently to perceived softness. We found an explicit relationship between the perceived softness of an object and its geometric properties. Using this approach, it is possible to design objects for human interaction with a desired level of perceived softness.

The Perception of Ultrasonic Square Reductions of Friction With Variable Sharpness and Duration

The human perception of square ultrasonic modulation of the finger-surface friction was investigated during active tactile exploration by using short frictional cues of varying duration and sharpness. In a first experiment, we asked participants to discriminate the transition time and duration of short square ultrasonic reductions of friction. They proved very sensitive to discriminate millisecond differences in these two parameters with the average psychophysical thresholds being 2.3-2.4 ms for both parameters. A second experiment focused on the perception of square friction reductions with variable transition times and durations. We found that for durations of the stimulation larger than 90 ms, participants often perceived three or four edges when only two stimulations were presented while they consistently felt two edges for signals shorter than 50 ms. A subsequent analysis of the contact forces induced by these ultrasonic stimulations during slow and fast active exploration showed that two identical consecutive ultrasonic pulses can induce significantly different frictional dynamics especially during fast motion of the finger. These results confirm the human sensitivity to transient frictional cues and suggest that the human perception of square reductions of friction can depend on their sharpness and duration as well as on the speed of exploration.

Evaluation of Electrovibration Stimulation with a Narrow Electrode

Recently, electrovibration tactile displays were studied and applied to several use cases by researchers. The high-resolution electrode for electrovibration stimulus will contribute to the presentation of a more realistic tactile sensation. However, the sizes of the electrodes that have been used thus far are of the millimeter-order. In this study, we evaluated whether a single narrow electrode was able to provide the electrovibration stimulus adequately. The widths of the prepared electrodes were 10, 20, 50, 100, 200, and 500 μm. We conducted a sensory experiment to characterize each electrode. The electrodes with widths of 50 μm or less were not durable or suitable for the applied signal, although the subjects perceived the stimulus. Therefore, we conducted the experiment without using these non-durable electrodes. The voltage waveform condition affected perception, and the subjects were not sensitive to the electrovibration stimulus at low frequencies. In addition, the stroke direction of the fingertip had a significant effect on perception under certain conditions. The results indicate that electrovibration stimulation requires an electrode with a width of only a few hundred micrometers for stimulation.

Complexity, rate, and scale in sliding friction dynamics between a finger and textured surface

Sliding friction between the skin and a touched surface is highly complex, but lies at the heart of our ability to discriminate surface texture through touch. Prior research has elucidated neural mechanisms of tactile texture perception, but our understanding of the nonlinear dynamics of frictional sliding between the finger and textured surfaces, with which the neural signals that encode texture originate, is incomplete. To address this, we compared measurements from human fingertips sliding against textured counter surfaces with predictions of numerical simulations of a model finger that resembled a real finger, with similar geometry, tissue heterogeneity, hyperelasticity, and interfacial adhesion. Modeled and measured forces exhibited similar complex, nonlinear sliding friction dynamics, force fluctuations, and prominent regularities related to the surface geometry. We comparatively analysed measured and simulated forces patterns in matched conditions using linear and nonlinear methods, including recurrence analysis. The model had greatest predictive power for faster sliding and for surface textures with length scales greater than about one millimeter. This could be attributed to the the tendency of sliding at slower speeds, or on finer surfaces, to complexly engage fine features of skin or surface, such as fingerprints or surface asperities. The results elucidate the dynamical forces felt during tactile exploration and highlight the challenges involved in the biological perception of surface texture via touch.