Touch uses frictional cues to discriminate flat materials

Alternatives to Friction Coefficient: Role of Frictional Instabilities on Fine Touch Perception

Fine touch perception is often correlated to material properties and friction coefficients, but the inherent variability of human motion has led to low correlations and contradictory findings. Instead, we hypothesized that humans use frictional instabilities to discriminate between objects. We constructed a set of coated surfaces with minimal physical differences that by themselves, are not perceptible to people, but instead, due to modification in surface chemistry, the surfaces created different types of instabilities based on how quickly a finger is slid and how hard a human finger is pressed during sliding. We found that participant accuracy in tactile discrimination most strongly correlated with formations of steady sliding, and response times negatively correlated with stiction spikes. Conversely, traditional metrics like surface roughness or average friction coefficient did not predict tactile discriminability. In fact, the typical method of averaging friction coefficients led to a spurious correlation which erroneously suggests that distinct objects should feel identical and identical objects should feel distinct. Identifying the central role of frictional instabilities as an alternative to using friction coefficients should accelerate the design of tactile interfaces for psychophysics and haptics.

Active touch in tactile perceptual discrimination: brain activity and behavioral responses to surface differences

This study investigates the neural and behavioral mechanisms of tactile perceptual discrimination using fMRI and a set of wrinkled surface stimuli with varying textures. Fifteen female participants were tasked with distinguishing between different surfaces by touch alone. Behavioral results demonstrated variable discriminability across conditions, reflecting the tactile sensitivity of human fingertips. Neural analysis showed varied brain activations tied to the task's difficulty. In the easiest least fine-grained discrimination condition, widespread activations were observed across sensory and integration regions. As task difficulty increased, stronger parietal and frontal lobe involvement reflected higher cognitive demands. In the hardest most fine-grained discrimination condition, activation concentrated in the right frontal lobe, indicating reliance on executive functions. These results highlight the brain's intricate role in processing sensory information during tactile discrimination tasks of varying difficulty. As task difficulty increases, the brain adapts by engaging additional neural resources to meet higher cognitive demands. This research advances our understanding of the psychophysical and neural bases of tactile discrimination acuity, with practical implications for designing materials that enhance tactile feedback.

Self-assembled thin films as alternative surface textures in assistive aids with users who are blind

Current tactile graphics primarily render tactile information for blind users through physical features, such as raised bumps or lines. However, the variety of distinctive physical features that can be created is effectively saturated, and alternatives to these physical features are not currently available for static tactile aids. Here, we explored the use of chemical modification through self-assembled thin films to generate distinctive textures in tactile aids. We used two silane precursors, n-butylaminopropyltrimethoxysilane and n-pentyltrichlorosilane, to coat playing card surfaces and investigated their efficacy as a tactile coating. We verified the surface coating process and examined their durability to repeated use by traditional materials characterization and custom mesoscale friction testing. Finally, we asked participants who were both congenitally blind and braille-literate to sort the cards based on touch. We found that participants were able to identify the correct coated card with 82% accuracy, which was significantly above chance, and two participants achieved 100% accuracy. This success with study participants demonstrates that surface coatings and surface modifications might augment or complement physical textures in next-generation tactile aids.

Perceptual Constancy in the Speed Dependence of Friction During Active Tactile Exploration

Fingertip friction is a key component of tactile perception. In active tactile exploration, friction forces depend on the applied normal force and on the sliding speed chosen. We have investigated whether humans perceive the speed dependence of friction for textured surfaces of materials, which show either increase or decrease of the friction coefficient with speed. Participants perceived the decrease or increase when the relative difference in friction coefficient between fast and slow sliding speed was more than 20%. The fraction of comparison judgments which were in agreement with the measured difference in friction coefficient did not depend on variations in the applied normal force. The results indicate a perceptual constancy for fingertip friction with respect to self-generated variations of sliding speed and applied normal force.

Tactile Perception of Coated Smooth Surfaces

Although surface coating is commonly utilized in many industries for improving the aesthetics and functionality of the end product, our tactile perception of coated surfaces has not been investigated in depth yet. In fact, there are only a few studies investigating the effect of coating material on our tactile perception of extremely smooth surfaces having roughness amplitudes in the order of a few nanometers. Moreover, the current literature needs more studies linking the physical measurements performed on these surfaces to our tactile perception in order to further understand the adhesive contact mechanism leading to our percept. In this study, we first perform 2AFC experiments with 8 participants to quantify their tactile discrimination ability of 5 smooth glass surfaces coated with 3 different materials. We then measure the coefficient of friction between human finger and those 5 surfaces via a custom-made tribometer and their surface energies via Sessile drop test performed with 4 different liquids. The results of our psychophysical experiments and the physical measurements show that coating material has a strong influence on our tactile perception and human finger is capable of detecting differences in surface chemistry due to, possibly, molecular interactions.

Masking Vibrations and Contact Force Affect the Discrimination of Slip Motion Speed in Touch

Multiple cues contribute to the discrimination of slip motion speed by touch. In our previous article, we demonstrated that masking vibrations at various frequencies impaired the discrimination of speed. In this article, we extended the previous results to evaluate this phenomenon on a smooth glass surface, and for different values of contact force and duration of the masking stimulus. Speed discrimination was significantly impaired by masking vibrations at high but not at low contact force. Furthermore, a short pulse of masking vibrations at motion onset produced a similar effect as the long masking stimulus, delivered throughout slip motion duration. This last result suggests that mechanical events at motion onset provide important cues to the discrimination of speed.

The neural basis of tactile texture perception

Running our fingers across a textured surface gives rise to two types of skin deformations, each transduced by different tactile nerve fibers. Coarse features produce large-scale skin deformations whose spatial configuration is reflected in the spatial pattern of activation of some tactile fibers. Scanning a finely textured surface elicits vibrations in the skin, which in turn evoked temporally patterned responses in other fibers. These two neural codes-spatial and temporal-drive a spectrum of neural response properties in somatosensory cortex: At one extreme, neurons are sensitive to spatial patterns and encode coarse features; at the other extreme, neurons are sensitive to vibrations and encode fine features. While the texture responses of nerve fibers are dependent on scanning speed, those of cortical neurons are less so, giving rise to a speed invariant texture percept. Neurons in high-level somatosensory cortices combine information about texture with information about task variables.

Naturalistic stimuli in touch research

Neural mechanisms of touch are typically studied in laboratory settings using robotic or other types of well-controlled devices. Such stimuli are very different from highly complex naturalistic human-to-human touch interactions. The lack of scientifically useful naturalistic stimuli hampers progress, particularly in social touch research. Vision science, on the other hand, has benefitted from inventions such as virtual reality systems that have provided researchers with precision control of naturalistic stimuli. In the field of touch research, producing and manipulating stimuli is particularly challenging due to the complexity of skin mechanics. Here, we review the history of touch neuroscience focusing on the contrast between strictly controlled and naturalistic stimuli, and compare the field to vision science. We discuss new methods that may overcome obstacles with precision-controlled tactile stimuli, and recent successes in naturalistic texture production. In social touch research, precise tracking and measurement of naturalistic human-to-human touch interactions offer exciting new possibilities.

Controlling fine touch sensations with polymer tacticity and crystallinity

The friction generated between a finger and an object forms the mechanical stimuli behind fine touch perception. To control friction, and therefore tactile perception, current haptic devices typically rely on physical features like bumps or pins, but chemical and microscale morphology of surfaces could be harnessed to recreate a wider variety of tactile sensations. Here, we sought to develop a new way to create tactile sensations by relying on differences in microstructure as quantified by the degree of crystallinity in polymer films. To isolate crystallinity, we used polystyrene films with the same chemical formula and number averaged molecular weights, but which differed in tacticity and annealing conditions. These films were also sufficiently thin as to be rigid which minimized effects from bulk stiffness and had variations in roughness lower than detectable by humans. To connect crystallinity to human perception, we performed mechanical testing with a mock finger to form predictions about the degree of crystallinity necessary to result in successful discrimination by human subjects. Psychophysical testing verified that humans could discriminate surfaces which differed only in the degree of crystallinity. Although related, human performance was not strongly correlated with a straightforward difference in the degree of crystallinity. Rather, human performance was better explained by quantifying transitions in steady to unsteady sliding and the generation of slow frictional waves (r2 = 79.6%). Tuning fine touch with polymer crystallinity may lead to better engineering of existing haptic interfaces or lead to new classes of actuators based on changes in microstructure.

Normal and tangential forces combine to convey contact pressure during dynamic tactile stimulation

Humans need to accurately process the contact forces that arise as they perform everyday haptic interactions such as sliding the fingers along a surface to feel for bumps, sticky regions, or other irregularities. Several different mechanisms are possible for how the forces on the skin could be represented and integrated in such interactions. In this study, we used a force-controlled robotic platform and simultaneous ultrasonic modulation of the finger-surface friction to independently manipulate the normal and tangential forces during passive haptic stimulation by a flat surface. To assess whether the contact pressure on their finger had briefly increased or decreased during individual trials in this broad stimulus set, participants did not rely solely on either the normal force or the tangential force. Instead, they integrated tactile cues induced by both components. Support-vector-machine analysis classified physical trial data with up to 75% accuracy and suggested a linear perceptual mechanism. In addition, the change in the amplitude of the force vector predicted participants' responses better than the change of the coefficient of dynamic friction, suggesting that intensive tactile cues are meaningful in this task. These results provide novel insights about how normal and tangential forces shape the perception of tactile contact.

Initial contact shapes the perception of friction

Humans have the remarkable ability to manipulate a large variety of objects, regardless of how fragile, heavy, or slippery they are. To correctly scale the grip forces, the nervous system gauges the slipperiness of the surface. This information is present at the instant we first touch an object, even before any lateral force develops. However, how friction could be estimated without slippage only from the fingertip skin deformation is not understood, either in neuroscience or engineering disciplines. This study demonstrates that a radial tensile strain of the skin is involved in the perception of slipperiness during this initial contact. These findings can inform the design of advanced tactile sensors for robotics or prosthetics and for improving haptic human–machine interactions.

Humans efficiently estimate the grip force necessary to lift a variety of objects, including slippery ones. The regulation of grip force starts with the initial contact and takes into account the surface properties, such as friction. This estimation of the frictional strength has been shown to depend critically on cutaneous information. However, the physical and perceptual mechanism that provides such early tactile information remains elusive. In this study, we developed a friction-modulation apparatus to elucidate the effects of the frictional properties of objects during initial contact. We found a correlation between participants’ conscious perception of friction and radial strain patterns of skin deformation. The results provide insights into the tactile cues made available by contact mechanics to the sensorimotor regulation of grip, as well as to the conscious perception of the frictional properties of an object.

Elastohydrodynamic friction of robotic and human fingers on soft micropatterned substrates

Frictional sliding between patterned surfaces is of fundamental and practical importance in the haptic engineering of soft materials. In emerging applications such as remote surgery and soft robotics, thin fluid films between solid surfaces lead to a multiphysics coupling between solid deformation and fluid dissipation. Here, we report a scaling law that governs the peak friction values of elastohydrodynamic lubrication on patterned surfaces. These peaks, absent in smooth tribopairs, arise due to a separation of length scales in the lubricant flow. The framework is generated by varying the geometry, elasticity and fluid properties of soft tribopairs and measuring the lubricated friction with a triborheometer. The model correctly predicts the elastohydrodynamic lubrication friction of a bioinspired robotic fingertip and human fingers. Its broad applicability can inform the future design of robotic hands or grippers in realistic conditions, and open up new ways of encoding friction into haptic signals.

Measuring fingerpad deformation during active object manipulation

During active object manipulation, the finger-object interactions give rise to complex fingertip skin deformations. These deformations are in turn encoded by the local tactile afferents and provide rich and behaviorally relevant information to the central nervous system. Most of the work studying the mechanical response of the finger to dynamic loading has been performed under a passive setup, thereby precisely controlling the kinematics or the dynamics of the loading. However, to identify aspects of the deformations that are relevant to online control during object manipulation, it is desirable to measure the skin response in an active setup. To that end, we developed a device that allows us to monitor finger forces, skin deformations, and kinematics during fine manipulation. We describe the device in detail and test it to precisely describe how the fingertip skin in contact with the object deforms during a simple vertical oscillation task. We show that the level of grip force directly influences the fingerpad skin strains and that the strain rates are substantial during active manipulation (norm up to 100%/s). The developed setup will enable us to causally relate sensory information, i.e. skin deformation, to online control, i.e. grip force adjustment, in future studies.NEW & NOTEWORTHY We present a novel device, a manipulandum, that enables to image the contact between the finger and the contact surface during active manipulation of the device. The device is tested in a simple vertical oscillation task involving 18 participants. We demonstrate that substantial surface skin strains take place at the finger-object interface and argue that those deformations provide essential information for grasp stability during object manipulation.

Harnessing tactile waves to measure skin-to-skin interactions

Skin-to-skin touch is an essential form of tactile interaction, yet there is no known method to quantify how we touch our own skin or someone else's skin. Skin-to-skin touch is particularly challenging to measure objectively, since interposing an instrumented sheet, no matter how thin and flexible, between the interacting skins is not an option. To fill this gap, we explored a technique that takes advantage of the propagation of vibrations from the locus of touch to pick up a signal that contains information about skin-to-skin tactile interactions. These "tactile waves" were measured by an accelerometer sensor placed on the touching finger. Applied pressure and speed had a direct influence on measured signal power when the target of touch was the self or another person. The measurements were insensitive to changes in the location of the sensor relative to the target. Our study suggests that this method has potential for probing behaviour during skin-to-skin tactile interactions and could be a valuable technique to study social touch, self-touch, and motor control. The method is non-invasive, easy to commission, inexpensive, and robust.

Human low-threshold mechanoafferent responses to pure changes in friction controlled using an ultrasonic haptic device

The forces that are developed when manipulating objects generate sensory cues that inform the central nervous system about the qualities of the object’s surface and the status of the hand/object interaction. Afferent responses to frictional transients or slips have been studied in the context of lifting/holding tasks. Here, we used microneurography and an innovative tactile stimulator, the Stimtac, to modulate both the friction level of a surface, without changing the surface or adding a lubricant, and, to generate the frictional transients in a pure and net fashion. In three protocols, we manipulated: the frictional transients, the friction levels, the rise times, the alternation of phases of decrease or increase in friction to emulate grating-like stimuli. Afferent responses were recorded in 2 FAIs, 1 FAII, 2 SAIs and 3 SAIIs from the median nerve of human participants. Independently of the unit type, we observed that: single spikes were generated time-locked to the frictional transients, and that reducing the friction level reduced the number of spikes during the stable phase of the stimulation. Our results suggest that those frictional cues are encoded in all the unit types and emphasize the possibility to use the Stimtac device to control mechanoreceptor firing with high temporal precision.

Predicting human touch sensitivity to single atom substitutions in surface monolayers for molecular control in tactile interfaces

The mechanical stimuli generated as a finger interrogates the physical and chemical features of an object form the basis of fine touch. Haptic devices, which are used to control touch, primarily focus on recreating physical features, but the chemical aspects of fine touch may be harnessed to create richer tactile interfaces and reveal fundamental aspects of tactile perception. To connect tactile perception with molecular structure, we systematically varied silane-derived monolayers deposited onto surfaces smoother than the limits of human perception. Through mechanical friction testing and cross-correlation analysis, we made predictions of which pairs of silanes might be distinguishable by humans. We predicted, and demonstrated, that humans can distinguish between two isosteric silanes which differ only by a single nitrogen-for-carbon substitution. The mechanism of tactile contrast originates from a difference in monolayer ordering, as quantified by the Hurst exponent, which was replicated in two alkylsilanes with a three-carbon difference in length. This approach may be generalizable to other materials and lead to new tactile sensations derived from materials chemistry.

High-resolution imaging of skin deformation shows that afferents from human fingertips signal slip onset

Human tactile afferents provide essential feedback for grasp stability during dexterous object manipulation. Interacting forces between an object and the fingers induce slip events that are thought to provide information about grasp stability. To gain insight into this phenomenon, we made a transparent surface slip against a fixed fingerpad while monitoring skin deformation at the contact. Using microneurography, we simultaneously recorded the activity of single tactile afferents innervating the fingertips. This unique combination allowed us to describe how afferents respond to slip events and to relate their responses to surface deformations taking place inside their receptive fields. We found that all afferents were sensitive to slip events, but fast-adapting type I (FA-I) afferents in particular faithfully encoded compressive strain rates resulting from those slips. Given the high density of FA-I afferents in fingerpads, they are well suited to detect incipient slips and to provide essential information for the control of grip force during manipulation.

Each fingertip hosts thousands of nerve fibers that allow us to handle objects with great dexterity. These fibers relay the amount of friction between the skin and the item, and the brain uses this sensory feedback to adjust the grip as necessary. Yet, exactly how tactile nerve fibers encode information about friction remains largely unknown.

Previous research has suggested that friction might not be recorded per se in nerve signals to the brain. Instead, fibers in the finger pad might be responding to localized ‘partial slips’ that indicate an impending loss of grip. Indeed, when lifting an object, fingertips are loaded with a tangential force that puts strain on the skin, resulting in subtle local deformations. Nerve fibers might be able to detect these skin changes, prompting the brain to adjust an insecure grip before entirely losing grasp of an object.

However, technical challenges have made studying the way tactile nerve fibers respond to slippage and skin strain difficult. For the first time, Delhaye et al. have now investigated how these fibers respond to and encode information about the strain placed on fingertips as they are loaded tangentially. A custom-made imaging apparatus was paired with standard electrodes to record the activity of four different kinds of tactile nerve fibers in participants who had a fingertip placed against a plate of glass. The imaging focused on revealing changes in skin surface as tangential force was applied; the electrodes measured impulses from individual nerve fibers from the fingertip. While all the fibers responded during partial slips, fast-adapting type 1 nerves generated strong responses that signal a local loss of grip. Recordings showed that these fibers consistently encoded changes in the skin strain patterns, and were more sensitive to skin compressions related to slippage than to stretch.

These results show how tactile nerve fibers encode the subtle skin compressions created when fingers handle objects. The methods developed by Delhaye et al. could further be used to explore the response properties of tactile nerve fibers, sensory feedback and grip.

How to Measure the Area of Real Contact of Skin on Glass

The contact between the fingertip and an object is formed by a collection of micro-scale junctions, which collectively constitute the real contact area. This real area of contact is only a fraction of the apparent area of contact and is directly linked to the frictional strength of the contact (i.e., the lateral force at which the finger starts sliding). As a consequence, a measure of this area of real contact can help probe into the mechanism behind the friction of skin on glass. In this article, we present two methods to measure the variations of contact area; one that improves upon a tried-and-true fingertip imaging technique to provide ground truth, and the other that relies on the absorption and reflection of acoustic energy. To achieve precise measurements, the ultrasonic method exploits a recently developed model of the interaction that incorporates the non-linearity of squeeze film levitation. The two methods are in good agreement ($\rho =0.94$) over a large range of normal forces and vibration amplitudes. Since the real area of contact fundamentally underlies fingertip friction, the methods described in the article have importance for studying human grasping, understanding friction perception, and controlling surface-haptic devices.

A review of the neurobiomechanical processes underlying secure gripping in object manipulation

O'SHEA, H. and S. J. Redmond. A review of the neurobiomechanical processes underlying secure gripping in object manipulation. NEUROSCI BIOBEHAV REV 286-300, 2021. Humans display skilful control over the objects they manipulate, so much so that biomimetic systems have yet to emulate this remarkable behaviour. Two key control processes are assumed to facilitate such dexterity: predictive cognitive-motor processes that guide manipulation procedures by anticipating action outcomes; and reactive sensorimotor processes that provide important error-based information for movement adaptation. Notwithstanding increased interdisciplinary research interest in object manipulation behaviour, the complexity of the perceptual-sensorimotor-cognitive processes involved and the theoretical divide regarding the fundamentality of control mean that the essential mechanisms underlying manipulative action remain undetermined. In this paper, following a detailed discussion of the theoretical and empirical bases for understanding human dexterous movement, we emphasise the role of tactile-related sensory events in secure object handling, and consider the contribution of certain biophysical and biomechanical phenomena. We aim to provide an integrated account of the current state-of-art in skilled human-object interaction that bridges the literature in neuroscience, cognitive psychology, and biophysics. We also propose novel directions for future research exploration in this area.

Friction sensing mechanisms for perception and motor control: passive touch without sliding may not provide perceivable frictional information

Perception of the frictional properties of a surface contributes to the multidimensional experience of exploring various materials; we slide our fingers over a surface to feel it. In contrast, during object manipulation, we grip objects without such intended exploratory movements. Given that we are aware of the slipperiness of objects or tools that are held in the hand, we investigated whether the initial contact between the fingertip skin and the surface of the object is sufficient to provide this consciously perceived frictional information. Using a two-alternative forced-choice protocol, we examined human capacity to detect frictional differences using touch, when two otherwise structurally identical surfaces were brought in contact with the immobilized finger perpendicularly or under an angle (20° or 30°) to the skin surface (passive touch). An ultrasonic friction reduction device was used to generate three different frictions over each of three flat surfaces with different surface structure: 1) smooth glass, 2) textured surface with dome-shaped features, and 3) surface with sharp asperities (sandpaper). Participants (n = 12) could not reliably indicate which of the two surfaces was more slippery under any of these conditions. In contrast, when slip was induced by moving the surface laterally by a total of 5 mm (passive slip), participants could clearly perceive frictional differences. Thus making contact with the surface, even with moderate tangential forces, was not enough to perceive frictional differences, instead conscious perception required a sufficient size slip.NEW & NOTEWORTHY This study contributes to understanding how frictional information is obtained and used by the brain. When the skin is contacting surfaces of identical topography but varying frictional properties, the deformation pattern is different; however, available sensory cues did not get translated into perception of frictional properties unless a sufficiently large lateral movement was present. These neurophysiological findings may inform how to design and operate haptic devices relying on friction modulation principles.

Modelling the effects of age-related morphological and mechanical skin changes on the stimulation of tactile mechanoreceptors

Our sense of fine touch deteriorates as we age, a phenomenon typically associated with neurological changes to the skin. However, geometric and material changes to the skin may also play an important role on tactile perception and have not been studied in detail. Here, a finite element model is utilised to assess the extent to which age-related structural changes to the skin influence the tactile stimuli experienced by the mechanoreceptors. A numerical, hyperelastic, four-layered skin model was developed to simulate sliding of the finger against a rigid surface. The strain, deviatoric stress and strain energy density were recorded at the sites of the Merkel and Meissner receptors, whilst parameters of the model were systematically varied to simulate age-related geometric and material skin changes. The simulations comprise changes in skin layer stiffness, flattening of the dermal-epidermal junction and thinning of the dermis. It was found that the stiffness of the skin layers has a substantial effect on the stimulus magnitudes recorded at mechanoreceptors. Additionally, reducing the thickness of the dermis has a substantial effect on the Merkel disc whilst the Meissner corpuscle is particularly affected by flattening of the dermal epidermal junction. In order to represent aged skin, a model comprising a combination of ageing manifestations revealed a decrease in stimulus magnitudes at both mechanoreceptor sites. The result from the combined model differed from the sum of effects of the individually tested ageing manifestations, indicating that the individual effects of ageing cannot be linearly superimposed. Each manifestation of ageing results in a decreased stimulation intensity at the Meissner Corpuscle site, suggesting that ageing reduces the proportion of stimuli meeting the receptor amplitude detection threshold. This model therefore offers an additional biomechanical explanation for tactile perceptive degradation amongst the elderly. Applications of the developed model are in the evaluation of cosmetics products aimed at mitigating the effects of ageing, e.g. through skin hydration and administration of antioxidants, as well as in the design of products with improved tactile sensation, e.g. through the optimisation of materials and surface textures.

Organic Haptics: Intersection of Materials Chemistry and Tactile Perception

The goal of the field of haptics is to create technologies that manipulate the sense of touch. In virtual and augmented reality, haptic devices are for touch what loudspeakers and RGB displays are for hearing and vision. Haptic systems that utilize micromotors or other miniaturized mechanical devices (e.g., for vibration and pneumatic actuation) produce interesting effects, but are quite far from reproducing the feeling of real materials. They are especially deficient in recapitulating surface properties: fine texture, friction, viscoelasticity, tack, and softness. The central argument of this Progress Report is that to reproduce the feel of everyday objects requires chemistry: molecular control over the properties of materials and ultimately design of materials which can change these properties in real time. Stimuli-responsive organic materials, such as polymers and composites, are a class of materials which can change their oxidation state, conductivity, shape, and rheological properties, and thus might be useful in future haptic technologies. Moreover, the use of such materials in research on tactile perception could help elucidate the limits of human tactile sensitivity. The work described represents the beginnings of this new area of inquiry, in which the defining approach is the marriage of materials science and psychology.

The finishing touches: the role of friction and roughness in haptic perception of surface coatings

Humans are extraordinarily skilled in the tactile evaluation of, and differentiation between, surfaces. The chemical and mechanical properties of these surfaces are translated into tactile signals during haptic exploration by mechanoreceptors in our skin, which are specialized to respond to different types of temporal and mechanical stimulation. Describing the effects of measurable physical characteristics on the human response to tactile exploration of surfaces is of great interest to manufacturers of household materials so that the haptic experience can be considered during design, product development and quality control. In this study, methods from psychophysics and materials science are combined to advance current understanding of which physical properties affect tactile perception of a range of furniture surfaces, i.e., foils and coatings, thus creating a tactile map of the furniture product landscape. Participants’ responses in a similarity scaling task were analyzed using INDSCAL from which three haptic dimensions were identified. Results show that specific roughness parameters, tactile friction and vibrational information, as characterized by a stylus profilometer, a Forceboard, and a biomimetic synthetic finger, are important for tactile differentiation and preferences of these surface treatments. The obtained dimensions are described as distinct combinations of the surface properties characterized, rather than as ‘roughness’ or ‘friction’ independently. Preferences by touch were related to the roughness, friction and thermal properties of the surfaces. The results both complement and advance current understanding of how roughness and friction relate to tactile perception of surfaces.

The Perception of Ultrasonic Square Reductions of Friction With Variable Sharpness and Duration

The human perception of square ultrasonic modulation of the finger-surface friction was investigated during active tactile exploration by using short frictional cues of varying duration and sharpness. In a first experiment, we asked participants to discriminate the transition time and duration of short square ultrasonic reductions of friction. They proved very sensitive to discriminate millisecond differences in these two parameters with the average psychophysical thresholds being 2.3-2.4 ms for both parameters. A second experiment focused on the perception of square friction reductions with variable transition times and durations. We found that for durations of the stimulation larger than 90 ms, participants often perceived three or four edges when only two stimulations were presented while they consistently felt two edges for signals shorter than 50 ms. A subsequent analysis of the contact forces induced by these ultrasonic stimulations during slow and fast active exploration showed that two identical consecutive ultrasonic pulses can induce significantly different frictional dynamics especially during fast motion of the finger. These results confirm the human sensitivity to transient frictional cues and suggest that the human perception of square reductions of friction can depend on their sharpness and duration as well as on the speed of exploration.

Psychophysical Evaluation of Change in Friction on an Ultrasonically-Actuated Touchscreen

To render tactile cues on a touchscreen by friction modulation, it is important to understand how humans perceive a change in friction. In this study, we investigate the relations between perceived change in friction on an ultrasonically actuated touchscreen and parameters involved in contact between finger and its surface. We first estimate the perceptual thresholds to detect rising and falling friction while a finger is sliding on the touch surface. Then, we conduct intensity scaling experiments and investigate the effect of finger sliding velocity, normal force, and rise/fall time of vibration amplitude (transition time) on the perceived intensity of change in friction. In order to better understand the role of contact mechanics, we also look into the correlations between the perceived intensities of subjects and several parameters involved in contact. The results of our experiments show that the contrast and rate of change in tangential force were best correlated with the perceived intensity. The subjects perceived rising friction more strongly than falling friction, particularly at higher tangential force contrast. We argue that this is due to hysteresis and viscoelastic behavior of fingertip under tangential loading. The results also showed that transition time and normal force have significant effect on our tactile perception.

Role of fingerprint-inspired relief structures in elastomeric slabs for detecting frictional differences arising from surface monolayers

The perception of fine texture of an object is influenced by its microscopic topography and surface chemistry-i.e., the topmost layer of atoms and molecules responsible for its surface energy, adhesion, and friction generated when probed by a fingertip. Recently, it has been shown that human subjects can discriminate high-energy (i.e., hydrophilic), oxidized silicon from low-energy (i.e., hydrophobic), fluorinated alkylsilane-coated silicon. The basis of discrimination was consistent with differences between stick-slip friction frequencies generated when sliding the fingertip across the two surfaces. One aspect that was not examined was the presence of surface relief structures on the fingertip. Indeed, papillary ridges-fingerprints-may be involved in enhanced discrimination of fine textures arising from surface roughness, but how (or whether) fingerprints may also be involved in the discrimination of surface chemistry-through its effect on friction-is unknown. Here, using a mock finger made from a slab of silicone rubber shows that relief structures amplify differences in stick-slip friction when slid across either a hydrophilic oxide or a hydrophobic monolayer on silicon. We quantify the similarity between the friction traces of the mock fingers sliding across hydrophilic and hydrophobic surfaces under varying velocities and applied masses using a cross-correlation analysis. We then convert the cross-correlational data into convenient "discriminability matrices." These matrices identify combinations of downward forces and sliding velocities that enhance differences in friction between hydrophilic and hydrophobic monolayers. In addition, a computational model of macroscopic, "rate-and-state" friction confirms that frictional differences in chemistry are amplified when elastic slabs bear a patterned interface. This biomimetic approach to engineering sliding interfaces may inform the development of improved electronic skin and haptic devices and may contribute to understanding the role of relief structure in tactile perception.

Complexity, rate, and scale in sliding friction dynamics between a finger and textured surface

Sliding friction between the skin and a touched surface is highly complex, but lies at the heart of our ability to discriminate surface texture through touch. Prior research has elucidated neural mechanisms of tactile texture perception, but our understanding of the nonlinear dynamics of frictional sliding between the finger and textured surfaces, with which the neural signals that encode texture originate, is incomplete. To address this, we compared measurements from human fingertips sliding against textured counter surfaces with predictions of numerical simulations of a model finger that resembled a real finger, with similar geometry, tissue heterogeneity, hyperelasticity, and interfacial adhesion. Modeled and measured forces exhibited similar complex, nonlinear sliding friction dynamics, force fluctuations, and prominent regularities related to the surface geometry. We comparatively analysed measured and simulated forces patterns in matched conditions using linear and nonlinear methods, including recurrence analysis. The model had greatest predictive power for faster sliding and for surface textures with length scales greater than about one millimeter. This could be attributed to the the tendency of sliding at slower speeds, or on finer surfaces, to complexly engage fine features of skin or surface, such as fingerprints or surface asperities. The results elucidate the dynamical forces felt during tactile exploration and highlight the challenges involved in the biological perception of surface texture via touch.

Photosynthetic Bioelectronic Sensors for Touch Perception, UV-Detection, and Nanopower Generation: Toward Self-Powered E-Skins

Energy self-sufficiency is an inspirational design feature of biological systems that fulfills sensory functions. Plants such as the "touch-me-not" and "Venus flytrap" not only sustain life by photosynthesis, but also execute specialized sensory responses to touch. Photosynthesis enables these organisms to sustainably harvest and expend energy, powering their sensory abilities. Photosynthesis therefore provides a promising model for self-powered sensory devices like electronic skins (e-skins). While the natural sensory abilities of human skin have been emulated in man-made materials for advanced prosthetics and soft-robotics, no previous e-skin has incorporated phototransduction and photosensory functions that could extend the sensory abilities of human skin. A proof-of-concept bioelectronic device integrated with natural photosynthetic pigment-proteins is presented that shows the ability to sense not only touch stimuli (down to 3000 Pa), but also low-intensity ultraviolet radiation (down to 0.01 mW cm^-2 ) and generate an electrical power of ≈260 nW cm^-2 . The scalability of this device is demonstrated through the fabrication of flexible, multipixel, bioelectronic sensors capable of touch registration and tracking. The polysensory abilities, energy self-sufficiency, and additional nanopower generation exhibited by this bioelectronic system make it particularly promising for applications like smart e-skins and wearable sensors, where the photogenerated power can enable remote data transmission.

Perception of partial slips under tangential loading of the fingertip

During tactile exploration, partial slips occur systematically at the periphery of fingertip-object contact prior to full slip. Although the mechanics of partial slips are well characterized, the perception of such events is unclear. Here, we performed psychophysical experiments to assess partial slip detection ability on smooth transparent surfaces. In these experiments, the index fingertip of human subjects was stroked passively by a smooth, transparent glass plate while we imaged the contact slipping against the glass. We found that subjects were able to detect fingertip slip before full slip occurred when, on average, only 48% of the contact area was slipping. Additionally, we showed that partial slips and plate displacement permitted slip detection, but that the subjects could not rely on tangential force to detect slipping of the plate. Finally, we observed that, keeping the normal contact force constant, slip detection was impeded when the plate was covered with a hydrophobic coating dramatically lowering the contact friction and therefore the amount of fingertip deformation. Together, these results demonstrate that partial slips play an important role in fingertip slip detection and support the hypothesis that the central nervous system relies on them to adjust grip force during object manipulation.

Contact geometry and mechanics predict friction forces during tactile surface exploration

When we touch an object, complex frictional forces are produced, aiding us in perceiving surface features that help to identify the object at hand, and also facilitating grasping and manipulation. However, even during controlled tactile exploration, sliding friction forces fluctuate greatly, and it is unclear how they relate to the surface topography or mechanics of contact with the finger. We investigated the sliding contact between the finger and different relief surfaces, using high-speed video and force measurements. Informed by these experiments, we developed a friction force model that accounts for surface shape and contact mechanical effects, and is able to predict sliding friction forces for different surfaces and exploration speeds. We also observed that local regions of disconnection between the finger and surface develop near high relief features, due to the stiffness of the finger tissues. Every tested surface had regions that were never contacted by the finger; we refer to these as “tactile blind spots”. The results elucidate friction force production during tactile exploration, may aid efforts to connect sensory and motor function of the hand to properties of touched objects, and provide crucial knowledge to inform the rendering of realistic experiences of touch contact in virtual reality.

The tactile perception of transient changes in friction

When we touch an object or explore a texture, frictional strains are induced by the tactile interactions with the surface of the object. Little is known about how these interactions are perceived, although it becomes crucial for the nascent industry of interactive displays with haptic feedback (e.g. smartphones and tablets) where tactile feedback based on friction modulation is particularly relevant. To investigate the human perception of frictional strains, we mounted a high-fidelity friction modulating ultrasonic device on a robotic platform performing controlled rubbing of the fingertip and asked participants to detect induced decreases of friction during a forced-choice task. The ability to perceive the changes in friction was found to follow Weber's Law of just noticeable differences, as it consistently depended on the ratio between the reduction in tangential force and the pre-stimulation tangential force. The Weber fraction was 0.11 in all conditions demonstrating a very high sensitivity to transient changes in friction. Humid fingers experienced less friction reduction than drier ones for the same intensity of ultrasonic vibration but the Weber fraction for detecting changes in friction was not influenced by the humidity of the skin.

Tactile Perception of Roughness and Hardness to Discriminate Materials by Friction-Induced Vibration

The human fingertip is an exquisitely powerful bio-tactile sensor in perceiving different materials based on various highly-sensitive mechanoreceptors distributed all over the skin. The tactile perception of surface roughness and material hardness can be estimated by skin vibrations generated during a fingertip stroking of a surface instead of being maintained in a static position. Moreover, reciprocating sliding with increasing velocities and pressures are two common behaviors in humans to discriminate different materials, but the question remains as to what the correlation of the sliding velocity and normal load on the tactile perceptions of surface roughness and hardness is for material discrimination. In order to investigate this correlation, a finger-inspired crossed-I beam structure tactile tester has been designed to mimic the anthropic tactile discrimination behaviors. A novel method of characterizing the fast Fourier transform integral (FFT) slope of the vibration acceleration signal generated from fingertip rubbing on surfaces at increasing sliding velocity and normal load, respectively, are defined as k_v and k_w, and is proposed to discriminate the surface roughness and hardness of different materials. Over eight types of materials were tested, and they proved the capability and advantages of this high tactile-discriminating method. Our study may find applications in investigating humanoid robot perceptual abilities.

Material recognition based on thermal cues: Mechanisms and applications

Some materials feel colder to the touch than others, and we can use this difference in perceived coldness for material recognition. This review focuses on the mechanisms underlying material recognition based on thermal cues. It provides an overview of the physical, perceptual, and cognitive processes involved in material recognition. It also describes engineering domains in which material recognition based on thermal cues have been applied. This includes haptic interfaces that seek to reproduce the sensations associated with contact in virtual environments and tactile sensors aim for automatic material recognition. The review concludes by considering the contributions of this line of research in both science and engineering.

Why pens have rubbery grips

The process by which human fingers gives rise to stable contacts with smooth, hard objects is surprisingly slow. Using high-resolution imaging, we found that, when pressed against glass, the actual contact made by finger pad ridges evolved over time following a first-order kinetics relationship. This evolution was the result of a two-stage coalescence process of microscopic junctions made between the keratin of the stratum corneum of the skin and the glass surface. This process was driven by the secretion of moisture from the sweat glands, since increased hydration in stratum corneum causes it to become softer. Saturation was typically reached within 20 s of loading the contact, regardless of the initial moisture state of the finger and of the normal force applied. Hence, the gross contact area, frequently used as a benchmark quantity in grip and perceptual studies, is a poor reflection of the actual contact mechanics that take place between human fingers and smooth, impermeable surfaces. In contrast, the formation of a steady-state contact area is almost instantaneous if the counter surface is soft relative to keratin in a dry state. It is for this reason that elastomers are commonly used to coat grip surfaces.

Characterizing and Imaging Gross and Real Finger Contacts under Dynamic Loading

We describe an instrument intended to study finger contacts under tangential dynamic loading. This type of loading is relevant to the natural conditions when touch is used to discriminate and identify the properties of the surfaces of objects-it is also crucial during object manipulation. The system comprises a high performance tribometer able to accurately record in vivo the components of the interfacial forces when a finger interacts with arbitrary surfaces which is combined with a high-speed, high-definition imaging apparatus. Broadband skin excitation reproducing the dynamic contact loads previously identified can be effected while imaging the contact through a transparent window, thus closely approximating the condition when the skin interacts with a non-transparent surface during sliding. As a preliminary example of the type of phenomenon that can be identified with this apparatus, we show that traction in the range from 10 to 1000 Hz tends to decrease faster with excitation frequency for dry fingers than for moist fingers.