Roles of Force Cues and Proprioceptive Joint Angles in Active Exploration of Compliant Objects

Task and Material Properties Interactively Affect Softness Explorations Along Different Dimensions

Haptic research has frequently equated softness with the compliance of elastic objects. However, in a recent study we have suggested that compliance is not the only perceived material dimension underlying what is commonly called softness [1 ]. Here, we investigate, whether the different perceptual dimensions of softness affect how materials are haptically explored. Specifically, we tested whether also the task, i.e., the attribute that a material is being judged on, might affect how a material is explored. To this end we selected 15 adjectives and 19 materials that each associate with different softness dimensions for the study. In the experiment, while participants freely explored and rated the materials, we recorded their hand movements. These movements were subsequently categorized into distinct exploratory procedures (EPs) and analyzed in a multivariate analysis of variance (MANOVA). The results of this analysis suggest that the pattern of EPs depended not only on the material's softness dimension and the task (i.e., what attributes were rated), but also on an interaction between the two factors. Taken together, our findings support the notion of multiple perceptual dimensions of softness and suggest that participants actively adapt their EPs in a nuanced way when judging a particular softness dimensions for a given material.

Individual Performance in Compliance Discrimination is Constrained by Skin Mechanics but Improved under Active Control

Tactile acuity differs between individuals, likely a function of several interrelated factors. The extent of the impact of skin mechanics on individual differences is unclear. Herein, we investigate if differences in skin elasticity between individuals impact their ability to distinguish compliant spheres near limits of discriminability. After characterizing hyperelastic material properties of their skin in compression, the participants were asked to discriminate spheres varying in elasticity and curvature, which generate non-distinct cutaneous cues. Simultaneous biomechanical measurements were used to dissociate the relative contributions from skin mechanics and volitional movements in modulating individuals' tactile sensitivity. The results indicate that, in passive touch, individuals with softer skin exhibit larger gross contact areas and higher perceptual acuity. In contrast, in active touch, where exploratory movements are behaviorally controlled, individuals with harder skin evoke relatively larger gross contact areas, which improve and compensate for deficits in their acuity as observed in passive touch. Indeed, these participants exhibit active control of their fingertip movements that improves their acuity, amidst the inherent constraints of their less elastic finger pad skin.

Identifying 3-D spatiotemporal skin deformation cues evoked in interacting with compliant elastic surfaces

We regularly touch soft, compliant fruits and tissues. To help us discriminate them, we rely upon cues embedded in spatial and temporal deformation of finger pad skin. However, we do not yet understand, in touching objects of various compliance, how such patterns evolve over time, and drive perception. Using a 3-D stereo imaging technique in passive touch, we develop metrics for quantifying skin deformation, across compliance, displacement, and time. The metrics map 2-D estimates of terminal contact area to 3-D metrics that represent spatial and temporal changes in penetration depth, surface curvature, and force. To do this, clouds of thousands of 3-D points are reduced in dimensionality into stacks of ellipses, to be more readily comparable between participants and trials. To evaluate the robustness of the derived 3-D metrics, human subjects experiments are performed with stimulus pairs varying in compliance and discriminability. The results indicate that metrics such as penetration depth and surface curvature can distinguish compliances earlier, at less displacement. Observed also are distinct modes of skin deformation, for contact with stiffer objects, versus softer objects that approach the skin's compliance. These observations of the skin's deformation may guide the design and control of haptic actuation.

Time-dependent Cues Encode the Minimum Exploration Time in Discriminating Naturalistic Compliances

Our perception of compliance is informed by multi-dimensional tactile cues. Compared with stationary cues at terminal contact, time-dependent cues may afford optimal efficiency, speed, and fidelity. In this work, we investigate strategies by which temporal cues may encode compliances by modulating our exploration time. Two potential perceptual strategies are considered, inspired by memory representations within and between explorations. For either strategy, we introduce a unique computational approach. First, a curve similarity analysis, of accumulating touch force between sequentially explored compliances, generates a minimum time for discrimination. Second, a Kalman filtering approach derives a recognition time from progressive integration of stiffness estimates over time within a single exploration. Human-subjects experiments are conducted for both single finger touch and pinch grasp. The results indicate that for either strategy, by employing a more natural pinch grasp, time-dependent cues afford greater efficiency by reducing the exploration time, especially for harder objects. Moreover, compared to single finger touch, pinch grasp improves discrimination rates in judging plum ripeness. The time-dependent strategies as defined here appear promising, and may tie with the time-scales over which we make perceptual judgments.

Tactile Exploration Strategies With Natural Compliant Objects Elicit Virtual Stiffness Cues

When interacting with deformable objects, tactile cues at the finger pad help inform our perception of material compliance. Nearly all prior studies have relied on highly homogenous, engineered materials such as silicone-elastomers and foams. In contrast, we employ soft plum fruit varying in ripeness; ecological substances associated with tasks of everyday life. In this article, we investigate volitional exploratory strategies and contact interactions, for comparison to engineered materials. New measurement techniques are introduced, including an ink-based method to capture finger pad to fruit contact interactions, and instrumented force and optical sensors to capture imposed force and displacement. Human-subjects experiments are conducted for both single finger touch and two finger grasp. The results indicate that terminal contact areas between soft and hard plums are indistinguishable, but the newly defined metric of virtual stiffness can differentiate between the fruits' ripeness, amidst their local variations in geometry, stiffness, and viscoelasticity. Moreover, it affords discrimination independent of one's touch force. This metric illustrates the tie between the deployment of active, exploratory strategies and the elicitation of optimal cues for perceptual discrimination. Compared to single finger touch, perceptual discrimination improves further in pinch grasp, which is indeed a more natural gesture for judging ripeness.