Haptic search is more efficient when the stimulus can be interpreted as consisting of fewer items

Target Search and Inspection Strategies in Haptic Search

Haptic search is a common everyday task, usually consisting of two processes: target search and target analysis. During target search we need to know where our fingers are in space, remember the already completed path and the outline of the remaining space. During target analysis we need to understand whether the detected potential target is the desired one. Here we characterized dynamics of exploratory movements in these two processes. In our experiments participants searched for a particular configuration of symbols on a rectangular tactile display. We observed that participants preferentially moved the hand parallel to the edges of the tactile display during target search, which possibly eased orientation within the search space. After a potential target was detected by any of the fingers, there was higher probability that subsequent exploration was performed by the index or the middle finger. At the same time, these fingers dramatically slowed down. Being in contact with the potential target, the index and the middle finger moved within a smaller area than the other fingers, which rather seemed to move away to leave them space. These results suggest that the middle and the index finger are specialized for fine analysis in haptic search.

Behavioural and electrophysiological evidence for the effect of target-distractor separation in a tactile search task

Evidence suggests that the N140cc component of event-related potentials (ERP) observed in tactile search tasks reflects the attentional selection of the target. Here, we investigated whether the target selection processes are affected by the separation between the target and an ipsilateral singleton distractor (singletons delivered to contiguous or non-contiguous fingers of the same hand). In addition, the external distance between search items was varied through posture (splayed or touching fingers). Accuracy improved when target and distractor were delivered to contiguous fingers that were also touching. Regardless of target-distractor separation, the N140cc was larger when the external distance between search-array stimuli decreased (touching fingers). Importantly, a smaller N140cc was observed at reduced target-distractor separations, suggesting a narrower attentional focus for contiguous singletons. These findings reveal that the mechanisms responsible for tactile target selection in the presence of an ipsilateral singleton distractor are fundamentally different from those emerged in vision.

Sequential search asymmetry: Behavioral and psychophysiological evidence from a dual oddball task

We conducted five experiments in order to explore the generalizability of a new type of search asymmetry, which we have termed sequential search asymmetry, across sensory modalities, and to better understand its origin. In all five experiments rare oddballs occurred randomly within longer sequences of more frequent standards. Oddballs and standards all consisted of rapidly-presented runs of five pure tones (Experiments 1 and 5) or five colored annuli (Experiments 2 through 4) somewhat analogous to simultaneously-presented feature-present and feature-absent stimuli in typical visual search tasks. In easy tasks feature-present reaction times and P300 latencies were shorter than feature-absent ones, similar to findings in search tasks with simultaneously-presented stimuli. Moreover the P3a subcomponent of the P300 ERP was strongly apparent only in the feature-present condition. In more difficult tasks requiring focused attention, however, RT and P300 latency differences disappeared but the P300 amplitude difference was significant. Importantly in all five experiments d’ for feature-present targets was larger than that for feature-absent targets. These results imply that sequential search asymmetry arises from discriminability differences between feature-present and feature-absent targets. Response time and P300 latency differences can be attributed to the use of different attention strategies in search for feature-present and feature-absent targets, indexed by the presence of a dominant P3a subcomponent in the feature-present target-evoked P300s that is lacking in the P300s to the feature-absent targets.

Perceptual grouping by similarity of surface roughness in haptics: the influence of task difficulty

We investigated grouping by similarity of surface roughness in the context of task difficulty. We hypothesized that grouping yields a larger benefit at higher levels of task complexity, because efficient processing is more helpful when more cognitive resources are needed to execute a task. Participants searched for a patch of a different roughness as compared to the distractors in two strips of similar or dissimilar roughness values. We reasoned that if the distractors could be grouped based on similar roughness values, exploration time would be shorter and fewer errors would occur. To manipulate task complexity, we varied task difficulty (high target saliency equalling low task difficulty), and we varied the fingers used to explore the display (two fingers of one hand being more cognitive demanding than two fingers of opposite hands). We found much better performance in the easy condition as compared to the difficult condition (in both error rates and mean search slopes). Moreover, we found a larger effect for the similarity manipulation in the difficult condition as compared to the easy condition. Within the difficult condition, we found a larger effect for the one-hand condition as compared to the two-hand condition. These results show that haptic search is accelerated by the use of grouping by similarity of surface roughness, especially when the task is relatively complex. We conclude that the effect of perceptual grouping is more prominent when more cognitive resources are needed to perform a task.

Perceptual Grouping Affects Haptic Enumeration Over the Fingers

Spatial arrangement is known to influence enumeration times in vision. In haptic enumeration, it has been shown that dividing the total number of items over the two hands can speed up enumeration. Here we investigated how spatial arrangement of items and non-items presented to the individual fingers impacts enumeration times. More specifically, we tested whether grouping by proximity facilitates haptic serial enumeration (counting). Participants were asked to report the number of tangible items, amongst non-items, presented to the finger pads of both hands. In the first experiment, we divided the tangible items in one, two, or three groups that were defined by proximity (i.e., one nonitem in between two groups) and found that number of groups and not number of items were the critical factor in enumeration times. In a second experiment, we found that this grouping even takes place when groups extend across fingers of both hands. These results suggest that grouping by proximity affects haptic serial enumeration and that this grouping takes place on a spatial level possibly in addition to the somatotopic level. Our results support the idea that grouping by proximity, a principle introduced in vision, also greatly affects haptic processing of spatial information.

Search efficiency for tactile features rendered by surface haptic displays

Haptic interfaces controlled by a single fingertip or hand-held probe tend to display surface features individually, requiring serial search for multiple features. Novel surface haptic devices, however, have the potential to provide displays to multiple fingertips simultaneously, affording the possibility of parallel search. Using variable-friction surface haptic devices, we investigated the ability of participants to detect a target feature among a set of distractors in parallel across the fingers. We found that searches for a material property (slipperiness) and an illusory shape (virtual hole) were significantly impaired by distractors, while search for an abrupt discontinuity (virtual edge) was not. The efficiency of search for edges rendered by surface haptics suggests that they engage primitive detectors in the haptic perceptual system.

The effect of perceptual grouping on haptic numerosity perception

We used a haptic enumeration task to investigate whether enumeration can be facilitated by perceptual grouping in the haptic modality. Eight participants were asked to count tangible dots as quickly and accurately as possible, while moving their finger pad over a tactile display. In Experiment 1, we manipulated the number and organization of the dots, while keeping the total exploration area constant. The dots were either evenly distributed on a horizontal line (baseline condition) or organized into groups based on either proximity (dots placed in closer proximity to each other) or configural cues (dots placed in a geometric configuration). In Experiment 2, we varied the distance between the subsets of dots. We hypothesized that when subsets of dots can be grouped together, the enumeration time will be shorter and accuracy will be higher than in the baseline condition. The results of both experiments showed faster enumeration for the configural condition than for the baseline condition, indicating that configural grouping also facilitates haptic enumeration. In Experiment 2, faster enumeration was also observed for the proximity condition than for the baseline condition. Thus, perceptual grouping speeds up haptic enumeration by both configural and proximity cues, suggesting that similar mechanisms underlie perceptual grouping in both visual and haptic enumeration.

Local and global processing in blind and sighted children in a naming and drawing task

This study investigated the spatial analysis of tactile hierarchical patterns in 110 early-blind children aged 6-8 to 16-18 years, as compared to 90 blindfolded sighted children, in a naming and haptic drawing task. The results revealed that regardless of visual status, young children predominantly produced local responses in both tasks, whereas the production of integrated responses emerged later. Development of local and global processing seems to proceed similarly in the two populations, but local processing continued to occur at high levels over a larger age range in the blind. The possibility of visual mediation is pointed out, as totally blind children tended to process information locally more often than blind children with minimal light perception.

Grouping by proximity in haptic contour detection

We investigated the applicability of the Gestalt principle of perceptual grouping by proximity in the haptic modality. To do so, we investigated the influence of element proximity on haptic contour detection. In the course of four sessions ten participants performed a haptic contour detection task in which they freely explored a haptic random dot display that contained a contour in 50% of the trials. A contour was defined by a higher density of elements (raised dots), relative to the background surface. Proximity of the contour elements as well as the average proximity of background elements was systematically varied. We hypothesized that if proximity of contour elements influences haptic contour detection, detection will be more likely when contour elements are in closer proximity. This should be irrespective of the ratio with the proximity of the background elements. Results showed indeed that the closer the contour elements were, the higher the detection rates. Moreover, this was the case independent of the contour/background ratio. We conclude that the Gestalt law of proximity applies to haptic contour detection.

Relative finger position influences whether you can localize tactile stimuli

To investigate whether the relative positions of the fingers influence tactile localization, participants were asked to localize tactile stimuli applied to their fingertips. We measured the location and rate of errors for three finger configurations: fingers stretched out and together so that they are touching each other, fingers stretched out and spread apart maximally and fingers stretched out with the two hands on top of each other so that the fingers are interwoven. When the fingers contact each other, it is likely that the error rate to the adjacent fingers will be higher than when the fingers are spread apart. In particular, we reasoned that localization would probably improve when the fingers are spread. We aimed at assessing whether such adjacency was measured in external coordinates (taking proprioception into account) or on the body (in skin coordinates). The results confirmed that the error rate was lower when the fingers were spread. However, there was no decrease in error rate to neighbouring fingertips in the fingers spread condition in comparison with the fingers together condition. In an additional experiment, we showed that the lower error rate when the fingers were spread was not related to the continuous tactile input from the neighbouring fingers when the fingers were together. The current results suggest that information from proprioception is taken into account in perceiving the location of a stimulus on one of the fingertips.

Visually Guided Haptic Search

In this study, we investigate the influence of visual feedback on haptic exploration. A haptic search task was designed in which subjects had to haptically explore a virtual display using a force-feedback device and to determine whether a target was present among distractor items. Although the target was recognizable only haptically, visual feedback of finger position or possible target positions could be given. Our results show that subjects could use visual feedback on possible target positions even in the absence of feedback on finger position. When there was no feedback on possible target locations, subjects scanned the whole display systematically. When feedback on finger position was present, subjects could make well-directed movements back to areas of interest. This was not the case without feedback on finger position, indicating that showing finger position helps to form a spatial representation of the display. In addition, we show that response time models of visual serial search do not generally apply for haptic serial search. Consequently, in teleoperation systems, for instance, it is helpful to show the position of the probe even if visual information on the scene is poor.

Serial search for fingers of the same hand but not for fingers of different hands

In most haptic search tasks, tactile stimuli are presented to the fingers of both hands. In such tasks, the search pattern for some object features, such as the shape of raised line symbols, has been found to be serial. The question is whether this search is serial over all fingers irrespective of the hand, or whether it is serial over the fingers of each hand and parallel over the two hands. To investigate this issue, we determined the speed of static haptic search when two items are presented to two fingers of the same hand and when two items are presented to two fingers of different hands. We compared the results with predictions for parallel and serial search based on the results of a previous study using the same items and a similar task. The results indicate that two fingers of the same hand process information in a serial manner, while two fingers of two different hands process information in parallel. Thus, considering the individual fingers as independent units in haptic search may not be justified, because the hand that they belong to matters.

The use of proprioception and tactile information in haptic search

To investigate how tactile and proprioceptive information are used in haptic object discrimination we conducted a haptic search task in which participants had to search for either a cylinder, a bar or a rotated cube within a grid of aligned cubes. Tactile information from one finger is enough to detect a cylinder amongst the cubes. For detecting a bar or a rotated cube amongst cubes touch alone is not enough. For the rotated cube this is evident because its shape is identical to that of the non-targets, so proprioception must provide information about the orientation of the fingers and hand when touching it. For the bar one either needs proprioceptive information about the distance and direction of a single finger's movements along the surfaces, or proprioceptive information from several fingers when they touch it simultaneously. When using only one finger, search times for the bar were much longer than those for the other two targets. When the whole hand or both hands were used the search times were similar for all shapes. Most errors were made when searching for the rotated cube, probably due to systematic posture-related biases in judging orientation on the basis of proprioception. The results suggest that tactile and proprioceptive information are readily combined for shape discrimination.