Mind the Gap: The Effects of Temporal and Spatial Separation in Localization of Dual Touches on the Hand

Multisensory integration reduces landmark distortions for tactile but not visual targets

Target localization is influenced by the presence of additionally presented nontargets, termed landmarks. In both the visual and tactile modality, these landmarks led to systematic distortions of target localizations often resulting in a shift toward the landmark. This shift has been attributed to averaging the spatial memory of both stimuli. Crucially, everyday experiences often rely on multiple modalities, and multisensory research suggests that inputs from different senses are optimally integrated, not averaged, for accurate perception, resulting in more reliable perception of cross-modal compared with uni-modal stimuli. As this could also lead to a reduced influence of the landmark, we wanted to test whether landmark distortions would be reduced when presented in a different modality or whether landmark distortions were unaffected by the modalities presented. In two experiments (each n = 30) tactile or visual targets were paired with tactile or visual landmarks. Experiment 1 showed that targets were less shifted toward landmarks from the different than the same modality, which was more pronounced for tactile than for visual targets. Experiment 2 aimed to replicate this pattern with increased visual uncertainty to rule out that smaller localization shifts of visual targets due to low uncertainty had led to the results. Still, landmark modality influenced localization shifts for tactile but not visual targets. The data pattern for tactile targets is not in line with memory averaging but seems to reflect the effects of multisensory integration, whereas visual targets were less prone to landmark distortions and do not appear to benefit from multisensory integration.NEW & NOTEWORTHY In the present study, we directly tested the predictions of two different accounts, namely, spatial memory averaging and multisensory integration, concerning the degree of landmark distortions of targets across modalities. We showed that landmark distortions were reduced across modalities compared to distortions within modalities, which is in line with multisensory integration. Crucially, this pattern was more pronounced for tactile than for visual targets.

Stimulus intensity modulates perceived tactile distance

Several features of tactile stimuli modulate the perceived distance between touches. In particular, distances are perceived as farther apart when the time interval between them is longer, than when it is shorter. Such effects have been interpreted as a form of 'psychological relativity', analogous to Einstein's conception of a four-dimensional space-time. We investigated whether similar effects occur for stimulus features other than time, specifically stimulus intensity. We hypothesised that perceived distance would be increased when the two stimuli differed in intensity, since they would then be farther apart in a multi-dimensional feature space. Participants made verbal estimates of the perceived distance between two touches on their left hand. Intensity was manipulated such that both stimuli could be intense, both could be light, or one could be intense and the other light. We found no evidence for change in perceived tactile distance when stimuli intensity mis-matched. In contrast, there were clear effects of average stimulus intensity on perceived distance. Intense stimuli were judged as farther apart than light stimuli, and mixed stimuli were intermediate. These results are consistent with theories of general magnitude representation, which argue that multiple dimensions of magnitude are dependent on a shared underlying representation of domain-general magnitude.

Morphology, Connectivity, and Encoding Features of Tactile and Motor Representations of the Fingers in the Human Precentral and Postcentral Gyrus

Despite the tight coupling between sensory and motor processing for fine manipulation in humans, it is not yet totally clear which specific properties of the fingers are mapped in the precentral and postcentral gyrus. We used fMRI to compare the morphology, connectivity, and encoding of the motor and tactile finger representations (FRs) in the precentral and postcentral gyrus of 25 5-fingered participants (8 females). Multivoxel pattern and structural and functional connectivity analyses demonstrated the existence of distinct motor and tactile FRs within both the precentral and postcentral gyrus, integrating finger-specific motor and tactile information. Using representational similarity analysis, we found that the motor and tactile FRs in the sensorimotor cortex were described by the perceived structure of the hand better than by the actual hand anatomy or other functional models (finger kinematics, muscles synergies). We then studied a polydactyly individual (i.e., with a congenital 6-fingered hand) showing superior manipulation abilities and divergent anatomic-functional hand properties. The perceived hand model was still the best model for tactile representations in the precentral and postcentral gyrus, while finger kinematics better described motor representations in the precentral gyrus. We suggest that, under normal conditions (i.e., in subjects with a standard hand anatomy), the sensorimotor representations of the 5 fingers in humans converge toward a model of perceived hand anatomy, deviating from the real hand structure, as the best synthesis between functional and structural features of the hand.SIGNIFICANCE STATEMENT Distinct motor and tactile finger representations exist in both the precentral and postcentral gyrus, supported by a finger-specific pattern of anatomic and functional connectivity across modalities. At the representational level, finger representations reflect the perceived structure of the hand, which might result from an adapting process harmonizing (i.e., uniformizing) the encoding of hand function and structure in the precentral and postcentral gyrus. The same analyses performed in an extremely rare polydactyly subject showed that the emergence of such representational geometry is also found in neuromechanical variants with different hand anatomy and function. However, the harmonization process across the precentral and postcentral gyrus might not be possible because of divergent functional-structural properties of the hand and associated superior manipulation abilities.

Anisotropic distortion in the perceived direction of motion on the arm

Skin covers the entire body, and its thickness and distribution of mechanoreceptors vary markedly across body parts. It has been shown that the brain is not able to fully compensate for such anisotropy, and as a result, the representational space of touch differs depending on which parts the stimulus is applied to. Here, by contrasting the hand and arm, we investigated the difference in perceived motion. Using a large-area braille display, we were able to present precisely controlled touchable motion stimuli with randomizing stimulus trajectories and varying the size. We found a new perceptual illusion in which the motion direction of stimuli perceived on the arm is rotated regionally, or even flipped. In particular, obliquely moving stimuli that move toward the distal radial are perceived as move toward the proximal radial, and stimuli that move toward the proximal ulnar are perceived as move toward the distal ulnar. This illusion was not observed on the palm, regardless of compensation for the stimulus size. Current study adds a clear example of how presenting the same motion stimuli to different body parts results in a different perception, emphasizing that the perceived tactile space is not uniform and needs to be examined in detail.

I am the metre: The representation of one's body size affects the perception of tactile distances on the body

Humans must ground the perception of one's body in a mental representation to move in space and interact with objects. This representation can be temporarily altered artificially. In the full-body illusion (FBI), participants see a virtual (or filmed) body receiving a tactile stimulation. When participants receive touches on their body similarly to the seen one (i.e., homologous location and synchronous timing), they embody the seen alien body. While the subjective embodiment of alien bodies of different sizes has been already manipulated with the FBI, it remains unexplored whether the body-metric perception is impacted too. We first developed a new setup for the FBI using 360° videos to favour the embodiment. The FBI was induced for bodies of three sizes adopting anatomical and non-anatomical viewpoints, and we measured the subjective embodiment. The results suggest that humans can embody normal size or bigger bodies seen from anatomical viewpoints, but not smaller ones. We then investigated if the FBI modulates the body-metric representation. We found that the resized bodies' vision affects the perception of one's body-metric representation, but this was independent of the embodiment, suggesting that the FBI alters the body representation at different levels with a specific impact.

Anisotropic distortion in the perceived orientation of stimuli on the arm

Mechanoreceptors on the skin are heterogeneously distributed, and the sampling of neural signals in the brain can vary depending on the part of the body. Therefore, it can be challenging for the brain to consistently represent stimuli applied to different body sites. Here, we report an example of a regional perceptual distortion of the tactile space. We used a piezoelectric braille display to examine shape perception on the volar surface of the arm and to compare it to that on the palm. We found that the orientation of perceived stimuli on the arm was distorted in certain areas. In particular, an inwardly-inclined line shape was perceived as being more inwardly-inclined than it actually was. On the other hand, an outwardly-inclined line was perceived accurately. When the same stimuli were applied to the palm, this anisotropic bias was not observed. We also found that changing the posture of the arm changed the angle at which this anisotropic distortion occurred, suggesting the influence of the skin frame of reference on this illusion. This study showed a clear example of how the representation of even simple stimuli is complexly distinct when the stimuli are applied to different body sites.

Perception of vibrotactile distance on the back

Vibrotactile displays worn on the back can be used as sensory substitution device. Often vibrotactile stimulation is chosen because vibration motors are easy to incorporate and relatively cheap. When designing such displays knowledge about vibrotactile perception on the back is crucial. In the current study we investigated distance perception. Biases in distance perception can explain spatial distortions that occur when, for instance, tracing a shape using vibration. We investigated the effect of orientation (horizontal vs vertical), the effect of positioning with respect to the spine and the effect of switching vibration motors on sequentially versus simultaneously. Our study includes four conditions. The condition which had a horizontal orientation with both vibration motors switching on sequentially on the same side of the spine was chosen is the baseline condition. The other three conditions were compared to this baseline condition. We found that distances felt longer in the vertical direction than in the horizontal direction. Furthermore, distances were perceived to be longer when vibration motors were distributed on both sides of the spine compared to when they were on the same side. Finally, distances felt shorter when vibration motors were switched on simultaneously compared to sequentially. In the simultaneous case a distance of 4 cm was not clearly perceived differently than a distance of 12 cm. When designing vibrotactile displays these anisotropies in perceived distance need to be taken into account because otherwise the intended shape will not match the perceived shape. Also, dynamically presented distances are more clearly perceived than static distances. This finding supports recommendations made in previous studies that dynamic patterns are easier to perceive than static patterns.

Sex differences in perceptual hand maps: A meta-analysis

A large body of research has suggested that localisation of the hand in external space relies on distorted representations of the hand. We developed a paradigm for measuring implicit perceptual maps of the hand (Longo & Haggard, 2010, Proc Natl Acad Sci USA, 107, 11727-11732), which show systematic deviation from actual hand shape, including overestimation of hand width and underestimation of finger length. Recently, Coelho and Gonzalez (in press, Psychol Res) reported sex differences in these perceptual hand maps, with women showing greater overestimation of hand width, but less underestimation of finger length than men. In the current study, I conducted a meta-analysis of 19 experiments using this paradigm by myself and my colleagues. The results replicated the sex differences reported by Coelho and Gonzalez. Importantly, however, these sex differences were not apparent when actual hand size was included as a covariate in analyses, suggesting that they may, at least in part, be due to women having smaller hands on average than men.

Dynamic Displacement Vector Interacts with Tactile Localization

Locating a tactile stimulus on the body seems effortless and straightforward. However, the perceived location of a tactile stimulation can differ from its physical location [1, 2, 3]. Tactile mislocalizations can depend on the timing of successive stimulations [2, 4, 5], tactile motion mechanisms [6], or processes that “remap” stimuli from skin locations to external space coordinates [7, 8, 9, 10, 11]. We report six experiments demonstrating that the perception of tactile localization on a static body part is strongly affected by the displacement between the locations of two successive task-irrelevant actions. Participants moved their index finger between two keys. Each keypress triggered synchronous tactile stimulation at a randomized location on the immobilized wrist or forehead. Participants reported the location of the second tactile stimulation relative to the first. The direction of either active finger movements or passive finger displacements biased participants’ tactile orientation judgements (experiment 1). The effect generalized to tactile stimuli delivered to other body sites (experiment 2). Two successive keypresses, by different fingers at distinct locations, reproduced the effect (experiment 3). The effect remained even when the hand that moved was placed far from the tactile stimulation site (experiments 4 and 5). Temporal synchrony within 600 ms between the movement and tactile stimulations was necessary for the effect (experiment 6). Our results indicate that a dynamic displacement vector, defined as the location of one sensorimotor event relative to the one before, plays a strong role in structuring tactile spatial perception.

•

Human tactile localization is biased by simultaneous finger displacement

•

The shift between two successive events biases the relative localization of touches

•

Both active and passive movements induce a bias, even if far from the touched site

•

The bias effect is vectorially organized

More than skin-deep: Integration of skin-based and musculoskeletal reference frames in localization of touch

The skin of the forearm is, in one sense, a flat 2-dimensional (2D) sheet, but in another sense approximately cylindrical, mirroring the 3-dimensional (3D) volumetric shape of the arm. The role of frames of reference based on the skin as a 2D sheet versus based on the musculoskeletal structure of the arm remains unclear. When we rotate the forearm from a pronated to a supinated posture, the skin on its surface is displaced. Thus, a marked location will slide with the skin across the underlying flesh, and the touch perceived at this location should follow this displacement if it is localized within a skin-based reference frame. We investigated, however, if the perceived tactile locations were also affected by the rearrangement in underlying musculoskeletal structure, that is, displaced medially and laterally on a pronated and supinated forearm, respectively. Participants pointed to perceived touches (Experiment 1), or marked them on a (3D) size-matched forearm on a computer screen (Experiment 2). The perceived locations were indeed displaced medially after forearm pronation in both response modalities. This misperception was reduced (Experiment 1), or absent altogether (Experiment 2) in the supinated posture when the actual stimulus grid moved laterally with the displaced skin. The grid was perceptually stretched at medial-lateral axis, and it was displaced distally, which suggest the influence of skin-based factors. Our study extends the tactile localization literature focused on the skin-based reference frame and on the effects of spatial positions of body parts by implicating the musculoskeletal factors in localization of touch on the body. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Distortions of perceived volume and length of body parts

We experience our body as a 3D, volumetric object in the world. Measures of our conscious body image, in contrast, have investigated the perception of body size along one or two dimensions at a time. There is, thus, a discrepancy between existing methods for measuring body image and our subjective experience of having 3D body. Here we assessed in a sample of healthy adults the perception of body size in terms of its 1D length and 3D volume. Participants were randomly assigned to two groups using different measuring units (other body part and non-body object). They estimated how many units would fit in a perceived size of body segments and the whole body. The patterns of length and volume misperception across judged segments were determined as their perceived size proportional to their actual size. The pattern of volume misperception paints the representation of 3D body proportions resembling those of a somatosensory homunculus. The body parts with a smaller actual surface area relative to their volume were underestimated more. There was a tendency for body parts underestimated in volume to be overestimated in length. Perceived body proportions thus changed as a function of judgement type while showing a similarity in magnitude of the absolute estimation error, be it an underestimation of volume or overestimation of length. The main contribution of this study is assessing the body image as a 3D body representation, and thus extending beyond the conventional 'allocentric' focus to include the body on the inside. Our findings highlight the value of studying the perceptual distortions "at the baseline", i.e., in healthy population, so as to advance the understanding of the nature of perceptual distortions in clinical conditions.