Why some size illusions affect grip aperture

The influence of body orientation on length judgements

Perceiving the size of a visual object requires the combination of various sources of visual information. A recent paper by Kim et al. (Body Orientation Affects the Perceived Size of Objects. Perception 2022, 51: 25-36) concluded that body orientation played a substantial role. The present paper aims to answer the question of whether the reported effect of body orientation on visuo-haptic size matching was due to effects on the visual or the haptic judgements of size. To do so, we used a within-participant design combining an experiment using visuo-haptic size matching with two experiments that assessed the visual and haptic size-percept using free magnitude estimation. Our experiments produced a systematic visuo-haptic mismatch, but the sign of the mismatch was opposite to that of the original study. Moreover, our study did not reveal a systematic effect of body orientation on this mismatch. Thirdly, we found that the mismatch we determined from participants matching a visual and haptic percept was considerably smaller than the mismatch we derived from their visual and haptic size estimates. In summary, our results emphasise that conclusions about the perceived size of objects are very sensitive to details of the experimental approach.

Coming to grips with reality: Real grasps, but not pantomimed grasps, resist a simultaneous tilt illusion

Investigations of grasping real, 3D objects subjected to illusory effects from a pictorial background often choose in-flight grasp aperture as the primary variable to test the hypothesis that the visuomotor system resists the illusion. Here we test an equally important feature of grasps that has received less attention: in-flight grasp orientation. The current study tested a variant of the simultaneous tilt illusion using a mirror-apparatus to manipulate the availability of haptic feedback. Participants performed grasps with haptic feedback (real grasps) and without it (pantomime grasps), reaching for the reflection of a real, 3D bar atop a background grating that induced a 1.1° bias in the perceived orientation of the bar in a separate sample of participants. Analysis of the hand's in-flight grasp orientation at early, late, and end stages of the reach showed that at no point were the real grasps biased by the illusion. In contrast, pantomimed grasps were affected by the illusion at the late and end stages of the reach. At each stage, the effect on the real grasps was significantly weaker than the effect of the illusion as measured by the mean point of subjective equality (PSE) in a two-alternative forced-choice task. In contrast, the effect on the pantomime grasps was statistically indistinguishable from the mean PSE at all three stages of the reach. These findings reinforce the idea that in-flight grasp orientation, like grasp aperture to pictorial illusions of target size, is refractory to pictorial backgrounds that bias perceived orientation.

Neural networks underlying visual illusions: An activation likelihood estimation meta-analysis

Visual illusions have long been used to study visual perception and contextual integration. Neuroimaging studies employ illusions to identify the brain regions involved in visual perception and how they interact. We conducted an Activation Likelihood Estimation (ALE) meta-analysis and meta-analytic connectivity modeling on fMRI studies using static and motion illusions to reveal the neural signatures of illusory processing and to investigate the degree to which different areas are commonly recruited in perceptual inference. The resulting networks encompass ventral and dorsal regions, including the inferior and middle occipital cortices bilaterally in both types of illusions. The static and motion illusion networks selectively included the right posterior parietal cortex and the ventral premotor cortex respectively. Overall, these results describe a network of areas crucially involved in perceptual inference relying on feed-back and feed-forward interactions between areas of the ventral and dorsal visual pathways. The same network is proposed to be involved in hallucinogenic symptoms characteristic of schizophrenia and other disorders, with crucial implications in the use of illusions as biomarkers.

The cost of aiming for the best answers: Inconsistent perception

The laws of physics and mathematics describe the world we live in as internally consistent. As these rules provide a very effective description, and our interaction with the world is also very effective, it seems self-evident that our perception follows these laws. As a result, when trying to explain imperfections in perception, we tend to impose consistency and introduce concepts such as deformations of visual space. In this review, we provide numerous examples that show that in many situations we perceive related attributes to have inconsistent values. We discuss how our tendency to assume consistency leads to erroneous conclusions on how we process sensory information. We propose that perception is not about creating a consistent internal representation of the outside world, but about answering specific questions about the outside world. As the information used to answer a question is specific for that question, this naturally leads to inconsistencies in perception and to an apparent dissociation between some perceptual judgments and related actions.

How prism adaptation reveals the distinct use of size and positions in grasping

The size of an object equals the distance between the positions of its opposite edges. However, human sensory processing for perceiving positions differs from that for perceiving size. Which of these two information sources is used to control grip aperture? In this paper, we answer this question by prism adaptation of single-digit movements of the index finger and thumb. We previously showed that it is possible to adapt the index finger and thumb in opposite directions and that this adaptation induces an aftereffect in grip aperture in grasping. This finding suggests that grasping is based on the perceived positions of the contact points. However, it might be compatible with grasping being controlled based on size provided that the opposing prism adaptation leads to changes in visually perceived size or proprioception of hand opening. In that case, one would predict a similar aftereffect in manually indicating the perceived size. In contrast, if grasping is controlled based on information about the positions of the edges, the aftereffect in grasping is due to altered position information, so one would predict no aftereffect in manually indicating the perceived size. Our present experiment shows that there was no aftereffect in manually indicating perceived size. We conclude that grip aperture during grasping is based on perceived positions rather than on perceived size.

Familiarity with an Object’s Size Influences the Perceived Size of Its Image

It is known that judgments about objects’ distances are influenced by familiar size: a soccer ball looks farther away than a tennis ball if their images are equally large on the retina. We here investigate whether familiar size also influences judgments about the size of images of objects that are presented side-by-side on a computer screen. Sixty-three participants indicated which of two images appeared larger on the screen in a 2-alternative forced-choice discrimination task. The objects were either two different types of balls, two different types of coins, or a ball and a grey disk. We found that the type of ball biased the comparison between their image sizes: the size of the image of the soccer ball was over-estimated by about 5% (assimilation). The bias in the comparison between the two balls was equal to the sum of the biases in the comparisons with the grey disk. The bias for the coins was smaller and in the opposite direction (contrast). The average precision of the size comparison was 3.5%, irrespective of the type of object. We conclude that knowing a depicted object’s real size can influence the perceived size of its image, but the perceived size is not always attracted towards the familiar size.

Precision in grasping: Consistent with Weber's law, but constrained by "safety margins"

Whether the visuomotor coding of size in grasping obeys Weber's law is currently debated. Following up on previous work from our laboratory, here we investigated the precision associated with the maximum in-flight index-thumb aperture (MGA) in grasping small-to-medium sized objects. We report three main findings. First, grasp preparation was longer with 5 mm objects and became increasingly faster as object size increased from 10 to 20-40 mm. Second, MGA variable errors increased as sizes increased from 5 to 10-20 mm, whereas they decreased as size reached 40 mm. Third, MGA distributions were symmetrical with 5 mm objects, but became increasingly right-skewed as size increased. These results, as well as a re-analysis of previous findings, suggest that the precision of visuomotor representations varies as a function of size, consistent with the key principle underlying Weber's law. However, a fundamental constraint on precision grips (the MGA must always exceed physical size) changes the skew of the distribution and reduces the variability of MGAs as size increases from very small to medium.

Grasping of Real-World Objects Is Not Biased by Ensemble Perception

The visual system is known to extract summary representations of visually similar objects which bias the perception of individual objects toward the ensemble average. Although vision plays a large role in guiding action, less is known about whether ensemble representation is informative for action. Motor behavior is tuned to the veridical dimensions of objects and generally considered resistant to perceptual biases. However, when the relevant grasp dimension is not available or is unconstrained, ensemble perception may be informative to behavior by providing gist information about surrounding objects. In the present study, we examined if summary representations of a surrounding ensemble display influenced grip aperture and orientation when participants reached-to-grasp a central circular target which had an explicit size but importantly no explicit orientation that the visuomotor system could selectively attend to. Maximum grip aperture and grip orientation were not biased by ensemble statistics during grasping, although participants were able to perceive and provide manual estimations of the average size and orientation of the ensemble display. Support vector machine classification of ensemble statistics achieved above-chance classification accuracy when trained on kinematic and electromyography data of the perceptual but not grasping conditions, supporting our univariate findings. These results suggest that even along unconstrained grasping dimensions, visually-guided behaviors toward real-world objects are not biased by ensemble processing.

Dissociating the Influence of Perceptual Biases and Contextual Artifacts Within Target Configurations During the Planning and Control of Visually Guided Action

The failure of perceptual illusions to elicit corresponding biases within movement supports the view of two visual pathways separately contributing to perception and action. However, several alternative findings may contest this overarching framework. The present study aimed to examine the influence of perceptual illusions within the planning and control of aiming. To achieve this, we manipulated and measured the planning/control phases by respectively perturbing the target illusion (relative size-contrast illusion; Ebbinghaus/Titchener circles) following movement onset and detecting the spatiotemporal characteristics of the movement trajectory. The perceptual bias that was indicated by the perceived target size estimates failed to correspondingly manifest within the effective target size. While movement time (specifically, time after peak velocity) was affected by the target configuration, this outcome was not consistent with the direction of the perceptual illusions. These findings advocate an influence of the surrounding contextual information (e.g., annuli) on movement control that is independent of the direction predicted by the illusion.

The Role of Haptic Expectations in Reaching to Grasp: From Pantomime to Natural Grasps and Back Again

When we reach to pick up an object, our actions are effortlessly informed by the object's spatial information, the position of our limbs, stored knowledge of the object's material properties, and what we want to do with the object. A substantial body of evidence suggests that grasps are under the control of "automatic, unconscious" sensorimotor modules housed in the "dorsal stream" of the posterior parietal cortex. Visual online feedback has a strong effect on the hand's in-flight grasp aperture. Previous work of ours exploited this effect to show that grasps are refractory to cued expectations for visual feedback. Nonetheless, when we reach out to pretend to grasp an object (pantomime grasp), our actions are performed with greater cognitive effort and they engage structures outside of the dorsal stream, including the ventral stream. Here we ask whether our previous finding would extend to cued expectations for haptic feedback. Our method involved a mirror apparatus that allowed participants to see a "virtual" target cylinder as a reflection in the mirror at the start of all trials. On "haptic feedback" trials, participants reached behind the mirror to grasp a size-matched cylinder, spatially coincident with the virtual one. On "no-haptic feedback" trials, participants reached behind the mirror and grasped into "thin air" because no cylinder was present. To manipulate haptic expectation, we organized the haptic conditions into blocked, alternating, and randomized schedules with and without verbal cues about the availability of haptic feedback. Replicating earlier work, we found the strongest haptic effects with the blocked schedules and the weakest effects in the randomized uncued schedule. Crucially, the haptic effects in the cued randomized schedule was intermediate. An analysis of the influence of the upcoming and immediately preceding haptic feedback condition in the cued and uncued random schedules showed that cuing the upcoming haptic condition shifted the haptic influence on grip aperture from the immediately preceding trial to the upcoming trial. These findings indicate that, unlike cues to the availability of visual feedback, participants take advantage of cues to the availability of haptic feedback, flexibly engaging pantomime, and natural modes of grasping to optimize the movement.

Double dissociation between perception and action in children

Previous research has demonstrated a functional dissociation between vision for perception and vision for action. However, the developmental trajectory of this functional dissociation is not well understood. We directly compared the sensitivity of grasping and perceptual estimations within the same experimental design to the real and illusory sizes of objects positioned in the Ponzo illusion display. Two different-sized objects were placed such that the differences between their real sizes and their perceived sizes were pitted against each other. Children aged 5-8 years and adults made perceptual size discriminations and then grasped (action) or estimated (perception) one of the objects based on its perceived size. Consistent with previous results, for the action task, grasping apertures of adults were scaled with the physical differences in the objects' sizes, even in trials where their overt perceptual decisions were deceived by the illusion. In contrast, perceptual estimations were robustly modulated by the illusion. Interestingly, children outperformed adults in their perceptual discriminations but exhibited adult-like behavior in grasping and in perceptual estimations of the objects, demonstrating a dissociation between perception and action. These results suggest that although the two visual functions are not operating at fully mature levels during childhood, some key mechanisms that support a dissociation between these functions are already in place.