Linking actions and objects: Context-specific learning of novel weight priors

New evidence for the sensorimotor mismatch theory of weight perception and the size-weight illusion

The size-weight illusion is a phenomenon where a smaller object is perceived heavier than an equally weighted larger object. The sensorimotor mismatch theory proposed that this illusion occurs because of a mismatch between efferent motor commands and afferent sensory feedback received when lifting large and small objects (i.e., the application of too little and too much lifting force, respectively). This explanation has been undermined by studies demonstrating a separation between the perceived weight of objects and the lifting forces that are applied on them. However, this research suffers from inconsistencies in the choice of lifting force measures reported. Therefore, we examined the contribution of sensorimotor mismatch in the perception of weight in the size-weight illusion and in non-size-weight illusion stimuli and evaluated the use of a lifting force aggregate measure comprising the four most common lifting force measures used in previous research. In doing so, the sensorimotor mismatch theory was mostly supported. In a size-weight illusion experiment, the lifting forces correlated with weight perception and, contrary to some earlier research, did not adapt over time. In a non-size-weight illusion experiment, switches between lifting light and heavy objects resulted in perceiving the weight of these objects differently compared to no switch trials, which mirrored differences in the manner participants applied forces on the objects. Additionally, we reveal that our force aggregate measure can allow for a more sensitive and objective examination of the effects of lifting forces on objects.

Object weight can be rapidly predicted, with low cognitive load, by exploiting learned associations between the weights and locations of objects

Weight prediction is critical for dexterous object manipulation. Previous work has focused on lifting objects presented in isolation and has examined how the visual appearance of an object is used to predict its weight. Here we tested the novel hypothesis that when interacting with multiple objects, as is common in everyday tasks, people exploit the locations of objects to directly predict their weights, bypassing slower and more demanding processing of visual properties to predict weight. Using a three-dimensional robotic and virtual reality system, we developed a task in which participants were presented with a set of objects. In each trial a randomly chosen object translated onto the participant's hand and they had to anticipate the object's weight by generating an equivalent upward force. Across conditions we could control whether the visual appearance and/or location of the objects were informative as to their weight. Using this task, and a set of analogous web-based experiments, we show that when location information was predictive of the objects' weights participants used this information to achieve faster prediction than observed when prediction is based on visual appearance. We suggest that by "caching" associations between locations and weights, the sensorimotor system can speed prediction while also lowering working memory demands involved in predicting weight from object visual properties.NEW & NOTEWORTHY We use a novel object support task using a three-dimensional robotic interface and virtual reality system to provide evidence that the locations of objects are used to predict their weights. Using location information, rather than the visual appearance of the objects, supports fast prediction, thereby avoiding processes that can be demanding on working memory.

The effects of TMS over the anterior intraparietal area on anticipatory fingertip force scaling and the size-weight illusion

When lifting an object skillfully, fingertip forces need to be carefully scaled to the object’s weight, which can be inferred from its apparent size and material. This anticipatory force scaling ensures smooth and efficient lifting movements. However, even with accurate motor plans, weight perception can still be biased. In the size-weight illusion, objects of different size but equal weight are perceived to differ in heaviness, with the small object perceived to be heavier than the large object. The neural underpinnings of anticipatory force scaling to object size and the size-weight illusion are largely unknown. In this study, we tested the role of anterior intraparietal cortex (aIPS) in predictive force scaling and the size-weight illusion, by applying continuous theta burst stimulation (cTBS) prior to participants lifting objects of different sizes. Participants received cTBS over aIPS, the primary motor cortex (control area), or Sham stimulation. We found no evidence that aIPS stimulation affected the size-weight illusion. Effects were, however, found on anticipatory force scaling, where grip force was less tuned to object size during initial lifts. These findings suggest that aIPS is not involved in the perception of object weight but plays a transient role in the sensorimotor predictions related to object size.

NEW & NOTEWORTHY Skilled object manipulation requires forming anticipatory motor plans according to the object’s properties. Here, we demonstrate the role of anterior intraparietal sulcus (aIPS) in anticipatory grip force scaling to object size, particularly during initial lifting experience. Interestingly, this role was not maintained after continued practice and was not related to perceptual judgments measured with the size-weight illusion.

Single versus dual-rate learning when exposed to Coriolis forces during reaching movements

When we reach for an object during a passive whole body rotation, a tangential Coriolis force is generated on the arm. Yet, within a few trials, the brain adapts to this force so it does not disrupt the reach. Is this adaptation governed by a single-rate or dual-rate learning process? Here, guided by state-space modeling, we studied human reach adaptation in a fully-enclosed rotating room. After 90 pre-rotation reaches (baseline), participants were trained to make 240 to-and-fro reaches while the room rotated at 10 rpm (block A), then performed 6 reaches under opposite room rotation (block B), and subsequently made 100 post-rotation reaches (washout). A control group performed the same paradigm, but without the reaches during rotation block B. Single-rate and dual-rate models can be best dissociated if there would be full un-learning of compensation A during block B, but minimal learning of B. From the perspective of a dual-rate model, the un-learning observed in block B would mainly be caused by the faster state, such that the washout reaches would show retention effects of the slower state, called spontaneous recovery. Alternatively, following a single-rate model, the same state would govern the learning in block A and un-learning in block B, such that the washout reaches mimic the baseline reaches. Our results do not provide clear signs of spontaneous recovery in the washout reaches. Model fits further show that a single-rate process outperformed a dual-rate process. We suggest that a single-rate process underlies Coriolis force reach adaptation, perhaps because these forces relate to familiar body dynamics and are assigned to an internal cause.

Dynamic size-weight changes after object lifting reduce the size-weight illusion

In the size-weight illusion, the smaller object from two equally weighted objects is typically judged as being heavier. One explanation is that the mismatch between the weight expectation based on object size and actual sensory feedback influences heaviness perception. In most studies, the size of an object is perceived before its weight. We investigated whether size changes would influence weight judgement if both would be perceived simultaneously. We used virtual reality to change the size and weight of an object after lifting and asked participants to judge whether the object became lighter or heavier. We found that simultaneous size-weight changes greatly reduced the size-weight illusion to perceptual biases below discrimination thresholds. In a control experiment in which we used a standard size-weight illusion protocol with sequential lifts of small and large objects in the same virtual reality setup, we found a larger, typical perceptual bias. These results show that the size-weight illusion is smaller when size and weight information is perceived simultaneously. This provides support for the prediction mismatch theory explaining the size-weight illusion. The comparison between perceived and expected weight during the lifting phase could be a critical brain mechanism for mediating the size-weight illusion.

Low-level sensory processes play a more crucial role than high-level cognitive ones in the size-weight illusion

The size-weight illusion (SWI) pertains to the experience of perceiving the smaller of two equally weighted objects as heavier. Competing theories to explain the illusion can be generally grouped into cognitive and sensory theories, which place more importance on top-down processing of cognitive expectations and bottom-up processing of sensory information about the size and weight of objects, respectively. The current study examined the relative contribution of these two general explanations. This was done by varying the amounts of cognitive load in a dual-task and the quality of somatosensory feedback by wearing or not wearing gloves. Participants placed their hands through a curtain inside a box so they could not see the test objects. Inside the box, they were presented with either a small or large sphere of varying weights, which they explored manually without vision. Participants provided magnitude estimates about each object's weight in four experimental conditions (no-load with gloves, no-load without gloves, low-load without gloves, and high-load without gloves). The dual-task involved the visual presentation of a cross on a computer monitor that changed in both colour and orientation. With foot pedals, the participants responded to a target colour and / or orientation, which varied across conditions, while they hefted an object. Some conditions were designed to be more cognitively taxing than others (high-load > low-load > no-load conditions). The results revealed that the strength of the SWI diminished when participants wore the gloves but did not change as cognitive load increased on the dual-task. We conclude that the illusion is more influenced by bottom-up sensory than top-down cognitive processes.

Influence of visually perceived shape and brightness on perceived size, expected weight, and perceived weight of 3D objects

In the size–weight illusion, when two objects of identical weight but different volume are lifted, the smaller object is typically perceived to weigh more than the larger object. A well-known explanation for this and other weight illusions is provided by the hypothesis that perceived weight results from the contrast between actual and expected weight. More recently, it has been suggested that an object’s size may exert a direct and automatic effect on its perceived weight, independently of expected weight. Here we test these two hypotheses by exploring two illusions that have been known for a long time but have remained relatively underexplored, namely the shape–weight and brightness–weight illusions. Specifically, we measured the influence of visually perceived shape and brightness on the perceived size, the expected weight, and the perceived weight of 3D plastic objects. A numerical rating task was used in Experiment 1, and a paired comparison task was used in Experiment 2. The results showed that spheres were perceived to be heavier than tetrahedrons and cubes, and cubes were perceived to be heavier than tetrahedrons. We did not find any consistent relationship between brightness and perceived weight. A systematic comparison between perceived size, expected weight, and perceived weight showed that the visual shape–weight and brightness–weight illusions are partially inconsistent with the hypothesis that perceived weight results from the contrast between actual and expected weight and with the hypothesis that perceived weight results from the contrast between actual weight and perceived size. The results appear to suggest that there may be a dissociation between the processing of variables that contribute to the conscious experience of size, such as brightness and vertical height, and the processing of variables that contribute to perceived weight, such as surface area.

The influence of size in weight illusions is unique relative to other object features

Research into weight illusions has provided valuable insight into the functioning of the human perceptual system. Associations between the weight of an object and its other features, such as its size, material, density, conceptual information, or identity, influence our expectations and perceptions of weight. Earlier accounts of weight illusions underscored the importance of previous interactions with objects in the formation of these associations. In this review, we propose a theory that the influence of size on weight perception could be driven by innate and phylogenetically older mechanisms, and that it is therefore more deep-seated than the effects of other features that influence our perception of an object's weight. To do so, we first consider the different associations that exist between the weight of an object and its other features and discuss how different object features influence weight perception in different weight illusions. After this, we consider the cognitive, neurological, and developmental evidence, highlighting the uniqueness of size-weight associations and how they might be reinforced rather than driven by experience alone. In the process, we propose a novel neuroanatomical account of how size might influence weight perception differently than other object features do.