Mental imagery of gravitational motion

The psychophysics of bouncing: Perceptual constraints, physical constraints, animacy, and phenomenal causality

In the present study we broadly explored the perception of physical and animated motion in bouncing-like scenarios through four experiments. In the first experiment, participants were asked to categorize bouncing-like displays as physical bounce, animated motion, or other. Several parameters of the animations were manipulated, that is, the simulated coefficient of restitution, the value of simulated gravitational acceleration, the motion pattern (uniform acceleration/deceleration or constant speed) and the number of bouncing cycles. In the second experiment, a variable delay at the moment of the collision between the bouncing object and the bouncing surface was introduced. Main results show that, although observers appear to have realistic representations of physical constraints like energy conservation and gravitational acceleration/deceleration, the amount of visual information available in the scene has a strong modulation effect on the extent to which they rely on these representations. A coefficient of restitution >1 was a crucial cue to animacy in displays showing three bouncing cycles, but not in displays showing one bouncing cycle. Additionally, bouncing impressions appear to be driven by perceptual constraints that are unrelated to the physical realism of the scene, like preference for simulated gravitational attraction smaller than g and perceived temporal contiguity between the different phases of bouncing. In the third experiment, the visible opaque bouncing surface was removed from the scene, and the results showed that this did not have any substantial effect on the resulting impressions of physical bounce or animated motion, suggesting that the visual system can fill-in the scene with the missing element. The fourth experiment explored visual impressions of causality in bouncing scenarios. At odds with claims of current causal perception theories, results indicate that a passive object can be perceived as the direct cause of the motion behavior of an active object.

Mental imagery of object motion in weightlessness

Mental imagery represents a potential countermeasure for sensorimotor and cognitive dysfunctions due to spaceflight. It might help train people to deal with conditions unique to spaceflight. Thus, dynamic interactions with the inertial motion of weightless objects are only experienced in weightlessness but can be simulated on Earth using mental imagery. Such training might overcome the problem of calibrating fine-grained hand forces and estimating the spatiotemporal parameters of the resulting object motion. Here, a group of astronauts grasped an imaginary ball, threw it against the ceiling or the front wall, and caught it after the bounce, during pre-flight, in-flight, and post-flight experiments. They varied the throwing speed across trials and imagined that the ball moved under Earth's gravity or weightlessness. We found that the astronauts were able to reproduce qualitative differences between inertial and gravitational motion already on ground, and further adapted their behavior during spaceflight. Thus, they adjusted the throwing speed and the catching time, equivalent to the duration of virtual ball motion, as a function of the imaginary 0 g condition versus the imaginary 1 g condition. Arm kinematics of the frontal throws further revealed a differential processing of imagined gravity level in terms of the spatial features of the arm and virtual ball trajectories. We suggest that protocols of this kind may facilitate sensorimotor adaptation and help tuning vestibular plasticity in-flight, since mental imagery of gravitational motion is known to engage the vestibular cortex.

Gravity and Known Size Calibrate Visual Information to Time Parabolic Trajectories

Catching a ball in a parabolic flight is a complex task in which the time and area of interception are strongly coupled, making interception possible for a short period. Although this makes the estimation of time-to-contact (TTC) from visual information in parabolic trajectories very useful, previous attempts to explain our precision in interceptive tasks circumvent the need to estimate TTC to guide our action. Obtaining TTC from optical variables alone in parabolic trajectories would imply very complex transformations from 2D retinal images to a 3D layout. We propose based on previous work and show by using simulations that exploiting prior distributions of gravity and known physical size makes these transformations much simpler, enabling predictive capacities from minimal early visual information. Optical information is inherently ambiguous, and therefore, it is necessary to explain how these prior distributions generate predictions. Here is where the role of prior information comes into play: it could help to interpret and calibrate visual information to yield meaningful predictions of the remaining TTC. The objective of this work is: (1) to describe the primary sources of information available to the observer in parabolic trajectories; (2) unveil how prior information can be used to disambiguate the sources of visual information within a Bayesian encoding-decoding framework; (3) show that such predictions might be robust against complex dynamic environments; and (4) indicate future lines of research to scrutinize the role of prior knowledge calibrating visual information and prediction for action control.

Actual and Imagined Movements Reveal a Dual Role of the Insular Cortex for Motor Control

Movements rely on a mixture of feedforward and feedback mechanisms. With experience, the brain builds internal representations of actions in different contexts. Many factors are taken into account in this process among which is the immutable presence of gravity. Any displacement of a massive body in the gravitational field generates forces and torques that must be predicted and compensated by appropriate motor commands. The insular cortex is a key brain area for graviception. However, no attempt has been made to address whether the same internal representation of gravity is shared between feedforward and feedback mechanisms. Here, participants either mentally simulated (only feedforward) or performed (feedforward and feedback) vertical movements of the hand. We found that the posterior part of the insular cortex was engaged when feedback was processed. The anterior insula, however, was activated only in mental simulation of the action. A psychophysical experiment demonstrates participants' ability to integrate the effects of gravity. Our results point toward a dual internal representation of gravity within the insula. We discuss the conceptual link between these two dualities.

The gravitational imprint on sensorimotor planning and control

Humans excel at learning complex tasks, and elite performers such as musicians or athletes develop motor skills that defy biomechanical constraints. All actions require the movement of massive bodies. Of particular interest in the process of sensorimotor learning and control is the impact of gravitational forces on the body. Indeed, efficient control and accurate internal representations of the body configuration in space depend on our ability to feel and anticipate the action of gravity. Here we review studies on perception and sensorimotor control in both normal and altered gravity. Behavioral and modeling studies together suggested that the nervous system develops efficient strategies to take advantage of gravitational forces across a wide variety of tasks. However, when the body was exposed to altered gravity, the rate and amount of adaptation exhibited substantial variation from one experiment to another and sometimes led to partial adjustment only. Overall, these results support the hypothesis that the brain uses a multimodal and flexible representation of the effect of gravity on our body and movements. Future work is necessary to better characterize the nature of this internal representation and the extent to which it can adapt to novel contexts.

Intuitive physics of gravitational motion as shown by perceptual judgment and prediction-motion tasks

In Experiment 1, we explored participants' perceptual knowledge of vertical fall by presenting them with virtually simulated polystyrene or wooden spheres falling to the ground from about two meters high. Participants rated the perceived naturalness of the motion. Besides the implied mass of the sphere, we manipulated the motion pattern (i.e., uniform acceleration vs. uniform velocity), and the magnitude of acceleration or velocity. Results show that relatively low values of acceleration or velocity were judged as natural for the polystyrene sphere, whereas relatively high values of acceleration or velocity were judged as natural for the wooden sphere. In Experiment 2, the same stimuli of Experiment 1 were used, but the sphere disappeared behind an invisible occluder at some point of its trajectory. Participants were asked to predict the time-to-contact (TTC) of the sphere with the ground by pressing a key at the exact time of impact of the lower edge of the sphere with the floor of the room. Results show that the estimated TTC for the simulated wooden sphere was slightly but consistently smaller than the estimated TTC for the simulated polystyrene sphere. The influence of the implied mass on participants' responses might be the manifestation of two processes, namely an explicit 'heavy-fast, light-slow' heuristic, and/or an implicit, automatic association between mass and falling speed.