Phenomenal Causality and Sensory Realism

Delay and Speed of Visual Feedback of a Keystroke Cause Illusory Heaviness and Stiffness

Imposing a delay between an action (e.g., a limb movement) and its related visual feedback (e.g., a cursor movement on the display) induces a peculiar sensation of heaviness or stiffness. Earlier studies have examined this delay-induced heaviness or stiffness sensation in relation to the non-arbitrary causal relationship between an action and its effect. Here, “non-arbitrary causal relationship” means that an action produces a specific and deterministic pattern of visual feedback; for example, a leftward limb movement consistently and deterministically causes a leftward visual motion. In modern graphical user interfaces, on the other hand, users often control visual information by pressing keys, wherein the relationship between the keystroke and the change in visual information is arbitrary. The present study examined whether the sensation of heaviness, stiffness and bumpiness could be caused when participants' keystroke produced a delayed arbitrary visual feedback. Participants were asked to press and hold down an assigned key to cause temporal luminance changes in a square centered on the display, an arbitrary visual feedback of their keystroke. Not only the onset delay of the temporal luminance change from the participant's keystroke but also the speed of the temporal luminance change were examined as a visual cue to heaviness, stiffness, or bumpiness. In Experiment 1, the participants' task was to give a rating for the strength of the heaviness, stiffness, or bumpiness perceived when they pressed the key. Our results showed that the heaviness and stiffness ratings increased as the delay increased and decreased as the speed increased. To check whether the manipulation of the delay and speed of the visual feedback caused changes in the subjective evaluation of sensorimotor incongruence, in Experiment 2, we asked the participants to give a rating for the sense of agency. The rating scores decreased as the delay increased and increased as the speed increased. The delay and speed influenced the rating scores for the sense of agency in the opposite direction to those for heaviness/stiffness. We discuss that the brain determines the heaviness and stiffness during a keystroke based on internalized statistics relating to the delay and speed of the action feedback.