Calibration of human locomotion and models of perceptual-motor organization

Prolonged exposure to mixed reality alters task performance in the unmediated environment

The popularity of mixed reality (MR) technologies, including virtual (VR) and augmented (AR) reality, have advanced many training and skill development applications. If successful, these technologies could be valuable for high-impact professional training, like medical operations or sports, where the physical resources could be limited or inaccessible. Despite MR's potential, it is still unclear whether repeatedly performing a task in MR would affect performance in the same or related tasks in the physical environment. To investigate this issue, participants executed a series of visually-guided manual pointing movements in the physical world before and after spending one hour in VR or AR performing similar movements. Results showed that, due to the MR headsets' intrinsic perceptual geometry, movements executed in VR were shorter and movements executed in AR were longer than the veridical Euclidean distance. Crucially, the sensorimotor bias in MR conditions also manifested in the subsequent post-test pointing task; participants transferring from VR initially undershoot whereas those from AR overshoot the target in the physical environment. These findings call for careful consideration of MR-based training because the exposure to MR may perturb the sensorimotor processes in the physical environment and negatively impact performance accuracy and transfer of training from MR to UR.

Control and recalibration of path integration in place cells using optic flow

Hippocampal place cells are influenced by both self-motion (idiothetic) signals and external sensory landmarks as an animal navigates its environment. To continuously update a position signal on an internal 'cognitive map', the hippocampal system integrates self-motion signals over time, a process that relies on a finely calibrated path integration gain that relates movement in physical space to movement on the cognitive map. It is unclear whether idiothetic cues alone, such as optic flow, exert sufficient influence on the cognitive map to enable recalibration of path integration, or if polarizing position information provided by landmarks is essential for this recalibration. Here, we demonstrate both recalibration of path integration gain and systematic control of place fields by pure optic flow information in freely moving rats. These findings demonstrate that the brain continuously rebalances the influence of conflicting idiothetic cues to fine-tune the neural dynamics of path integration, and that this recalibration process does not require a top-down, unambiguous position signal from landmarks.

Jumping and leaping estimations using optic flow

Optic flow provides information on movement direction and speed during locomotion. Changing the relationship between optic flow and walking speed via training has been shown to influence subsequent distance and hill steepness estimations. Previous research has shown that experience with slow optic flow at a given walking speed was associated with increased effort and distance overestimation in comparison to experiencing with fast optic flow at the same walking speed. Here, we investigated whether exposure to different optic flow speeds relative to gait influences perceptions of leaping and jumping ability. Participants estimated their maximum leaping and jumping ability after exposure to either fast or moderate optic flow at the same walking speed. Those calibrated to fast optic flow estimated farther leaping and jumping abilities than those calibrated to moderate optic flow. Findings suggest that recalibration between optic flow and walking speed may specify an action boundary when calibrated or scaled to actions such as leaping, and possibly, the manipulation of optic flow speed has resulted in a change in the associated anticipated effort for walking a prescribed distance, which in turn influence one's perceived action capabilities for jumping and leaping.

Changes in Navigation Controls and Field-of-View Modes Affect Cybersickness Severity and Spatiotemporal Gait Patterns After Exposure to Virtual Environments

OBJECTIVE

To examine the effects of navigation controls and field-of-view modes on cybersickness severity and gait dynamics after cessation of exposure to a virtual environment (VE).

BACKGROUND

The applications of virtual reality are increasing in various fields; however, whether changes in interaction techniques and visual contents could mitigate the potential gait disturbance following VE exposure remains unclear.

METHOD

Thirty healthy adults wore a head-mounted display to complete six sessions of 12-min run-and-gun tasks using different navigation controls (gamepad, head, natural) and field-of-view modes (full, restricted). Forward and backward walking tasks were performed before and after VE exposure. The degrees of cybersickness and presence were evaluated using questionnaires, along with the in-session task performance. Spatiotemporal gait measures and their variabilities were calculated for each walking task.

RESULTS

The participants experienced less cybersickness with the head and natural controls than with the gamepad. Natural control, based on matching body movements, was associated with the highest degree of presence and best performance. VE navigation using the gamepad showed reduced cadences and increased stride times during postexposure forward-walking tasks. When the VE was presented via the restricted field-of-view mode, increased gait variabilities were observed from backward-walking tasks after VE exposure.

CONCLUSION

Body movement-based navigation controls may alleviate cybersickness. We observed gait adaptation during both ambulation tasks, which was influenced by the navigation control method and field-of-view mode.

APPLICATION

This study provides the first evidence for gait adaptation during balance-demanding tasks after VE exposure, which is valuable for designing guidelines for virtual reality interactions.

Sensorimotor adaptation to destabilizing dynamics in weakly electric fish

Humans and other animals can readily learn to compensate for changes in the dynamics of movement. Such changes can result from an injury or changes in the weight of carried objects. These changes in dynamics can lead not only to reduced performance but also to dramatic instabilities. We evaluated the impacts of compensatory changes in control policies in relation to stability and robustness in Eigenmannia virescens, a species of weakly electric fish. We discovered that these fish retune their sensorimotor control system in response to experimentally generated destabilizing dynamics. Specifically, we used an augmented reality system to manipulate sensory feedback during an image stabilization task in which a fish maintained its position within a refuge. The augmented reality system measured the fish's movements in real time. These movements were passed through a high-pass filter and multiplied by a gain factor before being fed back to the refuge motion. We adjusted the gain factor to gradually destabilize the fish's sensorimotor loop. The fish retuned their sensorimotor control system to compensate for the experimentally induced destabilizing dynamics. This retuning was partially maintained when the augmented reality feedback was abruptly removed. The compensatory changes in sensorimotor control improved tracking performance as well as control-theoretic measures of robustness, including reduced sensitivity to disturbances and improved phase margins.

Continuous Bump Attractor Networks Require Explicit Error Coding for Gain Recalibration

Representations of continuous variables are crucial to create internal models of the external world. A prevailing model of how the brain maintains these representations is given by continuous bump attractor networks (CBANs) in a broad range of brain functions across different areas, such as spatial navigation in hippocampal/entorhinal circuits and working memory in prefrontal cortex. Through recurrent connections, a CBAN maintains a persistent activity bump, whose peak location can vary along a neural space, corresponding to different values of a continuous variable. To track the value of a continuous variable changing over time, a CBAN updates the location of its activity bump based on inputs that encode the changes in the continuous variable (e.g., movement velocity in the case of spatial navigation)-a process akin to mathematical integration. This integration process is not perfect and accumulates error over time. For error correction, CBANs can use additional inputs providing ground-truth information about the continuous variable's correct value (e.g., visual landmarks for spatial navigation). These inputs enable the network dynamics to automatically correct any representation error. Recent experimental work on hippocampal place cells has shown that, beyond correcting errors, ground-truth inputs also fine-tune the gain of the integration process, a crucial factor that links the change in the continuous variable to the updating of the activity bump's location. However, existing CBAN models lack this plasticity, offering no insights into the neural mechanisms and representations involved in the recalibration of the integration gain. In this paper, we explore this gap by using a ring attractor network, a specific type of CBAN, to model the experimental conditions that demonstrated gain recalibration in hippocampal place cells. Our analysis reveals the necessary conditions for neural mechanisms behind gain recalibration within a CBAN. Unlike error correction, which occurs through network dynamics based on ground-truth inputs, gain recalibration requires an additional neural signal that explicitly encodes the error in the network's representation via a rate code. Finally, we propose a modified ring attractor network as an example CBAN model that verifies our theoretical findings. Combining an error-rate code with Hebbian synaptic plasticity, this model achieves recalibration of integration gain in a CBAN, ensuring accurate representation for continuous variables.

Assessing the effectiveness of serious game training designed to assist in upper limb prothesis rehabilitation

Introduction

Controlling a myoelectric upper limb prosthesis is difficult, therefore training is required. Since training with serious games showed promising results, the current paper focuses on game design and its effectivity for transfer between in-game skill to actual prosthesis use for proportional control of hand opening and control of switching between grips. We also examined training duration and individual differences.

Method

Thirty-six participants were randomly assigned to one of three groups: a task-specific serious game training group, a non-task-specific serious game training group and a control group. Each group performed a pre-test, mid-test and a post-test with five training sessions between each test moment. Test sessions assessed proportional control using the Cylinder test, a test designed to measure scaling of hand aperture during grabbing actions, and the combined use of proportional and switch control using the Clothespin Relocation Test, part of the Southampton Hand Assessment Procedure and Tray Test. Switch control was assessed during training by measuring amplitude difference and phasing of co-contraction triggers.

Results

Differences between groups over test sessions were observed for proportional control tasks, however there was lack of structure in these findings. Maximum aperture changed with test moment and some participants adjusted maximum aperture for smaller objects. For proportional and switch control tasks no differences between groups were observed. The effect of test moment suggests a testing effect. For learning switch control, an overall improvement across groups was found in phasing of the co-contraction peaks. Importantly, individual differences were found in all analyses.

Conclusion

As improvements over test sessions were found, but no relevant differences between groups were revealed, we conclude that transfer effects from game training to actual prosthesis use did not take place. Task specificity nor training duration had effects on outcomes. Our results imply testing effects instead of transfer effects, in which individual differences played a significant role. How transfer from serious game training in upper limb prosthesis use can be enhanced, needs further attention.

Targeted reaching with monocular depth information and haptic feedback: Comparing between monocular patients and normally sighted observers

Monocular blindness impairs visual depth perception, yet patients seldom report difficulties in targeted actions like reaching, walking, or driving. We hypothesized that by utilizing monocular depth information and calibrating actions with haptic feedback, monocular patients can perceive egocentric distance and perform targeted actions. We compared targeted reaching in monocular patients, monocular-viewing, and binocular-viewing normal controls. Sixty observers reached either a far or a near target, calibrating reaches to the near target with accurate or false feedback while leaving reaches to the far target uncalibrated. Reaching accuracy and precision were analyzed. Results indicated no difference in reaching accuracy between monocular patients and normal controls; all groups initially underestimated distances before until calibration. Monocular patients responded to calibration sensitively, achieving accuracy in calibrated reaches and generalizing this effect to uncalibrated distances. Thus, with monocular depth information and haptic feedback, monocular patients could perceive distance and accomplish targeted reaching.

On the Role of Interoception in Body and Object Perception: A Multisensory-Integration Account

Various "embodied perception" phenomena suggest that what people sense of their body shapes what they perceive of the environment and that what they perceive of the environment shapes what they perceive of their bodies. For example, an observer's own hand can be felt where a fake hand is seen, events produced by own body movements seem to occur earlier than they did, and feeling a heavy weight at an observer's back may prompt hills to look steeper. Here we argue that such and various other phenomena are instances of multisensory integration of interoceptive signals from the body and exteroceptive signals from the environment. This overarching view provides a mechanistic description of what embodiment in perception means and how it works. It suggests new research questions while questioning a special role of the body itself and various phenomenon-specific explanations in terms of ownership, agency, or action-related scaling of visual information.

Serial dependencies between locomotion and visual space

How do we know the spatial distance of objects around us? Only by physical interaction within an environment can we measure true physical distances. Here, we investigated the possibility that travel distances, measured during walking, could be used to calibrate visual spatial perception. The sensorimotor contingencies that arise during walking were carefully altered using virtual reality and motion tracking. Participants were asked to walk to a briefly highlighted location. During walking, we systematically changed the optic flow, i.e., the ratio between the visual and physical motion speed. Although participants remained unaware of this manipulation, they walked a shorter or longer distance as a function of the optic flow speed. Following walking, participants were required to estimate the perceived distance of visual objects. We found that visual estimates were serially dependent on the experience of the manipulated flow in the previous trial. Additional experiments confirmed that to affect visual perception, both visual and physical motion are required. We conclude that the brain constantly uses movements to measure space for both, actions, and perception.

Perceptual-motor recalibration is intact in older adults

From an ecological perspective, perceptual-motor recalibration should be a robust and adaptable process, but there are suggestions that older adults may recalibrate slower. Therefore, this study investigated the age-related temporal effects in perceptual-motor recalibration after motor disturbances. In three experiments, we disturbed young and older adults' perception-action by fitting weights around their ankles and asking them to climb stairs or cross obstacles repeatedly. In Experiment 1, participants (n = 26) climbed stairs with different ankle weights. An innovative methodology was applied, identifying the timeline of recalibration as the point where a stable movement pattern emerged. Experiment 1 showed that older adults recalibrated slower than young adults in lighter (but not heavier) weight conditions. In Experiment 2, participants (n = 24) crossed obstacles with different ankle weights. Results showed that older adults recalibrated faster than young adults. Finally, in Experiment 3, participants (n = 24) crossed obstacles of unpredictable and varying heights with heavy ankle weights. Again, results showed that older adults recalibrated faster than young adults. Taken together these results show that although older adults had reduced muscle strength and flexibility, they recalibrated quickly, especially when the task was more challenging.

Walking humans and running mice: perception and neural encoding of optic flow during self-motion

Locomotion produces full-field optic flow that often dominates the visual motion inputs to an observer. The perception of optic flow is in turn important for animals to guide their heading and interact with moving objects. Understanding how locomotion influences optic flow processing and perception is therefore essential to understand how animals successfully interact with their environment. Here, we review research investigating how perception and neural encoding of optic flow are altered during self-motion, focusing on locomotion. Self-motion has been found to influence estimation and sensitivity for optic flow speed and direction. Nonvisual self-motion signals also increase compensation for self-driven optic flow when parsing the visual motion of moving objects. The integration of visual and nonvisual self-motion signals largely follows principles of Bayesian inference and can improve the precision and accuracy of self-motion perception. The calibration of visual and nonvisual self-motion signals is dynamic, reflecting the changing visuomotor contingencies across different environmental contexts. Throughout this review, we consider experimental research using humans, non-human primates and mice. We highlight experimental challenges and opportunities afforded by each of these species and draw parallels between experimental findings. These findings reveal a profound influence of locomotion on optic flow processing and perception across species. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Perceiving distance in virtual reality: theoretical insights from contemporary technologies

Decades of research have shown that absolute egocentric distance is underestimated in virtual environments (VEs) when compared with the real world. This finding has implications on the use of VEs for applications that require an accurate sense of absolute scale. Fortunately, this underperception of scale can be attenuated by several factors, making perception more similar to (but still not the same as) that of the real world. Here, we examine these factors as two categories: (i) experience inherent to the observer, and (ii) characteristics inherent to the display technology. We analyse how these factors influence the sources of information for absolute distance perception with the goal of understanding how the scale of virtual spaces is calibrated. We identify six types of cues that change with these approaches, contributing both to a theoretical understanding of depth perception in VEs and a call for future research that can benefit from changing technologies. This article is part of the theme issue 'New approaches to 3D vision'.

The influence of action on perception spans different effectors

Perception and action are fundamental processes that characterize our life and our possibility to modify the world around us. Several pieces of evidence have shown an intimate and reciprocal interaction between perception and action, leading us to believe that these processes rely on a common set of representations. The present review focuses on one particular aspect of this interaction: the influence of action on perception from a motor effector perspective during two phases, action planning and the phase following execution of the action. The movements performed by eyes, hands, and legs have a different impact on object and space perception; studies that use different approaches and paradigms have formed an interesting general picture that demonstrates the existence of an action effect on perception, before as well as after its execution. Although the mechanisms of this effect are still being debated, different studies have demonstrated that most of the time this effect pragmatically shapes and primes perception of relevant features of the object or environment which calls for action; at other times it improves our perception through motor experience and learning. Finally, a future perspective is provided, in which we suggest that these mechanisms can be exploited to increase trust in artificial intelligence systems that are able to interact with humans.

EXPRESS: "Run to the hills": Specific contributions of anticipated energy expenditure during active spatial learning

Grounded views of cognition consider that space perception is shaped by the body and its potential for action. These views are substantiated by observations such as the distance-on-hill effect, described as the overestimation of visually perceived uphill distances. An interpretation of this phenomenon is that slanted distances are overestimated because of the integration of energy expenditure cues. The visual perceptual processes involved are however usually tackled through explicit estimation tasks in passive situations. The goal of this study was to consider instead more ecological active spatial processing. Using immersive virtual reality and an omnidirectional treadmill, we investigated the effect of anticipated implicit physical locomotion cost by comparing spatial learning for uphill and downhill routes, while maintaining actual physical cost and walking speed constant. In the first experiment, participants learnt city layouts by exploring uphill or downhill routes. They were then tested using a landmark positioning task on a map. In the second experiment, the same protocol was used with participants who wore loaded ankle weights. Results from the first experiment showed that walking uphill routes led to a global underestimation of distances compared to downhill routes. This inverted distance-of-hill effect was not observed in the second experiment, where an additional effort was applied. These results suggest that the underestimation of distances observed in experiment one emerged from recalibration processes whose function was to solve the transgression of proprioceptive predictions linked with uphill energy expenditure. Results are discussed in relation to constructivist approaches on spatial representations and predictive coding theories.

Continuous Head Motion is a Greater Motor Control Challenge than Transient Head Motion in Patients with Loss of Vestibular Function

Background. The vestibular system is vital for gaze stability via the vestibulo-ocular reflex, which generates compensatory eye motion in the direction opposite to head motion. Consequently, individuals with peripheral vestibular loss demonstrate impaired gaze stability that reduces functional capacity and quality of life. To facilitate patients' compensatory strategies, two classes of gaze stabilization exercises are often prescribed: (i) transient (eg, ballistic) and (ii) continuous. However, the relative benefits of these two classes of exercises are not well understood. Objective. To quantify head motion kinematics in patients with vestibular loss while they performed both classes of exercises. Methods. Using inertial measurement units, head movements of 18 vestibular schwannoma patients were measured before and after surgical deafferentation and compared with age-matched controls. Results. We found that the head movement during both classes of exercises paralleled those of natural head movement recorded during daily activities. However, head movement patterns were more informative for continuous than transient exercises in distinguishing patients from healthy controls. Specifically, we observed coupling between kinematic measures in control subjects that was absent in patients for continuous but not transient head motion exercises. In addition, kinematic measures (eg, cycle duration) were predictive of standard clinical measures for continuous but not transient head motion exercises. Conclusions. Our data suggest that performing continuous head motion is a greater motor control challenge than transient head motion in patients with less reliable vestibular feedback during the sub-acute stage of recovery, which may also prove to be a reliable measure of progression in vestibular rehabilitation protocols.

Different generalization of fast and slow visuomotor adaptation across locomotion and pointing tasks

Sensorimotor adaptation can involve multiple learning processes with different time courses, and these processes may have different patterns of transfer. In this study, we tested how slow learning and fast learning transfer across tasks, and the specificity of transfer. We tested two natural goal-directed tasks: pointing and walking toward a visible target. We also tested a novel "hand locomotion" task in which subjects used pointing movements to cause simulated self-motion in virtual reality. The hand locomotion task used the same physical movement as pointing, but performed the same function as stepping. During an experimental block, subjects performed alternating training trials with perturbed visual feedback and test trials with no feedback. The test trials were either the same task to measure adaptation, or a different task to measure transfer. Perturbations on adaptation trials varied over time as a sum of sinusoids with different frequencies. Fast learning would be expected to produce equal responses to fast and slow perturbations, while slower learning would dampen responses to higher frequency perturbations. Subjects were generally not aware of the smoothly varying perturbations, but showed detectable adaptation for all three tasks. Only pointing produced significantly different responses to high- and low-frequency perturbations, consistent with slow learning. Adaptation of pointing produced more transfer to the hand locomotion task, which shared the same effector and motor actions, than to the stepping task. The other tasks showed fast learning but little or no slow learning, and equal transfer to tasks with different effector or function. Our results suggest that the slower components of sensorimotor adaptation are more movement specific, while faster learning is more generalizable.

Visual perceptual learning generalizes to untrained effectors

Visual perceptual learning (VPL) is an improvement in visual function following training. Although the practical utility of VPL was once thought to be limited by its specificity to the precise stimuli used during training, more recent work has shown that such specificity can be overcome with appropriate training protocols. In contrast, relatively little is known about the extent to which VPL exhibits motor specificity. Previous studies have yielded mixed results. In this work, we have examined the effector specificity of VPL by training observers on a motion discrimination task that maintains the same visual stimulus (drifting grating) and task structure, but that requires different effectors to indicate the response (saccade vs. button press). We find that, in these conditions, VPL transfers fully between a manual and an oculomotor response. These results are consistent with the idea that VPL entails the learning of a decision rule that can generalize across effectors.

Visually directed action

When people throw or walk to targets in front of them without visual feedback, they often respond short. With feedback, responses rapidly become approximately accurate. To understand this, an experiment is performed with four stages. 1) The errors in blind walking and blind throwing are measured in a virtual environment in light and dark cue conditions. 2) Error feedback is introduced and the resulting learning measured. 3) Transfer to the other response is then measured. 4) Finally, responses to the perceived distances of the targets are measured. There is large initial under-responding. Feedback rapidly makes responses almost accurate. Throw training transfers completely to walking. Walk training produces a small effect on throwing. Under instructions to respond to perceived distances, under-responding recurs. The phenomena are well described by a model in which the relation between target distance and response distance is determined by a sequence of a perceptual, a cognitive, and a motor transform. Walk learning is primarily motor; throw learning is cognitive.

Learning and transfer of perceptual-motor skill: Relationship with gaze and behavioral exploration

Visual and haptic exploration were shown to be central modes of exploration in the development of locomotion. However, it is unclear how learning affects these modes of exploration in locomotor task such as climbing. The first aim of this study was to investigate the modifications of learners' exploratory activity during the acquisition of a perceptual-motor skill. The second aim was to determine to what extent the acquired perceptual-motor skill and the learners' exploratory activity were transferred to environments presenting novel properties. Seven participants attended 10 learning sessions on wall climbing. The effects of practice were assessed during pretest, posttest, and retention tests, each composed of four climbing routes: the route climbed during the learning sessions and three transfer routes. The transfer routes were designed by manipulating either the distance between handholds, the orientation of the handholds or the handholds shape. The results showed that the number of exploratory hand movements and fixations decreased with practice on the learning route. A visual entropy measure suggested that the gaze path in this route became more goal-directed on posttest, but some search was necessary on the retention test. The number of exploratory movements also decreased on the three transfer routes following practice, whereas the number of fixations was higher than on the learning route, suggesting that, with learning, participants relied more on exploration from a distance to adapt to the new properties of the transfer routes. Analyses of the individual performances and behaviors showed differences in the development of skilled exploratory activity.

Hot Wind to the Body Can Facilitate Vection Only When Participants Walk Through a Fire Corridor Virtually

Vection has been reported to be enhanced by wind, as long as the wind is a normal temperature and not hot. However, here we report that a hot wind can facilitate vection, as long as it is natural and consistent with the visual stimulus. We created a fire-corridor stimulus that was consistent with a hot wind and a control stimulus composed of cubes, which were irrelevant to a hot wind. We compared the vection strength induced by a fire-corridor (fire condition) visual stimulus with that induced by geometric cubes (no-fire condition) visual stimulus. There were three wind type conditions: a normal temperature wind, hot wind, and no wind. The results showed that a normal temperature wind facilitated vection and that a hot wind (but not a normal wind) highly enhanced vection when a fire-corridor stimulus was presented. These results suggest that vection is highly affected and modulated by high-level cognitive processes.

The effect of water immersion on vection in virtual reality

Research about vection (illusory self-motion) has investigated a wide range of sensory cues and employed various methods and equipment, including use of virtual reality (VR). However, there is currently no research in the field of vection on the impact of floating in water while experiencing VR. Aquatic immersion presents a new and interesting method to potentially enhance vection by reducing conflicting sensory information that is usually experienced when standing or sitting on a stable surface. This study compares vection, visually induced motion sickness, and presence among participants experiencing VR while standing on the ground or floating in water. Results show that vection was significantly enhanced for the participants in the Water condition, whose judgments of self-displacement were larger than those of participants in the Ground condition. No differences in visually induced motion sickness or presence were found between conditions. We discuss the implication of this new type of VR experience for the fields of VR and vection while also discussing future research questions that emerge from our findings.

The impact of age and familiarity with the environment on categorical and coordinate spatial relation representations

Retrieving spatial information is a crucial everyday ability that is affected by age-related changes. Previous research has shown that this change is mediated by familiarity with an environment. The present research uses a series of landmark location tasks to extend and deepen our understanding of the role of aging in spatial mental representations of more or less familiar environments, also disentangling the contribution of coordinate and categorical spatial relations. The study tested the following hypotheses: (1) younger adults only have an advantage over the elderly in less familiar environments; (2) the advantage for categorical over coordinate spatial relations is mainly found for less familiar environments; and finally; (3) interactions between age, familiarity, and spatial relations might reveal that the effects of age and familiarity take different trajectories for coordinate and categorical spatial relations. Results confirmed that: (1) young people outperform the elderly only in less familiar environments; (2) there is a reduction in the difference between coordinate and categorical accuracy with increasing familiarity with the environment; while (3) the interaction between age and level of familiarity did not significantly differentiate coordinate from categorical spatial relations. In conclusion, the present study provides new evidence for the role of familiarity with geographical areas and its impact on the representation of categorical and coordinate relations, with practical implications for the assessment of topographical disorientation in aging.

The effects of testing environment, experimental design, and ankle loading on calibration to perturbed optic flow during locomotion

Calibration is the process by which the execution of actions becomes scaled to the (changing) relationship between environmental features and the actor's action capabilities. Though much research has investigated how individuals calibrate to perturbed optic flow, it remains unclear how different experimental factors contribute to the magnitude of calibration transfer. In the present study, we assessed how testing environment (Experiment 1), an adapted pretest-calibration-posttest design (Experiment 2), and bilateral ankle loading (Experiment 3) affected the magnitude of calibration to perturbed optic flow. We found that calibration transferred analogously to real-world and virtual environments. Although the magnitude of calibration transfer found here was greater than that reported by previous researchers, it was evident that calibration occurred rapidly and quickly plateaued, further supporting the claim that calibration is often incomplete despite continued calibration trials. We also saw an asymmetry in calibration magnitude, which may be due to a lack of appropriate perceptual-motor scaling prior to calibration. The implications of these findings for the assessment of distance perception and calibration in real-world and virtual environments are discussed.

"Walk this way": specific contributions of active walking to the encoding of metric properties during spatial learning

The effect of body-based information on spatial memory has been traditionally described as a facilitating factor for large-scale spatial learning in the field of active learning research (Chrastil & Warren, Psychonomic Bulletin and Review, 19(1):1-23; 2012). The specific contribution of body-based information to spatial representation properties is however not yet well defined and the mechanisms through which body-based information contributes to spatial learning are not clear enough. To disambiguate the effect of active spatial learning on the quality of spatial representations from the beneficial effect of physiological arousal, we compared four experimental conditions (walking on a unidirectional treadmill during learning, retrieval, both phases or no walking). Results showed no effect of the walking condition for a route perspective task, but a significant effect on a survey perspective task (landmark positioning on a map): participants who walked during encoding (encoding group and encoding + retrieval group) obtained better results than those who did not walk or walked only during retrieval. Geometrical analysis of spatial positions on maps revealed that the activity of walking during encoding improves the correlation between participants' coordinates and actual coordinates through better distance estimations and angular accuracy, even though the optic flow was not matched with individual walking speed. Control group variance in all measures was higher than that of the walking groups (regardless of the moment of walking). Taken together, these results provide arguments for the multimodal nature of spatial representations, where body-related information derived from walking is involved in metric properties accuracy and perspective switching.

Aquatic Competencies and Drowning Prevention in Children 2–4 Years: A Systematic Review

Aquatic competencies have been proposed as a prevention strategy for children aged 2–4 years who are over-represented in drowning statistics. For this recommendation to be made, exploration of the connection between aquatic competencies and drowning is required. This review critically analyzed studies exploring aquatic competencies and their effect on drowning and/or injury severity in children 2–4 years. English language peer-reviewed literature up to 31 July 2019 was searched and the PRISMA process utilized. Data were extracted from twelve studies that fulfilled the inclusion criteria. Findings from this study included that aquatic competencies were not found to increase risk of drowning and demonstrated children aged 2–4 years are capable of developing age-appropriate aquatic competencies. Age-appropriate aquatic competencies extracted were propulsion/locomotion, flotation/buoyancy, water familiarization, submersion and water exits. The acquisition of these competencies holds benefit for the prevention of drowning. No evidence was found relating to injury severity. There was limited exploration of the relationship between aquatic competencies attainment and age-related developmental readiness. The review highlights the need for consistent measures of exposure, clarity around skills acquisition, better age-specific data (2 years vs. 3 years vs. 4 years), studies with larger sample sizes, further exploration of the dose–response relationship and consistent skill level testing across age groups. Further investigation is required to establish the efficacy of aquatic competencies as a drowning prevention intervention, as well as exploring the relationship between aquatic competencies and age-related developmental readiness. In conclusion, early evidence suggests aquatic competencies can help to reduce drowning.

Calibration of perception fails to transfer between functionally similar affordances

Prior work shows that the calibration of perception and action transfers between actions depending on their functional similarity: Practising (and thus calibrating perception of) one affordance will also calibrate perception for an affordance with a similar function but not for an affordance with a disparate function. We tested this hypothesis by measuring whether calibration transferred between two affordances for passing through openings: squeezing sideways through doorways without becoming stuck and fitting sideways through doorways while avoiding collision. Participants wore a backpack to alter affordances for passage and create a need for perceptual recalibration. Calibration failed to transfer between the two actions (e.g., practising squeezing through doorways calibrated perception of squeezing but not fitting). Differences between squeezing and fitting affordances that might have required different information for perception and recalibration are explored to understand why calibration did not transfer. In light of these results, we propose a revised hypothesis-calibration transfers between affordances on the basis of both functional and informational similarity.

Rediscovering Richard Held: Activity and Passivity in Perceptual Learning

Understanding the role of self-generated movements in perceptual learning is central to action-based theories of perception. Pioneering work on sensory adaptation by Richard M. Held during the 1950s and 1960s can still shed light on this question. In a variety of rich experiments Held and his team demonstrated the need for self-generated movements in sensory adaptation and perceptual learning. This body of work received different critical interpretations, was then forgotten for some time, and saw a surge of revived interest within embodied cognitive science. Through a brief review of Held’s work and reactions to it, we seek to contribute to discussions on the role of activity and passivity in perceptual learning. We classify different positions according to whether this role is considered to be contextual (facilitatory, but not necessary), enabling (causally necessary), or constitutive (an inextricable part of the learning process itself). We also offer a critique of the notions of activity and passivity and how they are operationalized in experimental studies. The active-passive distinction is not a binary but involves a series of dimensions and relative degrees that can make it difficult to interpret and replicate experimental results. We introduce three of these dimensions drawing on work on the sense of agency: action initiation, control, and monitoring. These refinements in terms of causal relations and dimensions of activity-passivity should help illuminate open questions concerning the role of activity in perception and perceptual learning and clarify the convergences and differences between enaction and ecological psychology.

When weight is an encumbrance; avoidance of stairs by different demographic groups

BACKGROUND

Locomotion is an energy costly behaviour, particularly when it entails raising weight against gravity. Minimization of locomotor costs appears a universal default. Avoidance of stair climbing helps humans minimise their energetic costs. In public access settings, demographic subgroups that raise more 'dead' weight than their comparison groups when climbing are more likely to avoid stairs by choosing the escalator. Individuals who minimise stair costs at work, however, can accumulate a deficit in energy expenditure in daily life with potential implications for weight gain. This paper tests the generality of avoidance of stairs in pedestrians encumbered by additional weight in three studies.

METHODS

Pedestrian choices for stairs or the alternative were audited by trained observers who coded weight status, presence of large bags and sex for each pedestrian. Sex-specific silhouettes for BMIs of 25 facilitated coding of weight status. Choices between stairs and a lift to ascend and descend were coded in seven buildings (n = 26,981) and at an outdoor city centre site with the same alternatives (n = 7,433). A further study audited choices to ascend when the alternative to stairs was a sloped ramp in two locations (n = 16,297). Analyses employed bootstrapped logistic regression (1000 samples).

RESULTS

At work and the city centre site, the overweight, those carrying a large bag and females avoided both stair climbing and descent more frequently than their comparison groups. The final study revealed greater avoidance of stairs in these demographic subgroups when the alternative means of ascent was a sloped ramp.

DISCUSSION

Minimization of the physiological costs of transport-related walking biases behaviour towards avoidance of stair usage when an alternative is available. Weight carried is an encumbrance that can deter stair usage during daily life. This minimization of physical activity costs runs counter to public health initiatives to increase activity to improve population health.

Distance perception during self-movement

The perception of distance in open fields was widely studied with static observers. However, it is a fact that we and the world around us are in continuous relative movement, and that our perceptual experience is shaped by the complex interactions between our senses and the perception of our self-motion. This poses interesting questions about how our nervous system integrates this multisensory information to resolve specific tasks of our daily life, for example, distance estimation. This study provides new evidence about how visual and motor self-motion information affects our perception of distance and a hypothesis about how these two sources of information can be integrated to calibrate the estimation of distance. This model accounts for the biases found when visual and proprioceptive information is inconsistent.

Regular physical activity modulates perceived visual speed when running in treadmill-mediated virtual environments

In virtual reality, visual speed is usually underestimated relative to locomotor speed. Here we investigated how physical activity and fitness affect perceived visual speed when running in a treadmill-mediated virtual environment. Thirty healthy participants (ten sedentary individuals, ten team sport players and ten expert runners) ran on a treadmill at two different speeds (8, 12km/h) in front of a moving virtual scene. Participants were asked to match the speed of the visual scene to their running speed (i.e. treadmill speed), indicating for each trial whether the scene was moving slower or faster than the treadmill. The speed of the visual scene was adjusted according to the participant’s response using a staircase until visual and running speeds were perceived as equivalent. More sedentary participants underestimated visual speed relative to their actual running speed. Specifically, visual speed had to exceed running speed to be perceived as equivalent. The underestimation of visual speed was speed-dependent, and it was significantly larger for sedentary participants than for team sports players and expert runners. The volume of physical activity per week was found to be the best predictor of visual speed perception for both running speeds, while the perceived effort constituted a good predictor only at 8km/h. Physical fitness, on the other hand turned out to be a poor predictor of visual speed perception. Therefore, in order to enhance users’ engagement and their adherence to physical activity programs, the development of “personalized” treadmill-mediated virtual environments should take into account users’ personal characteristics to provide the most natural and engaging feedback possible.

The role of top-down knowledge about environmental context in egocentric distance judgments

Judgments of egocentric distances in well-lit natural environments can differ substantially in indoor versus outdoor contexts. Visual cues (e.g., linear perspective, texture gradients) no doubt play a strong role in context-dependent judgments when cues are abundant. Here we investigated a possible top-down influence on distance judgments that might play a unique role under conditions of perceptual uncertainty: assumptions or knowledge that one is indoors or outdoors. We presented targets in a large outdoor field and in an indoor classroom. To control visual distance and depth cues between the environments, we restricted the field of view by using a 14-deg aperture. Evidence of context effects depended on the response mode: Blindfolded-walking responses were systematically shorter indoors than outdoors, whereas verbal and size gesture judgments showed no context effects. These results suggest that top-down knowledge about the environmental context does not strongly influence visually perceived egocentric distance. However, this knowledge can operate as an output-level bias, such that blindfolded-walking responses are shorter when observers' top-down knowledge indicates that they are indoors and when the size of the room is uncertain.

Do Explicit Estimates of Angular Declination Become Ungrounded in the Presence of a Ground Plane?

In a series of seven experiments (total N = 220), it is shown that explicit angular declination judgments are influenced by the presence of a ground plane in the background. This is of theoretical importance because it bears on the interpretation of the relationship between angular declination and perceived distance on a ground plane. Explicit estimates of ground distance are consistent with a simple 1.5 gain in the underlying perceived angular declination function. The experiments show that, in general, functions of estimates of perceived angular declination have a slope of 1.5, but that an additional intercept can often be observed as a result of incorporating changes in ground distance into reports of changes in angular declination. By varying the background context, a variety of functions were observed that are consistent with this contamination hypothesis.

No environmental context-dependent effect, but interference, of physical activity on object location memory

Research on context-dependent memory has addressed many external and internal types of contexts. However, whether the physical activity engaged in at the time of encoding and recall can act as an environmental context cue has been systematically investigated only in one study. The purpose of the present study was to replicate this; furthermore, given the effect of physical activity/effort on the way space is represented, we sought to extend the findings to object location memory. Using a 1-list paradigm (Experiment 1) and a 2-list paradigm (Experiment 2), participants had to learn the locations of objects on a grid and then recall them, while standing or walking on a health walker. No evidence of activity context effects was found. However, an interference effect of the motor task on location memory was detected, such that participants' performance was worse when walking, compared to standing, at encoding (Experiment 2) or recall (Experiment 1). Results are discussed based on the outshining hypothesis and the possible link between motor task and object location memory.

Anxiety Influences the Perceptual-Motor Calibration of Visually Guided Braking to Avoid Collisions

We investigated whether anxiety influences perceptual-motor calibration in a braking to avoid a collision task. Participants performed either a discrete braking task (Experiment 1) or a continuous braking task (Experiment 2), with the goal of stopping before colliding with a stop sign. Half of participants performed the braking task after an anxiety induction. We investigated whether anxiety reduced the frequency of crashing and if it influenced the calibration of perception (visual information) and action (brake pressure) dynamically between-trials in Experiment 1 and within-trials in Experiment 2. In the discrete braking task, anxious participants crashed less often and made larger corrective adjustments trial-to-trial after crashing, suggesting that the influence of anxiety on behavior did not occur uniformly, but rather dynamically with anxiety amplifying the reaction to previous crashes. However, when performing continuous braking, anxious participants crashed more often, and their within-trial adjustments of deceleration were less related to visual information compared to controls. Taken together, these findings suggest that the timescale and nature of the task mediates the influence of anxiety on the performance of goal-directed actions.

Locomotive Recalibration and Prism Adaptation of Children and Teens in Immersive Virtual Environments

As virtual reality expands in popularity, an increasingly diverse audience is gaining exposure to immersive virtual environments (IVEs). A significant body of research has demonstrated how perception and action work in such environments, but most of this work has been done studying adults. Less is known about how physical and cognitive development affect perception and action in IVEs, particularly as applied to preteen and teenage children. Accordingly, in the current study we assess how preteens (children aged 8-12 years) and teenagers (children aged 15-18 years) respond to mismatches between their motor behavior and the visual information presented by an IVE. Over two experiments, we evaluate how these individuals recalibrate their actions across functionally distinct systems of movement. The first experiment analyzed forward walking recalibration after exposure to an IVE with either increased or decreased visual flow. Visual flow during normal bipedal locomotion was manipulated to be either twice or half as fast as the physical gait. The second experiment leveraged a prism throwing adaptation paradigm to test the effect of recalibration on throwing movement. In the first experiment, our results show no differences across age groups, although subjects generally experienced a post-exposure effect of shortened distance estimation after experiencing visually faster flow and longer distance estimation after experiencing visually slower flow. In the second experiment, subjects generally showed the typical prism adaptation behavior of a throwing after-effect error. The error lasted longer for preteens than older children. Our results have implications for the design of virtual systems with children as a target audience.

Optic flow is calibrated to walking effort

Through experience, people learn that a given magnitude of walking produces an associated magnitude of optic flow. Artificially altering this relationship has both behavioral and perceptual consequences: walking on a treadmill results in zero translational optic flow and causes people to subsequently drift forward when attempting to walk in place while blindfolded (they have learned that forward walking is required to remain stationary). Similarly, after walking on a treadmill people perceive the walking distance to targets to be greater (they have recalibrated the magnitude of walking required to reach the target). While the measurement unit for walking magnitude in this relationship has been treated as walking speed (stride length * [steps / time]), recent experiments suggest that walkable distances may instead be measured in bioenergetic units (i.e., the magnitude of energy required to produce a given magnitude of optic flow). In the first experiment, zero translational optic flow was paired with a constant walking speed, and walking energy was manipulated by varying the incline of the treadmill. Participants who walked on an inclined treadmill drifted farther while attempting to walk in place than participants who walked on a flat treadmill. A follow-up experiment presented optic flow via an immersive virtual environment, and no difference between flat and inclined treadmill walking was found, thereby showing that the effect found in the first experiment was not an artifact of biomechanical differences associated with flat versus inclined treadmill walking. The results support the hypothesis that walking magnitude is scaled by bioenergetic units.

Walking through a virtual environment improves perceived size within and beyond the walked space

Distances tend to be underperceived in virtual environments (VEs) by up to 50%, whereas distances tend to be perceived accurately in the real world. Previous work has shown that allowing participants to interact with the VE while receiving continual visual feedback can reduce this underperception. Judgments of virtual object size have been used to measure whether this improvement is due to the rescaling of perceived space, but there is disagreement within the literature as to whether judgments of object size benefit from interaction with feedback. This study contributes to that discussion by employing a more natural measure of object size. We also examined whether any improvement in virtual distance perception was limited to the space used for interaction (1-5 m) or extended beyond (7-11 m). The results indicated that object size judgments do benefit from interaction with the VE, and that this benefit extends to distances beyond the explored space.

The Anatomy of Action Systems: Task Differentiation When Learning an EMG Controlled Game

This study aims to determine to what extent the task for an action system in its initial development relies on functional and anatomical components. Fifty-two able-bodied participants were randomly assigned to one of three experimental groups or to a control group. As a pre- and post-test all groups performed a computer game with the same goal and using the same musculature. One experimental group also trained to perform this test, while the other two experimental groups learned to perform a game that differed either in its goal or in the musculature used. The observed change in accuracy indicated that retaining the goal of the task or the musculature used equally increased transfer performance relative to controls. Conversely, changing either the goal or the musculature equally decreased transfer relative to training the test. These results suggest that in the initial development of an action system, the task to which the system pertains is not specified solely by either the goal of the task or the anatomical structures involved. It is suggested that functional specificity and anatomical dependence might equally be outcomes of continuously differentiating activity.

Action potential influences spatial perception: Evidence for genuine top-down effects on perception

The action-specific account of spatial perception asserts that a perceiver's ability to perform an action, such as hitting a softball or walking up a hill, impacts the visual perception of the target object. Although much evidence is consistent with this claim, the evidence has been challenged as to whether perception is truly impacted, as opposed to the responses themselves. These challenges have recently been organized as six pitfalls that provide a framework with which to evaluate the empirical evidence. Four case studies of action-specific effects are offered as evidence that meets the framework's high bar, and thus that demonstrates genuine perceptual effects. That action influences spatial perception is evidence that perceptual and action-related processes are intricately and bidirectionally linked.

The Independent Perceptual Calibration of Action-Neutral and -Referential Environmental Properties

Two experiments were conducted to explore how the calibration of perception of environmental properties taken with reference to an animal and their action capabilities (e.g., affordances) and those that are independent of action capabilities (e.g., metric properties) relate. In both experiments, participants provided reports of the maximum height they could reach above their head with a number of different stick(s) (reach-with-stick height) and the length of those stick(s), a property that is a constituent of reach-with-stick height. In Experiment 1 reach-with-stick height reports improved over trials whereas stick length reports remained constant. In Experiment 2, feedback about maximum reach-with-stick height improved perception of this affordance, but such improvements did not transfer to perception of stick length in a pretest/practice task/posttest design. The results suggest that the perceptual calibration with practice perceiving or feedback about actual dimensions of action-referential and action-neutral properties do not necessarily depend on one another.

The Convergence of Robotics, Vision, and Computer Graphics for User Interaction

Mechanical interfaces to virtual environments and the creation of virtual environments represent important and relatively new application areas for robotics. The creation of immersive interfaces will require codevelopment of visual displays that complement mechanical stimuli with appropriate visual cues, ultimately determined from human psychophysics. Advances in interactive rendering and geometric modeling from computer graphics will play a key role. Examples are drawn from haptic and locomotion interface projects.

Enhanced Optic Flow Speed Discrimination While Walking: Contextual Tuning of Visual Coding

We tested the hypothesis that long-term adaptation to the normal contingencies between walking and its multisensory consequences (including optic flow) leads to enhanced discrimination of appropriate visual speeds during self-motion. In experiments 1 (task 1) and 2 a two-interval forced-choice procedure was used to compare the perceived speed of a simulated visual flow field viewed while walking with the perceived speed of a flow field viewed while standing. Both experiments demonstrated subtractive reductions in apparent speed. In experiments 1 and 3 discrimination thresholds were measured for optic flow speed while walking and while standing. Consistent with the optimal-coding hypothesis, speed discrimination for visual speeds near walking speed was enhanced during walking. Reduced sensitivity was found for slower visual speeds. The multisensory context of walking alters the coding of optic flow in a way that enhances speed discrimination in the expected range of flow speeds.

Visually Perceived Eye Level and Horizontal Midline of the Body Trunk Influenced by Optic Flow

The eye level and the horizontal midline of the body trunk can serve, respectively as references for judging the vertical and horizontal egocentric directions. We investigated whether the optic-flow pattern, which is the dynamic motion information generated when one moves in the visual world, can be used by the visual system to determine and calibrate these two references. Using a virtual-reality setup to generate the optic-flow pattern, we showed that judged elevation of the eye level and the azimuth of the horizontal midline of the body trunk are biased toward the positional placement of the focus of expansion (FOE) of the optic-flow pattern. Furthermore, for the vertical reference, prolonged viewing of an optic-flow pattern with lowered FOE not only causes a lowered judged eye level after removal of the optic-flow pattern, but also an overestimation of distance in the dark. This is equivalent to a reduction in the judged angular declination of the object after adaptation, indicating that the optic-flow information also plays a role in calibrating the extraretinal signals used to establish the vertical reference.

Perceiving Distance: A Role of Effort and Intent

Perceiving egocentric distance is not only a function of the optical variables to which it relates, but also a function of people's current physiological potential to perform intended actions. In a set of experiments, we showed that, as the effort associated with walking increases, perceived distance increases if the perceiver intends to walk the extent, but not if the perceiver intends to throw. Conversely, as the effort associated with throwing increases, perceived distance increases if people intend to throw to the target, but not if they intend to walk. Perceiving distance combines the geometry of the world with our behavior goals and the potential of our body to achieve these goals.

Discovering your inner Gibson: reconciling action-specific and ecological approaches to perception-action

Both the action-specific perception account and the ecological approach to perception-action emphasize the role of action in perception. However, the action-specific perception account demonstrates that different percepts are possible depending on the perceiver's ability to act, even when the same optical information is available. These findings challenge one of the fundamental claims of the ecological approach--that perception is direct--by suggesting that perception is mediated by internal processes. Here, we sought to resolve this apparent discrepancy. We contend that perception is based on the controlled detection of the information available in a global array that includes higher-order patterns defined across interoceptive and exteroceptive stimulus arrays. These higher-order patterns specify the environment in relation to the perceiver, so direct sensitivity to them would be consistent with the ecological claims that perception of the environment is direct and animal-specific. In addition, the action-specific approach provides further evidence for the theory of affordances, by demonstrating that even seemingly abstract properties of the environment, such as distance and size, are ultimately perceived in terms of an agent's action capabilities.