Bayesian Alternation during Tactile Augmentation

Correctly establishing evidence for cue combination via gains in sensory precision: Why the choice of comparator matters

Studying how sensory signals from different sources (sensory cues) are integrated within or across multiple senses allows us to better understand the perceptual computations that lie at the foundation of adaptive behaviour. As such, determining the presence of precision gains - the classic hallmark of cue combination - is important for characterising perceptual systems, their development and functioning in clinical conditions. However, empirically measuring precision gains to distinguish cue combination from alternative perceptual strategies requires careful methodological considerations. Here, we note that the majority of existing studies that tested for cue combination either omitted this important contrast, or used an analysis approach that, unknowingly, strongly inflated false positives. Using simulations, we demonstrate that this approach enhances the chances of finding significant cue combination effects in up to 100% of cases, even when cues are not combined. We establish how this error arises when the wrong cue comparator is chosen and recommend an alternative analysis that is easy to implement but has only been adopted by relatively few studies. By comparing combined-cue perceptual precision with the best single-cue precision, determined for each observer individually rather than at the group level, researchers can enhance the credibility of their reported effects. We also note that testing for deviations from optimal predictions alone is not sufficient to ascertain whether cues are combined. Taken together, to correctly test for perceptual precision gains, we advocate for a careful comparator selection and task design to ensure that cue combination is tested with maximum power, while reducing the inflation of false positives.

Utility and Usability of Two Forms of Supplemental Vibrotactile Kinesthetic Feedback for Enhancing Movement Accuracy and Efficiency in Goal-Directed Reaching

Recent advances in wearable sensors and computing have made possible the development of novel sensory augmentation technologies that promise to enhance human motor performance and quality of life in a wide range of applications. We compared the objective utility and subjective user experience for two biologically inspired ways to encode movement-related information into supplemental feedback for the real-time control of goal-directed reaching in healthy, neurologically intact adults. One encoding scheme mimicked visual feedback encoding by converting real-time hand position in a Cartesian frame of reference into supplemental kinesthetic feedback provided by a vibrotactile display attached to the non-moving arm and hand. The other approach mimicked proprioceptive encoding by providing real-time arm joint angle information via the vibrotactile display. We found that both encoding schemes had objective utility in that after a brief training period, both forms of supplemental feedback promoted improved reach accuracy in the absence of concurrent visual feedback over performance levels achieved using proprioception alone. Cartesian encoding promoted greater reductions in target capture errors in the absence of visual feedback (Cartesian: 59% improvement; Joint Angle: 21% improvement). Accuracy gains promoted by both encoding schemes came at a cost in terms of temporal efficiency; target capture times were considerably longer (1.5 s longer) when reaching with supplemental kinesthetic feedback than without. Furthermore, neither encoding scheme yielded movements that were particularly smooth, although movements made with joint angle encoding were smoother than movements with Cartesian encoding. Participant responses on user experience surveys indicate that both encoding schemes were motivating and that both yielded passable user satisfaction scores. However, only Cartesian endpoint encoding was found to have passable usability; participants felt more competent using Cartesian encoding than joint angle encoding. These results are expected to inform future efforts to develop wearable technology to enhance the accuracy and efficiency of goal-directed actions using continuous supplemental kinesthetic feedback.

Sensory augmentation for a rapid motor task in a multisensory environment

BACKGROUND

Sensory substitution and augmentation systems (SSASy) seek to either replace or enhance existing sensory skills by providing a new route to access information about the world. Tests of such systems have largely been limited to untimed, unisensory tasks.

OBJECTIVE

To test the use of a SSASy for rapid, ballistic motor actions in a multisensory environment.

METHODS

Participants played a stripped-down version of air hockey in virtual reality with motion controls (Oculus Touch). They were trained to use a simple SASSy (novel audio cue) for the puck's location. They were tested on ability to strike an oncoming puck with the SASSy, degraded vision, or both.

RESULTS

Participants coordinated vision and the SSASy to strike the target with their hand more consistently than with the best single cue alone, t(13) = 9.16, p <.001, Cohen's d = 2.448.

CONCLUSIONS

People can adapt flexibly to using a SSASy in tasks that require tightly timed, precise, and rapid body movements. SSASys can augment and coordinate with existing sensorimotor skills rather than being limited to replacement use cases - in particular, there is potential scope for treating moderate vision loss. These findings point to the potential for augmenting human abilities, not only for static perceptual judgments, but in rapid and demanding perceptual-motor tasks.

A three-armed cognitive-motor exercise intervention to increase spatial orientation and life-space mobility in nursing home residents: study protocol of a randomized controlled trial in the PROfit project

Background

In nursing home residents, the combination of decreasing mobility and declining cognitive abilities, including spatial orientation, often leads to reduced physical activity (PA) and life-space (LS) mobility. As a consequence of sedentary behavior, there is a lack of social interaction and cognitive stimulation, resulting in low quality of life. It has not yet been examined whether cognitive-motor training including spatial cognitive tasks is suitable to improve spatial orientation and, as a consequence, to enlarge LS mobility, and increase well-being and general cognitive-motor functioning. Therefore, the overall goal of this multicentric randomized controlled trial (RCT) is to compare the effect of three different intervention approaches including functional exercise and orientation tasks on PA, LS and spatial orientation in nursing home residents.

Methods

A three-arm single-blinded multicenter RCT with a wait-list control group will be conducted in a sample of 513 individuals (needed according to power analysis) in three different regions in Germany. In each nursing home, one of three different intervention approaches will be delivered to participating residents for 12 weeks, twice a week for 45 min each: The PROfit basic group will perform functional strength, balance, flexibility, and walking exercises always at the same location, whereas the PROfit plus group changes the location three times while performing similar/the same exercises as the PROfit basic group. The PROfit orientation group receives navigation tasks in addition to the relocation during the intervention. Physical and cognitive functioning as well as psychological measures will be assessed in all study groups at baseline. Participants will then be randomized into either the intervention group or the wait-list control group. After 12 weeks, and after 24 weeks the measures will be repeated.

Discussion

This study evaluates whether the three different interventions are feasible to reduce the decline of or even improve PA, LS, and spatial orientation in nursing home residents. By adding different training locations in PROfit plus, the program is expected to be superior to PROfit basic in increasing physical and cognitive parameters. Moreover, we expect the PROfit orientation intervention to be most effective in terms of PA, LS, and spatial orientation due to two mechanisms: (1) increased physical and cognitive activity will enhance cognitive-motor capacity and (2) the spatial training will help to build up cognitive strategies to compensate for age-related loss of spatial orientation abilities and related limitations.

Trial registration

The trial was prospectively registered at DRKS.de with registration number DRKS00021423 on April 16, 2020 and was granted permission by the Technical University Berlin local ethics committee (No. GR_14_20191217).

Bayes-Like Integration of a New Sensory Skill with Vision

Humans are effective at dealing with noisy, probabilistic information in familiar settings. One hallmark of this is Bayesian Cue Combination: combining multiple noisy estimates to increase precision beyond the best single estimate, taking into account their reliabilities. Here we show that adults also combine a novel audio cue to distance, akin to human echolocation, with a visual cue. Following two hours of training, subjects were more precise given both cues together versus the best single cue. This persisted when we changed the novel cue's auditory frequency. Reliability changes also led to a re-weighting of cues without feedback, showing that they learned something more flexible than a rote decision rule for specific stimuli. The main findings replicated with a vibrotactile cue. These results show that the mature sensory apparatus can learn to flexibly integrate new sensory skills. The findings are unexpected considering previous empirical results and current models of multisensory learning.

Is Attentional Resource Allocation Across Sensory Modalities Task-Dependent?

Human information processing is limited by attentional resources. That is, via attentional mechanisms, humans select a limited amount of sensory input to process while other sensory input is neglected. In multisensory research, a matter of ongoing debate is whether there are distinct pools of attentional resources for each sensory modality or whether attentional resources are shared across sensory modalities. Recent studies have suggested that attentional resource allocation across sensory modalities is in part task-dependent. That is, the recruitment of attentional resources across the sensory modalities depends on whether processing involves object-based attention (e.g., the discrimination of stimulus attributes) or spatial attention (e.g., the localization of stimuli). In the present paper, we review findings in multisensory research related to this view. For the visual and auditory sensory modalities, findings suggest that distinct resources are recruited when humans perform object-based attention tasks, whereas for the visual and tactile sensory modalities, partially shared resources are recruited. If object-based attention tasks are time-critical, shared resources are recruited across the sensory modalities. When humans perform an object-based attention task in combination with a spatial attention task, partly shared resources are recruited across the sensory modalities as well. Conversely, for spatial attention tasks, attentional processing does consistently involve shared attentional resources for the sensory modalities. Generally, findings suggest that the attentional system flexibly allocates attentional resources depending on task demands. We propose that such flexibility reflects a large-scale optimization strategy that minimizes the brain’s costly resource expenditures and simultaneously maximizes capability to process currently relevant information.