Helping Blind People Grasp: Evaluating a Tactile Bracelet for Remotely Guiding Grasping Movements

The problem of supporting visually impaired and blind people in meaningful interactions with objects is often neglected. To address this issue, we adapted a tactile belt for enhanced spatial navigation into a bracelet worn on the wrist that allows visually impaired people to grasp target objects. Participants' performance in locating and grasping target items when guided using the bracelet, which provides direction commands via vibrotactile signals, was compared to their performance when receiving auditory instructions. While participants were faster with the auditory commands, they also performed well with the bracelet, encouraging future development of this system and similar systems.

Augmented action observation: Theory and practical applications in sensorimotor rehabilitation

Sensory feedback is a fundamental aspect of effective motor learning in sport and clinical contexts. One way to provide this is through sensory augmentation, where extrinsic sensory information are associated with, and modulated by, movement. Traditionally, sensory augmentation has been used as an online strategy, where feedback is provided during physical execution of an action. In this article, we argue that action observation can be an additional effective channel to provide augmented feedback, which would be complementary to other, more traditional, motor learning and sensory augmentation strategies. Given these similarities between observing and executing an action, action observation could be used when physical training is difficult or not feasible, for example during immobilization or during the initial stages of a rehabilitation protocol when peripheral fatigue is a common issue. We review the benefits of observational learning and preliminary evidence for the effectiveness of using augmented action observation to improve learning. We also highlight current knowledge gaps which make the transition from laboratory to practical contexts difficult. Finally, we highlight the key areas of focus for future research.

Hybrid Life: Integrating biological, artificial, and cognitive systems

Artificial life is a research field studying what processes and properties define life, based on a multidisciplinary approach spanning the physical, natural, and computational sciences. Artificial life aims to foster a comprehensive study of life beyond "life as we know it" and toward "life as it could be," with theoretical, synthetic, and empirical models of the fundamental properties of living systems. While still a relatively young field, artificial life has flourished as an environment for researchers with different backgrounds, welcoming ideas, and contributions from a wide range of subjects. Hybrid Life brings our attention to some of the most recent developments within the artificial life community, rooted in more traditional artificial life studies but looking at new challenges emerging from interactions with other fields. Hybrid Life aims to cover studies that can lead to an understanding, from first principles, of what systems are and how biological and artificial systems can interact and integrate to form new kinds of hybrid (living) systems, individuals, and societies. To do so, it focuses on three complementary perspectives: theories of systems and agents, hybrid augmentation, and hybrid interaction. Theories of systems and agents are used to define systems, how they differ (e.g., biological or artificial, autonomous, or nonautonomous), and how multiple systems relate in order to form new hybrid systems. Hybrid augmentation focuses on implementations of systems so tightly connected that they act as a single, integrated one. Hybrid interaction is centered around interactions within a heterogeneous group of distinct living and nonliving systems. After discussing some of the major sources of inspiration for these themes, we will focus on an overview of the works that appeared in Hybrid Life special sessions, hosted by the annual Artificial Life Conference between 2018 and 2022. This article is categorized under: Neuroscience > Cognition Philosophy > Artificial Intelligence Computer Science and Robotics > Robotics.

Utility and Usability of Two Forms of Supplemental Vibrotactile Kinesthetic Feedback for Enhancing Movement Accuracy and Efficiency in Goal-Directed Reaching

Recent advances in wearable sensors and computing have made possible the development of novel sensory augmentation technologies that promise to enhance human motor performance and quality of life in a wide range of applications. We compared the objective utility and subjective user experience for two biologically inspired ways to encode movement-related information into supplemental feedback for the real-time control of goal-directed reaching in healthy, neurologically intact adults. One encoding scheme mimicked visual feedback encoding by converting real-time hand position in a Cartesian frame of reference into supplemental kinesthetic feedback provided by a vibrotactile display attached to the non-moving arm and hand. The other approach mimicked proprioceptive encoding by providing real-time arm joint angle information via the vibrotactile display. We found that both encoding schemes had objective utility in that after a brief training period, both forms of supplemental feedback promoted improved reach accuracy in the absence of concurrent visual feedback over performance levels achieved using proprioception alone. Cartesian encoding promoted greater reductions in target capture errors in the absence of visual feedback (Cartesian: 59% improvement; Joint Angle: 21% improvement). Accuracy gains promoted by both encoding schemes came at a cost in terms of temporal efficiency; target capture times were considerably longer (1.5 s longer) when reaching with supplemental kinesthetic feedback than without. Furthermore, neither encoding scheme yielded movements that were particularly smooth, although movements made with joint angle encoding were smoother than movements with Cartesian encoding. Participant responses on user experience surveys indicate that both encoding schemes were motivating and that both yielded passable user satisfaction scores. However, only Cartesian endpoint encoding was found to have passable usability; participants felt more competent using Cartesian encoding than joint angle encoding. These results are expected to inform future efforts to develop wearable technology to enhance the accuracy and efficiency of goal-directed actions using continuous supplemental kinesthetic feedback.

Improved Spatial Knowledge Acquisition through Sensory Augmentation

Sensory augmentation provides novel opportunities to broaden our knowledge of human perception through external sensors that record and transmit information beyond natural perception. To assess whether such augmented senses affect the acquisition of spatial knowledge during navigation, we trained a group of 27 participants for six weeks with an augmented sense for cardinal directions called the feelSpace belt. Then, we recruited a control group that did not receive the augmented sense and the corresponding training. All 53 participants first explored the Westbrook virtual reality environment for two and a half hours spread over five sessions before assessing their spatial knowledge in four immersive virtual reality tasks measuring cardinal, route, and survey knowledge. We found that the belt group acquired significantly more accurate cardinal and survey knowledge, which was measured in pointing accuracy, distance, and rotation estimates. Interestingly, the augmented sense also positively affected route knowledge, although to a lesser degree. Finally, the belt group reported a significant increase in the use of spatial strategies after training, while the groups' ratings were comparable at baseline. The results suggest that six weeks of training with the feelSpace belt led to improved survey and route knowledge acquisition. Moreover, the findings of our study could inform the development of assistive technologies for individuals with visual or navigational impairments, which may lead to enhanced navigation skills and quality of life.

Digitally embodied lifespan neurocognitive development and Tactile Internet: Transdisciplinary challenges and opportunities

Mechanisms underlying perceptual processing and inference undergo substantial changes across the lifespan. If utilized properly, technologies could support and buffer the relatively more limited neurocognitive functions in the still developing or aging brains. Over the past decade, a new type of digital communication infrastructure, known as the "Tactile Internet (TI)," is emerging in the fields of telecommunication, sensor and actuator technologies and machine learning. A key aim of the TI is to enable humans to experience and interact with remote and virtual environments through digitalized multimodal sensory signals that also include the haptic (tactile and kinesthetic) sense. Besides their applied focus, such technologies may offer new opportunities for the research tapping into mechanisms of digitally embodied perception and cognition as well as how they may differ across age cohorts. However, there are challenges in translating empirical findings and theories about neurocognitive mechanisms of perception and lifespan development into the day-to-day practices of engineering research and technological development. On the one hand, the capacity and efficiency of digital communication are affected by signal transmission noise according to Shannon's (1949) Information Theory. On the other hand, neurotransmitters, which have been postulated as means that regulate the signal-to-noise ratio of neural information processing (e.g., Servan-Schreiber et al., 1990), decline substantially during aging. Thus, here we highlight neuronal gain control of perceptual processing and perceptual inference to illustrate potential interfaces for developing age-adjusted technologies to enable plausible multisensory digital embodiments for perceptual and cognitive interactions in remote or virtual environments.

Beyond Human Touch Perception: An Adaptive Robotic Skin Based on Gallium Microgranules for Pressure Sensory Augmentation

Robotic skin with human-skin-like sensing ability holds immense potential in various fields such as robotics, prosthetics, healthcare, and industries. To catch up with human skin, numerous studies are underway on pressure sensors integrated on robotic skin to improve the sensitivity and detection range. However, due to the trade-off between them, existing pressure sensors have achieved only a single aspect, either high sensitivity or wide bandwidth. Here, an adaptive robotic skin is proposed that has both high sensitivity and broad bandwidth with an augmented pressure sensing ability beyond the human skin. A key for the adaptive robotic skin is a tunable pressure sensor built with uniform gallium microgranules embedded in an elastomer, which provides large tuning of the sensitivity and the bandwidth, excellent sensor-to-sensor uniformity, and high reliability. Through the mode conversion based on the solid-liquid phase transition of gallium microgranules, the sensor provides 97% higher sensitivity (16.97 kPa^-1 ) in the soft mode and 262.5% wider bandwidth (≈1.45 MPa) in the rigid mode compared to the human skin. Successful demonstration of the adaptive robotic skin verifies its capabilities in sensing a wide spectrum of pressures ranging from subtle blood pulsation to body weight, suggesting broad use for various applications.

Less Vibrotactile Feedback Is Effective to Improve Human Balance Control during Sensory Cues Alteration

For individuals with altered sensory cues, vibrotactile feedback improves their balance control. However, should vibrotactile feedback be provided every time balance control is compromised, or only one-third of the time their balance is compromised? We hypothesized that vibrotactile feedback would improve balance control more when provided every time their balance is compromised. Healthy young adults were randomly assigned to two groups: group 33% feedback (6 males and 6 females) and group 100% feedback (6 males and 6 females). Vibrotactile feedbacks related to the body's sway angle amplitude and direction were provided, while participants stood upright on a foam surface with their eyes closed. Then, we assessed if balance control improvement lasted when the vibrotactile feedback was removed (i.e., post-vibration condition). Finally, we verified whether or not vibrotactile feedback unrelated to the body's sway angle and direction (sham condition) altered balance control. The results revealed no significant group difference in balance control improvement during vibrotactile feedback. Immediately following vibrotactile feedback, both groups reduced their balance control commands; body sway velocity and the ground reaction forces variability decreased. For both groups, unrelated vibrotactile feedback worsened balance control. These results confirmed that participants processed and implemented vibrotactile feedback to control their body sways. Less vibrotactile feedback was effective in improving balance control.

Vibrotactile Perception for Sensorimotor Augmentation: Perceptual Discrimination of Vibrotactile Stimuli Induced by Low-Cost Eccentric Rotating Mass Motors at Different Body Locations in Young, Middle-Aged, and Older Adults

Sensory augmentation technologies are being developed to convey useful supplemental sensory cues to people in comfortable, unobtrusive ways for the purpose of improving the ongoing control of volitional movement. Low-cost vibration motors are strong contenders for providing supplemental cues intended to enhance or augment closed-loop feedback control of limb movements in patients with proprioceptive deficits, but who still retain the ability to generate movement. However, it remains unclear what form such cues should take and where on the body they may be applied to enhance the perception-cognition-action cycle implicit in closed-loop feedback control. As a step toward addressing this knowledge gap, we used low-cost, wearable technology to examine the perceptual acuity of vibrotactile stimulus intensity discrimination at several candidate sites on the body in a sample of participants spanning a wide age range. We also sought to determine the extent to which the acuity of vibrotactile discrimination can improve over several days of discrimination training. Healthy adults performed a series of 2-alternative forced choice experiments that quantified capability to perceive small differences in the intensity of stimuli provided by low-cost eccentric rotating mass vibration motors fixed at various body locations. In one set of experiments, we found that the acuity of intensity discrimination was poorer in older participants than in middle-aged and younger participants, and that stimuli applied to the torso were systematically harder to discriminate than stimuli applied to the forearm, knee, or shoulders, which all had similar acuities. In another set of experiments, we found that older adults could improve intensity discrimination over the course of 3 days of practice on that task such that their final performance did not differ significantly from that of younger adults. These findings may be useful for future development of wearable technologies intended to improve the control of movements through the application of supplemental vibrotactile cues.

Preliminary Study of Vibrotactile Feedback during Home-Based Balance and Coordination Training in Individuals with Cerebellar Ataxia

Intensive balance and coordination training is the mainstay of treatment for symptoms of impaired balance and mobility in individuals with hereditary cerebellar ataxia. In this study, we compared the effects of home-based balance and coordination training with and without vibrotactile SA for individuals with hereditary cerebellar ataxia. Ten participants (five males, five females; 47  ±  12 years) with inherited forms of cerebellar ataxia were recruited to participate in a 12-week crossover study during which they completed two six-week blocks of balance and coordination training with and without vibrotactile SA. Participants were instructed to perform balance and coordination exercises five times per week using smartphone balance trainers that provided written, graphic, and video guidance and measured trunk sway. The pre-, per-, and post-training performance were assessed using the Scale for the Assessment and Rating of Ataxia (SARA), SARAposture&gait sub-scores, Dynamic Gait Index, modified Clinical Test of Sensory Interaction in Balance, Timed Up and Go performed with and without a cup of water, and multiple kinematic measures of postural sway measured with a single inertial measurement unit placed on the participants’ trunks. To explore the effects of training with and without vibrotactile SA, we compared the changes in performance achieved after participants completed each six-week block of training. Among the seven participants who completed both blocks of training, the change in the SARA scores and SARAposture&gait sub-scores following training with vibrotactile SA was not significantly different from the change achieved following training without SA (p>0.05). However, a trend toward improved SARA scores and SARAposture&gait sub-scores was observed following training with vibrotactile SA; compared to their pre-vibrotacile SA training scores, participants significantly improved their SARA scores (mean=−1.21, p=0.02) and SARAposture&gait sub-scores (mean=−1.00, p=0.01). In contrast, no significant changes in SARA scores and SARAposture&gait sub-scores were observed following the six weeks of training without SA compared to their pre-training scores immediately preceding the training block without vibrotactile SA (p>0.05). No significant changes in trunk kinematic sway parameters were observed as a result of training (p>0.05). Based on the findings from this preliminary study, balance and coordination training improved the participants’ motor performance, as captured through the SARA. Vibrotactile SA may be a beneficial addition to training regimens for individuals with hereditary cerebellar ataxia, but additional research with larger sample sizes is needed to assess the significance and generalizability of these findings.

Retention Effects of Long-Term Balance Training with Vibrotactile Sensory Augmentation in Healthy Older Adults

Vibrotactile sensory augmentation (SA) decreases postural sway during real-time use; however, limited studies have investigated the long-term effects of training with SA. This study assessed the retention effects of long-term balance training with and without vibrotactile SA among community-dwelling healthy older adults, and explored brain-related changes due to training with SA. Sixteen participants were randomly assigned to the experimental group (EG) or control group (CG), and trained in their homes for eight weeks using smart-phone balance trainers. The EG received vibrotactile SA. Balance performance was assessed before, and one week, one month, and six months after training. Functional MRI (fMRI) was recorded before and one week after training for four participants who received vestibular stimulation. Both groups demonstrated significant improvement of SOT composite and MiniBESTest scores, and increased vestibular reliance. Only the EG maintained a minimal detectable change of 8 points in SOT scores six months post-training and greater improvements than the CG in MiniBESTest scores one month post-training. The fMRI results revealed a shift from activation in the vestibular cortex pre-training to increased activity in the brainstem and cerebellum post-training. These findings showed that additional balance improvements were maintained for up to six months post-training with vibrotactile SA for community-dwelling healthy older adults.

Wearable Technologies Using Peripheral Neuromodulation to Enhance Mobility and Gait Function in Older Adults - A Narrative Review

BACKGROUND

Mounting evidence suggests that wearable technologies using peripheral neuromodulation can provide novel ways of improving mobility and gait function in various patient populations including older adults. The purpose of this narrative review is to provide an overview of wearable technologies/devices to improve mobility and gait function through noninvasive peripheral neuromodulation in older adults over the age of 65 and to indicate the suggested mechanism of action behind these technologies.

METHODS

We performed searches for articles and conference abstracts written in English, using the following databases: Embase Classic+Embase from 1947 to July 15, 2021; Ovid MEDLINE®; Epub Ahead of Print, In-Process, In-Data-Review & Other Non-Indexed Citations, Daily and Versions® from 1946 to July 15, 2021; PubMed; and Scopus.

RESULTS

Forty-one technologies met the inclusion/exclusion criteria. We found that the primary implementation of the 41 technologies can be divided into three main categories: sensory substitution, sensory augmentation (open loop, closed loop), and motor stimulation. Using these technologies, various aspects of mobility are treated or addressed, including e.g., gait function, fall risk, foot drop, navigating environment, postural control.

CONCLUSIONS

This narrative review summarizes wearable technologies that are currently commercially available and in stages of research and development. Overall, studies suggest that wearable peripheral neuromodulation technologies can improve aspects of mobility for older adults. Existing literature suggests that these technologies may lead to physiological changes in the brain through sensory re-weighting or other neuroplastic mechanisms to enhance the performance of mobility and gait function in older adults over the age of 65.

Effects of Concurrent and Terminal Visual Feedback on Ankle Co-Contraction in Older Adults during Standing Balance

This preliminary investigation studied the effects of concurrent and terminal visual feedback during a standing balance task on ankle co-contraction, which was accomplished via surface electromyography of an agonist–antagonist muscle pair (medial gastrocnemius and tibialis anterior muscles). Two complementary mathematical definitions of co-contraction indices captured changes in ankle muscle recruitment and modulation strategies. Nineteen healthy older adults received both feedback types in a randomized order. Following an analysis of co-contraction index reliability as a function of surface electromyography normalization technique, linear mixed-effects regression analyses revealed participants learned or utilized different ankle co-contraction recruitment (i.e., relative muscle pair activity magnitudes) and modulation (i.e., absolute muscle pair activity magnitudes) strategies depending on feedback type and following the cessation of feedback use. Ankle co-contraction modulation increased when concurrent feedback was used and significantly decreased when concurrent feedback was removed. Ankle co-contraction recruitment and modulation did not significantly change when terminal feedback was used or when it was removed. Neither ankle co-contraction recruitment nor modulation was significantly different when concurrent feedback was used compared to when terminal feedback was used. The changes in ankle co-contraction recruitment and modulation were significantly different when concurrent feedback was removed as compared to when terminal feedback was removed. Finally, this study found a significant interaction between feedback type, removal of feedback, and order of use of feedback type. These results have implications for the design of balance training technologies using visual feedback.

Stretching the skin immediately enhances perceived stiffness and gradually enhances the predictive control of grip force

When manipulating objects, we use kinesthetic and tactile information to form an internal representation of their mechanical properties for cognitive perception and for preventing their slippage using predictive control of grip force. A major challenge in understanding the dissociable contributions of tactile and kinesthetic information to perception and action is the natural coupling between them. Unlike previous studies that addressed this question either by focusing on impaired sensory processing in patients or using local anesthesia, we used a behavioral study with a programmable mechatronic device that stretches the skin of the fingertips to address this issue in the intact sensorimotor system. We found that artificial skin-stretch increases the predictive grip force modulation in anticipation of the load force. Moreover, the stretch causes an immediate illusion of touching a harder object that does not depend on the gradual development of the predictive modulation of grip force.

Using a Vibrotactile Biofeedback Device to Augment Foot Pressure During Walking in Healthy Older Adults: A Brief Report

Human movement based on sensory control is significant to motor task performance. Thus, impairments to sensory input significantly limit feedback-type motor control. The present study introduces a vibrotactile biofeedback (BF) system which augments information regarding the user’s foot pressure to enhance gait performance. The effects of the proposed system on the gait patterns of healthy older adults and on the cognitive load during gait were evaluated; these factors are essential to clarify feasibility of the device in real-life settings. The primary task of our study was to evaluate gait along with a cognitively demanding activity in 10 healthy older adults. Regarding kinematic and kinetic data in the BF condition, the subjects had significantly increased ankle dorsiflexion during the heel contact phase in the sagittal plane and marginally increased foot pressure at the toe-off and stride length. However, such kinematic and kinetic changes were not attributed to the increased walking speed. In addition, cognitive performance (i.e., the number of correct answers) was significantly decreased in participants during gait measurements in the BF condition. These data suggest that the system had the potential for modifying the kinematic and kinetic patterns during walking but not the more comprehensive walking performance in older adults. Moreover, the device appears to place a cognitive load on older adults. This short report provides crucial primary data that would help in designing successful sensory augmentation devices and further research on a BF system.

Supplemental vibrotactile feedback of real-time limb position enhances precision of goal-directed reaching

We examined vibrotactile stimulation as a form of supplemental limb state feedback to enhance planning and ongoing control of goal-directed movements. Subjects wore a two-dimensional vibrotactile display on their nondominant arm while performing horizontal planar reaching with the dominant arm. The vibrotactile display provided feedback of hand position such that small hand displacements were more easily discriminable using vibrotactile feedback than with intrinsic proprioceptive feedback. When subjects relied solely on proprioception to capture visuospatial targets, performance was degraded by proprioceptive drift and an expansion of task space. By contrast, reach accuracy was enhanced immediately when subjects were provided vibrotactile feedback and further improved over 2 days of training. Improvements reflected resolution of proprioceptive drift, which occurred only when vibrotactile feedback was active, demonstrating that benefits of vibrotactile feedback are due, in part to its integration into the ongoing control of movement. A partial resolution of task space expansion persisted even when vibrotactile feedback was inactive, demonstrating that training with vibrotactile feedback also induced changes in movement planning. However, the benefits of vibrotactile feedback come at a cognitive cost. All subjects adopted a stereotyped strategy wherein they attempted to capture targets by moving first along one axis of the vibrotactile display and then the other. For most subjects, this inefficient approach did not resolve over two bouts of training performed on separate days, suggesting that additional training is needed to integrate vibrotactile feedback into the planning and online control of goal-directed reaching in a way that promotes smooth and efficient movement. NEW & NOTEWORTHY A two-dimensional vibrotactile display provided state (not error) feedback to enhance control of a moving limb. Subjects learned to use state feedback to perform blind reaches with accuracy and precision exceeding that attained using intrinsic proprioception alone. Feedback utilization incurred substantial cognitive cost: subjects moved first along one axis of the vibrotactile display, then the other. This stereotyped control strategy must be overcome if vibrotactile limb state feedback is to promote naturalistic limb movements.

Haptic Glove and Platform with Gestural Control For Neuromorphic Tactile Sensory Feedback In Medical Telepresence †

Advancements in the study of the human sense of touch are fueling the field of haptics. This is paving the way for augmenting sensory perception during object palpation in tele-surgery and reproducing the sensed information through tactile feedback. Here, we present a novel tele-palpation apparatus that enables the user to detect nodules with various distinct stiffness buried in an ad-hoc polymeric phantom. The contact force measured by the platform was encoded using a neuromorphic model and reproduced on the index fingertip of a remote user through a haptic glove embedding a piezoelectric disk. We assessed the effectiveness of this feedback in allowing nodule identification under two experimental conditions of real-time telepresence: In Line of Sight (ILS), where the platform was placed in the visible range of a user; and the more demanding Not In Line of Sight (NILS), with the platform and the user being 50 km apart. We found that the entailed percentage of identification was higher for stiffer inclusions with respect to the softer ones (average of 74% within the duration of the task), in both telepresence conditions evaluated. These promising results call for further exploration of tactile augmentation technology for telepresence in medical interventions.

Potential Mechanisms of Sensory Augmentation Systems on Human Balance Control

Numerous studies have demonstrated the real-time use of visual, vibrotactile, auditory, and multimodal sensory augmentation technologies for reducing postural sway during static tasks and improving balance during dynamic tasks. The mechanism by which sensory augmentation information is processed and used by the CNS is not well understood. The dominant hypothesis, which has not been supported by rigorous experimental evidence, posits that observed reductions in postural sway are due to sensory reweighting: feedback of body motion provides the CNS with a correlate to the inputs from its intact sensory channels (e.g., vision, proprioception), so individuals receiving sensory augmentation learn to increasingly depend on these intact systems. Other possible mechanisms for observed postural sway reductions include: cognition (processing of sensory augmentation information is solely cognitive with no selective adjustment of sensory weights by the CNS), “sixth” sense (CNS interprets sensory augmentation information as a new and distinct sensory channel), context-specific adaptation (new sensorimotor program is developed through repeated interaction with the device and accessible only when the device is used), and combined volitional and non-volitional responses. This critical review summarizes the reported sensory augmentation findings spanning postural control models, clinical rehabilitation, laboratory-based real-time usage, and neuroimaging to critically evaluate each of the aforementioned mechanistic theories. Cognition and sensory re-weighting are identified as two mechanisms supported by the existing literature.

Effect of Dual Tasking on Vibrotactile Feedback Guided Reaching - a Pilot Study

Vibrotactile feedback (VTF) has been proposed as a non-invasive way to augment impaired or lost kinesthetic feedback in certain patient populations, thereby enhancing the real-time control of purposeful limb movements and quality of life. We used a dual tasking scenario to investigate the effects of cognitive load and short-term VTF training on VTF-guided reaching. Participants grasped the handle of a planar manipulandum with one hand and received VTF of its motion via a vibrotactile display attached to the non-moving arm. We asked participants to simultaneously perform VTF-guided reaching and a choice reaction time task both before and after training with VTF-guided reaching. Participants readily used VTF to guide goal-directed hand movements in the absence of visual feedback in the dual-task setting, even prior to training. This capability came at the cost of increased movement completion time. Short-term training on VTF-guided reaching induced significant improvements in target capture errors. Pre- and post-training comparisons of dual-task performance found training-related improvements in VTF-guided reach accuracy were resistant to dual-task interference. We found no training-related improvements in movement completion time or button press performance. These results indicate that VTF can be used to complete goal-directed reaches in a dual task situation, and that a single short bout of training sufficed for participants to begin the transition between the cognitive and associative phases of learning for the integration of VTF into the planning and ongoing control of reaching movements.

Neuromorphic Vibrotactile Stimulation of Fingertips for Encoding Object Stiffness in Telepresence Sensory Substitution and Augmentation Applications

We present a tactile telepresence system for real-time transmission of information about object stiffness to the human fingertips. Experimental tests were performed across two laboratories (Italy and Ireland). In the Italian laboratory, a mechatronic sensing platform indented different rubber samples. Information about rubber stiffness was converted into on-off events using a neuronal spiking model and sent to a vibrotactile glove in the Irish laboratory. Participants discriminated the variation of the stiffness of stimuli according to a two-alternative forced choice protocol. Stiffness discrimination was based on the variation of the temporal pattern of spikes generated during the indentation of the rubber samples. The results suggest that vibrotactile stimulation can effectively simulate surface stiffness when using neuronal spiking models to trigger vibrations in the haptic interface. Specifically, fractional variations of stiffness down to 0.67 were significantly discriminated with the developed neuromorphic haptic interface. This is a performance comparable, though slightly worse, to the threshold obtained in a benchmark experiment evaluating the same set of stimuli naturally with the own hand. Our paper presents a bioinspired method for delivering sensory feedback about object properties to human skin based on contingency-mimetic neuronal models, and can be useful for the design of high performance haptic devices.

Encapsulation of Piezoelectric Transducers for Sensory Augmentation and Substitution with Wearable Haptic Devices

The integration of polymeric actuators in haptic displays is widespread nowadays, especially in virtual reality and rehabilitation applications. However, we are still far from optimizing the transducer ability in conveying sensory information. Here, we present a vibrotactile actuator characterized by a piezoelectric disk embedded in a polydimethylsiloxane (PDMS) shell. An original encapsulation technique was performed to provide the stiff active element with a compliant cover as an interface towards the soft human skin. The interface stiffness, together with the new geometry, generated an effective transmission of vibrotactile stimulation and made the encapsulated transducer a performant component for the development of wearable tactile displays. The mechanical behavior of the developed transducer was numerically modeled as a function of the driving voltage and frequency, and the exerted normal forces were experimentally measured with a load cell. The actuator was then tested for the integration in a haptic glove in single-finger and bi-finger condition, in a 2-AFC tactile stimulus recognition test. Psychophysical results across all the tested sensory conditions confirmed that the developed integrated haptic system was effective in delivering vibrotactile information when the frequency applied to the skin is within the 200–700 Hz range and the stimulus variation is larger than 100 Hz.

Bayesian Alternation during Tactile Augmentation

A large number of studies suggest that the integration of multisensory signals by humans is well-described by Bayesian principles. However, there are very few reports about cue combination between a native and an augmented sense. In particular, we asked the question whether adult participants are able to integrate an augmented sensory cue with existing native sensory information. Hence for the purpose of this study, we build a tactile augmentation device. Consequently, we compared different hypotheses of how untrained adult participants combine information from a native and an augmented sense. In a two-interval forced choice (2 IFC) task, while subjects were blindfolded and seated on a rotating platform, our sensory augmentation device translated information on whole body yaw rotation to tactile stimulation. Three conditions were realized: tactile stimulation only (augmented condition), rotation only (native condition), and both augmented and native information (bimodal condition). Participants had to choose one out of two consecutive rotations with higher angular rotation. For the analysis, we fitted the participants' responses with a probit model and calculated the just notable difference (JND). Then, we compared several models for predicting bimodal from unimodal responses. An objective Bayesian alternation model yielded a better prediction (χ_red² = 1.67) than the Bayesian integration model (χ_red² = 4.34). Slightly higher accuracy showed a non-Bayesian winner takes all (WTA) model (χ_red² = 1.64), which either used only native or only augmented values per subject for prediction. However, the performance of the Bayesian alternation model could be substantially improved (χ_red² = 1.09) utilizing subjective weights obtained by a questionnaire. As a result, the subjective Bayesian alternation model predicted bimodal performance most accurately among all tested models. These results suggest that information from augmented and existing sensory modalities in untrained humans is combined via a subjective Bayesian alternation process. Therefore, we conclude that behavior in our bimodal condition is explained better by top down-subjective weighting than by bottom-up weighting based upon objective cue reliability.

Balance Improvement Effects of Biofeedback Systems with State-of-the-Art Wearable Sensors: A Systematic Review

Falls and fall-induced injuries are major global public health problems. Balance and gait disorders have been the second leading cause of falls. Inertial motion sensors and force sensors have been widely used to monitor both static and dynamic balance performance. Based on the detected performance, instant visual, auditory, electrotactile and vibrotactile biofeedback could be provided to augment the somatosensory input and enhance balance control. This review aims to synthesize the research examining the effect of biofeedback systems, with wearable inertial motion sensors and force sensors, on balance performance. Randomized and non-randomized clinical trials were included in this review. All studies were evaluated based on the methodological quality. Sample characteristics, device design and study characteristics were summarized. Most previous studies suggested that biofeedback devices were effective in enhancing static and dynamic balance in healthy young and older adults, and patients with balance and gait disorders. Attention should be paid to the choice of appropriate types of sensors and biofeedback for different intended purposes. Maximizing the computing capacity of the micro-processer, while minimizing the size of the electronic components, appears to be the future direction of optimizing the devices. Wearable balance-improving devices have their potential of serving as balance aids in daily life, which can be used indoors and outdoors.

A Vibrotactile and Plantar Force Measurement-Based Biofeedback System: Paving the Way towards Wearable Balance-Improving Devices

Although biofeedback systems have been used to improve balance with success, they were confined to hospital training applications. Little attempt has been made to investigate the use of in-shoe plantar force measurement and wireless technology to turn hospital training biofeedback systems into wearable devices. This research developed a wearable biofeedback system which detects body sway by analyzing the plantar force and provides users with the corresponding haptic cues. The effects of this system were evaluated in thirty young and elderly subjects with simulated reduced foot sensation. Subjects performed a Romberg test under three conditions: (1) no socks, system turned-off; (2) wearing five layers of socks, system turned-off; (3) wearing five layers of socks, and system turned-on. Degree of body sway was investigated by computing the center of pressure (COP) movement measured by a floor-mounted force platform. Plantar tactile sensation was evaluated using a monofilament test. Wearing multiple socks significantly decreased the plantar tactile sensory input (p < 0.05), and increased the COP parameters (p < 0.017), indicating increased postural sway. After turning on the biofeedback system, the COP parameters decreased significantly (p < 0.017). The positive results of this study should inspire future development of wearable plantar force-based biofeedback systems for improving balance in people with sensory deficits.

A mathematical model for incorporating biofeedback into human postural control

BACKGROUND

Biofeedback of body motion can serve as a balance aid and rehabilitation tool. To date, mathematical models considering the integration of biofeedback into postural control have represented this integration as a sensory addition and limited their application to a single degree-of-freedom representation of the body. This study has two objectives: 1) to develop a scalable method for incorporating biofeedback into postural control that is independent of the model's degrees of freedom, how it handles sensory integration, and the modeling of its postural controller; and 2) to validate this new model using multidirectional perturbation experimental results.

METHODS

Biofeedback was modeled as an additional torque to the postural controller torque. For validation, this biofeedback modeling approach was applied to a vibrotactile biofeedback device and incorporated into a two-link multibody model with full-state-feedback control that represents the dynamics of bipedal stance. Average response trajectories of body sway and center of pressure (COP) to multidirectional surface perturbations of subjects with vestibular deficits were used for model parameterization and validation in multiple perturbation directions and for multiple display resolutions. The quality of fit was quantified using average error and cross-correlation values.

RESULTS

The mean of the average errors across all tactor configurations and perturbations was 0.24° for body sway and 0.39 cm for COP. The mean of the cross-correlation value was 0.97 for both body sway and COP.

CONCLUSIONS

The biofeedback model developed in this study is capable of capturing experimental response trajectory shapes with low average errors and high cross-correlation values in both the anterior-posterior and medial-lateral directions for all perturbation directions and spatial resolution display configurations considered. The results validate that biofeedback can be modeled as an additional torque to the postural controller without a need for sensory reweighting. This novel approach is scalable and applicable to a wide range of movement conditions within the fields of balance and balance rehabilitation. The model confirms experimental results that increased display resolution does not necessarily lead to reduced body sway. To our knowledge, this is the first theoretical confirmation that a spatial display resolution of 180° can be as effective as a spatial resolution of 22.5°.

Sensory augmentation for the blind

Common navigational aids used by blind travelers during large-scale navigation divert attention away from important cues of the immediate environment (i.e., approaching vehicles). Sensory augmentation devices, relying on principles similar to those at work in sensory substitution, can potentially bypass the bottleneck of attention through sub-cognitive implementation of a set of rules coupling motor actions with sensory stimulation. We provide a late blind subject with a vibrotactile belt that continually signals the direction of magnetic north. The subject completed a set of behavioral tests before and after an extended training period. The tests were complemented by questionnaires and interviews. This newly supplied information improved performance on different time scales. In a pointing task we demonstrate an instant improvement of performance based on the signal provided by the device. Furthermore, the signal was helpful in relevant daily tasks, often complicated for the blind, such as keeping a direction over longer distances or taking shortcuts in familiar environments. A homing task with an additional attentional load demonstrated a significant improvement after training. The subject found the directional information highly expedient for the adjustment of his inner maps of familiar environments and describes an increase in his feeling of security when exploring unfamiliar environments with the belt. The results give evidence for a firm integration of the newly supplied signals into the behavior of this late blind subject with better navigational performance and more courageous behavior in unfamiliar environments. Most importantly, the complementary information provided by the belt lead to a positive emotional impact with enhanced feeling of security. The present experimental approach demonstrates the positive potential of sensory augmentation devices for the help of handicapped people.

Understanding fibromyalgia: lessons from the broader pain research community

Fibromyalgia (FM) is a chronic pain condition marked by centrally mediated augmentation of pain and sensory processes. Skepticism has marked the history of this condition, but more recent study has identified neurobiological underpinnings supporting many of the symptoms associated with this condition. Early research in FM had unprecedented latitude within the rheumatology community to borrow heavily from theory and methods being applied in chronic pain research more generally. These insights facilitated rapid advances in FM research, not the least of which was the abandonment of a peripheral focus in favor of studying central mechanisms associated with central augmentation. Currently, rapid-paced discovery is taking place in FM genetics, patient assessment, new therapeutic targets, and novel methods of treatment delivery. Such insights are not likely to be limited in application just to FM and could have relevance to the broader field of pain research as well.

PERSPECTIVE

This manuscript reviews the history of FM and its diagnosis, evidence supporting central augmentation of pain in FM, potential mechanisms of central augmentation, current approaches to integrated care of FM, and areas of active collaboration between FM research and other chronic pain conditions.