Robotic hand illusion with tactile feedback: Unravelling the relative contribution of visuotactile and visuomotor input to the representation of body parts in space

Characterization, Experimental Validation and Pilot User Study of the Vibro-Inertial Bionic Enhancement System (VIBES)

This study presents the characterization and validation of the VIBES, a wearable vibrotactile device that provides high-frequency tactile information embedded in a prosthetic socket. A psychophysical characterization involving ten able-bodied participants is performed to compute the Just Noticeable Difference (JND) related to the discrimination of vibrotactile cues delivered on the skin in two forearm positions, with the goal of optimising vibrotactile actuator position to maximise perceptual response. Furthermore, system performance is validated and tested both with ten able-bodied participants and one prosthesis user considering three tasks. More specifically, in the Active Texture Identification, Slippage and Fragile Object Experiments, we investigate if the VIBES could enhance users' roughness discrimination and manual usability and dexterity. Finally, we test the effect of the vibrotactile system on prosthetic embodiment in a Rubber Hand Illusion (RHI) task. Results show the system's effectiveness in conveying contact and texture cues, making it a potential tool to restore sensory feedback and enhance the embodiment in prosthetic users.

Between Meanings and Senses-Making Spaces: Agency and Ownership Emergence Formalization from Cultural-Historical Activity Theory Position, for an AI-Friendly Model

Sense of agency and sense of ownership are considered crucial in autonomous systems. However, drawbacks still exist regarding how to represent their causal origin and internal structure, either in formalized psychological models or in artificial systems. This paper considers that these drawbacks are based on the ontological and epistemological duality in mainstream psychology and AI. By shedding light on the cultural-historical activity theory (CHAT) and dialectical logic, and by building on and extending related work, this paper attempts to investigate how the noted duality affects investigating the self and "I". And by differentiating between the space of meanings and the sense-making space, the paper introduces CHAT's position of the causal emergence of agency and ownership by stressing the twofold transition theory being central to CHAT. Furthermore, a qualitative formalized model is introduced to represent the emergence of agency and ownership through the emergence of the contradictions-based meaning with potential employment in AI.

A framework for understanding prosthetic embodiment for the plastic surgeon

Plastic surgeons play a critical role in the management of amputations and are uniquely positioned to improve the lives and functional abilities of patients with limb loss. The embodiment of a prosthesis describes how effectively it replaces a missing limb and is an important aspect of patient care. Despite its importance, the current prosthetics literature lacks a formal definition of embodiment, and descriptions are often vague or incomplete. In this narrative review, we assess the current literature on prosthetic embodiment to explore the main mechanisms of embodiment and how each allows a prosthesis to interface with the human body. In doing so, we provide a comprehensive, holistic framework for understanding this concept.

Hand-worn devices for assessment and rehabilitation of motor function and their potential use in BCI protocols: a review

Introduction

Various neurological conditions can impair hand function. Affected individuals cannot fully participate in activities of daily living due to the lack of fine motor control. Neurorehabilitation emphasizes repetitive movement and subjective clinical assessments that require clinical experience to administer.

Methods

Here, we perform a review of literature focused on the use of hand-worn devices for rehabilitation and assessment of hand function. We paid particular attention to protocols that involve brain-computer interfaces (BCIs) since BCIs are gaining ground as a means for detecting volitional signals as the basis for interactive motor training protocols to augment recovery. All devices reviewed either monitor, assist, stimulate, or support hand and finger movement.

Results

A majority of studies reviewed here test or validate devices through clinical trials, especially for stroke. Even though sensor gloves are the most commonly employed type of device in this domain, they have certain limitations. Many such gloves use bend or inertial sensors to monitor the movement of individual digits, but few monitor both movement and applied pressure. The use of such devices in BCI protocols is also uncommon.

Discussion

We conclude that hand-worn devices that monitor both flexion and grip will benefit both clinical diagnostic assessment of function during treatment and closed-loop BCI protocols aimed at rehabilitation.

Role of Immersive Virtual Reality in Motor Behaviour Decision-Making in Chronic Pain Patients

Primary chronic pain is a major contributor to disability worldwide, with an estimated prevalence of 20-33% of the world's population. The high socio-economic impact of musculoskeletal pain justifies seeking an appropriate therapeutic strategy. Immersive virtual reality (VR) has been proposed as a first-line intervention for chronic musculoskeletal pain. However, the growing literature has not been accompanied by substantial progress in understanding how VR exerts its impact on the pain experience and what neurophysiological mechanisms might be involved in the clinical effectiveness of virtual reality interventions in chronic pain patients. The aim of this review is: (i) to establish the state of the art on the effects of VR on patients with chronic pain; (ii) to identify neuroplastic changes associated with chronic pain that may be targeted by VR intervention; and (iii) to propose a hypothesis on how immersive virtual reality could modify motor behavioral decision-making through an interactive experience in patients with chronic pain.

Human-Robot Body Experience: An Artificial Intelligence Perspective

Human body experience is remarkably flexible, which enables us to integrate passive tools as well as intelligent robotic devices into our body representation. Accordingly, it can serve as a role model to make (assistive) robots interact seamlessly with their users or to provide (humanoid) robots with a human-like self-perception and behavior generation. This article discusses the potential of understanding human body experience and applying it to robotics. Particular focus is set on how to use artificial intelligence techniques and create intelligent artificial agents from insights about human body experience. The discussion is based on a summary of the author’s habilitation thesis and combines theoretical and experimental perspectives from psychology, cognitive science and neuroscience as well as computer science, engineering, and artificial intelligence. From this, it derives directions for future developments towards creating artificial body intelligence with human-like capabilities.

Assess and rehabilitate body representations via (neuro)robotics: An emergent perspective

The perceptions of our own body (e.g., size and shape) do not always coincide with its real characteristics (e.g., dimension). To track the complexity of our perception, the concept of mental representations (model) of the body has been conceived. Body representations (BRs) are stored in the brain and are maintained and updated through multiple sensory information. Despite being altered in different clinical conditions and being tightly linked with self-consciousness, which is one of the most astonishing features of the human mind, the BRs and, especially, the underlying mechanisms and functions are still unclear. In this vein, here we suggest that (neuro)robotics can make an important contribution to the study of BRs. The first section of the study highlights the potential impact of robotics devices in investigating BRs. Far to be exhaustive, we illustrate major examples of its possible exploitation to further improve the assessment of motor, haptic, and multisensory information building up the BRs. In the second section, we review the main evidence showing the contribution of neurorobotics-based (multi)sensory stimulation in reducing BRs distortions in various clinical conditions (e.g., stroke, amputees). The present study illustrates an emergent multidisciplinary perspective combining the neuroscience of BRs and (neuro)robotics to understand and modulate the perception and experience of one's own body. We suggest that (neuro)robotics can enhance the study of BRs by improving experimental rigor and introducing new experimental conditions. Furthermore, it might pave the way for the rehabilitation of altered body perceptions.

Prosthetic embodiment: systematic review on definitions, measures, and experimental paradigms

The term embodiment has become omnipresent within prosthetics research and is often used as a metric of the progress made in prosthetic technologies, as well as a hallmark for user acceptance. However, despite the frequent use of the term, the concept of prosthetic embodiment is often left undefined or described incongruently, sometimes even within the same article. This terminological ambiguity complicates the comparison of studies using embodiment as a metric of success, which in turn hinders the advancement of prosthetics research. To resolve these terminological ambiguities, we systematically reviewed the used definitions of embodiment in the prosthetics literature. We performed a thematic analysis of the definitions and found that embodiment is often conceptualized in either of two frameworks based on body representations or experimental phenomenology. We concluded that treating prosthetic embodiment within an experimental phenomenological framework as the combination of ownership and agency allows for embodiment to be a quantifiable metric for use in translational research. To provide a common reference and guidance on how to best assess ownership and agency, we conducted a second systematic review, analyzing experiments and measures involving ownership and agency. Together, we highlight a pragmatic definition of prosthetic embodiment as the combination of ownership and agency, and in an accompanying article, we provide a perspective on a multi-dimensional framework for prosthetic embodiment. Here, we concluded by providing recommendations on metrics that allow for outcome comparisons between studies, thereby creating a common reference for further discussions within prosthetics research.

Feel-Good Requirements: Neurophysiological and Psychological Design Criteria of Affective Touch for (Assistive) Robots

Previous research has shown the value of the sense of embodiment, i.e., being able to integrate objects into one's bodily self-representation, and its connection to (assistive) robotics. Especially, tactile interfaces seem essential to integrate assistive robots into one's body model. Beyond functional feedback, such as tactile force sensing, the human sense of touch comprises specialized nerves for affective signals, which transmit positive sensations during slow and low-force tactile stimulations. Since these signals are extremely relevant for body experience as well as social and emotional contacts but scarcely considered in recent assistive devices, this review provides a requirement analysis to consider affective touch in engineering design. By analyzing quantitative and qualitative information from engineering, cognitive psychology, and neuroscienctific research, requirements are gathered and structured. The resulting requirements comprise technical data such as desired motion or force/torque patterns and an evaluation of potential stimulation modalities as well as their relations to overall user experience, e.g., pleasantness and realism of the sensations. This review systematically considers the very specific characteristics of affective touch and the corresponding parts of the neural system to define design goals and criteria. Based on the analysis, design recommendations for interfaces mediating affective touch are derived. This includes a consideration of biological principles and human perception thresholds which are complemented by an analysis of technical possibilities. Finally, we outline which psychological factors can be satisfied by the mediation of affective touch to increase acceptance of assistive devices and outline demands for further research and development.

Grasping Embodiment: Haptic Feedback for Artificial Limbs

Upper-limb prostheses are subject to high rates of abandonment. Prosthesis abandonment is related to a reduced sense of embodiment, the sense of self-location, agency, and ownership that humans feel in relation to their bodies and body parts. If a prosthesis does not evoke a sense of embodiment, users are less likely to view them as useful and integrated with their bodies. Currently, visual feedback is the only option for most prosthesis users to account for their augmented activities. However, for activities of daily living, such as grasping actions, haptic feedback is critically important and may improve sense of embodiment. Therefore, we are investigating how converting natural haptic feedback from the prosthetic fingertips into vibrotactile feedback administered to another location on the body may allow participants to experience haptic feedback and if and how this experience affects embodiment. While we found no differences between our experimental manipulations of feedback type, we found evidence that embodiment was not negatively impacted when switching from natural feedback to proximal vibrotactile feedback. Proximal vibrotactile feedback should be further studied and considered when designing prostheses.

Prosthesis embodiment and attenuation of prosthetic touch in upper limb amputees - A proof-of-concept study

Sensory attenuation of self-touch, that is, the perceptual reduction of self-generated tactile stimuli, is considered a neurocognitive basis for self-other distinction. However, whether this effect can also be found in upper limb amputees using a prosthesis is unknown. Thirteen participants were asked to touch their foot sole with a) their intact hand (self-touch), b) their prosthesis (prosthesis-touch), or c) let it be touched by another person (other-touch). Intensity of touch was assessed with a questionnaire. In addition, prosthesis embodiment was assessed in nine participants. Self-touch as well as prosthesis-touch was characterized by significant perceptual attenuation compared to other-touch, while self- and prosthesis-touch did not differ. The more embodied the prosthesis was, the more similar was its elicited touch perception to actual self-touch. These findings - although preliminary - suggest that perceptually embodied prostheses can be represented as an actual limb by the users' sensorimotor system.

Perceptual correlates of successful body-prosthesis interaction in lower limb amputees: psychometric characterisation and development of the Prosthesis Embodiment Scale

Prostheses are used to at least partly restore the body after limb amputation. Making the user accepting the prosthetic device as part of his or her body, i.e., inducing prosthesis embodiment, has been identified as major aim of prosthetic treatment. However, up to now, there is no consensus about the psychometric nature of prosthesis embodiment in limb amputees. In the present study, 118 unilateral lower limb amputees using a prosthesis were asked to complete an online questionnaire targeting prosthesis embodiment. Principal axis factoring revealed the factor structure of prosthesis embodiment, i.e., Ownership/Integrity, Agency, and Anatomical Plausibility, which resembles the embodiment structure previously identified for normally-limbed participants. The majority of amputees achieved prosthesis embodiment as assessed with the final version of the newly developed Prosthesis Embodiment Scale. Internal consistency was excellent, and test–retest reliability was satisfying, while the instrument was also sensitive for new prosthetic equipment. Validation on the basis of relationships to prosthesis satisfaction and adjustment to prosthesis use was performed. The Prosthesis Embodiment Scale could be a valuable tool for the assessment of perceptual correlates of successful body–prosthesis interaction in rehabilitative and research contexts, the latter which might further benefit from the comparability of psychometrically evaluated data.

Toward Enhanced Teleoperation Through Embodiment

Telerobotics aims to transfer human manipulation skills and dexterity over an arbitrary distance and at an arbitrary scale to a remote workplace. A telerobotic system that is transparent enables a natural and intuitive interaction. We postulate that embodiment (with three sub-components: sense of ownership, agency, and self-location) of the robotic system leads to optimal perceptual transparency and increases task performance. However, this has not yet been investigated directly. We reason along four premises and present findings from the literature that substantiate each of them: (1) the brain can embody non-bodily objects (e.g., robotic hands), (2) embodiment can be elicited with mediated sensorimotor interaction, (3) embodiment is robust against inconsistencies between the robotic system and the operator's body, and (4) embodiment positively correlates to dexterous task performance. We use the predictive encoding theory as a framework to interpret and discuss the results reported in the literature. Numerous previous studies have shown that it is possible to induce embodiment over a wide range of virtual and real extracorporeal objects (including artificial limbs, avatars, and android robots) through mediated sensorimotor interaction. Also, embodiment can occur for non-human morphologies including for elongated arms and a tail. In accordance with the predictive encoding theory, none of the sensory modalities is critical in establishing ownership, and discrepancies in multisensory signals do not necessarily lead to loss of embodiment. However, large discrepancies in terms of multisensory synchrony or visual likeness can prohibit embodiment from occurring. The literature provides less extensive support for the link between embodiment and (dexterous) task performance. However, data gathered with prosthetic hands do indicate a positive correlation. We conclude that all four premises are supported by direct or indirect evidence in the literature, suggesting that embodiment of a remote manipulator may improve dexterous performance in telerobotics. This warrants further implementation testing of embodiment in telerobotics. We formulate a first set of guidelines to apply embodiment in telerobotics and identify some important research topics.