Robotic gaming prototype for upper limb exercise: Effects of age and embodiment on user preferences and movement

How can robots facilitate physical, cognitive, and social engagement in skilled nursing facilities?

As people live longer, the population of older adults in need of support continues to expand relative to the available workforce of caregivers, necessitating new solutions to supplement caregiver availability for the physical, cognitive, and social needs of older adults. Robotics and automation present strong possible solutions. Past solutions have typically supported short-term rehabilitation and aging in place, yet many older adults live in skilled nursing facilities (SNFs), a setting reached by relatively little research to date. In this paper, we examine the unique needs of staff and residents at SNFs, after which we begin an iterative design process of robot-mediated wellness activities for the SNF space. We worked closely with domain experts in exercise science and physical therapy for older adults and a local SNF to design and test a series of robot-mediated activity prototypes with residents, visitors, and staff. We found that while both residents and staff highly value physical activity, there are nuanced challenges associated with supporting resident activity (one important element of overall wellbeing). As a result, we considered and tested a wide range of intervention options from usual approaches (e.g., mirroring movements) to creative approaches (e.g., social engagement via lewd humor). Our final design insights can inform practitioners who wish to use robots to support resident wellbeing in SNFs.

Socially Assistive Robot for Stroke Rehabilitation: A Long-Term in-the-Wild Pilot Randomized Controlled Trial

Socially assistive robots (SARs) have been suggested as a platform for post-stroke training. It is not yet known whether long-term interaction with a SAR can lead to an improvement in the functional ability of individuals post-stroke. The aim of this pilot study was to compare the changes in motor ability and quality of life following a long-term intervention for upper-limb rehabilitation of post-stroke individuals using three approaches: 1) training with a SAR in addition to usual care; 2) training with a computer in addition to usual care; and 3) usual care with no additional intervention. Thirty-three post-stroke patients with moderate-severe to mild impairment were randomly allocated into three groups: two intervention groups - one with a SAR (ROBOT group) and one with a computer (COMPUTER group) - and one control group with no intervention (CONTROL group). The intervention sessions took place three times/week, for a total of 15 sessions/participant; The study was conducted over a period of two years, during which 306 sessions were held. Twenty-six participants completed the study. Participants in the ROBOT group significantly improved in their kinematic and clinical measures which included smoothness of movement, action research arm test (ARAT), and Fugl-Meyer upper-extremity assessment (FMA-UE). No significant improvement in these measures was found in the COMPUTER or the control groups. 100% of the participants in the SAR group gained improvement which reached - or exceeded - the minimal clinically important difference in the ARAT, the gold standard for upper-extremity activity performance post-stroke. This study demonstrates both the feasibility and the clinical benefit of using a SAR for long-term interaction with post-stroke individuals as part of their rehabilitation program. Trial Registration: ClinicalTrials.gov NCT03651063.

Personalization Characteristics and Evaluation of Gamified Exercise for Middle-Aged and Older People: A Scoping Review

Many studies have shown that personalized exergames have a positive effect on promoting regular and proper exercise. However, there is no consensus on the design characteristics and evaluation of exergames. This systematic review of published research literature aimed to explore the general characteristics, personalization characteristics, and evaluation of personalized exergames for middle-aged and older people. We screened published studies in the Web of Science, Scopus, PubMed, ACM, and IEEE Xplore databases, extracted data, and performed a thematic analysis according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews checklist. Three main themes and nine subthemes were generated from 24 included papers. Moreover, a personalization model (FACTS) and evaluation system (PMSS) of exergames were developed. Personalized exergames had potential positive effects on motivating middle-aged and older people to exercise and improve their health, particularly physical, mental, and social health. However, more fine-grained studies on personalized exergames are necessary in the future.

How should robots exercise with people? Robot-mediated exergames win with music, social analogues, and gameplay clarity

Introduction: The modern worldwide trend toward sedentary behavior comes with significant health risks. An accompanying wave of health technologies has tried to encourage physical activity, but these approaches often yield limited use and retention. Due to their unique ability to serve as both a health-promoting technology and a social peer, we propose robots as a game-changing solution for encouraging physical activity. Methods: This article analyzes the eight exergames we previously created for the Rethink Baxter Research Robot in terms of four key components that are grounded in the video-game literature: repetition, pattern matching, music, and social design. We use these four game facets to assess gameplay data from 40 adult users who each experienced the games in balanced random order. Results: In agreement with prior research, our results show that relevant musical cultural references, recognizable social analogues, and gameplay clarity are good strategies for taking an otherwise highly repetitive physical activity and making it engaging and popular among users. Discussion: Others who study socially assistive robots and rehabilitation robotics can benefit from this work by considering the presented design attributes to generate future hypotheses and by using our eight open-source games to pursue follow-up work on social-physical exercise with robots.

Socially Assistive Robots for Parkinson's Disease: Needs, Attitudes and Specific Applications as Identified by Healthcare Professionals

To explore how socially assistive robots (SARs) may assist the specific needs of individuals with Parkinson's disease (IwPD), we conducted three focus groups with 12 clinicians who treat IwPD. We present a thematic analysis of their perceptions of the needs of the patients, and their own expectations, perceived advantages, disadvantages and concerns regarding the use of SARs for IwPD. Clinicians were positive towards using SARs for IwPD, if used in the patient's home, for motor, communication, emotional, and cognitive needs, especially for practice and for help with activities of daily living. They were concerned that a SAR might be used to replace clinicians’ work, and stressed it should only augment the clinicians’ work. They thought a SAR may relieve some of the burden experienced by informal caregivers, and identified specific applications for SARs for PD. We asked 18 stakeholders (nine IwPD, nine family members) to rate their level of agreement with the clinicians’ statements. The greatest divergence between their views and those of the clinicians was on the topic of using a SAR as a companion, or as a feeding assistant, to which they objected. This work may be used as a basis for future studies designing SARs for IwPD.

A Socially Assistive Robot for Stroke Patients: Acceptance, Needs, and Concerns of Patients and Informal Caregivers

Stroke patients often contend with long-term physical challenges that require treatment and support from both formal and informal caregivers. Socially Assistive Robots (SARs) can assist patients in their physical rehabilitation process and relieve some of the burden on the informal caregivers, such as spouses and family members. We collected and analyzed information from 23 participants (11 stroke patients and 12 informal caregivers) who participated in a total of six focus-group discussions. The participants responded to questions regarding using a SAR to promote physical exercises during the rehabilitation process: (a) the advantages and disadvantages of doing so; (b) specific needs that they wish a SAR would address; (c) patient-specific adaptations they would propose to include; and (d) concerns they had regarding the use of such technology in stroke rehabilitation. We found that the majority of the participants in both groups were interested in experiencing the use of a SAR for rehabilitation, in the clinic and at home. Both groups noted the advantage of having the constant presence of a motivating entity with whom they can practice their rehabilitative exercises. The patients noted how such a device can assist formal caregivers in managing their workload, while the informal caregivers indicated that such a system could ease their own workload and sense of burden. The main disadvantages that participants noted related to the robot not possessing human abilities, such as the ability to hold a conversation, to physically guide the patient's movements, and to express or understand emotions. We anticipate that the data collected in this study-input from the patients and their family members, including the similarities and differences between their points of view-will aid in improving the development of SARs for rehabilitation, so that they can better suit people who have had a stroke, and meet their individual needs.

Interaction Matters: The Effect of Touching the Social Robot PARO on Pain and Stress is Stronger When Turned ON vs. OFF

Social touch between humans, as well as between humans and animals, was previously found to reduce pain and stress. We previously reported that touching a social robot can also induce a reduction in pain ratings. However, it is unclear if the effect that touching a robot has on pain perception is due to its appearance and its pleasant touch, or due to its ability to socially interact with humans. In the current experiment, we aimed to assess the contribution of the interactive quality to pain perception. We assessed the effect of touching the social robot PARO on mild and strong pain ratings and on stress perception, on a total of 60 healthy young participants. The robot either interacted with participants (ON group, n = 30) or was turned off (OFF group, n = 30). Touching the robot induced a decrease in mild pain ratings (compared to baseline) only in the ON group while strong pain ratings decreased similarly in both the ON and the OFF groups. The decrease in mild pain ratings in the ON group was significantly greater in participants with a higher positive perception of the interaction with PARO. We conclude that part of the effect that touching the robot has on pain stems from its interactive features.

A robot goes to rehab: a novel gamified system for long-term stroke rehabilitation using a socially assistive robot-methodology and usability testing

Background

Socially assistive robots (SARs) have been proposed as a tool to help individuals who have had a stroke to perform their exercise during their rehabilitation process. Yet, to date, there are no data on the motivating benefit of SARs in a long-term interaction with post-stroke patients.

Methods

Here, we describe a robot-based gamified exercise platform, which we developed for long-term post-stroke rehabilitation. The platform uses the humanoid robot Pepper, and also has a computer-based configuration (with no robot). It includes seven gamified sets of exercises, which are based on functional tasks from the everyday life of the patients. The platform gives the patients instructions, as well as feedback on their performance, and can track their performance over time. We performed a long-term patient-usability study, where 24 post-stroke patients were randomly allocated to exercise with this platform—either with the robot or the computer configuration—over a 5–7 week period, 3 times per week, for a total of 306 sessions.

Results

The participants in both groups reported that this rehabilitation platform addressed their arm rehabilitation needs, and they expressed their desire to continue training with it even after the study ended. We found a trend for higher acceptance of the system by the participants in the robot group on all parameters; however, this difference was not significant. We found that system failures did not affect the long-term trust that users felt towards the system.

Conclusions

We demonstrated the usability of using this platform for a long-term rehabilitation with post-stroke patients in a clinical setting. We found high levels of acceptance of both platform configurations by patients following this interaction, with higher ratings given to the SAR configuration. We show that it is not the mere use of technology that increases the motivation of the person to practice, but rather it is the appreciation of the technology’s effectiveness and its perceived contribution to the rehabilitation process. In addition, we provide a list of guidelines that can be used when designing and implementing other technological tools for rehabilitation.

Trial registration: This trial is registered in the NIH ClinicalTrials.gov database. Registration number NCT03651063, registration date 21.08.2018. https://clinicaltrials.gov/ct2/show/NCT03651063.

Mirror Visual Feedback Prior to Robot-Assisted Training Facilitates Rehabilitation After Stroke: A Randomized Controlled Study

Purpose: Robot-assisted training has been widely used in neurorehabilitation, but its effect on facilitating recovery after stroke remains controversial. One possible reason might be lacking consideration of the role of embodiment in robotic systems. Mirror visual feedback is an ideal method to approach embodiment. Thus, we hypothesized that mirror visual feedback priming with subsequent robot-assisted training might provide additional treatment benefits in rehabilitation. Method: This is a prospective, assessor-blinded, randomized, controlled study. Forty subacute stroke patients were randomly assigned into an experimental group (N = 20) or a control group (N = 20). They received either mirror visual feedback or sham-mirror visual feedback prior to robot-assisted training for 1.5 h/day, 5 days/week for 4 weeks. Before and after intervention, the Fugl-Meyer Assessment Upper Limb subscale, the Functional Independence Measure, the modified Barthel Index, and grip strength were measured. Scores of four specified games were recorded pre and post one-time mirror visual feedback priming before intervention in the experimental group. Results: All measurements improved significantly in both groups following interventions. Moreover, the Fugl-Meyer Assessment Upper Limb subscale, self-care subscale of the Functional Independence Measure, and the grip strength were improved significantly in the experimental group after a 4-week intervention, compared with the control group. Significantly higher scores of two games were revealed after one-time priming. Conclusions: Mirror visual feedback prior to robot-assisted training could prompt motor recovery, increase ability of self-care, and potentially enhance grip strength in stroke patients, compared to control treatment. Moreover, mirror visual feedback priming might have the capability to improve the patient's performance and engagement during robot-assisted training, which could prompt the design and development of robotic systems. Clinical Trial Registration: www.ClinicalTrials.gov, identifier: ChiCTR1900023356.

A Survey on Gamification for Health Rehabilitation Care: Applications, Opportunities, and Open Challenges

Research trends in gamification have shown a significant diversity in various areas of e-health, particularly in addressing the issues of rehabilitation and physical activity. Rehabilitation requires better engaging tools that help to increase the patient’s motivation and engagement in particular forms of rehabilitation training. Adopting gamification in rehabilitation offers different treatment and care environments when implementing rehabilitation training. As gamification is increasingly being explored in rehabilitation, one might not realize that using various techniques in gamified applications yields a different effect on gameplay. To date, varied gamification techniques have been utilized to provide useful experiences from the perspective of health applications. However, a limited number of surveys have investigated the gamification of rehabilitation and the use of suitable game techniques for rehabilitation in the literature. The objective of this paper is to examine and analyze the existing gamification techniques for rehabilitation applications. A classification of rehabilitation gamification is developed based on the rehabilitation gamifying requirements and the gamification characteristics that are commonly applied in rehabilitation applications. This classification is the main contribution of this paper. It provides insight for researchers and practitioners into suitable techniques to design and apply gamification with increased motivation and sustainable engagement for rehabilitation treatment and care. In addition, different game elements, selection blocks, and gamification techniques are identified for application in rehabilitation. In conclusion, several challenges and research opportunities are discussed to improve gamification deployment in rehabilitation in the future.

Touching the social robot PARO reduces pain perception and salivary oxytocin levels

Human-human social touch improves mood and alleviates pain. No studies have so far tested the effect of human-robot emotional touch on experimentally induced pain ratings, on mood and on oxytocin levels in healthy young adults. Here, we assessed the effect of touching the robot PARO on pain perception, on mood and on salivary oxytocin levels, in 83 young adults. We measured their perceived pain, happiness state, and salivary oxytocin. For the 63 participants in the PARO group, pain was assessed in three conditions: Baseline, Touch (touching PARO) and No-Touch (PARO present). The control group (20 participants) underwent the same measurements without ever encountering PARO. There was a decrease in pain ratings and in oxytocin levels and an increase in happiness ratings compared to baseline only in the PARO group. The Touch condition yielded a larger decrease in pain ratings compared to No-Touch. These effects correlated with the participants' positive perceptions of the interaction with PARO. Participants with higher perceived ability to communicate with PARO experienced a greater hypoalgesic effect when touching PARO. We show that human-robot social touch is effective in reducing pain ratings, improving mood and - surprisingly - reducing salivary oxytocin levels in adults.

Exercising with Baxter: preliminary support for assistive social-physical human-robot interaction

BACKGROUND

The worldwide population of older adults will soon exceed the capacity of assisted living facilities. Accordingly, we aim to understand whether appropriately designed robots could help older adults stay active at home.

METHODS

Building on related literature as well as guidance from experts in game design, rehabilitation, and physical and occupational therapy, we developed eight human-robot exercise games for the Baxter Research Robot, six of which involve physical human-robot contact. After extensive iteration, these games were tested in an exploratory user study including 20 younger adult and 20 older adult users.

RESULTS

Only socially and physically interactive games fell in the highest ranges for pleasantness, enjoyment, engagement, cognitive challenge, and energy level. Our games successfully spanned three different physical, cognitive, and temporal challenge levels. User trust and confidence in Baxter increased significantly between pre- and post-study assessments. Older adults experienced higher exercise, energy, and engagement levels than younger adults, and women rated the robot more highly than men on several survey questions.

CONCLUSIONS

The results indicate that social-physical exercise with a robot is more pleasant, enjoyable, engaging, cognitively challenging, and energetic than similar interactions that lack physical touch. In addition to this main finding, researchers working in similar areas can build on our design practices, our open-source resources, and the age-group and gender differences that we found.

Smooth leader or sharp follower? Playing the mirror game with a robot

Background:

The increasing number of opportunities for human-robot interactions in various settings, from industry through home use to rehabilitation, creates a need to understand how to best personalize human-robot interactions to fit both the user and the task at hand. In the current experiment, we explored a human-robot collaborative task of joint movement, in the context of an interactive game.

Objective:

We set out to test people’s preferences when interacting with a robotic arm, playing a leader-follower imitation game (the mirror game).

Methods:

Twenty two young participants played the mirror game with the robotic arm, where one player (person or robot) followed the movements of the other. Each partner (person and robot) was leading part of the time, and following part of the time. When the robotic arm was leading the joint movement, it performed movements that were either sharp or smooth, which participants were later asked to rate.

Results:

The greatest preference was given to smooth movements. Half of the participants preferred to lead, and half preferred to follow. Importantly, we found that the movements of the robotic arm primed the subsequent movements performed by the participants.

Conclusion:

The priming effect by the robot on the movements of the human should be considered when designing interactions with robots. Our results demonstrate individual differences in preferences regarding the role of the human and the joint motion path of the robot and the human when performing the mirror game collaborative task, and highlight the importance of personalized human-robot interactions.