Smooth leader or sharp follower? Playing the mirror game with a robot

How can robots facilitate physical, cognitive, and social engagement in skilled nursing facilities?

As people live longer, the population of older adults in need of support continues to expand relative to the available workforce of caregivers, necessitating new solutions to supplement caregiver availability for the physical, cognitive, and social needs of older adults. Robotics and automation present strong possible solutions. Past solutions have typically supported short-term rehabilitation and aging in place, yet many older adults live in skilled nursing facilities (SNFs), a setting reached by relatively little research to date. In this paper, we examine the unique needs of staff and residents at SNFs, after which we begin an iterative design process of robot-mediated wellness activities for the SNF space. We worked closely with domain experts in exercise science and physical therapy for older adults and a local SNF to design and test a series of robot-mediated activity prototypes with residents, visitors, and staff. We found that while both residents and staff highly value physical activity, there are nuanced challenges associated with supporting resident activity (one important element of overall wellbeing). As a result, we considered and tested a wide range of intervention options from usual approaches (e.g., mirroring movements) to creative approaches (e.g., social engagement via lewd humor). Our final design insights can inform practitioners who wish to use robots to support resident wellbeing in SNFs.

How should robots exercise with people? Robot-mediated exergames win with music, social analogues, and gameplay clarity

Introduction: The modern worldwide trend toward sedentary behavior comes with significant health risks. An accompanying wave of health technologies has tried to encourage physical activity, but these approaches often yield limited use and retention. Due to their unique ability to serve as both a health-promoting technology and a social peer, we propose robots as a game-changing solution for encouraging physical activity. Methods: This article analyzes the eight exergames we previously created for the Rethink Baxter Research Robot in terms of four key components that are grounded in the video-game literature: repetition, pattern matching, music, and social design. We use these four game facets to assess gameplay data from 40 adult users who each experienced the games in balanced random order. Results: In agreement with prior research, our results show that relevant musical cultural references, recognizable social analogues, and gameplay clarity are good strategies for taking an otherwise highly repetitive physical activity and making it engaging and popular among users. Discussion: Others who study socially assistive robots and rehabilitation robotics can benefit from this work by considering the presented design attributes to generate future hypotheses and by using our eight open-source games to pursue follow-up work on social-physical exercise with robots.

Playing the mirror game in virtual reality with an autonomous character

Perceptual-motor synchronisation in human groups is crucial in many activities, from musical ensembles to sports teams. To this aim, the mirror game, where partners are asked to imitate each other's movements or gestures, is one of the best available experimental paradigms to study how humans engage in joint tasks and how they tend to synchronise their behaviour. However, to date, virtual reality characters do not engage in motor synchronisation with human users. In this work, we explored to what extent an autonomous virtual character and a human that play the mirror game in virtual reality can synchronise their behaviour. We created a full-body version of the mirror game with an autonomous virtual character, whose movements were driven by a model based on coupled oscillators. Participants engaged in a joint imitation task with a virtual player animated with one of three options: a model that included a small coupling, a model with no coupling, or another human. Behavioural measures and subjective reports suggest that participants were unable to distinguish the condition of small coupling from the engagement with an avatar driven by another human participant.

Socially Assistive Robots for Parkinson's Disease: Needs, Attitudes and Specific Applications as Identified by Healthcare Professionals

To explore how socially assistive robots (SARs) may assist the specific needs of individuals with Parkinson's disease (IwPD), we conducted three focus groups with 12 clinicians who treat IwPD. We present a thematic analysis of their perceptions of the needs of the patients, and their own expectations, perceived advantages, disadvantages and concerns regarding the use of SARs for IwPD. Clinicians were positive towards using SARs for IwPD, if used in the patient's home, for motor, communication, emotional, and cognitive needs, especially for practice and for help with activities of daily living. They were concerned that a SAR might be used to replace clinicians’ work, and stressed it should only augment the clinicians’ work. They thought a SAR may relieve some of the burden experienced by informal caregivers, and identified specific applications for SARs for PD. We asked 18 stakeholders (nine IwPD, nine family members) to rate their level of agreement with the clinicians’ statements. The greatest divergence between their views and those of the clinicians was on the topic of using a SAR as a companion, or as a feeding assistant, to which they objected. This work may be used as a basis for future studies designing SARs for IwPD.

A Socially Assistive Robot for Stroke Patients: Acceptance, Needs, and Concerns of Patients and Informal Caregivers

Stroke patients often contend with long-term physical challenges that require treatment and support from both formal and informal caregivers. Socially Assistive Robots (SARs) can assist patients in their physical rehabilitation process and relieve some of the burden on the informal caregivers, such as spouses and family members. We collected and analyzed information from 23 participants (11 stroke patients and 12 informal caregivers) who participated in a total of six focus-group discussions. The participants responded to questions regarding using a SAR to promote physical exercises during the rehabilitation process: (a) the advantages and disadvantages of doing so; (b) specific needs that they wish a SAR would address; (c) patient-specific adaptations they would propose to include; and (d) concerns they had regarding the use of such technology in stroke rehabilitation. We found that the majority of the participants in both groups were interested in experiencing the use of a SAR for rehabilitation, in the clinic and at home. Both groups noted the advantage of having the constant presence of a motivating entity with whom they can practice their rehabilitative exercises. The patients noted how such a device can assist formal caregivers in managing their workload, while the informal caregivers indicated that such a system could ease their own workload and sense of burden. The main disadvantages that participants noted related to the robot not possessing human abilities, such as the ability to hold a conversation, to physically guide the patient's movements, and to express or understand emotions. We anticipate that the data collected in this study-input from the patients and their family members, including the similarities and differences between their points of view-will aid in improving the development of SARs for rehabilitation, so that they can better suit people who have had a stroke, and meet their individual needs.

Interaction Matters: The Effect of Touching the Social Robot PARO on Pain and Stress is Stronger When Turned ON vs. OFF

Social touch between humans, as well as between humans and animals, was previously found to reduce pain and stress. We previously reported that touching a social robot can also induce a reduction in pain ratings. However, it is unclear if the effect that touching a robot has on pain perception is due to its appearance and its pleasant touch, or due to its ability to socially interact with humans. In the current experiment, we aimed to assess the contribution of the interactive quality to pain perception. We assessed the effect of touching the social robot PARO on mild and strong pain ratings and on stress perception, on a total of 60 healthy young participants. The robot either interacted with participants (ON group, n = 30) or was turned off (OFF group, n = 30). Touching the robot induced a decrease in mild pain ratings (compared to baseline) only in the ON group while strong pain ratings decreased similarly in both the ON and the OFF groups. The decrease in mild pain ratings in the ON group was significantly greater in participants with a higher positive perception of the interaction with PARO. We conclude that part of the effect that touching the robot has on pain stems from its interactive features.

A robot goes to rehab: a novel gamified system for long-term stroke rehabilitation using a socially assistive robot-methodology and usability testing

Background

Socially assistive robots (SARs) have been proposed as a tool to help individuals who have had a stroke to perform their exercise during their rehabilitation process. Yet, to date, there are no data on the motivating benefit of SARs in a long-term interaction with post-stroke patients.

Methods

Here, we describe a robot-based gamified exercise platform, which we developed for long-term post-stroke rehabilitation. The platform uses the humanoid robot Pepper, and also has a computer-based configuration (with no robot). It includes seven gamified sets of exercises, which are based on functional tasks from the everyday life of the patients. The platform gives the patients instructions, as well as feedback on their performance, and can track their performance over time. We performed a long-term patient-usability study, where 24 post-stroke patients were randomly allocated to exercise with this platform—either with the robot or the computer configuration—over a 5–7 week period, 3 times per week, for a total of 306 sessions.

Results

The participants in both groups reported that this rehabilitation platform addressed their arm rehabilitation needs, and they expressed their desire to continue training with it even after the study ended. We found a trend for higher acceptance of the system by the participants in the robot group on all parameters; however, this difference was not significant. We found that system failures did not affect the long-term trust that users felt towards the system.

Conclusions

We demonstrated the usability of using this platform for a long-term rehabilitation with post-stroke patients in a clinical setting. We found high levels of acceptance of both platform configurations by patients following this interaction, with higher ratings given to the SAR configuration. We show that it is not the mere use of technology that increases the motivation of the person to practice, but rather it is the appreciation of the technology’s effectiveness and its perceived contribution to the rehabilitation process. In addition, we provide a list of guidelines that can be used when designing and implementing other technological tools for rehabilitation.

Trial registration: This trial is registered in the NIH ClinicalTrials.gov database. Registration number NCT03651063, registration date 21.08.2018. https://clinicaltrials.gov/ct2/show/NCT03651063.

Learning-Enabled Robotic Assistive Support: Understanding Older Adult Opinions and Comparing Them to Younger Adult Opinions

Background

As older adults age, they may require assistance completing activities of daily living (ADLs). Robotic assistance can offset healthcare costs and allow older adults to preserve their autonomy. Younger adults are often involved in the design and purchase of these robotic technologies, and must take into account the needs and expectations of the target population (i.e., older adults) to create a robot that the end-user will adopt.

Research Aim/Questions

This study evaluated the opinions of both younger and older adults regarding the design and performance of the Robot Activity Support (RAS) system. It is important to understand points of agreement and divergence between these populations' perspectives so that effective robotic aids are created for older adults.

Methods

Fifty-two younger and older adults completed three scripted tasks with the RAS robot in a smart home environment. Each participant made task errors to cue the robot to offer help via three prompt modalities (guide to the object, video of forgotten step, and video of the full task). After interacting with the robot, participants completed questionnaires to evaluate their opinions of and satisfaction with the robot.

Results

There were no differences between younger and older adults' perceptions of the robot across a variety of factors (e.g., likability, cognitive demand), with both age groups expressing generally neutral opinions. Both groups rated the Full Video prompt as least helpful, effective, and liked. Participants recommended the robot's response accuracy, movement speed, alerting style and system flexibility be improved. Younger adults overestimated how much older adults would want a robot like this.

Conclusions

This study underscores the importance of testing technology with the end-user, as older adults were less interested in having a similar robot in their home than younger counterparts expected. Future studies will show if older adults' opinions can be improved after making the recommended changes.

Touching the social robot PARO reduces pain perception and salivary oxytocin levels

Human-human social touch improves mood and alleviates pain. No studies have so far tested the effect of human-robot emotional touch on experimentally induced pain ratings, on mood and on oxytocin levels in healthy young adults. Here, we assessed the effect of touching the robot PARO on pain perception, on mood and on salivary oxytocin levels, in 83 young adults. We measured their perceived pain, happiness state, and salivary oxytocin. For the 63 participants in the PARO group, pain was assessed in three conditions: Baseline, Touch (touching PARO) and No-Touch (PARO present). The control group (20 participants) underwent the same measurements without ever encountering PARO. There was a decrease in pain ratings and in oxytocin levels and an increase in happiness ratings compared to baseline only in the PARO group. The Touch condition yielded a larger decrease in pain ratings compared to No-Touch. These effects correlated with the participants' positive perceptions of the interaction with PARO. Participants with higher perceived ability to communicate with PARO experienced a greater hypoalgesic effect when touching PARO. We show that human-robot social touch is effective in reducing pain ratings, improving mood and - surprisingly - reducing salivary oxytocin levels in adults.

Exercising with Baxter: preliminary support for assistive social-physical human-robot interaction

BACKGROUND

The worldwide population of older adults will soon exceed the capacity of assisted living facilities. Accordingly, we aim to understand whether appropriately designed robots could help older adults stay active at home.

METHODS

Building on related literature as well as guidance from experts in game design, rehabilitation, and physical and occupational therapy, we developed eight human-robot exercise games for the Baxter Research Robot, six of which involve physical human-robot contact. After extensive iteration, these games were tested in an exploratory user study including 20 younger adult and 20 older adult users.

RESULTS

Only socially and physically interactive games fell in the highest ranges for pleasantness, enjoyment, engagement, cognitive challenge, and energy level. Our games successfully spanned three different physical, cognitive, and temporal challenge levels. User trust and confidence in Baxter increased significantly between pre- and post-study assessments. Older adults experienced higher exercise, energy, and engagement levels than younger adults, and women rated the robot more highly than men on several survey questions.

CONCLUSIONS

The results indicate that social-physical exercise with a robot is more pleasant, enjoyable, engaging, cognitively challenging, and energetic than similar interactions that lack physical touch. In addition to this main finding, researchers working in similar areas can build on our design practices, our open-source resources, and the age-group and gender differences that we found.

Implicit task switching in Parkinson's disease is preserved when on medication

People with Parkinson's disease have been shown to have difficulty switching between movement plans. In the great majority of studies, the need to switch between tasks was made explicitly. Here, we tested whether people with Parkinson's disease, taking their normal medication, have difficulty switching between implicitly specified tasks. We further examined whether this switch is performed predictively or reactively. Twenty five people with Parkinson's disease continuously increased or decreased the frequency of their arm movements, inducing an abrupt-but unaware-switch between rhythmic movements (at high frequencies) and discrete movements (at low frequencies). We tested whether that precipitous change was performed reactively or predictively. We found that 56% of participants predictively switched between the two movement types. The ability of people with Parkinson's disease, taking their regular medication, to predictively control their movements on implicit tasks is thus preserved.

Robotic gaming prototype for upper limb exercise: Effects of age and embodiment on user preferences and movement

Background:

Effective human-robot interactions in rehabilitation necessitates an understanding of how these should be tailored to the needs of the human. We report on a robotic system developed as a partner on a 3-D everyday task, using a gamified approach.

Objectives:

To: (1) design and test a prototype system, to be ultimately used for upper-limb rehabilitation; (2) evaluate how age affects the response to such a robotic system; and (3) identify whether the robot’s physical embodiment is an important aspect in motivating users to complete a set of repetitive tasks.

Methods:

62 healthy participants, young (<30 yo) and old (>60 yo), played a 3D tic-tac-toe game against an embodied (a robotic arm) and a non-embodied (a computer-controlled lighting system) partner. To win, participants had to place three cups in sequence on a physical 3D grid. Cup picking-and-placing was chosen as a functional task that is often practiced in post-stroke rehabilitation. Movement of the participants was recorded using a Kinect camera.

Results:

The timing of the participants’ movement was primed by the response time of the system: participants moved slower when playing with the slower embodied system (p = 0.006). The majority of participants preferred the robot over the computer-controlled system. Slower response time of the robot compared to the computer-controlled one only affected the young group’s motivation to continue playing.

Conclusion:

We demonstrated the feasibility of the system to encourage the performance of repetitive 3D functional movements, and track these movements. Young and old participants preferred to interact with the robot, compared with the non-embodied system. We contribute to the growing knowledge concerning personalized human-robot interactions by (1) demonstrating the priming of the human movement by the robotic movement – an important design feature, and (2) identifying response-speed as a design variable, the importance of which depends on the age of the user.

Changes in Predictive Task Switching with Age and with Cognitive Load

Predictive control of movement is more efficient than feedback-based control, and is an important skill in everyday life. We tested whether the ability to predictively control movements of the upper arm is affected by age and by cognitive load. A total of 63 participants were tested in two experiments. In both experiments participants were seated, and controlled a cursor on a computer screen by flexing and extending their dominant arm. In Experiment 1, 20 young adults and 20 older adults were asked to continuously change the frequency of their horizontal arm movements, with the goal of inducing an abrupt switch between discrete movements (at low frequencies) and rhythmic movements (at high frequencies). We tested whether that change was performed based on a feed-forward (predictive) or on a feedback (reactive) control. In Experiment 2, 23 young adults performed the same task, while being exposed to a cognitive load half of the time via a serial subtraction task. We found that both aging and cognitive load diminished, on average, the ability of participants to predictively control their movements. Five older adults and one young adult under a cognitive load were not able to perform the switch between rhythmic and discrete movement (or vice versa). In Experiment 1, 40% of the older participants were able to predictively control their movements, compared with 70% in the young group. In Experiment 2, 48% of the participants were able to predictively control their movements with a cognitively loading task, compared with 70% in the no-load condition. The ability to predictively change a motor plan in anticipation of upcoming changes may be an important component in performing everyday functions, such as safe driving and avoiding falls.