Influence of the shape and mass of a small robot when thrown to a dummy human head

Heart Rate as a Predictor of Challenging Behaviours among Children with Autism from Wearable Sensors in Social Robot Interactions

Children with autism face challenges in various skills (e.g., communication and social) and they exhibit challenging behaviours. These challenging behaviours represent a challenge to their families, therapists, and caregivers, especially during therapy sessions. In this study, we have investigated several machine learning techniques and data modalities acquired using wearable sensors from children with autism during their interactions with social robots and toys in their potential to detect challenging behaviours. Each child wore a wearable device that collected data. Video annotations of the sessions were used to identify the occurrence of challenging behaviours. Extracted time features (i.e., mean, standard deviation, min, and max) in conjunction with four machine learning techniques were considered to detect challenging behaviors. The heart rate variability (HRV) changes have also been investigated in this study. The XGBoost algorithm has achieved the best performance (i.e., an accuracy of 99%). Additionally, physiological features outperformed the kinetic ones, with the heart rate being the main contributing feature in the prediction performance. One HRV parameter (i.e., RMSSD) was found to correlate with the occurrence of challenging behaviours. This work highlights the importance of developing the tools and methods to detect challenging behaviors among children with autism during aided sessions with social robots.

Real-Time Social Robot’s Responses to Undesired Interactions Between Children and their Surroundings

Aggression in children is frequent during the early years of childhood. Among children with psychiatric disorders in general, and autism in particular, challenging behaviours and aggression rates are higher. These can take on different forms, such as hitting, kicking, and throwing objects. Social robots that are able to detect undesirable interactions within its surroundings can be used to target such behaviours. In this study, we evaluate the performance of five machine learning techniques in characterizing five possible undesired interactions between a child and a social robot. We examine the effects of adding different combinations of raw data and extracted features acquired from two sensors on the performance and speed of prediction. Additionally, we evaluate the performance of the best developed model with children. Machine learning algorithms experiments showed that XGBoost achieved the best performance across all metrics (e.g., accuracy of 90%) and provided fast predictions (i.e., 0.004 s) for the test samples. Experiments with features showed that acceleration data were the most contributing factor on the prediction compared to gyroscope data and that combined data of raw and extracted features provided a better overall performance. Testing the best model with data acquired from children performing interactions with toys produced a promising performance for the shake and throw behaviours. The findings of this work can be used by social robot developers to address undesirable interactions in their robotic designs.

Influence of Reaction Time in the Emotional Response of a Companion Robot to a Child’s Aggressive Interaction

The quality of a companion robot’s reaction is important to make it acceptable to the users and to sustain interactions. Furthermore, the robot’s reaction can be used to train socially acceptable behaviors and to develop certain skills in both normally developing children and children with cognitive disabilities. In this study, we investigate the influence of reaction time in the emotional response of a robot when children display aggressive interactions toward it. Different interactions were considered, namely, pickup, shake, drop and throw. The robot produced responses as audible sounds, which were activated at three different reaction times, namely, 0.5 s, 1.0 s, and 1.5 s. The results for one of the tasks that involved shaking the robotic toys produced a significant difference between the timings tested. This could imply that producing a late response to an action (i.e. greater than 1.0 s) could negatively affect the children’s comprehension of the intended message. Furthermore, the response should be comprehensible to provide a clear message to the user. The results imply that the designers of companion robotic toys need to consider an appropriate timing and clear modality for their robots’ responses.