1
|
Alban AQ, Alhaddad AY, Al-Ali A, So WC, Connor O, Ayesh M, Ahmed Qidwai U, Cabibihan JJ. Heart Rate as a Predictor of Challenging Behaviours among Children with Autism from Wearable Sensors in Social Robot Interactions. ROBOTICS 2023. [DOI: 10.3390/robotics12020055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/05/2023] Open
Abstract
Children with autism face challenges in various skills (e.g., communication and social) and they exhibit challenging behaviours. These challenging behaviours represent a challenge to their families, therapists, and caregivers, especially during therapy sessions. In this study, we have investigated several machine learning techniques and data modalities acquired using wearable sensors from children with autism during their interactions with social robots and toys in their potential to detect challenging behaviours. Each child wore a wearable device that collected data. Video annotations of the sessions were used to identify the occurrence of challenging behaviours. Extracted time features (i.e., mean, standard deviation, min, and max) in conjunction with four machine learning techniques were considered to detect challenging behaviors. The heart rate variability (HRV) changes have also been investigated in this study. The XGBoost algorithm has achieved the best performance (i.e., an accuracy of 99%). Additionally, physiological features outperformed the kinetic ones, with the heart rate being the main contributing feature in the prediction performance. One HRV parameter (i.e., RMSSD) was found to correlate with the occurrence of challenging behaviours. This work highlights the importance of developing the tools and methods to detect challenging behaviors among children with autism during aided sessions with social robots.
Collapse
Affiliation(s)
- Ahmad Qadeib Alban
- Department of Computer Science and Engineering, Qatar University, Doha P.O. Box 2713, Qatar
| | - Ahmad Yaser Alhaddad
- Department of Mechanical and Industrial Engineering, Qatar University, Doha P.O. Box 2713, Qatar
| | - Abdulaziz Al-Ali
- Department of Computer Science and Engineering, Qatar University, Doha P.O. Box 2713, Qatar
- KINDI Computing Research Center, Qatar University, Doha P.O. Box 2713, Qatar
| | - Wing-Chee So
- Department of Educational Psychology, Faculty of Education, The Chinese University of Hong Kong, New Territories, Hong Kong
| | - Olcay Connor
- Step by Step Centre for Special Needs, Doha P.O. Box 47613, Qatar
| | - Malek Ayesh
- Department of Computer Science and Engineering, Qatar University, Doha P.O. Box 2713, Qatar
| | - Uvais Ahmed Qidwai
- Department of Computer Science and Engineering, Qatar University, Doha P.O. Box 2713, Qatar
| | - John-John Cabibihan
- Department of Mechanical and Industrial Engineering, Qatar University, Doha P.O. Box 2713, Qatar
| |
Collapse
|
2
|
Giansanti D. The Social Robot in Rehabilitation and Assistance: What Is the Future? Healthcare (Basel) 2021; 9:244. [PMID: 33668987 PMCID: PMC7996596 DOI: 10.3390/healthcare9030244] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Revised: 02/12/2021] [Accepted: 02/14/2021] [Indexed: 02/04/2023] Open
Abstract
This commentary aims to address the field of social robots both in terms of the global situation and research perspectives. It has four polarities. First, it revisits the evolutions in robotics, which, starting from collaborative robotics, has led to the diffusion of social robots. Second, it illustrates the main fields in the employment of social robots in rehabilitation and assistance in the elderly and handicapped and in further emerging sectors. Third, it takes a look at the future directions of the research development both in terms of clinical and technological aspects. Fourth, it discusses the opportunities and limits, starting from the development and clinical use of social robots during the COVID-19 pandemic to the increase of ethical discussion on their use.
Collapse
|
3
|
Alhaddad AY, Cabibihan JJ, Bonarini A. Datasets for recognition of aggressive interactions of children toward robotic toys. Data Brief 2021; 34:106697. [PMID: 33437854 PMCID: PMC7786023 DOI: 10.1016/j.dib.2020.106697] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Revised: 12/21/2020] [Accepted: 12/22/2020] [Indexed: 11/17/2022] Open
Abstract
The data is related to unwanted interactions between a person and a small robotic toy based on acceleration sensor embedded within the robotic toy. Three toys were considered namely, a stuffed panda, a stuffed robot, and an excavator. Each toy was embedded with an accelerometer to record the interactions. Five different unwanted interactions were performed by adult participants and children. The considered interactions were hit, shake, throw, pickup, drop, and idle for the no interaction case. The collected data contains the magnitude of the resultant acceleration from the interactions. The data was processed by extracting the instances of interactions. A secondary dataset was created from the original one by creating artificial sequences. This data article contains the processed data that can be used to explore different machine learning models and techniques in classifying such interactions. Online repository contains the files: https://doi.org/10.7910/DVN/FHOO0Q.
Collapse
Affiliation(s)
- Ahmad Yaser Alhaddad
- Department of Mechanical and Industrial Engineering, Qatar University, Doha 2713, Qatar
| | - John-John Cabibihan
- Department of Mechanical and Industrial Engineering, Qatar University, Doha 2713, Qatar
| | - Andrea Bonarini
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci 32, Milano 20133, Italy
| |
Collapse
|
4
|
Influence of Reaction Time in the Emotional Response of a Companion Robot to a Child’s Aggressive Interaction. Int J Soc Robot 2020. [DOI: 10.1007/s12369-020-00626-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
AbstractThe quality of a companion robot’s reaction is important to make it acceptable to the users and to sustain interactions. Furthermore, the robot’s reaction can be used to train socially acceptable behaviors and to develop certain skills in both normally developing children and children with cognitive disabilities. In this study, we investigate the influence of reaction time in the emotional response of a robot when children display aggressive interactions toward it. Different interactions were considered, namely, pickup, shake, drop and throw. The robot produced responses as audible sounds, which were activated at three different reaction times, namely, 0.5 s, 1.0 s, and 1.5 s. The results for one of the tasks that involved shaking the robotic toys produced a significant difference between the timings tested. This could imply that producing a late response to an action (i.e. greater than 1.0 s) could negatively affect the children’s comprehension of the intended message. Furthermore, the response should be comprehensible to provide a clear message to the user. The results imply that the designers of companion robotic toys need to consider an appropriate timing and clear modality for their robots’ responses.
Collapse
|
5
|
Sheridan TB. A review of recent research in social robotics. Curr Opin Psychol 2020; 36:7-12. [PMID: 32294577 DOI: 10.1016/j.copsyc.2020.01.003] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Revised: 01/22/2020] [Accepted: 01/29/2020] [Indexed: 10/25/2022]
Abstract
Research in social robotics has a different emphasis from research in robotics for factory, military, hospital, home (vacuuming), aerial (drone), space, and undersea applications. A social robot is one whose purpose is to serve a person in a caring interaction rather than to perform a mechanical task. Both because of its newness and because of its narrower psychological rather than technological emphasis, research in social robotics tends currently to be concentrated in a single journal and single annual conference. This review categorizes such a research into three areas: (1) Affect, Personality and Adaptation; (2) Sensing and Control for Action; and (3 Assistance to the Elderly and Handicapped. Current application is primarily for children's toys and devices to comfort the elderly and handicapped, as detailed in Section 'Toys and the market for social robots in general'.
Collapse
Affiliation(s)
- Thomas B Sheridan
- Massachusetts Institute of Technology, 1010 Waltham Street Lexington MA 02421, United States.
| |
Collapse
|
6
|
Abstract
Abstract
Social robots have shown some efficacy in assisting children with autism and are now being considered as assistive tools for therapy. The physical proximity of a small companion social robot could become a source of harm to children with autism during aggressive physical interactions. A child exhibiting challenging behaviors could throw a small robot that could harm another child’s head upon impact. In this paper, we investigate the effects of the mass and shape of objects thrown on impact at different velocities on the linear acceleration of a developed dummy head. This dummy head could be the head of another child or a caregiver in the room. A total of 27 main experiments were conducted based on Taguchi’s orthogonal array design. The data were then analyzed using ANOVA and then optimized based on the signal-to-noise ratio. Our results revealed that the two design factors considered (i.e. mass and shape) and the noise factor (i.e. impact velocities) affected the response. Finally, confirmation runs at the optimal identified shape and mass (i.e. mass of 0.3 kg and shape of either cube or wedge) showed an overall reduction in the resultant peak linear acceleration of the dummy head as compared to the other conditions. These results have implications on the design and manufacturing of small social robots whereby minimizing the mass of the robots can aid in mitigating the potential harm to the head due to impacts.
Collapse
|
7
|
Safety experiments for small robots investigating the potential of soft materials in mitigating the harm to the head due to impacts. SN APPLIED SCIENCES 2019. [DOI: 10.1007/s42452-019-0467-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022] Open
|