1
|
Conson M, Zappullo I, Cordasco G, Trojano L, Raimo G, Cecere R, Baiano C, Lauro A, Esposito A. Altercentrism in perspective-taking: The role of humanisation in embodying the agent's point of view. Q J Exp Psychol (Hove) 2025; 78:1041-1060. [PMID: 39502001 DOI: 10.1177/17470218241300252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2024]
Abstract
We investigated the role of humanisation in Visual Perspective-Taking (VPT) by testing whether and how agent's human-likeness and attractiveness ("hedonic quality") interact with social cues (action and eye gaze) in influencing the participants' disposition to embody another's perspective. In a VPT task, participants viewed scenes displaying an actor (human or robotic) grasping, gazing (or both) a target object, or adopting a still posture, and were required to judge the left/right location of the target, without receiving any instruction on the perspective to be assumed. Across two studies, we selected human and robotic agents to use as actors in the VPT task. Results consistently demonstrated that participants could be effectively clustered by a data-driven method into two perspective-taking styles, depending on the presence of a systematic tendency to locate the target object in the VPT scenarios from own (egocentric) or the actor's (altercentric) point of view. The human versus nonhuman nature of the agent seemed able to affect the participants' egocentric or altercentric tendency whereas both the agent's hedonic quality and social cues were not able to influence this propensity. Identifying the factors influencing altercentrism during human-robot interactions can be essential for developing artificial agents favouring user's acceptance and willingness to interact. In this respect, considering differences among individuals in their propensity to take another's point of view may be of central importance. Clustering approaches can represent a useful means to capture interindividual differences in this central aspect of human social cognition.
Collapse
Affiliation(s)
- Massimiliano Conson
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Isa Zappullo
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Gennaro Cordasco
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Luigi Trojano
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Gennaro Raimo
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Roberta Cecere
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Chiara Baiano
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Anna Lauro
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| | - Anna Esposito
- Department of Psychology, University of Campania "Luigi Vanvitelli," Caserta, Italy
| |
Collapse
|
2
|
Maier M, Leonhardt A, Blume F, Bideau P, Hellwich O, Abdel Rahman R. Neural dynamics of mental state attribution to social robot faces. Soc Cogn Affect Neurosci 2025; 20:nsaf027. [PMID: 40066991 PMCID: PMC11969468 DOI: 10.1093/scan/nsaf027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2024] [Revised: 01/06/2025] [Accepted: 03/10/2025] [Indexed: 04/04/2025] Open
Abstract
The interplay of mind attribution and emotional responses is considered crucial in shaping human trust and acceptance of social robots. Understanding this interplay can help us create the right conditions for successful human-robot social interaction in alignment with societal goals. Our study shows that affective information about robots describing positive, negative, or neutral behaviour leads participants (N = 90) to attribute mental states to robot faces, modulating impressions of trustworthiness, facial expression, and intentionality. Electroencephalography recordings from 30 participants revealed that affective information influenced specific processing stages in the brain associated with early face perception (N170 component) and more elaborate stimulus evaluation (late positive potential). However, a modulation of fast emotional brain responses, typically found for human faces (early posterior negativity), was not observed. These findings suggest that neural processing of robot faces alternates between being perceived as mindless machines and intentional agents: people rapidly attribute mental states during perception, literally seeing good or bad intentions in robot faces, but are emotionally less affected than when facing humans. These nuanced insights into the fundamental psychological and neural processes underlying mind attribution can enhance our understanding of human-robot social interactions and inform policies surrounding the moral responsibility of artificial agents.
Collapse
Affiliation(s)
- Martin Maier
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin D-10099, Germany
- Science of Intelligence, Research Cluster of Excellence, Technische Universität Berlin, Berlin D-10587, Germany
| | - Alexander Leonhardt
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin D-10099, Germany
| | - Florian Blume
- Science of Intelligence, Research Cluster of Excellence, Technische Universität Berlin, Berlin D-10587, Germany
- Computer Vision & Remote Sensing, Technische Universität Berlin, Berlin D-10587, Germany
| | - Pia Bideau
- Science of Intelligence, Research Cluster of Excellence, Technische Universität Berlin, Berlin D-10587, Germany
- Inria, CNRS, Univ. Grenoble Alpes, Montbonnot-Saint-Martin 38330, France
| | - Olaf Hellwich
- Science of Intelligence, Research Cluster of Excellence, Technische Universität Berlin, Berlin D-10587, Germany
- Computer Vision & Remote Sensing, Technische Universität Berlin, Berlin D-10587, Germany
| | - Rasha Abdel Rahman
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin D-10099, Germany
- Science of Intelligence, Research Cluster of Excellence, Technische Universität Berlin, Berlin D-10587, Germany
| |
Collapse
|
3
|
Yuan Y, Liu J, Dai C, Liu X, Hu B, Fan J. Exploring pattern-specific components associated with hand gestures through different sEMG measures. J Neuroeng Rehabil 2024; 21:233. [PMID: 39741272 DOI: 10.1186/s12984-024-01526-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2024] [Accepted: 12/04/2024] [Indexed: 01/02/2025] Open
Abstract
For surface electromyography (sEMG) based human-machine interaction systems, accurately recognizing the users' gesture intent is crucial. However, due to the existence of subject-specific components in sEMG signals, subject-specific models may deteriorate when applied to new users. In this study, we hypothesize that in addition to subject-specific components, sEMG signals also contain pattern-specific components, which is independent of individuals and solely related to gesture patterns. Based on this hypothesis, we disentangled these two components from sEMG signals with an auto-encoder and applied the pattern-specific components to establish a general gesture recognition model in cross-subject scenarios. Furthermore, we compared the characteristics of the pattern-specific information contained in three categories of EMG measures: signal waveform, time-domain features, and frequency-domain features. Our hypothesis was validated on an open source database. Ultimately, the combination of time- and frequency-domain features achieved the best performance in gesture classification tasks, with a maximum accuracy of 84.3%. For individual feature, frequency-domain features performed the best and were proved most suitable for separating the two components. Additionally, we intuitively visualized the heatmaps of pattern-specific components based on the topological position of electrode arrays and explored their physiological interpretability by examining the correspondence between the heatmaps and muscle activation areas.
Collapse
Affiliation(s)
- Yangyang Yuan
- School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Jionghui Liu
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China
| | - Chenyun Dai
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200241, China
| | - Xiao Liu
- School of Information Science and Technology, Fudan University, Shanghai, 200433, China
| | - Bo Hu
- School of Information Science and Technology, Fudan University, Shanghai, 200433, China.
| | - Jiahao Fan
- School of Information Science and Technology, Fudan University, Shanghai, 200433, China.
| |
Collapse
|
4
|
Oliveira M, Brands J, Mashudi J, Liefooghe B, Hortensius R. Perceptions of artificial intelligence system's aptitude to judge morality and competence amidst the rise of Chatbots. Cogn Res Princ Implic 2024; 9:47. [PMID: 39019988 PMCID: PMC11255178 DOI: 10.1186/s41235-024-00573-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 07/02/2024] [Indexed: 07/19/2024] Open
Abstract
This paper examines how humans judge the capabilities of artificial intelligence (AI) to evaluate human attributes, specifically focusing on two key dimensions of human social evaluation: morality and competence. Furthermore, it investigates the impact of exposure to advanced Large Language Models on these perceptions. In three studies (combined N = 200), we tested the hypothesis that people will find it less plausible that AI is capable of judging the morality conveyed by a behavior compared to judging its competence. Participants estimated the plausibility of AI origin for a set of written impressions of positive and negative behaviors related to morality and competence. Studies 1 and 3 supported our hypothesis that people would be more inclined to attribute AI origin to competence-related impressions compared to morality-related ones. In Study 2, we found this effect only for impressions of positive behaviors. Additional exploratory analyses clarified that the differentiation between the AI origin of competence and morality judgments persisted throughout the first half year after the public launch of popular AI chatbot (i.e., ChatGPT) and could not be explained by participants' general attitudes toward AI, or the actual source of the impressions (i.e., AI or human). These findings suggest an enduring belief that AI is less adept at assessing the morality compared to the competence of human behavior, even as AI capabilities continued to advance.
Collapse
Affiliation(s)
- Manuel Oliveira
- Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Justus Brands
- Department of Psychology, Utrecht University, Utrecht, The Netherlands
| | - Judith Mashudi
- Department of Psychology, Utrecht University, Utrecht, The Netherlands
| | - Baptist Liefooghe
- Department of Psychology, Utrecht University, Utrecht, The Netherlands
| | - Ruud Hortensius
- Department of Psychology, Utrecht University, Utrecht, The Netherlands.
| |
Collapse
|
5
|
Jastrzab LE, Chaudhury B, Ashley SA, Koldewyn K, Cross ES. Beyond human-likeness: Socialness is more influential when attributing mental states to robots. iScience 2024; 27:110070. [PMID: 38947497 PMCID: PMC11214418 DOI: 10.1016/j.isci.2024.110070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 03/08/2024] [Accepted: 05/17/2024] [Indexed: 07/02/2024] Open
Abstract
We sought to replicate and expand previous work showing that the more human-like a robot appears, the more willing people are to attribute mind-like capabilities and socially engage with it. Forty-two participants played games against a human, a humanoid robot, a mechanoid robot, and a computer algorithm while undergoing functional neuroimaging. We confirmed that the more human-like the agent, the more participants attributed a mind to them. However, exploratory analyses revealed that the perceived socialness of an agent appeared to be as, if not more, important for mind attribution. Our findings suggest top-down knowledge cues may be equally or possibly more influential than bottom-up stimulus cues when exploring mind attribution in non-human agents. While further work is now required to test this hypothesis directly, these preliminary findings hold important implications for robotic design and to understand and test the flexibility of human social cognition when people engage with artificial agents.
Collapse
Affiliation(s)
- Laura E. Jastrzab
- Institute for Cognitive Neuroscience, School of Human and Behavioural Science, Bangor University, Wales, UK
- Institute for Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, UK
| | - Bishakha Chaudhury
- Institute for Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, UK
| | - Sarah A. Ashley
- Institute for Cognitive Neuroscience, School of Human and Behavioural Science, Bangor University, Wales, UK
- Division of Psychiatry, Institute of Mental Health, University College London, London, UK
| | - Kami Koldewyn
- Institute for Cognitive Neuroscience, School of Human and Behavioural Science, Bangor University, Wales, UK
| | - Emily S. Cross
- Institute for Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, UK
- Chair for Social Brain Sciences, Department of Humanities, Social and Political Sciences, ETHZ, Zürich, Switzerland
| |
Collapse
|
6
|
Bonnaire J, Dumas G, Cassell J. Bringing together multimodal and multilevel approaches to study the emergence of social bonds between children and improve social AI. FRONTIERS IN NEUROERGONOMICS 2024; 5:1290256. [PMID: 38827377 PMCID: PMC11140154 DOI: 10.3389/fnrgo.2024.1290256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 04/29/2024] [Indexed: 06/04/2024]
Abstract
This protocol paper outlines an innovative multimodal and multilevel approach to studying the emergence and evolution of how children build social bonds with their peers, and its potential application to improving social artificial intelligence (AI). We detail a unique hyperscanning experimental framework utilizing functional near-infrared spectroscopy (fNIRS) to observe inter-brain synchrony in child dyads during collaborative tasks and social interactions. Our proposed longitudinal study spans middle childhood, aiming to capture the dynamic development of social connections and cognitive engagement in naturalistic settings. To do so we bring together four kinds of data: the multimodal conversational behaviors that dyads of children engage in, evidence of their state of interpersonal rapport, collaborative performance on educational tasks, and inter-brain synchrony. Preliminary pilot data provide foundational support for our approach, indicating promising directions for identifying neural patterns associated with productive social interactions. The planned research will explore the neural correlates of social bond formation, informing the creation of a virtual peer learning partner in the field of Social Neuroergonomics. This protocol promises significant contributions to understanding the neural basis of social connectivity in children, while also offering a blueprint for designing empathetic and effective social AI tools, particularly for educational contexts.
Collapse
Affiliation(s)
| | - Guillaume Dumas
- Research Center of the CHU Sainte-Justine, Department of Psychiatry, University of Montréal, Montreal, QC, Canada
- Mila–Quebec Artificial Intelligence Institute, Montreal, QC, Canada
| | - Justine Cassell
- Inria Paris Centre, Paris, France
- School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, United States
| |
Collapse
|
7
|
Wei Z, Chen Y, Zhao Q, Ren J, Piao Y, Zhang P, Zha R, Qiu B, Zhang D, Bi Y, Han S, Li C, Zhang X. Separable amygdala activation patterns in the evaluations of robots. Cereb Cortex 2024; 34:bhae011. [PMID: 38383721 DOI: 10.1093/cercor/bhae011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 12/27/2023] [Accepted: 12/29/2023] [Indexed: 02/23/2024] Open
Abstract
Given the increasing presence of robots in everyday environments and the significant challenge posed by social interactions with robots, it is crucial to gain a deeper understanding into the social evaluations of robots. One potentially effective approach to comprehend the fundamental processes underlying controlled and automatic evaluations of robots is to probe brain response to different perception levels of robot-related stimuli. Here, we investigate controlled and automatic evaluations of robots based on brain responses during viewing of suprathreshold (duration: 200 ms) and subthreshold (duration: 17 ms) humanoid robot stimuli. Our behavioral analysis revealed that despite participants' self-reported positive attitudes, they held negative implicit attitudes toward humanoid robots. Neuroimaging analysis indicated that subthreshold presentation of humanoid robot stimuli elicited significant activation in the left amygdala, which was associated with negative implicit attitudes. Conversely, no significant left amygdala activation was observed during suprathreshold presentation. Following successful attenuation of negative attitudes, the left amygdala response to subthreshold presentation of humanoid robot stimuli decreased, and this decrease correlated positively with the reduction in negative attitudes. These findings provide evidence for separable patterns of amygdala activation between controlled and automatic processing of robots, suggesting that controlled evaluations may influence automatic evaluations of robots.
Collapse
Affiliation(s)
- Zhengde Wei
- Department of Psychology, School of Humanities & Social Science, University of Science & Technology of China, Hefei, Anhui 230026, China
- Key Laboratory of Brain-Machine Intelligence for Information Behavior-Ministry of Education, Shanghai International Studies University, Shanghai 201620, China
| | - Ying Chen
- Department of Psychology, School of Humanities & Social Science, University of Science & Technology of China, Hefei, Anhui 230026, China
| | - Qian Zhao
- School of Life Science, Division of Life Science and Medicine, University of Science & Technology of China, Hefei 230027, China
| | - Jiecheng Ren
- School of Life Science, Division of Life Science and Medicine, University of Science & Technology of China, Hefei 230027, China
| | - Yi Piao
- Institute of Health and Medicine, Hefei Comprehensive Science Center, Hefei, 230071, China
| | - Pengyu Zhang
- School of Life Science, Division of Life Science and Medicine, University of Science & Technology of China, Hefei 230027, China
| | - Rujing Zha
- Department of Psychology, School of Humanities & Social Science, University of Science & Technology of China, Hefei, Anhui 230026, China
| | - Bensheng Qiu
- Centers for Biomedical Engineering, School of Information Science and Technology, University of Science & Technology of China, Hefei, Anhui 230027, China
| | - Daren Zhang
- Department of Psychology, School of Humanities & Social Science, University of Science & Technology of China, Hefei, Anhui 230026, China
- School of Life Science, Division of Life Science and Medicine, University of Science & Technology of China, Hefei 230027, China
| | - Yanchao Bi
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Shihui Han
- School of Psychological and Cognitive Sciences, PKU-IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100091, China
| | - Chunbo Li
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai 200030, China
| | - Xiaochu Zhang
- Department of Psychology, School of Humanities & Social Science, University of Science & Technology of China, Hefei, Anhui 230026, China
- Key Laboratory of Brain-Machine Intelligence for Information Behavior-Ministry of Education, Shanghai International Studies University, Shanghai 201620, China
- Institute of Health and Medicine, Hefei Comprehensive Science Center, Hefei, 230071, China
- School of Mental Health, Bengbu Medical College, Bengbu, Anhui 233030, China
| |
Collapse
|
8
|
Bouquet CA, Belletier C, Monceau S, Chausse P, Croizet JC, Huguet P, Ferrand L. Joint action with human and robotic co-actors: Self-other integration is immune to the perceived humanness of the interacting partner. Q J Exp Psychol (Hove) 2024; 77:70-89. [PMID: 36803063 DOI: 10.1177/17470218231158481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2023]
Abstract
When performing a joint action task, we automatically represent the action and/or task constraints of the co-actor with whom we are interacting. Current models suggest that, not only physical similarity, but also abstract, conceptual features shared between self and the interacting partner play a key role in the emergence of joint action effects. Across two experiments, we investigated the influence of the perceived humanness of a robotic agent on the extent to which we integrate the action of that agent into our own action/task representation, as indexed by the Joint Simon Effect (JSE). The presence (vs. absence) of a prior verbal interaction was used to manipulate robot's perceived humanness. In Experiment 1, using a within-participant design, we had participants perform the joint Go/No-go Simon task with two different robots. Before performing the joint task, one robot engaged in a verbal interaction with the participant and the other robot did not. In Experiment 2, we employed a between-participants design to contrast these two robot conditions as well as a human partner condition. In both experiments, a significant Simon effect emerged during joint action and its amplitude was not modulated by the humanness of the interacting partner. Experiment 2 further showed that the JSE obtained in robot conditions did not differ from that measured in the human partner condition. These findings contradict current theories of joint action mechanisms according to which perceived self-other similarity is a crucial determinant of self-other integration in shared task settings.
Collapse
Affiliation(s)
- Cédric A Bouquet
- CNRS, LAPSCO, Université Clermont Auvergne, Clermont-Ferrand, France
- CNRS, CeRCA, Université de Poitiers, Poitiers, France
| | - Clément Belletier
- CNRS, LAPSCO, Université Clermont Auvergne, Clermont-Ferrand, France
| | - Sophie Monceau
- CNRS, LAPSCO, Université Clermont Auvergne, Clermont-Ferrand, France
| | - Pierre Chausse
- CNRS, LAPSCO, Université Clermont Auvergne, Clermont-Ferrand, France
| | | | - Pascal Huguet
- CNRS, LAPSCO, Université Clermont Auvergne, Clermont-Ferrand, France
| | - Ludovic Ferrand
- CNRS, LAPSCO, Université Clermont Auvergne, Clermont-Ferrand, France
| |
Collapse
|
9
|
Caruana N, Moffat R, Miguel-Blanco A, Cross ES. Perceptions of intelligence & sentience shape children's interactions with robot reading companions. Sci Rep 2023; 13:7341. [PMID: 37147422 PMCID: PMC10162967 DOI: 10.1038/s41598-023-32104-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Accepted: 03/21/2023] [Indexed: 05/07/2023] Open
Abstract
The potential for robots to support education is being increasingly studied and rapidly realised. However, most research evaluating education robots has neglected to examine the fundamental features that make them more or less effective, given the needs and expectations of learners. This study explored how children's perceptions, expectations and experiences are shaped by aesthetic and functional features during interactions with different robot 'reading buddies'. We collected a range of quantitative and qualitative measures of subjective experience before and after children read a book with one of three different robots. An inductive thematic analysis revealed that robots have the potential offer children an engaging and non-judgemental social context to promote reading engagement. This was supported by children's perceptions of robots as being intelligent enough to read, listen and comprehend the story, particularly when they had the capacity to talk. A key challenge in the use of robots for this purpose was the unpredictable nature of robot behaviour, which remains difficult to perfectly control and time using either human operators or autonomous algorithms. Consequently, some children found the robots' responses distracting. We provide recommendations for future research seeking to position seemingly sentient and intelligent robots as an assistive tool within and beyond education settings.
Collapse
Affiliation(s)
- Nathan Caruana
- School of Psychological Sciences, Macquarie University, Level 3, 16 University Ave, Sydney, NSW, 2109, Australia.
| | - Ryssa Moffat
- School of Psychological Sciences, Macquarie University, Level 3, 16 University Ave, Sydney, NSW, 2109, Australia
| | - Aitor Miguel-Blanco
- School of Psychological Sciences, Macquarie University, Level 3, 16 University Ave, Sydney, NSW, 2109, Australia
| | - Emily S Cross
- School of Psychological Sciences, Macquarie University, Level 3, 16 University Ave, Sydney, NSW, 2109, Australia.
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, Australia.
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK.
- MARCS Institute for Brain, Behaviour and Development, University of Western Sydney, Sydney, Australia.
- Department of Humanities, Social & Political Sciences (D-GESS) and the Department of Health Sciences and Technology (D-HEST), ETH Zurich, Zurich, Switzerland.
| |
Collapse
|
10
|
Hsieh TY, Chaudhury B, Cross ES. Human–Robot Cooperation in Economic Games: People Show Strong Reciprocity but Conditional Prosociality Toward Robots. Int J Soc Robot 2023; 15:791-805. [DOI: 10.1007/s12369-023-00981-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/15/2023] [Indexed: 07/19/2023]
Abstract
AbstractUnderstanding how people socially engage with robots is becoming increasingly important as these machines are deployed in social settings. We investigated 70 participants’ situational cooperation tendencies towards a robot using prisoner’s dilemma games, manipulating the incentives for cooperative decisions to be high or low. We predicted that people would cooperate more often with the robot in high-incentive conditions. We also administered subjective measures to explore the relationships between people’s cooperative decisions and their social value orientation, attitudes towards robots, and anthropomorphism tendencies. Our results showed incentive structure did not predict human cooperation overall, but did influence cooperation in early rounds, where participants cooperated significantly more in high-incentive conditions. Exploratory analyses further revealed that participants played a tit-for-tat strategy against the robot (whose decisions were random), and only behaved prosocially toward the robot when they had achieved high scores themselves. These findings highlight how people make social decisions when their individual profit is at odds with collective profit with a robot, and advance understanding on human–robot interactions in collaborative contexts.
Collapse
|
11
|
Sarigul B, Urgen BA. Audio–Visual Predictive Processing in the Perception of Humans and Robots. Int J Soc Robot 2023. [DOI: 10.1007/s12369-023-00990-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/09/2023]
Abstract
AbstractRecent work in cognitive science suggests that our expectations affect visual perception. With the rise of artificial agents in human life in the last few decades, one important question is whether our expectations about non-human agents such as humanoid robots affect how we perceive them. In the present study, we addressed this question in an audio–visual context. Participants reported whether a voice embedded in a noise belonged to a human or a robot. Prior to this judgment, they were presented with a human or a robot image that served as a cue and allowed them to form an expectation about the category of the voice that would follow. This cue was either congruent or incongruent with the category of the voice. Our results show that participants were faster and more accurate when the auditory target was preceded by a congruent cue than an incongruent cue. This was true regardless of the human-likeness of the robot. Overall, these results suggest that our expectations affect how we perceive non-human agents and shed light on future work in robot design.
Collapse
|
12
|
Higashino K, Kimoto M, Iio T, Shimohara K, Shiomi M. Is Politeness Better than Impoliteness? Comparisons of Robot's Encouragement Effects Toward Performance, Moods, and Propagation. Int J Soc Robot 2023. [DOI: 10.1007/s12369-023-00971-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/12/2023]
Abstract
AbstractThis study experimentally compared the effects of encouragement with polite/ impolite attitudes from a robot in a monotonous task from three viewpoints: performance, mood, and propagation. Experiment I investigated encouragement effects on performance and mood. The participants did a monotonous task during which a robot continuously provided polite, neutral, or impolite encouragement. Our experiment results showed that polite and impolite encouragement significantly improved performance more than neutral comments, although there was no significant difference between polite and impolite encouragement. In addition, impolite encouragement caused significantly more negative moods than polite encouragement. Experiment II determined whether the robot's encouragement influenced the participants' encouragement styles. The participants behaved similarly to the robot in Experiment I, i.e., they selected polite, neutral, and impolite encouragements by observing the progress of a monotonous task by a dummy participant. The experiment results, which showed that the robot's encouragement significantly influenced the participants' encouragement styles, suggest that polite encouragement is more advantageous than impolite encouragement.
Collapse
|
13
|
|
14
|
Pena A, Tejada JC, Gonzalez-Ruiz JD, Sepúlveda-Cano LM, Chiclana F, Caraffini F, Gongora MA. An evolutionary intelligent control system for a flexible joints robot. Appl Soft Comput 2023. [DOI: 10.1016/j.asoc.2023.110043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
|
15
|
Hogenhuis A, Hortensius R. Domain-specific and domain-general neural network engagement during human-robot interactions. Eur J Neurosci 2022; 56:5902-5916. [PMID: 36111622 PMCID: PMC9828180 DOI: 10.1111/ejn.15823] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Accepted: 08/03/2022] [Indexed: 01/12/2023]
Abstract
To what extent do domain-general and domain-specific neural network engagement generalize across interactions with human and artificial agents? In this exploratory study, we analysed a publicly available functional MRI (fMRI) data set (n = 22) to probe the similarities and dissimilarities in neural architecture while participants conversed with another person or a robot. Incorporating trial-by-trial dynamics of the interactions, listening and speaking, we used whole-brain, region-of-interest and functional connectivity analyses to test response profiles within and across social or non-social, domain-specific and domain-general networks, that is, the person perception, theory-of-mind, object-specific, language and multiple-demand networks. Listening to a robot compared to a human resulted in higher activation in the language network, especially in areas associated with listening comprehension, and in the person perception network. No differences in activity of the theory-of-mind network were found. Results from the functional connectivity analysis showed no difference between interactions with a human or robot in within- and between-network connectivity. Together, these results suggest that although largely similar regions are activated when speaking to a human and to a robot, activity profiles during listening point to a dissociation at a lower level or perceptual level, but not higher order cognitive level.
Collapse
Affiliation(s)
- Ann Hogenhuis
- Liberal Arts and SciencesUtrecht UniversityUtrechtThe Netherlands
| | - Ruud Hortensius
- Department of PsychologyUtrecht UniversityUtrechtThe Netherlands
| |
Collapse
|
16
|
Cornelio P, Haggard P, Hornbaek K, Georgiou O, Bergström J, Subramanian S, Obrist M. The sense of agency in emerging technologies for human–computer integration: A review. Front Neurosci 2022; 16:949138. [PMID: 36172040 PMCID: PMC9511170 DOI: 10.3389/fnins.2022.949138] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Accepted: 08/05/2022] [Indexed: 11/13/2022] Open
Abstract
Human–computer integration is an emerging area in which the boundary between humans and technology is blurred as users and computers work collaboratively and share agency to execute tasks. The sense of agency (SoA) is an experience that arises by a combination of a voluntary motor action and sensory evidence whether the corresponding body movements have somehow influenced the course of external events. The SoA is not only a key part of our experiences in daily life but also in our interaction with technology as it gives us the feeling of “I did that” as opposed to “the system did that,” thus supporting a feeling of being in control. This feeling becomes critical with human–computer integration, wherein emerging technology directly influences people’s body, their actions, and the resulting outcomes. In this review, we analyse and classify current integration technologies based on what we currently know about agency in the literature, and propose a distinction between body augmentation, action augmentation, and outcome augmentation. For each category, we describe agency considerations and markers of differentiation that illustrate a relationship between assistance level (low, high), agency delegation (human, technology), and integration type (fusion, symbiosis). We conclude with a reflection on the opportunities and challenges of integrating humans with computers, and finalise with an expanded definition of human–computer integration including agency aspects which we consider to be particularly relevant. The aim this review is to provide researchers and practitioners with guidelines to situate their work within the integration research agenda and consider the implications of any technologies on SoA, and thus overall user experience when designing future technology.
Collapse
Affiliation(s)
- Patricia Cornelio
- Ultraleap Ltd., Bristol, United Kingdom
- Department of Computer Science, University College London, London, United Kingdom
- *Correspondence: Patricia Cornelio,
| | - Patrick Haggard
- Department of Computer Science, University College London, London, United Kingdom
| | - Kasper Hornbaek
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | | | - Joanna Bergström
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | - Sriram Subramanian
- Department of Computer Science, University College London, London, United Kingdom
| | - Marianna Obrist
- Department of Computer Science, University College London, London, United Kingdom
| |
Collapse
|
17
|
Industry 4.0: A Chance or a Threat for Gen Z? The Perspective of Economics Students. SUSTAINABILITY 2022. [DOI: 10.3390/su14148925] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Major transformations in the sphere of the economy that Industry 4.0 brings are also reflected in young people’s expectations regarding the development of their professional career. Existing social relations are being modified nowadays and new concepts of building them are being developed. The aim of the present article is to present the expectations, fears and hopes of young people related to the course of Industrial Revolution 4.0 in the context of their future life. For a simpler perception of the research objectives of students, the research was narrowed down to the topic of building relationships with robots, which are one of the pillars of Industry 4.0. The research methods are based on the literature studies and an experiment conducted among the students graduating from economic faculties and entering a strongly changing labour market. The experiment was qualitative. The students wrote a short essay on the topic of whether a friendship between a human and a robot is possible. One group of students was shown a short emotional clip about the relationship between the boy and the robot. Regardless of the attempt to influence the message with a film, both groups of students hardly noticed the negative effects of digitisation on building relationships and social trust. The relationship between human being and advanced technology will develop in the future, which will result in the emergence of new relationships between humans and artificial intelligence.
Collapse
|
18
|
Bara I, Binney RJ, Ward R, Ramsey R. A generalised semantic cognition account of aesthetic experience. Neuropsychologia 2022; 173:108288. [PMID: 35690113 DOI: 10.1016/j.neuropsychologia.2022.108288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Revised: 06/01/2022] [Accepted: 06/04/2022] [Indexed: 11/26/2022]
Abstract
Given that aesthetic experiences typically involve extracting meaning from environment, we believe that semantic cognition research has much to offer the field of neuroaesthetics. In the current paper, we propose a generalised framework that is inspired by the semantic cognition literature and that treats aesthetic experience as just one example of how meaning accumulates. According to our framework, aesthetic experiences are underpinned by the same cognitive and brain systems that are involved in deriving meaning from the environment in general, such as modality-specific conceptual representations and controlled processes for retrieving the appropriate type of information. Our generalised semantic cognition view of aesthetic experience has substantial implications for theory development: it leads to novel, falsifiable predictions and it reconfigures foundational assumptions regarding the structure of the cognitive and brain systems that may be involved in aesthetic experiences.
Collapse
Affiliation(s)
- Ionela Bara
- Wales Institute for Cognitive Neuroscience, School of Human and Behavioural Sciences, Bangor University, Bangor, Gwynedd, Wales, LL57 2AS, United Kingdom.
| | - Richard J Binney
- Wales Institute for Cognitive Neuroscience, School of Human and Behavioural Sciences, Bangor University, Bangor, Gwynedd, Wales, LL57 2AS, United Kingdom
| | - Robert Ward
- Wales Institute for Cognitive Neuroscience, School of Human and Behavioural Sciences, Bangor University, Bangor, Gwynedd, Wales, LL57 2AS, United Kingdom
| | - Richard Ramsey
- School of Psychological Sciences, Macquarie University, Sydney, NSW 2109, Australia.
| |
Collapse
|
19
|
Tidoni E, Holle H, Scandola M, Schindler I, Hill L, Cross ES. Human but not robotic gaze facilitates action prediction. iScience 2022; 25:104462. [PMID: 35707718 PMCID: PMC9189121 DOI: 10.1016/j.isci.2022.104462] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 05/05/2022] [Accepted: 05/17/2022] [Indexed: 01/08/2023] Open
Abstract
Do people ascribe intentions to humanoid robots as they would to humans or non-human-like animated objects? In six experiments, we compared people’s ability to extract non-mentalistic (i.e., where an agent is looking) and mentalistic (i.e., what an agent is looking at; what an agent is going to do) information from gaze and directional cues performed by humans, human-like robots, and a non-human-like object. People were faster to infer the mental content of human agents compared to robotic agents. Furthermore, although the absence of differences in control conditions rules out the use of non-mentalizing strategies, the human-like appearance of non-human agents may engage mentalizing processes to solve the task. Overall, results suggest that human-like robotic actions may be processed differently from humans’ and objects’ behavior. These findings inform our understanding of the relevance of an object’s physical features in triggering mentalizing abilities and its relevance for human–robot interaction. People differently ascribe mental content to human-like and non-human-like agents A human-like shape may automatically engage mentalizing processes Human actions are interpreted faster than non-human actions
Collapse
|
20
|
Bolotta S, Dumas G. Social Neuro AI: Social Interaction as the “Dark Matter” of AI. FRONTIERS IN COMPUTER SCIENCE 2022. [DOI: 10.3389/fcomp.2022.846440] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
This article introduces a three-axis framework indicating how AI can be informed by biological examples of social learning mechanisms. We argue that the complex human cognitive architecture owes a large portion of its expressive power to its ability to engage in social and cultural learning. However, the field of AI has mostly embraced a solipsistic perspective on intelligence. We thus argue that social interactions not only are largely unexplored in this field but also are an essential element of advanced cognitive ability, and therefore constitute metaphorically the “dark matter” of AI. In the first section, we discuss how social learning plays a key role in the development of intelligence. We do so by discussing social and cultural learning theories and empirical findings from social neuroscience. Then, we discuss three lines of research that fall under the umbrella of Social NeuroAI and can contribute to developing socially intelligent embodied agents in complex environments. First, neuroscientific theories of cognitive architecture, such as the global workspace theory and the attention schema theory, can enhance biological plausibility and help us understand how we could bridge individual and social theories of intelligence. Second, intelligence occurs in time as opposed to over time, and this is naturally incorporated by dynamical systems. Third, embodiment has been demonstrated to provide more sophisticated array of communicative signals. To conclude, we discuss the example of active inference, which offers powerful insights for developing agents that possess biological realism, can self-organize in time, and are socially embodied.
Collapse
|
21
|
Bara I, Binney RJ, Ramsey R. EXPRESS: Investigating the Role of Working Memory Resources across Aesthetic and Non-Aesthetic Judgments. Q J Exp Psychol (Hove) 2022; 76:1026-1044. [PMID: 35510887 PMCID: PMC10363947 DOI: 10.1177/17470218221101876] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Aesthetic judgments dominate much of daily life by guiding how we evaluate objects, people, and experiences in our environment. One key question that remains unanswered is the extent to which more specialised or largely general cognitive resources support aesthetic judgments. To investigate this question in the context of working memory, we examined the extent to which a working memory load produces similar or different response time interference on aesthetic compared to non-aesthetic judgments. Across three pre-registered experiments that used Bayesian multi-level modelling approaches (N>100 per experiment), we found clear evidence that a working memory load produces similar response time interference on aesthetic judgments relative to non-aesthetic (motion) judgments. We also showed that this similarity in processing across aesthetic versus non-aesthetic judgments holds across variations in the form of art (people vs landscape; Exps. 1-3), medium type (artwork vs photographs; Exp. 2) and load content (art images vs letters; Exps. 1-3). These findings suggest that across a range of experimental contexts, as well as different processing streams in working memory (e.g., visual vs verbal), aesthetic and motion judgments commonly rely on a domain-general cognitive system, rather than a system that is more specifically tied to aesthetic judgments. In doing so, these findings shine new light on the working memory resources that supports aesthetic judgments, as well as how domain-general cognitive systems operate more generally in cognition.
Collapse
Affiliation(s)
- Ionela Bara
- Wales Institute for Cognitive Neuroscience, School of Human and Behavioural Sciences, Bangor University, Bangor, Gwynedd, Wales, LL57 2AS, United Kingdom. 151667
| | - Richard J Binney
- Wales Institute for Cognitive Neuroscience, School of Human and Behavioural Sciences, Bangor University, Bangor, Gwynedd, Wales, LL57 2AS, United Kingdom. 151667
| | - Richard Ramsey
- Department of Psychology, Macquarie University, Sydney, NSW 2109, Australia. 7788
| |
Collapse
|
22
|
Lomas JD, Lin A, Dikker S, Forster D, Lupetti ML, Huisman G, Habekost J, Beardow C, Pandey P, Ahmad N, Miyapuram K, Mullen T, Cooper P, van der Maden W, Cross ES. Resonance as a Design Strategy for AI and Social Robots. Front Neurorobot 2022; 16:850489. [PMID: 35574227 PMCID: PMC9097027 DOI: 10.3389/fnbot.2022.850489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Accepted: 03/23/2022] [Indexed: 11/20/2022] Open
Abstract
Resonance, a powerful and pervasive phenomenon, appears to play a major role in human interactions. This article investigates the relationship between the physical mechanism of resonance and the human experience of resonance, and considers possibilities for enhancing the experience of resonance within human-robot interactions. We first introduce resonance as a widespread cultural and scientific metaphor. Then, we review the nature of "sympathetic resonance" as a physical mechanism. Following this introduction, the remainder of the article is organized in two parts. In part one, we review the role of resonance (including synchronization and rhythmic entrainment) in human cognition and social interactions. Then, in part two, we review resonance-related phenomena in robotics and artificial intelligence (AI). These two reviews serve as ground for the introduction of a design strategy and combinatorial design space for shaping resonant interactions with robots and AI. We conclude by posing hypotheses and research questions for future empirical studies and discuss a range of ethical and aesthetic issues associated with resonance in human-robot interactions.
Collapse
Affiliation(s)
- James Derek Lomas
- Department of Human Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, Netherlands
| | - Albert Lin
- Center for Human Frontiers, Qualcomm Institute, University of California, San Diego, San Diego, CA, United States
| | - Suzanne Dikker
- Department of Psychology, New York University, New York, NY, United States
- Department of Clinical Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Deborah Forster
- Center for Human Frontiers, Qualcomm Institute, University of California, San Diego, San Diego, CA, United States
| | - Maria Luce Lupetti
- Department of Human Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, Netherlands
| | - Gijs Huisman
- Department of Human Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, Netherlands
| | - Julika Habekost
- The Design Lab, California Institute of Information and Communication Technologies, University of California, San Diego, San Diego, CA, United States
| | - Caiseal Beardow
- Department of Human Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, Netherlands
| | - Pankaj Pandey
- Centre for Cognitive and Brain Sciences, Indian Institute of Technology, Gandhinagar, India
| | - Nashra Ahmad
- Centre for Cognitive and Brain Sciences, Indian Institute of Technology, Gandhinagar, India
| | - Krishna Miyapuram
- Centre for Cognitive and Brain Sciences, Indian Institute of Technology, Gandhinagar, India
| | - Tim Mullen
- Intheon Labs, San Diego, CA, United States
| | - Patrick Cooper
- Department of Physics, Duquesne University, Pittsburgh, PA, United States
| | - Willem van der Maden
- Department of Human Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, Netherlands
| | - Emily S. Cross
- Social Robotics, Institute of Neuroscience and Psychology, School of Computing Science, University of Glasgow, Glasgow, United Kingdom
- SOBA Lab, School of Psychology, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
23
|
Hsieh TY, Cross ES. People's dispositional cooperative tendencies towards robots are unaffected by robots' negative emotional displays in prisoner's dilemma games. Cogn Emot 2022; 36:995-1019. [PMID: 35389323 DOI: 10.1080/02699931.2022.2054781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
The study explores the impact of robots' emotional displays on people's tendency to cooperate with a robot opponent in prisoner's dilemma games. Participants played iterated prisoner's dilemma games with a non-expressive robot (as a measure of cooperative baseline), followed by an angry, and a sad robot, in turn. Based on the Emotion as Social Information model, we expected participants with higher cooperative predispositions to cooperate less when a robot displayed anger, and cooperate more when the robot displayed sadness. Contrarily, according to this model, participants with lower cooperative predispositions should cooperate more with an angry robot and less with a sad robot. The results of 60 participants failed to support the predictions. Only the participants' cooperative predispositions significantly predicted their cooperative tendencies during gameplay. Participants who cooperated more in the baseline measure also cooperated more with the robots displaying sadness and anger. In exploratory analyses, we found that participants who accurately recognised the robots' sad and angry displays tended to cooperate less with them overall. The study highlights the impact of personal factors in human-robot cooperation, and how these factors might surpass the influence of bottom-up emotional displays by the robots in the present experimental scenario.
Collapse
Affiliation(s)
- Te-Yi Hsieh
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland
| | - Emily S Cross
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland.,Department of Cognitive Science, Macquarie University, Sydney, Australia
| |
Collapse
|
24
|
Wu Y, Luo Y, Cuthbert TJ, Shokurov AV, Chu PK, Feng S, Menon C. Hydrogels as Soft Ionic Conductors in Flexible and Wearable Triboelectric Nanogenerators. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2106008. [PMID: 35187859 PMCID: PMC9009134 DOI: 10.1002/advs.202106008] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 02/07/2022] [Indexed: 05/12/2023]
Abstract
Flexible triboelectric nanogenerators (TENGs) have attracted increasing interest since their advent in 2012. In comparison with other flexible electrodes, hydrogels possess transparency, stretchability, biocompatibility, and tunable ionic conductivity, which together provide great potential as current collectors in TENGs for wearable applications. The development of hydrogel-based TENGs (H-TENGs) is currently a burgeoning field but research efforts have lagged behind those of other common flexible TENGs. In order to spur research and development of this important area, a comprehensive review that summarizes recent advances and challenges of H-TENGs will be very useful to researchers and engineers in this emerging field. Herein, the advantages and types of hydrogels as soft ionic conductors in TENGs are presented, followed by detailed descriptions of the advanced functions, enhanced output performance, as well as flexible and wearable applications of H-TENGs. Finally, the challenges and prospects of H-TENGs are discussed.
Collapse
Affiliation(s)
- Yinghong Wu
- Biomedical and Mobile Health Technology LabDepartment of Health Sciences and TechnologyETH ZurichZurich8008Switzerland
| | - Yang Luo
- Department of PhysicsDepartment of Materials Science and Engineeringand Department of Biomedical EngineeringCity University of Hong KongHong Kong999077China
| | - Tyler J. Cuthbert
- Biomedical and Mobile Health Technology LabDepartment of Health Sciences and TechnologyETH ZurichZurich8008Switzerland
| | - Alexander V. Shokurov
- Biomedical and Mobile Health Technology LabDepartment of Health Sciences and TechnologyETH ZurichZurich8008Switzerland
| | - Paul K. Chu
- Department of PhysicsDepartment of Materials Science and Engineeringand Department of Biomedical EngineeringCity University of Hong KongHong Kong999077China
| | - Shien‐Ping Feng
- Department of Mechanical EngineeringThe University of Hong KongHong Kong999077China
- Department of Advanced Design and Systems EngineeringCity University of Hong KongKowloonHong Kong999077China
| | - Carlo Menon
- Biomedical and Mobile Health Technology LabDepartment of Health Sciences and TechnologyETH ZurichZurich8008Switzerland
| |
Collapse
|
25
|
More than appearance: the uncanny valley effect changes with a robot’s mental capacity. CURRENT PSYCHOLOGY 2021. [DOI: 10.1007/s12144-021-02298-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
26
|
Zhang D, Shen J, Li S, Gao K, Gu R. I, robot: depression plays different roles in human-human and human-robot interactions. Transl Psychiatry 2021; 11:438. [PMID: 34420040 PMCID: PMC8380250 DOI: 10.1038/s41398-021-01567-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Revised: 08/04/2021] [Accepted: 08/13/2021] [Indexed: 02/07/2023] Open
Abstract
Socially engaging robots have been increasingly applied to alleviate depressive symptoms and to improve the quality of social life among different populations. Seeing that depression negatively influences social reward processing in everyday interaction, we investigate this influence during simulated interactions with humans or robots. In this study, 35 participants with mild depression and 35 controls (all from nonclinical populations) finished the social incentive delay task with event-related potential recording, in which they received performance feedback from other persons or from a robot. Compared to the controls, the mild depressive symptom (MDS) group represented abnormalities of social reward processing in the human feedback condition: first, the MDS group showed a lower hit rate and a smaller contingent-negative variation (correlated with each other) during reward anticipation; second, depression level modulated both the early phase (indexed by the feedback-related negativity (FRN)) and the late phase (indexed by the P3) of reward consumption. In contrast, the effect of depression was evident only on FRN amplitude in the robot feedback condition. We suggest that compared to human-human interaction, the rewarding properties of human-robot interaction are less likely to be affected by depression. These findings have implications for the utilization of robot-assisted intervention in clinical practice.
Collapse
Affiliation(s)
- Dandan Zhang
- School of Psychology, Shenzhen University, 518060, Shenzhen, China.
- Magnetic Resonance Imaging Center, Shenzhen University, 518060, Shenzhen, China.
| | - Junshi Shen
- School of Psychology, Shenzhen University, 518060, Shenzhen, China
| | - Sijin Li
- School of Psychology, Shenzhen University, 518060, Shenzhen, China
| | - Kexiang Gao
- School of Psychology, Shenzhen University, 518060, Shenzhen, China
| | - Ruolei Gu
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, 100101, Beijing, China.
- Department of Psychology, University of Chinese Academy of Sciences, 100049, Beijing, China.
| |
Collapse
|
27
|
Abstract
Despite recent developments in integrating autonomous and human-like robots into many aspects of everyday life, social interactions with robots are still a challenge. Here, we focus on a central tool for social interaction: verbal communication. We assess the extent to which humans co-represent (simulate and predict) a robot's verbal actions. During a joint picture naming task, participants took turns in naming objects together with a social robot (Pepper, Softbank Robotics). Previous findings using this task with human partners revealed internal simulations on behalf of the partner down to the level of selecting words from the mental lexicon, reflected in partner-elicited inhibitory effects on subsequent naming. Here, with the robot, the partner-elicited inhibitory effects were not observed. Instead, naming was facilitated, as revealed by faster naming of word categories co-named with the robot. This facilitation suggests that robots, unlike humans, are not simulated down to the level of lexical selection. Instead, a robot's speaking appears to be simulated at the initial level of language production where the meaning of the verbal message is generated, resulting in facilitated language production due to conceptual priming. We conclude that robots facilitate core conceptualization processes when humans transform thoughts to language during speaking.
Collapse
|
28
|
Hortensius R, Kent M, Darda KM, Jastrzab L, Koldewyn K, Ramsey R, Cross ES. Exploring the relationship between anthropomorphism and theory-of-mind in brain and behaviour. Hum Brain Mapp 2021; 42:4224-4241. [PMID: 34196439 PMCID: PMC8356980 DOI: 10.1002/hbm.25542] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 05/07/2021] [Accepted: 05/11/2021] [Indexed: 01/14/2023] Open
Abstract
The process of understanding the minds of other people, such as their emotions and intentions, is mimicked when individuals try to understand an artificial mind. The assumption is that anthropomorphism, attributing human‐like characteristics to non‐human agents and objects, is an analogue to theory‐of‐mind, the ability to infer mental states of other people. Here, we test to what extent these two constructs formally overlap. Specifically, using a multi‐method approach, we test if and how anthropomorphism is related to theory‐of‐mind using brain (Experiment 1) and behavioural (Experiment 2) measures. In a first exploratory experiment, we examine the relationship between dispositional anthropomorphism and activity within the theory‐of‐mind brain network (n = 108). Results from a Bayesian regression analysis showed no consistent relationship between dispositional anthropomorphism and activity in regions of the theory‐of‐mind network. In a follow‐up, pre‐registered experiment, we explored the relationship between theory‐of‐mind and situational and dispositional anthropomorphism in more depth. Participants (n = 311) watched a short movie while simultaneously completing situational anthropomorphism and theory‐of‐mind ratings, as well as measures of dispositional anthropomorphism and general theory‐of‐mind. Only situational anthropomorphism predicted the ability to understand and predict the behaviour of the film's characters. No relationship between situational or dispositional anthropomorphism and general theory‐of‐mind was observed. Together, these results suggest that while the constructs of anthropomorphism and theory‐of‐mind might overlap in certain situations, they remain separate and possibly unrelated at the personality level. These findings point to a possible dissociation between brain and behavioural measures when considering the relationship between theory‐of‐mind and anthropomorphism.
Collapse
Affiliation(s)
- Ruud Hortensius
- Department of Psychology, Utrecht University, Utrecht, The Netherlands.,Institute of Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, Scotland, UK
| | - Michaela Kent
- Institute of Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, Scotland, UK.,Faculty of Neuroscience, Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada
| | - Kohinoor M Darda
- Institute of Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, Scotland, UK.,Department of Cognitive Science, Macquarie University, Sydney, New South Wales, Australia
| | - Laura Jastrzab
- Institute of Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, Scotland, UK.,Wales Institute for Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, Wales, UK
| | - Kami Koldewyn
- Wales Institute for Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, Wales, UK
| | - Richard Ramsey
- Department of Psychology, Macquarie University, Sydney, New South Wales, Australia
| | - Emily S Cross
- Institute of Neuroscience and Psychology, School of Psychology, University of Glasgow, Glasgow, Scotland, UK.,Department of Cognitive Science, Macquarie University, Sydney, New South Wales, Australia
| |
Collapse
|
29
|
Cornelio P, Velasco C, Obrist M. Multisensory Integration as per Technological Advances: A Review. Front Neurosci 2021; 15:652611. [PMID: 34239410 PMCID: PMC8257956 DOI: 10.3389/fnins.2021.652611] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Accepted: 04/29/2021] [Indexed: 11/13/2022] Open
Abstract
Multisensory integration research has allowed us to better understand how humans integrate sensory information to produce a unitary experience of the external world. However, this field is often challenged by the limited ability to deliver and control sensory stimuli, especially when going beyond audio-visual events and outside laboratory settings. In this review, we examine the scope and challenges of new technology in the study of multisensory integration in a world that is increasingly characterized as a fusion of physical and digital/virtual events. We discuss multisensory integration research through the lens of novel multisensory technologies and, thus, bring research in human-computer interaction, experimental psychology, and neuroscience closer together. Today, for instance, displays have become volumetric so that visual content is no longer limited to 2D screens, new haptic devices enable tactile stimulation without physical contact, olfactory interfaces provide users with smells precisely synchronized with events in virtual environments, and novel gustatory interfaces enable taste perception through levitating stimuli. These technological advances offer new ways to control and deliver sensory stimulation for multisensory integration research beyond traditional laboratory settings and open up new experimentations in naturally occurring events in everyday life experiences. Our review then summarizes these multisensory technologies and discusses initial insights to introduce a bridge between the disciplines in order to advance the study of multisensory integration.
Collapse
Affiliation(s)
- Patricia Cornelio
- Department of Computer Science, University College London, London, United Kingdom
| | - Carlos Velasco
- Centre for Multisensory Marketing, Department of Marketing, BI Norwegian Business School, Oslo, Norway
| | - Marianna Obrist
- Department of Computer Science, University College London, London, United Kingdom
| |
Collapse
|
30
|
Henschel A, Laban G, Cross ES. What Makes a Robot Social? A Review of Social Robots from Science Fiction to a Home or Hospital Near You. CURRENT ROBOTICS REPORTS 2021; 2:9-19. [PMID: 34977592 PMCID: PMC7860159 DOI: 10.1007/s43154-020-00035-0] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 12/21/2020] [Indexed: 12/17/2022]
Abstract
Purpose of Review We provide an outlook on the definitions, laboratory research, and applications of social robots, with an aim to understand what makes a robot social—in the eyes of science and the general public. Recent Findings Social robots demonstrate their potential when deployed within contexts appropriate to their form and functions. Some examples include companions for the elderly and cognitively impaired individuals, robots within educational settings, and as tools to support cognitive and behavioural change interventions. Summary Science fiction has inspired us to conceive of a future with autonomous robots helping with every aspect of our daily lives, although the robots we are familiar with through film and literature remain a vision of the distant future. While there are still miles to go before robots become a regular feature within our social spaces, rapid progress in social robotics research, aided by the social sciences, is helping to move us closer to this reality.
Collapse
Affiliation(s)
- Anna Henschel
- Institute of Neuroscience and Psychology, Department of Psychology, University of Glasgow, Glasgow, Scotland
| | - Guy Laban
- Institute of Neuroscience and Psychology, Department of Psychology, University of Glasgow, Glasgow, Scotland
| | - Emily S Cross
- Institute of Neuroscience and Psychology, Department of Psychology, University of Glasgow, Glasgow, Scotland.,Department of Cognitive Science, Macquarie University, Sydney, Australia
| |
Collapse
|
31
|
Laban G, Ben-Zion Z, Cross ES. Social Robots for Supporting Post-traumatic Stress Disorder Diagnosis and Treatment. Front Psychiatry 2021; 12:752874. [PMID: 35185629 PMCID: PMC8854768 DOI: 10.3389/fpsyt.2021.752874] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Accepted: 12/27/2021] [Indexed: 12/13/2022] Open
Abstract
Post-Traumatic Stress Disorder (PTSD) is a severe psychiatric disorder with profound public health impact due to its high prevalence, chronic nature, accompanying functional impairment, and frequently occurring comorbidities. Early PTSD symptoms, often observed shortly after trauma exposure, abate with time in the majority of those who initially express them, yet leave a significant minority with chronic PTSD. While the past several decades of PTSD research have produced substantial knowledge regarding the mechanisms and consequences of this debilitating disorder, the diagnosis of and available treatments for PTSD still face significant challenges. Here, we discuss how novel therapeutic interventions involving social robots can potentially offer meaningful opportunities for overcoming some of the present challenges. As the application of social robotics-based interventions in the treatment of mental disorders is only in its infancy, it is vital that careful, well-controlled research is conducted to evaluate their efficacy, safety, and ethics. Nevertheless, we are hopeful that robotics-based solutions could advance the quality, availability, specificity and scalability of care for PTSD.
Collapse
Affiliation(s)
- Guy Laban
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| | - Ziv Ben-Zion
- Tel-Aviv Sourasky Medical Center, Sagol Brain Institute Tel-Aviv, Wohl Institute for Advanced Imaging, Tel-Aviv, Israel.,Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel.,Departments of Comparative Medicine and Psychiatry, Yale School of Medicine, Yale University, New Haven, CT, United States.,The Clinical Neurosciences Division, VA Connecticut Healthcare System, United States Department of Veterans Affairs, National Center for Posttraumatic Stress Disorder, West Haven, CT, United States
| | - Emily S Cross
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom.,Department of Cognitive Science, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|