The development of the uncanny valley in infants

A stimulus exposure of 50 ms elicits the uncanny valley effect

The uncanny valley (UV) effect captures the observation that artificial entities with near-human appearances tend to create feelings of eeriness. Researchers have proposed many hypotheses to explain the UV effect, but the visual processing mechanisms of the UV have yet to be fully understood. In the present study, we examined if the UV effect is as accessible in brief stimulus exposures compared to long stimulus exposures (Experiment 1). Forty-one participants, aged 21-31, rated each human-robot face presented for either a brief (50 ms) or long duration (3 s) in terms of attractiveness, eeriness, and humanness (UV indices) in a 7-point Likert scale. We found that brief and long exposures to stimuli generated a similar UV effect. This suggests that the UV effect is accessible at early visual processing. We then examined the effect of exposure duration on the categorisation of visual stimuli in Experiment 2. Thirty-three participants, aged 21-31, categorised faces as either human or robot in a two-alternative forced choice task. Their response accuracy and variance were recorded. We found that brief stimulus exposures generated significantly higher response variation and errors than the long exposure condition. This indicated that participants were more uncertain in categorising faces in the brief exposure condition due to insufficient time. Further comparisons between Experiment 1 and 2 revealed that the eeriest faces were not the hardest to categorise. Overall, these findings indicate (1) that both the UV effect and categorical uncertainty can be elicited through brief stimulus exposure, but (2) that categorical uncertainty is unlikely to cause the UV effect. These findings provide insights towards the perception of robotic faces and implications for the design of robots, androids, avatars, and artificial intelligence agents.

People with Autism Spectrum Disorder Could Interact More Easily with a Robot than with a Human: Reasons and Limits

Individuals with Autism Spectrum Disorder show deficits in communication and social interaction, as well as repetitive behaviors and restricted interests. Interacting with robots could bring benefits to this population, notably by fostering communication and social interaction. Studies even suggest that people with Autism Spectrum Disorder could interact more easily with a robot partner rather than a human partner. We will be looking at the benefits of robots and the reasons put forward to explain these results. The interest regarding robots would mainly be due to three of their characteristics: they can act as motivational tools, and they are simplified agents whose behavior is more predictable than that of a human. Nevertheless, there are still many challenges to be met in specifying the optimum conditions for using robots with individuals with Autism Spectrum Disorder.

Human vs. machine-like representation in chatbot mental health counseling: the serial mediation of psychological distance and trust on compliance intention

This study examined a serial mediation mechanism to test the effect of chatbots' human representation on the intention to comply with health recommendations through psychological distance and trust towards the chatbot counselor. The sample of the study comprised 385 adults from the USA. Two artificial intelligence chatbots either with human or machine-like representation were developed. Participants had a short conversation with either of the chatbots to simulate an online mental health counseling session and reported their experience in an online survey. The results showed that participants in the human representation condition reported a higher intention to comply with chatbot-generated mental health recommendations than those in the machine-like representation condition. Furthermore, the results supported that both psychological distance and perceived trust towards the chatbot mediated the relationship between human representation and compliance intention, respectively. The serial mediation through psychological distance and trust in the relationship between human representation and compliance intention was also supported. These findings provide practical guidance for healthcare chatbot developers and theoretical implications for human-computer interaction research.

From Freud to Android: Constructing a Scale of Uncanny Feelings

The uncanny valley is a topic for engineers, animators, and psychologists, yet uncanny emotions are without a clear definition. Across three studies, we developed an 8-item measure of unnerved feelings, finding that it was discriminable from other affective experiences. In Study 1, we conducted an exploratory factor analysis that yielded two factors; an unnerved factor, which connects to emotional reactions to the uncanny, and a disoriented factor, which connects to mental state changes more distally following uncanny experiences. Focusing on the unnerved measure, Study 2 tests the scale's convergent and discriminant validity, concluding that participants who watched an uncanny video were more unnerved than those who watched a disgusting, fearful, or a neutral video. In Study 3, we determined that our scale detects unnerved feelings created during early 2020 by the coronavirus pandemic; a distinct source of uncanniness. These studies contribute to the psychological and interdisciplinary understanding of this strange, eerie phenomenon of being confronted with what looms just beyond our understanding.

Monkey visual attention does not fall into the uncanny valley

Very humanlike artificial agents can induce feelings of uneasiness in human perceivers. Stimuli that generate this response are said to occupy "the uncanny valley". Given inconsistent findings in the literature, whether or not nonhuman animals experience the uncanny valley is unclear. Here, we recorded the visual attention of eleven male rhesus monkeys as they viewed faces varying in realness across five levels, with visual attention measured by both number and duration of visual fixations on faces as a whole and on areas of interest within the faces (e.g., eyes, mouth). Face stimuli varied in terms of the realism of the image and behavior depicted by the face (lipsmack, threat, bared teeth, and neutral). We largely found no support that rhesus monkeys perceive an uncanny valley when viewing our stimuli; however, monkeys did generally pay more attention to eyes and less attention to mouths in real images compared to less realistic images. Across all stimuli, monkeys' visual attention was drawn to the mouths of images when teeth were visible. These findings suggest that rhesus monkeys in our study did not display an uncanny valley effect when viewing realistic stimuli but did percieve affective information depicted by faces regardless of how real those faces appear.

A Meta-analysis of the Uncanny Valley's Independent and Dependent Variables

The uncanny valley (UV) effect is a negative affective reaction to human-looking artificial entities. It hinders comfortable, trust-based interactions with android robots and virtual characters. Despite extensive research, a consensus has not formed on its theoretical basis or methodologies. We conducted a meta-analysis to assess operationalizations of human likeness (independent variable) and the UV effect (dependent variable). Of 468 studies, 72 met the inclusion criteria. These studies employed 10 different stimulus creation techniques, 39 affect measures, and 14 indirect measures. Based on 247 effect sizes, a three-level meta-analysis model revealed the UV effect had a large effect size, Hedges’ g = 1.01 [0.80, 1.22]. A mixed-effects meta-regression model with creation technique as the moderator variable revealed face distortion produced the largest effect size, g = 1.46 [0.69, 2.24], followed by distinct entities, g = 1.20 [1.02, 1.38], realism render, g = 0.99 [0.62, 1.36], and morphing, g = 0.94 [0.64, 1.24]. Affective indices producing the largest effects were threatening, likable, aesthetics, familiarity , and eeriness , and indirect measures were dislike frequency, categorization reaction time, like frequency, avoidance , and viewing duration . This meta-analysis—the first on the UV effect—provides a methodological foundation and design principles for future research.

British Children’s and Adults’ Perceptions of Robots

Robotics and artificial intelligence (AI) systems are quickly becoming a familiar part of different aspects of everyday life. We know very little about how children and adults perceive the abilities of different robots and whether these ascriptions are associated with a willingness to interact with a robot. In the current study, we asked British children aged 4–13 years and British adults to complete an online experiment. Participants were asked to describe what a robot looks like, give their preference for various types of robots (a social robot, a machine-like robot, and a human-like robot), and answer whether they were willing to engage in different activities with the different robots. Results showed that younger children (4 to 8 years old) are more willing to engage with robots compared to older children (9 to 13 years) and adults. Specifically, younger children were more likely to see robots as kind compared to older children and adults. Younger children were also more likely to rate the social robot as helpful compared to older children and adults. This is also the first study to examine preferences for robots engaging in religious activities, and results show that British adults prefer humans over robots to pray for them but such biases may not be generally applicable to children. These results provide new insight into how children and adults in the United Kingdom accept the presence and function of robots.

Learning Through Shared Care : Allomaternal Care Impacts Cognitive Development in Early Infancy in a Western Population

This study investigates how allomaternal care (AMC) impacts human development outside of energetics by evaluating relations between important qualitative and quantitative aspects of AMC and developmental outcomes in a Western population. This study seeks to determine whether there are measurable differences in cognitive and language outcomes as predicted by differences in exposure to AMC via formal (e.g., childcare facilities) and informal (e.g., family and friends) networks. Data were collected from 102 mothers and their typically developing infants aged 13-18 months. AMC predictor data were collected using questionnaires, structured daily diaries, and longitudinal interviews. Developmental outcomes were assessed using the Cognitive, Receptive Language, and Expressive Language subtests of the Bayley III Screening Test. Additional demographic covariates were also evaluated. Akaike Information Criterion (AIC)-informed model selection was used to identify the best-fitting model for each outcome across three working linear regression models. Although AMC variables had no significant effects on Receptive and Expressive Language subtest scores, highly involved familial AMC had a significant medium effect on Cognitive subtest score (β = 0.23, p < 0.01, semi-partial r = 0.28). Formal childcare had no effect on any outcome. This study provides preliminary evidence that there is a measurable connection between AMC and cognitive development in some populations and provides a methodological base from which to assess these connections cross-culturally through future studies. As these effects are attributable to AMC interactions with networks of mostly related individuals, these findings present an area for further investigation regarding the kin selection hypothesis for AMC.

Creepy cats and strange high houses: Support for configural processing in testing predictions of nine uncanny valley theories

In 1970, Masahiro Mori proposed the uncanny valley (UV), a region in a human-likeness continuum where an entity risks eliciting a cold, eerie, repellent feeling. Recent studies have shown that this feeling can be elicited by entities modeled not only on humans but also nonhuman animals. The perceptual and cognitive mechanisms underlying the UV effect are not well understood, although many theories have been proposed to explain them. To test the predictions of nine classes of theories, a within-subjects experiment was conducted with 136 participants. The theories' predictions were compared with ratings of 10 classes of stimuli on eeriness and coldness indices. One type of theory, configural processing, predicted eight out of nine significant effects. Atypicality, in its extended form, in which the uncanny valley effect is amplified by the stimulus appearing more human, also predicted eight. Threat avoidance predicted seven; atypicality, perceptual mismatch, and mismatch+ predicted six; category+, novelty avoidance, mate selection, and psychopathy avoidance predicted five; and category uncertainty predicted three. Empathy's main prediction was not supported. Given that the number of significant effects predicted depends partly on our choice of hypotheses, a detailed consideration of each result is advised. We do, however, note the methodological value of examining many competing theories in the same experiment.

Self-face perception in 12-month-old infants: A study using the morphing technique

The present study investigated self-face perception in 12-month-old infants using the morphing technique. Twenty-four 12-month-old infants participated in both the main and control experiments. In the main experiment, we used the participant's own face, an unfamiliar infant's face (age- and gender-matched), and a morphed face comprising 50 % each of the self and unfamiliar faces as stimuli. The control experiment followed the same procedure, except that the self-face was replaced with another unfamiliar face. In both experiments, two of these stimuli were presented side by side on a monitor in each trial, and infants' fixation duration was measured. Results showed that shorter fixation durations were found for the morphed face compared with the self-face and the unfamiliar face in the main experiment, but there were no significant preferences for any comparisons in the control experiment. The results suggest that 12-month-old infants could detect subtle differences in facial features between the self-face and the other faces, and infants might show less preference for the self-resembling morphed face due to increased processing costs, which can be interpreted using the uncanny valley hypothesis. Overall, representations of the self-face seem to a certain extent to be formed by the end of the first year of life through daily visual experience.

A Naturalistic Dynamic Monkey Head Avatar Elicits Species-Typical Reactions and Overcomes the Uncanny Valley

Research on social perception in monkeys may benefit from standardized, controllable, and ethologically valid renditions of conspecifics offered by monkey avatars. However, previous work has cautioned that monkeys, like humans, show an adverse reaction toward realistic synthetic stimuli, known as the "uncanny valley" effect. We developed an improved naturalistic rhesus monkey face avatar capable of producing facial expressions (fear grin, lip smack and threat), animated by motion capture data of real monkeys. For validation, we additionally created decreasingly naturalistic avatar variants. Eight rhesus macaques were tested on the various videos and avoided looking at less naturalistic avatar variants, but not at the most naturalistic or the most unnaturalistic avatar, indicating an uncanny valley effect for the less naturalistic avatar versions. The avoidance was deepened by motion and accompanied by physiological arousal. Only the most naturalistic avatar evoked facial expressions comparable to those toward the real monkey videos. Hence, our findings demonstrate that the uncanny valley reaction in monkeys can be overcome by a highly naturalistic avatar.

Age-Related Differences in the Uncanny Valley Effect

BACKGROUND

Due to declining birthrates and an increasing aging population, shortage of the caregiving labor force has become a global issue. Among various efforts toward the solution, introducing robotic products for assistance could provide an effective way to help older adults in their daily lives. As previous studies have indicated that older adults' acceptance of robots is lower than that of younger adults, enhancing older adults' acceptance of robots is imperative. Because older adults' first impressions based on a robot's appearance might affect their acceptance of the robot, we investigated the uncanny valley effect (UVE) here. The UVE refers to the phenomenon that people rate robots more positively as robots become more humanlike, but only up to a certain point; as robots approach a near-perfect similarity to human appearance, likeability drops and forms the uncanny valley. Nevertheless, evidence for the UVE came mainly from younger adults.

OBJECTIVE

The present study aimed to examine whether the UVE varies across different age groups and whether a robot's appearance would affect participants' acceptance of the robot's service or companionship.

METHODS

An online questionnaire study was conducted with 255 participants, including younger (n = 77, age 18-39 years), middle-aged (n = 87, age 40-59 years), and older (n = 91, age 60-87 years) adults. Participants were asked to view each picture in a set selected from a total of 83 robot pictures and evaluate their impressions of each robot and the intention of use regarding robot function as a service provider or a companion.

RESULTS

The UVE was found in younger and middle-aged adults; however, older adults did not show the UVE. Older adults preferred humanlike over non-humanlike robots, regardless of robot function.

CONCLUSION

The design of assistive robots should take the UVE into consideration by customizing robot appearance based on the age group of the intended user.

Young Children's Indiscriminate Helping Behavior Toward a Humanoid Robot

Young children help others in a range of situations, relatively indiscriminate of the characteristics of those they help. Recent results have suggested that young children's helping behavior extends even to humanoid robots. However, it has been unclear how characteristics of robots would influence children's helping behavior. Considering previous findings suggesting that certain robot features influence adults' perception of and their behavior toward robots, the question arises of whether young children's behavior and perception would follow the same principles. The current study investigated whether two key characteristics of a humanoid robot (animate autonomy and friendly expressiveness) would affect children's instrumental helping behavior and their perception of the robot as an animate being. Eighty-two 3-year-old children participated in one of four experimental conditions manipulating a robot's ostensible animate autonomy (high/low) and friendly expressiveness (friendly/neutral). Helping was assessed in an out-of-reach task and animacy ratings were assessed in a post-test interview. Results suggested that both children's helping behavior, as well as their perception of the robot as animate, were unaffected by the robot's characteristics. The findings indicate that young children's helping behavior extends largely indiscriminately across two important characteristics. These results increase our understanding of the development of children's altruistic behavior and animate-inanimate distinctions. Our findings also raise important ethical questions for the field of child-robot interaction.

Upper- and lower-limb amputees show reduced levels of eeriness for images of prosthetic hands

The "uncanny phenomenon" describes the feeling of unease associated with seeing an image that is close to appearing human. Prosthetic hands in particular are well known to induce this effect. Little is known, however, about this phenomenon from the viewpoint of prosthesis users. We studied perceptions of eeriness and human-likeness for images of different types of mechanical, cosmetic, and anatomic hands in upper-limb prosthesis users (n=9), lower-limb prosthesis users (n=10), prosthetists (n=16), control participants with no prosthetic training (n=20), and control participants who were trained to use a myoelectric prosthetic hand simulator (n=23). Both the upper- and lower-limb prosthesis user groups showed a reduced uncanny phenomenon (i.e., significantly lower levels of eeriness) for cosmetic prosthetic hands compared to the other groups, with no concomitant reduction in how these stimuli were rated in terms of human-likeness. However, a similar effect was found neither for prosthetists with prolonged visual experience of prosthetic hands nor for the group with short-term training with the simulator. These findings in the prosthesis users therefore seem likely to be related to limb absence or prolonged experience with prostheses.

The uncanny valley effect in typically developing children and its absence in children with autism spectrum disorders

Robots and virtual reality are gaining popularity in the intervention of children with autism spectrum disorder (ASD). To shed light on children’s attitudes towards robots and characters in virtual reality, this study aims to examine whether children with ASD show the uncanny valley effect. We varied the realism of facial appearance by morphing a cartoon face into a human face, and induced perceptual mismatch by enlarging the eyes, which has previously been shown as an effective method to induce the uncanny valley effect in adults. Children with ASD and typically developing (TD) children participated in a two-alternative forced choice task that asked them to choose one they liked more from the two images presented on the screen. We found that TD children showed the effect, i.e., the enlargement of eye size and the approaching realism reduced their preference. In contrast, children with ASD did not show the uncanny valley effect. Our findings in TD children help resolve the controversy in the literature about the existence of the uncanny valley effect among young children. Meanwhile, the absence of the uncanny valley effect in children with ASD might be attributed to their reduced sensitivity to subtle changes of face features and their limited visual experience to faces caused by diminished social motivation. Last, our findings provide practical implications for designing robots and virtual characters for the intervention of children with ASD.

Comparative thanatology, an integrative approach: exploring sensory/cognitive aspects of death recognition in vertebrates and invertebrates

Evolutionary thanatology benefits from broad taxonomic comparisons of non-human animals' responses to death. Furthermore, exploring the sensory and cognitive bases of these responses promises to allow classification of the underlying mechanisms on a spectrum from phylogenetically ancient to more derived traits. We draw on studies of perception and cognition in invertebrate and vertebrate taxa (with a focus on arthropods, corvids, proboscids, cetaceans and primates) to explore the cues that these animals use to detect life and death in others, and discuss proximate and ultimate drivers behind their capacities to do so. Parallels in thanatological behaviour exhibited by the last four taxa suggest similar sensory-cognitive processing rules for dealing with corpses, the evolution of which may have been driven by complex social environments. Uniting these responses is a phenomenon we term 'animacy detection malfunction', whereupon the corpse, having both animate and inanimate attributes, creates states of fear/curiosity manifested as approach/avoidance behaviours in observers. We suggest that integrating diverse lines of evidence (including the 'uncanny valley' effect originating from the field of robotics) provides a promising way to advance the field, and conclude by proposing avenues for future research.This article is part of the theme issue 'Evolutionary thanatology: impacts of the dead on the living in humans and other animals'.

Avoidance of Novelty Contributes to the Uncanny Valley

A hypothesis suggests that objects with a high degree of visual similarity to real humans trigger negative impressions (i.e., the uncanny valley). Previous studies have suggested that difficulty in object categorization elicits negative emotional reactions to enable the avoidance of potential threats. The present study further investigated this categorization-difficulty hypothesis. In an experiment, observers categorized morphed images of photographs and human doll faces as "photograph" or "doll" and evaluated the perceived eeriness of the images. Additionally, we asked the observers to answer questionnaires on behavioral inhibition systems (BIS). The results indicated that individual differences in the BIS score were associated with enhanced eeriness in the objects with a specific human likeness. These findings suggest that the tendency to avoid a potentially threatening novel experience contributes to promoting the perceived eeriness of objects with some degree of visual similarity to real humans.

Understanding the Uncanny: Both Atypical Features and Category Ambiguity Provoke Aversion toward Humanlike Robots

Robots intended for social contexts are often designed with explicit humanlike attributes in order to facilitate their reception by (and communication with) people. However, observation of an “uncanny valley”—a phenomenon in which highly humanlike entities provoke aversion in human observers—has lead some to caution against this practice. Both of these contrasting perspectives on the anthropomorphic design of social robots find some support in empirical investigations to date. Yet, owing to outstanding empirical limitations and theoretical disputes, the uncanny valley and its implications for human-robot interaction remains poorly understood. We thus explored the relationship between human similarity and people's aversion toward humanlike robots via manipulation of the agents' appearances. To that end, we employed a picture-viewing task (N_agents = 60) to conduct an experimental test (N_participants = 72) of the uncanny valley's existence and the visual features that cause certain humanlike robots to be unnerving. Across the levels of human similarity, we further manipulated agent appearance on two dimensions, typicality (prototypic, atypical, and ambiguous) and agent identity (robot, person), and measured participants' aversion using both subjective and behavioral indices. Our findings were as follows: (1) Further substantiating its existence, the data show a clear and consistent uncanny valley in the current design space of humanoid robots. (2) Both category ambiguity, and more so, atypicalities provoke aversive responding, thus shedding light on the visual factors that drive people's discomfort. (3) Use of the Negative Attitudes toward Robots Scale did not reveal any significant relationships between people's pre-existing attitudes toward humanlike robots and their aversive responding—suggesting positive exposure and/or additional experience with robots is unlikely to affect the occurrence of an uncanny valley effect in humanoid robotics. This work furthers our understanding of both the uncanny valley, as well as the visual factors that contribute to an agent's uncanniness.

Ethorobotics: A New Approach to Human-Robot Relationship

Here we aim to lay the theoretical foundations of human-robot relationship drawing upon insights from disciplines that govern relevant human behaviors: ecology and ethology. We show how the paradox of the so called “uncanny valley hypothesis” can be solved by applying the “niche” concept to social robots, and relying on the natural behavior of humans. Instead of striving to build human-like social robots, engineers should construct robots that are able to maximize their performance in their niche (being optimal for some specific functions), and if they are endowed with appropriate form of social competence then humans will eventually interact with them independent of their embodiment. This new discipline, which we call ethorobotics, could change social robotics, giving a boost to new technical approaches and applications.

Circling Around the Uncanny Valley: Design Principles for Research Into the Relation Between Human Likeness and Eeriness

The uncanny valley effect (UVE) is a negative emotional response experienced when encountering entities that appear almost human. Research on the UVE typically investigates individual, or collections of, near human entities but may be prone to methodological circularity unless the properties that give rise to the emotional response are appropriately defined and quantified. In addition, many studies do not sufficiently control the variation in human likeness portrayed in stimulus images, meaning that the nature of stimuli that elicit the UVE is also not well defined or quantified. This article describes design criteria for UVE research to overcome the above problems by measuring three variables (human likeness, eeriness, and emotional response) and by using stimuli spanning the artificial to human continuum. These criteria allow results to be plotted and compared with the hypothesized uncanny valley curve and any effect observed can be quantified. The above criteria were applied to the methods used in a subset of existing UVE studies. Although many studies made use of some of the necessary measurements and controls, few used them all. The UVE is discussed in relation to this result and research methodology more broadly.

The Uncanny Valley: Existence and Explanations

More than 40 years ago, Japanese roboticist Masahiro Mori (1970/2005) proposed the “uncanny valley” hypothesis, which predicted a nonlinear relation between robots’ perceived human likeness and their likability. Although some studies have corroborated this hypothesis and proposed explanations for its existence, the evidence on both fronts has been mixed and open to debate. We first review the literature to ascertain whether the uncanny valley exists. We then try to explain the uncanny phenomenon by reviewing hypotheses derived from diverse theoretical and methodological perspectives within psychology and allied fields, including evolutionary, social, cognitive, and psychodynamic approaches. Next, we provide an evaluation and critique of these studies by focusing on their methodological limitations, leading us to question the accepted definition of the uncanny valley. We examine the definitions of human likeness and likability, and propose a statistical test to preliminarily quantify their nonlinear relation. We argue that the uncanny valley hypothesis is ultimately an engineering problem that bears on the possibility of building androids that may some day become indistinguishable from humans. In closing, we propose a dehumanization hypothesis to explain the uncanny phenomenon.

Infant discrimination of humanoid robots

Recently, extremely humanlike robots called “androids” have been developed, some of which are already being used in the field of entertainment. In the context of psychological studies, androids are expected to be used in the future as fully controllable human stimuli to investigate human nature. In this study, we used an android to examine infant discrimination ability between human beings and non-human agents. Participants (N = 42 infants) were assigned to three groups based on their age, i.e., 6- to 8-month-olds, 9- to 11-month-olds, and 12- to 14-month-olds, and took part in a preferential looking paradigm. Of three types of agents involved in the paradigm—a human, an android modeled on the human, and a mechanical-looking robot made from the android—two at a time were presented side-by-side as they performed a grasping action. Infants’ looking behavior was measured using an eye tracking system, and the amount of time spent focusing on each of three areas of interest (face, goal, and body) was analyzed. Results showed that all age groups predominantly looked at the robot and at the face area, and that infants aged over 9 months watched the goal area for longer than the body area. There was no difference in looking times and areas focused on between the human and the android. These findings suggest that 6- to 14-month-olds are unable to discriminate between the human and the android, although they can distinguish the mechanical robot from the human.

Reducing consistency in human realism increases the uncanny valley effect; increasing category uncertainty does not

Human replicas may elicit unintended cold, eerie feelings in viewers, an effect known as the uncanny valley. Masahiro Mori, who proposed the effect in 1970, attributed it to inconsistencies in the replica's realism with some of its features perceived as human and others as nonhuman. This study aims to determine whether reducing realism consistency in visual features increases the uncanny valley effect. In three rounds of experiments, 548 participants categorized and rated humans, animals, and objects that varied from computer animated to real. Two sets of features were manipulated to reduce realism consistency. (For humans, the sets were eyes-eyelashes-mouth and skin-nose-eyebrows.) Reducing realism consistency caused humans and animals, but not objects, to appear eerier and colder. However, the predictions of a competing theory, proposed by Ernst Jentsch in 1906, were not supported: The most ambiguous representations-those eliciting the greatest category uncertainty-were neither the eeriest nor the coldest.

A Bayesian Model of the Uncanny Valley Effect for Explaining the Effects of Therapeutic Robots in Autism Spectrum Disorder

One of the core features of autism spectrum disorder (ASD) is impaired reciprocal social interaction, especially in processing emotional information. Social robots are used to encourage children with ASD to take the initiative and to interact with the robotic tools to stimulate emotional responses. However, the existing evidence is limited by poor trial designs. The purpose of this study was to provide computational evidence in support of robot-assisted therapy for children with ASD. We thus propose an emotional model of ASD that adapts a Bayesian model of the uncanny valley effect, which holds that a human-looking robot can provoke repulsion and sensations of eeriness. Based on the unique emotional responses of children with ASD to the robots, we postulate that ASD induces a unique emotional response curve, more like a cliff than a valley. Thus, we performed numerical simulations of robot-assisted therapy to evaluate its effects. The results showed that, although a stimulus fell into the uncanny valley in the typical condition, it was effective at avoiding the uncanny cliff in the ASD condition. Consequently, individuals with ASD may find it more comfortable, and may modify their emotional response, if the robots look like deformed humans, even if they appear "creepy" to typical individuals. Therefore, we suggest that our model explains the effects of robot-assisted therapy in children with ASD and that human-looking robots may have potential advantages for improving social interactions in ASD.

Animal-oriented virtual environments: illusion, dilation, and discovery

As a research tool, virtual environments (VEs) hold immense promise for brain scientists. Yet to fully realize this potential in non-human systems, theoretical and conceptual perspectives must be developed. When selectively coupled to nervous systems, virtual environments can help us better understand the functional architecture of animals’ brains during naturalistic behaviors. While this will no doubt allow us to further our understanding of the neural basis of behavior, there is also an opportunity to uncover the diversity inherent in brain activity and behavior. This is due to two properties of virtual environments: the ability to create sensory illusions, and the ability to dilate space and/or time. These and other potential manipulations will be characterized as the effects of virtuality. In addition, the systems-level outcomes of virtual environment enhanced perception will be discussed in the context of the uncanny valley and other expected relationships between emotional valence, cognition, and training. These effects and their usefulness for brain science will be understood in the context of three types of neurobehavioral phenomena: sensorimotor integration, spatial navigation, and interactivity. For each of these behaviors, a combination of illusory and space/time dilation examples will be reviewed. Once these examples are presented, the implications for improving upon virtual models for more directly inducing the mental phenomena of illusion and space/time dilation will be considered. To conclude, future directions for integrating the use of VEs into a strategy of broader biological inquiry will be presented.

Early experience and multisensory perceptual narrowing

Perceptual narrowing reflects the effects of early experience and contributes in key ways to perceptual and cognitive development. Previous studies have found that unisensory perceptual sensitivity in young infants is broadly tuned such that they can discriminate native as well as non-native sensory inputs but that it is more narrowly tuned in older infants such that they only respond to native inputs. Recently, my coworkers and I discovered that multisensory perceptual sensitivity narrows as well. The present article reviews this new evidence in the general context of multisensory perceptual development and the effects of early experience. Together, the evidence on unisensory and multisensory narrowing shows that early experience shapes the emergence of perceptual specialization and expertise.

EEG theta and Mu oscillations during perception of human and robot actions

The perception of others' actions supports important skills such as communication, intention understanding, and empathy. Are mechanisms of action processing in the human brain specifically tuned to process biological agents? Humanoid robots can perform recognizable actions, but can look and move differently from humans, and as such, can be used in experiments to address such questions. Here, we recorded EEG as participants viewed actions performed by three agents. In the Human condition, the agent had biological appearance and motion. The other two conditions featured a state-of-the-art robot in two different appearances: Android, which had biological appearance but mechanical motion, and Robot, which had mechanical appearance and motion. We explored whether sensorimotor mu (8-13 Hz) and frontal theta (4-8 Hz) activity exhibited selectivity for biological entities, in particular for whether the visual appearance and/or the motion of the observed agent was biological. Sensorimotor mu suppression has been linked to the motor simulation aspect of action processing (and the human mirror neuron system, MNS), and frontal theta to semantic and memory-related aspects. For all three agents, action observation induced significant attenuation in the power of mu oscillations, with no difference between agents. Thus, mu suppression, considered an index of MNS activity, does not appear to be selective for biological agents. Observation of the Robot resulted in greater frontal theta activity compared to the Android and the Human, whereas the latter two did not differ from each other. Frontal theta thus appears to be sensitive to visual appearance, suggesting agents that are not sufficiently biological in appearance may result in greater memory processing demands for the observer. Studies combining robotics and neuroscience such as this one can allow us to explore neural basis of action processing on the one hand, and inform the design of social robots on the other.

Robots with display screens: a robot with a more humanlike face display is perceived to have more mind and a better personality

It is important for robot designers to know how to make robots that interact effectively with humans. One key dimension is robot appearance and in particular how humanlike the robot should be. Uncanny Valley theory suggests that robots look uncanny when their appearance approaches, but is not absolutely, human. An underlying mechanism may be that appearance affects users’ perceptions of the robot’s personality and mind. This study aimed to investigate how robot facial appearance affected perceptions of the robot’s mind, personality and eeriness. A repeated measures experiment was conducted. 30 participants (14 females and 16 males, mean age 22.5 years) interacted with a Peoplebot healthcare robot under three conditions in a randomized order: the robot had either a humanlike face, silver face, or no-face on its display screen. Each time, the robot assisted the participant to take his/her blood pressure. Participants rated the robot’s mind, personality, and eeriness in each condition. The robot with the humanlike face display was most preferred, rated as having most mind, being most humanlike, alive, sociable and amiable. The robot with the silver face display was least preferred, rated most eerie, moderate in mind, humanlikeness and amiability. The robot with the no-face display was rated least sociable and amiable. There was no difference in blood pressure readings between the robots with different face displays. Higher ratings of eeriness were related to impressions of the robot with the humanlike face display being less amiable, less sociable and less trustworthy. These results suggest that the more humanlike a healthcare robot’s face display is, the more people attribute mind and positive personality characteristics to it. Eeriness was related to negative impressions of the robot’s personality. Designers should be aware that the face on a robot’s display screen can affect both the perceived mind and personality of the robot.

Eye contrast polarity is critical for face recognition by infants

Just as faces share the same basic arrangement of features, with two eyes above a nose above a mouth, human eyes all share the same basic contrast polarity relations, with a sclera lighter than an iris and a pupil, and this is unique among primates. The current study examined whether this bright-dark relationship of sclera to iris plays a critical role in face recognition from early in development. Specifically, we tested face discrimination in 7- and 8-month-old infants while independently manipulating the contrast polarity of the eye region and of the rest of the face. This gave four face contrast polarity conditions: fully positive condition, fully negative condition, positive face with negated eyes ("negative eyes") condition, and negated face with positive eyes ("positive eyes") condition. In a familiarization and novelty preference procedure, we found that 7- and 8-month-olds could discriminate between faces only when the contrast polarity of the eyes was preserved (positive) and that this did not depend on the contrast polarity of the rest of the face. This demonstrates the critical role of eye contrast polarity for face recognition in 7- and 8-month-olds and is consistent with previous findings for adults.

Infants prefer the faces of strangers or mothers to morphed faces: an uncanny valley between social novelty and familiarity

The ‘uncanny valley’ response is a phenomenon involving the elicitation of a negative feeling and subsequent avoidant behaviour in human adults and infants as a result of viewing very realistic human-like robots or computer avatars. It is hypothesized that this uncanny feeling occurs because the realistic synthetic characters elicit the concept of ‘human’ but fail to satisfy it. Such violations of our normal expectations regarding social signals generate a feeling of unease. This conflict-induced uncanny valley between mutually exclusive categories (human and synthetic agent) raises a new question: could an uncanny feeling be elicited by other mutually exclusive categories, such as familiarity and novelty? Given that infants prefer both familiarity and novelty in social objects, we address this question as well as the associated developmental profile. Using the morphing technique and a preferential-looking paradigm, we demonstrated uncanny valley responses of infants to faces of mothers (i.e. familiarity) and strangers (i.e. novelty). Furthermore, this effect strengthened with the infant's age. We excluded the possibility that infants detect and avoid traces of morphing. This conclusion follows from our finding that the infants equally preferred strangers’ faces and the morphed faces of two strangers. These results indicate that an uncanny valley between familiarity and novelty may accentuate the categorical perception of familiar and novel objects.