The Eyes as Windows Into Other Minds

I help, therefore, I am? - A registered report on longitudinal inter-relations of the three-dimensional moral self-concept and prosocial behaviours in preschool children

Children's moral self-concept (MSC) has been proposed to relate to prosocial behaviour. However, systematic assessments of their inter-relations are scarce. Therefore, this longitudinal study investigated the development, structure and inter-relation of prosocial behaviours and the MSC in childhood, using three measurement points at ages 4, 5 and 6 years. We assessed children's MSC and helping, sharing and comforting behaviours in a laboratory setting. Confirmatory factor analyses revealed a three-dimensional MSC structure at 5 and 6 years, but not at 4 years. There was inconsistent stability across time points regarding prosocial behaviour and MSC. For the comforting domain, but not the other domains, cross-lagged relations between self-concept and behaviour were present. Moreover, helping behaviour and self-concept were inter-related at 6 years. Results provide support for reciprocal associations between MSC and prosocial behaviour, albeit only in the comforting domain. They highlight the importance of distinguishing between types of prosocial behaviour and corresponding dimensions of the self-concept, as different developmental trajectories and associations emerge.

The role of cognitive estimation in understanding the mental states of others

Previous studies have emphasized the critical role of the prefrontal cortex in cognitive estimation and theory of mind, however, none of them has questioned the possible role of cognitive estimation processes in understanding the mental states of others. In this study, we compared 30 patients with focal prefrontal cortex damage and 30 control subjects matched by gender, age, and education level on their performances on a cognitive estimation task and two tasks assessing theory of mind: the "Faux-Pas" task and the Reading the Mind in the Eyes task. The results showed that patients were significantly impaired compared with control subjects on both abilities of cognitive estimation and theory of mind. Moreover, regression analyses showed that performance on theory of mind was predicted by the scores on cognitive estimation. Finally, using voxel-based lesion analysis, we identified a partially common bilaterally distributed prefrontal network involved in both these domains centred within the ventral and dorsomedial areas with extension to the dorsolateral prefrontal cortex.

Sharing and Receiving Eye-Contact Predicts Mate Choice After a 5-Minute Conversation: Evidence from a Speed-Dating Study

In popular narratives, the first date with a potential mate often centers on their gaze as embodiment of interest and attraction. However, evidence is still lacking on the role of eye-contact as a potent signal in human social interaction in the context of dating. In addition, behavioral mechanisms of mate selection are not well understood. In the present study, we therefore examined mutual eye-contact and its influence on mate choice by applying dual mobile eye-tracking during naturalistic speed-dates. A total of 30 male and 30 female subjects attended four speed-dates each (N = 240). Subjects were more likely to choose those dating partners with whom they shared more eye-contact with. In addition, perceived attractiveness played an important role for mate choice. Interestingly, receiving but not giving eye-contact also predicted individual mate choice. Eye-contact thus acts as an important signal of romantic attraction when encountering a dating partner.

The effects of early rearing experiences on mutual eye gaze among captive olive baboons (Papio anubis)

Among human and nonhuman primates, mutual eye gaze (MEG) and gaze following are believed to be important for social cognition and communicative signaling. The goals of this study were to examine how early rearing experiences contribute to individual variation in MEG and to examine the potential role of genetic factors underlying this variation. Subjects included 93 female and 23 male baboons (Papio anubis) ranging from 3 to 20 years of age. Within the sample, there were 55 mother-reared (MR) and 61 nursery-reared (NR) baboons. MEG was assessed in four 60-s test sessions. For each session, the duration, frequency, and bout length were recorded. Mean values were then calculated for each individual from the four sessions. A multivariate analysis of covariance revealed an overall significant main effect for rearing. Subsequent univariate analyses revealed significant rearing effects on mean bout length, but not mean duration or mean frequency, with MR baboons having longer bout lengths compared to NR baboons. Furthermore, mean bout length was found to be significantly heritable. These results indicate that rearing experiences, and to a small extent, genetic factors, affect patterns of mutual eye gaze - in particular, bout length. These results differ from previous findings in MR and NR chimpanzees, further suggesting that rearing may impact MEG in a species-specific manner that reflects the function of gaze in different primate species.

Infants' responses to masked and unmasked smiling faces: A longitudinal investigation of social interaction during Covid-19

During the COVID-19 pandemic, face masks became an effective hygienic measure to reduce infection rates. Given the relevance of facial expressions for social interactions, the question arises how face masks affect early social interactions. The current longitudinal study investigated how covering parts of the face might impact infants' responses to others' emotional expressions. Infants who were born during the pandemic were examined at three measurement points at the age of 6, 10 and 14 months. After displaying a neutral facial expression an experimenter smiled at infants while either wearing a mask (mask condition) or not wearing a mask (no mask condition). Infants' change in affect (i.e., negative, neutral, positive) from the neutral to the test phase (i.e., smiling experimenter) was evaluated. Results showed that at 6 and at 10 months infants' behavior did not differ between conditions, whereas at 14 months infants were more likely to show a change from neutral/negative affect to positive affect in the no mask condition than in the mask condition. Moreover, at 14 months infants were less likely to respond positively to the experimenter's smile (across conditions) than at 6 and at 10 months. These findings broaden our understanding of potential effects of mask wearing on the development of face processing and affective communication. Overall, they indicate a developmental trend according to which infants' processing and response to others' positive emotions becomes more selective and differentiated with increasing age.

Prioritized Identification of Fearful Eyes during the Attentional Blink Is Not Automatic

The eye region conveys considerable information regarding an individual's emotions, motivations, and intentions during interpersonal communication. Evidence suggests that the eye regions of an individual expressing emotions can capture attention more rapidly than the eye regions of an individual in a neutral affective state. However, how attentional resources affect the processing of emotions conveyed by the eye regions remains unclear. Accordingly, the present study employed a dual-target rapid serial visual presentation task: happy, neutral, or fearful eye regions were presented as the second target, with a temporal lag between two targets of 232 or 696 ms. Participants completed two tasks successively: Task 1 was to identify which species the upright eye region they had seen belonged to, and Task 2 was to identify what emotion was conveyed in the upright eye region. The behavioral results showed that the accuracy for fearful eye regions was lower than that for neutral eye regions under the condition of limited attentional resources; however, accuracy differences across the three types of eye regions did not reach significance under the condition of adequate attentional resources. These findings indicate that preferential processing of fearful expressions is not automatic but is modulated by available attentional resources.

The moderating role of spirituality and gender in Canadian and Iranian emerging adolescents’ theory of mind and prosocial behavior

Introduction

While research has found a link between ToM and prosociality in terms of caring and helping others which may also vary across cultures, the moderating role of spirituality and culture of this association in emerging adolescence has received little attention.

Methods

The current study empirically “examined” the role of spirituality and gender in relation to ToM and prosocial behavior in Canadian and Iranian emerging adolescents. A total of 300 (153 girls) emerging adolescents (M = 11.502, SD = 2.228) were recruited from Montreal, Canada and Karaj, Iran. A series of double moderation analysis and ANOVA was conducted.

Results and discussion

Results indicated the difference between direct and indirect influences of ToM and its interactions with culture, gender, and spirituality on prosocial behavior. This implies an emerging complex framework which suggests the dynamic nonlinear interactions between these factors. Implications for youth’s social-emotional understanding will be discussed.

The Unique Cost of Human Eye Gaze in Cognitive Control: Being Human-Specific and Body-Related?

This study investigated the eye gaze cost in cognitive control and whether it is human-specific and body-related. In Experiment 1, we explored whether there was a cost of human eye gaze in cognitive control and extended it by focusing on the role of emotion in the cost. Stroop effect was found to be larger in eye-gaze condition than vertical grating condition, and to be comparable across positive, negative, and neutral trials. In Experiment 2, we explored whether the eye gaze cost in cognitive control was limited to human eyes. No larger Stroop effect was found in feline eye-gaze condition, neither the modulating role of emotion. In Experiment 3, we explored whether the mouth could elicit a cost in Stroop effect. Stroop effect was not significantly larger in mouth condition compared to vertical grating condition, nor across positive, negative, and neutral conditions. The results suggest that: (1) There is a robust cost of eye gaze in cognitive control; (2) Such eye-gaze cost was specific to human eyes but not to animal eyes; (3) Only human eyes could have such eye-gaze costs but not human mouth. This study supported the notion that presentation of social cues, such as human eyes, could influence attentional processing, and provided preliminary evidence that the human eye plays an important role in cognitive processing.

Infants infer third-party social dominance relationships based on visual access to intergroup conflict

During a conflict, having a greater number of allies than the opposition can improve one's success in a conflict. However, allies must be aware that has a conflict has occurred, and this is often influenced by what they are able to see. Here, we explored whether infants' assessment of social dominance is influenced by whether or not social allies have visual access to an episode of intergroup conflict. In Experiment 1, 9-12-month-olds only expected an agent to be socially dominant if their allies were able to witness the conflict. Experiment 2 provided further support for this finding, as infants did not expect an agent from a numerically larger group to be socially dominant when allies were unable to witness the conflict. Together, these results suggest that infants do not simply use a heuristic in which "numerically larger groups are always more dominant". Importantly, infants are able to incorporate social allies' ability to witness a conflict when predicting social dominance between groups.

Face-to-face contact during infancy: How the development of gaze to faces feeds into infants' vocabulary outcomes

Infants acquire their first words through interactions with social partners. In the first year of life, infants receive a high frequency of visual and auditory input from faces, making faces a potential strong social cue in facilitating word-to-world mappings. In this position paper, we review how and when infant gaze to faces is likely to support their subsequent vocabulary outcomes. We assess the relevance of infant gaze to faces selectively, in three domains: infant gaze to different features within a face (that is, eyes and mouth); then to faces (compared to objects); and finally to more socially relevant types of faces. We argue that infant gaze to faces could scaffold vocabulary construction, but its relevance may be impacted by the developmental level of the infant and the type of task with which they are presented. Gaze to faces proves relevant to vocabulary, as gazes to eyes could inform about the communicative nature of the situation or about the labeled object, while gazes to the mouth could improve word processing, all of which are key cues to highlighting word-to-world pairings. We also discover gaps in the literature regarding how infants' gazes to faces (versus objects) or to different types of faces relate to vocabulary outcomes. An important direction for future research will be to fill these gaps to better understand the social factors that influence infant vocabulary outcomes.

Wearing the face mask affects our social attention over space

Recent studies suggest that covering the face inhibits the recognition of identity and emotional expressions. However, it might also make the eyes more salient, since they are a reliable index to orient our social and spatial attention. This study investigates (1) whether the pervasive interaction with people with face masks fostered by the COVID-19 pandemic modulates the processing of spatial information essential to shift attention according to other’s eye-gaze direction (i.e., gaze-cueing effect: GCE), and (2) whether this potential modulation interacts with motor responses (i.e., Simon effect). Participants were presented with face cues orienting their gaze to a congruent or incongruent target letter location (gaze-cueing paradigm) while wearing a surgical mask (Mask), a patch (Control), or nothing (No-Mask). The task required to discriminate the identity of the lateralized target letters by pressing one of two lateralized response keys, in a corresponding or a non-corresponding position with respect to the target. Results showed that GCE was not modulated by the presence of the Mask, but it occurred in the No-Mask condition, confirming previous studies. Crucially, the GCE interacted with Simon effect in the Mask and Control conditions, though in different ways. While in the Mask condition the GCE emerged only when target and response positions corresponded (i.e., Simon-corresponding trials), in the Control condition it emerged only when they did not correspond (i.e., Simon-non-corresponding trials). These results indicate that people with face masks induce us to jointly orient our visual attention in the direction of the seen gaze (GCE) in those conditions resembling (or associated with) a general approaching behavior (Simon-corresponding trials). This is likely promoted by the fact that we tend to perceive wearing the mask as a personal safety measure and, thus, someone wearing the face mask is perceived as a trustworthy person. In contrast, people with a patch on their face can be perceived as more threatening, therefore inducing a GCE in those conditions associated with a general avoidance behavior (Simon-non-corresponding trials).

Multimodal explainable AI predicts upcoming speech behavior in adults who stutter

A key goal of cognitive neuroscience is to better understand how dynamic brain activity relates to behavior. Such dynamics, in terms of spatial and temporal patterns of brain activity, are directly measured with neurophysiological methods such as EEG, but can also be indirectly expressed by the body. Autonomic nervous system activity is the best-known example, but, muscles in the eyes and face can also index brain activity. Mostly parallel lines of artificial intelligence research show that EEG and facial muscles both encode information about emotion, pain, attention, and social interactions, among other topics. In this study, we examined adults who stutter (AWS) to understand the relations between dynamic brain and facial muscle activity and predictions about future behavior (fluent or stuttered speech). AWS can provide insight into brain-behavior dynamics because they naturally fluctuate between episodes of fluent and stuttered speech behavior. We focused on the period when speech preparation occurs, and used EEG and facial muscle activity measured from video to predict whether the upcoming speech would be fluent or stuttered. An explainable self-supervised multimodal architecture learned the temporal dynamics of both EEG and facial muscle movements during speech preparation in AWS, and predicted fluent or stuttered speech at 80.8% accuracy (chance=50%). Specific EEG and facial muscle signals distinguished fluent and stuttered trials, and systematically varied from early to late speech preparation time periods. The self-supervised architecture successfully identified multimodal activity that predicted upcoming behavior on a trial-by-trial basis. This approach could be applied to understanding the neural mechanisms driving variable behavior and symptoms in a wide range of neurological and psychiatric disorders. The combination of direct measures of neural activity and simple video data may be applied to developing technologies that estimate brain state from subtle bodily signals.

The effects of face coverings, own-ethnicity biases, and attitudes on emotion recognition

As a result of the COVID-19 pandemic, face coverings were introduced as a safety measure in certain environments in England and some research suggests that they can affect emotion recognition. Factors such as own-ethnicity bias (e.g. whether people perceiving and expressing emotions are of the same ethnicity) and social biases are also known to influence emotion recognition. However, it is unclear whether these factors interact with face coverings to affect emotion recognition. Therefore, this study examined the effects of face coverings, own-ethnicity biases, and attitudes on emotion recognition accuracy. In this study, 131 participants viewed masked and unmasked emotional faces varying in ethnicity and completed a questionnaire on their attitudes towards face masks. We found that emotion recognition was associated with masks and attitudes: accuracy was lower in masked than unmasked conditions and attitudes towards masks Inside and Outside were associated with emotion recognition. However, a match between perceiver and stimulus ethnicity did not have a significant effect on emotion recognition. Ultimately, our results suggest that masks, and negative attitudes towards them, were associated with poorer emotion recognition. Future research should explore different mask-wearing behaviours and possible in-group/out-group biases and their interaction with other social cues (e.g. in-group biases).

Processing third-party social interactions in the human infant brain

The understanding of developing social brain functions during infancy relies on research that has focused on studying how infants engage in first-person social interactions or view individual agents and their actions. Behavioral research suggests that observing and learning from third-party social interactions plays a foundational role in early social and moral development. However, the brain systems involved in observing third-party social interactions during infancy are unknown. The current study tested the hypothesis that brain systems in prefrontal and temporal cortex, previously identified in adults and children, begin to specialize in third-party social interaction processing during infancy. Infants (N = 62), ranging from 6 to 13 months in age, had their brain responses measured using functional near-infrared spectroscopy (fNIRS) while viewing third-party social interactions and two control conditions, infants viewing two individual actions and infants viewing inverted social interactions. The results show that infants preferentially engage brain regions localized within the dorsomedial prefrontal cortex when viewing third-party social interactions. These findings suggest that brain systems processing third-party social interaction begin to develop early in human ontogeny and may thus play a foundational role in supporting the interpretation of and learning from social interactions.

The human fear paradox: Affective origins of cooperative care

Already as infants humans are more fearful than our closest living primate relatives, the chimpanzees. Yet heightened fearfulness is mostly considered maladaptive, as it is thought to increase the risk of developing anxiety and depression. How can this human fear paradox be explained? The fearful ape hypothesis presented herein stipulates that, in the context of cooperative caregiving and provisioning unique to human great ape group life, heightened fearfulness was adaptive. This is because from early in ontogeny fearfulness expressed and perceived enhanced care-based responding and provisioning from, while concurrently increasing cooperation with, mothers and others. This explanation is based on a synthesis of existing research with human infants and children, demonstrating a link between fearfulness, greater sensitivity to and accuracy in detecting fear in others, and enhanced levels of cooperative behaviors. These insights critically advance current evolutionary theories of human cooperation by adding an early-developing affective component to the human cooperative makeup. Moreover, the current proposal has important cultural, societal, and health implications, as it challenges the predominant view in Western, educated, industrialized, rich, and democratic (WEIRD) societies that commonly construe fearfulness as a maladaptive trait, potentially ignoring its evolutionary adaptive functions.

Cephalopod Behavior: From Neural Plasticity to Consciousness

It is only in recent decades that subjective experience - or consciousness - has become a legitimate object of scientific inquiry. As such, it represents perhaps the greatest challenge facing neuroscience today. Subsumed within this challenge is the study of subjective experience in non-human animals: a particularly difficult endeavor that becomes even more so, as one crosses the great evolutionary divide between vertebrate and invertebrate phyla. Here, we explore the possibility of consciousness in one group of invertebrates: cephalopod molluscs. We believe such a review is timely, particularly considering cephalopods' impressive learning and memory abilities, rich behavioral repertoire, and the relative complexity of their nervous systems and sensory capabilities. Indeed, in some cephalopods, these abilities are so sophisticated that they are comparable to those of some higher vertebrates. Following the criteria and framework outlined for the identification of hallmarks of consciousness in non-mammalian species, here we propose that cephalopods - particularly the octopus - provide a unique test case among invertebrates for examining the properties and conditions that, at the very least, afford a basal faculty of consciousness. These include, among others: (i) discriminatory and anticipatory behaviors indicating a strong link between perception and memory recall; (ii) the presence of neural substrates representing functional analogs of thalamus and cortex; (iii) the neurophysiological dynamics resembling the functional signatures of conscious states in mammals. We highlight the current lack of evidence as well as potentially informative areas that warrant further investigation to support the view expressed here. Finally, we identify future research directions for the study of consciousness in these tantalizing animals.

Early lifetime experience of urban living predicts social attention in real world crowds

More than half of the world's population is currently living in cities, with more and more people moving to densely populated areas. The experience of growing up and living in crowded environments might influence the way we explore our social environment, mainly how we attend to others. Yet, we know little about how urbanicity affects this vital function of our social life. In two studies, we use mobile eye-tracking to measure participants' social attention, while walking through a shopping mall. Results show that social density of participants' native place impacts how frequently they look at passing strangers. People who experienced more city living from birth to early adolescence, attend more to strangers' faces than their rural counterparts. Our findings demonstrate that the early experience of urban upbringing configures social attention in adulthood. The urbanicity-related bias towards social gazing might reflect a more efficient processing of social information in urban natives.

An EEG-Based Investigation of the Effect of Perceived Observation on Visual Memory in Virtual Environments

The presence of external observers has been shown to affect performance on cognitive tasks, but the parameters of this impact for different types of tasks and the underlying neural dynamics are less understood. The current study examined the behavioral and brain activity effects of perceived observation on participants’ visual working memory (VWM) in a virtual reality (VR) classroom setting, using the task format as a moderating variable. Participants (n = 21) were equipped with a 57-channel EEG cap, and neural data were collected as they completed two VWM tasks under two observation conditions (observed and not observed) in a within-subjects experimental design. The “observation” condition was operationalized through the addition of a static human avatar in the VR classroom. The avatar’s presence was associated with a significant effect on extending the task response time, but no effect was found on task accuracy. This outcome may have been due to a ceiling effect, as the mean participant task scores were quite high. EEG data analysis supported the behavioral findings by showing consistent differences between the no-observation and observation conditions for one of the VWM tasks only. These neural differences were identified in the dorsolateral prefrontal cortex (dlPFC) and the occipital cortex (OC) regions, with higher theta-band activity occurring in the dlPFC during stimulus encoding and in the OC during response selection when the “observing” avatar was present. These findings provide evidence that perceived observation can inhibit performance during visual tasks by altering attentional focus, even in virtual contexts.

Eye Size Affects Cuteness in Different Facial Expressions and Ages

Researchers have suggested that infants exhibiting baby schema are considered cute. These similar studies have mainly focused on changes in overall baby schema facial features. However, whether a change in only eye size affects the perception of cuteness across different facial expressions and ages has not been explicitly evaluated until now. In the present study, a paired comparison method and 7-point scale were used to investigate the effects of eye size on perceived cuteness across facial expressions (positive, neutral, and negative) and ages (adults and infants). The results show that stimuli with large eyes were perceived to be cuter than both unmanipulated eyes and small eyes across all facial expressions and age groups. This suggests not only that the effect of baby schema on cuteness is based on changes in a set of features but also that eye size as an individual feature can affect the perception of cuteness.

Human face and gaze perception is highly context specific and involves bottom-up and top-down neural processing

This review summarizes human perception and processing of face and gaze signals. Face and gaze signals are important means of non-verbal social communication. The review highlights that: (1) some evidence is available suggesting that the perception and processing of facial information starts in the prenatal period; (2) the perception and processing of face identity, expression and gaze direction is highly context specific, the effect of race and culture being a case in point. Culture affects by means of experiential shaping and social categorization the way in which information on face and gaze is collected and perceived; (3) face and gaze processing occurs in the so-called 'social brain'. Accumulating evidence suggests that the processing of facial identity, facial emotional expression and gaze involves two parallel and interacting pathways: a fast and crude subcortical route and a slower cortical pathway. The flow of information is bi-directional and includes bottom-up and top-down processing. The cortical networks particularly include the fusiform gyrus, superior temporal sulcus (STS), intraparietal sulcus, temporoparietal junction and medial prefrontal cortex.

Insights into the uniquely human origins of understanding other minds

We summarize research and theory to show that, from early in human ontogeny, much information about other minds can be gleaned from reading the eyes. This analysis suggests that eyes serve as uniquely human windows into other minds, which critically extends the target article by drawing attention to what might be considered the neurodevelopmental origins of knowledge attribution in humans.

Impaired social perception from eyes and face visual cues: evidence from prefrontal cortex damage

Despite the key role that decoding of social-perceptual cues from faces plays in interpersonal communication, it is only recently that the potential of prefrontal cortex damage to disrupt this ability has been recognized. In fact, few studies to date had assessed whether the ability to identify the state of mind of others from the whole or part of the face is disrupted after prefrontal cortex damage and whether these two abilities are associated and share overlapped neural systems. In the present study, 30 patients with focal prefrontal lesions and 30 matched control subjects were assessed on their ability to recognize six basic emotions from facial expressions of the whole face and to identify states of mind of others from photographs of only the eyes using the "Reading the Mind in the Eyes Task". Results showed that frontal patients were significantly impaired compared with control subjects on both tasks. Moreover, regression analyses showed that these two abilities are associated and reciprocally predictive of one another. Finally, using voxel-based lesion analysis; we identified a partially common bilaterally distributed prefrontal network in the decoding of both emotional cues from both the whole face and eyes centered within the dorsomedial and ventral regions with extension to the lateral frontal pole.

Genetic variation in the oxytocin system and its link to social motivation in human infants

Frontal brain asymmetry has been linked to motivational processes in infants and adults, with left lateralization reflecting motivation to approach and right lateralization reflecting motivation to withdraw. We examined the hypothesis that variability in infants' social motivation may be linked to genetic variation in the oxytocin system. Eleven-month-old infants' brain responses and looking preferences to smiling and frowning individuals were assessed in conjunction with a polymorphism in CD38 (rs3796863) linked to autism spectrum disorder (ASD) and reduced oxytocin. Frontal brain asymmetry and looking preferences differed as a function of CD38 genotype. While non-risk A-allele carriers displayed left lateralization to smiling faces (approach) and a heightened looking preference for the individual who smiled, infants with the CC (ASD risk) genotype displayed withdrawal from smiling faces and a preference for the individual who frowned. Findings demonstrate that the oxytocin system is linked to brain and behavioral markers of social motivation in infancy.

Temporal Behavioral Parameters of On-Going Gaze Encounters in a Virtual Environment

To navigate the social world, humans heavily rely on gaze for non-verbal communication as it conveys information in a highly dynamic and complex, yet concise manner: For instance, humans utilize gaze effortlessly to direct and infer the attention of a possible interaction partner. Many traditional paradigms in social gaze research though rely on static ways of assessing gaze interaction, e.g., by using images or prerecorded videos as stimulus material. Emerging gaze contingent paradigms, in which algorithmically controlled virtual characters can respond flexibly to the gaze behavior of humans, provide high ecological validity. Ideally, these are based on models of human behavior which allow for precise, parameterized characterization of behavior, and should include variable interactive settings and different communicative states of the interacting agents. The present study provides a complete definition and empirical description of a behavioral parameter space of human gaze behavior in extended gaze encounters. To this end, we (i) modeled a shared 2D virtual environment on a computer screen in which a human could interact via gaze with an agent and simultaneously presented objects to create instances of joint attention and (ii) determined quantitatively the free model parameters (temporal and probabilistic) of behavior within this environment to provide a first complete, detailed description of the behavioral parameter space governing joint attention. This knowledge is essential to enable the modeling of interacting agents with a high degree of ecological validity, be it for cognitive studies or applications in human-robot interaction.

Sharing Experiences in Infancy: From Primary Intersubjectivity to Shared Intentionality

We contrast two theses that make different assumptions about the developmental onset of human-unique sociality. The primary intersubjectivity thesis (PIT) argues that humans relate to each other in distinct ways from the beginning of life, as is shown by newborns' participation in face-to-face encounters or "primary intersubjectivity." According to this thesis, humans' innate relational capacity is the seedbed from which all subsequent social-emotional and social-cognitive developments continuously emerge. The shared intentionality thesis (SIT) states that human-unique forms of interaction develop at 9-12 months of age, when infants put their heads together with others in acts of object-focused joint attention and simple collaborative activities. According to this thesis, human-unique cognition emerges rapidly with the advent of mind-reading capacities that evolved specifically for the purpose of coordination. In this paper, we first contrast the two theses and then sketch the outlines of an account that unifies their strengths. This unified account endorses the PIT's recognition of the fundamental importance of primary intersubjectivity. Any act of sharing experiences is founded on the communicative capacity that is already displayed by young infants in primary intersubjectivity. At the same time, we question the PIT's interpretation that dyadic encounters have the triadic structure of joint attention. Lastly, we draw on empirical work on the development of joint attention, imitation, and social referencing that serves as evidence that primary intersubjectivity continuously unfolds into the capacity for triadic joint attention.

Differences in the mutual eye gaze of bonobos (Pan paniscus) and chimpanzees (Pan troglodytes)

Eye gaze is widespread in nonhuman primate taxa and important for social cognition and communicative signaling. Bonobos and chimpanzees, two closely related primate species, differ in social organization, behavior, and cognition. Chimpanzees' eye gaze and gaze following has been studied extensively, whereas less is known about bonobos' eye gaze. To examine species differences using a more ecologically relevant measure than videos or pictures, the current study compared bonobo and chimpanzee mutual eye gaze with a human observer. A multivariate analysis of variance revealed significant species differences in frequency and total duration, but not bout length, of mutual eye gaze (p < .001). Specifically, bonobos engage in mutual eye gaze more frequently and for longer total duration than chimpanzees. These results are likely related to species differences in social behavior and temperament and are consistent with eye-tracking studies in which bonobos looked at the eye region of conspecifics (in pictures and videos) longer than chimpanzees. Future research should examine the relationship between mutual eye gaze and gaze following, as well as examine its genetic and neurological correlates. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Attention Deployment to the Eye Region of Emotional Faces among Adolescents with and without Social Anxiety Disorder

BACKGROUND

Avoidance of the eye region, especially of faces showing anger, may maintain social anxiety symptoms by negatively reinforcing expectations and fears associated with social situations. Eye-tracking research, however, has yet to explicitly examine differences in attention allocation to the eye region of emotional faces among adolescents with social anxiety disorder (SAD).

METHODS

Gaze patterns were explored in a sample of youth with and without SAD matched on age and sex.

RESULTS

Adolescents with SAD were quicker to fixate, and maintained their initial gaze longer, to the eye region, regardless of emotion, relative to teens without SAD. Group-level differences also emerged for initial fixation duration directed to the eye region of angry faces (when compared with happy faces).

CONCLUSIONS

These findings suggest that vigilance to the eye region of faces, especially angry faces, (when compared with happy faces) is characteristic of adolescents with SAD. Adolescents with SAD seem drawn to the eye region, more so than teens without SAD.

Sclera color in humans facilitates gaze perception during daytime and nighttime

Species vary widely in the conspicuousness of their eye morphology and this could influence gaze perception. Eyes with conspicuous morphology can enhance gaze perception while eyes with camouflaged morphology may hinder gaze perception. While evidence suggests that conspicuous eye morphology enhances gaze perception, little is known about how environmental conditions affect this interaction. Thus, we investigated whether environmental light conditions affect gaze perception. Human subjects (Homo sapiens) were instructed to find direct-gaze faces within arrays of averted-gaze faces or to find averted-gaze faces within arrays of directed-gaze faces. The faces were displayed under conditions simulating nighttime or daytime conditions. Furthermore, the faces had naturally-colored sclera (white) or modified sclera (same color as the iris). Participants were fastest and most accurate in detecting faces during the daytime and nighttime conditions when the sclera were naturally-colored. Participants were worst at detecting faces with modified sclera during the nighttime conditions. These results suggest that eyes with conspicuous morphology enhance gaze perception during both daytime and nighttime conditions.

Probing infants' sensitivity to pupil size when viewing eyes

Sensitive responding to eye cues plays a key role in human social interactions. Pupil size provides subtle cues regarding a social interaction partner's arousal states. The current study assessed infants' sensitivity to and preference for differences in pupil size. Specifically, we examined White 14-month-old infants' pupillary responses when viewing own-race and other-race (Asian) eyes with dilating, constricting, and static medium-sized pupils. Our results show that, independent of race, infants' pupils dilated more when viewing eyes with dynamically changing (dilating and constricting) pupils than when viewing eyes with non-changing, static, and medium-sized pupils. We also measured infants' looking preferences, showing that, independent of race, infants preferentially attended to eyes with dilated pupils. Moreover, our results show that infants orient more quickly to pupillary changes in own-race eyes than in other-race eyes. These findings demonstrate that infants detect, but do not mimic, changes in pupil size in others and show a preference for eyes with dilated pupils.

Children's emotion inferences from masked faces: Implications for social interactions during COVID-19

To slow the progression of COVID-19, the Centers for Disease Control (CDC) and the World Health Organization (WHO) have recommended wearing face coverings. However, very little is known about how occluding parts of the face might impact the emotion inferences that children make during social interactions. The current study recruited a racially diverse sample of school-aged (7- to 13-years) children from publicly funded after-school programs. Children made inferences from facial configurations that were not covered, wearing sunglasses to occlude the eyes, or wearing surgical masks to occlude the mouth. Children were still able to make accurate inferences about emotions, even when parts of the faces were covered. These data suggest that while there may be some challenges for children incurred by others wearing masks, in combination with other contextual cues, masks are unlikely to dramatically impair children's social interactions in their everyday lives.

How We Perceive Others Resembling Us

Eye contact is essential for social cognition, acting as an important tool for social communication. While differences in face scanning patterns concerning familiarity have been thoroughly investigated, the impact of facial similarity on gaze behavior has not been examined yet. We addressed this topic by recording subjects' eye-directed gazing while looking at faces that were individually created systematically varying in terms of similarity to the self-face and familiarity. Subjects' self-faces were morphed into three other faces including a close friend of the same sex. Afterwards, they rated similarity to their self-face of those morphed face stimuli in a separate rating task. Our results show a general preference for the eyes' area as well as differences regarding fixation patterns depending on similarity to the self-face. The lower the similarity to the self-face, the more fixations on the eyes' area. Subjects' ratings followed a linear line, indicating well-pronounced face perception. Nevertheless, other faces were rated faster than the self-face independent of familiarity, while morphed faces got the slowest ratings. Our results mirror the importance of similarity to the self-face as a factor shaping the way we look at the eyes of others explaining variance apart from familiarity.

In the Blink of an Eye: Reading Mental States From Briefly Presented Eye Regions

Faces provide not only cues to an individual’s identity, age, gender, and ethnicity but also insight into their mental states. The aim was to investigate the temporal aspects of processing of facial expressions of complex mental states for very short presentation times ranging from 12.5 to 100 ms in a four-alternative forced choice paradigm based on Reading the Mind in the Eyes test. Results show that participants are able to recognise very subtle differences between facial expressions; performance is better than chance, even for the shortest presentation time. Importantly, we show for the first time that observers can recognise these expressions based on information contained in the eye region only. These results support the hypothesis that the eye region plays a particularly important role in social interactions and that the expressions in the eyes are a rich source of information about other peoples’ mental states. When asked to what extent the observers guessed during the task, they significantly underestimated their ability to make correct decisions, yet perform better than chance, even for very brief presentation times. These results are particularly relevant in the light of the current COVID-19 pandemic and the associated wearing of face coverings.

How does gaze to faces support face-to-face interaction? A review and perspective

Gaze-where one looks, how long, and when-plays an essential part in human social behavior. While many aspects of social gaze have been reviewed, there is no comprehensive review or theoretical framework that describes how gaze to faces supports face-to-face interaction. In this review, I address the following questions: (1) When does gaze need to be allocated to a particular region of a face in order to provide the relevant information for successful interaction; (2) How do humans look at other people, and faces in particular, regardless of whether gaze needs to be directed at a particular region to acquire the relevant visual information; (3) How does gaze support the regulation of interaction? The work reviewed spans psychophysical research, observational research, and eye-tracking research in both lab-based and interactive contexts. Based on the literature overview, I sketch a framework for future research based on dynamic systems theory. The framework holds that gaze should be investigated in relation to sub-states of the interaction, encompassing sub-states of the interactors, the content of the interaction as well as the interactive context. The relevant sub-states for understanding gaze in interaction vary over different timescales from microgenesis to ontogenesis and phylogenesis. The framework has important implications for vision science, psychopathology, developmental science, and social robotics.

Oxytocin enhances the recovery of eye-contact induced autonomic arousal: A treatment mechanism study with placebo-controlled design

The neuropeptide oxytocin (OT) is suggested to exert a pivotal role in a variety of complex human behaviors, including trust, attachment, social perception and fear regulation. Previous studies have demonstrated that intranasal administration of OT reduces subjective and neuroendocrine stress responses and dampens amygdala reactivity. OT has also been proposed to modulate activity of the autonomic nervous system. Here, a randomized double-blind, placebo-controlled study (with parallel design) was conducted with 56 healthy adult men to investigate whether a single-dose of OT (24 IU) modulates sympathetic autonomic arousal upon live dyadic gaze interactions. To do so, electrodermal recordings of skin conductance were performed during the engagement of eye contact with a live model in a two-person social context. In accordance to prior research, direct eye gaze elicited a significant enhancement in skin conductance responses, but OT did not specifically enhance or dampen the overall magnitude (amplitude) of the skin conductance response. Administration of OT did facilitate the recovery of skin conductance responses back to baseline (reduced recovery time), indicating a role of OT in restoring homeostatic balance. Notably, the treatment-effect on autonomic recovery was most prominent in participants with low self-reported social responsiveness, indicating that person-dependent factors play an important role in determining OT treatment-responses. Exploratory, it was shown that OT also significantly reduced self-reported feelings of tension and (at trend-level) worrying about how one presents oneself. Together, these observations add further evidence to a role of OT in modulating activity of the autonomic nervous system, primarily by facilitating a restoration of homeostatic balance after stimulus-induced increases in sympathetically-driven autonomic arousal.

Impression Formation in the Human Infant Brain

Forming an impression of another person is an essential aspect of human social cognition linked to medial prefrontal cortex (mPFC) function in adults. The current study examined the neurodevelopmental origins of impression formation by testing the hypothesis that infants rely on processes localized in mPFC when forming impressions about individuals who appear friendly or threatening. Infants’ brain responses were measured using functional near-infrared spectroscopy while watching 4 different face identities displaying either smiles or frowns directed toward or away from them (N = 77). This was followed by a looking preference test for these face identities (now displaying a neutral expression) using eyetracking. Our results show that infants’ mPFC responses distinguish between smiling and frowning faces when directed at them and that these responses predicted their subsequent person preferences. This suggests that the mPFC is involved in impression formation in human infants, attesting to the early ontogenetic emergence of brain systems supporting person perception and adaptive behavior.

"Parental" responses to human infants (and puppy dogs): Evidence that the perception of eyes is especially influential, but eye contact is not

The present investigation tests: (i) whether the perception of an human infant’s eyes, relative to other facial features, especially strongly elicits “parental” responses (e.g., appraisals of cuteness and vulnerability); (ii) if, so, whether effects of the visual perception of eyes may be partially attributable to eye contact; (iii) whether the perception of non-human animals’ (puppy dogs’) eyes also especially strongly influence appraisals of their cuteness and vulnerability; and (iv) whether individual differences in caregiving motives moderate effects. Results from 5 experiments (total N = 1458 parents and non-parents) provided empirical evidence to evaluate these hypotheses: Appraisals of human infants were influenced especially strongly by the visual perception of human infants’ eyes (compared to other facial features); these effects do not appear to be attributable to eye contact; the visual perception of eyes influenced appraisals of puppy dogs, but not exactly in the same way that it influenced appraisals of human infants; and there was no consistent evidence of moderation by individual differences in caregiving motives. These results make novel contributions to several psychological literatures, including literatures on the motivational psychology of parental care and on person perception.

The role of early social rearing, neurological, and genetic factors on individual differences in mutual eye gaze among captive chimpanzees

Mutual eye gaze plays an important role in primate social development and communication. In the current study, we examined the underlying experiential, genetic, and neuroanatomical basis of mutual eye gaze variation in adult captive chimpanzees. A multivariate analysis of variance revealed a significant rearing effect on bout length, with human-reared chimpanzees engaging in longer bouts of mutual gaze compared to mother-reared and wild-born individuals. Next, we utilized source-based morphometry (SBM) to examine gray matter covariation in magnetic resonance imaging scans and determine the relationship between the resulting gray matter covariation components and mutual eye gaze. One SBM component was negatively correlated with gaze duration (nucleus accumbens and anterior insular cortex), while two components were positively correlated with bout length (posterior cingulate cortex, inferior occipital cortex, middle temporal cortex, hippocampus, and the precentral sulcus). Finally, heritability analyses revealed mutual eye gaze to be modestly heritable and significant genetic correlations between bout length and two gray matter covariation components. This study reveals that non-genetic factors, and to a lesser extent, genetic factors appear to influence mutual eye gaze in adult chimpanzees, and is the first to report neuroanatomical correlates of mutual eye gaze variation in chimpanzees.

The Measurement of Eye Contact in Human Interactions: A Scoping Review

Eye contact is a fundamental aspect of nonverbal communication and therefore important for understanding human interaction. Eye contact has been the subject of research in many disciplines, including communication sciences, social psychology, and psychiatry, and a variety of techniques have been used to measure it. The choice of measurement method has consequences for research outcomes and their interpretation. To ensure that research findings align with study aims and populations, it is essential that methodological choices are well substantiated. Therefore, to enhance the effective examination of eye contact, we performed a literature review of the methods used to study eye contact. We searched Medline, PsycINFO and Web of Science for empirical peer-reviewed articles published in English that described quantitative studies on human eye contact and included a methodological description. The identified studies (N = 109) used two approaches to assess eye contact: direct, i.e., assessing eye contact while it is occurring, and indirect, i.e., assessing eye contact retrospectively (e.g., from video recordings). Within these categories, eight specific techniques were distinguished. Variation was found regarding the reciprocity of eye contact between two individuals, the involvement of an assessor and the behavior of participants while being studied. Measures not involving the interactors in assessment of eye contact and have a higher spatial and temporal resolution, such as eye tracking, have gained popularity. Our results show wide methodological diversity regarding the measurement of eye contact. Although studies often define eye contact as gaze towards an exact location, this may not do justice to the subjective character of eye contact. The various methodologies have hardly ever been compared, limiting the ability to compare findings between studies. Future studies should take notice of the controversy surrounding eye contact measures.

Sclera color enhances gaze perception in humans

Gaze perception is an essential behavior that allows individuals to determine where others are directing their attention but we know relatively little about the ways in which eye morphology influences it. We therefore tested whether eyes with conspicuous morphology have evolved to facilitate gaze perception. During a visual search task, we recorded the eye movements of human participants (Homo sapiens) as they searched for faces with directed gaze within arrays of faces with averted gaze or the reverse; the faces were large and upright, small and upright, or large and inverted. The faces had sclera that were conspicuous (white or colored lighter than the iris color) or inconspicuous (colored the same or darker than the iris color). We found that participants were fastest and most accurate in finding the faces with conspicuous sclera versus inconspicuous sclera. Our results demonstrate that eyes with conspicuous morphology facilitate gaze perception in humans.

Intentionally distracting: Working memory is disrupted by the perception of other agents attending to you - even without eye-gaze cues

Of all the visual stimuli you can perceive, perhaps the most important are other people's eyes. And this is especially true when those eyes are looking at you: direct gaze has profound influences, even at the level of basic cognitive processes such as working memory. For example, memory for the properties of simple geometric shapes is disrupted by the presence of other eyes gazing at you. But are such effects really specific to direct gaze per se? Seeing eyes is undoubtedly important, but presumably only because of what it tells us about the "mind behind the eyes" - i.e., about others' attention and intentions. This suggests that the same effects might arise even without eyes, as long as an agent's directed attention is conveyed by other means. Here we tested the impact on working memory of simple "mouth" shapes - which in no way resemble eyes, yet can still be readily seen as intentionally facing you (or not). Just as with gaze cues, the ability to detect changes in geometric shapes was impaired by direct (compared to averted) mouths - but not in very similar control stimuli that were not perceived as intentional. We conclude that this disruption of working memory reflects a general phenomenon of "mind contact," rather than a specific effect of eye contact.

Attachment styles have a modulatory impact on psychophysiological arousal evoked by reciprocated and unreciprocated gaze

Gaze processing plays an essential role during social interactions. Here, it was investigated whether variations in attachment style (secure, anxious and avoidant) were associated with differential expressions of sympathetic autonomic arousal upon live dyadic gaze interactions. To do so, 47 participants were presented with either reciprocated or unreciprocated eye gaze from a live model and skin conductance responses (SCRs) were collected. In line with previous observations, SCRs and subjective ratings of arousal were higher in response to reciprocated, compared to unreciprocated gaze. In terms of the modulation by attachment style, it was shown that participants with low attachment security and high attachment avoidance displayed overall higher sympathetic arousal upon the presentation of the live dyadic gaze cues, irrespective of whether the observed model showed reciprocal or unreciprocated gaze. Together, these observations indicate that attachment styles have a modulatory effect on individuals' psychophysiological responses to dyadic gaze interactions.

Face detection in 2- to 6-month-old infants is influenced by gaze direction and species

Humans detect faces efficiently from a young age. Face detection is critical for infants to identify and learn from relevant social stimuli in their environments. Faces with eye contact are an especially salient stimulus, and attention to the eyes in infancy is linked to the emergence of later sociality. Despite the importance of both of these early social skills-attending to faces and attending to the eyes-surprisingly little is known about how they interact. We used eye tracking to explore whether eye contact influences infants' face detection. Longitudinally, we examined 2-, 4-, and 6-month-olds' (N = 65) visual scanning of complex image arrays with human and animal faces varying in eye contact and head orientation. Across all ages, infants displayed superior detection of faces with eye contact; however, this effect varied as a function of species and head orientation. Infants were more attentive to human than animal faces and were more sensitive to eye and head orientation for human faces compared to animal faces. Unexpectedly, human faces with both averted heads and eyes received the most attention. This pattern may reflect the early emergence of gaze following-the ability to look where another individual looks-which begins to develop around this age. Infants may be especially interested in averted gaze faces, providing early scaffolding for joint attention. This study represents the first investigation to document infants' attention patterns to faces systematically varying in their attentional states. Together, these findings suggest that infants develop early, specialized functional conspecific face detection.

Inferring Interactivity From Gaze Patterns During Triadic Person-Object-Agent Interactions

Observing others' gaze informs us about relevant matters in the environment. Humans' sensitivity to gaze cues and our ability to use this information to focus our own attention is crucial to learning, social coordination, and survival. Gaze can also be a deliberate social signal which captures and directs the gaze of others toward an object of interest. In the current study, we investigated whether the intention to actively communicate one's own attentional focus can be inferred from the dynamics of gaze alone. We used a triadic gaze interaction paradigm based on the recently proposed classification of attentional states and respective gaze patterns in person-object-person interactions, the so-called "social gaze space (SGS)." Twenty-eight participants interacted with a computer controlled virtual agent while they assumed to interact with a real human. During the experiment, the virtual agent engaged in various gaze patterns which were determined by the agent's attentional communicative state, as described by the concept of SGS. After each interaction, participants were asked to judge whether the other person was trying to deliberately interact with them. Results show that participants were able to infer the communicative intention solely from the agent's gaze behavior. The results substantiate claims about the pivotal role of gaze in social coordination and relationship formation. Our results further reveal that social expectations are reflected in differential responses to the displayed gaze patterns and may be crucial for impression formation during gaze-based interaction. To the best of our knowledge, this is the first study to document the experience of interactivity in continuous and contingent triadic gaze interactions.