Universality Reconsidered: Diversity in Making Meaning of Facial Expressions

Application of Stereo Digital Image Correlation on Facial Expressions Sensing

Facial expression is an important way to reflect human emotions and it represents a dynamic deformation process. Analyzing facial movements is an effective means of understanding expressions. However, there is currently a lack of methods capable of analyzing the dynamic details of full-field deformation in expressions. In this paper, in order to enable effective dynamic analysis of expressions, a classic optical measuring method called stereo digital image correlation (stereo-DIC or 3D-DIC) is employed to analyze the deformation fields of facial expressions. The forming processes of six basic facial expressions of certain experimental subjects are analyzed through the displacement and strain fields calculated by 3D-DIC. The displacement fields of each expression exhibit strong consistency with the action units (AUs) defined by the classical Facial Action Coding System (FACS). Moreover, it is shown that the gradient of the displacement, i.e., the strain fields, offers special advantages in characterizing facial expressions due to their localized nature, effectively sensing the nuanced dynamics of facial movements. By processing extensive data, this study demonstrates two featured regions in six basic expressions, one where deformation begins and the other where deformation is most severe. Based on these two regions, the temporal evolutions of the six basic expressions are discussed. The presented investigations demonstrate the superior performance of 3D-DIC in the quantitative analysis of facial expressions. The proposed analytical strategy might have potential value in objectively characterizing human expressions based on quantitative measurement.

The Sound of Emotional Prosody: Nearly 3 Decades of Research and Future Directions

Emotional voices attract considerable attention. A search on any browser using "emotional prosody" as a key phrase leads to more than a million entries. Such interest is evident in the scientific literature as well; readers are reminded in the introductory paragraphs of countless articles of the great importance of prosody and that listeners easily infer the emotional state of speakers through acoustic information. However, despite decades of research on this topic and important achievements, the mapping between acoustics and emotional states is still unclear. In this article, we chart the rich literature on emotional prosody for both newcomers to the field and researchers seeking updates. We also summarize problems revealed by a sample of the literature of the last decades and propose concrete research directions for addressing them, ultimately to satisfy the need for more mechanistic knowledge of emotional prosody.

Facial Expression Recognition of Emotional Situations in Mild and Moderate Alzheimer's Disease

Background: Recognizing emotional situations may be impaired in people with Alzheimer's disease (AD). Purpose: We examined differences in the comprehension of an emotional situation in healthy older controls (HOC) and individuals with mild and moderate AD. Research Design: cross-sectional study. Study Sample: We assessed a convenience sample of 115 participants in 3 contexts: understanding the situation, ability to name the congruent emotion, and choice of the correct face in 4 emotional situations (sadness, surprise, anger, happiness). Data Colection: Chi-square and Mann-Whitney U tests were used for comparison between groups separated by CDR 1 and 2. Chi-square and Kruskal-Wallis tests were also used for comparison between groups separated by CDR 0, 1, and 2, with a pairwise comparisons analysis. Results: We found that the ability to understand, name, and choose the proper emotion is not linked and depends on the portrayed emotion. Conclusions: The findings suggest an interaction between emotional processing and cognitive functioning. Therefore, knowledge of an emotional condition and the connection to a specific facial choice most likely involve 2 degraded areas of knowledge, resulting in even higher odds of inaccuracy.

What We Can Learn About Emotion by Talking With the Hadza

Emotions are often thought of as internal mental states centering on individuals' subjective feelings and evaluations. This understanding is consistent with studies of emotion narratives, or the descriptions people give for experienced events that they regard as emotions. Yet these studies, and contemporary psychology more generally, often rely on observations of educated Europeans and European Americans, constraining psychological theory and methods. In this article, we present observations from an inductive, qualitative analysis of interviews conducted with the Hadza, a community of small-scale hunter-gatherers in Tanzania, and juxtapose them with a set of interviews conducted with Americans from North Carolina. Although North Carolina event descriptions largely conformed to the assumptions of eurocentric psychological theory, Hadza descriptions foregrounded action and bodily sensations, the physical environment, immediate needs, and the experiences of social others. These observations suggest that subjective feelings and internal mental states may not be the organizing principle of emotion the world around. Qualitative analysis of emotion narratives from outside of a U.S. (and western) cultural context has the potential to uncover additional diversity in meaning-making, offering a descriptive foundation on which to build a more robust and inclusive science of emotion.

Four Misconceptions About Nonverbal Communication

Research and theory in nonverbal communication have made great advances toward understanding the patterns and functions of nonverbal behavior in social settings. Progress has been hindered, we argue, by presumptions about nonverbal behavior that follow from both received wisdom and faulty evidence. In this article, we document four persistent misconceptions about nonverbal communication-namely, that people communicate using decodable body language; that they have a stable personal space by which they regulate contact with others; that they express emotion using universal, evolved, iconic, categorical facial expressions; and that they can deceive and detect deception, using dependable telltale clues. We show how these misconceptions permeate research as well as the practices of popular behavior experts, with consequences that extend from intimate relationships to the boardroom and courtroom and even to the arena of international security. Notwithstanding these misconceptions, existing frameworks of nonverbal communication are being challenged by more comprehensive systems approaches and by virtual technologies that ambiguate the roles and identities of interactants and the contexts of interaction.

Pain E-motion Faces Database (PEMF): Pain-related micro-clips for emotion research

A large number of publications have focused on the study of pain expressions. Despite the growing knowledge, the availability of pain-related face databases is still very scarce compared with other emotional facial expressions. The Pain E-Motion Faces Database (PEMF) is a new open-access database currently consisting of 272 micro-clips of 68 different identities. Each model displays one neutral expression and three pain-related facial expressions: posed, spontaneous-algometer and spontaneous-CO2 laser. Normative ratings of pain intensity, valence and arousal were provided by students of three different European universities. Six independent coders carried out a coding process on the facial stimuli based on the Facial Action Coding System (FACS), in which ratings of intensity of pain, valence and arousal were computed for each type of facial expression. Gender and age effects of models across each type of micro-clip were also analysed. Additionally, participants' ability to discriminate the veracity of pain-related facial expressions (i.e., spontaneous vs posed) was explored. Finally, a series of ANOVAs were carried out to test the presence of other basic emotions and common facial action unit (AU) patterns. The main results revealed that posed facial expressions received higher ratings of pain intensity, more negative valence and higher arousal compared with spontaneous pain-related and neutral faces. No differential effects of model gender were found. Participants were unable to accurately discriminate whether a given pain-related face represented spontaneous or posed pain. PEMF thus constitutes a large open-source and reliable set of dynamic pain expressions useful for designing experimental studies focused on pain processes.

Universal interpretations of vocal music

Despite the variability of music across cultures, some types of human songs share acoustic characteristics. For example, dance songs tend to be loud and rhythmic, and lullabies tend to be quiet and melodious. Human perceptual sensitivity to the behavioral contexts of songs, based on these musical features, suggests that basic properties of music are mutually intelligible, independent of linguistic or cultural content. Whether these effects reflect universal interpretations of vocal music, however, is unclear because prior studies focus almost exclusively on English-speaking participants, a group that is not representative of humans. Here, we report shared intuitions concerning the behavioral contexts of unfamiliar songs produced in unfamiliar languages, in participants living in Internet-connected industrialized societies (n = 5,516 native speakers of 28 languages) or smaller-scale societies with limited access to global media (n = 116 native speakers of three non-English languages). Participants listened to songs randomly selected from a representative sample of human vocal music, originally used in four behavioral contexts, and rated the degree to which they believed the song was used for each context. Listeners in both industrialized and smaller-scale societies inferred the contexts of dance songs, lullabies, and healing songs, but not love songs. Within and across cohorts, inferences were mutually consistent. Further, increased linguistic or geographical proximity between listeners and singers only minimally increased the accuracy of the inferences. These results demonstrate that the behavioral contexts of three common forms of music are mutually intelligible cross-culturally and imply that musical diversity, shaped by cultural evolution, is nonetheless grounded in some universal perceptual phenomena.

Development and Validation of the AIIMS Facial Toolbox for Emotion Recognition

Background

Emotional facial expression database, used in emotion regulation studies, is a special set of pictures with high social and biological relevance. We present the AIIMS Facial Toolbox for Emotion Recognition (AFTER) database. It consists of pictures of 15 adult professional artists displaying seven facial expressions-neutral, happiness, anger, sadness, disgust, fear, and surprise.

Methods

This cross-sectional study enrolled 15 volunteer students from a professional drama college in India (six males and nine females; mean age = 26.2 ± 1.93 years). They were instructed to pose with different emotional expressions in high and low intensity. A total of 240 pictures were captured in a brightly lit room against a common, light background. Each picture was validated independently by 19 mental health professionals and two professional teachers of dramatic art. Apart from recognition of emotional quality, ratings were done for each emotion on a 5-point Likert scale with respect to three dimensions-intensity, clarity, and genuineness. Results are discussed in terms of mean scores on all four parameters.

Results

The percentage hit rate for all the emotions, after exclusion of contempt, was 84.3%, with the mean kappa for emotional expression being 0.68. Mean scores on intensity, clarity, and genuineness of the emotions depicted in the pictures were high.

Conclusions

The database would be useful in the Indian context for researching facial emotion recognition. It has been validated among a group of experts and was found to have high inter-rater reliability.

Optomyography-based sensing of facial expression derived arousal and valence in adults with depression

Background

Continuous assessment of affective behaviors could improve the diagnosis, assessment and monitoring of chronic mental health and neurological conditions such as depression. However, there are no technologies well suited to this, limiting potential clinical applications.

Aim

To test if we could replicate previous evidence of hypo reactivity to emotional salient material using an entirely new sensing technique called optomyography which is well suited to remote monitoring.

Methods

Thirty-eight depressed and 37 controls (≥18, ≤40 years) who met a research diagnosis of depression and an age-matched non-depressed control group. Changes in facial muscle activity over the brow (corrugator supercilli) and cheek (zygomaticus major) were measured whilst volunteers watched videos varying in emotional salience.

Results

Across all participants, videos rated as subjectively positive were associated with activation of muscles in the cheek relative to videos rated as neutral or negative. Videos rated as subjectively negative were associated with brow activation relative to videos judged as neutral or positive. Self-reported arousal was associated with a step increase in facial muscle activation across the brow and cheek. Group differences were significantly reduced activation in facial muscles during videos considered subjectively negative or rated as high arousal in depressed volunteers compared with controls.

Conclusion

We demonstrate for the first time that it is possible to detect facial expression hypo-reactivity in adults with depression in response to emotional content using glasses-based optomyography sensing. It is hoped these results may encourage the use of optomyography-based sensing to track facial expressions in the real-world, outside of a specialized testing environment.

The Meso-Expression Test (MET): A Novel Assessment of Emotion Perception

Emotion perception is a primary facet of Emotional Intelligence (EI) and the underpinning of interpersonal communication. In this study, we examined meso-expressions-the everyday, moderate-intensity emotions communicated through the face, voice, and body. We theoretically distinguished meso-expressions from other well-known emotion research paradigms (i.e., macro-expression and micro-expressions). In Study 1, we demonstrated that people can reliably discriminate between meso-expressions, and we created a corpus of 914 unique video displays of meso-expressions across a race- and gender-diverse set of expressors. In Study 2, we developed a novel video-based assessment of emotion perception ability: The Meso-Expression Test (MET). In this study, we found that the MET is psychometrically valid and demonstrated measurement equivalence across Asian, Black, Hispanic, and White perceiver groups and across men and women. In Study 3, we examined the construct validity of the MET and showed that it converged with other well-known measures of emotion perception and diverged from cognitive ability. Finally, in Study 4, we showed that the MET is positively related to important psychosocial outcomes, including social well-being, social connectedness, and empathic concern and is negatively related to alexithymia, stress, depression, anxiety, and adverse social interactions. We conclude with a discussion focused on the implications of our findings for EI ability research and the practical applications of the MET.

Facial Expressions as an Index of Listening Difficulty and Emotional Response

Knowledge about listening difficulty experienced during a task can be used to better understand speech perception processes, to guide amplification outcomes, and can be used by individuals to decide whether to participate in communication. Another factor affecting these decisions is individuals' emotional response which has not been measured objectively previously. In this study, we describe a novel method of measuring listening difficulty and affect of individuals in adverse listening situations using automatic facial expression algorithm. The purpose of our study was to determine if facial expressions of confusion and frustration are sensitive to changes in listening difficulty. We recorded speech recognition scores, facial expressions, subjective listening effort scores, and subjective emotional responses in 33 young participants with normal hearing. We used the signal-to-noise ratios of -1, +2, and +5 dB SNR and quiet conditions to vary the difficulty level. We found that facial expression of confusion and frustration increased with increase in difficulty level, but not with change in each level. We also found a relationship between facial expressions and both subjective emotion ratings and subjective listening effort. Emotional responses in the form of facial expressions show promise as a measure of affect and listening difficulty. Further research is needed to determine the specific contribution of affect to communication in challenging listening environments.

Evidence for cultural differences in affect during mother-infant interactions

Maternal care is considered a universal and even cross-species set of typical behaviors, which are necessary to determine the social development of children. In humans, most research on mother-infant bonding is based on Western cultures and conducted in European and American countries. Thus, it is still unknown which aspects of mother-infant behaviors are universal and which vary with culture. Here we test whether typical mother-infant behaviors of affect-communication and affect-regulation are equally represented during spontaneous interaction in Palestinian-Arab and Jewish cultures. 30 Palestinian-Arab and 43 Jewish mother-infant dyads were recruited and videotaped. Using AffectRegulation Coding System (ARCS), we behaviorally analyzed the second-by-second display of valence and arousal in each participant and calculated the dynamic patterns of affect co-regulation. The results show that Palestinian-Arab infants express more positive valence than Jewish infants and that Palestinian-Arab mothers express higher arousal compared to Jewish mothers. Moreover, we found culturally-distinct strategies to regulate the infant: increased arousal in Palestinian-Arab dyads and increased mutual affective match in Jewish dyads. Such cross-cultural differences in affect indicate that basic features of emotion that are often considered universal are differentially represented in different cultures. Affect communication and regulation patterns can be transmitted across generations in early-life socialization with caregivers.

Context reconsidered: Complex signal ensembles, relational meaning, and population thinking in psychological science

This article considers the status and study of "context" in psychological science through the lens of research on emotional expressions. The article begins by updating three well-trod methodological debates on the role of context in emotional expressions to reconsider several fundamental assumptions lurking within the field's dominant methodological tradition: namely, that certain expressive movements have biologically prepared, inherent emotional meanings that issue from singular, universal processes which are independent of but interact with contextual influences. The second part of this article considers the scientific opportunities that await if we set aside this traditional understanding of "context" as a moderator of signals with inherent psychological meaning and instead consider the possibility that psychological events emerge in ecosystems of signal ensembles, such that the psychological meaning of any individual signal is entirely relational. Such a fundamental shift has radical implications not only for the science of emotion but for psychological science more generally. It offers opportunities to improve the validity and trustworthiness of psychological science beyond what can be achieved with improvements to methodological rigor alone. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Registered report: Social face evaluation: ethnicity-specific differences in the judgement of trustworthiness of faces and facial parts

Social face evaluation is a common and consequential element of everyday life based on the judgement of trustworthiness. However, the particular facial regions that guide such trustworthiness judgements are largely unknown. It is also unclear whether different facial regions are consistently utilized to guide judgments for different ethnic groups, and whether previous exposure to specific ethnicities in one's social environment has an influence on trustworthiness judgements made from faces or facial regions. This registered report addressed these questions through a global online survey study that recruited Asian, Black, Latino, and White raters (N = 4580). Raters were shown full faces and specific parts of the face for an ethnically diverse, sex-balanced set of 32 targets and rated targets' trustworthiness. Multilevel modelling showed that in forming trustworthiness judgements, raters relied most strongly on the eyes (with no substantial information loss vis-à-vis full faces). Corroborating ingroup-outgroup effects, raters rated faces and facial parts of targets with whom they shared their ethnicity, sex, or eye color as significantly more trustworthy. Exposure to ethnic groups in raters' social environment predicted trustworthiness ratings of other ethnic groups in nuanced ways. That is, raters from the ambient ethnic majority provided slightly higher trustworthiness ratings for stimuli of their own ethnicity compared to minority ethnicities. In contrast, raters from an ambient ethnic minority (e.g., immigrants) provided substantially lower trustworthiness ratings for stimuli of the ethnic majority. Taken together, the current study provides a new window into the psychological processes underlying social face evaluation and its cultural generalizability. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on 7 January 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.6084/m9.figshare.18319244 .

Sex differences in emotional perception: Evidence from population of Tuvans (Southern Siberia)

Prior studies have reported that women outperform men in nonverbal communication, including the recognition of emotions through static facial expressions. In this experimental study, we investigated sex differences in the estimation of states of happiness, anger, fear, and disgust through static photographs using a two-culture approach. This study was conducted among the Tuvans and Mongolian people from Southern Siberia. The respondents were presented with a set of photographs of men and women of European and Tuvan origin and were asked to interpret each of them. They were asked: “What does the person in the photo feel?” We found that the Tuvans easily identified happiness and anger; however, the level of accuracy of fear and disgust recognition was low. No sex differences in the recognition of happiness, disgust, and fear were observed. However, anger recognition was significantly moderated by the perceiver’s sex and the origin of the model. Compared to Tuvan men, Tuvan women were significantly less accurate in identifying anger in male Tuvans. Furthermore, the age effect was found in recognition of fear: older Tuvans were more accurate while recognizing the fearful faces of Tuvan, but not the European models.

EmBody/EmFace as a new open tool to assess emotion recognition from body and face expressions

Nonverbal expressions contribute substantially to social interaction by providing information on another person’s intentions and feelings. While emotion recognition from dynamic facial expressions has been widely studied, dynamic body expressions and the interplay of emotion recognition from facial and body expressions have attracted less attention, as suitable diagnostic tools are scarce. Here, we provide validation data on a new open source paradigm enabling the assessment of emotion recognition from both 3D-animated emotional body expressions (Task 1: EmBody) and emotionally corresponding dynamic faces (Task 2: EmFace). Both tasks use visually standardized items depicting three emotional states (angry, happy, neutral), and can be used alone or together. We here demonstrate successful psychometric matching of the EmBody/EmFace items in a sample of 217 healthy subjects with excellent retest reliability and validity (correlations with the Reading-the-Mind-in-the-Eyes-Test and Autism-Spectrum Quotient, no correlations with intelligence, and given factorial validity). Taken together, the EmBody/EmFace is a novel, effective (< 5 min per task), highly standardized and reliably precise tool to sensitively assess and compare emotion recognition from body and face stimuli. The EmBody/EmFace has a wide range of potential applications in affective, cognitive and social neuroscience, and in clinical research studying face- and body-specific emotion recognition in patient populations suffering from social interaction deficits such as autism, schizophrenia, or social anxiety.

How Tone, Intonation and Emotion Shape the Development of Infants’ Fundamental Frequency Perception

Fundamental frequency (ƒ₀), perceived as pitch, is the first and arguably most salient auditory component humans are exposed to since the beginning of life. It carries multiple linguistic (e.g., word meaning) and paralinguistic (e.g., speakers’ emotion) functions in speech and communication. The mappings between these functions and ƒ₀ features vary within a language and differ cross-linguistically. For instance, a rising pitch can be perceived as a question in English but a lexical tone in Mandarin. Such variations mean that infants must learn the specific mappings based on their respective linguistic and social environments. To date, canonical theoretical frameworks and most empirical studies do not view or consider the multi-functionality of ƒ₀, but typically focus on individual functions. More importantly, despite the eventual mastery of ƒ₀ in communication, it is unclear how infants learn to decompose and recognize these overlapping functions carried by ƒ₀. In this paper, we review the symbioses and synergies of the lexical, intonational, and emotional functions that can be carried by ƒ₀ and are being acquired throughout infancy. On the basis of our review, we put forward the Learnability Hypothesis that infants decompose and acquire multiple ƒ₀ functions through native/environmental experiences. Under this hypothesis, we propose representative cases such as the synergy scenario, where infants use visual cues to disambiguate and decompose the different ƒ₀ functions. Further, viable ways to test the scenarios derived from this hypothesis are suggested across auditory and visual modalities. Discovering how infants learn to master the diverse functions carried by ƒ₀ can increase our understanding of linguistic systems, auditory processing and communication functions.

A new science of emotion: implications for functional neurological disorder

Functional neurological disorder reflects impairments in brain networks leading to distressing motor, sensory and/or cognitive symptoms that demonstrate positive clinical signs on examination incongruent with other conditions. A central issue in historical and contemporary formulations of functional neurological disorder has been the mechanistic and aetiological role of emotions. However, the debate has mostly omitted fundamental questions about the nature of emotions in the first place. In this perspective article, we first outline a set of relevant working principles of the brain (e.g. allostasis, predictive processing, interoception and affect), followed by a focused review of the theory of constructed emotion to introduce a new understanding of what emotions are. Building on this theoretical framework, we formulate how altered emotion category construction can be an integral component of the pathophysiology of functional neurological disorder and related functional somatic symptoms. In doing so, we address several themes for the functional neurological disorder field including: (i) how energy regulation and the process of emotion category construction relate to symptom generation, including revisiting alexithymia, 'panic attack without panic', dissociation, insecure attachment and the influential role of life experiences; (ii) re-interpret select neurobiological research findings in functional neurological disorder cohorts through the lens of the theory of constructed emotion to illustrate its potential mechanistic relevance; and (iii) discuss therapeutic implications. While we continue to support that functional neurological disorder is mechanistically and aetiologically heterogenous, consideration of how the theory of constructed emotion relates to the generation and maintenance of functional neurological and functional somatic symptoms offers an integrated viewpoint that cuts across neurology, psychiatry, psychology and cognitive-affective neuroscience.

Representations of facial expressions since Darwin

Darwin's book on expressions of emotion was one of the first publications to include photographs (Darwin, The expression of the emotions in Man and animals, 1872). The inclusion of expression photographs meant that readers could form their own opinions and could, like Darwin, survey others for their interpretations. As such, the images provided an evidence base and an 'open source'. Since Darwin, increases in the representativeness and realism of emotional expressions have come from the use of composite images, colour, multiple views and dynamic displays. Research on understanding emotional expressions has been aided by the use of computer graphics to interpolate parametrically between different expressions and to extrapolate exaggerations. This review tracks the developments in how emotions are illustrated and studied and considers where to go next.

Perceiving ingroup and outgroup faces within and across nations

The human face is arguably the most important of all social stimuli because it provides so much valuable information about others. Therefore, one critical factor for successful social communication is the ability to process faces. In general, a wide body of social cognitive research has demonstrated that perceivers are better at extracting information from their own-race compared to other-race faces and that these differences can be a barrier to positive cross-race relationships. The primary objective of the present paper was to provide an overview of how people process faces in diverse contexts, focusing on racial ingroup and outgroup members within one nation and across nations. To achieve this goal, we first broadly describe social cognitive research on categorization processes related to ingroups vs. outgroups. Next, we briefly examine two prominent mechanisms (experience and motivation) that have been used to explain differences in recognizing facial identities and identifying emotions when processing ingroup and outgroup racial faces within nations. Then, we explore research in this domain across nations and cultural explanations, such as norms and practices, that supplement the two proposed mechanisms. Finally, we propose future cross-cultural research that has the potential to help us better understand the role of these key mechanisms in processing ingroup and outgroup faces.

The 3d Mind Model characterizes how people understand mental states across modern and historical cultures

Humans rely on social interaction to achieve many important goals. These interactions rely in turn on people's capacity to understand others' mental states: their thoughts and feelings. Do different cultures understand minds in different ways, or do widely shared principles describe how different cultures understand mental states? Extensive data suggest that the mind organizes mental state concepts using the 3d Mind Model, composed of the psychological dimensions: rationality (vs. emotionality), social impact (states which affect others more vs. less), and valence (positive vs. negative states). However, this evidence comes primarily from English-speaking individuals in the United States. Here we investigated mental state representation in 57 contemporary countries, using 163 million English language tweets; in 17 languages, using billions of words of text from internet webpages; and across more than 2000 years of history, using curated texts from four historical societies. We quantified mental state meaning by analyzing the text produced by each culture using word embeddings. We then tested whether the 3d Mind Model could explain which mental states were similar in meaning within each culture. We found that the 3d Mind Model significantly explained mental state meaning in every country, language, and historical society that we examined. These results suggest that rationality, social impact, and valence form a generalizable conceptual backbone for mental state representation.

Positive, negative, neutral-or unknown? The perceived valence of emotions expressed by young autistic children in a novel context suited to autism

Starting early in life, autistics are characterized as having atypical facial expressions, as well as decreased positive and increased negative affect. The literature on autistic facial expressions remains small, however, with disparate methods and results suggesting limited understanding of common autistic emotions. Furthermore, unlike non-autistics’ emotions, autistics’ emotions have been assessed without considering this population’s characteristics. In this study, the valence of young children’s facial expressions was thus rated as positive, negative, neutral, or “unknown”—a term for perceived emotions observers do not understand. Facial expressions were assessed using the Montreal Stimulating Play Situation, a context incorporating potential autistic interests. Comparing 37 autistic and 39 typical young (27–56 months) age-matched children, we found no group differences in expressed positive, negative, and neutral emotions. We did find differences in unknown emotions, which were unique to the autistic group. Preliminary data also showed that autistic children’s repetitive behaviors co-occurred with positive, neutral, and unknown emotions, but not with negative emotions. In a novel context that considers their characteristics, we did not find decreased positive or increased negative emotions in young autistic children. Instead, they uniquely expressed emotions perceived as unknown, showing the need to improve our understanding of their full emotional repertoire.

Evidence for similar conceptual progress across diverse cultures in children’s understanding of emotion

Research with adults has increasingly moved beyond the focus on a small set of allegedly basic emotions, each associated with a signature facial expression. That expansion has been accompanied by a greater emphasis on the potential variability of emotion concepts across different cultural settings. In this conceptual review of children’s understanding of emotion, we argue that it is also important in developmental research to look beyond the small set of emotions associated with distinctive facial expressions. At the same time, we caution against any premature rejection of a universalist approach to children’s understanding of emotion. We review three different lines of evidence in support of this stance: (1) children’s ability to appropriately cite situational elicitors for emotions beyond the basic set; (2) their developing understanding of the relations between emotions and other mental processes; and (3) their realization that a person’s facially expressed emotion may not indicate their felt emotion. In each of these three domains, we target studies that have included children from a variety of cultures to assess how far they respond similarly or differently. We conclude that there is robust evidence for similar conceptual progress in children’s understanding of emotion across a range of cultural settings.

Emotion words link faces to emotional scenarios in early childhood

Recent theories have suggested that emotion words may facilitate the development of emotion concepts. The present study investigates whether emotion words affect children's performance on an emotion category learning task. Across two experiments, 72 three-year-old children (49 female) were asked to identify which emotional face best matched particular emotional scenarios during nine pretest and nine posttest trials. The scenarios in the present studies aligned with emotions typically learned among older age groups (annoyed, disgusted, and nervous). Between pretest and posttest, children participated in training in which a facial configuration (annoyed, disgusted, or nervous) was paired with an associated scenario while they heard the emotion labeled explicitly or heard irrelevant information (Experiment 1) or heard a broad emotion label versus irrelevant information (Experiment 2). Aside from the labels presented, all other information was kept the same across conditions, including the specific faces and scenarios heard during learning trials. In Experiment 1, children's emotion understanding increased more from pretest to posttest in the explicit label versus irrelevant condition, t(34) = 2.26, p = .030, d = .75, but in Experiment 2 the broad emotion labels did not provide an advantage over irrelevant information, t(34) = .72, p = .474, d = .24. These results suggest that emotion labels may be particularly helpful for young children learning about unfamiliar emotions, because specific labels may help children to aggregate disparate emotional information into meaningful categories. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Preventing and reducing fear using positive modelling: A systematic review of experimental research with children

Fear of specific stimuli is thought to develop through associative learning mechanisms and research indicates that a form of observational (vicarious) learning known as positive modelling can counter these effects. This systematic review examined and synthesised the experimental positive modelling literature to establish its efficacy for reducing fear. Psych Info, Medline and the Psychology and Behavioural Science Collection databases were systematically searched until August 2021. Of the 1,677 papers identified, 18 experiments across 14 articles met the inclusion criteria. In the majority of these, positive modelling was found to lower fear levels in one or more of three procedures: fear prevention, fear reduction and fear reversal. Procedures inform prevention and treatment initiatives for specific phobias in several ways. The overall efficacy of positive modelling techniques and the ease in which they can be implemented highlight the importance of further research to evaluate their inclusion in prevention and treatment interventions. More research is required to establish the longevity and transferability of positive modelling.

Augmenting salivation, but not evaluations, through subliminal conditioning of eating-related words

Correlating eating-related words (CS) with positively valenced words (US+) may augment eating-associated motivational responses (e.g., preingestive salivation) with minimal CS knowledge. We tested this claim using a subliminal conditioning procedure, where CS and US were presented under subliminal and supraliminal visual conditions. Three groups of Brazilian undergraduates (N = 69) viewed eating-related words (CS) or their scrambled counterparts (non-CS) followed by positive (US+) or neutral (US-) words. A free-selection visibility check confirmed that subliminally presented CS and non-CS had not been detected by any group. Participants exposed to CS/US+ pairings produced significantly more saliva relative to participants exposed to CS/US- and non-CS/US+ pairings. Reliable induction of salivation, coupled with null outcomes across evaluation measures, suggests that affective information related to eating can subliminally augment preingestive salivation with minimal deliberation.

Expertise in emotion: A scoping review and unifying framework for individual differences in the mental representation of emotional experience

Expertise refers to outstanding skill or ability in a particular domain. In the domain of emotion, expertise refers to the observation that some people are better at a range of competencies related to understanding and experiencing emotions, and these competencies may help them lead healthier lives. These individual differences are represented by multiple constructs including emotional awareness, emotional clarity, emotional complexity, emotional granularity, and emotional intelligence. These constructs derive from different theoretical perspectives, highlight different competencies, and are operationalized and measured in different ways. The full set of relationships between these constructs has not yet been considered, hindering scientific progress and the translation of findings to aid mental and physical well-being. In this article, we use a scoping review procedure to integrate these constructs within a shared conceptual space. Scoping reviews provide a principled means of synthesizing large and diverse literature in a transparent fashion, enabling the identification of similarities as well as gaps and inconsistencies across constructs. Using domain-general accounts of expertise as a guide, we build a unifying framework for expertise in emotion and apply this to constructs that describe how people understand and experience their own emotions. Our approach offers opportunities to identify potential mechanisms of expertise in emotion, encouraging future research on those mechanisms and on educational or clinical interventions. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Elements of Neuroanthropology

Neuroanthropology is the integration of neuroscience into anthropology and aims to understand “brains in the wild.” This interdisciplinary field examines patterns of human variation in field settings and provides empirical research that complements work done in clinical and laboratory settings. Neuroanthropology often uses ethnography in combination with theories and methods from cognitive science as a way to capture how culture, mind, and brain interact. This article describes nine elements that outline how to do neuroanthropology research: (1) integrating biology and culture through neuroscience and biocultural anthropology; (2) extending focus of anthropology on what people say and do to include what people process; (3) sizing culture appropriately, from broad patterns of culture to culture in small-scale settings; (4) understanding patterns of cultural variation, in particular how culture produces patterns of shared variation; (5) considering individuals in interaction with culture, with levels of analysis that can go from biology to social structures; (6) focusing on interactive elements that bring together biological and cultural processes; (7) conceptual triangulation, which draws on anthropology, psychology, and neuroscience in conjunction with field, clinic, and laboratory; (8) critical complementarity as a way to integrate the strengths of critical scholarship with interdisciplinary work; and (9) using methodological triangulation as a way to advance interdisciplinary research. These elements are illustrated through three case studies: research on US combat veterans and how they use Brazilian Jiu Jitsu as a way to manage the transition to becoming civilians, work on human-raptor interactions to understand how and why these interactions can prove beneficial for human handlers, and adapting cue reactivity research on addiction to a field-based approach to understand how people interact with cues in naturalistic settings.

Infants are sensitive to cultural differences in emotions at 11 months

A myriad of emotion perception studies has shown infants' ability to discriminate different emotional categories, yet there has been little investigation of infants' perception of cultural differences in emotions. Hence little is known about the extent to which culture-specific emotion information is recognised in the beginning of life. Caucasian Australian infants of 10-12 months participated in a visual-paired comparison task where their preferential looking patterns to three types of infant-directed emotions (anger, happiness, surprise) from two different cultures (Australian, Japanese) were examined. Differences in racial appearances were controlled. Infants exhibited preferential looking to Japanese over Caucasian Australian mothers' angry and surprised expressions, whereas no difference was observed in trials involving East-Asian Australian mothers. In addition, infants preferred Caucasian Australian mothers' happy expressions. These findings suggest that 11-month-olds are sensitive to cultural differences in spontaneous infant-directed emotional expressions when they are combined with a difference in racial appearance.

Can we get human nature right?

Few questions in science are as controversial as human nature. At stake is whether our basic concepts and emotions are all learned from experience, or whether some are innate. Here, I demonstrate that reasoning about innateness is biased by the basic workings of the human mind. Psychological science suggests that newborns possess core concepts of "object" and "number." Laypeople, however, believe that newborns are devoid of such notions but that they can recognize emotions. Moreover, people presume that concepts are learned, whereas emotions (along with sensations and actions) are innate. I trace these beliefs to two tacit psychological principles: intuitive dualism and essentialism. Essentialism guides tacit reasoning about biological inheritance and suggests that innate traits reside in the body; per intuitive dualism, however, the mind seems ethereal, distinct from the body. It thus follows that, in our intuitive psychology, concepts (which people falsely consider as disembodied) must be learned, whereas emotions, sensations, and emotions (which are considered embodied) are likely innate; these predictions are in line with the experimental results. These conclusions do not speak to the question of whether concepts and emotions are innate, but they suggest caution in its scientific evaluation.

Professional actors demonstrate variability, not stereotypical expressions, when portraying emotional states in photographs

It is long hypothesized that there is a reliable, specific mapping between certain emotional states and the facial movements that express those states. This hypothesis is often tested by asking untrained participants to pose the facial movements they believe they use to express emotions during generic scenarios. Here, we test this hypothesis using, as stimuli, photographs of facial configurations posed by professional actors in response to contextually-rich scenarios. The scenarios portrayed in the photographs were rated by a convenience sample of participants for the extent to which they evoked an instance of 13 emotion categories, and actors' facial poses were coded for their specific movements. Both unsupervised and supervised machine learning find that in these photographs, the actors portrayed emotional states with variable facial configurations; instances of only three emotion categories (fear, happiness, and surprise) were portrayed with moderate reliability and specificity. The photographs were separately rated by another sample of participants for the extent to which they portrayed an instance of the 13 emotion categories; they were rated when presented alone and when presented with their associated scenarios, revealing that emotion inferences by participants also vary in a context-sensitive manner. Together, these findings suggest that facial movements and perceptions of emotion vary by situation and transcend stereotypes of emotional expressions. Future research may build on these findings by incorporating dynamic stimuli rather than photographs and studying a broader range of cultural contexts.

Investigating Emotion Perception via the Two-Dimensional Affect and Feeling Space: An Example of a Cross-Cultural Study Among Chinese and Non-Chinese Participants

The categorical approach to cross-cultural emotion perception research has mainly relied on constrained experimental tasks, which have arguably biased previous findings and attenuated cross-cultural differences. On the other hand, in the constructionist approach, conclusions on the universal nature of valence and arousal have mainly been indirectly drawn based on participants' word-matching or free-sorting behaviors, but studies based on participants' continuous valence and arousal ratings are very scarce. When it comes to self-reports of specific emotion perception, constructionists tend to rely on free labeling, which has its own limitations. In an attempt to move beyond the limitations of previous methods, a new instrument called the Two-Dimensional Affect and Feeling Space (2DAFS) has been developed. The 2DAFS is a useful, innovative, and user-friendly instrument that can easily be integrated in online surveys and allows for the collection of both continuous valence and arousal ratings and categorical emotion perception data in a quick and flexible way. In order to illustrate the usefulness of this tool, a cross-cultural emotion perception study based on the 2DAFS is reported. The results indicate the cross-cultural variation in valence and arousal perception, suggesting that the minimal universality hypothesis might need to be more nuanced.

Author Reply: Aligning Social Relations With Faces, Words, and Emotions

How do facial movements and verbal statements relate to emotional processes? A familiar answer is that the primary phenomenon is an internally located emotion that may then get expressed on the face and represented in words. In this view, emotion’s social functions and effects are indirect consequences of prior intrapsychic states or events. By contrast, my target article argued that facial and verbal activity are constituents rather than consequences of the dynamic production of fundamentally relational emotions. This article clarifies this alternative position and evaluates potential counterarguments.

The impact of facemasks on emotion recognition, trust attribution and re-identification

Covid-19 pandemics has fostered a pervasive use of facemasks all around the world. While they help in preventing infection, there are concerns related to the possible impact of facemasks on social communication. The present study investigates how emotion recognition, trust attribution and re-identification of faces differ when faces are seen without mask, with a standard medical facemask, and with a transparent facemask restoring visual access to the mouth region. Our results show that, in contrast to standard medical facemasks, transparent masks significantly spare the capability to recognize emotional expressions. Moreover, transparent masks spare the capability to infer trustworthiness from faces with respect to standard medical facemasks which, in turn, dampen the perceived untrustworthiness of faces. Remarkably, while transparent masks (unlike standard masks) do not impair emotion recognition and trust attribution, they seemingly do impair the subsequent re-identification of the same, unmasked, face (like standard masks). Taken together, this evidence supports a dissociation between mechanisms sustaining emotion and identity processing. This study represents a pivotal step in the much-needed analysis of face reading when the lower portion of the face is occluded by a facemask.

Sty in the Mind's Eye: A Meta-Analytic Investigation of the Nomological Network and Internal Consistency of the "Reading the Mind in the Eyes" Test

The Reading the Mind in the Eyes Test (RMET) is the most popular adult measure of individual differences in theory of mind. We present a meta-analytic investigation of the test's psychometric properties (k = 119 effect sizes, 61 studies, n_total = 8,611 persons). Using random effects models, we found the internal consistency of the test was acceptable (α = .73). However, the RMET was more strongly related with emotion perception (r = .33, ρ = .48) relative to alternative theory of mind measures (r = .29, ρ = .39), and weakly to moderately related with vocabulary (r = .25, ρ = .32), cognitive empathy (r = .14, ρ = .20), and affective empathy (r = .13, ρ = .19). Overall, we conclude that the RMET operates rather as emotion perception measure than as theory of mind measure, challenging the interpretation of RMET results.

Heart to Heart: A Relation-Alignment Approach to Emotion’s Social Effects

This article integrates arguments and evidence from my 2019 monograph Heart to Heart: How Your Emotions Affect Other People. The central claim is that emotions operate as processes of relation alignment that produce convergence, complementarity, or conflict between two or more people’s orientations to objects. In some cases, relation alignment involves strategic presentation of emotional information for the purpose of regulating other people’s behaviour. In other cases, emotions consolidate from socially distributed reciprocal adjustments of cues, signals, and emerging actions without any explicit registration or communication of emotional meaning by parties to the exchange. The relation-alignment approach provides a fresh perspective on issues relating to emotion’s interpersonal, intragroup, and organizational functions and clarifies how emotions are regulated for social purposes.

The construction of awe in science communication

Awe is a frequently represented and commonly experienced emotion in science communication. According to a popular account of this emotion, awe is an innate and universal human affective experience that occurs when a person evaluates a target as vast, forcing a shift in their worldview. This shift is portrayed in science communication as resulting in an enhanced interest in the scientific material at hand. Based on the latest research in affective science, however, we challenge this narrow version of awe in science communication and instead advocate a broader account of this emotion in line with a constructionist perspective. We argue that there are a variety of awe types in science communication, each with different forms and functions in relation to the mandates within the multiplicity of contexts in this cultural space. We also contend that people's awe experiences result from their previous interactions with this emotion and the unique affordances provided by the science communication situation.

Comparing supervised and unsupervised approaches to emotion categorization in the human brain, body, and subjective experience

Machine learning methods provide powerful tools to map physical measurements to scientific categories. But are such methods suitable for discovering the ground truth about psychological categories? We use the science of emotion as a test case to explore this question. In studies of emotion, researchers use supervised classifiers, guided by emotion labels, to attempt to discover biomarkers in the brain or body for the corresponding emotion categories. This practice relies on the assumption that the labels refer to objective categories that can be discovered. Here, we critically examine this approach across three distinct datasets collected during emotional episodes—measuring the human brain, body, and subjective experience—and compare supervised classification solutions with those from unsupervised clustering in which no labels are assigned to the data. We conclude with a set of recommendations to guide researchers towards meaningful, data-driven discoveries in the science of emotion and beyond.

Factors Facilitating Early Emotion Understanding Development: Contributions to Individual Differences

Children's emotion understanding is crucial for healthy social and academic development. The behaviors influenced by emotion understanding in childhood have received much attention, but less focus has been placed on factors that may predict individual differences in emotion understanding, the principle issue addressed in the current review. A more thorough understanding of the developmental underpinnings of this skill may allow for better prediction of emotion understanding, and for interventions to improve emotion understanding early in development. Here, we present theoretical arguments for the substantial roles of three aspects of children's environments in development of emotion understanding: family expressiveness, discussions about emotions, and language development, and we discuss how these are interrelated. Ultimately, this may aid in predicting the effects of environmental influences on development of emotion understanding more broadly, and the mechanisms by which they do so.

Recognizing Emotions through Facial Expressions: A Largescale Experimental Study

Experimental research examining emotional processes is typically based on the observation of images with affective content, including facial expressions. Future studies will benefit from databases with emotion-inducing stimuli in which characteristics of the stimuli potentially influencing results can be controlled. This study presents Portuguese normative data for the identification of seven facial expressions of emotions (plus a neutral face), on the Radboud Faces Database (RaFD). The effect of participants’ gender and models’ sex on emotion recognition was also examined. Participants (N = 1249) were exposed to 312 pictures of white adults displaying emotional and neutral faces with a frontal gaze. Recognition agreement between the displayed and participants’ chosen expressions ranged from 69% (for anger) to 97% (for happiness). Recognition levels were significantly higher among women than among men only for anger and contempt. The emotion recognition was higher either in female models or in male models depending on the emotion. Overall, the results show high recognition levels of the facial expressions presented, indicating that the RaFD provides adequate stimuli for studies examining the recognition of facial expressions of emotion among college students. Participants’ gender had a limited influence on emotion recognition, but the sex of the model requires additional consideration.

Essentialist Biases in Reasoning About Emotions

A large literature debates whether emotions are universal and innate. Here, we ask whether reasoning about such matters is shaped by intuitive Essentialist biases that link innateness to the material body. To gauge the perception of innateness, we asked laypeople to evaluate whether emotion categories will be recognized spontaneously by hunter–gatherers who have had no contact with Westerners. Experiment 1 shows that participants believe that emotions are innate and embodied (facially and internally) and these two properties correlate reliably. Experiment 2 demonstrates that the link is causal. When told that emotions are localized in specific brain areas (i.e., embodied), participants concluded that emotions are innate. Experiment 3 shows that this naïve view persists even when participants are explicitly informed that these emotions are acquired. Our results are the first to suggest that laypeople incorrectly believe that, if emotions are embodied, then they must be innate. We suggest that people’s failure to grasp the workings of their psyche arises from the human psyche itself.

The neuroscience of sadness: A multidisciplinary synthesis and collaborative review

Sadness is typically characterized by raised inner eyebrows, lowered corners of the mouth, reduced walking speed, and slumped posture. Ancient subcortical circuitry provides a neuroanatomical foundation, extending from dorsal periaqueductal grey to subgenual anterior cingulate, the latter of which is now a treatment target in disorders of sadness. Electrophysiological studies further emphasize a role for reduced left relative to right frontal asymmetry in sadness, underpinning interest in the transcranial stimulation of left dorsolateral prefrontal cortex as an antidepressant target. Neuroimaging studies - including meta-analyses - indicate that sadness is associated with reduced cortical activation, which may contribute to reduced parasympathetic inhibitory control over medullary cardioacceleratory circuits. Reduced cardiac control may - in part - contribute to epidemiological reports of reduced life expectancy in affective disorders, effects equivalent to heavy smoking. We suggest that the field may be moving toward a theoretical consensus, in which different models relating to basic emotion theory and psychological constructionism may be considered as complementary, working at different levels of the phylogenetic hierarchy.

Emotion Perception in Hadza Hunter-Gatherers

It has long been claimed that certain configurations of facial movements are universally recognized as emotional expressions because they evolved to signal emotional information in situations that posed fitness challenges for our hunting and gathering hominin ancestors. Experiments from the last decade have called this particular evolutionary hypothesis into doubt by studying emotion perception in a wider sample of small-scale societies with discovery-based research methods. We replicate these newer findings in the Hadza of Northern Tanzania; the Hadza are semi-nomadic hunters and gatherers who live in tight-knit social units and collect wild foods for a large portion of their diet, making them a particularly relevant population for testing evolutionary hypotheses about emotion. Across two studies, we found little evidence of universal emotion perception. Rather, our findings are consistent with the hypothesis that people infer emotional meaning in facial movements using emotion knowledge embrained by cultural learning.

Developing an Understanding of Emotion Categories: Lessons from Objects

How and when infants and young children begin to develop emotion categories is not yet well understood. Research has largely treated the learning problem as one of identifying perceptual similarities among exemplars (typically posed, stereotyped facial configurations). However, recent meta-analyses and reviews converge to suggest that emotion categories are abstract, involving high-dimensional and situationally variable instances. In this paper we consult research on the development of abstract object categorization to guide hypotheses about how infants might learn abstract emotion categories because the two domains present infants with similar learning challenges. In particular, we consider how a developmental cascades framework offers opportunities to understand how and when young children develop emotion categories.

Trait-Based Module for Culturally-Competent Robots

Robots might not act according to human expectations if they cannot anticipate how people make sense of a situation and what behavior they consider appropriate in some given circumstances. In many cases, understanding, expectations and behavior are constrained, if not driven, by culture, and a robot that knows about human culture could improve the quality level of human–robot interaction. Can we share human culture with a robot? Can we provide robots with formal representations of different cultures? In this paper, we discuss the (elusive) notion of culture and propose an approach based on the notion of trait which, we argue, permits us to build formal modules suitable to represent culture (broadly understood) in a robot architecture. We distinguish the types of traits that such modules should contain, namely behavior, knowledge, rule and interpretation traits, and how they could be organized. We identify the interpretation process that maps situations to specific knowledge traits, called scenarios, as a key component of the trait-based culture module. Finally, we describe how culture modules can be integrated in an existing architecture, and discuss three use cases to exemplify the advantages of having a culture module in the robot architecture highlighting surprising potentialities.

Emotion semantics show both cultural variation and universal structure

Many human languages have words for emotions such as “anger” and “fear,” yet it is not clear whether these emotions have similar meanings across languages, or why their meanings might vary. We estimate emotion semantics across a sample of 2474 spoken languages using “colexification”—a phenomenon in which languages name semantically related concepts with the same word. Analyses show significant variation in networks of emotion concept colexification, which is predicted by the geographic proximity of language families. We also find evidence of universal structure in emotion colexification networks, with all families differentiating emotions primarily on the basis of hedonic valence and physiological activation. Our findings contribute to debates about universality and diversity in how humans understand and experience emotion.