A data-driven characterisation of natural facial expressions when giving good and bad news

Is she still angry? Intact learning but no updating of facial expressions priors in autism

Autistic people exhibit atypical use of prior information when processing simple perceptual stimuli; yet, it remains unclear whether and how these difficulties in using priors extend to complex social stimuli. Here, we compared autistic people without accompanying intellectual disability and nonautistic people in their ability to acquire an "emotional prior" of a facial expression and update this prior to a different facial expression of the same identity. Participants performed a two-interval same/different discrimination task between two facial expressions. To study the acquisition of the prior, we examined how discrimination was modified by the contraction of the perceived facial expressions toward the average of presented stimuli (i.e., regression to the mean). At first, facial expressions surrounded one average emotional prior (mostly sad or angry), and then the average switched (to mostly angry or sad, accordingly). Autistic people exhibited challenges in facial discrimination, and yet acquired the first prior, demonstrating typical regression-to-the-mean effects. However, unlike nonautistic people, autistic people did not update their perception to the second prior, suggesting they are less flexible in updating an acquired prior of emotional expressions. Our findings shed light on the perception of emotional expressions, one of the most pressing challenges in autism.

Py-Feat: Python Facial Expression Analysis Toolbox

Studying facial expressions is a notoriously difficult endeavor. Recent advances in the field of affective computing have yielded impressive progress in automatically detecting facial expressions from pictures and videos. However, much of this work has yet to be widely disseminated in social science domains such as psychology. Current state-of-the-art models require considerable domain expertise that is not traditionally incorporated into social science training programs. Furthermore, there is a notable absence of user-friendly and open-source software that provides a comprehensive set of tools and functions that support facial expression research. In this paper, we introduce Py-Feat, an open-source Python toolbox that provides support for detecting, preprocessing, analyzing, and visualizing facial expression data. Py-Feat makes it easy for domain experts to disseminate and benchmark computer vision models and also for end users to quickly process, analyze, and visualize face expression data. We hope this platform will facilitate increased use of facial expression data in human behavior research.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42761-023-00191-4.

A PCA-Based Active Appearance Model for Characterising Modes of Spatiotemporal Variation in Dynamic Facial Behaviours

Faces carry key personal information about individuals, including cues to their identity, social traits, and emotional state. Much research to date has employed static images of faces taken under tightly controlled conditions yet faces in the real world are dynamic and experienced under ambient conditions. A common approach to studying key dimensions of facial variation is the use of facial caricatures. However, such techniques have again typically relied on static images, and the few examples of dynamic caricatures have relied on animating graphical head models. Here, we present a principal component analysis (PCA)-based active appearance model for capturing patterns of spatiotemporal variation in videos of natural dynamic facial behaviours. We demonstrate how this technique can be applied to generate dynamic anti-caricatures of biological motion patterns in facial behaviours. This technique could be extended to caricaturing other facial dimensions, or to more general analyses of spatiotemporal variations in dynamic faces.