Faces on Her and His Mind: Female and Likable

Dynamic brain communication underwriting face pareidolia

Face pareidolia is a tendency to seeing faces in nonface images that reflects high tuning to a face scheme. Yet, studies of the brain networks underwriting face pareidolia are scarce. Here, we examined the time course and dynamic topography of gamma oscillatory neuromagnetic activity while administering a task with nonface images resembling a face. Images were presented either with canonical orientation or with display inversion that heavily impedes face pareidolia. At early processing stages, the peaks in gamma activity (40 to 45 Hz) to images either triggering or not face pareidolia originate mainly from the right medioventral and lateral occipital cortices, rostral and caudal cuneus gyri, and medial superior occipital gyrus. Yet, the difference occurred at later processing stages in the high-frequency range of 80 to 85 Hz over a set of the areas constituting the social brain. The findings speak rather for a relatively late neural network playing a key role in face pareidolia. Strikingly, a cutting-edge analysis of brain connectivity unfolding over time reveals mutual feedforward and feedback intra- and interhemispheric communication not only within the social brain but also within the extended large-scale network of down- and upstream regions. In particular, the superior temporal sulcus and insula strongly engage in communication with other brain regions either as signal transmitters or recipients throughout the whole processing of face-pareidolia images.

Emotions behind a mask: the value of disgust

The impact of face masks on social cognition and interaction became a popular topic due to the long-lasting COVID-19 pandemic. This theme persists in the focus of attention beyond the pandemic, since face covering not only reduces the overall amount of face information available but also introduces biases and prejudices affecting social perception at large. Many questions are still open. One of them is whether gender of beholders affects inferring of emotions covered by face masks. Reading covered faces may be particularly challenging for individuals with mental disorders, most of which are gender-specific. Previous findings are not only sparse, but inconclusive because most research had been conducted online with resulting samples heavily dominated by females. Here in a face-to-face study, females and males were presented with a randomized set of faces covered by masks. In a two-alternative forced-choice paradigm, participants had to indicate facial emotions displayed by posers. In general, the outcome dovetails with earlier findings that face masks affect emotion recognition in a dissimilar way: Inferring some emotions suffers more severely than others, with the most pronounced influence of mask wearing on disgust and close to ceiling recognition of fear and neutral expressions. Contrary to our expectations, however, males were on overall more proficient in emotion recognition. In particular, males substantially excelled in inferring disgust. The findings help to understand gender differences in recognition of disgust, the forgotten emotion of psychiatry, that is of substantial value for a wide range of mental disorders including schizophrenia. Watch Prof. Marina Pavlova discussing this her work and this article: https://vimeo.com/860126397/5966610f49?share=copy .

Do subtle cultural differences sculpt face pareidolia?

Face tuning to non-face images such as shadows or grilled toasts is termed face pareidolia. Face-pareidolia images represent a valuable tool for investigation of social cognition in mental disorders. Here we examined (i) whether, and, if so, how face pareidolia is affected by subtle cultural differences; and (ii) whether this impact is modulated by gender. With this purpose in mind, females and males from Northern Italy were administered a set of Face-n-Thing images, photographs of objects such as houses or waves to a varying degree resembling a face. Participants were presented with pareidolia images with canonical upright orientation and display inversion that heavily affects face pareidolia. In a two-alternative forced-choice paradigm, beholders had to indicate whether each image resembled a face. The outcome was compared with the findings obtained in the Southwest of Germany. With upright orientation, neither cultural background nor gender affected face pareidolia. As expected, display inversion generally mired face pareidolia. Yet, while display inversion led to a drastic reduction of face impression in German males as compared to females, in Italians, no gender differences were found. In a nutshell, subtle cultural differences do not sculpt face pareidolia, but instead affect face impression in a gender-specific way under unusual viewing conditions. Clarification of the origins of these effects requires tailored brain imaging work. Implications for transcultural psychiatry, in particular, for schizophrenia research, are highlighted and discussed.

Face pareidolia in male schizophrenia

Faces are valuable signals for efficient social interaction. Yet, social cognition including the sensitivity to a coarse face scheme may be deviant in schizophrenia (SZ). Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is termed face pareidolia. This phenomenon is poorly investigated in SZ. Here face tuning was assessed in 44 male participants with SZ and person-by-person matched controls by using recently created Face-n-Thing images (photographs of non-face objects to a varying degree resembling a face). The advantage of these images is that single components do not automatically trigger face processing. Participants were administered a set of images with upright and inverted (180° in the image plane) orientation. In a two-alternative forced-choice paradigm, they had to indicate whether an image resembled a face. The findings showed that: (i) With upright orientation, SZ patients exhibited deficits in face tuning: they provided much fewer face responses than controls. (ii) Inversion generally hindered face pareidolia. However, while in neurotypical males, inversion led to a drastic drop in face impression, in SZ, the impact of orientation was reduced. (iii) Finally, in accord with the signal detection theory analysis, the sensitivity index (d-prime) was lower in SZ, whereas no difference occurred in decision criterion. The outcome suggests altered face pareidolia in SZ is caused by lower face sensitivity rather than by alterations in cognitive bias. Comparison of these findings with earlier evidence confirms that tuning to social signals is lower in SZ, and warrants tailored brain imaging research.

Ties between reading faces, bodies, eyes, and autistic traits

While reading covered with masks faces during the COVID-19 pandemic, for efficient social interaction, we need to combine information from different sources such as the eyes (without faces hidden by masks) and bodies. This may be challenging for individuals with neuropsychiatric conditions, in particular, autism spectrum disorders. Here we examined whether reading of dynamic faces, bodies, and eyes are tied in a gender-specific way, and how these capabilities are related to autistic traits expression. Females and males accomplished a task with point-light faces along with a task with point-light body locomotion portraying different emotional expressions. They had to infer emotional content of displays. In addition, participants were administered the Reading the Mind in the Eyes Test, modified and Autism Spectrum Quotient questionnaire. The findings show that only in females, inferring emotions from dynamic bodies and faces are firmly linked, whereas in males, reading in the eyes is knotted with face reading. Strikingly, in neurotypical males only, accuracy of face, body, and eyes reading was negatively tied with autistic traits. The outcome points to gender-specific modes in social cognition: females rely upon merely dynamic cues while reading faces and bodies, whereas males most likely trust configural information. The findings are of value for examination of face and body language reading in neuropsychiatric conditions, in particular, autism, most of which are gender/sex-specific. This work suggests that if male individuals with autistic traits experience difficulties in reading covered with masks faces, these deficits may be unlikely compensated by reading (even dynamic) bodies and faces. By contrast, in females, reading covered faces as well as reading language of dynamic bodies and faces are not compulsorily connected to autistic traits preventing them from paying high costs for maladaptive social interaction.

Neural circuits underpinning face tuning in male depression

Reading bodies and faces is essential for efficient social interactions, though it may be thought-provoking for individuals with depression. Yet aberrations in the face sensitivity and underwriting neural circuits are not well understood, in particular, in male depression. Here, we use cutting-edge analyses of time course and dynamic topography of gamma oscillatory neuromagnetic cortical activity during administration of a task with Arcimboldo-like images. No difference in face tuning was found between individuals with depression and their neurotypical peers. Furthermore, this behavioral outcome nicely dovetails with magnetoencephalographic data: at early processing stages, the gamma oscillatory response to images resembling a face was rather similar in patients and controls. These bursts originated primarily from the right medioventral occipital cortex and lateral occipital cortex. At later processing stages, however, its topography altered remarkably in depression with profound engagement of the frontal circuits. Yet the primary difference in depressive individuals as compared with their neurotypical peers occurred over the left middle temporal cortices, a part of the social brain, engaged in feature integration and meaning retrieval. The outcome suggests compensatory recruitment of neural resources in male depression.

Acquired Prosopagnosia with Structurally Intact and Functional Fusiform Face Area and with Face Identity-Specific Configuration Processing Deficits

Prosopagnosia or loss of face perception and recognition is still poorly understood and rare single cases of acquired prosopagnosia can provide a unique window on the behavioural and brain basis of normal face perception. The present study of a new case of acquired prosopagnosia with bilateral occipito-temporal lesions but a structurally intact FFA and OFA investigated whether the lesion overlapped with the face network and whether the structurally intact FFA showed a face selective response. We also investigated the behavioral correlates of the neural findings and assessed configural processing in the context of facial and non-facial identity recognition, expression recognition and memory, also focusing on the face-selectivity of each specific deficit. The findings reveal a face-selective response in the FFA, despite lesions in the face perception network. At the behavioural level, the results showed impaired configural processing for facial identity, but not for other stimulus categories and not for facial expression recognition. These findings challenge a critical role of the FFA for face identity processing and support a domain-specific account of configural processing.

Reading Covered Faces

Covering faces with masks, due to mandatory pandemic safety regulations, we can no longer rely on the habitual daily-life information. This may be thought-provoking for healthy people, but particularly challenging for individuals with neuropsychiatric and neurodevelopmental conditions. Au fait research on reading covered faces reveals that: 1) wearing masks hampers facial affect recognition, though it leaves reliable inferring basic emotional expressions; 2) by buffering facial affect, masks lead to narrowing of emotional spectrum and dampen veridical evaluation of counterparts; 3) masks may affect perceived face attractiveness; 4) covered (either by masks or other veils) faces have a certain signal function introducing perceptual biases and prejudices; 5) reading covered faces is gender- and age-specific, being more challenging for males and more variable even in healthy aging; 6) the hampering effects of masks on social cognition occur over the globe; and 7) reading covered faces is likely to be supported by the large-scale assemblies of the neural circuits far beyond the social brain. Challenges and limitations of ongoing research and parallels to the Reading the Mind in the Eyes Test are assessed. Clarification of how masks affect face reading in the real world, where we deal with dynamic faces and have entrée to additional valuable social signals such as body language, as well as the specificity of neural networks underlying reading covered faces calls for further tailored research.

Social cognition in individuals born preterm

Faces hold a substantial value for effective social interactions and sharing. Covering faces with masks, due to COVID-19 regulations, may lead to difficulties in using social signals, in particular, in individuals with neurodevelopmental conditions. Daily-life social participation of individuals who were born preterm is of immense importance for their quality of life. Here we examined face tuning in individuals (aged 12.79 ± 1.89 years) who were born preterm and exhibited signs of periventricular leukomalacia (PVL), a dominant form of brain injury in preterm birth survivors. For assessing the face sensitivity in this population, we implemented a recently developed experimental tool, a set of Face-n-Food images bordering on the style of Giuseppe Arcimboldo. The key benefit of these images is that single components do not trigger face processing. Although a coarse face schema is thought to be hardwired in the brain, former preterms exhibit substantial shortages in the face tuning not only compared with typically developing controls but also with individuals with autistic spectrum disorders. The lack of correlations between the face sensitivity and other cognitive abilities indicates that these deficits are domain-specific. This underscores impact of preterm birth sequelae for social functioning at large. Comparison of the findings with data in individuals with other neurodevelopmental and neuropsychiatric conditions provides novel insights into the origins of deficient face processing.

Face Tuning in Depression

The latest COVID-19 pandemic reveals that unexpected changes elevate depression bringing people apart, but also calling for social sharing. Yet the impact of depression on social cognition and functioning is not well understood. Assessment of social cognition is crucial not only for a better understanding of major depressive disorder (MDD), but also for screening, intervention, and remediation. Here by applying a novel experimental tool, a Face-n-Food task comprising a set of images bordering on the Giuseppe Arcimboldo style, we assessed the face tuning in patients with MDD and person-by-person matched controls. The key benefit of these images is that single components do not trigger face processing. Contrary to common beliefs, the outcome indicates that individuals with depression express intact face responsiveness. Yet, while in depression face sensitivity is tied with perceptual organization, in typical development, it is knotted with social cognition capabilities. Face tuning in depression, therefore, may rely upon altered behavioral strategies and underwriting brain mechanisms. To exclude a possible camouflaging effect of female social skills, we examined gender impact. Neither in depression nor in typical individuals had females excelled in face tuning. The outcome sheds light on the origins of the face sensitivity and alterations in social functioning in depression and mental well-being at large. Aberrant social functioning in depression is likely to be the result of deeply-rooted maladaptive strategies rather than of poor sensitivity to social signals. This has implications for mental well-being under the current pandemic conditions.

Face pareidolia in the brain: Impact of gender and orientation

Research on face sensitivity is of particular relevance during the rapidly evolving Covid-19 pandemic leading to social isolation, but also calling for intact interaction and sharing. Humans possess high sensitivity even to a coarse face scheme, seeing faces in non-face images where real faces do not exist. The advantage of non-face images is that single components do not trigger face processing. Here by implementing a novel set of Face-n-Thing images, we examined (i) how face tuning alters with changing display orientation, and (ii) whether it is affected by observers’ gender. Young females and males were presented with a set of Face-n-Thing images either with canonical upright orientation or inverted 180° in the image plane. Face impression was substantially impeded by display inversion. Furthermore, whereas with upright display orientation, no gender differences were found, with inversion, Face-n-Thing images elicited face impression in females significantly more often. The outcome sheds light on the origins of the face inversion effect in general. Moreover, the findings open a way for examination of face sensitivity and underwriting brain networks in neuropsychiatric conditions related to the current pandemic (such as depression and anxiety), most of which are gender/sex-specific.

Face pareidolia in schizophrenia

BACKGROUND

Faces convey valuable daily life social signals. As in most psychiatric conditions, non-verbal social cognition or its components including face processing may be aberrant in schizophrenia (SZ). Social participation of individuals with SZ is vital for their quality of life, and remediation of social abilities in this population is of high relevance both for society and clinical care.

METHOD

Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is called face pareidolia. Humans possess high sensitivity to facial signals: even fetuses and infants are well tuned to coarse face cues. Here we assessed face tuning in individuals with SZ and person-by-person matched controls by using a new experimental tool, a set of food-plate images bordering on the Giuseppe Arcimboldo style. The key benefit of these images is that single components do not trigger face processing.

RESULTS AND CONCLUSIONS

The outcome indicates that individuals with SZ exhibit aberrant face tuning in face-like non-face images (χ²(1) = 17.44, p = 0.0001) that can hamper adaptive interaction with peers and social participation hindering, in turn, clinical remediation. Face response rate in SZ patients was related to the scores on the event arrangement task tapping social cognition (Pearson product-moment correlation, r = 0.602, p = 0.01) and on picture completion task assessing visual perceptual organization (Spearman's rho = 0.614, p = 0.009). Therefore, poor performance on the face tuning task is unlikely to be accounted for by deviant general cognitive abilities, but rather by impairments in perceptual integration and social cognition. Comparison of these findings with data in autism and other neuropsychiatric conditions provides novel insights on the origins of face tuning in SZ and triggers brain imaging research.

Gender Differences in Familiar Face Recognition and the Influence of Sociocultural Gender Inequality

Are gender differences in face recognition influenced by familiarity and socio-cultural factors? Previous studies have reported gender differences in processing unfamiliar faces, consistently finding a female advantage and a female own-gender bias. However, researchers have recently highlighted that unfamiliar faces are processed less efficiently than familiar faces, which have more robust, invariant representations. To-date, no study has examined whether gender differences exist for familiar face recognition. The current study addressed this by using a famous faces task in a large, web-based sample of  > 2000 participants across different countries. We also sought to examine if differences varied by socio-cultural gender equality within countries. When examining raw accuracy as well when controlling for fame, the results demonstrated that there were no participant gender differences in overall famous face accuracy, in contrast to studies of unfamiliar faces. There was also a consistent own-gender bias in male but not female participants. In countries with low gender equality, including the USA, females showed significantly better recognition of famous female faces compared to male participants, whereas this difference was abolished in high gender equality countries. Together, this suggests that gender differences in recognizing unfamiliar faces can be attenuated when there is enough face learning and that sociocultural gender equality can drive gender differences in familiar face recognition.

Social Cognition in Down Syndrome: Face Tuning in Face-Like Non-Face Images

Individuals with Down syndrome (DS) are widely believed to possess considerable socialization strengths. However, the findings on social cognition capabilities are controversial. In the present study, we investigated whether individuals with DS exhibit shortage in face tuning, one of the indispensable components of social cognition. For this purpose, we implemented a recently developed Face-n-Food paradigm with food-plate images composed of food ingredients such as fruits and vegetables. The key benefit of such face-like non-face images is that single elements do not facilitate face processing. In a spontaneous recognition task, 25 children with DS aged 9 to 18 years were presented with a set of Face-n-Food images bordering on the Giuseppe Arcimboldo style. The set of images was administered in a predetermined order from the least to most resembling a face. In DS individuals, thresholds for recognition of the Face-n-Food images as a face were drastically higher as compared not only with typically developing controls, but also with individuals with autistic spectrum disorders and Williams-Beuren syndrome. This outcome represents a significant step toward better conceptualization of the visual social world in DS and neurodevelopmental disorders in general.

Even subtle cultural differences affect face tuning

Culture shapes social cognition in many ways. Yet cultural impact on face tuning remains largely unclear. Here typically developing females and males from the French-speaking part of Switzerland were presented with a set of Arcimboldo-like Face-n-Food images composed of food ingredients and in different degree resembling a face. The outcome had been compared with previous findings obtained in young adults of the South-West Germany. In that study, males exhibit higher thresholds for face tuning on the Face-n-Food task than females. In Swiss participants, no gender differences exist in face tuning. Strikingly, males from the French-speaking part of Switzerland possess higher sensitivity to faces than their German peers, whereas no difference in face tuning occurs between females. The outcome indicates that even relatively subtle cultural differences as well as culture by gender interaction can modulate social cognition. Clarification of the nature of cultural impact on face tuning as well as social cognition at large is of substantial value for understanding a wide range of neuropsychiatric and neurodevelopmental conditions.

Social cognition in autism: Face tuning

Faces convey valuable information for social cognition, effective interpersonal interaction, and non-verbal communication. Face perception is believed to be atypical in autism, but the origin of this deficit is controversial. Dominant featural face encoding is suggested to be responsible for face tuning scarcity. Here we used a recently developed Face-n-Food paradigm for studying face tuning in individuals with autistic spectrum disorders (ASD). The key benefit of these images is that single components do not explicitly trigger face processing. In a spontaneous recognition task, adolescents with autism and typically developing matched controls were presented with a set of Face-n-Food images in different degree resembling a face (slightly bordering on the Giuseppe Arcimboldo style). The set of images was shown in a predetermined order from the least to most resembling a face. Thresholds for recognition of the Face-n-Food images as a face in ASD individuals were substantially higher than in typically developing controls: they did not report seeing a face on the images, which controls easily recognized as a face, and gave overall fewer face responses. This outcome not only lends support to atypical face tuning, but provides novel insights into the origin of face encoding deficits in autism.

A large-scale analysis of sex differences in facial expressions

There exists a stereotype that women are more expressive than men; however, research has almost exclusively focused on a single facial behavior, smiling. A large-scale study examines whether women are consistently more expressive than men or whether the effects are dependent on the emotion expressed. Studies of gender differences in expressivity have been somewhat restricted to data collected in lab settings or which required labor-intensive manual coding. In the present study, we analyze gender differences in facial behaviors as over 2,000 viewers watch a set of video advertisements in their home environments. The facial responses were recorded using participants’ own webcams. Using a new automated facial coding technology we coded facial activity. We find that women are not universally more expressive across all facial actions. Nor are they more expressive in all positive valence actions and less expressive in all negative valence actions. It appears that generally women express actions more frequently than men, and in particular express more positive valence actions. However, expressiveness is not greater in women for all negative valence actions and is dependent on the discrete emotional state.

Social Cognition in Williams Syndrome: Face Tuning

Many neurological, neurodevelopmental, neuropsychiatric, and psychosomatic disorders are characterized by impairments in visual social cognition, body language reading, and facial assessment of a social counterpart. Yet a wealth of research indicates that individuals with Williams syndrome exhibit remarkable concern for social stimuli and face fascination. Here individuals with Williams syndrome were presented with a set of Face-n-Food images composed of food ingredients and in different degree resembling a face (slightly bordering on the Giuseppe Arcimboldo style). The primary advantage of these images is that single components do not explicitly trigger face-specific processing, whereas in face images commonly used for investigating face perception (such as photographs or depictions), the mere occurrence of typical cues already implicates face presence. In a spontaneous recognition task, participants were shown a set of images in a predetermined order from the least to most resembling a face. Strikingly, individuals with Williams syndrome exhibited profound deficits in recognition of the Face-n-Food images as a face: they did not report seeing a face on the images, which typically developing controls effortlessly recognized as a face, and gave overall fewer face responses. This suggests atypical face tuning in Williams syndrome. The outcome is discussed in the light of a general pattern of social cognition in Williams syndrome and brain mechanisms underpinning face processing.