1
|
Achour-Benallegue A, Pelletier J, Kaminski G, Kawabata H. Facial icons as indexes of emotions and intentions. Front Psychol 2024; 15:1356237. [PMID: 38807962 PMCID: PMC11132266 DOI: 10.3389/fpsyg.2024.1356237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 04/02/2024] [Indexed: 05/30/2024] Open
Abstract
Various objects and artifacts incorporate representations of faces, encompassing artworks like portraits, as well as ethnographic or industrial artifacts such as masks or humanoid robots. These representations exhibit diverse degrees of human-likeness, serving different functions and objectives. Despite these variations, they share common features, particularly facial attributes that serve as building blocks for facial expressions-an effective means of communicating emotions. To provide a unified conceptualization for this broad spectrum of face representations, we propose the term "facial icons" drawing upon Peirce's semiotic concepts. Additionally, based on these semiotic principles, we posit that facial icons function as indexes of emotions and intentions, and introduce a significant anthropological theory aligning with our proposition. Subsequently, we support our assertions by examining processes related to face and facial expression perception, as well as sensorimotor simulation processes involved in discerning others' mental states, including emotions. Our argumentation integrates cognitive and experimental evidence, reinforcing the pivotal role of facial icons in conveying mental states.
Collapse
Affiliation(s)
- Amel Achour-Benallegue
- Cognition, Environment and Communication Research Team, Human Augmentation Research Center, National Institute of Advanced Industrial Science and Technology, Kashiwa, Japan
| | - Jérôme Pelletier
- Institut Jean Nicod, Département d'études cognitives, ENS, EHESS, CNRS, PSL University, Paris, France
- Department of Philosophy, University of Western Brittany, Brest, France
| | - Gwenaël Kaminski
- Cognition, Langues, Langage, Ergonomie, Université de Toulouse, Toulouse, France
- Institut Universitaire de France, Paris, France
| | - Hideaki Kawabata
- Department of Psychology, Faculty of Letters, Keio University, Tokyo, Japan
| |
Collapse
|
2
|
Romagnano V, Kubon J, Sokolov AN, Fallgatter AJ, Braun C, Pavlova MA. Dynamic brain communication underwriting face pareidolia. Proc Natl Acad Sci U S A 2024; 121:e2401196121. [PMID: 38588422 PMCID: PMC11032489 DOI: 10.1073/pnas.2401196121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Accepted: 03/04/2024] [Indexed: 04/10/2024] Open
Abstract
Face pareidolia is a tendency to seeing faces in nonface images that reflects high tuning to a face scheme. Yet, studies of the brain networks underwriting face pareidolia are scarce. Here, we examined the time course and dynamic topography of gamma oscillatory neuromagnetic activity while administering a task with nonface images resembling a face. Images were presented either with canonical orientation or with display inversion that heavily impedes face pareidolia. At early processing stages, the peaks in gamma activity (40 to 45 Hz) to images either triggering or not face pareidolia originate mainly from the right medioventral and lateral occipital cortices, rostral and caudal cuneus gyri, and medial superior occipital gyrus. Yet, the difference occurred at later processing stages in the high-frequency range of 80 to 85 Hz over a set of the areas constituting the social brain. The findings speak rather for a relatively late neural network playing a key role in face pareidolia. Strikingly, a cutting-edge analysis of brain connectivity unfolding over time reveals mutual feedforward and feedback intra- and interhemispheric communication not only within the social brain but also within the extended large-scale network of down- and upstream regions. In particular, the superior temporal sulcus and insula strongly engage in communication with other brain regions either as signal transmitters or recipients throughout the whole processing of face-pareidolia images.
Collapse
Affiliation(s)
- Valentina Romagnano
- Social Neuroscience Unit, Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen72076, Germany
| | - Julian Kubon
- Social Neuroscience Unit, Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen72076, Germany
| | - Alexander N. Sokolov
- Social Neuroscience Unit, Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen72076, Germany
| | - Andreas J. Fallgatter
- Social Neuroscience Unit, Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen72076, Germany
| | - Christoph Braun
- Magnetoencephalography Center, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen72076, Germany
- Hertie Institute for Clinical Brain Research, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen72076, Germany
| | - Marina A. Pavlova
- Social Neuroscience Unit, Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen72076, Germany
| |
Collapse
|
3
|
Romagnano V, Sokolov AN, Fallgatter AJ, Pavlova MA. Do subtle cultural differences sculpt face pareidolia? SCHIZOPHRENIA (HEIDELBERG, GERMANY) 2023; 9:28. [PMID: 37142598 PMCID: PMC10160123 DOI: 10.1038/s41537-023-00355-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 04/10/2023] [Indexed: 05/06/2023]
Abstract
Face tuning to non-face images such as shadows or grilled toasts is termed face pareidolia. Face-pareidolia images represent a valuable tool for investigation of social cognition in mental disorders. Here we examined (i) whether, and, if so, how face pareidolia is affected by subtle cultural differences; and (ii) whether this impact is modulated by gender. With this purpose in mind, females and males from Northern Italy were administered a set of Face-n-Thing images, photographs of objects such as houses or waves to a varying degree resembling a face. Participants were presented with pareidolia images with canonical upright orientation and display inversion that heavily affects face pareidolia. In a two-alternative forced-choice paradigm, beholders had to indicate whether each image resembled a face. The outcome was compared with the findings obtained in the Southwest of Germany. With upright orientation, neither cultural background nor gender affected face pareidolia. As expected, display inversion generally mired face pareidolia. Yet, while display inversion led to a drastic reduction of face impression in German males as compared to females, in Italians, no gender differences were found. In a nutshell, subtle cultural differences do not sculpt face pareidolia, but instead affect face impression in a gender-specific way under unusual viewing conditions. Clarification of the origins of these effects requires tailored brain imaging work. Implications for transcultural psychiatry, in particular, for schizophrenia research, are highlighted and discussed.
Collapse
Affiliation(s)
- Valentina Romagnano
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany
| | - Alexander N Sokolov
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany
| | - Andreas J Fallgatter
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany
| | - Marina A Pavlova
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany.
| |
Collapse
|
4
|
Romagnano V, Sokolov AN, Steinwand P, Fallgatter AJ, Pavlova MA. Face pareidolia in male schizophrenia. SCHIZOPHRENIA (HEIDELBERG, GERMANY) 2022; 8:112. [PMID: 36517504 PMCID: PMC9751144 DOI: 10.1038/s41537-022-00315-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 11/09/2022] [Indexed: 05/22/2023]
Abstract
Faces are valuable signals for efficient social interaction. Yet, social cognition including the sensitivity to a coarse face scheme may be deviant in schizophrenia (SZ). Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is termed face pareidolia. This phenomenon is poorly investigated in SZ. Here face tuning was assessed in 44 male participants with SZ and person-by-person matched controls by using recently created Face-n-Thing images (photographs of non-face objects to a varying degree resembling a face). The advantage of these images is that single components do not automatically trigger face processing. Participants were administered a set of images with upright and inverted (180° in the image plane) orientation. In a two-alternative forced-choice paradigm, they had to indicate whether an image resembled a face. The findings showed that: (i) With upright orientation, SZ patients exhibited deficits in face tuning: they provided much fewer face responses than controls. (ii) Inversion generally hindered face pareidolia. However, while in neurotypical males, inversion led to a drastic drop in face impression, in SZ, the impact of orientation was reduced. (iii) Finally, in accord with the signal detection theory analysis, the sensitivity index (d-prime) was lower in SZ, whereas no difference occurred in decision criterion. The outcome suggests altered face pareidolia in SZ is caused by lower face sensitivity rather than by alterations in cognitive bias. Comparison of these findings with earlier evidence confirms that tuning to social signals is lower in SZ, and warrants tailored brain imaging research.
Collapse
Affiliation(s)
- Valentina Romagnano
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, and Tübingen Center for Mental Health (TüCMH), Tübingen, Germany
| | - Alexander N Sokolov
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, and Tübingen Center for Mental Health (TüCMH), Tübingen, Germany
| | - Patrick Steinwand
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, and Tübingen Center for Mental Health (TüCMH), Tübingen, Germany
| | - Andreas J Fallgatter
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, and Tübingen Center for Mental Health (TüCMH), Tübingen, Germany
| | - Marina A Pavlova
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, and Tübingen Center for Mental Health (TüCMH), Tübingen, Germany.
| |
Collapse
|
5
|
Decramer T, Premereur E, Zhu Q, Van Paesschen W, van Loon J, Vanduffel W, Taubert J, Janssen P, Theys T. Single-Unit Recordings Reveal the Selectivity of a Human Face Area. J Neurosci 2021; 41:9340-9349. [PMID: 34732521 PMCID: PMC8580152 DOI: 10.1523/jneurosci.0349-21.2021] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Revised: 08/24/2021] [Accepted: 08/26/2021] [Indexed: 11/21/2022] Open
Abstract
The exquisite capacity of primates to detect and recognize faces is crucial for social interactions. Although disentangling the neural basis of human face recognition remains a key goal in neuroscience, direct evidence at the single-neuron level is limited. We recorded from face-selective neurons in human visual cortex in a region characterized by functional magnetic resonance imaging (fMRI) activations for faces compared with objects. The majority of visually responsive neurons in this fMRI activation showed strong selectivity at short latencies for faces compared with objects. Feature-scrambled faces and face-like objects could also drive these neurons, suggesting that this region is not tightly tuned to the visual attributes that typically define whole human faces. These single-cell recordings within the human face processing system provide vital experimental evidence linking previous imaging studies in humans and invasive studies in animal models.SIGNIFICANCE STATEMENT We present the first recordings of face-selective neurons in or near an fMRI-defined patch in human visual cortex. Our unbiased multielectrode array recordings (i.e., no selection of neurons based on a search strategy) confirmed the validity of the BOLD contrast (faces-objects) in humans, a finding with implications for all human imaging studies. By presenting faces, feature-scrambled faces, and face-pareidolia (perceiving faces in inanimate objects) stimuli, we demonstrate that neurons at this level of the visual hierarchy are broadly tuned to the features of a face, independent of spatial configuration and low-level visual attributes.
Collapse
Affiliation(s)
- Thomas Decramer
- Research Group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
- Departments of Neurosurgery and
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Elsie Premereur
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Qi Zhu
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Wim Van Paesschen
- Neurology, University Hospitals Leuven, 3000 Leuven, Belgium
- Laboratory for Epilepsy Research, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Johannes van Loon
- Research Group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
- Departments of Neurosurgery and
| | - Wim Vanduffel
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Jessica Taubert
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland 20892
| | - Peter Janssen
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Tom Theys
- Research Group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
- Departments of Neurosurgery and
| |
Collapse
|
6
|
Do you see the “face”? Individual differences in face pareidolia. JOURNAL OF PACIFIC RIM PSYCHOLOGY 2021. [DOI: 10.1017/prp.2019.27] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
People tend to see faces from non-face objects or meaningless patterns. Such illusory face perception is called face pareidolia. Previous studies have revealed an interesting fact that there are huge individual differences in face pareidolia experience among the population. Here, we review previous findings on individual differences in face pareidolia experience from four categories: sex differences, developmental factors, personality traits and neurodevelopmental factors. We further discuss underlying cognitive or neural mechanisms to explain why some perceive the objects as faces while others do not. The individual differences in face pareidolia could not only offer scientific insights on how the brain works to process face information, but also suggest potential clinical applications.
Collapse
|
7
|
Pavlova MA, Romagnano V, Fallgatter AJ, Sokolov AN. Face pareidolia in the brain: Impact of gender and orientation. PLoS One 2021; 15:e0244516. [PMID: 33382767 PMCID: PMC7774913 DOI: 10.1371/journal.pone.0244516] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Accepted: 12/10/2020] [Indexed: 02/08/2023] Open
Abstract
Research on face sensitivity is of particular relevance during the rapidly evolving Covid-19 pandemic leading to social isolation, but also calling for intact interaction and sharing. Humans possess high sensitivity even to a coarse face scheme, seeing faces in non-face images where real faces do not exist. The advantage of non-face images is that single components do not trigger face processing. Here by implementing a novel set of Face-n-Thing images, we examined (i) how face tuning alters with changing display orientation, and (ii) whether it is affected by observers’ gender. Young females and males were presented with a set of Face-n-Thing images either with canonical upright orientation or inverted 180° in the image plane. Face impression was substantially impeded by display inversion. Furthermore, whereas with upright display orientation, no gender differences were found, with inversion, Face-n-Thing images elicited face impression in females significantly more often. The outcome sheds light on the origins of the face inversion effect in general. Moreover, the findings open a way for examination of face sensitivity and underwriting brain networks in neuropsychiatric conditions related to the current pandemic (such as depression and anxiety), most of which are gender/sex-specific.
Collapse
Affiliation(s)
- Marina A. Pavlova
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany
- * E-mail:
| | - Valentina Romagnano
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany
| | - Andreas J. Fallgatter
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany
- LEAD Graduate School & Research Network, Eberhard Karls University of Tübingen, Tübingen, Germany
- German Center for Neurodegenerative Disorders (DZNE), Medical School and University Hospital, Tübingen, Germany
| | - Alexander N. Sokolov
- Department of Psychiatry and Psychotherapy, Medical School and University Hospital, Eberhard Karls University of Tübingen, Tübingen, Germany
| |
Collapse
|
8
|
Akdeniz G, Gumusyayla S, Vural G, Bektas H, Deniz O. Changes in face and face pareidolia processing in patients with migraine: an ERP study. J Neurophysiol 2020; 123:876-884. [PMID: 31940235 DOI: 10.1152/jn.00549.2019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Migraine is a multifactorial brain disorder characterized by recurrent disabling headache attacks. One of the possible mechanisms in the pathogenesis of migraine may be a decrease in inhibitory cortical stimuli in the primary visual cortex attributable to cortical hyperexcitability. The aim of this study was to investigate the neural correlates underlying face and face pareidolia processing in terms of the event-related potential (ERP) components, N170, vertex positive potential (VPP), and N250, in patients with migraine. In total, 40 patients with migraine without aura, 23 patients with migraine and aura, and 30 healthy controls were enrolled. We recorded ERPs during the presentation of face and face pareidolia images. N170, VPP, and N250 mean amplitudes and latencies were examined. N170 was significantly greater in patients with migraine with aura than in healthy controls. VPP amplitude was significantly greater in patients with migraine without aura than in healthy controls. The face stimuli evoked significantly earlier VPP responses to faces (168.7 ms, SE = 1.46) than pareidolias (173.4 ms, SE = 1.41) in patients with migraine with aura. We did not find a significant difference between N250 amplitude for face and face pareidolia processing. A significant difference was observed between the groups for pareidolia in terms of N170 [F(2,86) = 14,75, P < 0.001] and VPP [F(2,86) = 16.43, P < 0.001] amplitudes. Early ERPs are a valuable tool to study the neural processing of face processing in patients with migraine to demonstrate visual cortical hyperexcitability.NEW & NOTEWORTHY Event-related potentials (ERPs) are important for understanding face and face pareidolia processing in patients with migraine. N170, vertex positive potential (VPP), and N250 ERPs were investigated. N170 was revealed as a potential component of cortical excitability for face and face pareidolia processing in patients with migraine.
Collapse
Affiliation(s)
- Gülsüm Akdeniz
- Department of Biophysics and Neuroscience, Electroneurophysiology Laboratory, Yenimahalle Training and Research Hospital, Ankara, Turkey
| | - Sadiye Gumusyayla
- Department of Neurology, School of Medicine, Yildirim Beyazit University, Ankara, Turkey
| | - Gonul Vural
- Department of Neurology, School of Medicine, Yildirim Beyazit University, Ankara, Turkey
| | - Hesna Bektas
- Department of Neurology, School of Medicine, Yildirim Beyazit University, Ankara, Turkey
| | - Orhan Deniz
- Department of Neurology, School of Medicine, Yildirim Beyazit University, Ankara, Turkey
| |
Collapse
|
9
|
Akdeniz G. A Validity and Reliability Study of Pareidolia Test. ANKARA MEDICAL JOURNAL 2018. [DOI: 10.17098/amj.461661] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
|