1
|
Saurels BW, Peluso N, Taubert J. A behavioral advantage for the face pareidolia illusion in peripheral vision. Sci Rep 2024; 14:10040. [PMID: 38693189 PMCID: PMC11063176 DOI: 10.1038/s41598-024-60892-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 04/29/2024] [Indexed: 05/03/2024] Open
Abstract
Investigation of visual illusions helps us understand how we process visual information. For example, face pareidolia, the misperception of illusory faces in objects, could be used to understand how we process real faces. However, it remains unclear whether this illusion emerges from errors in face detection or from slower, cognitive processes. Here, our logic is straightforward; if examples of face pareidolia activate the mechanisms that rapidly detect faces in visual environments, then participants will look at objects more quickly when the objects also contain illusory faces. To test this hypothesis, we sampled continuous eye movements during a fast saccadic choice task-participants were required to select either faces or food items. During this task, pairs of stimuli were positioned close to the initial fixation point or further away, in the periphery. As expected, the participants were faster to look at face targets than food targets. Importantly, we also discovered an advantage for food items with illusory faces but, this advantage was limited to the peripheral condition. These findings are among the first to demonstrate that the face pareidolia illusion persists in the periphery and, thus, it is likely to be a consequence of erroneous face detection.
Collapse
Affiliation(s)
- Blake W Saurels
- School of Psychology, The University of Queensland, St Lucia, Queensland, Australia
| | - Natalie Peluso
- School of Psychology, The University of Queensland, St Lucia, Queensland, Australia
| | - Jessica Taubert
- School of Psychology, The University of Queensland, St Lucia, Queensland, Australia.
| |
Collapse
|
2
|
Moses E, Nelson N, Taubert J, Pegna AJ. Oxytocin differentially modulates the early neural responses to faces and non-social stimuli. Soc Cogn Affect Neurosci 2024; 19:nsae010. [PMID: 38372627 PMCID: PMC10876073 DOI: 10.1093/scan/nsae010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 07/30/2023] [Accepted: 02/14/2024] [Indexed: 02/20/2024] Open
Abstract
Oxytocin (OT) alters social cognition partly through effects on the processing and appraisal of faces. It is debated whether the hormone also impacts the processing of other, non-social, visual stimuli. To this end, we conducted a randomized, counter-balanced, double-blind, placebo (PL)-controlled within-subjects' electro-encephalography (EEG) study with cismale participants (to control for gender dimorphic hormonal effects; n = 37). Participants received intranasal OT (24IU) and completed a one-back task viewing emotional (fearful/ happy) and neutral faces, and threat (snakes/spiders) and non-threat (mushrooms/flowers) non-social stimuli. OT differentially impacted event-related potentials (ERP)s to faces and non-social stimuli. For faces regardless of emotion, OT evoked greater occipital N1 and anterior P1 amplitudes at ∼155 ms than after PL, and lead to sustained differences over anterior, bilateral parietal and occipital sites from 205 ms onwards. For all non-social stimuli, OT evoked greater right parietal N1 amplitudes, and later only impacted threat stimuli over right parietal and occipital sites. None of these OT-induced modulations was related to individual anxiety levels. This pattern of results indicates that OT differentially modulates the processing of faces and non-social stimuli, and that the hormone's effect on visual processing and cognition does not occur as a function of non-clinical levels of anxiety.
Collapse
Affiliation(s)
- Eleanor Moses
- School of Psychology, The University of Queensland, Brisbane 4072, Australia
| | - Nicole Nelson
- School of Psychology, University of Adelaide, Adelaide 5000, Australia
| | - Jessica Taubert
- School of Psychology, The University of Queensland, Brisbane 4072, Australia
| | - Alan J Pegna
- School of Psychology, The University of Queensland, Brisbane 4072, Australia
| |
Collapse
|
3
|
Taubert J, Japee S. Real Face Value: The Processing of Naturalistic Facial Expressions in the Macaque Inferior Temporal Cortex. J Cogn Neurosci 2024:1-17. [PMID: 38261366 DOI: 10.1162/jocn_a_02108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
For primates, expressions of fear are thought to be powerful social signals. In laboratory settings, faces with fearful expressions have reliably evoked valence effects in inferior temporal cortex. However, because macaques use so called "fear grins" in a variety of different contexts, the deeper question is whether the macaque inferior temporal cortex is tuned to the prototypical fear grin, or to conspecifics signaling fear? In this study, we combined neuroimaging with the results of a behavioral task to investigate how macaques encode a wide variety of fearful facial expressions. In Experiment 1, we identified two sets of macaque face stimuli using different approaches; we selected faces based on the emotional context (i.e., calm vs. fearful), and we selected faces based on the engagement of action units (i.e., neutral vs. fear grins). We also included human faces in Experiment 1. Then, using fMRI, we found that the faces selected based on context elicited a larger valence effect in the inferior temporal cortex than faces selected based on visual appearance. Furthermore, human facial expressions only elicited weak valence effects. These observations were further supported by the results of a two-alternative, forced-choice task (Experiment 2), suggesting that fear grins vary in their perceived pleasantness. Collectively, these findings indicate that the macaque inferior temporal cortex is more involved in social intelligence than commonly assumed, encoding emergent properties in naturalistic face stimuli that transcend basic visual features. These results demand a rethinking of theories surrounding the function and operationalization of primate inferior temporal cortex.
Collapse
Affiliation(s)
- Jessica Taubert
- The National Institute of Mental Health, Bethesda, MD
- The University of Queensland
| | - Shruti Japee
- The National Institute of Mental Health, Bethesda, MD
| |
Collapse
|
4
|
Azadi R, Lopez E, Taubert J, Patterson A, Afraz A. Inactivation of face-selective neurons alters eye movements when free viewing faces. Proc Natl Acad Sci U S A 2024; 121:e2309906121. [PMID: 38198528 PMCID: PMC10801883 DOI: 10.1073/pnas.2309906121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 10/06/2023] [Indexed: 01/12/2024] Open
Abstract
During free viewing, faces attract gaze and induce specific fixation patterns corresponding to the facial features. This suggests that neurons encoding the facial features are in the causal chain that steers the eyes. However, there is no physiological evidence to support a mechanistic link between face-encoding neurons in high-level visual areas and the oculomotor system. In this study, we targeted the middle face patches of the inferior temporal (IT) cortex in two macaque monkeys using an functional magnetic resonance imaging (fMRI) localizer. We then utilized muscimol microinjection to unilaterally suppress IT neural activity inside and outside the face patches and recorded eye movements while the animals free viewing natural scenes. Inactivation of the face-selective neurons altered the pattern of eye movements on faces: The monkeys found faces in the scene but neglected the eye contralateral to the inactivation hemisphere. These findings reveal the causal contribution of the high-level visual cortex in eye movements.
Collapse
Affiliation(s)
- Reza Azadi
- Unit on Neurons, Circuits and Behavior, Laboratory of Neuropsychology, National Institute of Mental Health, NIH, Bethesda, MD20892
| | - Emily Lopez
- Unit on Neurons, Circuits and Behavior, Laboratory of Neuropsychology, National Institute of Mental Health, NIH, Bethesda, MD20892
| | - Jessica Taubert
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, NIH, Bethesda, MD20892
- School of Psychology, The University of Queensland, Brisbane, QLD4072, Australia
| | - Amanda Patterson
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, NIH, Bethesda, MD20892
| | - Arash Afraz
- Unit on Neurons, Circuits and Behavior, Laboratory of Neuropsychology, National Institute of Mental Health, NIH, Bethesda, MD20892
| |
Collapse
|
5
|
Katti H, Valiyamattam G, Taubert J, Nadig A. Editorial: Improving the quality of life of autistic people and their caregivers from diverse backgrounds: methods and approaches. Front Psychol 2023; 14:1242236. [PMID: 38022950 PMCID: PMC10680255 DOI: 10.3389/fpsyg.2023.1242236] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Accepted: 10/23/2023] [Indexed: 12/01/2023] Open
Affiliation(s)
- Harish Katti
- National Institute of Mental Health, Bethesda, MD, United States
| | | | - Jessica Taubert
- The School of Psychology, The University of Queensland, St. Lucia, QLD, Australia
| | - Aparna Nadig
- School of Communication Sciences and Disorders, McGill University, Montreal, QC, Canada
| |
Collapse
|
6
|
Bouyer LN, Arnold DH, Johnston A, Taubert J. Predictive extrapolation effects can have a greater impact on visual decisions, while visual adaptation has a greater impact on conscious visual experience. Conscious Cogn 2023; 115:103583. [PMID: 37839114 DOI: 10.1016/j.concog.2023.103583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 09/19/2023] [Accepted: 09/30/2023] [Indexed: 10/17/2023]
Abstract
Human vision is shaped by historic and by predictive processes. The lingering impact of visual adaptation, for instance, can act to exaggerate differences between past and present inputs, whereas predictive processes can promote extrapolation effects that allow us to anticipate the near future. It is unclear to what extent either of these effects manifest in changes to conscious visual experience. It is also unclear how these influences combine, when acting in concert or opposition. We had people make decisions about the sizes of inputs, and report on levels of decisional confidence. Tests were either selectively subject to size adaptation, to an extrapolation effect, or to both of these effects. When these two effects were placed in opposition, extrapolation had a greater impact on decision making. However, our data suggest the influence of extrapolation is primarily decisional, whereas size adaptation more fully manifests in changes to conscious visual awareness.
Collapse
Affiliation(s)
- Loren N Bouyer
- School of Psychology, The University of Queensland, Australia
| | - Derek H Arnold
- School of Psychology, The University of Queensland, Australia.
| | - Alan Johnston
- School of Psychology, The University of Nottingham, UK
| | - Jessica Taubert
- School of Psychology, The University of Queensland, Australia
| |
Collapse
|
7
|
Taubert J, Wally S, Dixson BJ. Preliminary evidence of an increased susceptibility to face pareidolia in postpartum women. Biol Lett 2023; 19:20230126. [PMID: 37700700 PMCID: PMC10498352 DOI: 10.1098/rsbl.2023.0126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Accepted: 08/24/2023] [Indexed: 09/14/2023] Open
Abstract
As primates, we are hypersensitive to faces and face-like patterns in the visual environment, hence we often perceive illusory faces in otherwise inanimate objects, such as burnt pieces of toast and the surface of the moon. Although this phenomenon, known as face pareidolia, is a common experience, it is unknown whether our susceptibility to face pareidolia is static across our lifespan or what factors would cause it to change. Given the evidence that behaviour towards face stimuli is modulated by the neuropeptide oxytocin (OT), we reasoned that participants in stages of life associated with high levels of endogenous OT might be more susceptible to face pareidolia than participants in other stages of life. We tested this hypothesis by assessing pareidolia susceptibility in two groups of women; pregnant women (low endogenous OT) and postpartum women (high endogenous OT). We found evidence that postpartum women report seeing face pareidolia more easily than women who are currently pregnant. These data, collected online, suggest that our sensitivity to face-like patterns is not fixed and may change throughout adulthood, providing a crucial proof of concept that requires further research.
Collapse
Affiliation(s)
- Jessica Taubert
- School of Psychology, The University of Queensland, McElwain Building, St Lucia, 4072 Brisbane, Queensland, Australia
| | - Samantha Wally
- School of Psychology, The University of Queensland, McElwain Building, St Lucia, 4072 Brisbane, Queensland, Australia
| | - Barnaby J. Dixson
- School of Psychology, The University of Queensland, McElwain Building, St Lucia, 4072 Brisbane, Queensland, Australia
- Psychology and Social Sciences, The University of Sunshine Coast, Sippy Downs, Australia
| |
Collapse
|
8
|
Azadi R, Lopez E, Taubert J, Patterson A, Afraz A. Inactivation of face selective neurons alters eye movements when free viewing faces. bioRxiv 2023:2023.06.20.544678. [PMID: 37502993 PMCID: PMC10370202 DOI: 10.1101/2023.06.20.544678] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
During free viewing, faces attract gaze and induce specific fixation patterns corresponding to the facial features. This suggests that neurons encoding the facial features are in the causal chain that steers the eyes. However, there is no physiological evidence to support a mechanistic link between face encoding neurons in high-level visual areas and the oculomotor system. In this study, we targeted the middle face patches of inferior temporal (IT) cortex in two macaque monkeys using an fMRI localizer. We then utilized muscimol microinjection to unilaterally suppress IT neural activity inside and outside the face patches and recorded eye movements while the animals free viewing natural scenes. Inactivation of the face selective neurons altered the pattern of eye movements on faces: the monkeys found faces in the scene but neglected the eye contralateral to the inactivation hemisphere. These findings reveal the causal contribution of the high-level visual cortex in eye movements. Significance It has been shown, for more than half a century, that eye movements follow distinctive patterns when free viewing faces. This suggests causal involvement of the face-encoding visual neurons in the eye movements. However, the literature is scant of evidence for this possibility and has focused mostly on the link between low-level image saliency and eye movements. Here, for the first time, we bring causal evidence showing how face-selective neurons in inferior temporal cortex inform and steer eye movements when free viewing faces.
Collapse
|
9
|
Long H, Peluso N, Baker CI, Japee S, Taubert J. A database of heterogeneous faces for studying naturalistic expressions. Sci Rep 2023; 13:5383. [PMID: 37012369 PMCID: PMC10070342 DOI: 10.1038/s41598-023-32659-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 03/30/2023] [Indexed: 04/05/2023] Open
Abstract
Facial expressions are thought to be complex visual signals, critical for communication between social agents. Most prior work aimed at understanding how facial expressions are recognized has relied on stimulus databases featuring posed facial expressions, designed to represent putative emotional categories (such as 'happy' and 'angry'). Here we use an alternative selection strategy to develop the Wild Faces Database (WFD); a set of one thousand images capturing a diverse range of ambient facial behaviors from outside of the laboratory. We characterized the perceived emotional content in these images using a standard categorization task in which participants were asked to classify the apparent facial expression in each image. In addition, participants were asked to indicate the intensity and genuineness of each expression. While modal scores indicate that the WFD captures a range of different emotional expressions, in comparing the WFD to images taken from other, more conventional databases, we found that participants responded more variably and less specifically to the wild-type faces, perhaps indicating that natural expressions are more multiplexed than a categorical model would predict. We argue that this variability can be employed to explore latent dimensions in our mental representation of facial expressions. Further, images in the WFD were rated as less intense and more genuine than images taken from other databases, suggesting a greater degree of authenticity among WFD images. The strong positive correlation between intensity and genuineness scores demonstrating that even the high arousal states captured in the WFD were perceived as authentic. Collectively, these findings highlight the potential utility of the WFD as a new resource for bridging the gap between the laboratory and real world in studies of expression recognition.
Collapse
Affiliation(s)
- Houqiu Long
- The School of Psychology, The University of Queensland, St Lucia, QLD, Australia
| | - Natalie Peluso
- The School of Psychology, The University of Queensland, St Lucia, QLD, Australia
| | - Chris I Baker
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| | - Shruti Japee
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| | - Jessica Taubert
- The School of Psychology, The University of Queensland, St Lucia, QLD, Australia.
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA.
| |
Collapse
|
10
|
Taubert J, Wardle SG, Patterson A, Baker CI. Beyond faces: Characterizing the response of the amygdala to visual stimuli. J Vis 2022. [DOI: 10.1167/jov.22.14.3054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Affiliation(s)
- Jessica Taubert
- The University of Queensland
- The National Institute of Mental Health
| | | | | | | |
Collapse
|
11
|
Rana K, Sargeant M, Taubert J, Ungerleider L, Merriam E. Gamma-band connectivity suggests a functional pathway from the amygdala to the anterior temporal lobe during face processing. J Vis 2022. [DOI: 10.1167/jov.22.14.3836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
12
|
Sargeant MM, Rana K, Taubert J, Ungerleider LG, Merriam EP. Dynamic binding of faces and bodies when recognizing emotional expression. J Vis 2022. [DOI: 10.1167/jov.22.14.4244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
13
|
Taubert J, Japee S, Patterson A, Wild H, Goyal S, Yu D, Ungerleider LG. A broadly tuned network for affective body language in the macaque brain. Sci Adv 2022; 8:eadd6865. [PMID: 36427322 PMCID: PMC9699662 DOI: 10.1126/sciadv.add6865] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Accepted: 10/27/2022] [Indexed: 06/16/2023]
Abstract
Body language is a powerful tool that we use to communicate how we feel, but it is unclear whether other primates also communicate in this way. Here, we use functional magnetic resonance imaging to show that the body-selective patches in macaques are activated by affective body language. Unexpectedly, we found these regions to be tolerant of naturalistic variation in posture as well as species; the bodies of macaques, humans, and domestic cats all evoked a stronger response when they conveyed fear than when they conveyed no affect. Multivariate analyses confirmed that the neural representation of fear-related body expressions was species-invariant. Collectively, these findings demonstrate that, like humans, macaques have body-selective brain regions in the ventral visual pathway for processing affective body language. These data also indicate that representations of body stimuli in these regions are built on the basis of emergent properties, such as socio-affective meaning, and not just putative image properties.
Collapse
Affiliation(s)
- Jessica Taubert
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
- School of Psychology, The University of Queensland, Brisbane, QLD 4072, Australia
| | - Shruti Japee
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
| | - Amanda Patterson
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
| | - Hannah Wild
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
| | - Shivani Goyal
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
| | - David Yu
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
| | - Leslie G. Ungerleider
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
| |
Collapse
|
14
|
Taubert J, Wardle SG, Tardiff CT, Patterson A, Yu D, Baker CI. Clutter Substantially Reduces Selectivity for Peripheral Faces in the Macaque Brain. J Neurosci 2022; 42:6739-6750. [PMID: 35868861 PMCID: PMC9436017 DOI: 10.1523/jneurosci.0232-22.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 04/29/2022] [Accepted: 06/06/2022] [Indexed: 11/21/2022] Open
Abstract
According to a prominent view in neuroscience, visual stimuli are coded by discrete cortical networks that respond preferentially to specific categories, such as faces or objects. However, it remains unclear how these category-selective networks respond when viewing conditions are cluttered, i.e., when there is more than one stimulus in the visual field. Here, we asked three questions: (1) Does clutter reduce the response and selectivity for faces as a function of retinal location? (2) Is the preferential response to faces uniform across the visual field? And (3) Does the ventral visual pathway encode information about the location of cluttered faces? We used fMRI to measure the response of the face-selective network in awake, fixating macaques (two female, five male). Across a series of four experiments, we manipulated the presence and absence of clutter, as well as the location of the faces relative to the fovea. We found that clutter reduces the response to peripheral faces. When presented in isolation, without clutter, the selectivity for faces is fairly uniform across the visual field, but, when clutter is present, there is a marked decrease in the selectivity for peripheral faces. We also found no evidence of a contralateral visual field bias when faces were presented in clutter. Nonetheless, multivariate analyses revealed that the location of cluttered faces could be decoded from the multivoxel response of the face-selective network. Collectively, these findings demonstrate that clutter blunts the selectivity of the face-selective network to peripheral faces, although information about their retinal location is retained.SIGNIFICANCE STATEMENT Numerous studies that have measured brain activity in macaques have found visual regions that respond preferentially to faces. Although these regions are thought to be essential for social behavior, their responses have typically been measured while faces were presented in isolation, a situation atypical of the real world. How do these regions respond when faces are presented with other stimuli? We report that, when clutter is present, the preferential response to foveated faces is spared but preferential response to peripheral faces is reduced. Our results indicate that the presence of clutter changes the response of the face-selective network.
Collapse
Affiliation(s)
- Jessica Taubert
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland 20814
- School of Psychology, The University of Queensland, Brisbane, Queensland 4072, Australia
| | - Susan G Wardle
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland 20814
| | - Clarissa T Tardiff
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland 20814
| | - Amanda Patterson
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland 20814
| | - David Yu
- Neurophysiology Imaging Facility, National Institutes of Health, Bethesda, Maryland 20814
| | - Chris I Baker
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland 20814
| |
Collapse
|
15
|
Flessert M, Taubert J, Beran MJ. Assessing the perception of face pareidolia in children (Homo sapiens), rhesus monkeys (Macaca mulatta), and capuchin monkeys (Sapajus apella). J Comp Psychol 2022:2022-81173-001. [PMID: 35834209 DOI: 10.1037/com0000320] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Face pareidolia is the misperception of a face in an inanimate object and is a common feature of the face detection system in humans. Whereas there are many similarities in how humans and nonhuman animals such as monkeys perceive and respond to faces, it is still unclear whether other species also perceive certain nonface stimuli as faces. We presented a novel computerized task to capuchin monkeys (Sapajus apella), rhesus monkeys (Macaca mulatta), and preschool-aged children (Homo sapiens). This task trained subjects to choose faces over nonface images, and then presented pareidolia images with nonface images. All species selected faces most often on trials that included face images. However, only children selected pareidolia images at levels above chance. These results indicate that while children report perceiving face pareidolia, monkeys do not. These species differences could be due to human-unique experiences that result in an increased aptitude for anthropomorphizing objects with face-like patterns. It could also be due to monkeys showing a greater reliance on stimulus features rather than global, holistically organized cues that faces provide. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
|
16
|
Taubert J, Wardle SG, Tardiff CT, Koele EA, Kumar S, Messinger A, Ungerleider LG. The cortical and subcortical correlates of face pareidolia in the macaque brain. Soc Cogn Affect Neurosci 2022; 17:965-976. [PMID: 35445247 PMCID: PMC9629476 DOI: 10.1093/scan/nsac031] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 03/27/2022] [Accepted: 04/19/2022] [Indexed: 01/12/2023] Open
Abstract
Face detection is a foundational social skill for primates. This vital function is thought to be supported by specialized neural mechanisms; however, although several face-selective regions have been identified in both humans and nonhuman primates, there is no consensus about which region(s) are involved in face detection. Here, we used naturally occurring errors of face detection (i.e. objects with illusory facial features referred to as examples of 'face pareidolia') to identify regions of the macaque brain implicated in face detection. Using whole-brain functional magnetic resonance imaging to test awake rhesus macaques, we discovered that a subset of face-selective patches in the inferior temporal cortex, on the lower lateral edge of the superior temporal sulcus, and the amygdala respond more to objects with illusory facial features than matched non-face objects. Multivariate analyses of the data revealed differences in the representation of illusory faces across the functionally defined regions of interest. These differences suggest that the cortical and subcortical face-selective regions contribute uniquely to the detection of facial features. We conclude that face detection is supported by a multiplexed system in the primate brain.
Collapse
Affiliation(s)
- Jessica Taubert
- Correspondence should be addressed to Jessica Taubert, School of Psychology, The University of Queensland, Building 24A, St Lucia, QLD 4067, Australia. E-mail:
| | - Susan G Wardle
- Laboratory of Brain and Cognition, The National Institute of Mental Health, NIH, Bethesda, MD 20892, USA
| | - Clarissa T Tardiff
- Laboratory of Brain and Cognition, The National Institute of Mental Health, NIH, Bethesda, MD 20892, USA
| | - Elissa A Koele
- Laboratory of Brain and Cognition, The National Institute of Mental Health, NIH, Bethesda, MD 20892, USA
| | - Susheel Kumar
- Laboratory of Brain and Cognition, The National Institute of Mental Health, NIH, Bethesda, MD 20892, USA
| | - Adam Messinger
- Laboratory of Brain and Cognition, The National Institute of Mental Health, NIH, Bethesda, MD 20892, USA
| | | |
Collapse
|
17
|
Decramer T, Premereur E, Zhu Q, Van Paesschen W, van Loon J, Vanduffel W, Taubert J, Janssen P, Theys T. Single-Unit Recordings Reveal the Selectivity of a Human Face Area. J Neurosci 2021; 41:9340-9349. [PMID: 34732521 PMCID: PMC8580152 DOI: 10.1523/jneurosci.0349-21.2021] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Revised: 08/24/2021] [Accepted: 08/26/2021] [Indexed: 11/21/2022] Open
Abstract
The exquisite capacity of primates to detect and recognize faces is crucial for social interactions. Although disentangling the neural basis of human face recognition remains a key goal in neuroscience, direct evidence at the single-neuron level is limited. We recorded from face-selective neurons in human visual cortex in a region characterized by functional magnetic resonance imaging (fMRI) activations for faces compared with objects. The majority of visually responsive neurons in this fMRI activation showed strong selectivity at short latencies for faces compared with objects. Feature-scrambled faces and face-like objects could also drive these neurons, suggesting that this region is not tightly tuned to the visual attributes that typically define whole human faces. These single-cell recordings within the human face processing system provide vital experimental evidence linking previous imaging studies in humans and invasive studies in animal models.SIGNIFICANCE STATEMENT We present the first recordings of face-selective neurons in or near an fMRI-defined patch in human visual cortex. Our unbiased multielectrode array recordings (i.e., no selection of neurons based on a search strategy) confirmed the validity of the BOLD contrast (faces-objects) in humans, a finding with implications for all human imaging studies. By presenting faces, feature-scrambled faces, and face-pareidolia (perceiving faces in inanimate objects) stimuli, we demonstrate that neurons at this level of the visual hierarchy are broadly tuned to the features of a face, independent of spatial configuration and low-level visual attributes.
Collapse
Affiliation(s)
- Thomas Decramer
- Research Group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
- Departments of Neurosurgery and
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Elsie Premereur
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Qi Zhu
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Wim Van Paesschen
- Neurology, University Hospitals Leuven, 3000 Leuven, Belgium
- Laboratory for Epilepsy Research, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Johannes van Loon
- Research Group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
- Departments of Neurosurgery and
| | - Wim Vanduffel
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Jessica Taubert
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland 20892
| | - Peter Janssen
- Laboratory for Neuro- and Psychophysiology, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
| | - Tom Theys
- Research Group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, Leuven Brain Institute, 3000 Leuven, Belgium
- Departments of Neurosurgery and
| |
Collapse
|
18
|
Rana K, Sargeant M, Taubert J, Ungerleider L. Time-varying functional connectivity reveals fast, band-limited communication between amygdala and cortex during face presentation. J Vis 2021. [DOI: 10.1167/jov.21.9.2622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
19
|
Paranjape S, Wardle SG, Taubert J, Baker CI. Illusory faces are more likely to be perceived as male than female. J Vis 2021. [DOI: 10.1167/jov.21.9.1990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
20
|
Abstract
Facial expressions are vital for social communication, yet the underlying mechanisms are still being discovered. Illusory faces perceived in objects (face pareidolia) are errors of face detection that share some neural mechanisms with human face processing. However, it is unknown whether expression in illusory faces engages the same mechanisms as human faces. Here, using a serial dependence paradigm, we investigated whether illusory and human faces share a common expression mechanism. First, we found that images of face pareidolia are reliably rated for expression, within and between observers, despite varying greatly in visual features. Second, they exhibit positive serial dependence for perceived facial expression, meaning an illusory face (happy or angry) is perceived as more similar in expression to the preceding one, just as seen for human faces. This suggests illusory and human faces engage similar mechanisms of temporal continuity. Third, we found robust cross-domain serial dependence of perceived expression between illusory and human faces when they were interleaved, with serial effects larger when illusory faces preceded human faces than the reverse. Together, the results support a shared mechanism for facial expression between human faces and illusory faces and suggest that expression processing is not tightly bound to human facial features.
Collapse
Affiliation(s)
- David Alais
- School of Psychology, The University of Sydney, Sydney, New South Wales, Australia
| | - Yiben Xu
- School of Psychology, The University of Sydney, Sydney, New South Wales, Australia
| | - Susan G Wardle
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| | - Jessica Taubert
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| |
Collapse
|
21
|
Taubert J, Japee S. Using FACS to trace the neural specializations underlying the recognition of facial expressions: A commentary on Waller et al. (2020). Neurosci Biobehav Rev 2020; 120:75-77. [PMID: 33227326 DOI: 10.1016/j.neubiorev.2020.10.016] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 10/20/2020] [Accepted: 10/30/2020] [Indexed: 02/08/2023]
Abstract
In the recent review by Waller et al. (2020) the authors discuss how the Facial Action Coding System (FACS) can be used to study the evolution of facial behaviors. This is a timely and thought-provoking review which highlights the numerous ways in which FACS could be used to compare the mechanisms responsible for the production of facial behaviors across species. We propose that FACS could also be used to study the recognition of facial behaviors in nonhuman subjects where one of the key challenges is finding suitable stimuli that convey different emotions. By using FACS-rated images in awake neuroimaging experiments, researchers could accurately identify the brain mechanisms responsible for recognizing expressions across mammalian species. This approach would reveal neural homologs and deepen our understanding of how nonverbal social communication has evolved.
Collapse
Affiliation(s)
- Jessica Taubert
- The Laboratory of Brain and Cognition, The National Institute of Mental Health, United States.
| | - Shruti Japee
- The Laboratory of Brain and Cognition, The National Institute of Mental Health, United States
| |
Collapse
|
22
|
Patterson A, Taubert J, Azadi R, Wardle SG, Afraz A, Ungerleider LG. Emotional valence mediates attention to illusory facial features in rhesus monkeys. J Vis 2020. [DOI: 10.1167/jov.20.11.1329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
| | | | - Reza Azadi
- Psychological & Brain Sciences, University of California, Santa Barbara
| | - Susan G Wardle
- Department of Radiology, New York University School of Medicine, NYU Langone Health, New York, USA
| | - Arash Afraz
- Department of Kinesiology, York University, Toronto, ON, Canada
| | | |
Collapse
|
23
|
Wild H, Goyal S, Japee S, Ungerleider L, Taubert J. Cross-species characterization of facial expression and head orientation processing. J Vis 2020. [DOI: 10.1167/jov.20.11.1273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Hannah Wild
- Laboratory of Brain and Cognition, NIMH, NIH
| | | | | | | | | |
Collapse
|
24
|
Alais D, Xu Y, Wardle S, Taubert J. Expression in human and illusory faces (pareidolia) shows cross-domain serial dependence: evidence for common processing. J Vis 2020. [DOI: 10.1167/jov.20.11.1748] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
| | - Yiben Xu
- The University of Sydney, Australia
| | | | | |
Collapse
|
25
|
Wardle SG, Taubert J, Teichmann L, Baker CI. Rapid and dynamic processing of face pareidolia in the human brain. Nat Commun 2020; 11:4518. [PMID: 32908146 PMCID: PMC7481186 DOI: 10.1038/s41467-020-18325-8] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Accepted: 08/07/2020] [Indexed: 11/09/2022] Open
Abstract
The human brain is specialized for face processing, yet we sometimes perceive illusory faces in objects. It is unknown whether these natural errors of face detection originate from a rapid process based on visual features or from a slower, cognitive re-interpretation. Here we use a multifaceted approach to understand both the spatial distribution and temporal dynamics of illusory face representation in the brain by combining functional magnetic resonance imaging and magnetoencephalography neuroimaging data with model-based analysis. We find that the representation of illusory faces is confined to occipital-temporal face-selective visual cortex. The temporal dynamics reveal a striking evolution in how illusory faces are represented relative to human faces and matched objects. Illusory faces are initially represented more similarly to real faces than matched objects are, but within ~250 ms, the representation transforms, and they become equivalent to ordinary objects. This is consistent with the initial recruitment of a broadly-tuned face detection mechanism which privileges sensitivity over selectivity.
Collapse
Affiliation(s)
- Susan G Wardle
- Section on Learning and Plasticity, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA.
| | - Jessica Taubert
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| | - Lina Teichmann
- Section on Learning and Plasticity, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA.,Department of Cognitive Science, Macquarie University, Sydney, NSW, Australia
| | - Chris I Baker
- Section on Learning and Plasticity, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| |
Collapse
|
26
|
Silson EH, Kumar S, Jung B, Koele E, James C, Messinger A, Baker CI, Taubert J. Comparing population receptive fields in human and macaque visual cortex. J Vis 2019. [DOI: 10.1167/19.10.123a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
27
|
|
28
|
Wardle SG, Taubert J, Teichmann L, Baker CI. Rapid processing of illusory faces in inanimate objects by the human brain. J Vis 2019. [DOI: 10.1167/19.10.92b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Susan G Wardle
- Laboratory of Brain & Cognition, National Institute of Mental Health
| | - Jessica Taubert
- Laboratory of Brain & Cognition, National Institute of Mental Health
| | | | - Chris I Baker
- Laboratory of Brain & Cognition, National Institute of Mental Health
| |
Collapse
|
29
|
Rossion B, Taubert J. What can we learn about human individual face recognition from experimental studies in monkeys? Vision Res 2019; 157:142-158. [DOI: 10.1016/j.visres.2018.03.012] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2017] [Revised: 03/22/2018] [Accepted: 03/29/2018] [Indexed: 10/28/2022]
|
30
|
Keys R, Taubert J, Wardle S. A visual search advantage for illusory faces in inanimate objects. J Vis 2018. [DOI: 10.1167/18.10.172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Robert Keys
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Jessica Taubert
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Susan Wardle
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| |
Collapse
|
31
|
Taubert J, Wardle S, Flessert M, Basile B, Koele E, James C, Murray E, Ungerleider L. Amygdala damage eliminates monkeys' viewing preference for real and illusory faces. J Vis 2018. [DOI: 10.1167/18.10.1232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Jessica Taubert
- Section on Neurocircuitry, Laboratory of Brain and Cognition (LBC), NIMH, USA
| | - Susan Wardle
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Molly Flessert
- Section on Neurocircuitry, Laboratory of Brain and Cognition (LBC), NIMH, USADepartment of Psychology, Language Research Center, Georgia State University
| | - Benjamin Basile
- Section on Neurobiology of Learning and Memory, Laboratory of Neuropsychology (LN), NIMH, USA
| | - Elissa Koele
- Section on Neurocircuitry, Laboratory of Brain and Cognition (LBC), NIMH, USA
| | - Clarissa James
- Section on Neurocircuitry, Laboratory of Brain and Cognition (LBC), NIMH, USA
| | - Elisabeth Murray
- Section on Neurobiology of Learning and Memory, Laboratory of Neuropsychology (LN), NIMH, USA
| | - Leslie Ungerleider
- Section on Neurocircuitry, Laboratory of Brain and Cognition (LBC), NIMH, USA
| |
Collapse
|
32
|
Taubert J, Van Belle G, Vogels R, Rossion B. The impact of stimulus size and orientation on individual face coding in monkey face-selective cortex. Sci Rep 2018; 8:10339. [PMID: 29985387 PMCID: PMC6037706 DOI: 10.1038/s41598-018-28144-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2017] [Accepted: 06/18/2018] [Indexed: 11/25/2022] Open
Abstract
Face-selective neurons in the monkey temporal cortex discharge at different rates in response to pictures of different individual faces. Here we tested whether this pattern of response across single neurons in the face-selective area ML (located in the middle Superior Temporal Sulcus) tolerates two affine transformations; picture-plane inversion, known to decrease the average response of face-selective neurons and the other, stimulus size. We recorded the response of 57 ML neurons in two awake and fixating monkeys. Face stimuli were presented at two sizes (10 and 5 degrees of visual angle) and two orientations (upright and inverted). Different faces elicited distinct patterns of activity across ML neurons that were reliable (i.e., predictable with a classifier) within a specific size and orientation condition. Despite observing a reduction in the average response magnitude of face-selective neurons to inverted faces, compared to upright faces, classifier performance was above chance for both upright and inverted faces. While decoding was largely preserved across changes in stimulus size, a classifier trained with one orientation condition and tested on the other did not lead to performance above chance level. We conclude that different individual faces can be decoded from patterns of responses in the monkey area ML regardless of orientation or size, but with qualitatively different patterns of responses for upright and inverted faces.
Collapse
Affiliation(s)
- Jessica Taubert
- Psychological Sciences Research Institute and Neuroscience Institute, University of Louvain, Louvain-La-Neuve, 1348, Belgium.
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, 3000, Belgium.
| | - Goedele Van Belle
- Psychological Sciences Research Institute and Neuroscience Institute, University of Louvain, Louvain-La-Neuve, 1348, Belgium
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, 3000, Belgium
| | - Bruno Rossion
- Psychological Sciences Research Institute and Neuroscience Institute, University of Louvain, Louvain-La-Neuve, 1348, Belgium
- Université de Lorraine, CNRS, CRAN, F-54000, Nancy, France
- Université de Lorraine, CHRU-Nancy, Service de Neurologie, Nancy, F-5400, France
| |
Collapse
|
33
|
Affiliation(s)
- Bruno Rossion
- Face Categorization Lab, Psychological Sciences Research Institute and Institute of Neuroscience, Université Catholique de Louvain, Louvain-la-Neuve, Belgium.,Service de Neurologie, Centre Hospitalier Universitaire de Nancy, Nancy, France
| | - Jessica Taubert
- School of Psychology, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
34
|
Affiliation(s)
| | - Susan Wardle
- Department of Cognitive Science, Macquarie University
| | | | | | | |
Collapse
|
35
|
Affiliation(s)
- Susan Wardle
- Department of Cognitive Science, Macquarie University, Sydney, AustraliaARC Centre for Excellence in Cognition and its Disorders, Macquarie University
| | - Kiley Seymour
- Department of Cognitive Science, Macquarie University, Sydney, AustraliaARC Centre for Excellence in Cognition and its Disorders, Macquarie University
| | - Jessica Taubert
- Laboratory of Brain And Cognition, National Institute of Mental Health
| |
Collapse
|
36
|
Flessert M, Taubert J, Liu N, Ungerleider L. Rhesus monkeys are able to discriminate facial identity and expression. J Vis 2017. [DOI: 10.1167/17.10.1006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
| | | | - Ning Liu
- Laboratory of Brain and Cognition, NIMH/NIH
| | | |
Collapse
|
37
|
Taubert J, Wardle SG, Flessert M, Leopold DA, Ungerleider LG. Face Pareidolia in the Rhesus Monkey. Curr Biol 2017; 27:2505-2509.e2. [PMID: 28803877 DOI: 10.1016/j.cub.2017.06.075] [Citation(s) in RCA: 52] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2017] [Revised: 06/08/2017] [Accepted: 06/29/2017] [Indexed: 10/19/2022]
Abstract
Face perception in humans and nonhuman primates is rapid and accurate [1-4]. In the human brain, a network of visual-processing regions is specialized for faces [5-7]. Although face processing is a priority of the primate visual system, face detection is not infallible. Face pareidolia is the compelling illusion of perceiving facial features on inanimate objects, such as the illusory face on the surface of the moon. Although face pareidolia is commonly experienced by humans, its presence in other species is unknown. Here we provide evidence for face pareidolia in a species known to possess a complex face-processing system [8-10]: the rhesus monkey (Macaca mulatta). In a visual preference task [11, 12], monkeys looked longer at photographs of objects that elicited face pareidolia in human observers than at photographs of similar objects that did not elicit illusory faces. Examination of eye movements revealed that monkeys fixated the illusory internal facial features in a pattern consistent with how they view photographs of faces [13]. Although the specialized response to faces observed in humans [1, 3, 5-7, 14] is often argued to be continuous across primates [4, 15], it was previously unclear whether face pareidolia arose from a uniquely human capacity. For example, pareidolia could be a product of the human aptitude for perceptual abstraction or result from frequent exposure to cartoons and illustrations that anthropomorphize inanimate objects. Instead, our results indicate that the perception of illusory facial features on inanimate objects is driven by a broadly tuned face-detection mechanism that we share with other species.
Collapse
Affiliation(s)
- Jessica Taubert
- Section on Neurocircuitry, Laboratory of Brain and Cognition, The National Institute of Mental Health, BG 10 RM 4C104, 10 Center Drive, Bethesda, MD 20892, USA.
| | - Susan G Wardle
- Department of Cognitive Science and ARC Centre of Excellence in Cognition and its Disorders, Macquarie University, 16 University Avenue, Sydney, NSW 2109, Australia
| | - Molly Flessert
- Section on Neurocircuitry, Laboratory of Brain and Cognition, The National Institute of Mental Health, BG 10 RM 4C104, 10 Center Drive, Bethesda, MD 20892, USA
| | - David A Leopold
- Section on Cognitive Neurophysiology and Imaging, Laboratory of Neuropsychology, The National Institute of Mental Health, NIH, BG 49 RM 1E21, 49 Convent Drive, Bethesda, MD 20892, USA
| | - Leslie G Ungerleider
- Section on Neurocircuitry, Laboratory of Brain and Cognition, The National Institute of Mental Health, BG 10 RM 4C104, 10 Center Drive, Bethesda, MD 20892, USA
| |
Collapse
|
38
|
Kok R, Taubert J, Van der Burg E, Rhodes G, Alais D. Face familiarity promotes stable identity recognition: exploring face perception using serial dependence. R Soc Open Sci 2017; 4:160685. [PMID: 28405355 PMCID: PMC5383812 DOI: 10.1098/rsos.160685] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2016] [Accepted: 02/01/2017] [Indexed: 06/07/2023]
Abstract
Studies suggest that familiar faces are processed in a manner distinct from unfamiliar faces and that familiarity with a face confers an advantage in identity recognition. Our visual system seems to capitalize on experience to build stable face representations that are impervious to variation in retinal input that may occur due to changes in lighting, viewpoint, viewing distance, eye movements, etc. Emerging evidence also suggests that our visual system maintains a continuous perception of a face's identity from one moment to the next despite the retinal input variations through serial dependence. This study investigates whether interactions occur between face familiarity and serial dependence. In two experiments, participants used a continuous scale to rate attractiveness of unfamiliar and familiar faces (either experimentally learned or famous) presented in rapid sequences. Both experiments revealed robust inter-trial effects in which attractiveness ratings for a given face depended on the preceding face's attractiveness. This inter-trial attractiveness effect was most pronounced for unfamiliar faces. Indeed, when participants were familiar with a given face, attractiveness ratings showed significantly less serial dependence. These results represent the first evidence that familiar faces can resist the temporal integration seen in sequential dependencies and highlight the importance of familiarity to visual cognition.
Collapse
Affiliation(s)
- Rebecca Kok
- The School of Psychology, The University of Sydney, Camperdown, New South Wales 2006, Australia
| | - Jessica Taubert
- The School of Psychology, The University of Sydney, Camperdown, New South Wales 2006, Australia
| | - Erik Van der Burg
- The School of Psychology, The University of Sydney, Camperdown, New South Wales 2006, Australia
- Department of Cognitive Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Gillian Rhodes
- The School of Psychology, The University of Western Australia, Crawley, Western Australia 6009, Australia
| | - David Alais
- The School of Psychology, The University of Sydney, Camperdown, New South Wales 2006, Australia
| |
Collapse
|
39
|
Taubert J, van Golde C, Verstraten FAJ. Who is the Usual Suspect? Evidence of a Selection Bias Toward Faces That Make Direct Eye Contact in a Lineup Task. Iperception 2017; 8:2041669517690411. [PMID: 28203355 PMCID: PMC5298513 DOI: 10.1177/2041669517690411] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
The speed and ease with which we recognize the faces of our friends and family members belies the difficulty we have recognizing less familiar individuals. Nonetheless, overconfidence in our ability to recognize faces has carried over into various aspects of our legal system; for instance, eyewitness identification serves a critical role in criminal proceedings. For this reason, understanding the perceptual and psychological processes that underlie false identification is of the utmost importance. Gaze direction is a salient social signal and direct eye contact, in particular, is thought to capture attention. Here, we tested the hypothesis that differences in gaze direction may influence difficult decisions in a lineup context. In a series of experiments, we show that when a group of faces differed in their gaze direction, the faces that were making eye contact with the participants were more likely to be misidentified. Interestingly, this bias disappeared when the faces are presented with their eyes closed. These findings open a critical conversation between social neuroscience and forensic psychology, and imply that direct eye contact may (wrongly) increase the perceived familiarity of a face.
Collapse
Affiliation(s)
- Jessica Taubert
- The School of Psychology, The University of Sydney, Sydney, Australia; The National Institute of Mental Health (NIMH), MD, USA
| | - Celine van Golde
- The School of Psychology, The University of Sydney, Sydney, Australia
| | - Frans A J Verstraten
- The School of Psychology, The University of Sydney, Sydney, Australia; Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
40
|
Premereur E, Taubert J, Janssen P, Vogels R, Vanduffel W. Effective Connectivity Reveals Largely Independent Parallel Networks of Face and Body Patches. Curr Biol 2016; 26:3269-3279. [DOI: 10.1016/j.cub.2016.09.059] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2016] [Revised: 09/04/2016] [Accepted: 09/28/2016] [Indexed: 10/20/2022]
|
41
|
Taubert J, Van der Burg E, Alais D. Are we looking for love in all the wrong faces? J Vis 2016. [DOI: 10.1167/16.12.494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
42
|
Abstract
The mechanisms held responsible for familiar face recognition are thought to be orientation dependent; inverted faces are more difficult to recognize than their upright counterparts. Although this effect of inversion has been investigated extensively, researchers have typically sliced faces from photographs and presented them in isolation. As such, it is not known whether the perceived orientation of a face is inherited from the visual scene in which it appears. Here, we address this question by measuring performance in a simultaneous same–different task while manipulating both the orientation of the faces and the scene. We found that the face inversion effect survived scene inversion. Nonetheless, an improvement in performance when the scene was upside down suggests that sensitivity to identity increased when the faces were more easily segmented from the scene. Thus, while these data identify congruency with the visual environment as a contributing factor in recognition performance, they imply different mechanisms operate on upright and inverted faces.
Collapse
Affiliation(s)
- Jessica Taubert
- The School of Psychology, The University of Sydney, Australia
| | | | - Frans A. J. Verstraten
- The School of Psychology, The University of Sydney, Australia
- Helmholtz Institute, The University of Utrecht, The Netherlands
| |
Collapse
|
43
|
Taubert J, Alais D. Serial dependence in face attractiveness judgements tolerates rotations around the yaw axis but not the roll axis. Visual Cognition 2016. [DOI: 10.1080/13506285.2016.1196803] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
44
|
Taubert J, Goffaux V, Van Belle G, Vanduffel W, Vogels R. The impact of orientation filtering on face-selective neurons in monkey inferior temporal cortex. Sci Rep 2016; 6:21189. [PMID: 26879148 PMCID: PMC4754760 DOI: 10.1038/srep21189] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2015] [Accepted: 01/19/2016] [Indexed: 11/09/2022] Open
Abstract
Faces convey complex social signals to primates. These signals are tolerant of some image transformations (e.g. changes in size) but not others (e.g. picture-plane rotation). By filtering face stimuli for orientation content, studies of human behavior and brain responses have shown that face processing is tuned to selective orientation ranges. In the present study, for the first time, we recorded the responses of face-selective neurons in monkey inferior temporal (IT) cortex to intact and scrambled faces that were filtered to selectively preserve horizontal or vertical information. Guided by functional maps, we recorded neurons in the lateral middle patch (ML), the lateral anterior patch (AL), and an additional region located outside of the functionally defined face-patches (CONTROL). We found that neurons in ML preferred horizontal-passed faces over their vertical-passed counterparts. Neurons in AL, however, had a preference for vertical-passed faces, while neurons in CONTROL had no systematic preference. Importantly, orientation filtering did not modulate the firing rate of neurons to phase-scrambled face stimuli in any recording region. Together these results suggest that face-selective neurons found in the face-selective patches are differentially tuned to orientation content, with horizontal tuning in area ML and vertical tuning in area AL.
Collapse
Affiliation(s)
- Jessica Taubert
- Face Categorization Lab, University of Louvain, Louvain-La-Neuve 1348, Belgium
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven 3000, Belgium
| | - Valerie Goffaux
- Face Categorization Lab, University of Louvain, Louvain-La-Neuve 1348, Belgium
| | - Goedele Van Belle
- Face Categorization Lab, University of Louvain, Louvain-La-Neuve 1348, Belgium
| | - Wim Vanduffel
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven 3000, Belgium
- MGH Martinos Center, Charlestown, MA 02129, USA
- Harvard Medical School, Boston, MA 02115, USA
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven 3000, Belgium
| |
Collapse
|
45
|
Taubert J, Van Belle G, Vanduffel W, Rossion B, Vogels R. The effect of face inversion for neurons inside and outside fMRI-defined face-selective cortical regions. J Neurophysiol 2014; 113:1644-55. [PMID: 25520434 DOI: 10.1152/jn.00700.2014] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
It is widely believed that face processing in the primate brain occurs in a network of category-selective cortical regions. Combined functional MRI (fMRI)-single-cell recording studies in macaques have identified high concentrations of neurons that respond more to faces than objects within face-selective patches. However, cells with a preference for faces over objects are also found scattered throughout inferior temporal (IT) cortex, raising the question whether face-selective cells inside and outside of the face patches differ functionally. Here, we compare the properties of face-selective cells inside and outside of face-selective patches in the IT cortex by means of an image manipulation that reliably disrupts behavior toward face processing: inversion. We recorded IT neurons from two fMRI-defined face-patches (ML and AL) and a region outside of the face patches (herein labeled OUT) during upright and inverted face stimulation. Overall, turning faces upside down reduced the firing rate of face-selective cells. However, there were differences among the recording regions. First, the reduced neuronal response for inverted faces was independent of stimulus position, relative to fixation, in the face-selective patches (ML and AL) only. Additionally, the effect of inversion for face-selective cells in ML, but not those in AL or OUT, was impervious to whether the neurons were initially searched for using upright or inverted stimuli. Collectively, these results show that face-selective cells differ in their functional characteristics depending on their anatomicofunctional location, suggesting that upright faces are preferably coded by face-selective cells inside but not outside of the fMRI-defined face-selective regions of the posterior IT cortex.
Collapse
Affiliation(s)
- Jessica Taubert
- Psychological Sciences Research Institute and Neuroscience Institute, University of Louvain, Louvain-La-Neuve, Belgium; Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, Belgium;
| | - Goedele Van Belle
- Psychological Sciences Research Institute and Neuroscience Institute, University of Louvain, Louvain-La-Neuve, Belgium
| | - Wim Vanduffel
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, Belgium; MGH Martinos Center, Charlestown, Massachusetts; and Harvard Medical School, Boston, Massachusetts
| | - Bruno Rossion
- Psychological Sciences Research Institute and Neuroscience Institute, University of Louvain, Louvain-La-Neuve, Belgium
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, Belgium
| |
Collapse
|
46
|
Taubert J, Van Belle G, Vanduffel W, Vogels R, Rossion B. Are the patches important? The effect of inversion on the responses of face-selective cells found throughout the monkey superior temporal sulcus. J Vis 2014. [DOI: 10.1167/14.10.601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
47
|
Taubert J, Gentile F, Popivanov ID, Rossion B, Vogels R, Vanduffel W. The effect of fast periodic stimulation on the face-selective patches of the monkey superior temporal sulcus: An fMRI adaptation study. J Vis 2013. [DOI: 10.1167/13.9.1111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
48
|
Abstract
It is a widespread assumption that all primate species process faces in the same way because the species are closely related and they engage in similar social interactions. However, this approach ignores potentially interesting and informative differences that may exist between species. This paper describes a comparative study of holistic face processing. Twelve subjects (six chimpanzees Pan troglodytes and six rhesus monkeys Macaca mulatta) were trained to discriminate whole faces (faces with features in their canonical position) and feature-scrambled faces in two separate conditions. We found that both species tended to match the global configuration of features over local features, providing strong evidence of global precedence. In addition, we show that both species were better able to generalize from a learned configuration to an entirely novel configuration when they were first trained to match feature-scrambled faces compared to when they were trained with whole faces. This result implies that the subjects were able to access local information easier when facial features were presented in a scrambled configuration and is consistent with a holistic processing hypothesis. Interestingly, these data also suggest that, while holistic processing in chimpanzees is tuned to own-species faces, monkeys have a more general approach towards all faces. Thus, while these data confirm that both chimpanzees and rhesus monkeys process faces holistically, they also indicate that there are differences between the species that warrant further investigation.
Collapse
Affiliation(s)
- Jessica Taubert
- Yerkes National Primate Research Centre, Emory University, Atlanta, GA 30322, USA;
| | | | | |
Collapse
|
49
|
Abstract
Humans and chimpanzees demonstrate numerous cognitive specializations for processing faces, but comparative studies with monkeys suggest that these may be the result of recent evolutionary adaptations. The present study utilized the novel approach of face space, a powerful theoretical framework used to understand the representation of face identity in humans, to further explore species differences in face processing. According to the theory, faces are represented by vectors in a multidimensional space, the centre of which is defined by an average face. Each dimension codes features important for describing a face's identity, and vector length codes the feature's distinctiveness. Chimpanzees and rhesus monkeys discriminated male and female conspecifics' faces, rated by humans for their distinctiveness, using a computerized task. Multidimensional scaling analyses showed that the organization of face space was similar between humans and chimpanzees. Distinctive faces had the longest vectors and were the easiest for chimpanzees to discriminate. In contrast, distinctiveness did not correlate with the performance of rhesus monkeys. The feature dimensions for each species' face space were visualized and described using morphing techniques. These results confirm species differences in the perceptual representation of conspecific faces, which are discussed within an evolutionary framework.
Collapse
Affiliation(s)
- Lisa A Parr
- Department of Psychiatry and Behavioral Science, Yerkes National Primate Research Center and Center for Translational Social Neuroscience, Emory University, Atlanta, GA 30329, USA.
| | | | | | | |
Collapse
|
50
|
Taubert J, Qureshi AA, Parr LA. The composite face effect in chimpanzees (Pan troglodytes) and rhesus monkeys (Macaca mulatta). ACTA ACUST UNITED AC 2012; 126:339-46. [PMID: 22390621 DOI: 10.1037/a0027287] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The accurate recognition of individuals is a cornerstone of social exchange in primates. Current approaches to the study of individual recognition, however, are focused on human performance and only occasionally reference comparative research for support. A number of studies have suggested that humans can easily recognize thousands of individual faces and that this perceptual expertise is supported by holistic processing, a phenomenon best demonstrated by the composite face effect (CFE). Recent advances have indicated that the CFE in humans is robust to changes in contrast polarity (positive or negative). Here we apply a two alternative forced choice match-to-sample paradigm across two species of nonhuman primate, chimpanzees (Pan troglodyte) and rhesus monkeys (Macaca mulatta). We find strong evidence that chimpanzees and rhesus monkeys experience interference from holistic processing in the positive contrast condition. While there is some indication that the chimpanzees experienced a CFE in the negative contrast condition, there was no evidence of a CFE in the corresponding rhesus monkey data. These results suggest that, while holistic processing is a general mechanism, rhesus monkeys are more sensitive to contrast-polarity than humans.
Collapse
|