1
|
Schaller P, Richoz AR, Duncan J, de Lissa P, Caldara R. Prosopagnosia and the role of face-sensitive areas in race perception. Sci Rep 2025; 15:5751. [PMID: 39962188 PMCID: PMC11832744 DOI: 10.1038/s41598-025-88769-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2024] [Accepted: 01/30/2025] [Indexed: 02/20/2025] Open
Abstract
Race is rapidly and effortlessly extracted from faces. Previous fMRI studies have reported race-related modulations in the bilateral Fusiform Face Areas (FFAs) and Occipital Face Areas (OFAs) during the categorization of faces by race. However, our recent findings revealed a comparable Other-Race Categorization Advantage between a well-studied case of pure acquired prosopagnosia-patient PS-and healthy controls. Notably, PS demonstrated faster categorization by race of other-compared to same-race faces, similar to healthy participants, despite sustaining lesions in the right OFA (rOFA) and left FFA (lFFA). This observation suggests that race processing can occur effectively even with damage to core face-sensitive regions, challenging the functional significance of race-related activations in the rOFA and lFFA observed in healthy individuals with fMRI. To address this apparent contradiction, we tested PS and age-matched controls during the categorization by race of same- to other-race morphed faces. Our data showed that PS required more visual information to accurately categorize racially ambiguous faces, indicating that intact rOFA and/or lFFA are crucial for extracting fine-grained racial information. These results refine our understanding of the functional roles of these key cortical regions and offer novel insights into the neural mechanisms underlying the perception of face race and prosopagnosia.
Collapse
Affiliation(s)
- Pauline Schaller
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, Fribourg, 1700, Switzerland
| | - Anne-Raphaëlle Richoz
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, Fribourg, 1700, Switzerland.
| | - Justin Duncan
- Département de psychoéducation et psychologie, Université du Québec en Outaouais, Gatineau, Canada
| | - Peter de Lissa
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, Fribourg, 1700, Switzerland
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, Fribourg, 1700, Switzerland
| |
Collapse
|
2
|
Pickron CB, Brown AJ, Hudac CM, Scott LS. Diverse Face Images (DFI): Validated for racial representation and eye gaze. Behav Res Methods 2024; 56:8801-8819. [PMID: 39285143 DOI: 10.3758/s13428-024-02504-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/15/2024] [Indexed: 11/01/2024]
Abstract
Face processing is a central component of human communication and social engagement. The present investigation introduces a set of racially and ethnically inclusive faces created for researchers interested in perceptual and socio-cognitive processes linked to human faces. The Diverse Face Images (DFI) stimulus set includes high-quality still images of female faces that are racially and ethnically representative, include multiple images of direct and indirect gaze for each model and control for low-level perceptual variance between images. The DFI stimuli will support researchers interested in studying face processing throughout the lifespan as well as other questions that require a diversity of faces or gazes. This report includes a detailed description of stimuli development and norming data for each model. Adults completed a questionnaire rating each image in the DFI stimuli set on three major qualities relevant to face processing: (1) strength of race/ethnicity group associations, (2) strength of eye gaze orientation, and (3) strength of emotion expression. These validation data highlight the presence of rater variability within and between individual model images as well as within and between race and ethnicity groups.
Collapse
Affiliation(s)
- Charisse B Pickron
- Institute of Child Development, University of Minnesota, Minneapolis, MN, USA.
| | - Alexia J Brown
- Department of Psychology, University of Florida, Gainesville, FL, USA
| | - Caitlin M Hudac
- Department of Psychology and Center for Autism and Neurodevelopment Research Center, University of South Carolina, Columbia, SC, USA
| | - Lisa S Scott
- Department of Psychology, University of Florida, Gainesville, FL, USA.
| |
Collapse
|
3
|
Paparelli A, Sokhn N, Stacchi L, Coutrot A, Richoz AR, Caldara R. Idiosyncratic fixation patterns generalize across dynamic and static facial expression recognition. Sci Rep 2024; 14:16193. [PMID: 39003314 PMCID: PMC11246522 DOI: 10.1038/s41598-024-66619-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Accepted: 07/02/2024] [Indexed: 07/15/2024] Open
Abstract
Facial expression recognition (FER) is crucial for understanding the emotional state of others during human social interactions. It has been assumed that humans share universal visual sampling strategies to achieve this task. However, recent studies in face identification have revealed striking idiosyncratic fixation patterns, questioning the universality of face processing. More importantly, very little is known about whether such idiosyncrasies extend to the biological relevant recognition of static and dynamic facial expressions of emotion (FEEs). To clarify this issue, we tracked observers' eye movements categorizing static and ecologically valid dynamic faces displaying the six basic FEEs, all normalized for time presentation (1 s), contrast and global luminance across exposure time. We then used robust data-driven analyses combining statistical fixation maps with hidden Markov Models to explore eye-movements across FEEs and stimulus modalities. Our data revealed three spatially and temporally distinct equally occurring face scanning strategies during FER. Crucially, such visual sampling strategies were mostly comparably effective in FER and highly consistent across FEEs and modalities. Our findings show that spatiotemporal idiosyncratic gaze strategies also occur for the biologically relevant recognition of FEEs, further questioning the universality of FER and, more generally, face processing.
Collapse
Affiliation(s)
- Anita Paparelli
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, 1700, Fribourg, Switzerland
| | - Nayla Sokhn
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, 1700, Fribourg, Switzerland
| | - Lisa Stacchi
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, 1700, Fribourg, Switzerland
| | - Antoine Coutrot
- Laboratoire d'Informatique en Image Et Systèmes d'information, French Centre National de La Recherche Scientifique, University of Lyon, Lyon, France
| | - Anne-Raphaëlle Richoz
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, 1700, Fribourg, Switzerland
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Faucigny 2, 1700, Fribourg, Switzerland.
| |
Collapse
|
4
|
de Lissa P, Schaller P, Caldara R. The speed of race. Soc Cogn Affect Neurosci 2024; 19:nsad076. [PMID: 38102475 PMCID: PMC10868132 DOI: 10.1093/scan/nsad076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 10/17/2023] [Accepted: 12/12/2023] [Indexed: 12/17/2023] Open
Abstract
When asked to categorize faces according to 'race', people typically categorize other-race faces faster than faces belonging to their own race. This 'Other Race Categorization Advantage' is thought to reflect enhanced sensitivity to early visual signals characteristic of other-race faces, and can manifest within 200 ms of face presentation. However, recent research has highlighted the importance of signal intensity in this effect, where visual-degradation of the face images significantly enhances the effect and exposes a behavioural threshold at very low levels of visual quality where other-race visual signals are able to be perceived while same-race signals are not. The current study investigated the effect of signal intensity in race categorization processes in the brain through electroencephalography and in accuracy/reaction times. While replicating the previously observed enhancement of the other-race categorization advantage, we also found enhanced sensitivity to other-race faces in early P1 peaks, as well as later N170 and N250 peaks. These effects, however, related to the varying levels of signal intensity in the face stimuli, suggesting that race categorization may involve different types of perceptual and neural processes rather than one discrete process. The speed at which race is perceived depends on the intensity of the face signal.
Collapse
Affiliation(s)
- Peter de Lissa
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg 1700, Switzerland
| | - Pauline Schaller
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg 1700, Switzerland
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg 1700, Switzerland
| |
Collapse
|
5
|
Hagen S, Vuong QC, Jung L, Chin MD, Scott LS, Tanaka JW. A perceptual field test in object experts using gaze-contingent eye tracking. Sci Rep 2023; 13:11437. [PMID: 37454134 PMCID: PMC10349839 DOI: 10.1038/s41598-023-37695-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 06/26/2023] [Indexed: 07/18/2023] Open
Abstract
A hallmark of expert object recognition is rapid and accurate subordinate-category recognition of visually homogenous objects. However, the perceptual strategies by which expert recognition is achieved is less known. The current study investigated whether visual expertise changes observers' perceptual field (e.g., their ability to use information away from fixation for recognition) for objects in their domain of expertise, using a gaze-contingent eye-tracking paradigm. In the current study, bird experts and novices were presented with two bird images sequentially, and their task was to determine whether the two images were of the same species (e.g., two different song sparrows) or different species (e.g., song sparrow and chipping sparrow). The first study bird image was presented in full view. The second test bird image was presented fully visible (full-view), restricted to a circular window centered on gaze position (central-view), or restricted to image regions beyond a circular mask centered on gaze position (peripheral-view). While experts and novices did not differ in their eye-movement behavior, experts' performance on the discrimination task for the fastest responses was less impaired than novices in the peripheral-view condition. Thus, the experts used peripheral information to a greater extent than novices, indicating that the experts have a wider perceptual field to support their speeded subordinate recognition.
Collapse
Affiliation(s)
- Simen Hagen
- Department of Psychology, University of Victoria, Victoria, Canada.
- CNRS, CRAN, Université de Lorraine, F-54000 Nancy, France.
| | - Quoc C Vuong
- Biosciences Institute, Newcastle University, Newcastle Upon Tyne, UK
| | - Liandra Jung
- Department of Psychology, University of Victoria, Victoria, Canada
- Herbert Wertheim School of Optometry & Vision Science, University of California, Berkeley, USA
| | - Michael D Chin
- Department of Psychology, University of Victoria, Victoria, Canada
| | - Lisa S Scott
- Department of Psychology, University of Florida, Gainesville, FL, USA
| | - James W Tanaka
- Department of Psychology, University of Victoria, Victoria, Canada
| |
Collapse
|
6
|
de Lissa P, Watanabe K, Gu L, Ishii T, Nakamura K, Kimura T, Sagasaki A, Caldara R. Race categorization in noise. Iperception 2022; 13:20416695221119530. [PMID: 36061242 PMCID: PMC9437912 DOI: 10.1177/20416695221119530] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 07/27/2022] [Indexed: 11/17/2022] Open
Abstract
People are typically faster to categorize the race of a face if it belongs to a race different from their own. This Other Race Categorization Advantage (ORCA) is thought to reflect an enhanced sensitivity to the visual race signals of other race faces, leading to faster response times. The current study investigated this sensitivity in a cross-cultural sample of Swiss and Japanese observers with a race categorization task using faces that had been parametrically degraded of visual structure, with normalized luminance and contrast. While Swiss observers exhibited an increasingly strong ORCA in both reaction time and accuracy as the face images were visually degraded up to 20% structural coherence, the Japanese observers manifested this pattern most distinctly when the faces were fully structurally-intact. Critically, for both observer groups, there was a clear accuracy effect at the 20% structural coherence level, indicating that the enhanced sensitivity to other race visual signals persists in significantly degraded stimuli. These results suggest that different cultural groups may rely on and extract distinct types of visual race signals during categorization, which may depend on the available visual information. Nevertheless, heavily degraded stimuli specifically favor the perception of other race faces, indicating that the visual system is tuned by experience and is sensitive to the detection of unfamiliar signals.
Collapse
Affiliation(s)
| | | | - Li Gu
- School of Innovation Design, Guangzhou Academy of Fine Arts,
Guangzhou, China
| | - Tatsunori Ishii
- Japan Womens' University, Tokyo, Japan; Waseda University, Tokyo, Japan
| | - Koyo Nakamura
- University of Vienna, Vienna, Austria; Japan Society for the Promotion of Science, Tokyo, Japan; Waseda University, Tokyo, Japan
| | | | | | | |
Collapse
|