1
|
Chang CH, Drobotenko N, Ruocco AC, Lee ACH, Nestor A. Perception and memory-based representations of facial emotions: Associations with personality functioning, affective states and recognition abilities. Cognition 2024; 245:105724. [PMID: 38266352 DOI: 10.1016/j.cognition.2024.105724] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2023] [Revised: 11/09/2023] [Accepted: 01/15/2024] [Indexed: 01/26/2024]
Abstract
Personality traits and affective states are associated with biases in facial emotion perception. However, the precise personality impairments and affective states that underlie these biases remain largely unknown. To investigate how relevant factors influence facial emotion perception and recollection, Experiment 1 employed an image reconstruction approach in which community-dwelling adults (N = 89) rated the similarity of pairs of facial expressions, including those recalled from memory. Subsequently, perception- and memory-based expression representations derived from such ratings were assessed across participants and related to measures of personality impairment, state affect, and visual recognition abilities. Impairment in self-direction and level of positive affect accounted for the largest components of individual variability in perception and memory representations, respectively. Additionally, individual differences in these representations were impacted by face recognition ability. In Experiment 2, adult participants (N = 81) rated facial image reconstructions derived in Experiment 1, revealing that individual variability was associated with specific visual face properties, such as expressiveness, representation accuracy, and positivity/negativity. These findings highlight and clarify the influence of personality, affective state, and recognition abilities on individual differences in the perception and recollection of facial expressions.
Collapse
Affiliation(s)
- Chi-Hsun Chang
- Department of Psychology at Scarborough, University of Toronto, 1265 Military Trail, Scarborough, Ontario M1C 1A4, Canada
| | - Natalia Drobotenko
- Department of Psychology at Scarborough, University of Toronto, 1265 Military Trail, Scarborough, Ontario M1C 1A4, Canada
| | - Anthony C Ruocco
- Department of Psychology at Scarborough, University of Toronto, 1265 Military Trail, Scarborough, Ontario M1C 1A4, Canada; Department of Psychological Clinical Science at Scarborough, University of Toronto, 1265 Military Trail, Scarborough, Ontario M1C 1A4, Canada
| | - Andy C H Lee
- Department of Psychology at Scarborough, University of Toronto, 1265 Military Trail, Scarborough, Ontario M1C 1A4, Canada; Rotman Research Institute, Baycrest Centre, 3560 Bathurst St, North York, Ontario M6A 2E1, Canada
| | - Adrian Nestor
- Department of Psychology at Scarborough, University of Toronto, 1265 Military Trail, Scarborough, Ontario M1C 1A4, Canada.
| |
Collapse
|
2
|
Han J, Zhang M, Liu J, Song Y, Yamada Y. The Medusa effect: a registered replication report of Will, Merritt, Jenkins and Kingstone (2021). ROYAL SOCIETY OPEN SCIENCE 2024; 11:231802. [PMID: 38204780 PMCID: PMC10776219 DOI: 10.1098/rsos.231802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 12/11/2023] [Indexed: 01/12/2024]
Abstract
Will et al.'s (2021 Proc. Natl Acad. Sci. USA 118, e2106640118 (doi:10.1073/pnas.2106640118)) found the Medusa effect, which refers to the tendency that people evaluate a 'person in picture' more mindful than a 'person in picture of a picture'. The present study tried to directly replicate the Experiments 2 and 5 of Will et al.'s (2021), to examine the reliability, validity and generalization of the Medusa effect, as well as its effect on prosocial behaviour. We used the same stimuli and methodology as the original research, but recruited participants in Japan with a larger sample size (N = 1387 in total) as a registered report. In our two replication experiments, we again found that pictures with lower levels of abstraction (L1) were perceived to convey more mind and lead to higher levels of prosocial behaviour, successfully replicating the original findings. The results of the present study suggested the high reproducibility and generalizability of the Medusa effect. Pre-registered Stage 1 protocol: https://osf.io/xj46z (date of in-principle acceptance: 9 February 2023).
Collapse
Affiliation(s)
- Jing Han
- Graduate School of Human-Environment Studies, Kyushu University, Fukuoka, Fukuoka, Japan
| | - Minjun Zhang
- Graduate School of Human-Environment Studies, Kyushu University, Fukuoka, Fukuoka, Japan
| | - Jiaxin Liu
- Graduate School of Human-Environment Studies, Kyushu University, Fukuoka, Fukuoka, Japan
| | - Yu Song
- Graduate School of Human-Environment Studies, Kyushu University, Fukuoka, Fukuoka, Japan
| | - Yuki Yamada
- Faculty of Arts and Science, Kyushu University, Fukuoka, Fukuoka, Japan
| |
Collapse
|
3
|
Ganel T, Sofer C, Goodale MA. Biases in human perception of facial age are present and more exaggerated in current AI technology. Sci Rep 2022; 12:22519. [PMID: 36581653 PMCID: PMC9800363 DOI: 10.1038/s41598-022-27009-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2022] [Accepted: 12/23/2022] [Indexed: 12/30/2022] Open
Abstract
Our estimates of a person's age from their facial appearance suffer from several well-known biases and inaccuracies. Typically, for example, we tend to overestimate the age of smiling faces compared to those with a neutral expression, and the accuracy of our estimates decreases for older faces. The growing interest in age estimation using artificial intelligence (AI) technology raises the question of how AI compares to human performance and whether it suffers from the same biases. Here, we compared human performance with the performance of a large sample of the most prominent AI technology available today. The results showed that AI is even less accurate and more biased than human observers when judging a person's age-even though the overall pattern of errors and biases is similar. Thus, AI overestimated the age of smiling faces even more than human observers did. In addition, AI showed a sharper decrease in accuracy for faces of older adults compared to faces of younger age groups, for smiling compared to neutral faces, and for female compared to male faces. These results suggest that our estimates of age from faces are largely driven by particular visual cues, rather than high-level preconceptions. Moreover, the pattern of errors and biases we observed could provide some insights for the design of more effective AI technology for age estimation from faces.
Collapse
Affiliation(s)
- Tzvi Ganel
- grid.7489.20000 0004 1937 0511Department of Psychology, Ben-Gurion University of the Negev, 8410500 Beer-Sheva, Israel
| | - Carmel Sofer
- grid.7489.20000 0004 1937 0511Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, 8410500 Beer-Sheva, Israel ,grid.7489.20000 0004 1937 0511Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, 8410500 Beer-Sheva, Israel
| | - Melvyn A. Goodale
- grid.39381.300000 0004 1936 8884The Western Institute for Neuroscience, The University of Western Ontario, London, ON N6A 5B7 Canada
| |
Collapse
|
4
|
Ganel T, Goodale MA. Smiling makes you look older, even when you wear a mask: the effect of face masks on age perception. Cogn Res Princ Implic 2022; 7:84. [PMID: 36068390 PMCID: PMC9448834 DOI: 10.1186/s41235-022-00432-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Accepted: 08/12/2022] [Indexed: 11/30/2022] Open
Abstract
The widespread use of face masks in the era of the Covid-19 pandemic has promoted research on their effect on the perception and recognition of faces. There is growing evidence that masks hinder the recognition of identity and expression, as well as the interpretation of speech from facial cues. It is less clear whether and in what manner masks affect the perception of age from facial cues. Recent research has emphasized the role of the upper region of the face, a part not covered by a mask, in the evaluation of age. For example, smile-related wrinkles in the region of the eyes make smiling faces appear older than neutral faces of the same individuals (the aging effect of smiling, AES). In two experiments, we tested the effect of face masks on age evaluations of neutral and smiling faces in a range of different age groups from 20 to 80 years. The results showed that smiling faces were perceived as older than neutral faces even when individuals were wearing a face mask—and there was no effect of masks on bias in age evaluations. Additional analyses showed reduced accuracy in age evaluations for smiling compared to neutral faces and for masked compared to unmasked faces. The results converge on previous studies emphasizing the importance of the upper region of the face in evaluations of age.
Collapse
|
5
|
Yoshimura N, Yonemitsu F, Sasaki K, Yamada Y. Robustness of the aging effect of smiling against vertical facial orientation. F1000Res 2022; 11:404. [PMID: 35811801 PMCID: PMC9247519 DOI: 10.12688/f1000research.111126.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/01/2022] [Indexed: 11/20/2022] Open
Abstract
Background: Previous studies have shown that the association between smiling and youth is a misconception; smiling faces have been estimated to be older than neutral faces. Previous studies have indicated that this aging effect of smiling (AES) is due to eye wrinkles caused by the facial action of smiling. However, whether holistic processing for facial expressions is involved in AES has not been investigated. The present study aimed to clarify these issues. Methods: Participants were recruited to participate in an online experiment that had a 3 (facial expression: smiling/neutral/surprised) × 2 (facial orientation: upright/inverted) mixed design. Participants were presented with an upright or inverted face for each expression (neutral, smiling, and surprised) and were asked to estimate the individual's age. Results: In total, 104 participants were included in the analysis. The results show that smiling faces were estimated to be older than neutral faces, whereas there was no significant difference between upright and inverted faces. Conclusions: Our findings suggest that AES is not dependent on holistic processing.
Collapse
Affiliation(s)
- Naoto Yoshimura
- Graduate School of Human-Environment Studies, Kyushu University, Fukuoka, Fukuoka, 819-0395, Japan
- Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo, 102-0083, Japan
| | - Fumiya Yonemitsu
- Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo, 102-0083, Japan
- Faculty of Letters, Chuo University, Hachioji, Tokyo, 192-1393, Japan
| | - Kyoshiro Sasaki
- Faculty of Informatics, Kansai University, Takatsuki, Osaka, 569-1095, Japan
| | - Yuki Yamada
- Faculty of Arts and Science, Kyushu University, Fukuoka, Fukuoka, 819-0395, Japan
| |
Collapse
|
6
|
Yoshimura N, Yonemitsu F, Sasaki K, Yamada Y. Robustness of the aging effect of smiling against vertical facial orientation. F1000Res 2022; 11:404. [PMID: 35811801 PMCID: PMC9247519 DOI: 10.12688/f1000research.111126.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 06/17/2022] [Indexed: 09/05/2024] Open
Abstract
Background: Previous studies have shown that the association between smiling and youth is a misconception; smiling faces have been estimated to be older than neutral faces. Previous studies have indicated that this aging effect of smiling (AES) is due to eye wrinkles caused by the facial action of smiling. However, whether holistic processing for facial expressions is involved in AES has not been investigated. The present study aimed to clarify these issues. Methods: Participants were recruited to participate in an online experiment that had a 3 (facial expression: smiling/neutral/surprised) × 2 (facial orientation: upright/inverted) mixed design. Participants were presented with an upright or inverted face for each expression (neutral, smiling, and surprised) and were asked to estimate the individual's age. Results: In total, 104 participants were included in the analysis. The results show that smiling faces were estimated to be older than neutral faces, whereas there was no significant difference between upright and inverted faces. Conclusions: Our findings suggest that AES is not dependent on holistic processing.
Collapse
Affiliation(s)
- Naoto Yoshimura
- Graduate School of Human-Environment Studies, Kyushu University, Fukuoka, Fukuoka, 819-0395, Japan
- Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo, 102-0083, Japan
| | - Fumiya Yonemitsu
- Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo, 102-0083, Japan
- Faculty of Letters, Chuo University, Hachioji, Tokyo, 192-1393, Japan
| | - Kyoshiro Sasaki
- Faculty of Informatics, Kansai University, Takatsuki, Osaka, 569-1095, Japan
| | - Yuki Yamada
- Faculty of Arts and Science, Kyushu University, Fukuoka, Fukuoka, 819-0395, Japan
| |
Collapse
|
7
|
Yoshimura N, Yonemitsu F, Sasaki K, Yamada Y. Robustness of the aging effect of smiling against vertical facial orientation. F1000Res 2022; 11:404. [PMID: 35811801 PMCID: PMC9247519 DOI: 10.12688/f1000research.111126.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/04/2022] [Indexed: 09/05/2024] Open
Abstract
Background: Previous studies have shown that the association between smiling and youth is a misconception; smiling faces have been estimated to be older than neutral faces. Previous studies have indicated that this aging effect of smiling (AES) is due to eye wrinkles caused by the facial action of smiling. However, whether holistic processing for facial expressions is involved in AES has not been investigated. The present study aimed to clarify these issues. Methods: Participants were recruited to participate in an online experiment that had a 3 (facial expression: smiling/neutral/surprised) × 2 (facial orientation: upright/inverted) mixed design. Participants were presented with an upright or inverted face for each expression (neutral, smiling, and surprised) and were asked to estimate the individual's age. Results: In total, 104 participants were included in the analysis. The results show that smiling faces were estimated to be older than neutral faces, whereas there was no significant difference between upright and inverted faces. Conclusions: Our findings suggest that direct age estimation is not dependent on holistic processing.
Collapse
Affiliation(s)
- Naoto Yoshimura
- Graduate School of Human-Environment Studies, Kyushu University, Fukuoka, Fukuoka, 819-0395, Japan
- Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo, 102-0083, Japan
| | - Fumiya Yonemitsu
- Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo, 102-0083, Japan
- Faculty of Letters, Chuo University, Hachioji, Tokyo, 192-1393, Japan
| | - Kyoshiro Sasaki
- Faculty of Informatics, Kansai University, Takatsuki, Osaka, 569-1095, Japan
| | - Yuki Yamada
- Faculty of Arts and Science, Kyushu University, Fukuoka, Fukuoka, 819-0395, Japan
| |
Collapse
|
8
|
The effect of smiling on the perceived age of male and female faces across the lifespan. Sci Rep 2021; 11:23020. [PMID: 34837017 PMCID: PMC8626502 DOI: 10.1038/s41598-021-02380-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 11/15/2021] [Indexed: 11/22/2022] Open
Abstract
Previous research has shown an unintuitive effect of facial expression on perceived age: smiling faces are perceived as older compared to neutral faces of the same people. The aging effect of smiling (AES), which is thought to result from the presence of smile-related wrinkles around the eyes, contradicts the common belief that smiling faces should be perceived as younger, not older. Previous research, however, has focused on faces of young adults, where the absence of inherent, age-related wrinkles and other age signs is offset by the weight of the smile-related wrinkles. In a series of experiments, we tested whether the AES extends to male and female faces in older age groups. We replicated the AES in young adults (20–39) and showed that it disappeared in older adults (60–79) of both genders. For photos of middle-aged adults (40–59), however, AES was found only for male, but not for female faces, who showed fewer and less prominent smile-related wrinkles. The results suggest that a person’s apparent age is perceived in a holistic manner in which age-related cues in the region of the eyes are weighted against age cues in other regions of the face.
Collapse
|
9
|
Bonassi A, Ghilardi T, Gabrieli G, Truzzi A, Doi H, Borelli JL, Lepri B, Shinohara K, Esposito G. The Recognition of Cross-Cultural Emotional Faces Is Affected by Intensity and Ethnicity in a Japanese Sample. Behav Sci (Basel) 2021; 11:bs11050059. [PMID: 33922502 PMCID: PMC8146535 DOI: 10.3390/bs11050059] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Revised: 04/14/2021] [Accepted: 04/16/2021] [Indexed: 02/06/2023] Open
Abstract
Human faces convey a range of emotions and psychobiological signals that support social interactions. Multiple factors potentially mediate the facial expressions of emotions across cultures. To further determine the mechanisms underlying human emotion recognition in a complex and ecological environment, we hypothesized that both behavioral and neurophysiological measures would be influenced by stimuli ethnicity (Japanese, Caucasian) in the context of ambiguous emotional expressions (mid-happy, angry). We assessed the neurophysiological and behavioral responses of neurotypical Japanese adults (N = 27, 13 males) involved in a facial expression recognition task. Results uncover an interaction between universal and culturally-driven mechanisms. No differences in behavioral responses are found between male and female participants, male and female faces, and neutral Japanese versus Caucasian faces. However, Caucasian ambiguous emotional expressions which require more energy-consuming processing, as highlighted by neurophysiological results of the Arousal Index, were judged more accurately than Japanese ones. Additionally, a differential Frontal Asymmetry Index in neuronal activation, the signature of an approach versus avoidance response, is found in male participants according to the gender and emotional valence of the stimuli.
Collapse
Affiliation(s)
- Andrea Bonassi
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy;
- Mobile and Social Computing Lab, Fondazione Bruno Kessler, 38122 Trento, Italy;
| | - Tommaso Ghilardi
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, 6525 AJ Nijmegen, The Netherlands;
| | - Giulio Gabrieli
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639818, Singapore;
| | - Anna Truzzi
- Trinity College Institute of Neuroscience, Trinity College, Dublin 2, Ireland;
| | - Hirokazu Doi
- Medical Engineering Department, Kokushikan University, Tokyo 154-8515, Japan;
| | - Jessica L. Borelli
- Department of Psychological Science, University of California, Irvine, CA 92697-7085, USA;
| | - Bruno Lepri
- Mobile and Social Computing Lab, Fondazione Bruno Kessler, 38122 Trento, Italy;
| | - Kazuyuki Shinohara
- Department of Neurology and Behavior, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki 852-8523, Japan;
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy;
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639818, Singapore;
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 308222, Singapore
- Correspondence: or
| |
Collapse
|