1
|
Tripathi S, Imai H, Adachi I. Behavioral (reaction time) and prefrontal cortex response revealed differences in grief vs. sadness perception. Sci Rep 2025; 15:6356. [PMID: 39984554 PMCID: PMC11845682 DOI: 10.1038/s41598-025-90387-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Accepted: 02/12/2025] [Indexed: 02/23/2025] Open
Abstract
Research on basic emotions has expanded beyond the traditional six categories, identifying over 20 distinct emotional states. However, differentiating some emotions remained challenging due to partially overlapping facial expressions. Grief and sadness are two such emotions that are difficult to distinguish. This study investigated the behavioral and neural mechanisms of grief perception in the prefrontal cortex (PFC), comparing it with sadness. Participants categorized and rated emotional facial images in grief and sadness conditions on valence, arousal, and dominance scales. While participants perceiving emotional facial images prefrontal cortex (PFC) hemodynamic activities were measured using functional near-infrared spectroscopy (fNIRS). Explicit behavioral responses showed no significant differences, however implicit measures (reaction times) revealed distinctions between grief and sadness perception. Further fNIRS results indicated increased oxy-Hb in the right dorsolateral PFC for grief condition images compared to sadness condition images. Additionally, cultural differences were observed, with Asian participants showing higher oxy-Hb responses in the dorsal PFC for unpleasant facial stimuli in grief conditions. These findings support cultural variability in emotion perception and regulation. The combination of behavioral reaction time and neuroimaging data suggests distinct implicit perceptual and neural processing mechanisms for grief and sadness. This indicates separate automatic implicit mechanisms for these emotions.
Collapse
Affiliation(s)
- Srishti Tripathi
- Center for the Evolutionary Origins of Human Behavior, Kyoto University, Inuyama Campus, Aichi, Japan.
| | - Hiroo Imai
- Center for the Evolutionary Origins of Human Behavior, Kyoto University, Inuyama Campus, Aichi, Japan
| | - Ikuma Adachi
- Center for the Evolutionary Origins of Human Behavior, Kyoto University, Inuyama Campus, Aichi, Japan
| |
Collapse
|
2
|
Tsikandilakis M, Bali P, Karlis A, Morfi P, Mével PA, Madan C, Milbank A. "Sentio ergo est": Unmasking the psychological realities of emotional misperception. Perception 2025; 54:3-31. [PMID: 39648752 DOI: 10.1177/03010066241302996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/10/2024]
Abstract
Perception is an important aspect of our personal lives, interpersonal interactions and professional activities and performance. A large body of psychological research has been dedicated to exploring how perception happens, whether and when it involves conscious awareness and what are the physiological correlates, such as skin-conductance and heart-rate responses, that occur when we perceive particularly emotional elicitors. A more recent and less explored question in psychological science is how and when misperception happens, and what are the physiological characteristics of the misperception of emotion. Therefore, in the current study, for the first time in relevant research, we recruited participants using trial-contour power calculations for false-positive responses, such as incorrectly reporting that a brief backward masked face was presented and thoroughly explored these responses. We reported that false-positive responses for backward masked emotional faces were characterised by pre-trial arousal, and post-trial arousal increases, high confidence ratings, and corresponding to stimulus-type misperception valence and arousal participant ratings. These outcomes were most pronounced for false-positive responses for fearful faces. Based on these findings, we discussed the possibility of a mechanism for partial self-encapsulated emotional-experiential apperception and the possibility of a fear primacy socio-emotional response module during combined visual ambiguity and high psychophysiological arousal.
Collapse
Affiliation(s)
- Myron Tsikandilakis
- School of Psychology, University of Nottingham, Nottingham, UK Medical School, Faculty of Medicine and Health Sciences, University of Nottingham, Nottingham, UK
- School of Cultures, Languages and Area Studies, University of Nottingham, Nottingham, UK
| | - Persefoni Bali
- School of Psychology, University of Nottingham, Nottingham, UK
| | - Alexander Karlis
- Department of Physics, National and Kapodistrian University of Athens, Athens, Greece
| | - Patty Morfi
- School of Engineering, Nottingham Trent University, Nottingham, UK
| | - Pierre-Alexis Mével
- School of Cultures, Languages and Area Studies, University of Nottingham, Nottingham, UK
| | | | - Alison Milbank
- Department of Philosophy, University of Nottingham, Nottingham, UK
| |
Collapse
|
3
|
Kaduwela NA, Horner S, Dadar P, Manworren RCB. Application of a human-centered design for embedded machine learning model to develop data labeling software with nurses: Human-to-Artificial Intelligence (H2AI). Int J Med Inform 2024; 183:105337. [PMID: 38199191 DOI: 10.1016/j.ijmedinf.2023.105337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 12/16/2023] [Accepted: 12/30/2023] [Indexed: 01/12/2024]
Abstract
BACKGROUND Nurses are essential for assessing and managing acute pain in hospitalized patients, especially those who are unable to self-report pain. Given their role and subject matter expertise (SME), nurses are also essential for the design and development of a supervised machine learning (ML) model for pain detection and clinical decision support software (CDSS) in a pain recognition automated monitoring system (PRAMS). Our first step for developing PRAMS with nurses was to create SME-friendly data labeling software. PURPOSE To develop an intuitive and efficient data labeling software solution, Human-to-Artificial Intelligence (H2AI). METHOD The Human-centered Design for Embedded Machine Learning Solutions (HCDe-MLS) model was used to engage nurses. In this paper, HCDe-MLS will be explained using H2AI and PRAMS as illustrative cases. FINDINGS Using HCDe-MLS, H2AI was developed and facilitated labeling of 139 videos (mean = 29.83 min) with 3189 images labeled (mean = 75 s) by 6 nurses. OpenCV was used for video-to-image pre-processing; and MobileFaceNet was used for default landmark placement on images. H2AI randomly assigned videos to nurses for data labeling, tracked labelers' inter-rater reliability, and stored labeled data to train ML models. CONCLUSIONS Nurses' engagement in CDSS development was critical for ensuring the end-product addressed nurses' priorities, reflected nurses' cognitive and decision-making processes, and garnered nurses' trust for technology adoption.
Collapse
Affiliation(s)
| | - Susan Horner
- Ann & Robert H. Lurie Children's Hospital of Chicago, 255 E. Chicago Ave, Box 101, Chicago, IL, USA.
| | - Priyansh Dadar
- KaviGlobal, 1250 Grove St, Suite 300, Barrington, IL, USA.
| | - Renee C B Manworren
- Ann & Robert H. Lurie Children's Hospital of Chicago, 255 E. Chicago Ave, Box 101, Chicago, IL, USA; Northwestern University Feinberg School of Medicine, Department of Pediatrics, 255 E. Chicago Ave, Chicago, IL, USA.
| |
Collapse
|
4
|
Tsikandilakis M, Bali P. Learning emotional dialects: A British population study of cross-cultural communication. Perception 2023; 52:812-843. [PMID: 37796849 PMCID: PMC10634218 DOI: 10.1177/03010066231204180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 09/12/2023] [Indexed: 10/07/2023]
Abstract
The aim of the current research was to explore whether we can improve the recognition of cross-cultural freely-expressed emotional faces in British participants. We tested several methods for improving the recognition of freely-expressed emotional faces, such as different methods for presenting other-culture expressions of emotion from individuals from Chile, New Zealand and Singapore in two experimental stages. In the first experimental stage, in phase one, participants were asked to identify the emotion of cross-cultural freely-expressed faces. In the second phase, different cohorts were presented with interactive side-by-side, back-to-back and dynamic morphing of cross-cultural freely-expressed emotional faces, and control conditions. In the final phase, we repeated phase one using novel stimuli. We found that all non-control conditions led to recognition improvements. Morphing was the most effective condition for improving the recognition of cross-cultural emotional faces. In the second experimental stage, we presented morphing to different cohorts including own-to-other and other-to-own freely-expressed cross-cultural emotional faces and neutral-to-emotional and emotional-to-neutral other-culture freely-expressed emotional faces. All conditions led to recognition improvements and the presentation of freely-expressed own-to-other cultural-emotional faces provided the most effective learning. These findings suggest that training can improve the recognition of cross-cultural freely-expressed emotional expressions.
Collapse
|
5
|
Pfaltz MC, Halligan SL, Haim-Nachum S, Sopp MR, Åhs F, Bachem R, Bartoli E, Belete H, Belete T, Berzengi A, Dukes D, Essadek A, Iqbal N, Jobson L, Langevin R, Levy-Gigi E, Lüönd AM, Martin-Soelch C, Michael T, Oe M, Olff M, Ceylan D, Raghavan V, Ramakrishnan M, Sar V, Spies G, Wadji DL, Wamser-Nanney R, Fares-Otero NE, Schnyder U, Seedat S. Social Functioning in Individuals Affected by Childhood Maltreatment: Establishing a Research Agenda to Inform Interventions. PSYCHOTHERAPY AND PSYCHOSOMATICS 2022; 91:238-251. [PMID: 35381589 PMCID: PMC9393832 DOI: 10.1159/000523667] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Accepted: 02/12/2022] [Indexed: 12/30/2022]
Abstract
Childhood maltreatment (CM) is linked to impairments in various domains of social functioning. Here, we argue that it is critical to identify factors that underlie impaired social functioning as well as processes that mediate the beneficial health effects of positive relationships in individuals exposed to CM. Key research recommendations are presented, focusing on: (1) identifying attachment-related alterations in specific inter- and intrapersonal processes (e.g., regulation of closeness and distance) that underlie problems in broader domains of social functioning (e.g., lack of perceived social support) in individuals affected by CM; (2) identifying internal (e.g., current emotional state) and external situational factors (e.g., cultural factors, presence of close others) that modulate alterations in specific social processes; and (3) identifying mechanisms that explain the positive health effects of intact social functioning. Methodological recommendations include: (1) assessing social processes through interactive and (close to) real-life assessments inside and outside the laboratory; (2) adopting an interdisciplinary, lifespan perspective to assess social processes, using multi-method assessments; (3) establishing global research collaborations to account for cultural influences on social processes and enable replications across laboratories and countries. The proposed line of research will contribute to globally develop and refine interventions that prevent CM and further positive relationships, which - likely through buffering the effects of chronic stress and corresponding allostatic load - foster resilience and improve mental and physical health, thereby reducing personal suffering and the societal and economic costs of CM and its consequences. Interventions targeting euthymia and psychological well-being are promising therapeutic concepts in this context.
Collapse
Affiliation(s)
- Monique C. Pfaltz
- Department of Psychology and Social Work, Mid Sweden University, Östersund, Sweden
- Department of Consultation-Liaison Psychiatry and Psychosomatic Medicine, University Hospital, University of Zurich, Zurich, Switzerland
| | - Sarah L. Halligan
- Department of Psychology, University of Bath, Bath, United Kingdom
- Department of Psychiatry and Mental Health, University of Cape Town, Cape Town, South Africa
| | | | - Marie R. Sopp
- School of Education, Bar-Ilan University, Bar-Ilan, Israel
- Division of Clinical Psychology and Psychotherapy, Saarland University, Saarland, Germany
| | - Fredrik Åhs
- Department of Psychology and Social Work, Mid Sweden University, Östersund, Sweden
| | - Rahel Bachem
- Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Eleonora Bartoli
- Faculty of Psychology, Goethe University of Frankfurt, Frankfurt, Germany
| | - Habte Belete
- Department of Psychiatry, College of Medicine and Health Sciences, Bahir Dar University, Bahir Dar, Ethiopia
| | - Tilahun Belete
- Department of Psychiatry, College of Medicine and Health Sciences, Bahir Dar University, Bahir Dar, Ethiopia
| | - Azi Berzengi
- University of East Anglia, Norwich, United Kingdom
| | - Daniel Dukes
- Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland
- Department of Special Education, University of Fribourg, Fribourg, Switzerland
| | - Aziz Essadek
- Interpsy EA4432, University of Lorraine, Lorraine, France
| | - Naved Iqbal
- Department of Psychology, Jamia Millia islamia, New Delhi, India
| | - Laura Jobson
- School of Psychological Sciences, Turner Institute for Brain and Mental Health, Monash University, Monash, Australian Capital Territory, Australia
| | - Rachel Langevin
- Department of Educational and Counselling Psychology, McGill University, Montreal, Québec, Canada
| | | | - Antonia M. Lüönd
- Department of Consultation-Liaison Psychiatry and Psychosomatic Medicine, University Hospital, University of Zurich, Zurich, Switzerland
| | | | - Tanja Michael
- Division of Clinical Psychology and Psychotherapy, Saarland University, Saarland, Germany
| | - Misari Oe
- Department of Neuropsychiatry, School of Medicine, Kurume University, Kurume, Japan
| | - Miranda Olff
- Department of Psychiatry, Amsterdam Neuroscience and Public Health, Amsterdam UMC, Amsterdam, The Netherlands
- ARQ National Psychotrauma Centre, Diemen, The Netherlands
| | - Deniz Ceylan
- Department of Psychiatry, Koç University School of Medicine, Koç, Turkey
| | | | | | - Vedat Sar
- Department of Psychiatry, Stellenbosch University, Stellenbosch, South Africa
| | - Georgina Spies
- DSI/NRF South African Research Chairs Initiative in PTSD, Department of Psychiatry, Faculty of Medicine and Health Sciences, Stellenbosch University, Stellenbosch, South Africa
- South African Medical Research Council/Stellenbosch University Genomics of Brain Disorders Research Unit, Department of Psychiatry, Stellenbosch University, Cape Town, South Africa
- Department of Psychology, University of Yaounde 1, Yaounde, Cameroon
| | - Dany Laure Wadji
- Department of Psychological Sciences, University of Missouri St. Louis, St. Louis, Missouri, USA
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Rachel Wamser-Nanney
- CIBERSAM: Biomedical Research Networking Center for Mental Health Network, Department of Psychiatry and Psychology, Bipolar and Depressive Disorders Unit, Institute of Neurosciences, Hospital Clínic de Barcelona, Barcelona, Spain
| | | | - Ulrich Schnyder
- Department of Consultation-Liaison Psychiatry and Psychosomatic Medicine, University Hospital, University of Zurich, Zurich, Switzerland
| | - Soraya Seedat
- Department of Psychiatry, Stellenbosch University, Stellenbosch, South Africa
- DSI/NRF South African Research Chairs Initiative in PTSD, Department of Psychiatry, Faculty of Medicine and Health Sciences, Stellenbosch University, Stellenbosch, South Africa
- South African Medical Research Council/Stellenbosch University Genomics of Brain Disorders Research Unit, Department of Psychiatry, Stellenbosch University, Cape Town, South Africa
| |
Collapse
|
6
|
Tsikandilakis M, Yu Z, Kausel L, Boncompte G, Lanfranco RC, Oxner M, Bali P, Urale Leong P, Qing M, Paterakis G, Caci S, Milbank A, Mevel PA, Carmel D, Madan C, Derrfuss J, Chapman P. "There Is No (Where a) Face Like Home": Recognition and Appraisal Responses to Masked Facial Dialects of Emotion in Four Different National Cultures. Perception 2021; 50:1027-1055. [PMID: 34806492 DOI: 10.1177/03010066211055983] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The theory of universal emotions suggests that certain emotions such as fear, anger, disgust, sadness, surprise and happiness can be encountered cross-culturally. These emotions are expressed using specific facial movements that enable human communication. More recently, theoretical and empirical models have been used to propose that universal emotions could be expressed via discretely different facial movements in different cultures due to the non-convergent social evolution that takes place in different geographical areas. This has prompted the consideration that own-culture emotional faces have distinct evolutionary important sociobiological value and can be processed automatically, and without conscious awareness. In this paper, we tested this hypothesis using backward masking. We showed, in two different experiments per country of origin, to participants in Britain, Chile, New Zealand and Singapore, backward masked own and other-culture emotional faces. We assessed detection and recognition performance, and self-reports for emotionality and familiarity. We presented thorough cross-cultural experimental evidence that when using Bayesian assessment of non-parametric receiver operating characteristics and hit-versus-miss detection and recognition response analyses, masked faces showing own cultural dialects of emotion were rated higher for emotionality and familiarity compared to other-culture emotional faces and that this effect involved conscious awareness.
Collapse
Affiliation(s)
- Myron Tsikandilakis
- School of Psychology, University of Nottingham.,Medical School, Faculty of Medicine and Health Sciences, 6123University of Nottingham
| | - Zhaoliang Yu
- Department of Psychology, National University of Singapore.,Department of Psychology, Wuhan University, China
| | - Leonie Kausel
- School of Medicine, Pontificia Universidad Católica de Chile.,School of Psychology, Pontificia Universidad Católica de Chile
| | - Gonzalo Boncompte
- Universidad del Desarrollo, Centro de Investigación en Complejidad Social.,School of Psychology, Pontificia Universidad Católica de Chile
| | - Renzo C Lanfranco
- Department of Psychology, The University of Edinburgh.,Department of Neuroscience, Karolinska Institutet
| | - Matt Oxner
- School of Psychology, The University of Auckland.,University of Leipzig, Institute of Psychology
| | | | | | - Man Qing
- Department of Psychology, National University of Singapore
| | | | | | | | | | - David Carmel
- Victoria University of Wellington, School of Psychology
| | | | | | | |
Collapse
|
7
|
Bonassi A, Ghilardi T, Gabrieli G, Truzzi A, Doi H, Borelli JL, Lepri B, Shinohara K, Esposito G. The Recognition of Cross-Cultural Emotional Faces Is Affected by Intensity and Ethnicity in a Japanese Sample. Behav Sci (Basel) 2021; 11:bs11050059. [PMID: 33922502 PMCID: PMC8146535 DOI: 10.3390/bs11050059] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Revised: 04/14/2021] [Accepted: 04/16/2021] [Indexed: 02/06/2023] Open
Abstract
Human faces convey a range of emotions and psychobiological signals that support social interactions. Multiple factors potentially mediate the facial expressions of emotions across cultures. To further determine the mechanisms underlying human emotion recognition in a complex and ecological environment, we hypothesized that both behavioral and neurophysiological measures would be influenced by stimuli ethnicity (Japanese, Caucasian) in the context of ambiguous emotional expressions (mid-happy, angry). We assessed the neurophysiological and behavioral responses of neurotypical Japanese adults (N = 27, 13 males) involved in a facial expression recognition task. Results uncover an interaction between universal and culturally-driven mechanisms. No differences in behavioral responses are found between male and female participants, male and female faces, and neutral Japanese versus Caucasian faces. However, Caucasian ambiguous emotional expressions which require more energy-consuming processing, as highlighted by neurophysiological results of the Arousal Index, were judged more accurately than Japanese ones. Additionally, a differential Frontal Asymmetry Index in neuronal activation, the signature of an approach versus avoidance response, is found in male participants according to the gender and emotional valence of the stimuli.
Collapse
Affiliation(s)
- Andrea Bonassi
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy;
- Mobile and Social Computing Lab, Fondazione Bruno Kessler, 38122 Trento, Italy;
| | - Tommaso Ghilardi
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, 6525 AJ Nijmegen, The Netherlands;
| | - Giulio Gabrieli
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639818, Singapore;
| | - Anna Truzzi
- Trinity College Institute of Neuroscience, Trinity College, Dublin 2, Ireland;
| | - Hirokazu Doi
- Medical Engineering Department, Kokushikan University, Tokyo 154-8515, Japan;
| | - Jessica L. Borelli
- Department of Psychological Science, University of California, Irvine, CA 92697-7085, USA;
| | - Bruno Lepri
- Mobile and Social Computing Lab, Fondazione Bruno Kessler, 38122 Trento, Italy;
| | - Kazuyuki Shinohara
- Department of Neurology and Behavior, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki 852-8523, Japan;
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy;
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639818, Singapore;
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 308222, Singapore
- Correspondence: or
| |
Collapse
|
8
|
Tsikandilakis M. "The Harder One Tries …": Findings and Insights From the Application of Covert Response Pressure Assessment Technology in Three Studies of Visual Perception. Iperception 2020; 11:2041669520913319. [PMID: 32341777 PMCID: PMC7171999 DOI: 10.1177/2041669520913319] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Accepted: 02/26/2020] [Indexed: 12/26/2022] Open
Abstract
In this article, we present a force measuring method for assessing participant responses in studies of visual perception. We present a device disguised as a mouse pad and designed to measure mouse-click-pressure and click-press-to-release-time responses by unaware, as regards to the physiological assessment, participants. The aim of the current technology, in the current studies, was to provide a physiological assessment of confidence and task difficulty. We tested the device in three experiments. The studies comprised of a gender-recognition study using morphed male and female faces, a visual suppression study using backwards masking, and a target-search study that included deciding whether a letter was repeated in a subsequently presented letter string. Across all studies, higher task difficulty was associated with higher click-release-time responses. Higher task difficulty was, intriguingly, also associated with lower click pressure. Higher confidence ratings were consistently associated with higher click pressure and shorter click-release time across all experiments. These findings suggest that the current technology can be used to assess responses relating to task difficulty and participant confidence in studies of visual perception. We suggest that the assessment of release times can also be implemented using standard equipment, and we provide manual and easy-to-use code for the implementation.
Collapse
Affiliation(s)
- Myron Tsikandilakis
- School of Psychology, University of Nottingham; School of Medicine, Faculty of Medicine and Health Sciences, University of Nottingham
| |
Collapse
|
9
|
Tsikandilakis M, Bali P, Derrfuss J, Chapman P. The unconscious mind: From classical theoretical controversy to controversial contemporary research and a practical illustration of the “error of our ways”. Conscious Cogn 2019; 74:102771. [DOI: 10.1016/j.concog.2019.102771] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Revised: 05/22/2019] [Accepted: 06/16/2019] [Indexed: 01/13/2023]
|