1
|
Jansen K, Nestler S. Correcting for Differences in Measurement Unreliability in Meta-Analysis of Variances. MULTIVARIATE BEHAVIORAL RESEARCH 2025:1-20. [PMID: 40084560 DOI: 10.1080/00273171.2025.2469789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/16/2025]
Abstract
There is a growing interest of researchers in meta-analytic methods for comparing variances as a means to answer questions on between-group differences in variability. When measurements are fallible, however, the variance of an outcome reflects both the variance of the true scores and the error variance. Consequently, effect sizes based on variances, such as the log variability ratio (lnVR) or the log coefficient of variation ratio (lnCVR), may thus not only reflect between-group differences in the true-score variances but also differences in measurement reliability. In this article, we derive formulas to correct the lnVR and lnCVR and their sampling variances for between-group differences in reliability and evaluate their performance in simulation studies. We find that when the goal is to meta-analyze differences between the true-score variances and reliability differs between groups, our proposed corrections lead to accurate estimates of effect sizes and sampling variances in single studies, accurate estimates of the average effect and the between-study variance in random-effects meta-analysis, and adequate type I error rates for the significance test of the average effect. We discuss how to deal with problems arising from missing or imprecise group-specific reliability estimates in meta-analytic data sets and identify questions for further methodological research.
Collapse
|
2
|
Cejalvo E, Martí-Vilar M, Gisbert-Pérez J, Badenes-Ribera L. The CarerQol Instrument: A Systematic Review, Validity Analysis, and Generalization Reliability Study. J Clin Med 2025; 14:1916. [PMID: 40142723 PMCID: PMC11943389 DOI: 10.3390/jcm14061916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2025] [Revised: 03/03/2025] [Accepted: 03/06/2025] [Indexed: 03/28/2025] Open
Abstract
Background/Objectives: The CarerQol instrument is used to measure the quality of life of informal caregivers and to assess the impact that caring for a dependent person has on them. The scale consists of two parts, CarerQol-7D, which measures the effects of informal care using two positive and five negative domains, and CarerQol-VAS, which measures happiness on a visual analog scale. Methods: In the present work, we conducted a systematic review of the instrument since its development in 2006, followed by a (convergent, clinical, and discriminative) validity analysis and a meta-analysis of the reliability of generalizing CarerQol. A total of 54 articles that used CarerQol were identified. Results: The instrument was found to have good convergent, clinical, and discriminant validity, although the average reliability coefficient was 0.67 (95% CI [0.56, 0.75]) for Cronbach's alpha coefficients and 0.62 (95% CI [0.04, 0.89]) for test-retest reliability coefficients, with a high degree of heterogeneity between the coefficients. Conclusions: According to the psychometric theory, CarerQol is a reliable instrument and can be used for exploratory purposes in the field of research, although it should be used with caution when making decisions in clinical practice.
Collapse
Affiliation(s)
- Elena Cejalvo
- Department of Basic Psychology, Faculty of Psychology and Speech Therapy, University of Valencia, 46010 Valencia, Spain;
| | - Manuel Martí-Vilar
- Department of Basic Psychology, Faculty of Psychology and Speech Therapy, University of Valencia, 46010 Valencia, Spain;
| | - Júlia Gisbert-Pérez
- Department of Behavioural Sciences Methodology, Faculty of Psychology and Speech Therapy, University of Valencia, 46010 Valencia, Spain; (J.G.-P.); (L.B.-R.)
| | - Laura Badenes-Ribera
- Department of Behavioural Sciences Methodology, Faculty of Psychology and Speech Therapy, University of Valencia, 46010 Valencia, Spain; (J.G.-P.); (L.B.-R.)
| |
Collapse
|
3
|
Shukla M, Upadhyay N. Cold hearts and dark minds: a systematic review and meta-analysis of empathy across dark triad personalities. Front Psychiatry 2025; 16:1546917. [PMID: 40084055 PMCID: PMC11904307 DOI: 10.3389/fpsyt.2025.1546917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/17/2024] [Accepted: 02/05/2025] [Indexed: 03/16/2025] Open
Abstract
Introduction This systematic review and meta-analysis explored cognitive and affective empathy differences across Dark Triad traits-Narcissism, Machiavellianism, and Psychopathy. Methods Registered on PROSPERO and following PRISMA guidelines, PubMed, Scopus, Science Direct, ProQuest, and Google Scholar were searched for studies published until June 2024. Risk of bias was evaluated using Egger's test and Rank correlation test, along with risk-of-bias plots (Robvis) for quality assessment. Results Fourteen studies (N = 5,328) met the inclusion criteria. Meta-analysis showed Narcissism was negatively associated with affective empathy (r= -.134, p<.05) but not significantly linked to cognitive empathy (r= .061, p= .215), while Machiavellianism had a significant negative correlation with both cognitive (r= -.089, p<.05) and affective empathy (r= -.291, p<.0001). Psychopathy demonstrated the strongest negative association with affective empathy (r= -.347, p<.0001). Moderate-to-high heterogeneity was found across all analyses (I2 range: 40.56% - 94.03%). Discussion This review underscores differential empathy profiles across Dark Triad traits, with significant affective empathy deficits in Psychopathy and Machiavellianism and the complex role of cognitive empathy in Narcissism and Machiavellianism. Further research should examine situational and subtype -specific factors influencing empathy in Dark Triad traits to enhance theoretical understanding and inform interventions. Systematic review registration https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42024559533, identifier CRD42024559533.
Collapse
Affiliation(s)
- Meenakshi Shukla
- Department of Psychology, University of Allahabad, Prayagraj, India
| | - Niti Upadhyay
- Department of Psychology, Banaras Hindu University, Varanasi, India
| |
Collapse
|
4
|
Cargill MI, Lerner MD, Kang E. The Moderating Effect of Sex on Autistic Trait Emotional Intelligence, Alexithymia, and Empathy. J Autism Dev Disord 2024:10.1007/s10803-024-06540-x. [PMID: 39325286 DOI: 10.1007/s10803-024-06540-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/23/2024] [Indexed: 09/27/2024]
Abstract
Autism spectrum disorder (ASD) is associated with differences in social communication, and these differences are related to trait emotional intelligence (TEI), alexithymia, and empathy. Autism is known to present differently in males and females, but research on sex differences in TEI, alexithymia, and empathy is largely relegated to non-autistic people. Therefore, the current research sought to explore individual relationships between autistic characteristics and TEI, alexithymia, and empathy, as well as the possible influence of sex in these relationships. In the current study, autistic and non-autistic adults reported on their autistic characteristics, TEI, alexithymia, and empathy. Based on previous research, it was hypothesized that more autistic characteristics would be associated with less TEI, more alexithymia, and less empathy, and that these relationships would be more prominent amongst males. More autistic characteristics were associated with greater challenges across the three areas of interest. However, only the relationship between TEI and autistic characteristics was moderated by sex, such that males demonstrated higher support needs related to TEI than females. Results from this analysis indicate that adults with more autistic characteristics, regardless of diagnostic status, demonstrate differences in TEI, alexithymia, and empathy. The current analysis may offer additional context to the evolving understanding of empathy and autism by suggesting that TEI and alexithymia could account for differences in empathy. Moreover, sex seems to play a role in the relationship between autistic characteristics and TEI such that differences are especially prominent for males.
Collapse
Affiliation(s)
- Mary Isaac Cargill
- Psychology Department, Montclair State University, 1 Normal Ave, Montclair, NJ, 07043, USA
| | - Matthew D Lerner
- AJ Drexel Autism Institute, Drexel University, 3020 Market Street Suite #560, Philadelphia, PA, 19104, USA
| | - Erin Kang
- Psychology Department, Montclair State University, 1 Normal Ave, Montclair, NJ, 07043, USA.
| |
Collapse
|
5
|
Nowakowska I, Rajchert J, Jasielska D. Prosocial sharing with organizations after the COVID-19 pandemic: A longitudinal test of the role of motives for helping and time perspectives. PLoS One 2024; 19:e0310511. [PMID: 39292685 PMCID: PMC11410197 DOI: 10.1371/journal.pone.0310511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Accepted: 09/03/2024] [Indexed: 09/20/2024] Open
Abstract
The time after the COVID-19 pandemic posed a threat to engagement in prosocial behaviors within charity organizations. In the current study, we intended to test how three motivational paths: affective empathy-based, life satisfaction-based, and perceived social support-based shaped the change in intentions to give money and time to charity organizations over a yearly period (right after revocation of the most essential anti-COVID-19 laws and at the same time, outbreak of the war in Ukraine in 2022, in May 2022 and after a year, in late April-early May 2023). We also tested how past negative and present hedonistic time perspectives-namely, those most robust in predicting emotional states - shaped the changes in the abovementioned motivational paths and giving intentions. We conducted our longitudinal study on the general population of Poland (N = 566). We found that there has been a significant drop in the willingness to give time to organizations over the year after loosening the COVID-19 restrictions and the outbreak of war in Ukraine. We found that affective empathy helped sustain the intentions to give time to organizations, whereas past negative time perspective contributed to the decrease in such intentions. Our study suggests threats to organizations and highlights potential ways to encourage supporting them and caring for their volunteers' well-being.
Collapse
Affiliation(s)
- Iwona Nowakowska
- Institute of Psychology, The Maria Grzegorzewska University, Institute of Psychology, Warsaw, Mazovia, Poland
| | - Joanna Rajchert
- Institute of Psychology, The Maria Grzegorzewska University, Institute of Psychology, Warsaw, Mazovia, Poland
| | - Dorota Jasielska
- Institute of Psychology, The Maria Grzegorzewska University, Institute of Psychology, Warsaw, Mazovia, Poland
| |
Collapse
|
6
|
Silva Santos IL, Pimentel CE. Superhero Films' Impacts on Prosocial Behavior: The Mediating Role of State-Empathy and Violence Justification. THE JOURNAL OF PSYCHOLOGY 2024; 159:192-206. [PMID: 39110881 DOI: 10.1080/00223980.2024.2387039] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 06/18/2024] [Accepted: 07/27/2024] [Indexed: 04/25/2025] Open
Abstract
The present research aimed to observe superhero films' impacts on prosocial behavior, mediated by state-empathy (cognitive, affective and associative empathy) and moral justification. To achieve this goal, two online experiments were conducted, each with 200 Brazilian volunteers (Study 1: 70.5% women, mean age = 28.82, SD = 9.22. Study 2: 52.5% men, mean age = 27.63, SD = 9.25). We used a scene from Batman v Superman as the stimulus in the experimental groups. Prosocial behavior was measured using a food allocation task. Data from both studies showed that even when featuring violent elements, superhero films positively impacted prosocial behavior. These effects were indirect, mediated by associative empathy in Study 1 and moral justification in Study 2. Results highlight the complex relationship between prosocial violent media (aggressive content with prosocial goals) and behavior. We also emphasize the research's novelty, as studies that investigate media content that is both negative and positive are still scarce.
Collapse
|
7
|
Dallagi-Belkilani M, Olivier M, Besche-Richard C. Validation of the Basic Empathy Scale in an Arabic-speaking population: The BES-Ar. L'ENCEPHALE 2024; 50:149-153. [PMID: 37088580 DOI: 10.1016/j.encep.2023.04.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 03/26/2023] [Accepted: 04/04/2023] [Indexed: 04/25/2023]
Abstract
PURPOSE The aim of this work was to test the psychometric properties of the Arabic version of the BES (Basic Empathy Scale) by establishing its factor structure, its internal consistency and construct validity in the general population. DESIGN AND METHODS The BES was tested among 526 Tunisian adults. FINDINGS The two-factor structure of the BES-20 was confirmed. Internal consistency and concurrent validity were very satisfactory. DISCUSSION This scale will be useful for clinicians in various fields (mental health, psychiatry) in Arabic countries.
Collapse
Affiliation(s)
- Manel Dallagi-Belkilani
- Université de Reims Champagne-Ardenne, Cognition Santé Société, C2S UR6291, 57, rue Pierre Taittinger, 51571 Reims, France
| | - Marie Olivier
- Université de Reims Champagne-Ardenne, Cognition Santé Société, C2S UR6291, 57, rue Pierre Taittinger, 51571 Reims, France
| | - Chrystel Besche-Richard
- Université de Reims Champagne-Ardenne, Cognition Santé Société, C2S UR6291, 57, rue Pierre Taittinger, 51571 Reims, France.
| |
Collapse
|
8
|
Yüksel Doğan R, Demir E, Öz S, Demircioğlu H. A Reliability Generalization Meta-Analysis of the Child and Adolescent Mindfulness Measure (CAMM). Psychol Rep 2023:332941231212844. [PMID: 37988752 DOI: 10.1177/00332941231212844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2023]
Abstract
We carried out the present meta-analysis study to secure the reliability generalization of the Child and Adolescent Mindfulness Scale (CAMM) based on its reliability findings in different studies. The study only considered full-text papers in English that were indexed in Web of Science, PubMed, ProQuest, and Scopus and presented a Cronbach's alpha value of the measurements with the CAMM (209 alpha values out of 155 papers). Using the random effects model and the Bonnet transformation, the relevant analyses yielded the transformed Cronbach's alpha value of the CAMM to be 0.80 (CI = 0.79-0.81). The present meta-analysis study concluded that the CAMM is rather reliable to be utilized in child and adolescent populations. Besides, moderator analyses to scrutinize the alpha values yielded significant differences in favor of the origin continent of the research and the CAMM-short version (25-item/10-item). Yet, it was not the case with the publication type and the adaptation status of the scale. In a nutshell, future research may confidently employ the 10-item short form of the CAMM to assess mindfulness among children and adolescents.
Collapse
Affiliation(s)
- Raziye Yüksel Doğan
- Department of Child Development, Faculty of Health Sciences, Hacettepe University, Ankara, Turkey
| | - Emin Demir
- Department of Child Development, Faculty of Health Sciences, Tarsus University, Tarsus, Turkey
| | - Sena Öz
- Department of Child Development, Faculty of Health Sciences, Ankara University, Ankara, Turkey
| | - Haktan Demircioğlu
- Department of Child Development, Faculty of Health Sciences, Hacettepe University, Ankara, Turkey
| |
Collapse
|
9
|
Gonçalves MT, Malafaia S, Moutinho Dos Santos J, Roth T, Marques DR. Epworth sleepiness scale: A meta-analytic study on the internal consistency. Sleep Med 2023; 109:261-269. [PMID: 37487279 DOI: 10.1016/j.sleep.2023.07.008] [Citation(s) in RCA: 33] [Impact Index Per Article: 16.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 07/06/2023] [Accepted: 07/07/2023] [Indexed: 07/26/2023]
Abstract
OBJECTIVE/BACKGROUND The Epworth Sleepiness Scale (ESS) is one of the most used self-reported instruments to assess sleepiness. Thus, several adaptations into different Languages have been performed worldwide over the years. The scale has produced disparate psychometric properties when applied in different settings. In the current study, our aim was to perform a Reliability Generalization meta-analysis of the Cronbach᾽s alphas of all published studies on ESS, specifically with a psychometric focus. PATIENTS/METHODS Three reference databases (Scopus, PubMed and Web of Science) were searched since 1991 to October 2022 and all the records on psychometric or validation studies that reported Cronbach's alphas, from clinical and nonclinical groups, were included. In total, data from 46 publications (63 estimates) were extracted, comprising 92,503 participants. RESULTS Using a Random-Effects Model, the cumulative Cronbach's alpha for the 63 estimates was about 0.82 (CI: 0.798, 0.832) which can be considered as a good measure. However, and as expected, it was observed a high level of heterogeneity (I2 = 98.96%). Moderation analyses considering setting, date, continent, risk of bias, sex, age and language were performed in order to account for the heterogeneity. Even so, only the variables study setting and continent were significant, and had little importance in explaining the heterogeneity. CONCLUSIONS The ESS is a reliable tool to measure sleepiness; however, further studies are needed to investigate what variables might explain the observed variability. Moreover, it will be important to include empirical studies beyond psychometric ones.
Collapse
Affiliation(s)
- Maria Teresa Gonçalves
- University of Aveiro, Department of Education and Psychology, Campus Universitário de Santiago, 3810-193, Aveiro, Portugal
| | - Simone Malafaia
- University of Aveiro, Department of Education and Psychology, Campus Universitário de Santiago, 3810-193, Aveiro, Portugal
| | | | - Thomas Roth
- Sleep Disorders and Research Center, Henry Ford Hospital, Detroit, MI, USA
| | - Daniel Ruivo Marques
- University of Aveiro, Department of Education and Psychology, Campus Universitário de Santiago, 3810-193, Aveiro, Portugal; CINEICC - Centre for Research in Neuropsychology and Cognitive Behavioural Intervention, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal.
| |
Collapse
|
10
|
Development and Reliability of a Questionnaire Assessing Stress, Coping, and Empathy (SCOPE) in Occupational Settings: Preliminary Evidence from Veterinarians. PSYCHIATRY INTERNATIONAL 2022. [DOI: 10.3390/psychiatryint3040029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Workplaces can be associated with occupational stress, detrimental consequences in terms of loss of health and reduced psychosocial well-being. Importantly, employees may be particularly at risk of poorer well-being during times of adversity at work, when not able to apply adaptive coping strategies and adopt a more empathetic approach. This study aimed to develop a scale to estimate occupational stress both in terms of situational and individual components, by performing item selection, internal reliability assessment, and investigation of the ceiling/floor effect. The target population consisted of veterinarians (n = 116), based on evidence of high risk of occupational stress and related mental distress. Out of twenty initial candidate entries, exploratory factor analysis retained fifteen items consisting of three domains related to occupational stress, copying strategies, and empathy (SCOPE). The SCOPE scale demonstrated good internal consistency as a whole (Cronbach’s alpha = 0.79) and when considering the three subscales (stress, 0.85; coping, 0.77; and empathy, 0.71). On a possible range from 15 (worst adjustment) to 75 (best adjustment), the sample mean performance was 51.68 (SD, 8.50). Preliminary evidence indicated that the SCOPE questionnaire may reveal differential effects of type of work on levels of occupational stress and related coping and empathy skills.
Collapse
|