The Validity of Conscientiousness Is Overestimated in the Prediction of Job Performance

A Meta-Analytic Review of the Validity of the Tangram Help/Hurt Task

The Tangram Help/Hurt Task (THHT) allows participants to help another participant win a prize (by assigning them easy tangrams), to hurt another participant by preventing them from winning the prize (by assigning them difficult tangrams), or to do neither (by assigning them medium tangrams) in offline or online studies. Consistent with calls for continued evidence supporting psychological measurement, we conducted a meta-analytic review of the THHT that included 52 independent studies involving 11,060 participants. THHT scores were associated with helping and hurting outcomes in theoretically predicted ways. Results showed that THHT scores were not only associated with short-term (experimental manipulations, state measures) and long-term (trait measures) helping and hurting outcomes, but also with helping and harming intentions. We discuss the strengths and limitations of the THHT relative to other laboratory measures of prosocial behavior and aggression, discuss unanswered questions about the task, and offer suggestions for the best use of the task.

But I have no time to read this article! A meta-analytic review of the consequences of employee time management behaviors

Time management is a beneficial tool for both individuals and their organizations. In this study, we conduct a meta-analytic review of the consequences of employee time management behaviors. Our results suggest that time management is associated with a variety of beneficial employee outcomes such as increased job satisfaction, job performance, and lower levels of stress and burnout. In addition, we found that the relationship between time management and employee outcomes is partially mediated by work-family conflict. Finally, relative weight analyses results indicated that perceived control over time exhibits incremental validity in predicting job satisfaction, job performance, and stress vis a vis conscientiousness. Directions for future research and practical implications of these findings are discussed.

A Silicon Valley love triangle: Hiring algorithms, pseudo-science, and the quest for auditability

In this perspective, we develop a matrix for auditing algorithmic decision-making systems (ADSs) used in the hiring domain. The tool is a socio-technical assessment of hiring ADSs that is aimed at surfacing the underlying assumptions that justify the use of an algorithmic tool and the forms of knowledge or insight they purport to produce. These underlying assumptions, it is argued, are crucial for assessing not only whether an ADS works "as intended," but also whether the intentions with which the tool was designed are well founded. Throughout, we contextualize the use of the matrix within current and proposed regulatory regimes and within emerging hiring practices that incorporate algorithmic technologies. We suggest using the matrix to expose underlying assumptions rooted in pseudo-scientific essentialized understandings of human nature and capability and to critically investigate emerging auditing standards and practices that fail to address these assumptions.

Effects of violent and nonviolent sexualized media on aggression-related thoughts, feelings, attitudes, and behaviors: A meta-analytic review

Women are often depicted as sex objects rather than as human beings in the media (e.g., magazines, television programs, films, and video games). Theoretically, media depictions of females as sex objects could lead to negative attitudes and even aggressive behavior toward them in the real world. Using the General Aggression Model (Anderson & Bushman, 2002) as a theoretical framework, this meta-analytic review synthesizes the literature on the effects of sexualized media (both violent and nonviolent) on aggression-related thoughts, attitudes, and behaviors. Our sample includes 166 independent studies involving 124,236 participants, which yielded 321 independent effects. Overall, the effects were "small" to "moderate" in size (r = .16 [.14-.18]). Significant correlations were found in experimental, cross-sectional, and longitudinal studies, indicating a triangulation of evidence. Effects were stronger for violent sexualized media (r = .25 [.19-.31]) than for nonviolent sexualized media (r = .15 [.13-.17]), although the effects of nonviolent sexualized media were still significant and nontrivial in size. Moreover, the effects of violent sexualized media on aggression were greater than the effects of violent non-sexualized media on aggression obtained in previous meta-analyses. Effects were similar for male and female participants, for college students and non-students, and for participants of all ages. The effects were also stable over time. Sensitivity analyses found that effects were not unduly influenced by publication bias and/or outliers. In summary, exposure to sexualized media content, especially in combination with violence, has negative effects on women, particularly on what people think about them and how aggressively they treat them.

Community-Augmented Meta-Analyses (CAMAs) in Psychology

Abstract. The limits of static snapshot meta-analyses and the relevance of reproducibility and data accessibility for cumulative meta-analytic research are outlined. A publication format to meet these requirements is presented: Community-augmented meta-analyses (CAMA). We give an overview of existing systems implementing this approach and compare these in terms of scope, technical implementation, data collection and augmentation, data curation, tools available for analysis, and methodological flexibility.

Near and Far Transfer in Cognitive Training: A Second-Order Meta-Analysis

Theory building in science requires replication and integration of findings regarding a particular research question. Second-order meta-analysis (i.e., a meta-analysis of meta-analyses) offers a powerful tool for achieving this aim, and we use this technique to illuminate the controversial field of cognitive training. Recent replication attempts and large meta-analytic investigations have shown that the benefits of cognitive-training programs hardly go beyond the trained task and similar tasks. However, it is yet to be established whether the effects differ across cognitive-training programs and populations (children, adults, and older adults). We addressed this issue by using second-order meta-analysis. In Models 1 (k = 99) and 2 (k = 119), we investigated the impact of working-memory training on near-transfer (i.e., memory) and far-transfer (e.g., reasoning, speed, and language) measures, respectively, and whether it is mediated by the type of population. Model 3 (k = 233) extended Model 2 by adding six meta-analyses assessing the far-transfer effects of other cognitive-training programs (video-games, music, chess, and exergames). Model 1 showed that working-memory training does induce near transfer, and that the size of this effect is moderated by the type of population. By contrast, Models 2 and 3 highlighted that far-transfer effects are small or null. Crucially, when placebo effects and publication bias were controlled for, the overall effect size and true variance equaled zero. That is, no impact on far-transfer measures was observed regardless of the type of population and cognitive-training program. The lack of generalization of skills acquired by training is thus an invariant of human cognition.

Effects of Weapons on Aggressive Thoughts, Angry Feelings, Hostile Appraisals, and Aggressive Behavior: A Meta-Analytic Review of the Weapons Effect Literature

A landmark 1967 study showed that simply seeing a gun can increase aggression—called the “weapons effect.” Since 1967, many other studies have attempted to replicate and explain the weapons effect. This meta-analysis integrates the findings of weapons effect studies conducted from 1967 to 2017 and uses the General Aggression Model (GAM) to explain the weapons effect. It includes 151 effect-size estimates from 78 independent studies involving 7,668 participants. As predicted by the GAM, our naïve meta-analytic results indicate that the mere presence of weapons increased aggressive thoughts, hostile appraisals, and aggression, suggesting a cognitive route from weapons to aggression. Weapons did not significantly increase angry feelings. Yet, a comprehensive sensitivity analysis indicated that not all naïve mean estimates were robust to the presence of publication bias. In general, these results suggest that the published literature tends to overestimate the weapons effect for some outcomes and moderators.

The Need for Formal Evidence Synthesis in Food Policy: A Case Study of Willingness-to-Pay

Meta-analysis is increasingly utilised in the understanding of consumer behaviour, including in relation to farm animal welfare. However, the issue of publication bias has received little attention. As willingness-to-pay (WTP) is widely used in policy, it is important to explore publication bias. This research aimed to evaluate publication bias in WTP, specifically public WTP for farm animal welfare. A systematic review of four databases yielded 54 studies for random effects meta-analysis. Publication bias was assessed by the Egger test, rank test, contour-enhanced funnel plots, and the Vevea and Hedges weight-function model. Results consistently indicated the presence of publication bias, highlighting an overestimation of WTP for farm animal welfare. Stakeholders should be wary of WTP estimates that have not been critically evaluated for publication bias.