Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement

The transparency of quantitative empirical legal research published in highly ranked law journals (2018-2020): an observational study

Background

Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include sharing data, materials, and analytic scripts, and preregistering protocols. This shift towards increased transparency and rigor has been referred to as a "credibility revolution." The credibility of empirical legal research has been questioned in the past due to its distinctive peer review system and because the legal background of its researchers means that many often are not trained in study design or statistics. Still, there has been no systematic study of transparency and credibility-related characteristics of published empirical legal research.

Methods

To fill this gap and provide an estimate of current practices that can be tracked as the field evolves, we assessed 300 empirical articles from highly ranked law journals including both faculty-edited journals and student-edited journals.

Results

We found high levels of article accessibility (86%, 95% CI = [82%, 90%]), especially among student-edited journals (100%). Few articles stated that a study's data are available (19%, 95% CI = [15%, 23%]). Statements of preregistration (3%, 95% CI = [1%, 5%]) and availability of analytic scripts (6%, 95% CI = [4%, 9%]) were very uncommon. (i.e., they collected new data using the study's reported methods, but found results inconsistent or not as strong as the original).

Conclusion

We suggest that empirical legal researchers and the journals that publish their work cultivate norms and practices to encourage research credibility. Our estimates may be revisited to track the field's progress in the coming years.

Exposure to the Death of Others during the COVID-19 Pandemic: Growing Mistrust in Medical Institutions as a Result of Personal Loss

BACKGROUND AND AIMS

The prominence of death during the COVID-19 pandemic was heightened by the potential of personally knowing someone who lost their life to the virus. The terror management theory (TMT) suggests that the salient presence of death has a pronounced effect on behavior and may result in the ossification of beliefs and actions aligned with one's worldview (i.e., the mortality salience hypothesis). In this study, we evaluated how death exposure early in the COVID-19 pandemic could enact the process of firming up held beliefs and attitudes related to health and safety. Specifically, we tested the hypothesis that exposure to a personal loss during the pandemic would strengthen participants' baseline attitudes and behaviors regarding COVID-19 safety guidelines.

METHOD

Data were analyzed from a prospective, regional survey administered at two time points during the pandemic, June-July 2020 and May 2021, in five United States northeastern states. Baseline and follow-up surveys were administered approximately 12 months apart, with adherence to public guidance and death exposure measured at both timepoints and other safety measures at follow-up only.

FINDINGS

Our results indicated that there were significant main effects of death exposure on guideline adherence and support for COVID-related public policy. Contrary to the mortality salience hypothesis, death exposures after baseline were related to higher medical mistrust at follow-up for those high in adherence at baseline, rather than those with low adherence.

CONCLUSION

Our results offer some conflicting evidence to the mortality salience hypothesis. Rather than entrench people in their worldviews, death in the context of the COVID-19 pandemic appeared to sway people away from their initial stances. This finding has important implications for TMT literature and for the COVID-19 pandemic response.

Eleven years of student replication projects provide evidence on the correlates of replicability in psychology

Cumulative scientific progress requires empirical results that are robust enough to support theory construction and extension. Yet in psychology, some prominent findings have failed to replicate, and large-scale studies suggest replicability issues are widespread. The identification of predictors of replication success is limited by the difficulty of conducting large samples of independent replication experiments, however: most investigations reanalyse the same set of 170   replications . We introduce a new dataset of 176 replications from students in a graduate-level methods course. Replication results were judged to be successful in 49% of replications; of the 136 where effect sizes could be numerically compared, 46% had point estimates within the prediction interval of the original outcome (versus the expected 95%). Larger original effect sizes and within-participants designs were especially related to replication success. Our results indicate that, consistent with prior reports, the robustness of the psychology literature is low enough to limit cumulative progress by student investigators.

Intraindividual Changes in Political Identity Strength (But Not Direction) Are Associated With Political Animosity in the United States and the Netherlands

We test if within-person changes in political identities are associated with within-person changes in political animosity in two longitudinal studies (United States N = 552, Waves = 26; Netherlands N = 1,670, Waves = 12). Typical studies examine cross-sectional associations without assessing within-person change. Our work provides a stronger test of the relationship. We find that within-person changes in the strength of people's ideological and partisan identities are associated with increased political animosity. We found no such associations with within-person changes in identity direction. These patterns were robust to covariates and emerged in both studies. In addition to these average effects, we found substantial heterogeneity across participants in the associations among identity strength, identity direction, and political animosity. We did not find robust and replicable moderators for this heterogeneity. These findings suggest that identity strength (but not identity direction) is a key, if heterogenous, factor in changes in political animosity.

Reminders of Mortality: Investigating the Effects of Different Mortality Saliences on Somatosensory Neural Activity

The Terror Management Theory (TMT) offered a great deal of generative hypotheses that have been tested in a plethora of studies. However, there is a still substantive lack of clarity about the interpretation of TMT-driven effects and their underlying neurological mechanisms. Here, we aimed to expand upon previous research by introducing two novel methodological manipulations aimed to enhance the effects of mortality salience (MS). We presented participants with the idea of the participants' romantic partner's death as well as increased the perceived threat of somatosensory stimuli. Linear mixed modelling disclosed the greater effects of MS directed at one's romantic partner on pain perception (as opposed to the participant's own mortality). The theta event-related oscillatory activity measured at the vertex of the scalp was significantly lower compared to the control condition. We suggest that MS aimed at one's romantic partner can result in increased effects on perceptual experience; however, the underlying neural activities are not reflected by a classical measure of cortical arousal.

No significant effect of mortality salience on unconscious ethnic bias among the Japanese

OBJECTIVE

Terror management theory posits that when mortality is salient, individuals attempt to defend their cultural worldviews. Although numerous studies have confirmed this hypothesis, some recent studies have suggested that East Asians do not engage in worldview defense. We conducted a pre-registered experiment with 895 Japanese adults to investigate whether they exhibited worldview defense at an unconscious level. Participants performed the Implicit Association Test using Japanese and Korean surnames as stimuli after being primed with thoughts about mortality.

RESULTS

The results revealed that mortality salience had no influence on implicit ethnic bias. These findings support the notion that East Asians do not engage in worldview defense, in accord with recent criticism of the validity of terror management theory. We discuss the limitations and implications of our findings.

Comparing Foodie Calls in Poland, the United Kingdom, and the United States: A Registered Replication Report

Collisson et al. (2020) found Dark Triad traits and gender role beliefs predicted "foodie calls," a phenomenon where people go on a date with others, to whom they are not attracted, for a free meal. Because gender roles and dating norms differ across cultures, we conducted a registered replication across different cultures by surveying 1838 heterosexual women from Poland, the United Kingdom (UK), and the United States (US). Relying on the structural equation modeling, as conducted in the original study, our findings revealed gender role beliefs best predicted foodie calls and their perceived acceptability, whereas the Dark Triad's general factor was nonsignificant. Analyses at the country level yielded mixed results. The original findings were replicated in the UK and Poland, but not in the US, where only narcissism predicted foodie calls. In the US, gender role beliefs predicted foodie call acceptability, but the Dark Triad general factor did not. Potential reasons for why traditional gender roles, but not the Dark Triad, predicted foodie calls in the US are discussed.

"Life's too short to be small": An experimental exploration of the relationship between death anxiety and muscle dysmorphia symptoms

Growing research demonstrates that death anxiety is strongly associated with numerous mental health conditions. It is possible that death anxiety may similarly contribute to behaviours associated with muscle dysmorphia (MD). The current pre-registered study examined this possibility in 322 young men with an interest in health and fitness. The mortality salience paradigm was used to experimentally examine whether reminders of death increased behaviours relevant to MD. Measures of MD symptoms and death anxiety were also completed by participants. Contrary to expectations, reminders of death did not significantly increase willingness to trial workout supplements, or dissatisfaction with current muscularity. Participants reminded of death reported lower intention to exercise in the near future, compared to the control condition. Moreover, death reminders did not lead to significantly larger portion sizes being chosen. However, in post-hoc analyses, men with high, but not low, MD symptoms did choose larger portions after being primed with death. Lastly, positive correlations were found between self-report measures of MD symptoms and two measures of death anxiety. Cumulatively, these results suggest that while fears of death may be associated with self-reported MD symptoms, they may not drive excessive exercise, nor body dissatisfaction in men.

The TRIBE model: How socioemotional processes fuel end-of-life treatment in the United States

Prior interventions have repeatedly failed to decrease the prescription and receipt of treatments and procedures that confer more harm than benefit at the End-of-Life (EoL); new approaches to intervention are needed. Ideally, future interventions would be informed by a social-ecological conceptual model that explains EoL healthcare utilization patterns, but current models ignore two facts: (1) healthcare is an inherently social activity, involving clinical teams and patients' social networks, and (2) emotions influence social activity. To address these omissions, we scaffolded Terror Management Theory and Socioemotional Selectivity Theory to create the Transtheoretical Model of Irrational Biomedical Exuberance (TRIBE). Based on Terror Management Theory, TRIBE suggests that the prospect of patient death motivates healthcare teams to conform to a biomedical norm of care, even when clinicians believe that biomedical interventions will likely be unhelpful. Based on Socioemotional Selectivity Theory, TRIBE suggests that the prospect of dwindling time motivates families to prioritize emotional goals, and leads patients to consent to disease-directed treatments they know will likely be unhelpful, as moral emotions motivate deference to the perceived emotional needs of their loved ones. TRIBE is unique among models of healthcare utilization in its acknowledgement that moral emotions and processes (e.g., shame, compassion, regret-avoidance) influence healthcare delivery, patients' interactions with family members, and patients' outcomes. TRIBE is especially relevant to potentially harmful EoL care in the United States, and it also offers insights into the epidemics of overtreatment in healthcare settings worldwide. By outlining the role of socioemotional processes in the care of persons with serious conditions, TRIBE underscores the critical need for psychological innovation in interventions, health policy and research on healthcare utilization.

Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies

Terror management theory postulates that mortality salience (MS) increases the motivation to defend one's cultural worldviews. How that motivation is expressed may depend on the social norm that is momentarily salient. Meta-analyses were conducted on studies that manipulated MS and social norm salience. Results based on 64 effect sizes for the hypothesized interaction between MS and norm salience revealed a small-to-medium effect of g = 0.34, 95% confidence interval [0.26, 0.41]. Bias-adjustment techniques suggested the presence of publication bias and/or the exploitation of researcher degrees of freedom and arrived at smaller effect size estimates for the hypothesized interaction, in several cases reducing the effect to nonsignificance (range g_corrected = -0.36 to 0.15). To increase confidence in the idea that MS and norm salience interact to influence behavior, preregistered, high-powered experiments using validated norm salience manipulations are necessary. Concomitantly, more specific theorizing is needed to identify reliable boundary conditions of the effect.