The Benefits, Barriers, and Risks of Big-Team Science

Sample characteristics for quantitative analyses in Body Image: Issues of generalisability

Psychological research frequently encounters criticism regarding the representativeness of the samples under study, highlighting concerns about the external validity of the obtained results. Here, we conducted a comprehensive survey of all the quantitative samples from the journal Body Image for 2021 (n = 149 samples). Our primary objective was to examine the extent to which the sampled populations deviated from the population at large, which could potentially compromise the generalizability of findings. We identified that a substantial number of these samples came from student populations (n = 44) and the majority were from the United States, United Kingdom, and Australia. Only a small number of samples (n = 9) employed direct measurements of body mass index (BMI), while the majority relied on self-reported data (n = 93). For a subset of samples in the journal, which were drawn from the general population, we compared whether these differed from population reference values in terms of age and BMI. Using Monte Carlo simulations, we found that samples tended to be younger and score lower on BMI than reference values obtained from the broader population. Samples drawn from female university students also tended to be lower on BMI than age-matched reference samples. We discuss the implications of our findings and make recommendations on sampling and inference. We conclude that a clearer specification of the parameters or conditions under which findings are expected to generalise has the potential to enhance the overall rigor and validity of this field of research.

Toolbox of individual-level interventions against online misinformation

The spread of misinformation through media and social networks threatens many aspects of society, including public health and the state of democracies. One approach to mitigating the effect of misinformation focuses on individual-level interventions, equipping policymakers and the public with essential tools to curb the spread and influence of falsehoods. Here we introduce a toolbox of individual-level interventions for reducing harm from online misinformation. Comprising an up-to-date account of interventions featured in 81 scientific papers from across the globe, the toolbox provides both a conceptual overview of nine main types of interventions, including their target, scope and examples, and a summary of the empirical evidence supporting the interventions, including the methods and experimental paradigms used to test them. The nine types of interventions covered are accuracy prompts, debunking and rebuttals, friction, inoculation, lateral reading and verification strategies, media-literacy tips, social norms, source-credibility labels, and warning and fact-checking labels.

A Novel, Network-Based Approach to Assessing Romantic-Relationship Quality

How should romantic-relationship quality be approached psychometrically? This is a complicated theoretical and methodological challenge that we begin to address through three studies. In Study 1a, we identified 25 distinct romantic-relationship categories among 754 items from 26 romantic-relationship-quality instruments with a weak Jaccard index (0.38), indicating that the scales' item content was extremely heterogeneous. Study 1b then demonstrated limited structure validity evidence in 43 scale-development-validation articles of 23 of these 26 instruments. Finally, Study 2 surveyed 587 French-speaking participants in a romantic relationship on romantic-relationship quality. Applying a network-based model, we identified four dimensions, three of which are central to relationship quality. The inferences were mostly limited to French-speaking, monogamous, heterosexual women. To resolve challenges detected in the literature, we recommend a multicountry qualitative approach, more diverse sampling, better definitions of romantic-relationship quality, and a dynamic-systems approach to measuring romantic-relationship quality.

Big team science initiatives: A catalyst for trustworthy advancements in IO psychology

Keener et al. (2023) raise concerns about the trustworthiness of Industrial/Organizational (IO) Psychology research and related fields due to the low reproducibility and replicability of research findings. The authors provide various solutions to resolve this crisis, such as improving training, realigning incentives, and adopting open science practices. Our commentary elaborates on one solution to which they briefly allude: Big Team Science Initiatives (BTSIs). BTSIs allow scholars to address the trustworthiness of our science by facilitating large sample theory testing, sharing and allocating resources, and selecting appropriate research strategies, all of which support the reproducibility and replication of research. Further, we propose that BTSIs may facilitate researcher training, encourage data sharing and materials, and realign incentives in our field. We discuss how BTSIs could be implemented in IO psychology and related fields, identifying and drawing upon similar BTSIs in related disciplines. Thus, our commentary is an extension of the focal article, encouraging scholars to collaboratively address the "crisis of confidence" facing our field using a big team science approach.

A metascience investigation of inclusive, open, and reproducible science practices in research posters at the 2021 SRCD biennial meeting

Over the past decade, there has been a growing appreciation of metascience issues in psychological science. Using data collected from 2615 posters presented at the 2021 biennial meeting of the Society for Research in Child Development, this article examines the use of transparent research practices to increase rigor and reproducibility as well as generalizability through greater inclusivity of diverse samples. Research presented through poster presentations was heavily skewed toward quantitative studies featuring American researchers using Western hemisphere samples. Sharing of data/materials, preregistrations, and replications were uncommon. During a time when governments are increasingly requiring more open practices and access, this research provides an important baseline by which developmental science can benchmark progress toward the goals of greater inclusivity and openness.

Speech, Language, and Hearing in the 21st Century: A Bibliometric Review of JSLHR From 2001 to 2021

PURPOSE

A bibliometric analysis was performed for articles published in the Journal of Speech, Language, and Hearing Research (JSLHR) from 2001 to 2021 to examine changes to and emerging trends in the speech, language, and hearing sciences in the 21st century.

METHOD

Quantitative analyses using JASP were performed on the publication rate and number of authors in articles published in JSLHR for each year from 2001 to 2021. VOSviewer was used to analyze and visualize networks of co-occurring Keyword Plus terms extracted from the articles published in JSLHR for several representative years from 2001 to 2021.

RESULTS

Although the number of publications and number of authors published in JSLHR increased from 2001 to 2021, that growth was consistent with the growth found in science in general and with changes in publication policies and practices. The number and range of countries other than the United States published in JSLHR increased from 2001 to 2021. A consistent set of institutions published frequently in JSLHR across the years examined. The analysis of Keyword Plus terms showed an increase in the range of populations, disorders, and languages that were the subject of research from 2001 to 2021, as well as influences from other fields on speech, language, and hearing sciences.

CONCLUSION

The science of science approach and the tools of network science are useful for assessing how changes in editorial policy affect diversity, for monitoring research topics that are growing (or declining), for identifying institutions that lead the field, and for inviting discussions among various interested parties related to the growth and development of a discipline.

Perspectives on scientific error

Theoretical arguments and empirical investigations indicate that a high proportion of published findings do not replicate and are likely false. The current position paper provides a broad perspective on scientific error, which may lead to replication failures. This broad perspective focuses on reform history and on opportunities for future reform. We organize our perspective along four main themes: institutional reform, methodological reform, statistical reform and publishing reform. For each theme, we illustrate potential errors by narrating the story of a fictional researcher during the research cycle. We discuss future opportunities for reform. The resulting agenda provides a resource to usher in an era that is marked by a research culture that is less error-prone and a scientific publication landscape with fewer spurious findings.

Forgiving lark, resentful owl: Self-control mediates the relationship between chronotype and forgiveness

Considerable evidence shows that nocturnal chronotypes have increased odds of mental health problems, poor academic performance, and impairment in executive functions. Although the cognitive and health costs of evening-oriented preference are well-documented in the literature, little is known about its interpersonal costs. In this article, we propose that people with a preference for an evening chronotype show a lower tendency to forgive following an interpersonal offense because of their lower self-control ability. Three studies using independent samples and complementary measures reveal that morning-evening preference plays a role in the emergence of forgiveness, which provides support for our theoretical perspective. In Study 1, we found that evening-type students were less forgiving when responding to a transgression than morning-type students. Employing a longer measure of forgiveness and a more representative population, Study 2 replicated our initial findings and supported our hypothesis regarding the mediating role of self-control. To circumvent methodological issues associated with self-report data, Study 3 used a behavioral measure of forgiveness and revealed that chronotype can also predict actual forgiving behavior in a laboratory setting. Together, these findings suggest that diurnal preference towards eveningness not only imposes threats on people's health, but can also incur interpersonal costs.