Framing COVID-19 Preprint Research as Uncertain: A Mixed-Method Study of Public Reactions

During the COVID-19 pandemic, journalists were encouraged to convey uncertainty surrounding preliminary scientific evidence, including mentioning when research is unpublished or unverified by peer review. To understand how public audiences interpret this information, we conducted a mixed method study with U.S. adults. Participants read a news article about preprint COVID-19 vaccine research in early April 2021, just as the vaccine was becoming widely available to the U.S. public. We modified the article to test two ways of conveying uncertainty (hedging of scientific claims and mention of preprint status) in a 2 × 2 between-participants factorial design. To complement this, we collected open-ended data to assess participants' understanding of the concept of a scientific preprint. In all, participants who read hedged (vs. unhedged) versions of the article reported less favorable vaccine attitudes and intentions and found the scientists and news reporting less trustworthy. These effects were moderated by participants' epistemic beliefs and their preference for information about scientific uncertainty. However, there was no impact of describing the study as a preprint, and participants' qualitative responses indicated a limited understanding of the concept. We discuss implications of these findings for communicating initial scientific evidence to the public and we outline important next steps for research and theory-building.

Making science public: a review of journalists' use of Open Access research

Science journalists are uniquely positioned to increase the societal impact of open research outputs by contextualizing and communicating findings in ways that highlight their relevance and implications for non-specialist audiences. Yet, it is unclear to what degree journalists use open research outputs, such as open access publications or preprints, in their reporting; what factors motivate or constrain this use; and how the recent surge in openly available research seen during the COVID-19 pandemic has affected this. This article examines these questions through a review of relevant literature published from 2018 onwards-particularly literature relating to the COVID-19 pandemic-as well as seminal articles outside the search dates. We find that research that explicitly examines journalists' engagement with open access publications or preprints is scarce, with existing literature mostly addressing the topic tangentially or as a secondary concern, rather than a primary focus. Still, the limited body of evidence points to several factors that may hamper journalists' use of these outputs and thus warrant further exploration. These include an overreliance on traditional criteria for evaluating scientific quality; concerns about the trustworthiness of open research outputs; and challenges using and verifying the findings. We also find that, while the COVID-19 pandemic encouraged journalists to explore open research outputs such as preprints, the extent to which these explorations will become established journalistic practices remains unclear. Furthermore, we note that current research is overwhelmingly authored and focused on the Global North, and the United States specifically. We conclude with recommendations for future research that attend to issues of equity and diversity, and more explicitly examine the intersections of open access and science journalism.

A synthesis of evidence for policy from behavioural science during COVID-19

Scientific evidence regularly guides policy decisions1, with behavioural science increasingly part of this process2. In April 2020, an influential paper3 proposed 19 policy recommendations ('claims') detailing how evidence from behavioural science could contribute to efforts to reduce impacts and end the COVID-19 pandemic. Here we assess 747 pandemic-related research articles that empirically investigated those claims. We report the scale of evidence and whether evidence supports them to indicate applicability for policymaking. Two independent teams, involving 72 reviewers, found evidence for 18 of 19 claims, with both teams finding evidence supporting 16 (89%) of those 18 claims. The strongest evidence supported claims that anticipated culture, polarization and misinformation would be associated with policy effectiveness. Claims suggesting trusted leaders and positive social norms increased adherence to behavioural interventions also had strong empirical support, as did appealing to social consensus or bipartisan agreement. Targeted language in messaging yielded mixed effects and there were no effects for highlighting individual benefits or protecting others. No available evidence existed to assess any distinct differences in effects between using the terms 'physical distancing' and 'social distancing'. Analysis of 463 papers containing data showed generally large samples; 418 involved human participants with a mean of 16,848 (median of 1,699). That statistical power underscored improved suitability of behavioural science research for informing policy decisions. Furthermore, by implementing a standardized approach to evidence selection and synthesis, we amplify broader implications for advancing scientific evidence in policy formulation and prioritization.

Changes in health communication in the age of COVID-19: A study on the dissemination of preprints to the public

Introduction

Preprints have become an important tool for meeting the challenges of health communication in the context of COVID-19. They allow scientists to disseminate their results more quickly due to the absence of a peer review process. Preprints have been well-received by scientists, however, there have been concerns about the exposure of wider public audiences to preprints due in part to this lack of peer review.

Methods

The aim of this study is to examine the dissemination of preprints on medRxiv and bioRxiv during the COVID-19 pandemic using content analysis and statistical analysis.

Results

Our findings show that preprints have played an unprecedented role in disseminating COVID-19-related science results to the public.

Discussion

While the overall media coverage of preprints is unsatisfactory, digital native news media performed better than legacy media in reporting preprints, which means that we could make the most of digital native media to improve health communication. This study contributes to understanding how science communication has evolved in response to the COVID-19 pandemic and provides some practical recommendations.

Science in motion: A qualitative analysis of journalists' use and perception of preprints

This qualitative study explores how and why journalists use preprints-unreviewed research papers-in their reporting. Through thematic analysis of interviews conducted with 19 health and science journalists in the second year of the COVID-19 pandemic, it applies a theoretical framework that conceptualizes COVID-19 preprint research as a form of post-normal science, characterized by high scientific uncertainty and societal relevance, urgent need for political decision-making, and value-related policy considerations. Findings suggest that journalists approach the decision to cover preprints as a careful calculation, in which the potential public benefits and the ease of access preprints provided were weighed against risks of spreading misinformation. Journalists described viewing unreviewed studies with extra skepticism and relied on diverse strategies to find, vet, and report on them. Some of these strategies represent standard science journalism, while others, such as labeling unreviewed studies as preprints, mark a departure from the norm. However, journalists also reported barriers to covering preprints, as many felt they lacked the expertise or the time required to fully understand or vet the research. The findings suggest that coverage of preprints is likely to continue post-pandemic, with important implications for scientists, journalists, and the publics who read their work.

[Informed trust in science: lessons from the COVID 19 pandemic for the conceptualization of science literacy]

Informed trust in science is necessary for the 'interfaces' within the flow of knowledge between citizens' everyday understanding of the pandemic and the dynamically evolving state of knowledge in the sciences. This is the core thesis of this paper. Without science, the COVID-19 pandemic can neither be understood nor controlled, and for this to happen, citizens must engage with science based knowledge. However, such knowledge is dynamic (evolving and intertwined with normative issues). Furthermore, science based knowledge competes with pseudoscientific contributions. As non-experts, laypersons must therefore decide whom to trust. The paper describes the concept of functional scientific literacy as a prerequisite of informed trust. The knowledge bases for judgments of informed trust should be taught in school and judging rationally about the trustworthiness of science-related knowledge claims should be practiced.