A synthesis of evidence for policy from behavioural science during COVID-19

Scientific evidence regularly guides policy decisions1, with behavioural science increasingly part of this process2. In April 2020, an influential paper3 proposed 19 policy recommendations ('claims') detailing how evidence from behavioural science could contribute to efforts to reduce impacts and end the COVID-19 pandemic. Here we assess 747 pandemic-related research articles that empirically investigated those claims. We report the scale of evidence and whether evidence supports them to indicate applicability for policymaking. Two independent teams, involving 72 reviewers, found evidence for 18 of 19 claims, with both teams finding evidence supporting 16 (89%) of those 18 claims. The strongest evidence supported claims that anticipated culture, polarization and misinformation would be associated with policy effectiveness. Claims suggesting trusted leaders and positive social norms increased adherence to behavioural interventions also had strong empirical support, as did appealing to social consensus or bipartisan agreement. Targeted language in messaging yielded mixed effects and there were no effects for highlighting individual benefits or protecting others. No available evidence existed to assess any distinct differences in effects between using the terms 'physical distancing' and 'social distancing'. Analysis of 463 papers containing data showed generally large samples; 418 involved human participants with a mean of 16,848 (median of 1,699). That statistical power underscored improved suitability of behavioural science research for informing policy decisions. Furthermore, by implementing a standardized approach to evidence selection and synthesis, we amplify broader implications for advancing scientific evidence in policy formulation and prioritization.

Nudging New York: adaptive models and the limits of behavioral interventions to reduce no-shows and health inequalities

Background

Missed healthcare appointments (no-shows) are costly and operationally inefficient for health systems. No-show rates are particularly high for vulnerable populations, even though these populations often require additional care. Few studies on no-show behavior or potential interventions exist specifically for Federally Qualified Health Centers (FQHCs), which care for over 24 million disadvantaged individuals in the United States. The purpose of this study is to identify predictors of no-show behavior and to analyze the effects of a reminder intervention in urban FQHCs in order to design effective policy solutions to a protracted issue in healthcare.

Methods

This is a retrospective observational study using electronic medical record data from 11 facilities belonging to a New York City-based FQHC network between June 2017 to April 2018. This data includes 53,149 visits for 41,495 unique patients. Seven hierarchical generalized linear models and generalized additive models were used to predict no-shows, and multiple regression models evaluated the effectiveness of a reminder. All analyses were conducted in R.

Results

The strongest predictor of no-show rates in FQHCs is whether or not patients are assigned to empaneled providers (z = − 91.45, p < 10^− 10), followed by lead time for appointments (z = 23.87, p < 10^− 10). These effects were fairly stable across facilities. The reminder had minimal effects on no-show rates overall (No show rate before: 41.6%, after: 42.1%). For individuals with appointments before and after the reminder, there was a small decrease in no-shows of 2%.

Conclusions

The limited effects of the reminder intervention suggest the need for more personalized behavioral interventions to reduce no-shows. We recommend that these begin with increasing the use of empaneled providers for preventive care appointments and reducing the lag time between setting the appointment and the actual date of the appointment, at least for individuals with a high rate of no-show. By complementing these with low-intensity, low-cost behavioral interventions, we would expect greater impacts for improved access to care, contributing to the well-being of vulnerable populations.