So what? A framework for assessing the potential impact of intervention research

A science impact framework to measure impact beyond journal metrics

Measuring the impact of public health science or research is important especially when it comes to health outcomes. Achieving the desired health outcomes take time and may be influenced by several contributors, making attribution of credit to any one entity or effort problematic. Here we offer a science impact framework (SIF) for tracing and linking public health science to events and/or actions with recognized impact beyond journal metrics. The SIF was modeled on the Institute of Medicine's (IOM) Degrees of Impact Thermometer, but differs in that SIF is not incremental, not chronological, and has expanded scope. The SIF recognizes five domains of influence: disseminating science, creating awareness, catalyzing action, effecting change and shaping the future (scope differs from IOM). For public health, the goal is to achieve one or more specific health outcomes. What is unique about this framework is that the focus is not just on the projected impact or outcome but rather the effects that are occurring in real time with the recognition that the measurement field is complex, and it takes time for the ultimate outcome to occur. The SIF is flexible and can be tailored to measure the impact of any scientific effort: from complex initiatives to individual publications. The SIF may be used to measure impact prospectively of an ongoing or new body of work (e.g., research, guidelines and recommendations, or technology) and retrospectively of completed and disseminated work, through linking of events using indicators that are known and have been used for measuring impact. Additionally, linking events offers an approach to both tell our story and also acknowledge other players in the chain of events. The value added by science can easily be relayed to the scientific community, policy makers and the public.

Getting the Word Out: New Approaches for Disseminating Public Health Science

The gap between discovery of public health knowledge and application in practice settings and policy development is due in part to ineffective dissemination. This article describes (1) lessons related to dissemination from related disciplines (eg, communication, agriculture, social marketing, political science), (2) current practices among researchers, (3) key audience characteristics, (4) available tools for dissemination, and (5) measures of impact. Dissemination efforts need to take into account the message, source, audience, and channel. Practitioners and policy makers can be more effectively reached via news media, social media, issue or policy briefs, one-on-one meetings, and workshops and seminars. Numerous “upstream” and “midstream” indicators of impact include changes in public perception or awareness, greater use of evidence-based interventions, and changes in policy. By employing ideas outlined in this article, scientific discoveries are more likely to be applied in public health agencies and policy-making bodies.

Bringing health into transportation and land use scenario planning: Creating a National Public Health Assessment Model (N-PHAM)

There is mounting evidence linking land development and transportation investments to physical activity with resulting implications for chronic disease prevention. Links between the physical environment and health have traditionally focused on harmful exposures such as air pollution, noise, and traffic injury. Given limited funds and competition for how and where investments are made, there is a need to prioritize and target resources to maximize health benefits that can include activity related chronic disease prevention. The ability to apply this evidence to decision making has been limited by the complexity and inconsistency of research methods, and lack of a direct connection with the planning contexts in which decisions are made. Scenario planning tools provide a method to apply evidence with spatial planning decisions at a range of geographic scales. The US Environmental Protection Agency commissioned the development of a National Public Health Assessment Model (N-PHAM). This project utilized built and natural environment data at the block-group level and large population surveys to model the relationships of the environment with several health outcomes for a range of age and income groups. N-PHAM is the first health assessment tool that can connect to multiple existing scenario planning platforms utilizing nationally available data and can be consistently applied nationally. Such tools can empower communities to choose investments that have the greatest potential to improve public health and quality of life, reduce health care costs, and address environmental justice related disparities.