CDC's Program Evaluation Journey: 1999 to Present

Evaluation of Centers for Disease Control and Prevention's Evaluation Fellowship Program

OBJECTIVE

The Centers for Disease Control and Prevention's (CDC's) Evaluation Fellowship Program is a 2-year fellowship that includes training, placement with a CDC program, and professional development funds. We evaluated whether the program contributed to CDC's evaluation capacity, prepared fellows for evaluation work, and contributed to their career advancement during its first 10 years.

METHODS

We used a mixed-methods approach, including conducting an online survey and telephone interviews. External evaluators sent surveys to all 152 alumni and all 123 mentors who participated in the program from 2011 through 2020 (first 8 cohorts) and interviewed 9 mentors and 15 alumni.

RESULTS

A total of 110 alumni (72.4%) and 44 mentors (35.8%) completed surveys. Of 44 mentors, most agreed their fellow(s) contributed to their program's overall evaluation capacity (90.9%) and its ability to do more evaluation (88.6%). Most (84.2%-88.1%) alumni agreed that the Evaluation Fellowship Program prepared them to apply the 6 skill sets that aligned with CDC's Framework for Program Evaluation in Public Health. Support from the Fellowship office was significantly and positively correlated with performing evaluation tasks (β = 0.25; P = .004) and alumni obtaining their first job (β = 0.36; P < .001). Host program mentoring was significantly correlated with performing evaluation tasks (β = 0.27; P = .02) and alumni obtaining their first job (β = 0.34; P = .007).

CONCLUSION

CDC's Evaluation Fellowship Program has made progress toward building CDC's evaluation capacity and preparing a public health workforce to use evaluation skills in various settings. A service-learning model that provides training and applied experiences could prepare a workforce to build evaluation capacity.

Key insights on multisector community partnerships from real-world efforts to address social determinants of health

PURPOSE

To better understand and inform how multisector community partnerships (MCPs) perform meaningful work to prevent chronic disease and advance health equity by addressing social determinants of health (SDOH).

METHODS

We conducted a rapid retrospective evaluation of SDOH initiatives implemented within the past three years by 42 established MCPs across the United States. The mixed methods evaluation included document review and coding of available outcomes data, virtual discussions, and Prevention Impacts Simulation Model (PRISM) analysis.

RESULTS

All 42 MCPs built community capacity for addressing SDOH through new or strengthened data systems, leveraged resources, or engaged residents, for example. Most MCPs (N = 38, 90%) reported contributions to community changes that promote healthy living. More than half of the MCPs (N = 22) reported health outcomes data for their SDOH initiatives, including improved health behaviors and clinical outcomes. Based on reach data provided by 27 MCPs, PRISM analysis results suggest that sustained initiatives could save over $633 million in productivity and medical costs cumulatively through 20 years.

CONCLUSIONS

With sufficient technical assistance and funding resources, MCPs are a key component of the public health strategy to address SDOH.

Health Departments' Role in Addressing Social Determinants of Health in Collaboration With Multisector Community Partnerships

Multisector community partnerships (MCPs) are key component of the public health strategy for addressing social determinants of health (SDOH) and promoting health equity. Governmental public health agencies are often members or leaders of MCPs, but few studies have examined the role of health departments in supporting MCPs' SDOH initiatives. We engaged 42 established MCPs in a rapid retrospective evaluation to better understand how MCPs' SDOH initiatives contribute to community changes that promote healthy living and improved health outcomes. As part of this work, we gained insights into how health departments support MCPs' SDOH initiatives, as well as opportunities for enhanced collaboration. Results indicate that health departments can support MCPs' SDOH initiatives through the provision of funding and technical assistance, data sharing, and connecting community organizations with shared missions, for example. Findings can be used to inform the development of funding opportunities and technical assistance for MCPs and health department partners.

Nurses' experiences of an outreach interprofessional mental health service for nursing homes: a qualitative descriptive study

WHAT IS KNOWN ON THE SUBJECT?: Treatment and mental health care in familiar environments are beneficial for older people experiencing mental health issues. But there are not enough qualified and specialized nurses who can meet the complex needs of nursing home residents experiencing mental health issues. The University Hospital of Psychiatry Zurich, Switzerland, established an outreach interprofessional mental health service to foster the care for residents experiencing mental health issues in nursing homes. Based on existing studies, little can be said about whether nurses in nursing homes find these types of services helpful. WHAT DOES THIS PAPER ADD TO EXISTING KNOWLEDGE?: Nurses in nursing homes caring for residents experiencing mental health issues felt relieved by having inclusive support from the interprofessional mental health service. Nurses appreciated the mental health team and felt accompanied and more confident in their daily work. Results showed that nurses wanted to be included in the care and treatment processes and to work as partners on an equal footing with the mental health team. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Outreach interprofessional mental health services for nursing homes should take into account nurses' views and professional experience, and value and respect their role as nurses. Outreach interprofessional mental health services for nursing homes should offer further training in psychiatric nursing, include an accessible contact person in the team, and develop clear processes and responsibilities.

ABSTRACT

INTRODUCTION: Outreach interprofessional mental health services for nursing homes can increase the quality of care for residents experiencing mental health issues but research on how nurses in nursing homes experience such a service is lacking worldwide.

AIM

To describe how nurses experience the involvement of an outreach interprofessional mental health team in the care for older people experiencing mental health issues in nursing homes and to identify barriers to and facilitators of interprofessional collaboration.

METHOD

Qualitative descriptive analysis based on 13 semi-structured interviews. Framework analysis and complex adaptive systems theory were applied.

RESULTS

One core theme with two main categories: Nurses experienced relief from burden through inclusive support provided by the mental health team. Main categories were feeling accompanied and confident as a nurse and partnership-based collaboration.

DISCUSSION

Results showed for the first time that nurses felt supported by the mental health team and were encouraged to find new ways of coping with challenging situations.

IMPLICATIONS FOR PRACTICE

To empower nurses, mental health teams should take into account nurses' perceptions in the treatment process, value and respect their role as nurses, transfer knowledge in both formal and informal settings, establish a steady and reliable contact person, and define processes and responsibilities.

Readying the Applied Epidemiology Workforce for Emerging Areas of Public Health Practice

CONTEXT

Epidemiologists are key professionals within the public health workforce. As the role of public health agencies changes over time, epidemiologists will need to adapt and develop new skill sets to work in emerging areas of (public health) practice (EAoPs), which are areas of practice that are new or are growing in interest and use.

OBJECTIVE

This mixed-methods research study sought to explore the role and readiness of state health department epidemiologists in the United States to work in EAoPs.

DESIGN

Three phases of data collection and analysis were conducted including secondary analysis of the Public Health Workforce Interests and Needs Survey, a survey of the designated state epidemiologist in all 50 states and the District of Columbia, and focus groups with early-, mid-, and senior-career epidemiologists working in state health departments.

SETTING

Fifty state health departments and the District of Columbia.

PARTICIPANTS

Epidemiologists working in state health departments.

MAIN OUTCOME MEASURES

Identification of EAoPs relevant to epidemiologists, the role of epidemiologists in these EAoPs, and readiness of epidemiologists to work in EAoPs.

RESULTS

Participant state health department epidemiologists indicated that the studied EAoPs were important to their work and that epidemiologists have some role in them. Key facilitators identified to working in EAoPs included supportive organizational strategy and leadership, dedicated time for training and work, cross-training across programs, and the development of crosscutting skills.

CONCLUSIONS

There is much opportunity for epidemiologists to be more engaged in current EAoPs. Not only can epidemiologists supply relevant data but they can also bring skills and expertise to help improve the overall success of population health improvement work. Workforce development strategies should be implemented to ensure a nimble epidemiology workforce that can readily adapt to the needs of future public health practice.

Evaluation of the public health achievements made by projects supported by a federal contract mechanism at the Centers for Disease Control and Prevention (CDC), USA

In 2012, the Centers for Disease Control and Prevention (CDC) established the Achieving Public Health Impact through Research (APHIR) contract mechanism. APHIR provides CDC's Centers, Institute, and Offices (CIOs) a mechanism that supports multiyear, high impact public health research. Awarded projects supported research on a wide range of topics (e.g., cancer surveillance, HIV education programs, development of biological assays, and evaluation of traumatic brain injury prevention programs) and achieved diverse outcomes (e.g., contribution to the body of knowledge in their field, changes in practice and health service delivery, and capacity building). This article describes how existing impact frameworks and a variety of methods and tools (key informant interviews, online survey, bibliometric analysis, Altmetric and document reviews) were used to identify the outcomes achieved by awarded projects. The approach discussed in this paper can be used to evaluate projects that involve a diversity of activities and outcomes.