Striking a Balance between Program-Specific and Portfolio-Level Evaluation: Lessons Learned from a Multi-Site Evaluation on the Texas-Mexico Border

Evaluation of the collaborative integrated surveillance system (ViCo) in Guatemala: a qualitative study on lessons learned and future perspectives

Background

The collaborative integrated surveillance system known as Vigilancia Integrada Comunitaria (ViCo) was implemented in 2007 to better understand and characterize the burden of diarrheal, respiratory and febrile illnesses in Guatemala.

Methods

To evaluate the usefulness of ViCo and inform a redesign of the system and new surveillance activities in the Central American region, personnel from the United States Centers for Disease Control and Prevention (CDC) conducted thirty-nine in-depth interviews from June—December 2018 with key stakeholders responsible for the design and implementation of ViCo in Guatemala. A semi-structured questionnaire adapted from the Updated CDC Guidelines for Evaluating Public Health Surveillance Systems was used for data collection. We used a grounded theory approach to explore stakeholder perceptions of ViCo and generate recommendations for improvement. Primary qualitative findings were organized based on thematic areas using ATLAS.ti version 8 software.

Results

Emergent themes relevant to the usefulness of ViCo were organized across strengths, weaknesses, and recommendations pertaining to the: (1) Size and Complexity of ViCo, (2) Stakeholder Expectations About the Objectives of ViCo, (3) Data Management and Structure of the Information System, (4) Local Control of Data, (5) Integration of ViCo within the Ministry of Health, and, (6) Improvement of the Operational and Design Aspects of ViCo across System, Process, and Output levels.

Conclusions

Stakeholders perceived ViCo to be useful. They recommended measures to improve system performance and quality, including simplifying the surveillance system, routine data analysis and feedback, and channeling efforts towards integrating surveillance data into the national health information system. To create a well-performing surveillance system and achieve the intended objective of surveillance for public health action, ongoing evaluation and assessment of surveillance activities are necessary.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-12719-7.

The Effect of Integrating Primary Care and Mental Health Services on Diabetes and Depression: A Multi-site Impact Evaluation on the US-Mexico Border

BACKGROUND

Health care delivery systems are increasingly integrating physical and mental health services to address patients' complex needs, contain costs, and improve satisfaction. Therefore, it is critical to understand whether adoption of integrated care models is effective in diverse settings.

OBJECTIVE

This study examined the effect of integrated care on physical and mental health outcomes among low-income Latino participants on the US-Mexico border.

RESEARCH DESIGN

In this quasi-experimental multisite study, individual-level data were pooled from 8 studies of locally adapted integrated care models.

SUBJECTS

Participants were 18 years or older and had 1 or more chronic conditions: diabetes, depression, hypertension, or obesity. The study enrolled 4226 participants with 2254 participants in the intervention group and 1972 in the comparison group.

MEASURES

Primary outcomes were depressive symptoms as measured by the Patient Health Questionnaire-9 score and blood glucose measured by hemoglobin A1c (HbA1c). Blood pressure, body mass index, and quality of life were secondary outcomes.

RESULTS

Multivariable linear regression analyses indicated intervention participants had significantly lower Patient Health Questionnaire-9 scores (β=-0.39, P=0.03) and HbA1c (β=-0.14, P=0.02) at 12 months compared with comparison group participants. Stratified analyses showed improvements in HbA1c were even greater among intervention participants who had diabetes, depression, severe and persistent mental illness, were older or female compared with their counterparts in the comparison group.

CONCLUSIONS

Health care is constantly transforming, making it critical to study these changes across populations and settings. Findings from this study indicate that integrated care can significantly improve mental and physical health in an underserved Latino population.