1
|
Lindeman PT, Bettin E, Beach LB, Adames CN, Johnson AK, Kern D, Stonehouse P, Greene GJ, Phillips G. Evaluation capacity building-Results and reflections across two years of a multisite empowerment evaluation in an HIV prevention context. EVALUATION AND PROGRAM PLANNING 2018; 71:83-88. [PMID: 30223173 DOI: 10.1016/j.evalprogplan.2018.09.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2018] [Revised: 07/26/2018] [Accepted: 09/05/2018] [Indexed: 06/08/2023]
Abstract
As the need for rigorous evidence of program efficacy increases, integrating evaluation activities into program implementation is becoming crucial. As a result, external evaluators are placing increased focus on evaluation capacity building as a practice. However, empirical evidence of how to foster evaluation capacity in different contexts remains limited. This study presents findings from an evaluation capacity survey conducted within a multisite Empowerment Evaluation initiative, in which an external evaluator worked with 20 project teams at diverse community agencies implementing HIV prevention projects. Survey results revealed representatives from project teams (n = 33) reported significantly higher overall evaluation capacity after engaging with the external evaluator on planning and implementing their evaluation. Improvements differed across organization type, intervention type, staff position, and reported engagement on various activities throughout the course of the evaluation. Results indicated empowerment evaluation and other stakeholder-focused evaluation approaches are broadly applicable when evaluation capacity building is a desired outcome, particularly when able to engage project staff in the planning of the evaluation and in delivering technical assistance services. Accordingly, efforts should be made by program funders, staff, and evaluators to encourage active engagement starting in the early stages of program and evaluation planning.
Collapse
Affiliation(s)
- Peter T Lindeman
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, 625 N. Michigan Ave., 14th Floor, Chicago, IL, 60611, USA; Institute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, 625 N. Michigan Ave., 14thFloor, Chicago, IL, 60611, USA.
| | - Emily Bettin
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, 625 N. Michigan Ave., 14th Floor, Chicago, IL, 60611, USA; Institute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, 625 N. Michigan Ave., 14thFloor, Chicago, IL, 60611, USA.
| | - Lauren B Beach
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, 625 N. Michigan Ave., 14th Floor, Chicago, IL, 60611, USA; Institute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, 625 N. Michigan Ave., 14thFloor, Chicago, IL, 60611, USA.
| | - Christian N Adames
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, 625 N. Michigan Ave., 14th Floor, Chicago, IL, 60611, USA; Institute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, 625 N. Michigan Ave., 14thFloor, Chicago, IL, 60611, USA.
| | - Amy K Johnson
- Center for Gender, Sexuality and HIV Prevention, Division of Adolescent Medicine, Ann & Robert H. Lurie Children's Hospital of Chicago, 225 E. Chicago Ave., Chicago, IL, 60611, USA; AIDS Foundation of Chicago, 200 W. Jackson Blvd. #2100, Chicago, IL, 60606, USA.
| | - Dave Kern
- HIV/STI Bureau, Chicago Department of Public Health, 333 S. State Street, Chicago, IL, 60604, USA.
| | - Patrick Stonehouse
- HIV/STI Bureau, Chicago Department of Public Health, 333 S. State Street, Chicago, IL, 60604, USA.
| | - George J Greene
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, 625 N. Michigan Ave., 14th Floor, Chicago, IL, 60611, USA; Institute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, 625 N. Michigan Ave., 14thFloor, Chicago, IL, 60611, USA.
| | - Gregory Phillips
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, 625 N. Michigan Ave., 14th Floor, Chicago, IL, 60611, USA; Institute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, 625 N. Michigan Ave., 14thFloor, Chicago, IL, 60611, USA.
| |
Collapse
|
2
|
Cunradi CB, Mair C, Todd M. Alcohol outlet density, drinking contexts and intimate partner violence: a review of environmental risk factors. JOURNAL OF DRUG EDUCATION 2015; 44:19-33. [PMID: 25725018 PMCID: PMC4422380 DOI: 10.1177/0047237915573527] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Alcohol use is a robust predictor of intimate partner violence (IPV). A critical barrier to progress in preventing alcohol-related IPV is that little is known about how an individual's specific drinking contexts (where, how often, and with whom one drinks) are related to IPV, or how these contexts are affected by environmental characteristics, such as alcohol outlet density and neighborhood disadvantage. The putative mechanism is the social environment in which drinking occurs that may promote or strengthen aggressive norms. Once these contexts are known, specific prevention measures can be put in place, including policy-oriented (e.g., regulating outlet density) and individually oriented (e.g., brief interventions to reduce risk for spousal aggression) measures targeting at-risk populations. This paper reviews applicable theories and empirical research evidence that links IPV to drinking contexts and alcohol outlet density, highlights research gaps, and makes recommendations for future research.
Collapse
Affiliation(s)
- Carol B. Cunradi
- Prevention Research Center, Pacific Institute for Research & Evaluation, Oakland, CA 94612, Phone 510-883-5771
| | - Christina Mair
- University of Pittsburgh, Graduate School of Public Health, Pittsburgh, PA 15261
| | - Michael Todd
- Arizona State University, College of Nursing and Health Innovation, Phoenix, AZ 85004
| |
Collapse
|
3
|
Nitsch M, Waldherr K, Denk E, Griebler U, Marent B, Forster R. Participation by different stakeholders in participatory evaluation of health promotion: a literature review. EVALUATION AND PROGRAM PLANNING 2013; 40:42-54. [PMID: 23732440 DOI: 10.1016/j.evalprogplan.2013.04.006] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2012] [Revised: 04/22/2013] [Accepted: 04/24/2013] [Indexed: 06/02/2023]
Abstract
Participatory evaluation has been increasingly used in health promotion (HP) and various forms of participatory evaluation have been put into practice. Simultaneously, the concept of participation has become more important for evaluation research in general, which is equally diverse and the subject of various discourses. This study addresses the issue of how the concept of participation has been established in HP evaluation practice. An analytical framework was developed, which served as a basis for a literature review, but can also be used as a general framework for analyzing and planning the scope of participation by various stakeholders within different phases of participatory evaluation. Three dimensions of participation, which refer to decision making (decision power, deliberation) and action processes are distinguished. The results show that only a few articles discussed participatory evaluation processes and participatory (evaluation) research was largely put forth by participatory (action) research in communities. The articles analyzed referred mostly to three stakeholder groups - evaluators, program staff and beneficiaries - and to participation processes in the initial evaluation phases. The application of the framework revealed that decision power seems to be held predominantly by program staff, evaluators seem to be more involved in action processes and beneficiaries in deliberation processes.
Collapse
Affiliation(s)
- Martina Nitsch
- Ludwig Boltzmann Institute Health Promotion Research, Untere Donaustraße 47, 1020 Vienna, Austria.
| | | | | | | | | | | |
Collapse
|
4
|
Cunradi CB, Todd M, Mair C, Remer L. Intimate Partner Violence among California Couples: Multilevel Analysis of Environmental and Partner Risk Factors. ACTA ACUST UNITED AC 2013; 4:419-443. [PMID: 24812578 DOI: 10.1891/1946-6560.4.4.419] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
This study assessed the extent to which environmental (Census block-group alcohol outlet density, neighborhood demographic characteristics) and partner risk factors (e.g., hazardous drinking, psychosocial characteristics) contribute to the likelihood of intimate partner violence among 1,753 couples residing in 50 medium-to-large California cities. Multilevel logistic regression models were used to analyze the role of alcohol outlets (off-premise outlets, bars/pubs and restaurants), neighborhood demographic characteristics, and partner risk factors in relation to male-to-female partner violence (MFPV) and female-to-male partner violence (FMPV) risk. Approximately 12% of couples reported past-year partner violence. Results showed that none of the environmental measures were related to MFPV or FMPV. Male partner's impulsivity and each partner's adverse childhood experiences were associated with MFPV risk. Risk factors for FMPV were male partner's impulsivity and frequency of intoxication and female partner's adverse childhood experiences. Individual/couple characteristics appear to be the most salient IPV risk factors. The male partner's heavy drinking may lead to negative partner/spousal interactions that result in FMPV. The male partner's impulsivity, and each partner's adverse childhood experiences, may potentiate couple conflict and result in aggression. Interventions that target prevention of family dysfunction during childhood may help reduce interpersonal violence in adulthood.
Collapse
Affiliation(s)
- Carol B Cunradi
- Prevention Research Center, Pacific Institute for Research and Evaluation, Berkeley, CA 94704
| | - Michael Todd
- Prevention Research Center, Pacific Institute for Research and Evaluation, Berkeley, CA 94704
| | - Christina Mair
- Prevention Research Center, Pacific Institute for Research and Evaluation, Berkeley, CA 94704 ; School of Public Health, University of California, Berkeley, 94720
| | - Lillian Remer
- Prevention Research Center, Pacific Institute for Research and Evaluation, Berkeley, CA 94704
| |
Collapse
|
5
|
Vanderploeg JJ, Franks RP, Plant R, Cloud M, Tebes JK. Extended Day Treatment: A Comprehensive Model of After School Behavioral Health Services for Youth. CHILD & YOUTH CARE FORUM 2010; 38:5-18. [PMID: 20454587 DOI: 10.1007/s10566-008-9062-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
This paper describes Extended Day Treatment (EDT), an innovative intermediate-level service for children and adolescents with serious emotional and behavioral disorders, delivered in the after school hours. The current paper describes the core components of the EDT model of care within the context of statewide systems of care, including its theoretical foundations, core service components, relation to evidence-based practices, workforce composition and staff training, and data collection and reporting mechanisms. Recommendations are provided for statewide implementation, followed by discussion of model development as an approach to systems reform for the treatment of children and youth with emotional and behavioral disorders.
Collapse
|
6
|
O'Campo P, Caughy MO, Nettles SM. Partner abuse or violence, parenting and neighborhood influences on children's behavioral problems. Soc Sci Med 2010; 70:1404-15. [PMID: 20163906 DOI: 10.1016/j.socscimed.2009.11.036] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2008] [Revised: 10/12/2009] [Accepted: 11/16/2009] [Indexed: 11/15/2022]
Abstract
We examined the relationship between neighborhood characteristics, parenting behaviors, experiences of intimate partner abuse or violence (IPV) and children's behavioral problems in a socioeconomically diverse sample of 383 families residing in an urban environment. Data were collected in the Fall/Winter of 2002. The census block group of residence was used as our measure of neighborhood. Census block groups typically contain 1500 residents on average. IPV was measured using a modified version of the HITS (physically Hurt, Insult, Threaten, and Screamed at) scale, a short four item tool assessing emotional and physical violence to which we added an item capturing domination or emotional control. IPV in the last year was reported by 50% of the sample with rates varying by socioeconomic position; families with the lowest and highest income reported the most IPV. Patterns of association between parenting, neighborhood and the children's behavioral problems differed for families who reported IPV in the last year compared to families who reported no IPV. While positive neighborhood characteristics such as high levels of Community Involvement with Children - based upon four scales capturing neighborhood levels of social interaction and collective socialization of children - were protective for high levels of behavioral problems among families not reporting IPV, this protective effect was not seen among families who did report IPV. Hypothesized interactions between negative neighborhood characteristics and IPV-namely that behavioral problems would be worse among families experiencing IPV in highly economically deprived or areas with negative social climates-were not supported by our data. These interactions between neighborhood factors and IPV were not explained by parental factors.
Collapse
Affiliation(s)
- Patricia O'Campo
- The Centre for Research on Inner City Health, The Kennan Research Centre, Li Ka Shing Knowledge Institute of St. Michael's Hospital, 30 Bond street, Toronto, ON, Canada M5B 1W8.
| | | | | |
Collapse
|