Promising community-level indicators for evaluating cardiovascular health-promotion programs

Generating community measures of food purchasing activities using store-level electronic grocery transaction records: an ecological study in Montreal, Canada

OBJECTIVE

Geographic measurement of diets is generally not available at areas smaller than a national or provincial (state) scale, as existing nutrition surveys cannot achieve sample sizes needed for an acceptable statistical precision for small geographic units such as city subdivisions.

DESIGN

Using geocoded Nielsen grocery transaction data collected from supermarket, supercentre and pharmacy chains combined with a gravity model that transforms store-level sales into area-level purchasing, we developed small-area public health indicators of food purchasing for neighbourhood districts. We generated the area-level indicators measuring per-resident purchasing quantity for soda, diet soda, flavoured (sugar-added) yogurt and plain yogurt purchasing. We then provided an illustrative public health application of these indicators as covariates for an ecological spatial regression model to estimate spatially correlated small-area risk of type 2 diabetes mellitus (T2D) obtained from the public health administrative data.

SETTING

Greater Montreal, Canada in 2012.

PARTICIPANTS

Neighbourhood districts (n 193).

RESULTS

The indicator of flavoured yogurt had a positive association with neighbourhood-level risk of T2D (1·08, 95 % credible interval (CI) 1·02, 1·14), while that of plain yogurt had a negative association (0·93, 95 % CI 0·89, 0·96). The indicator of soda had an inconclusive association, and that of diet soda was excluded due to collinearity with soda. The addition of the indicators also improved model fit of the T2D spatial regression (Watanabe-Akaike information criterion = 1765 with the indicators, 1772 without).

CONCLUSION

Store-level grocery sales data can be used to reveal micro-scale geographic disparities and trends of food selections that would be masked by traditional survey-based estimation.

Linking Perceptions of the Community to Behavior: Are Protective Social Factors Associated with Physical Activity?

Although the relationship of psychosocial factors to physical activity has been explored, there is increased interest in how perceptions of the community environment influence behavior.However, few methodological studies have incorporated perceptions of the social and community environment (protective social factors) or addressed key measurement issues.Computer-assisted telephone interviews were administered to a national sample of 1, 818 U.S.adults.Unadjusted and multivariate-adjusted odds ratios were calculated to compare active and inactive participants by Protective Social Factors (PSF) scores and selected sociodemographics. Confirmatory factor analysis and reliability analysis suggested strong PSF scale psychometric properties (• =. 92). After adjustment for potential confounders, a 10-point rise in the PSF score resulted in a 12% increased likelihood of meeting Centers for Disease Control and Prevention/American College of Sports Medicine recommendations. Additional analyses indicated that greater perceived PSFs were associated with meeting these recommendations among Whites but not among African Americans.

Community wide interventions for increasing physical activity

BACKGROUND

Multi-strategic community wide interventions for physical activity are increasingly popular but their ability to achieve population level improvements is unknown.

OBJECTIVES

To evaluate the effects of community wide, multi-strategic interventions upon population levels of physical activity.

SEARCH METHODS

We searched the Cochrane Public Health Group Segment of the Cochrane Register of Studies,The Cochrane Library, MEDLINE, MEDLINE in Process, EMBASE, CINAHL, LILACS, PsycINFO, ASSIA, the British Nursing Index, Chinese CNKI databases, EPPI Centre (DoPHER, TRoPHI), ERIC, HMIC, Sociological Abstracts, SPORT Discus, Transport Database and Web of Science (Science Citation Index, Social Sciences Citation Index, Conference Proceedings Citation Index). We also scanned websites of the EU Platform on Diet, Physical Activity and Health; Health-Evidence.org; the International Union for Health Promotion and Education; the NIHR Coordinating Centre for Health Technology (NCCHTA); the US Centre for Disease Control and Prevention (CDC) and NICE and SIGN guidelines. Reference lists of all relevant systematic reviews, guidelines and primary studies were searched and we contacted experts in the field. The searches were updated to 16 January 2014, unrestricted by language or publication status.

SELECTION CRITERIA

Cluster randomised controlled trials, randomised controlled trials, quasi-experimental designs which used a control population for comparison, interrupted time-series studies, and prospective controlled cohort studies were included. Only studies with a minimum six-month follow up from the start of the intervention to measurement of outcomes were included. Community wide interventions had to comprise at least two broad strategies aimed at physical activity for the whole population. Studies which randomised individuals from the same community were excluded.

DATA COLLECTION AND ANALYSIS

At least two review authors independently extracted the data and assessed the risk of bias. Each study was assessed for the setting, the number of included components and their intensity. The primary outcome measures were grouped according to whether they were dichotomous (per cent physically active, per cent physically active during leisure time, and per cent physically inactive) or continuous (leisure time physical activity time (time spent)), walking (time spent), energy expenditure (as metabolic equivalents or METS)). For dichotomous measures we calculated the unadjusted and adjusted risk difference, and the unadjusted and adjusted relative risk. For continuous measures we calculated percentage change from baseline, unadjusted and adjusted.

MAIN RESULTS

After the selection process had been completed, 33 studies were included. A total of 267 communities were included in the review (populations between 500 and 1.9 million). Of the included studies, 25 were set in high income countries and eight were in low income countries. The interventions varied by the number of strategies included and their intensity. Almost all of the interventions included a component of building partnerships with local governments or non-governmental organisations (NGOs) (29 studies). None of the studies provided results by socio-economic disadvantage or other markers of equity. However, of those included studies undertaken in high income countries, 14 studies were described as being provided to deprived, disadvantaged or low socio-economic communities. Nineteen studies were identified as having a high risk of bias, 10 studies were unclear, and four studies had a low risk of bias. Selection bias was a major concern with these studies, with only five studies using randomisation to allocate communities. Four studies were judged as being at low risk of selection bias although 19 studies were considered to have an unclear risk of bias. Twelve studies had a high risk of detection bias, 13 an unclear risk and four a low risk of bias. Generally, the better designed studies showed no improvement in the primary outcome measure of physical activity at a population level.All four of the newly included, and judged to be at low risk of bias, studies (conducted in Japan, United Kingdom and USA) used randomisation to allocate the intervention to the communities. Three studies used a cluster randomised design and one study used a stepped wedge design. The approach to measuring the primary outcome of physical activity was better in these four studies than in many of the earlier studies. One study obtained objective population representative measurements of physical activity by accelerometers, while the remaining three low-risk studies used validated self-reported measures. The study using accelerometry, conducted in low income, high crime communities of USA, emphasised social marketing, partnership with police and environmental improvements. No change in the seven-day average daily minutes of moderate to vigorous physical activity was observed during the two years of operation. Some program level effect was observed with more people walking in the intervention community, however this result was not evident in the whole community. Similarly, the two studies conducted in the United Kingdom (one in rural villages and the other in urban London; both using communication, partnership and environmental strategies) found no improvement in the mean levels of energy expenditure per person per week, measured from one to four years from baseline. None of the three low risk studies reporting a dichotomous outcome of physical activity found improvements associated with the intervention.Overall, there was a noticeable absence of reporting of benefit in physical activity for community wide interventions in the included studies. However, as a group, the interventions undertaken in China appeared to have the greatest possibility of success with high participation rates reported. Reporting bias was evident with two studies failing to report physical activity measured at follow up. No adverse events were reported.The data pertaining to cost and sustainability of the interventions were limited and varied.

AUTHORS' CONCLUSIONS

Although numerous studies have been undertaken, there is a noticeable inconsistency of the findings in the available studies and this is confounded by serious methodological issues within the included studies. The body of evidence in this review does not support the hypothesis that the multi-component community wide interventions studied effectively increased physical activity for the population, although some studies with environmental components observed more people walking.

Strengthening the rigour of population-wide, community-based obesity prevention evaluations

OBJECTIVE

The aim of the present study was to review the methodological literature regarding evaluation methods for complex public health interventions broadly and, based on such methods, to critically reflect on the evaluation of contemporary community-based obesity prevention programmes.

DESIGN

A systematic review of the methods and community-based literature was performed by one reviewer.

RESULTS

The review identified that there is considerable scope to improve the rigour of community-based obesity prevention programmes through: prospective trial registration; the use of more rigorous research designs, particularly where routine databases including an objective measure of adiposity are available; implementing strategies to quantify and reduce the risk of selective non-participation bias; the development and use of validated instruments to assess intervention impacts; reporting of intervention process and context information; and more comprehensive analyses of trial outcomes.

CONCLUSIONS

To maximise the quality and utility of community-based obesity prevention evaluations, programme implementers and evaluators need to carefully examine the strengths and pitfalls of evaluation decisions and seek to maximise evaluation rigour in the context of political, resource and practical constraints.

Community wide interventions for increasing physical activity

BACKGROUND

Multi-strategic community wide interventions for physical activity are increasingly popular but their ability to achieve population level improvements is unknown.

OBJECTIVES

To evaluate the effects of community wide, multi-strategic interventions upon population levels of physical activity.

SEARCH STRATEGY

We searched the Cochrane Public Health Group Specialised Register, The Cochrane Library, MEDLINE, MEDLINE in Process, EMBASE, CINAHL, LILACS, PsycINFO, ASSIA, The British Nursing Index, Chinese CNKI databases, EPPI Centre (DoPHER, TRoPHI), ERIC, HMIC, Sociological Abstracts, SPORTDiscus, Transport Database and Web of Science (Science Citation Index, Social Sciences Citation Index, Conference Proceedings Citation Index). We also scanned websites of the EU Platform on Diet, Physical Activity and Health; Health-Evidence.ca; the International Union for Health Promotion and Education; the NIHR Coordinating Centre for Health Technology (NCCHTA) and NICE and SIGN guidelines. Reference lists of all relevant systematic reviews, guidelines and primary studies were followed up. We contacted experts in the field from the National Obesity Observatory Oxford, Oxford University; Queensland Health, Queensland University of Technology, the University of Central Queensland; the University of Tennessee and Washington University; and handsearched six relevant journals. The searches were last updated to the end of November 2009 and were not restricted by language or publication status.

SELECTION CRITERIA

Cluster randomised controlled trials, randomised controlled trials (RCT), quasi-experimental designs which used a control population for comparison, interrupted time-series (ITS) studies, and prospective controlled cohort studies (PCCS) were included. Only studies with a minimum six-month follow up from the start of the intervention to measurement of outcomes were included. Community wide interventions had to comprise at least two broad strategies aimed at physical activity for the whole population. Studies which randomised individuals from the same community were excluded.

DATA COLLECTION AND ANALYSIS

At least two review authors independently extracted the data and assessed the risk of bias of each included study. Non-English language papers were reviewed with the assistance of an epidemiologist interpreter. Each study was assessed for the setting, the number of included components and their intensity. Outcome measures were grouped according to whether they were dichotomous (physically active, physically active during leisure time and sedentary or physically inactive) or continuous (leisure time physical activity, walking, energy expenditure). For dichotomous measures we calculated the unadjusted and adjusted risk difference, and the unadjusted and adjusted relative risk. For continuous measures we calculated net percentage change from baseline, unadjusted and adjusted risk difference, and the unadjusted and adjusted relative risk.

MAIN RESULTS

After the selection process had been completed 25 studies were included in the review. Of the included studies, 19 were set in high income countries, using the World Bank economic classification, and the remaining six were in low income countries. The interventions varied by the number of strategies included and their intensity. Almost all of the interventions included a component of building partnerships with local governments or non-governmental organisations (NGOs) (22 studies). None of the studies provided results by socio-economic disadvantage or other markers of equity consideration. However of those included studies undertaken in high income countries, 11 studies were described by the authors as being provided to deprived, disadvantaged, or low socio-economic communities.Fifteen studies were identified as having a high risk of bias, 10 studies were unclear, and no studies had a low risk of bias. Selection bias was a major concern with these studies, with only one study using randomisation to allocate communities (Simon 2008). No studies were judged as being at low risk of selection bias although 16 studies were considered to have an unclear risk of bias. Eleven studies had a high risk of detection bias, 10 with an unclear risk and four with no risk. Assessment of detection bias included an assessment of the validity of the measurement tools and quality of outcome measures. The effects reported were inconsistent across the studies and the measures. Some of the better designed studies showed no improvement in measures of physical activity. Publication bias was evident.

AUTHORS' CONCLUSIONS

Although numerous studies have been undertaken, there is a noticeable inconsistency of the findings of the available studies and this is confounded by serious methodological issues within the included studies. The body of evidence in this review does not support the hypothesis that multi-component community wide interventions effectively increase population levels of physical activity. There is a clear need for well-designed intervention studies and such studies should focus on the quality of the measurement of physical activity, the frequency of measurement and the allocation to intervention and control communities.

Quantifying the effect of a community-based injury prevention program in Queensland using a generalized estimating equation approach

OBJECTIVE

To develop a generalized estimating equation (GEE) model of childhood injury rates to quantify the effectiveness of a community-based injury prevention program implemented in 2 communities in Australia, in order to contribute to the discussion of community-based injury prevention program evaluation.

DESIGN

An ecological study was conducted comparing injury rates in two intervention communities in rural and remote Queensland, Australia, with those of 16 control regions. A model of childhood injury was built using hospitalization injury rate data from 1 July 1991 to 30 June 2005 and 16 social variables. The model was built using GEE analysis and was used to estimate parameters and to test the effectiveness of the intervention.

RESULTS

When social variables were controlled for, the intervention was associated with a decrease of 0.09 injuries/10,000 children aged 0-4 years (95% CI -0.29 to 0.11) in logarithmically transformed injury rates; however, this decrease was not significant (p = 0.36).

CONCLUSIONS

The evaluation methods proposed in this study provide a way of determining the effectiveness of a community-based injury prevention program while considering the effect of baseline differences and secular changes in social variables.

Formative evaluation of AARP's Active for Life campaign to improve walking and bicycling environments in two cities

AARP conducted a 2.5-year social-marketing campaign to improve physical activity levels among older adults in Richmond, Virginia and Madison, Wisconsin. This article presents formative evaluation findings from the campaign's policy/environmental change component. Evaluation data were abstracted from technical-assistance documentation and telephone interviews. Results include 11 policy and 14 environmental changes attained or in-process by campaign closure. Differences between the cities' results are explained through differences in program implementation (e.g., types of changes planned, formalization of partnerships). Project teams took less time deciding to pursue policy change than environmental change; however, planning the policy activities took longer than planning environmental-change activities. Recommendations for future policy/environmental change interventions focus on the selection of strategies; planning for administrative resources; formalizing partnerships to ensure sustainability of impact; ensuring training and technical assistance; and documenting progress. Similar intervention results may be attainable with a multi-year timeframe, adequate part-time coordination, and committed volunteers.

Understanding Facilitators of and Barriers to Health Promotion Practice

The health promotion best practices literature is imbued with hope for knowledge mobilization, enhanced practice, and improved population health. Given constrained medical care systems, health promotion is key to reducing the significant burden of chronic disease. However, we have seen little evidence of change. This article investigates facilitators of, and barriers to, three stages of health promotion practice in public health organizations, interagency coalitions, and volunteer committees. The article focuses not on what works but why it does or does not, drawing on five case studies within the Canadian Heart Health Initiative. Results indicate that the presence or absence of appropriately committed and/or skilled people, funds and/or resources, and priority and/or interest are the most common factors affecting all stages of health promotion practice. The article extends the literature on internal and external factors affecting health promotion and highlights strategic influences to consider in support of effective health promotion practice.

The Dutch heart health community intervention ‘Hartslag Limburg’: results of an effect study at organizational level

BACKGROUND

'Hartslag Limburg', a cardiovascular diseases (CVD) prevention programme, integrates a community strategy and a high-risk strategy to reduce CVD risk behaviours. This article presents the results of the effect evaluation study of the community intervention at the organizational level. Organizational changes were an intermediate goal of the Hartslag Limburg community intervention, as these are assumed to be a prerequisite for changes at the individual level.

METHODS

A baseline-post-test control group design was used. The baseline measurement was conducted in 1998 and the post-test measurement in 2001. At baseline, 700 organizations were selected in the Maastricht region, and 577 in a control region. All organizations that were potentially significant agents in health-promoting activities were included. Data on organizational involvement in health-promoting activities were gathered by means of structured questionnaires, and sent to organization representatives by mail.

RESULTS

The overall post-test percentage of organizations involved in at least one activity relating to physical activity was higher in the Maastricht region than in the control region. Furthermore, the number of activities per organization involved in activities relating to healthy eating, smoking behaviour or physical activity was higher in the Maastricht region than in the control region at post-test.

CONCLUSIONS

This study provided valuable information about organizational involvement in health-promoting activities, as well as important information to consider in future research in this area. Due to the limitations of the study, the importance of measuring change at different social levels in community-based programmes, and the scarcity of effect studies of community interventions at the organizational level, further research on this subject is warranted.

Evaluation of Public Health Demonstration Programs: The Effectiveness and Cost-Effectiveness of WISEWOMAN

BACKGROUND

In today's healthcare environment, public health resources are scarce. Thus, interventions to improve the public's health must be rigorously evaluated to ensure that they make the best use of available resources.

METHODS

The Centers for Disease Control and Prevention (CDC) provides a general framework for program evaluation. This paper presents additional details on several key evaluation areas within CDC's framework.

RESULTS

Successful evaluations will be built into the program design; will be multifaceted, incorporating both quantitative and qualitative methods; will assess both process and outcome measures; and will engage stakeholders to ensure utility of results.

CONCLUSIONS

Well-planned evaluations can lead to less burdensome yet more effective assessment and better program performance and can increase the knowledge base for health promotion practice.

Measuring the environment for friendliness toward physical activity: a comparison of the reliability of 3 questionnaires

OBJECTIVES

We tested the reliability of 3 instruments that assessed social and physical environments.

METHODS

We conducted a test-retest study among US adults (n = 289). We used telephone survey methods to measure suitableness of the perceived (vs objective) environment for recreational physical activity and nonmotorized transportation.

RESULTS

Most questions in our surveys that attempted to measure specific characteristics of the built environment showed moderate to high reliability. Questions about the social environment showed lower reliability than those that assessed the physical environment. Certain blocks of questions appeared to be selectively more reliable for urban or rural respondents.

CONCLUSIONS

Despite differences in content and in response formats, all 3 surveys showed evidence of reliability, and most items are now ready for use in research and in public health surveillance.

Health promotion and health education viewed as symbiotic paradigms: bridging the theory and practice gap between them

A recognized 'paradigm war' exists between the two distinct approaches of health education and health promotion practice. This tension is both unhealthy and unhelpful and is known to have a profound effect on nursing activity. Leading health promotionalists have begun to acknowledge the futility of the stated paradigm tension, realizing that health education and health promotion interventions are not that dissimilar in their origins and intentions. Progressive health education and health promotion programmes acknowledge the interrelatedness of both approaches and seek to incorporate favourable aspects of the two. The aim of this article is to present arguments and stances that help to diffuse/avoid the stated paradigm conflict, as a basis for health education and health promotion reform in nursing. It also seeks to clarify the nature of both health education and health promotion practice so as to avoid contextual confusion. In doing so, this article draws significantly from the author's previous work. This article concludes that the constructive review of any intended health education/health promotion programme lies in the consideration of each approach according to its own relative merits, what is required of the programme, and the nature of the setting in which the intervention takes place.

Local ordinances that promote physical activity: a survey of municipal policies

In this Utah-based study, we sought to identify the types of municipal employees responsible for physical activity policies, identify municipal ordinances that may influence physical activity, and determine local governments' intentions to implement policies. In 2001, we mailed a survey to all of the state's municipalities with the goal of measuring 6 physical activity domains: sidewalks, bicycle lanes, shared-use paths, work sites, greenways, and recreational facilities. Data from 74 municipalities revealed that planners made up a small proportion of municipal staff. Relative to cities experiencing slow or medium growth, high growth cities reported more ordinances encouraging physical activity. Physical activity policies can be monitored across municipalities. Moreover, evidence-based public health practice provides direction for limited staff and funding resources.

A theoretical and empirical analysis of context: neighbourhoods, smoking and youth

Numerous studies are currently addressing the issue of contextual effects on health and disease outcomes. The majority of these studies fall short of providing a theoretical basis with which to explain what context is and how it affects individual disease outcomes. We propose a theoretical model, entitled collective lifestyles, which brings together three concepts from practice theory: social structure, social practices and agency. We do so in an attempt to move away from both behavioural and structural-functionalist explanations of the differential distribution of disease outcomes among areas by including a contextualisation of health behaviours that considers their meaning. We test the framework using the empirical example of smoking and pre-adolescents in 32 communities across Québec, Canada. Social structure is operationalised as characteristics and resources; characteristics are the socio-economic aggregate characteristics of individuals culled from the 1996 Canadian Census, and resources are what regulates and transforms smoking practices. Information about social practices was collected in focus groups with pre-adolescents from four of the participating communities. Using zero-order and partial correlations we find that a portrait of communities emerges. Where there is a high proportion of more socio-economically advantaged people, resources tend to be more smoking discouraging, with the opposite being true for disadvantaged communities. Upon analysis of the focus group material, however, we find that the social practices in communities do not necessarily reflect the "objectified" measures of social structure. We suggest that a different conceptualisation of accessibility and lifestyle in contextual studies may enable us to improve our grasp on how differential rates of disease come about in local areas.

Ecological and socioeconomic correlates of fruit, juice, and vegetable consumption among African-American boys

BACKGROUND

Investigators have reported that the availability of foods in local grocery stores correlated with consumption when using large geopolitical units of analysis, e.g., zip codes. Associations across smaller geopolitical units, e.g., census tracts, have not been tested, nor has this work focused on restaurant availability, child consumption, or specific ethnic groups.

METHODS

This study examined whether median family income and fruit, juice, and vegetable (FJV) availability in grocery stores, restaurants, and homes in 11 census tracts correlated with FJV consumption among 11- to 14-year-old African-American Boy Scouts. FJV consumption was measured in 90 scouts using two 24-h food recalls. Instruments were developed to measure the availability of FJV at area grocery stores, restaurants, and homes where troop members resided.

RESULTS

Median household income (from 1990 census) was significantly correlated with restaurant fruit availability. Significant correlations were found between restaurant juice and vegetable availability and Boy Scout reported consumption of juice and vegetables.

CONCLUSION

Census tract may be a useful unit when studying restaurant, but not grocery store, FJV availability. Within a census tract, restaurant FJV availability may be a significant target for community intervention and process evaluation.

Health promotion research: dilemmas and challenges

OBJECTIVE

To analyse dilemmas and challenges in health promotion research, and to generate ideas for future development.

METHOD

The analysis is based on authors' experiences in working in the field of research and action in health promotion and on experiences of others as found in literature.

RESULTS

The assumptions underlying scientific research as based in the biomedical design are difficult to meet in community-based health promotion research. Dilemmas are identified in relation to the possibility of defining the independent and dependent variables beforehand and the intermingling of these variables (the intervention and outcome dilemma), the difficulty in quantifying the desired outcomes (the number dilemma), and the problem of diffusion of the programme to the control group (the control group dilemma).

CONCLUSION

Research in health promotion has specific reasons to reconsider the approach towards research, the selection of outcome variables, and research techniques. Strategies and methods to make activities and their outcomes clear are discussed and criteria to judge confidence and applicability of research findings are presented.