Evaluation of an inter-organizational prevention program against injuries among the elderly in a WHO Safe Community

Efficacy of Government-Sponsored Community Health Programs for Older Adults: A Systematic Review of Published Evaluation Studies

Objective: Population aging is an ongoing challenge for global health policy and is expected to have an increasing impact on developing economies in years to come. A variety of community health programs have been developed to deliver health services to older adults, and evaluating these programs is crucial to improving service delivery and avoiding barriers to implementation. This systematic review examines published evaluation research relating to public and community health programs aimed at older adults throughout the world.

Methods: A literature search using standardized criteria yielded 58 published articles evaluating 46 specific programs in 14 countries.

Results: Service models involving sponsorship of comprehensive facilities providing centralized access to multiple types of health services were generally evaluated the most positively, with care coordination programs appearing to have generally more modest success, and educational programs having limited effectiveness. Lack of sufficient funding was a commonly-cited barrier to successful program implementations.

Conclusion: It is important to include program evaluation as a component of future community and public health interventions aimed at aging populations to better understand how to improve these programs.

Measurement of Fall Injury With Health Care System Data and Assessment of Inclusiveness and Validity of Measurement Models

IMPORTANCE

National injury surveillance systems use administrative data to collect information about severe fall-related trauma and mortality. Measuring milder injuries in ambulatory clinics would improve comprehensive outcomes measurement across the care spectrum.

OBJECTIVES

To assess a flexible set of administrative data-only algorithms for health systems to capture a greater breadth of injuries than traditional fall injury surveillance algorithms and to quantify the algorithm inclusiveness and validity associated with expanding to milder injuries.

DESIGN, SETTING, AND PARTICIPANTS

In this longitudinal diagnostic study of 13 939 older adults (≥65 years) in the nationally representative Health and Retirement Study, a survey was conducted every 2 years and was linked to hospital, emergency department, postacute skilled nursing home, and outpatient Medicare claims (2000-2012). During each 2-year observation period, participants were considered to have sustained a fall-related injury (FRI) based on a composite reference standard of having either an external cause of injury (E-code) or confirmation by the Health and Retirement Study patient interview. A framework involving 3 algorithms with International Classification of Diseases, Ninth Revision codes that extend FRI identification with administrative data beyond the use of fall-related E-codes was developed: an acute care algorithm (head and face or limb, neck, and trunk injury reported at the hospital or emergency department), a balanced algorithm (all acute care algorithm injuries plus severe nonemergency outpatient injuries), and an inclusive algorithm (almost all injuries). Data were collected from January 1, 1998, through December 31, 2012, and statistical analysis was performed from August 1, 2016, to March 1, 2019.

MAIN OUTCOMES AND MEASURES

Validity, measured as the proportion of potential FRI diagnoses confirmed by the reference standard, and inclusiveness, measured as the proportion of reference-standard FRIs captured by the potential FRI diagnoses.

RESULTS

Of 13 939 participants, 1672 (42.4%) were male, with a mean (SD) age of 77.56 (7.63) years. Among 50 310 observation periods, 9270 potential FRI diagnoses (18.4%) were identified; these were tested against 8621 reference-standard FRIs (17.1%). Compared with the commonly used method of E-coded-only FRIs (2-year incidence, 8.8% [95% CI, 8.6%-9.1%]; inclusion of 51.5% [95% CI, 50.4%-52.5%] of the reference-standard FRIs), FRI inclusion was increased with use of the study framework of algorithms. With the acute care algorithm (2-year incidence, 12.6% [95% CI, 12.4%-12.9%]), validity was prioritized (88.6% [95% CI, 87.4%-89.8%]) over inclusiveness (62.1% [95% CI, 61.1%-63.1%]). The balanced algorithm showed a 2-year incidence of 14.6% (95% CI, 14.3%-14.9%), inclusion of 65.3% (95% CI, 64.3%-66.3%), and validity of 83.2% (95% CI, 81.9%-84.6%). With the inclusive algorithm, the number of potential FRIs increased compared with the E-code-only method (2-year incidence, 17.4% [95% CI, 17.1%-17.8%]; inclusion, 68.4% [95% CI, 67.4%-69.3%]; validity, 75.2% [95% CI, 73.7%-76.6%]).

CONCLUSIONS AND RELEVANCE

The findings suggest that use of algorithms with International Classification of Diseases, Ninth Revision codes may increase inclusion of FRIs by health care systems compared with E-codes and that these algorithms may be used by health systems to evaluate interventions and quality improvement efforts.

Developing indicators for evaluation of age-friendly communities in Canada: process and results

INTRODUCTION

In 2006, the World Health Organization launched the Global Age-Friendly Cities Project to support active aging. Canada has a large number of age-friendly initiatives; however, little is known about the effectiveness and outcomes of age-friendly community (AFC) initiatives. In addition, stakeholders report that they lack the capacity and tools to develop and conduct evaluations of their AFC initiatives. In order to address these gaps, the Public Health Agency of Canada developed indicators to support the evaluation of AFC initiatives relevant to a wide range of Canadian communities. These indicators meet the varied needs of communities, but are not designed to evaluate collective impact or enable crosscommunity comparisons.

METHODS

An evidence-based, iterative consultation approach was used to develop indicators for AFCs. This involved a literature review and an environmental scan. Two rounds of key expert and stakeholder consultations were conducted to rate potential indicators according to their importance, actionability and feasibility. A final list of indicators and potential measures were developed based on results from these consultations, as well as key policy considerations.

RESULTS

Thirty-nine indicators emerged across eight AFC domains plus four indicators related to long-term health and social outcomes. All meet the intended purpose of evaluating AFC initiatives at the community level. A user-friendly guide is available to support and share this work.

CONCLUSION

The AFC indicators can help communities evaluate age-friendly initiatives, which is the final step in completing a cycle of the Pan-Canadian AFC milestones. Communities are encouraged to use the evaluation results to improve their AFC initiatives, thereby benefiting a broad range of Canadians.

Neighborhood Environment and Falls among Community-Dwelling Older Adults

Background: Falls present a major challenge to active aging, but the relationship between neighborhood factors and falls is poorly understood. This study examined the relationship between fall events and neighborhood factors, including neighborhood social cohesion (sense of belonging, trust, friendliness, and helpfulness) and physical environment (vandalism/graffiti, rubbish, vacant/deserted houses, and perceived safety walking home at night). Methods: Data were analyzed from 9259 participants over four biennial waves (2006-2012) of the Health and Retirement Study (HRS), a nationally representative sample of adults aged 65 and older in the United States. Results: In models adjusting for demographic and health-related covariates, a one-unit increase in neighborhood social cohesion was associated with 4% lower odds of experiencing a single fall (odds ratio (OR): 0.96, 95% confidence interval (CI): 0.93-0.99) and 6% lower odds of experiencing multiple falls (OR: 0.94, 95% CI: 0.90-0.98). A one-unit increase in the physical environment scale was associated with 4% lower odds of experiencing a single fall (OR: 0.96, 95% CI: 0.93-0.99) and with 5% lower odds of experiencing multiple falls (OR: 0.95, 95% CI: 0.91-1.00) in adjusted models. Conclusions: The physical and social neighborhood environment may affect fall risk among community-dwelling older adults. Findings support the ongoing need for evidence-based fall prevention programming in community and clinical settings.

Examining Contextual Influences on Fall-Related Injuries Among Older Adults for Population Health Management

The objectives were to assess the associations between fall-related injuries (FRIs) treated in the emergency department (ED) among older adults in California and contextual county-level physical, social, and economic characteristics, and to assess how county-level economic conditions are associated with FRIs when controlling for other county-level factors. Data from 2008 California ED discharge, Medicare Impact File, and County Health Rankings were used. Random effects logistic regression models estimated contextual associations between county-level factors representing economic conditions, the built environment, community safety, access to care, and obesity with patient-level FRI treatment among 1,712,409 older adults, controlling for patient-level and hospital-level characteristics. Patient-level predictors of FRI treatment were consistent with previous studies not accounting for contextual associations. Larger and rural hospitals had higher odds of FRI treatment, while teaching and safety net hospitals had lower odds. Better county economic conditions were associated with greater odds (ß=0.73, P=0.001) and higher county-level obesity were associated with lower odds (ß=-0.37, P=0.004), but safer built environments (ß=-0.31, P=0.38) were not associated with FRI treatment. The magnitude of association between county-level economic conditions and FRI treatment attenuated with the inclusion of county-level obesity rates. FRI treatment was most strongly and consistently related to more favorable county economic conditions, suggesting differences in treatment or preferences for treatment for FRIs among older individuals in communities of varying resource levels. Using population health data on FRIs, policy makers may be able to remove barriers unique to local contexts when implementing falls prevention educational programs and built environment modifications.

Implementation and results of a survey on safe community programs in Gangbuk-gu, Korea: focusing on participants at a local public health center

OBJECTIVES

The purpose of this study was to investigate the current status of and problems with the Safe Community Programs in Gangbuk-gu, one of the 25 districts of the capital city of Korea.

METHODS

The study subjects were 396 individuals who were involved in Safe Community Programs between 2009 and 2011. We examined the effectiveness and willingness of respondents to participate as a safety leader of the Safe Community Program with a questionnaire. We examined the injury death rates of Gangbuk-gu by using of the death certificate data of Korea's National Statistical Office. Descriptive statistics and chi-squared tests were used.

RESULTS

The effectiveness of programs did not differ but active participation differed significantly among subjects (p<0.05). The injury death rate of Gangbuk-gu as a whole increased during the implementation period. However, senior safety, in particular, may be a helpful program for reducing injuries in Gangbuk-gu.

CONCLUSIONS

This study suggests that the lack of active participation may be a major problem of Safe Community Programs in Gangbuk-gu. Therefore, Safe Community Programs should be expanded to the entire district of Gangbuk-gu and more active participation programs should be developed.

Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis

Background

Community engagement has been advanced as a promising way of improving health and reducing health inequalities; however, the approach is not yet supported by a strong evidence base.

Objectives

To undertake a multimethod systematic review which builds on the evidence that underpins the current UK guidance on community engagement; to identify theoretical models underpinning community engagement; to explore mechanisms and contexts through which communities are engaged; to identify community engagement approaches that are effective in reducing health inequalities, under what circumstances and for whom; and to determine the processes and costs associated with their implementation.

Data sources

Databases including the Cochrane Database of Systematic Reviews (CDSR), The Campbell Library, the Database of Abstracts of Reviews of Effects (DARE), the Health Technology Assessment (HTA) database, the NHS Economic Evaluation Database (NHS EED) and EPPI-Centre’s Trials Register of Promoting Health Interventions (TRoPHI) and Database of Promoting Health Effectiveness Reviews (DoPHER) were searched from 1990 to August 2011 for systematic reviews and primary studies. Trials evaluating community engagement interventions reporting health outcomes were included.

Review methods

Study eligibility criteria: published after 1990; outcome, economic, or process evaluation; intervention relevant to community engagement; written in English; measured and reported health or community outcomes, or presents cost, resource, or implementation data characterises study populations or reports differential impacts in terms of social determinants of health; conducted in an Organisation for Economic Co-operation and Development (OECD) country. Study appraisal: risk of bias for outcome evaluations; assessment of validity and relevance for process evaluations; comparison against an economic evaluation checklist for economic evaluations. Synthesis methods: four synthesis approaches were adopted for the different evidence types: theoretical, quantitative, process, and economic evidence.

Results

The theoretical synthesis identified key models of community engagement that are underpinned by different theories of changes. Results from 131 studies included in a meta-analysis indicate that there is solid evidence that community engagement interventions have a positive impact on health behaviours, health consequences, self-efficacy and perceived social support outcomes, across various conditions. There is insufficient evidence – particularly for long-term outcomes and indirect beneficiaries – to determine whether one particular model of community engagement is likely to be more effective than any other. There are also insufficient data to test the effects on health inequalities, although there is some evidence to suggest that interventions that improve social inequalities (as measured by social support) also improve health behaviours. There is weak evidence from the effectiveness and process evaluations that certain implementation factors may affect intervention success. From the economic analysis, there is weak but inconsistent evidence that community engagement interventions are cost-effective. By combining findings across the syntheses, we produced a new conceptual framework.

Limitations

Differences in the populations, intervention approaches and health outcomes made it difficult to pinpoint specific strategies for intervention effectiveness. The syntheses of process and economic evidence were limited by the small (generally not rigorous) evidence base.

Conclusions

Community engagement interventions are effective across a wide range of contexts and using a variety of mechanisms. Public health initiatives should incorporate community engagement into intervention design. Evaluations should place greater emphasis on long-term outcomes, outcomes for indirect beneficiaries, process evaluation, and reporting costs and resources data. The theories of change identified and the newly developed conceptual framework are useful tools for researchers and practitioners. We identified trends in the evidence that could provide useful directions for future intervention design and evaluation.

Funding

The National Institute for Health Research Public Health Research programme.

[Final results of a multifactorial and community intervention study for the prevention of falls in the elderly]

OBJECTIVE

To evaluate the effectiveness of a multifactorial and community intervention programme to decrease the number of falls and their complications in the >or=70 years population in a community.

DESIGN

Multicentre, community intervention study, with no random assignment and with controls.

SETTING

Two basic health areas in the province of Girona (Spain).

PARTICIPANTS

Random sample of people >or=70 years, 2515 in the intervention group (IG) and 1212 in the control group (CG). The IG received multifactorial intervention with community activities, individual in the clinic or at home and by the professionals, for 2 years. The CG received routine health care. MEASUREMENTS AND PRIMARY OUTCOMES: The baseline situation of two representative random samples, IG (n=329) and CG (n=379) and post-intervention IG (n=292) and CG (n=310), usinn a survey.

RESULTS

(People with falls): IG baseline 29% (95% confidence interval [CI]: 25.8-31.9) and post-intervention 31% (95% CI: 25.6-36.5). CG baseline 32% (95% CI: 28.8-35.2) and post-intervention 30% (95% CI: 24.9-35.4). Falls with fractures: IG baseline 10.4% (95% CI:6-16.3) and post-intervention 5.3% (95% CI:2-11,2); CG baseline 7% (95% CI:4-11.2) and post-intervention 10.7% (95% CI:5.8-17.7). Falls with medical care: IG baseline 45.4% (95% CI: 37-54) and post-intervention 43.8% (95% CI: 34.4-54.4). GC baseline 30.3% (95% CI: 24.3-36.8) and post-intervention 40.8% (95% CI: 31-51.2).

CONCLUSIONS

A multifactorial community intervention programme in people >or=70 years did not reduce the number of falls at 2 years, but a tendency to reduce their consequences was observed, and could be integrated within routine care activities.

The 'WHO Safe Communities' model for the prevention of injury in whole populations

BACKGROUND

The World Health Organization (WHO) 'safe communities' approach to injury prevention has been embraced around the world as a model for co-ordinating community efforts to enhance safety and reduce injury. Approximately 150 communities throughout the world have formal 'Safe Communities' designation. It is of public health interest to determine to what degree the model is successful, and whether it reduces injury rates. This Cochrane Review is an update of a previous published version.

OBJECTIVES

To determine the effectiveness of the WHO Safe Communities model to prevent injury in whole populations.

SEARCH STRATEGY

Our search included CENTRAL, MEDLINE and EMBASE, PsycINFO, ISI Web of Science: Social Sciences Citation Index (SSCI) and ZETOC. We handsearched selected journals and contacted key people from each WHO Safe Community. The last search was December 2008.

SELECTION CRITERIA

Two authors independently screened studies for inclusion. Included studies were those conducted within a WHO Safe Community that reported changes in population injury rates within the community compared to a control community.

DATA COLLECTION AND ANALYSIS

Two authors independently extracted data. Meta-analysis was not appropriate due to the heterogeneity of the included studies.

MAIN RESULTS

We included evaluations for 21 communities from five countries in two geographical regions in the world: Austria, Sweden and Norway, and Australia and New Zealand. Although positive results were reported for some communities, there was no consistent relationship between being a WHO designated Safe Community and subsequent changes in observed injury rates.

AUTHORS' CONCLUSIONS

There is marked inconsistency in the results of the studies included in this systematic review. While the frequency of injury in some study communities did reduce following their designation as a WHO Safe Community, there remains insufficient evidence from which to draw definitive conclusions regarding the effectiveness of the model.The lack of consistency in results may be due to the heterogeneity of the approaches to implementing the model, varying efficacy of activities and strategies, varying intensity of implementation and methodological limitations in evaluations. While all communities included in the review fulfilled the WHO Safe Community criteria, these criteria were too general to prescribe a standardised programme of activity or evaluation methodology.Adequate documentation describing how various Safe Communities implemented the model was limited, making it unclear which factors affected success. Where a reduction in injury rates was not reported, lack of information makes it difficult to distinguish whether this was due to problems with the model or with the way in which it was implemented.

The home environment and disability-related outcomes in aging individuals: what is the empirical evidence?

PURPOSE

Building on the disablement process model and the concept of person-environment fit (p-e fit), this review article examines 2 critical questions concerning the role of home environments: (a) What is the recent evidence supporting a relationship between home environments and disability-related outcomes? and (b) What is the recent evidence regarding the effects of home modifications on disability-related outcomes?

DESIGN AND METHODS

Using computerized and manual search, we identified relevant peer-reviewed original publications and review articles published between January 1, 1997, and August 31, 2006. For Research Question 1, 25 original investigations and for Research Question 2, 29 original investigations and 10 review articles were identified.

RESULTS

For Research Question 1, evidence for a relationship between home environments and disability-related outcomes for older adults exists but is limited by cross-sectional designs and poor research quality. For Research Question 2, evidence based on randomized controlled trials shows that improving home environments enhances functional ability outcomes but not so much falls-related outcomes. Some evidence also exists that studies using a p-e fit perspective result in more supportive findings than studies that do not use this framework.

IMPLICATIONS

Considerable evidence exists that supports the role of home environments in the disablement process, but there are also inconsistencies in findings across studies. Future research should optimize psychometric properties of home environment assessment tools and explore the role of both objective characteristics and perceived attributions of home environments to understand person-environment dynamics and their impact on disability-related outcomes in old age.

Non-pharmaceutical prevention of hip fractures - a cost-effectiveness analysis of a community-based elderly safety promotion program in Sweden

BACKGROUND

Elderly injuries are a recognized public health concern and are due to two factors; osteoporosis and accidental falls. Several osteoporosis pharmaceuticals are considered cost-effective, but intervention programs aiming at preventing falls should also be subjected to economic evaluations. This study presents a cost-effectiveness analysis of a community-based elderly safety promotion program.

METHODS

A five-year elderly safety promotion program combining environmental structural changes with individually based measures was implemented in a community in the metropolitan area of Stockholm, Sweden. The community had around 5,500 inhabitants aged 65+ years and a first hip fracture incidence of 10.7 per 1,000 in pre-intervention years 1990-1995. The intervention outcome was measured as avoided hip fractures, obtained from a register-based quasi-experimental longitudinal analysis with several control areas. The long-term consequences in societal costs and health effects due to the avoided hip fractures, conservatively assumed to be avoided for one year, were estimated with a Markov model based on Swedish data. The analysis holds the societal perspective and conforms to recommendations for pharmaceutical cost-effectiveness analyses.

RESULTS

Total societal intervention costs amounted to 6.45 million SEK (in Swedish krona 2004; 1 Euro = 9.13 SEK). The number of avoided hip fractures during the six-year post-intervention period was estimated to 14 (0.44 per 1,000 person-years). The Markov model estimated a difference in societal costs between an individual that experiences a first year hip fracture and an individual that avoids a first year hip fracture ranging from 280,000 to 550,000 SEK, and between 1.1 and 3.2 QALYs (quality-adjusted life-years, discounted 3%), for males and females aged 65-79 years and 80+ years. The cost-effectiveness analysis resulted in zero net costs and a gain of 35 QALYs, and the do-nothing alternative was thus dominated.

CONCLUSION

The community-based elderly safety promotion program aiming at preventing accidental falls seems as cost-effective as osteoporosis pharmaceuticals.

Outdoor falls among middle-aged and older adults: a neglected public health problem

OBJECTIVES

Although risk factors for indoor falls among older individuals have been well studied, little is known about the etiology of outdoor falls. We examined risk factors for outdoor falls among middle-aged and older adults.

METHODS

We analyzed data on the most recent fall during the past year among participants aged 45 years and older in the control group (N=2193) of a case-control study of fractures. The study was conducted at 5 Northern California Kaiser Permanente Medical Centers between 1996 and 2001.

RESULTS

Falls occurred outdoors more often than indoors among most age groups. Study participants who reported more leisure-time physical activity had a higher risk for outdoor falls, and participants who were in poorer health had a greater risk for indoor falls. Most outdoor falls (73%) were precipitated by environmental factors, such as uneven surfaces and tripping or slipping on objects, and usually occurred on sidewalks, curbs, and streets. Walking (47.3%) was the most common fall-related activity.

CONCLUSIONS

Outdoor falls among adults aged 45 years and older were frequently attributable to modifiable environmental factors. With the widespread promotion of active lifestyles among older people, improvements in their outdoor environment are urgently needed.

What makes community based injury prevention work? In search of evidence of effectiveness

Community based injury prevention work has become a widely accepted strategy among safety promotion specialists. Hundreds of community based injury prevention programs have been implemented since the mid-1970s, but relatively few have been evaluated rigorously, resulting in a lack of consensus regarding the effectiveness of this approach. This study sought to identify key components that contribute to the effectiveness of these programs. The objective was to gain a better understanding of the community based model for injury prevention. The study was performed as a structured review of existing evaluations of injury prevention programs that employed multiple strategies to target different age groups, environments, and situations. The results of this study suggested that there are complex relationships between the outcome and the context, structure, and process of community-wide injury prevention programs. The interconnectedness of these variables made it difficult to provide solid evidence to prioritise in terms of program effectiveness. The evaluations of multifaceted community oriented injury prevention programs were found to have many shortcomings. Meagre descriptions of community characteristics and conditions, insufficient assessment of structural program components, and failure to establish process-outcome relationships contributed to the difficulty of identifying key success factors of the programs.