Cost-effectiveness of the Mpowerment Project, a community-level intervention for young gay men

Cost and economic evidence for asset-based approaches to health improvement and their evaluation methods: a systematic review

BACKGROUND

Asset-based approaches (ABAs) tackle health inequalities by empowering people in more disadvantaged communities, or targeted populations, to better utilise pre-existing local community-based resources. Using existing resources supports individuals to better manage their own health and its determinants, potentially at low cost. Targeting individuals disengaged with traditional service delivery methods offers further potential for meaningful cost-savings, since these people often require costly care. Thus, improving prevention, and management, of ill-health in these groups may have considerable cost implications.

AIM

To systematically review the extent of current cost and economic evidence on ABAs, and methods used to develop it.

METHODS

Search strategy terms encompassed: i) costing; ii) intervention detail; and iii) locality. Databases searched: Medline, CENTRAL and Wed of Science. Researchers screened 9,116 articles. Risk of bias was assessed using the Critical Appraisal Skills Programme (CASP) tool. Narrative synthesis summarised findings.

RESULTS

Twelve papers met inclusion criteria, representing eleven different ABAs. Within studies, methods varied widely, not only in design and comparators, but also in terms of included costs and outcome measures. Studies suggested economic efficiency, but lack of suitable comparators made more definitive conclusions difficult.

CONCLUSION

Economic evidence around ABAs is limited. ABAs may be a promising way to engage underserved or minority groups, that may have lower net costs compared to alternative health and wellbeing improvement approaches. ABAs, an example of embedded services, suffer in the context of economic evaluation, which typically consider services as mutually exclusive alternatives. Economics of the surrounding services, mechanisms of information sharing, and collaboration underpin the success of assets and ABAs. The economic evidence, and evaluations in general, would benefit from increased context and detail to help ensure more nuanced and sophisticated understanding of the economics of ABAs. Further evidence is needed to reach conclusions about cost-effectiveness of ABAs.

The Cost-Effectiveness of HIV/STI Prevention in High-Income Countries with Concentrated Epidemic Settings: A Scoping Review

The purpose of this scoping review is to establish the state of the art on economic evaluations in the field of HIV/STI prevention in high-income countries with concentrated epidemic settings and to assess what we know about the cost-effectiveness of different measures. We reviewed economic evaluations of HIV/STI prevention measures published in the Web of Science and Cost-Effectiveness Registry databases. We included a total of 157 studies focusing on structural, behavioural, and biomedical interventions, covering a variety of contexts, target populations and approaches. The majority of studies are based on mathematical modelling and demonstrate that the preventive measures under scrutiny are cost-effective. Interventions targeted at high-risk populations yield the most favourable results. The generalisability and transferability of the study results are limited due to the heterogeneity of the populations, settings and methods involved. Furthermore, the results depend heavily on modelling assumptions. Since evidence is unequally distributed, we discuss implications for future research.

Model-Based Methods to Translate Adolescent Medicine Trials Network for HIV/AIDS Interventions Findings Into Policy Recommendations: Rationale and Protocol for a Modeling Core (ATN 161)

Background

The United States Centers for Disease Control and Prevention estimates that approximately 60,000 US youth are living with HIV. US youth living with HIV (YLWH) have poorer outcomes compared with adults, including lower rates of diagnosis, engagement, retention, and virologic suppression. With Adolescent Medicine Trials Network for HIV/AIDS Interventions (ATN) support, new trials of youth-centered interventions to improve retention in care and medication adherence among YLWH are underway.

Objective

This study aimed to use a computer simulation model, the Cost-Effectiveness of Preventing AIDS Complications (CEPAC)-Adolescent Model, to evaluate selected ongoing and forthcoming ATN interventions to improve viral load suppression among YLWH and to define the benchmarks for uptake, effectiveness, durability of effect, and cost that will make these interventions clinically beneficial and cost-effective.

Methods

This protocol, ATN 161, establishes the ATN Modeling Core. The Modeling Core leverages extensive data—already collected by successfully completed National Institutes of Health–supported studies—to develop novel approaches for modeling critical components of HIV disease and care in YLWH. As new data emerge from ongoing ATN trials during the award period about the effectiveness of novel interventions, the CEPAC-Adolescent simulation model will serve as a flexible tool to project their long-term clinical impact and cost-effectiveness. The Modeling Core will derive model input parameters and create a model structure that reflects key aspects of HIV acquisition, progression, and treatment in YLWH. The ATN Modeling Core Steering Committee, with guidance from ATN leadership and scientific experts, will select and prioritize specific model-based analyses as well as provide feedback on derivation of model input parameters and model assumptions. Project-specific teams will help frame research questions for model-based analyses as well as provide feedback regarding project-specific inputs, results, sensitivity analyses, and policy conclusions.

Results

This project was funded as of September 2017.

Conclusions

The ATN Modeling Core will provide critical information to guide the scale-up of ATN interventions and the translation of ATN data into policy recommendations for YLWH in the United States.

Screening for HIV and linkage to care in adolescents: insights from a systematic review of recent interventions in high- versus low- and middle-income settings

Introduction

Compared to adults, adolescents and young adults have a higher incidence of HIV infection, yet lower rates of HIV testing. Few evidence-based interventions effectively diagnose new HIV infections among adolescents while successfully providing linkage to care.

Methods

We conducted a systematic review of recent interventions to increase HIV testing among adolescents and young adults using data retrieved from PubMed and Google Scholar, and using abstracts presented at the International AIDS Society conferences and Conference on Retroviruses and Opportunistic Infections published between January 1, 2015, and April 28, 2018.

Results

We identified 36 interventions (N=14 in high- income countries and N=22 in low- and middle-income countries) that were published in the literature (N=28) or presented at conferences (N=8). Interventions were categorized as behavioral/educational, alternate venue/self-testing, youth-friendly services, technology/mobile health, incentives, or peer-based/community-based interventions. The studies consisted of randomized controlled trials (RCTs), prospective and retrospective observational studies, and quasi-experimental/pre-post evaluations with variable sample sizes. Study designs, populations, and settings varied. All categories showed some degree of acceptability, yet not all interventions were effective in increasing HIV testing. Effectiveness was seen in more than one RCT involving technology/mobile health (2/3 RCTs) and alternative venue/self-testing (3/3 RCTs) interventions, and only in one RCT each for behavioral interventions, community interventions, and incentives. There were no effective RCTs for adolescent-friendly services. Data were limited on the number of new infections identified and on the methods to increase linkage to care after diagnosis.

Conclusion

Future studies should include combinations of proven methods for engaging adolescents in HIV testing, while ensuring effective methods of linkage to care.

A Systems Thinking Approach to Understanding and Demonstrating the Role of Peer-Led Programs and Leadership in the Response to HIV and Hepatitis C: Findings From the W3 Project

The central role of community and peer-led programs has been a key characteristic of the Australian partnership response to HIV and hepatitis C since the beginning of the epidemics. Despite this, peer-led programs continue to have limited capacity to demonstrate their role and value as part of a multi-sectoral response. What makes one peer-led program a better investment than another? What role does the rest of the sector have in ensuring we gain the most value from these investments? To investigate this, we facilitated interactive systems thinking methods with 10 programs working within communities of people who inject drugs, gay men, sex workers and people living with HIV across Australia. This included articulating program theories in diagram and textual form to help us understand the role of peer-based programs promoting peer leadership within the Australian HIV and hepatitis C responses. Our aim was to develop a framework for monitoring and evaluation that could be applied to peer led programs at different levels and in different contexts. We found that for peer-led programs to fulfill their role, and to navigate the rapid changes occurring in the both epidemics, they need to: demonstrate the credibility of their peer and community insights; continually adapt to changing contexts and policy priorities in tandem with their communities; and maintain influence in both community and policy systems. We developed a framework of four key functions (Engagement, Alignment, Adaptation, and Influence) which peer-based programs need to demonstrate, which form the basis for identifying quality indicators. This article presents a new way of framing and monitoring investments in peer-led programs and peer eadership actions by these programs. If health policy is committed to strengthening the leadership shown by affected communities, then we need to understand, enhance, monitor and value the role of peer-led programs and peer leadership within the overall prevention system. We believe the W3 framework, drawing on systems thinking and modeling, can support funders, policy-makers and programs to achieve this.

HIV Treatment and Prevention: A Simple Model to Determine Optimal Investment

OBJECTIVE

To create a simple model to help public health decision makers determine how to best invest limited resources in HIV treatment scale-up and prevention.

METHOD

A linear model was developed for determining the optimal mix of investment in HIV treatment and prevention, given a fixed budget. The model incorporates estimates of secondary health benefits accruing from HIV treatment and prevention and allows for diseconomies of scale in program costs and subadditive benefits from concurrent program implementation. Data sources were published literature. The target population was individuals infected with HIV or at risk of acquiring it. Illustrative examples of interventions include preexposure prophylaxis (PrEP), community-based education (CBE), and antiretroviral therapy (ART) for men who have sex with men (MSM) in the US. Outcome measures were incremental cost, quality-adjusted life-years gained, and HIV infections averted.

RESULTS

Base case analysis indicated that it is optimal to invest in ART before PrEP and to invest in CBE before scaling up ART. Diseconomies of scale reduced the optimal investment level. Subadditivity of benefits did not affect the optimal allocation for relatively low implementation levels. The sensitivity analysis indicated that investment in ART before PrEP was optimal in all scenarios tested. Investment in ART before CBE became optimal when CBE reduced risky behavior by 4% or less. Limitations of the study are that dynamic effects are approximated with a static model.

CONCLUSIONS

Our model provides a simple yet accurate means of determining optimal investment in HIV prevention and treatment. For MSM in the US, HIV control funds should be prioritized on inexpensive, effective programs like CBE, then on ART scale-up, with only minimal investment in PrEP.

Economics of mass media health campaigns with health-related product distribution: a community guide systematic review

CONTEXT

The objective of this systematic review was to determine the costs, benefits, and overall economic value of communication campaigns that included mass media and distribution of specified health-related products at reduced price or free of charge.

EVIDENCE ACQUISITION

Economic evaluation studies from a literature search from January 1980 to December 2009 were screened and abstracted following systematic economic review methods developed by The Community Guide. Data were analyzed in 2011.

EVIDENCE SYNTHESIS

The economic evidence was grouped and assessed by type of product distributed and health risk addressed. A total of 15 evaluation studies were included in the economic review, involving campaigns promoting the use of child car seats or booster seats, pedometers, condoms, recreational safety helmets, and nicotine replacement therapy.

CONCLUSIONS

Economic merits of the intervention could not be determined for health communication campaigns associated with use of recreational helmets, child car seats, and pedometers, primarily because available economic information and analyses were incomplete. There is some evidence that campaigns with free condom distribution to promote safer sex practices were cost-effective among high-risk populations and the cost per quit achieved in campaigns promoting tobacco cessation with nicotine replacement therapy products may translate to a cost per quality-adjusted life-year less than $50,000. Many interventions were publicly funded trials or programs, and the failure to properly evaluate their economic cost and benefit is a serious gap in the science and practice of public health.

From personal survival to public health: community leadership by men who have sex with men in the response to HIV

Community leadership and participation by gay men and men who have sex with men (MSM) have been central to the response to HIV since the beginning of the epidemic. Through a wide array of actions, engagement of MSM has been important in the protection of communities. The connection between personal and community health as drivers of health advocacy continue to be a powerful element. The passion and urgency brought by MSM communities have led to the targeting and expansion of HIV and AIDS research and programming, and have improved the synergy of health and human rights, sustainability, accountability, and health outcomes for all people affected by HIV. MSM are, however, frequently excluded from the evidence-based services that they helped to develop, despite them generally being the most effective actors in challenging environments. Without MSM community involvement, government-run health programmes might have little chance of effectively reaching communities or scaling up interventions to lessen, and ultimately end, the HIV pandemic.

Optimal investment in HIV prevention programs: more is not always better

This paper develops a mathematical/economic framework to address the following question: Given a particular population, a specific HIV prevention program, and a fixed amount of funds that could be invested in the program, how much money should be invested? We consider the impact of investment in a prevention program on the HIV sufficient contact rate (defined via production functions that describe the change in the sufficient contact rate as a function of expenditure on a prevention program), and the impact of changes in the sufficient contact rate on the spread of HIV (via an epidemic model). In general, the cost per HIV infection averted is not constant as the level of investment changes, so the fact that some investment in a program is cost effective does not mean that more investment in the program is cost effective. Our framework provides a formal means for determining how the cost per infection averted changes with the level of expenditure. We can use this information as follows: When the program has decreasing marginal cost per infection averted (which occurs, for example, with a growing epidemic and a prevention program with increasing returns to scale), it is optimal either to spend nothing on the program or to spend the entire budget. When the program has increasing marginal cost per infection averted (which occurs, for example, with a shrinking epidemic and a prevention program with decreasing returns to scale), it may be optimal to spend some but not all of the budget. The amount that should be spent depends on both the rate of disease spread and the production function for the prevention program. We illustrate our ideas with two examples: that of a needle exchange program, and that of a methadone maintenance program.

A linear programming model for allocating HIV prevention funds with state agencies: a pilot study

Given the initiatives to improve resource allocation decisions for HIV prevention activities, a linear programming model was designed specifically for use by state and local decision-makers. A pilot study using information from the state of Florida was conducted and studied under a series of scenarios depicting the impact of common resource allocation constraints. Improvements over the past allocation strategy in the number of potential infections averted were observed in all scenarios with a maximal improvement of 73%. When allocating limited resources, policymakers must balance efficiency and equity. In this pilot study, the optimal allocation (i.e., most-efficient strategy) would not distribute resources in an equitable manner. Instead, only 12% of at-risk people would receive prevention funds. We find that less efficient strategies, where 58% fewer infections are averted, result in significantly more equitable allocations. This tool serves as a guide for allocating funds for prevention activities.

The effectiveness of individual-, group-, and community-level HIV behavioral risk-reduction interventions for adult men who have sex with men: a systematic review

This article presents the results of a systematic review of the effectiveness and economic efficiency of individual-, group-, and community-level behavioral interventions intended to reduce the risk of acquiring sexually transmitted HIV in adult men who have sex with men (MSM). These results form the basis for recommendations by the Task Force on Community Preventive Services on the use of these interventions. Sexual risk behavior and condom use were the outcomes used to assess effectiveness. Intervention effectiveness on biological outcomes could not be assessed because too few studies of adequate quality have been published. The evidence found in our review shows that individual-level, group-level, and community-level HIV behavioral interventions are effective in reducing the odds of unprotected anal intercourse (range 27% to 43% decrease) and increasing the odds of condom use for the group-level approach (by 81%). The Task Force concluded that the findings are applicable to MSM aged 20 years or older, across a range of settings and populations, assuming that interventions are appropriately adapted to the needs and characteristics of the MSM population of interest. Based on findings from economic evaluation studies, the Task Force also concluded that group- and community-level HIV behavioral interventions for adult MSM are not only cost effective but also result in actual cost savings. Additional information about other effects, barriers to implementation, and research gaps is provided in this paper. The recommendations based on these systematic reviews are expected to serve the needs of researchers, planners, and other public health decision makers.

Conceptualizing the Influence of Social Agents of Behavior Change: A Meta-Analysis of the Effectiveness of HIV-Prevention Interventionists for Different Groups

A meta-analysis of 166 HIV-prevention interventions tested theoretical predictions about the effects of experts, lay community members, and similar and dissimilar others, as agents of change. In general, expert interventionists produced greater behavior change than lay community members, and the demographic and behavioral similarity between the interventionist and the recipients facilitated behavioral change. Equally importantly, there were differences across groups in the efficacy of various sources, especially among populations of low status and/or power. These findings support the hypothesis that unempowered populations are more sensitive to characteristics of the interventionists who can facilitate access to various resources. In addition, they suggest the need to ensure the availability of health professionals from diverse demographic and behavioral backgrounds.

A test of major assumptions about behavior change: a comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic

This meta-analysis tested the major theoretical assumptions about behavior change by examining the outcomes and mediating mechanisms of different preventive strategies in a sample of 354 HIV-prevention interventions and 99 control groups, spanning the past 17 years. There were 2 main conclusions from this extensive review. First, the most effective interventions were those that contained attitudinal arguments, educational information, behavioral skills arguments, and behavioral skills training, whereas the least effective ones were those that attempted to induce fear of HIV. Second, the impact of the interventions and the different strategies behind them was contingent on the gender, age, ethnicity, risk group, and past condom use of the target audience in ways that illuminate the direction of future preventive efforts.

A test of major assumptions about behavior change: a comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic

This meta-analysis tested the major theoretical assumptions about behavior change by examining the outcomes and mediating mechanisms of different preventive strategies in a sample of 354 HIV-prevention interventions and 99 control groups, spanning the past 17 years. There were 2 main conclusions from this extensive review. First, the most effective interventions were those that contained attitudinal arguments, educational information, behavioral skills arguments, and behavioral skills training, whereas the least effective ones were those that attempted to induce fear of HIV. Second, the impact of the interventions and the different strategies behind them was contingent on the gender, age, ethnicity, risk group, and past condom use of the target audience in ways that illuminate the direction of future preventive efforts.

Health and Economic Impacts of an HIV Intervention in Out of Treatment Substance Abusers: Evidence from a Dynamic Model

INTRODUCTION

A community-based intervention program found that the high-risk target population interacts with its surrounding community as a source of drugs and prostitution, creating a measure of co-dependence in the health status of each group.

METHODOLOGY

The intervention collected extensive data on sexual and drug use practices in the target population. A dynamic compartment model estimates the epidemiological impact of the intervention, which serves as the basis for the economic assessment comparing intervention costs and lifetime HIV treatment costs.

RESULTS

Approximately 2/3 of the new infections arise in the surrounding community. Intervention spillover benefits in the surrounding community are sufficient to make the intervention cost-saving in the first year--a savings of approximately 534,000 dollars.

CONCLUSIONS

Conducting the intervention results in health benefits and cost-savings not only for the risk group, but for the entire community in which it resides. Quantifying the spillovers is vital to policymakers attempting to allocate scarce public health resources.

Comparing the Cost-Effectiveness of HIV Prevention Interventions

OBJECTIVE

Communities need to identify cost-effective interventions for HIV prevention to optimize limited resources.

METHODS

The authors developed a spreadsheet tool using Bernoulli and proportionate change models to estimate the relative cost-effectiveness for 26 HIV prevention interventions including biomedical interventions, structural interventions, and interventions designed to change risk behaviors of individuals. They also conducted sensitivity analyses to assess patterns of the cost-effectiveness across different populations using various assumptions.

RESULTS

The 2 factors most strongly determining the cost-effectiveness of the different interventions were the HIV prevalence of the population at risk and the cost per person reached. In low-prevalence populations (eg, heterosexuals) the most cost-effective interventions were structural interventions (eg, mass media, condom distribution), whereas in high-prevalence populations (eg, men who have sex with men) individually focused interventions to change risk behavior were also relatively cost-effective. Among the most cost-effective interventions overall were showing videos in STD clinics and raising alcohol taxes. School-based HIV prevention programs appeared to be the least cost-effective. Needle exchange and needle deregulation programs were relatively cost-effective only when injection drug users have a high HIV prevalence.

CONCLUSIONS

Comparing estimates of the cost-effectiveness of HIV interventions provides insight that can help local communities maximize the impact of their HIV prevention resources.

HIV infection and associated risks among young men who have sex with men in a Florida resort community

OBJECTIVE

Several recent studies have reported high rates of sexual risk-taking and HIV infection among young men who have sex with men (MSM). Most of these studies used samples of convenience. The authors obtained population-based data on young MSM living in South Beach (Miami Beach, Florida), a resort community where some of the highest AIDS rates in the United States have been reported.

METHODS

A household probability sample was drawn to survey unmarried 18- to 29-year-old MSM living in South Beach. Subjects were interviewed, completed self-administered questionnaires, and provided oral specimens for HIV antibody testing.

RESULTS

From the 2,622 screened residential units, 100 mostly white and Hispanic MSM (92.6% of eligible participants) were enrolled in the study. Fifteen percent of the sample tested positive for antibodies to HIV. White and Hispanic MSM had similar rates. Forty-five percent of the sample reported engaging in unprotected anal intercourse (UAI) in the prior 12 months, and 31% reported UAI with a nonprimary partner. The estimated annual incidence of HIV infection was 6.3%.

CONCLUSION

The high prevalences of UAI and HIV infection in South Beach attest to a previously undocumented public health concern. The extremely high estimated incidence for young MSM in South Beach highlights the urgent need for more effective risk-reduction interventions and further epidemiological research on resort areas.

The Mpowerment Project: community-building with young gay and bisexual men to prevent HIV1

The Mpowerment Project is a community-level HIV prevention intervention for young gay and bisexual men ages 18-27. The program seeks to build a strong, supportive young gay and bisexual men's community where young gay and bisexual men nurture and protect each other, particularly with regard to HIV prevention. The program's theoretical framework draws from the areas of diffusion of innovations, community organizing, peer influence, and personal empowerment. The Mpowerment Project promotes a norm for safer sex through a variety of social, outreach and small group activities. The project is run by a "Core Group" of 12-15 young gay and bisexual men who, with volunteers, design and carry out all project activities. Implemented in 4 communities (Eugene, OR; Santa Barbara, CA; Albuquerque, NM; Austin, TX), the Mpowerment Project has proven to be effective in reducing high risk sex. This paper discusses the development and implementation of the program and various challenges encountered.

Interventions to modify sexual risk behaviors for preventing HIV infection in men who have sex with men

BACKGROUND

MSM remain at great risk for HIV infection. Program planners and policy makers need descriptions of interventions and quantitative estimates of intervention effects to make informed decisions concerning prevention efforts.

OBJECTIVES

1. To locate and describe outcome studies evaluating the effects of behavioral and social interventions targeting MSM. 2. To summarize the effectiveness of these interventions among MSM. 3. To stratify results by characteristics of interventions and participants. 4. To identify gaps and indicate future research, policy, and practice needs.

SEARCH STRATEGY

We searched electronic databases (MedLine, PsycInfo, etc.); several current journals (e.g., AIDS, AIDS and Behavior, AIDS Education and Prevention, American Journal of Public Health, Journal of Acquired Immune Deficiency Syndromes, etc.); manuscripts submitted by researchers; bibliographies of relevant articles; and other published reviews, for published and unpublished reports from 1988 through 1997.

SELECTION CRITERIA

Studies were considered in scope if they examined the effects of behavioral interventions to reduce risk for HIV or STD transmission. We reviewed studies in scope for criteria of outcome relevance (measurement of at least one of a list of behavioral or biologic outcomes, e.g., unprotected sex or incidence of HIV infections) and methodologic rigor (randomized controlled trials or certain strong quasi-experimental designs with comparison groups).

DATA COLLECTION AND ANALYSIS

As of June 1998 we had identified 13 eligible studies. Twelve studies (7 trials of small group interventions, 3 community-level interventions, and 2 individual level interventions) reported intervention effects on unprotected sex. Because few studies reported effects on condom use (3 studies), number of sex partners without regard to condom use (4 studies), or HIV or STD incidence (1 study in which no infections occurred) we do not address these outcomes at this time. We present those analyses which can be performed in the current Cochrane RevMan software, followed by more complete analyses that permit inclusion of community-level studies, adjustment for baseline conditions, calculation of effect sizes from a wider variety of statistics (e.g., an F-statistic from a one-way ANOVA), and simultaneous meta-analysis of continuous and dichotomous outcomes (Johnson 2002b). We translate the summary effect to reduction in risk behavior based on the background prevalence of unprotected sex. Finally we provide analyses stratified by intervention content (interpersonal skills addressed or not), intervention format (community vs small group or individual) and mean age of participants (23 to 31 vs. 32 to 36).

MAIN RESULTS

A summary measure of intervention effects on reducing unprotected sex was favorable (odds ratio = 0.73) and statistically significant (CI, 0.60 to 0.88), corresponding to a 23% reduction in the proportion of men engaging in unprotected sex. Effects were homogeneous among studies, but were slightly more favorable among community-level interventions, those that served populations in their 20s rather than their 30s, and those that promoted interpersonal skills.

REVIEWER'S CONCLUSIONS

These studies demonstrate that interventions can promote risk reduction among MSM. Yet given the epidemiology of HIV in Pattern I countries, the small number of rigorous controlled intervention trials for this population is striking. Many more rigorous evaluations of HIV prevention efforts with MSM are needed to ascertain with confidence the effects of specific intervention components, population characteristics, and methodologic features.