Applying cost analysis methods to school-based prevention programs

An Economic Evaluation of the Costs and Benefits of Providing Comprehensive Supports to Students in Elementary School

There is growing evidence that out-of-school factors, such as physical and mental health, family support, and social and emotional development, significantly affect student learning (Berliner 2009). To address challenges related to poverty, schools are being charged with serving as a focal point in providing and coordinating support services for students and their families (Adelman and Taylor 2002; Dryfoos 2002). In many schools these support services are provided in fragmented ways that do not address the needs of all students or engage teachers in connecting these services to the academic mission of the school (Walsh and DePaul 2008). An emerging school-based model, broadly termed "comprehensive student support" (Walsh et al. 2016), is designed to overcome such fragmentation. In this paper, we build upon previous effectiveness work with an economic evaluation of a successful support model, City Connects. We find that the benefits of the program exceed the costs, indicating that the program is a sound investment and should be considered an option to address the needs of students and to prevent future crises from disrupting their learning.

Brief, Non-Pharmacological, Interventions for Pediatric Anxiety: Meta-Analysis and Evidence Base Status

In 1998, Ost published [One-session treatment of specific phobias-a rapid and effective method] [in Swedish] giving rise to the idea that brief, intensive, and concentrated psychosocial interventions could exhibit public health impact. At this juncture, and per criteria of the Society for Clinical Child and Adolescent Psychology, there are data supporting that brief, non-pharmacological intervention [prescriptions] for pediatric anxiety can be considered well-established or probably efficacious. In addition, data from 76 randomized controlled trials (N = 17,203 youth) yield an overall mean effect size of 0.19 on pediatric anxiety outcomes (pre-post). Note, however, that effect sizes vary significantly. These data point to the capacity for clinical change coming from in-vivo exposures for specific phobias (~3 h, one session), CBT with social skills training (~3 h, six sessions for indicated prevention and early intervention), and CBT-based parent training (~6 h, eight digital modules with clinician support). Given such evidence, we recommend efforts be made to establish ways to position such treatment innovations for rapid deployment facilitated by high-quality training, monitoring, technical assistance, and ongoing disclosures.

Reducing disability via a family centered intervention for acutely ill persons with Alzheimer's disease and related dementias: protocol of a cluster-randomized controlled trial (Fam-FFC study)

Background

Hospitalized older persons with Alzheimer’s disease and related dementias are at greater risk for functional decline and increased care dependency after discharge due to a combination of intrinsic factors, environmental, policy, and care practices that restrict physical and cognitive activity, lack of family involvement and limited staff knowledge of dementia care. We have developed a theory-based intervention, Family centered Function-focused Care, that incorporates an educational empowerment model for family caregivers (FCGs) provided within a social-ecological framework to promote specialized care to patients with dementia during hospitalization and the 60-day post-acute period. Primary aims are to test the efficacy of the intervention in improving physical and cognitive recovery in hospitalized persons living with Alzheimer’s disease and related dementias (ADRD) and improving FCG preparedness and experiences.

Method

We will implement Family centered Function-focused Care in a cluster-randomized trial of 438 patient/FCG dyads in six hospital units randomized within three hospitals. We hypothesize that patients who receive the intervention will demonstrate better physical function, less delirium occurrence and severity, neuropsychiatric symptoms, and depression compared to those in the control condition (Education-only). We also hypothesize that FCGs enrolled in Family centered Function-focused Care will experience increased preparedness for caregiving, and less strain, burden, and desire to institutionalize, as compared to FCGs the control group. We will also examine the costs and relative cost savings associated with the intervention and will evaluate the cultural appropriateness of Family centered Function-focused Care for families from diverse backgrounds.

Discussion

Our theory-based intervention makes use of real-world applicable approaches in a novel and innovative way to change the paradigm of how we currently look at acute care and post-acute transitions in persons with ADRD.

Trial registration

ClinicalTrials.gov, ID: NCT03046121. Registered on 8 February 2017.

Electronic supplementary material

The online version of this article (10.1186/s13063-018-2875-1) contains supplementary material, which is available to authorized users.

Nurse Family Partnership: Comparing Costs per Family in Randomized Trials Versus Scale-Up

The literature that addresses cost differences between randomized trials and full-scale replications is quite sparse. This paper examines how costs differed among three randomized trials and six statewide scale-ups of nurse family partnership (NFP) intensive home visitation to low income first-time mothers. A literature review provided data on pertinent trials. At our request, six well-established programs reported their total expenditures. We adjusted the costs to national prices based on mean hourly wages for registered nurses and then inflated them to 2010 dollars. A centralized data system provided utilization. Replications had fewer home visits per family than trials (25 vs. 31, p = .05), lower costs per client ($8860 vs. $12,398, p = .01), and lower costs per visit ($354 vs. $400, p = .30). Sample size limited the significance of these differences. In this type of labor intensive program, costs probably were lower in scale-up than in randomized trials. Key cost drivers were attrition and the stable caseload size possible in an ongoing program. Our estimates reveal a wide variation in cost per visit across six state programs, which suggests that those planning replications should not expect a simple rule to guide cost estimations for scale-ups. Nevertheless, NFP replications probably achieved some economies of scale.

Did we get our money's worth? Bridging economic and behavioral measures of program success in adolescent drug prevention

The recent U.S. Congressional mandate for creating drug-free learning environments in elementary and secondary schools stipulates that education reform rely on accountability, parental and community involvement, local decision making, and use of evidence-based drug prevention programs. By necessity, this charge has been paralleled by increased interest in demonstrating that drug prevention programs net tangible benefits to society. One pressing concern is precisely how to integrate traditional scientific methods of program evaluation with economic measures of “cost efficiency”. The languages and methods of each respective discipline don’t necessarily converge on how to establish the true benefits of drug prevention. This article serves as a primer for conducting economic analyses of school-based drug prevention programs. The article provides the reader with a foundation in the relevant principles, methodologies, and benefits related to conducting economic analysis. Discussion revolves around how economists value the potential costs and benefits, both financial and personal, from implementing school-based drug prevention programs targeting youth. Application of heterogeneous costing methods coupled with widely divergent program evaluation findings influences the feasibility of these techniques and may hinder utilization of these practices. Determination of cost-efficiency should undoubtedly become one of several markers of program success and contribute to the ongoing debate over health policy.

Multisite cost analysis of a school-based voluntary alcohol and drug prevention program

OBJECTIVE

This article estimates the societal costs of Project CHOICE, a voluntary after-school alcohol and other drug prevention program for adolescents. To our knowledge, this is the first cost analysis of an after-school program specifically focused on reducing alcohol and other drug use.

METHOD

The article uses microcosting methods based on the societal perspective and includes a number of sensitivity analyses to assess how the results change with alternative assumptions. Cost data were obtained from surveys of participants, facilitators, and school administrators; insights from program staff members; program expenditures; school budgets; the Bureau of Labor Statistics; and the National Center for Education Statistics.

RESULTS

From the societal perspective, the cost of implementing Project CHOICE in eight California schools ranged from $121 to $305 per participant (Mdn = $238). The major cost drivers included labor costs associated with facilitating Project CHOICE, opportunity costs of displaced class time (because of in-class promotions for Project CHOICE and consent obtainment), and other efforts to increase participation. Substituting nationally representative cost information for wages and space reduced the range to $100-$206 (Mdn = $182), which is lower than the Substance Abuse and Mental Health Services Administration's estimate of $262 per pupil for the "average effective school-based program in 2002." Denominating national Project CHOICE costs by enrolled students instead of participants generates a median per-pupil cost of $21 (range: $14-$28).

CONCLUSIONS

Estimating the societal costs of school-based prevention programs is crucial for efficiently allocating resources to reduce alcohol and other drug use. The large variation in Project CHOICE costs across schools highlights the importance of collecting program cost information from multiple sites.

Practical approach for using Medicare data to estimate costs for cost-effectiveness analysis

Many methods have been used to measure costs for cost-effectiveness analysis in healthcare. A central challenge in cost estimation is determining the direct cost of medical goods and services from a societal perspective. This review applies the methodology for calculating Medicare reimbursements for physician services, hospital services and medications as a means of estimating healthcare costs from a US societal perspective. This review provides the tools and information needed to calculate direct medical costs related to in- and outpatient services provided by physicians and hospitals, as well as drug costs using Medicare reimbursement data. The data used in calculating Medicare reimbursements was obtained from the Centers for Medicare and Medicaid Services website. Methods for estimating costs for a particular service in a specific location using Medicare and Medicaid Services are described and demonstrated. A method based on Medicare data that uses the unadjusted geographic practice cost index and standard hospital base rate to estimate healthcare costs that can be generalized to the US population is described and demonstrated. This review provides cost-effectiveness analysts with the tools needed to calculate healthcare service costs for economic research. It contains links to all websites needed for obtaining Medicare and Medicaid Services data and provides a step-by-step analysis of the methodology involved in calculating costs. A practical guide for applying the methodology used by Medicare and Medicaid Services to calculate direct medical costs in order to estimate US societal costs in cost-effectiveness analysis is provided.

Developing an Internet-based survey to collect program cost data

This manuscript describes the development and testing of an Internet-based cost survey that was designed by the authors for the National Assembly on School-Based Health Care (NASBHC) to capture the costs of school-based health programs. The intent of the survey was twofold. First, the survey was designed to collect comprehensive data on costs in a uniform and consistent manner that would be appropriate for economic evaluations and to inform policy. Second, the survey was constructed such that program administrators potentially could use it as a tool for internal purposes related to operations and planning. We begin by describing the economic conceptual framework on which the survey is based and the need for a cost data collection instrument that can be used both within and outside of a traditional research setting. We then outline the survey components and how they were developed, pilot-tested, and refined. We conclude with a discussion of how this survey is currently being used and how a survey of this type can be applied in other settings to collect program cost data for economic evaluations.

Enhancing the net benefits of disseminating efficacious prevention programs: a note on target efficiency with illustrative examples

We consider the implementation, in a non-research setting, of a new prevention program that has previously been evaluated in a randomized trial. When the target population for the implementation is heterogeneous, the overall net benefits of the implementation may differ substantially from those reported in the economic evaluation of the randomized trial, and from those that would be realized if the program were implemented within a selected subgroup of the target population. This note illustrates a simple and practical approach to targeting that can combine risk-factor results from the literature with the overall cost-benefit results from the program's randomized trial to maximize the expected net benefit of implementing the program in a heterogeneous population.

Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination

Ever increasing demands for accountability, together with the proliferation of lists of evidence-based prevention programs and policies, led the Society for Prevention Research to charge a committee with establishing standards for identifying effective prevention programs and policies. Recognizing that interventions that are effective and ready for dissemination are a subset of effective programs and policies, and that effective programs and policies are a subset of efficacious interventions, SPR's Standards Committee developed overlapping sets of standards. We designed these Standards to assist practitioners, policy makers, and administrators to determine which interventions are efficacious, which are effective, and which are ready for dissemination. Under these Standards, an efficacious intervention will have been tested in at least two rigorous trials that (1) involved defined samples from defined populations, (2) used psychometrically sound measures and data collection procedures; (3) analyzed their data with rigorous statistical approaches; (4) showed consistent positive effects (without serious iatrogenic effects); and (5) reported at least one significant long-term follow-up. An effective intervention under these Standards will not only meet all standards for efficacious interventions, but also will have (1) manuals, appropriate training, and technical support available to allow third parties to adopt and implement the intervention; (2) been evaluated under real-world conditions in studies that included sound measurement of the level of implementation and engagement of the target audience (in both the intervention and control conditions); (3) indicated the practical importance of intervention outcome effects; and (4) clearly demonstrated to whom intervention findings can be generalized. An intervention recognized as ready for broad dissemination under these Standards will not only meet all standards for efficacious and effective interventions, but will also provide (1) evidence of the ability to "go to scale"; (2) clear cost information; and (3) monitoring and evaluation tools so that adopting agencies can monitor or evaluate how well the intervention works in their settings. Finally, the Standards Committee identified possible standards desirable for current and future areas of prevention science as the field develops. If successful, these Standards will inform efforts in the field to find prevention programs and policies that are of proven efficacy, effectiveness, or readiness for adoption and will guide prevention scientists as they seek to discover, research, and bring to the field new prevention programs and policies.

Critical issues in the prevention of violence-related behavior in youth

Violence prevention programs with varying degrees of scientific support have proliferated in the United States and elsewhere. This paper previewed a broad range of programs involving youth, families, or systems that aimed to prevent or reduce violence-related behavior. The purpose of the review was to address critical issues concerning (1) target level of programming, (2) theory-driven versus problem-driven conceptualization, (3) cultural considerations, (4) developmental considerations, (5) intervention fidelity, and (6) outcome and impact assessment. Conclusions about these issues address tendencies and trends across programs.