A Technology-Mediated Approach to the Implementation of an Evidence-Based Child Maltreatment Prevention Program

Engaging Parents in Technology-Assisted Interventions for Childhood Adversity: Systematic Review

BACKGROUND

Youth mental health problems are a major public health concern and are strongly associated with adverse childhood experiences (ACEs). Technology-assisted parenting programs can intervene with ACEs that are within a parent's capacity to modify. However, engagement with such programs is suboptimal.

OBJECTIVE

This review aims to describe and appraise the efficacy of strategies used to engage parents in technology-assisted parenting programs targeting ACEs on the behavioral and subjective outcomes of engagement.

METHODS

Using PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) reporting guidelines, we conducted a systematic review of peer-reviewed papers that described the use of at least 1 engagement strategy in a technology-assisted parenting program targeting ACEs that are within a parent's capacity to modify. A total of 8 interdisciplinary bibliographic databases (CENTRAL, CINAHL, Embase, OVID MEDLINE, OVID PsycINFO, Scopus, ACM, and IEEE Xplore) and gray literature were searched. The use of engagement strategies and measures was narratively synthesized. Associations between specific engagement strategies and engagement outcomes were quantitatively synthesized using the Stouffer method of combining P values.

RESULTS

We identified 13,973 articles for screening. Of these, 156 (1.12%) articles were eligible for inclusion, and 29 (18.2%) of the 156 were associated with another article; thus, 127 studies were analyzed. Preliminary evidence for a reliable association between 5 engagement strategies (involving parents in a program's design, delivering a program on the web compared to face-to-face, use of personalization or tailoring features, user control features, and provision of practical support) and greater engagement was found. Three engagement strategies (professional support features, use of videos, and behavior change techniques) were not found to have a reliable association with engagement outcomes.

CONCLUSIONS

This review provides a comprehensive assessment and description of the use of engagement strategies and engagement measures in technology-assisted parenting programs targeting parenting-related ACEs and extends the current evidence with preliminary quantitative findings. Heterogeneous definition and measurement of engagement and insufficient engagement outcome data were caveats to this synthesis. Future research could use integrated definitions and measures of engagement to support robust systematic evaluations of engagement in this context.

TRIAL REGISTRATION

PROSPERO CRD42020209819; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=209819.

Calculating power for multilevel implementation trials in mental health: Meaningful effect sizes, intraclass correlation coefficients, and proportions of variance explained by covariates

Background

Despite the ubiquity of multilevel sampling, design, and analysis in mental health implementation trials, few resources are available that provide reference values of design parameters (e.g., effect size, intraclass correlation coefficient [ICC], and proportion of variance explained by covariates [covariate R 2]) needed to accurately determine sample size. The aim of this study was to provide empirical reference values for these parameters by aggregating data on implementation and clinical outcomes from multilevel implementation trials, including cluster randomized trials and individually randomized repeated measures trials, in mental health. The compendium of design parameters presented here represents plausible values that implementation scientists can use to guide sample size calculations for future trials.

Method

We searched NIH RePORTER for all federally funded, multilevel implementation trials addressing mental health populations and settings from 2010 to 2020. For all continuous and binary implementation and clinical outcomes included in eligible trials, we generated values of effect size, ICC, and covariate R2 at each level via secondary analysis of trial data or via extraction of estimates from analyses in published research reports. Effect sizes were calculated as Cohen d; ICCs were generated via one-way random effects ANOVAs; covariate R2 estimates were calculated using the reduction in variance approach.

Results

Seventeen trials were eligible, reporting on 53 implementation and clinical outcomes and 81 contrasts between implementation conditions. Tables of effect size, ICC, and covariate R2 are provided to guide implementation researchers in power analyses for designing multilevel implementation trials in mental health settings, including two- and three-level cluster randomized designs and unit-randomized repeated-measures designs.

Conclusions

Researchers can use the empirical reference values reported in this study to develop meaningful sample size determinations for multilevel implementation trials in mental health. Discussion focuses on the application of the reference values reported in this study.

Use of technology in evidence-based programs for child maltreatment and its impact on parent and child outcomes

Introduction

Technology has been used in evidence-based child maltreatment (CM) programs for over a decade. Although advancements have been made, the extent of the application of technology in these programs, and its influence on parental and child outcomes, remains unclear within the context of changes that emerged because of the COVID-19 pandemic. This scoping review provides a contextualized overview and summary of the use of technology in evidence-based parenting and child programs serving families impacted by child maltreatment and the effects of technology-enhanced programs on target outcomes.

Materials and methods

Using Arksey and O'Malley's methodological framework, we searched seven databases to identify peer-reviewed and grey literature published in English from 2000 to 2023 on evidence-based programs, according to the California Evidence-Based Clearinghouse (CEBC), that included technological supports for two populations: at-risk parents for child maltreatment prevention, and children and youth 0-18 years exposed to child maltreatment. All study designs were included.

Results

Eight evidence-based parenting programs and one evidence-based child trauma program were identified as using technology across a total of 25 peer-reviewed articles and 2 peer-reviewed abstracts meeting inclusion criteria (n = 19 on parent-level programs; n = 8 on child-level programs). Four studies were published in the context of COVID-19. Two main uses of technology emerged: (1) remote programmatic delivery (i.e., delivering all or part of the program virtually using technology) and (2) programmatic enhancement (i.e., augmenting program content with technology). Improvements across parenting and child mental health and behavioral outcomes were generally observed.

Discussion

Technology use in evidence-based child maltreatment programs is not new; however, the small sample since the start of the COVID-19 pandemic in this review that met inclusion criteria highlight the dearth of research published on the topic. Findings also suggest the need for the inclusion of implementation outcomes related to adoption and engagement, which could inform equitable dissemination and implementation of these programs. Additional considerations for research and practice are discussed.

Evaluating child maltreatment and family violence risk during the COVID-19 Pandemic: Using a telehealth home visiting program as a conduit to families

The COVID-19 pandemic has affected many child maltreatment risk factors and may have affected maltreatment among vulnerable families. We surveyed 258 certified providers of an evidence-based home visiting program, SafeCare, about their perception of the impact of the pandemic on the families they serve. We examined if the providers perceived an overall change in child maltreatment and family violence risk among the families with young children they served and factors that may have contributed to changes. Regressions estimated the relationship between providers' assessment of families' ability to social distance, emotional struggles, and access to public resources/services with providers' perception of child maltreatment and family violence risk in the home. Findings indicate that 87% of providers believed maltreatment risk had increased during the pandemic. Providers serving families who were unable to social distance due to employment were more likely to report increased supervisory neglect and material neglect among the families they serve. Providers reporting that families were struggling with elevated frustration levels also reported more family conflict and material neglect among the families they serve. Results from this research can inform strategic decision-making for policies and programs that address the challenges low-income families with young children face in emergency situations.

Mental health solutions for domestic violence victims amid COVID-19: a review of the literature

BACKGROUND

Due to COVID-19, domestic violence victims face a range of mental health challenges, possibly resulting in substantial human and economic consequences. However, there is a lack of mental health interventions tailored to domestic violence victims and in the context of COVID-19. In this study, we aim to identify interventions that can improve domestic violence victims' mental health amid the COVID-19 pandemic to address the research gap.

MAIN TEXT

Drawing insights from established COVID-19 review frameworks and a comprehensive review of PubMed literature, we obtained information on interventions that can address domestic violence victims' mental health challenges amid COVID-19. We identified practical and timely solutions that can be utilized to address mental health challenges domestic violence victims face amid COVID-19, mainly focusing on (1) decreasing victims' exposure to the abuser and (2) increasing victims' access to mental health services.

CONCLUSION

Domestic violence is a public health crisis that affects all demographics and could result in significant morbidity and mortality. In addition to emphasizing mental health challenges faced by domestic violence victims, multidisciplinary interventions are identified that could provide timely and practical solutions to domestic violence victims amid the pandemic, which range from tailored shelter home strategies, education programs, escape plans, laws and regulations, as well as more technology-based mental health solutions. There is a significant need for more multipronged and multidisciplinary strategies to address domestic violence amid and beyond the pandemic, particularly interventions that could capitalize on the ubiquity and cost-effectiveness of technology-based solutions.

Digital Tools to Support Family-Based Weight Management for Children: Mixed Methods Pilot and Feasibility Study

BACKGROUND

Family-based behavioral therapy is an efficacious approach to deliver weight management counseling to children and their parents. However, most families do not have access to in-person, evidence-based treatment. We previously developed and tested DRIVE (Developing Relationships that Include Values of Eating and Exercise), a home-based parent training program to maintain body weight among children at risk for obesity, with the intent to eventually disseminate it nationally alongside SafeCare, a parent support program that focuses on parent-child interactions. Currently the DRIVE program has only been tested independently of SafeCare. This study created the "mHealth DRIVE" program by further adapting DRIVE to incorporate digital and mobile health tools, including remotely delivered sessions, a wireless scale that enabled a child-tailored weight graph, and a pedometer. Telehealth delivery via mHealth platforms and other digital tools can improve program cost-effectiveness, deliver long-term care, and directly support both families and care providers.

OBJECTIVE

The objective of this study was to examine preliminary acceptability and effectiveness of the mHealth DRIVE program among children and parents who received it and among SafeCare providers who potentially could deliver it.

METHODS

Study 1 was a 13-week pilot study of a remotely delivered mHealth family-based weight management program. Satisfaction surveys were administered, and height and weight were measured pre- and post-study. Study 2 was a feasibility/acceptability survey administered to SafeCare providers.

RESULTS

Parental and child satisfaction (mean of 4.9/6.0 and 3.8/5.0, respectively) were high, and children's (N=10) BMI z-scores significantly decreased (mean -0.14, SD 0.17; P=.025). Over 90% of SafeCare providers (N=74) indicated that SafeCare families would benefit from learning how to eat healthily and be more active, and 80% of providers reported that they and the families would benefit from digital tools to support child weight management.

CONCLUSIONS

Pediatric mHealth weight management interventions show promise for effectiveness and acceptability by families and providers.

TRIAL REGISTRATION

Clinicaltrials.gov NCT03297541, https://clinicaltrials.gov/ct2/show/NCT03297541.

The Impact of COVID-19 on the Delivery of an Evidence-Based Child Maltreatment Prevention Program: Understanding the Perspectives of SafeCare® Providers

Child maltreatment (CM) is a global public health problem. Evidence-based home visiting programs, such as SafeCare®, reduce CM risk, and enhance parent-child relationships and other protective factors. As the result of the COVID-19 pandemic and resulting restrictions, SafeCare Providers transitioned from home to virtual delivery for the SafeCare curriculum. The purpose of this study is to 1) examine active SafeCare Providers' opinions on the feasibility and effectiveness of SafeCare via remote delivery, and 2) better understand workforce concerns for human service professionals within the context of COVID-19 mitigation efforts. Data are from a cross-sectional survey of SafeCare Providers (N = 303) in the United States, Canada, and Australia. The majority of Providers reported they were actively delivering SafeCare virtually and were comfortable with the delivery format. Providers indicated that the majority of SafeCare families are making progress on target skills, and that engagement is high among many families. Some service delivery challenges were reported, ranging from family data plan limitations to difficulty with delivery of specific components of the SafeCare curriculum related to modeling and assessment. The impact of COVID-19 on Providers' daily routines, stress level, and work-life balance has been significant. Remote, virtual delivery of CM prevention programming offers the opportunity to continue serving vulnerable families in the midst of a pandemic. Barriers related to family technology and data access must be addressed to ensure reach and the effective delivery of prevention programming during the pandemic and beyond.

Incorporators, Early Investors, and Learners: a longitudinal study of organizational adaptation during EBP implementation and sustainment

BACKGROUND

The majority of literature on evidence-based practice (EBP) adaptation focuses on changes to clinical practices without explicitly addressing how organizations must adapt to accommodate a new EBP. This study explores the process of organizational-rather than EBP-adaptation during implementation and sustainment. To the authors' knowledge, there are no previous implementation studies that focus on organizational adaptation in this way.

METHODS

This analysis utilizes a case study approach to examine longitudinal qualitative data from 17 community-based organizations (CBOs) in one state and seven county-based child welfare systems. The CBOs had sustained a child-neglect intervention EBP (SafeCare®) for 2 to 10 years. The unit of analysis was the organization, and each CBO represented a case. Organizational-level profiles were created to describe the organizational adaptation process.

RESULTS

Three organizational-level adaptation profiles were identified as follows: incorporators (n = 7), early investors (n = 6), and learners (n = 4). Incorporators adapted by integrating SafeCare into existing operations to meet contractual or EBP fidelity requirements. Early Investors made substantial organizational adaptations during the early implementation period, then operated relatively consistently as the EBP became embedded in the organization and service system. Learners were characterized by steady and continuous attention to new ways that the organization could adapt to support the EBP.

CONCLUSION

The profiles demonstrated that there can be multiple effective paths to EBP sustainment. Organizational adaptation was calibrated to fit a CBO's operations (e.g., size of the program) and immediate environmental constraints (e.g., funding levels). Additionally, organizations fulfilled different functional roles in the network of entities involved in EBP implementation. Knowing organizational roles and adaptation profiles can guide implementation planning and help to structure contract designs that bridge the outer (system) and inner (organizational) contexts. Adaptation profiles can also inform the intensity of the implementation strategy tailoring process and the way that strategies are marketed to organizations.

Future Directions for Research on Early Intervention for Young Children at Risk for Social Anxiety

Anxiety disorders are common among young children, with earlier onset typically associated with greater severity and persistence. A stable behaviorally inhibited (BI) temperament and subsequent shyness and social withdrawal (SW) place children at increased risk of developing anxiety disorders, particularly social anxiety. In this Future Directions article, we briefly review developmental and clinical research and theory that point to parenting and peer interactions as key moderators of both the stability of BI/SW and risk for later anxiety, and we describe existing interventions that address early BI/SW and/or anxiety disorders in young children. We recommend that future research on early intervention to disrupt the trajectory of anxiety in children at risk (a) be informed by both developmental science and clinical research, (b) incorporate multiple levels of analysis (including both individual and contextual factors), (c) examine mediators that move us closer to understanding how and why treatments work, (d) be developed with the end goal of dissemination, (e) examine moderators of outcome toward the goal of treatment efficiency, (f) consider transdiagnostic or modular approaches, (g) integrate technology, and (h) consider cultural norms regarding BI/SW/anxiety and parenting.

Service needs of adolescent parents in child welfare: Is an evidence-based, structured, in-home behavioral parent training protocol effective?

SafeCare is an evidence-based behavioral parent training intervention that has been successfully implemented in multiple state child welfare systems. A statewide implementation in Oklahoma established the effectiveness of SafeCare with a diverse group of parents, which included adolescent parents under 21 years of age, a particularly at-risk group. The current study examined whether SafeCare is also effective for this subsample of 294 adolescent parents with regard to child welfare recidivism, depression and child abuse potential, and attainment of service goals. Post-treatment adolescent parent ratings of program engagement and satisfaction were also examined. Among the subsample of adolescent parents, the SafeCare intervention did not result in significantly improved outcomes in terms of preventing recidivism or reduction in risk factors associated with child abuse and neglect as compared to child welfare services as usual. Further, no significant differences in program engagement and satisfaction between SafeCare and services as usual were detected. These findings shed light on the potential differences in program effectiveness between adolescent and adult parents, and the need for future research to rigorously evaluate the effectiveness of behavioral parenting programs with adolescent parents.

Technology 2.0: A Commentary on Progress, Challenges, and Next Steps

This commentary highlights the importance and promise of the innovative strategies described in the Child Maltreatment special issue on "Technology 2.0: A Focus on the Newest Technological Advances in Child Maltreatment Research." The commentary first highlights the collective advancements reflected in the articles in the special issue, with a primary focus on how the authors' work addresses a general challenge in services research that is perhaps nowhere more problematic than in the field of maltreatment. Next, the commentary extends the discussion of these articles to raise remaining gaps in our knowledge, theory, and methodology, which must be the focus of ongoing research if the true potential of technology as a service delivery vehicle is to be realized. Finally, the commentary concludes with a call for subsequent research which will be inspired by the articles in this special issue.