Indirect effects of fidelity to the family check-up on changes in parenting and early childhood problem behaviors

Engagement Measures in Maltreatment Prevention Studies: A Scoping Review

Prevention services can promote public health by building protective factors and reducing maltreatment risk. Yet, engaging caregivers in prevention services presents a unique set of challenges. Measurement studies are important first steps to increase the knowledge of caregiver engagement in prevention services. The purpose of this scoping review was to investigate how family engagement has been measured and operationalized in the studies of maltreatment prevention/positive parenting programs. The review examined quantitative and mixed methods studies conducted in the U.S., which measured multiple dimensions of client engagement, including behavioral, attitudinal, and relational domains. A total of 88 studies selected from PubMed, CINAHL, ERIC, PsycINFO, Social Work Abstracts, Academic Search Premier, and Web of Science were included in this review. Results indicated that studies examine engagement constructs in all three domains of engagement with a primary focus on behavioral engagement. The attitudinal and relational engagement was mostly assessed through general satisfaction surveys, and a limited number of studies utilized validated measures to assess those constructs. While most studies reported acceptable internal reliabilities, only two studies reported other dimensions of psychometric qualities. Only one validated measure was found, which assessed client perceptions of provider cultural competence. More measurement studies are needed to further incorporate multiple dimensions of engagement into the studies of maltreatment prevention programs, which can inform the effort to develop tailored implementation strategies to fully engage various groups of parents in maltreatment prevention programs.

A Longitudinal Analysis of Trajectories and Predictors of Fidelity Using the SafeCare Parenting Model

Evidence-based practice (EBP) fidelity, understood as the extent to which a program is implemented as the developers intended, is a key implementation variable which likely relates to consumer outcomes. However, studies that track fidelity longitudinally and at large scale are uncommon, and finding reliable predictors of fidelity has proven to be a complex challenge. Further, attitudes toward EBP are a potentially important predictor of fidelity, but results across the literature have been mixed. The purpose of the present study is to use data from the ongoing implementation and dissemination of the SafeCare model to better understand (1) the characteristics of SafeCare implementation fidelity trajectories, and (2) whether individual level factors predict differences in fidelity and fidelity trajectories, especially provider attitudes toward EBP. The analyses reported here include 14,778 observed fidelity sessions by 868 providers in 172 agencies. We use multilevel modeling to examine fidelity, fidelity trajectories over time, and several potential individual-level predictors of fidelity, including demographics, work history, and attitudes toward EBP. We found: (1) that SafeCare fidelity begins high at baseline (93.85% on average); (2) that SafeCare fidelity displays a statistically significant trend of positive linear growth, even among those with less positive attitudes; and (3) that positive attitudes are associated with slightly higher fidelity on average and at baseline, while negative attitudes are associated with slightly lower fidelity on average and at baseline. To our knowledge, this is the largest longitudinal analysis of EBP fidelity in a child welfare program to date, and our findings support the notion that intensive coaching supports which are titrated over time can be sufficient to ensure sustained high fidelity, at least in some cases. Further, these findings indicate that robust training and coaching processes can ensure high fidelity and fidelity growth even among providers with less positive attitudes toward EBP.

Practitioner Review: A core competencies perspective on the evidence-based treatment of child conduct problems

BACKGROUND

The effective treatment of child conduct problems is understood to rely on a range of therapist competencies, yet these have rarely been an explicit focus of research. In this practitioner review, we examine core competencies for the delivery of evidence-based parenting interventions for conduct problems in early-to-middle childhood. These are examined in light of research into the common elements shared by these interventions, literature regarding common challenges in these interventions, and conceptualisations of such competencies in other fields of mental health.

METHODS

We report on the development of a novel consensus-based model of core competencies for evidence-based practice in this field, based on consultation with an international expert panel. This includes competencies as they apply to complex presentations of conduct problems.

RESULTS

Despite considerable variation among widely disseminated programmes in terms of content, format and skills-training practices, there is strong consensus among practitioners regarding core competencies. These relate to three broad domains: (a) generic therapeutic competencies; (b) parenting intervention competencies; (c) specific parenting skills/techniques.

CONCLUSIONS

Practitioners working with conduct problems, particularly complex presentations thereof, require competencies for engaging not only mothers, but fathers and diverse/non-traditional caregivers and other stakeholders, in evidence-based parenting interventions. Moreover, the successful delivery of these interventions necessitates competencies that extend beyond behaviour management and encompass broader aspects of the family system and the wider ecology of the child.

The Association Between Facilitator Competent Adherence and Outcomes in Parenting Programs: a Systematic Review and SWiM Analysis

There is increasing interest about the fidelity with which interventions are implemented because it is theorized that better implementation fidelity by facilitators is associated with better participant outcomes. However, in the parenting program literature, there is mixed evidence on the relationship between implementation fidelity and outcomes. This paper provides a synthesis of the evidence on the relationship between facilitator delivery and outcomes in the parenting program literature. Following PRISMA guidelines, this paper synthesizes the results of a systematic review of studies on parenting programs aiming to reduce violence against children and child behavior problems. Specifically, it examines associations between observational measures of facilitator competent adherence and parent and child outcomes. A meta-analysis was not feasible due to study heterogeneity. As a result, Synthesis Without Meta-Analysis guidelines were followed. Searches in electronic databases, reference searching, forward citation tracking, and expert input identified 9653 articles. After screening using pre-specified criteria, 18 articles were included. The review found that most studies (n = 13) reported a statistically significant positive relationship with at least one parent or child outcome. However, eight studies reported inconsistent findings across outcomes, and four studies found no association with outcomes. The results suggest that better facilitator competent adherence is generally associated with positive parent and child outcomes. However, this finding is weakened by the methodological heterogeneity of included studies and due to the wide variety of ways in which studies conceptualized competent adherence-outcome relationships.

The Case for Assessing and Reporting on Facilitator Fidelity: Introducing the Fidelity of Implementation in Parenting Programs Guideline

The sizeable body of evidence indicating that parenting programs have a positive impact on children and families highlights the potential public health benefits of their implementation on a large scale. Despite evidence and global attention, beyond the highly controlled delivery of parenting programs via randomized trials, little is known about program effectiveness or how to explain the poorer results commonly observed when implemented in community settings. Researchers, practitioners, and policymakers must work together to identify what is needed to spur adoption and sustainment of evidence-based parenting programs in real-world service systems and how to enhance program effectiveness when delivered via these systems. Collecting, analyzing, and using facilitator fidelity data is an important frontier through which researchers and practitioners can contribute. In this commentary, we outline the value of assessing facilitator fidelity and utilizing the data generated from these assessments; describe gaps in research, knowledge, and practice; and recommend directions for research and practice. In making recommendations, we describe a collaborative process to develop a preliminary guideline-the Fidelity of Implementation in Parenting Programs Guideline or FIPP-to use when reporting on facilitator fidelity. Readers are invited to complete an online survey to provide comments and feedback on the first draft of the guideline.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-023-00092-5.

Five-year fidelity assessment of an evidence-based parenting program (GenerationPMTO): inter-rater reliability following international implementation

BACKGROUND

Implementing evidence-based programs in community service settings introduces the challenge of ensuring sustained fidelity to the original program. We employ a fidelity measure based on direct observation of practitioners' competence and adherence to the evidence-based parenting program (EBPP) GenerationPMTO following installation in national and international sites. Fidelity monitoring is crucial, especially when the program purveyor transfers administration of the program to the community as was done in this case. In previous studies, the Fidelity of Implementation rating system (FIMP) was used to evaluate practitioners' fidelity to the GenerationPMTO intervention in six countries following implementation showing high levels of adherence up to 17 years post certification. Other studies showed FIMP to have predictive validity. The present study provides inter-rater reliability data for this fidelity tool across teams of the purveyor, Implementation Sciences International, Inc./ISII, and national and international sites over a five-year period.

METHODS

Data assess inter-rater reliability in terms of percent agreement and intraclass correlation (ICC) for the purveyor's two fidelity teams and the fidelity teams in seven implementation sites.

RESULTS

Results report stable good to excellent levels of inter-rater reliability and ICCs as well as good attendance at fidelity meetings for all fidelity teams.

CONCLUSIONS

This observational method of assessing fidelity post implementation is a promising approach to enable EBPPs to be transferred safely from purveyors to communities while maintaining reliable fidelity to the intervention.

Engagement in a brief preventive parenting intervention during the transition to kindergarten: Effects of parent stress and child behavior concerns

Although school-based preventive parenting interventions have been found to promote children's social-emotional skill development and behavioral functioning, it is important to understand potential barriers to engagement in such programs to ensure that intervention access is equitable and likely to reach those who could most benefit. In the present study, we tested independent and interactive associations between parents' concerns about their child's hyperactivity behavior and their perceived stress in relation to their participation in a preventive parenting intervention, the Family Check-Up (FCU), delivered when children were in kindergarten. Participants were parents of 164 children who were randomized to the intervention group of a randomized controlled trial that took place at five elementary schools. Results indicated that parents who reported higher levels of hyperactivity in their children and high levels of perceived stress were less likely to initially engage in the FCU, but if they did engage, they were more likely to participate more intensively as measured by total treatment time. Parents' motivation to change mediated the association between high parent stress and child hyperactivity in relation to total treatment time. This study has important implications for the use of motivational interviewing strategies to engage parents in school-based, family-centered interventions.

Family-level antecedents of children's patterns of reactivity to interparental conflict: Testing the reformulation of emotional security theory

Guided by emotional security theory, this study examined the family-level antecedents of children's reaction patterns to interparental conflict in a sample of 243 preschool children (M age = 4.60 years; 48% Black; 16% Latinx; 56% girls) and their parents in the Northeastern United States. Behavioral observations of children's responses to interparental conflict over two annual measurement occasions assessed their tendencies to exhibit four patterns of defending against threat: secure (i.e., efficiently address direct threats), mobilizing (i.e., high reactivity to potential threat and social opportunities), dominant (i.e., directly defeat threat), and demobilizing (i.e., reduce salience as a target of hostility). Latent profile analyses of interparental, coparental, and parent characteristics derived from multiple methods at the first wave yielded four profiles corresponding with harmonious, enmeshed, compensatory, and detouring patterns of family-level functioning. Additional analyses revealed that children in harmonious and compensatory family profiles exhibited more secure patterns of reactivity over a 1-year period than children in the enmeshed family profile. In contrast, subsequent mobilizing reactivity was most pronounced for children in the enmeshed family profile. Finally, children in the detouring profile exhibited substantially higher levels of demobilizing reactivity to interparental conflict. Results are discussed in the context of how they inform and refine emotional security theory. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care

Background

Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner.

Methods

In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes.

Results

Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83-1.02 to 0.62-0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81-27.3 to 0.62-19.50, resulting in an approximate average improvement of 18%.

Conclusions

These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented.

Trial registration

NCT03013309 ClinicalTrials.gov.

Study Protocol: Type 1 Hybrid Effectiveness-Implementation Trial of a Behavioral Parent Training Intervention for Parents of Young Children Who Are Deaf or Hard of Hearing

PURPOSE

Children who are deaf or hard of hearing (DHH) and who use hearing aids or cochlear implants are more likely than their peers with typical hearing to exhibit behavior problems. Although multiple evidence-based interventions for child behavior problems exist, they are rarely delivered to children who are DHH, and no rigorous randomized controlled trials have been conducted to determine their effects with this population. This protocol describes a study aiming to test the effectiveness of an evidence-based behavioral parent training intervention adapted for parents of young children who are DHH and simultaneously to assess key implementation outcomes and multilevel contextual factors influencing implementation.

METHOD

The protocol for a Type 1 hybrid effectiveness-implementation trial of a behavioral parent training intervention for parents of young children who are DHH is presented, including details of the study design, participants, assessments, and analyses. Using a stakeholder-engaged, mixed-methods approach, we will test the effects of the intervention versus treatment as usual on parenting behaviors, child behaviors, and a range of secondary effectiveness outcomes, including adherence to using hearing aids and cochlear implants as well as measures of child speech and language. We will assess the acceptability, feasibility, fidelity, and costs of the intervention from the perspectives of peer coaches who deliver the intervention, hearing health care clinicians (including audiologists and speech-language pathologists), and administrators of programs serving young children who are DHH.

CONCLUSIONS

Results of this trial will inform future efforts to close the gap between prevalence of behavioral problems in young children who are DHH and access to and use of evidence-based interventions to prevent and treat them. If effective, this intervention could be widely implemented using strategies informed by the findings of this study to benefit young children who are DHH and followed in hearing health care and their families.

Examining the Relation Between Technical and Global Competence in Two Treatments for Youth Anxiety

Although technical (quality of delivering techniques from a specific treatment) and global (general clinical expertise) competence are believed to be important ingredients of successful psychosocial treatment with youth, there have been few empirical efforts to measure both dimensions. Efforts to understand the role that each competence dimension plays in the process and outcome of youth treatment starts with determining whether the dimensions can be measured separately. This study examined whether scores from measures designed to assess technical and global competence were distinct. Treatment sessions (N = 603) from 38 youths (M age = 9.84 years, SD = 1.65; 60.5% White; 52.6% male) treated for primary anxiety problems within a randomized effectiveness trial were coded. Four coders used observational measures designed to assess technical competence, global competence, protocol adherence, and the alliance. Mean item interrater reliability was .70 (SD = .09) for technical competence and .66 (SD = .05) for global competence. While most components of global competence were distinct from technical competence scores, two components showed redundancy (r > .70). Scores on both competence measures were empirically distinct (r < .70) from scores on measures of protocol adherence and the alliance. Although the measures did not fully distinguish between technical and global competence, our findings do indicate that some components of technical and global competence may provide unique information about competence.

Health behaviour outcomes of a family based intervention for paediatric obesity in primary care: A randomized type II hybrid effectiveness-implementation trial

BACKGROUND

Paediatric obesity is a multifaceted public health problem. Family based behavioural interventions are the recommended approach for the prevention of excess weight gain in children and adolescents, yet few have been tested under "real-world" conditions.

OBJECTIVES

To evaluate the effectiveness of a family based intervention, delivered in coordination with paediatric primary care, on child and family health outcomes.

METHODS

A sample of 240 families with racially and ethnically diverse (86% non-White) and predominantly low-income children (49% female) ages 6 to 12 years (M = 9.5 years) with body mass index (BMI) ≥85th percentile for age and gender were identified in paediatric primary care. Participants were randomized to either the Family Check-Up 4 Health (FCU4Health) program (N = 141) or usual care plus information (N = 99). FCU4Health, an assessment-driven individually tailored intervention designed to preempt excess weight gain by improving parenting skills was delivered for 6 months in clinic, at home and in the community. Child BMI and body fat were assessed using a bioelectrical impedance scale and caregiver-reported health behaviours (eg, diet, physical activity and family health routines) were obtained at baseline, 3, 6 and 12 months.

RESULTS

Change in child BMI and percent body fat did not differ by group assignment. Path analysis indicated significant group differences in child health behaviours at 12 months, mediated by improved family health routines at 6 months.

CONCLUSION

The FCU4Health, delivered in coordination with paediatric primary care, significantly impacted child and family health behaviours that are associated with the development and maintenance of paediatric obesity. BMI did not significantly differ.

Adaptation to family-based treatment for Medicaid-insured youth with anorexia nervosa in publicly-funded settings: Protocol for a mixed methods implementation scale-out pilot study

BACKGROUND

Family-based treatment (FBT) for anorexia nervosa is an evidence-based treatment, but its effectiveness is untested among socioeconomically disadvantaged and racially diverse youth. Adapting FBT may facilitate "scale-out" for Medicaid-insured youth served in publicly-funded settings and potentially improve outcomes for more diverse populations.

METHODS

This mixed methods effectiveness-implementation Hybrid Type 3 pilot study protocol included a planning period in collaboration with the San Francisco Department of Public Health, culminating in a two-day in-person FBT training for 25 therapists in the county, followed by the opportunity to engage in one year of weekly supervision. The training incorporated FBT adaptations intended to improve fit for low-income families within community-based settings. Treatment appropriateness and acceptability will be measured immediately post-training. Following the training, cases referred for FBT will only be assigned to the trained clinicians who voluntarily opted into long-term group supervision. Clinicians treating at least one FBT case during the supervision period will report on implementation, adaptations, and patient weight gain. Finally, semi-structured interviews with clinician participants will be conducted, focused on implementation challenges and facilitators, local treatment adaptations, and overall satisfaction with FBT.

DISCUSSION

Learning about clinician adaptations will advance knowledge about treatment of eating disorders in publicly-funded community clinics, which serve a racially/ethnically and socioeconomically diverse group of youth. This project is designed to accelerate FBT implementation in publicly-funded mental health systems, and inform service improvements for underserved youth with eating disorders.

Using Motivational Interviewing to Improve Parenting Skills and Prevent Problem Behavior During the Transition to Kindergarten

In this study, we examined the efficacy of a version of the Family Check-Up (FCU) adapted for kindergarten school entry with regard to parenting skills during the transition to school. We also examined whether improvements in parenting skills would mediate improvements in parent- and teacher-rated child behavior problems from kindergarten to second grade. The FCU is a motivational interviewing (MI) intervention designed to engage parents in treatment to improve parenting skills. Participants were parents of 365 children enrolled in one of five elementary schools in the Pacific Northwestern United States. Main and indirect effects were tested with structural equation path modeling using an intent-to-treat approach. The FCU was associated with improved change in parenting skills, and changes in parenting skills, in turn, predicted reductions in child behavior problems. Implications for embedding MI in family-centered interventions at kindergarten school entry are discussed. Trial registration: NCT02289092.

Fidelity Assessment Checklist Development for Community Nursing Research in Early Childhood

Nurses play an important role in promoting positive childhood development via early interventions intended to support parenting. Despite recognizing the need to deliver vital parenting programs, monitoring fidelity has largely been ignored. Fidelity refers to the degree to which healthcare programs follow a well-defined set of criteria specifically designed for a particular program model. With increasing demands for early intervention programs to be delivered by non-specialists, rigorous yet pragmatic strategies for maintaining fidelity are needed. This paper describes the step-by-step development and evaluation of a program fidelity measure, using the Attachment and Child Health (ATTACH™) parenting program as an exemplar. The overall quality index for program delivery varied between "very good" to "excellent," with a mean of 4.3/5. Development of checklists like the ATTACH™ fidelity assessment checklist enables the systematic evaluation of program delivery and identification of therapeutic components that enable targeted efforts at improvement. In future, research should examine links between program fidelity and targeted outcomes to ascertain if increased fidelity scores yield more favorable effects of parenting programs.

Therapeutic alliance as a predictor of behavioral outcomes in a relationally focused, family-centered telehealth intervention

This study evaluates therapeutic alliance as a mediator of the relationship between dosage and clinical outcomes for the Family Check-Up (FCU) Online, a telehealth adaptation of an evidence-based parenting intervention for parents of middle school youth. The sample consisted of N = 111 parents with children in middle school who received the FCU Online as part of an ongoing clinical trial. They were randomly assigned to receive telehealth coaching and participated in the intervention and follow-up assessment 12 months later. Data was collected using parent and child questionnaires as well as engagement data collected as part of the online intervention, using both parents and children as reporters of parent behavioral change. Using parent report measures, there was clear support for a mediation model, with parent report of alliance predicting parent self-report ratings of clinical progress (parent behavior change) at 12-month follow-up. However, for the child-report data, there was no clear relationship between dosage or therapeutic alliance with child reports of parenting. Clinical implications and future research directions are discussed.

Effects of the Family Check-Up 4 Health on Parenting and Child Behavioral Health: A Randomized Clinical Trial in Primary Care

The Family Check-Up 4 Health (FCU4Health) is an adaptation of the Family Check-Up (FCU) for delivery in primary care settings. While maintaining the original FCU's focus on parenting and child behavioral health, we added content targeting health behaviors. This study evaluated whether the adapted FCU maintained positive effects on parenting (positive behavior support, limit setting, parental warmth) and child behavioral health (self-regulation, conduct problems, emotional problems). Pediatric (6-12 years) primary care patients with a BMI ≥ 85^th%ile (n = 240) were recruited from primary care clinics in Phoenix. Children were 75% Latino, 49% female, and 73% Medicaid recipients. This type 2 effectiveness-implementation hybrid trial compared families randomized to FCU4Health (n = 141) or usual care (n = 99). FCU4Health was delivered over a period of 6 months. This study focuses on a priori secondary outcomes included parenting and child behavioral health targets of the original FCU, assessed at baseline and 3, 6, and 12 months. Significant improvements were found for the FCU4Health condition, compared to usual care, in parenting from baseline to the 3-month assessment [β = .17 (.01; .32)]. Parenting predicted improvements in child self-regulation at 6-months [β = .17 (.03; .30)], which in turn predicted reductions in conduct problems [β = - .38 (- .51; - .23)] and emotional problems [β = - .24 (- .38; - .09)] at 12 months. Ethnicity and language of delivery (English or Spanish) did not moderate these effects. The FCU4Health can improve parenting and child behavioral health outcomes when delivered in primary care.Trial Registration Trial registration number: NCT03013309 ClinicalTrials.gov.

The Family Check-Up: Ecological Family-Based Assessments in the Context of Potential Child Abuse or Chaotic Home Environments

One percent of all children in the United States are estimated to be abused or neglected each year, equating to about 700,000 children per year. Limited parenting skills are one of the most robust risk factors for child abuse and neglect. The present paper describes the Family Check-Up (FCU), a trauma-informed, strengths-based and comprehensive family management intervention aimed at promoting positive parenting skills, reducing child maladaptive behaviors, and optimizing child and family outcomes. By evaluating various ecological and contextual factors, the FCU targets a range of parenting and child behavior difficulties to prevent child abuse/neglect, while improving long-term child and family outcomes.

Measures of Facilitator Competent Adherence Used in Parenting Programs and Their Psychometric Properties: A Systematic Review

Implementation fidelity is a critical component of intervention science, which aims to understand how interventions unfold in practice to improve outcomes. A key element of fidelity is facilitator competent adherence-the extent to which a program is delivered as prescribed with the specified level of quality. We conducted a two-part systematic review examining these aspects in parenting programs aiming to reduce child behavior problems and maltreatment. Part One reviews measures of facilitator competent adherence and Part Two examines the psychometric properties of the observational measures found. Searches identified 9153 articles from electronic databases, citation tracking, and expert input. After screening using pre-specified criteria, 156 (Part One) and 41 (Part Two) articles remained. In Part One, measure, facilitator, and intervention characteristics were extracted and synthesized from 65 measures. Most measures were observational, used by facilitators and researchers, and employed Likert-scale ratings. In Part Two, evidence on the reliability (internal consistency, inter-rater, intra-rater, test-retest) and validity (content, construct, convergent/divergent, criterion) of 30 observational measures identified from Part One was synthesized and evaluated. An adapted COSMIN checklist was used to assess study and measure quality. We found most studies to be of reasonably high quality. This is the first review to summarize and critically appraise measures of facilitator competent adherence used in the parenting program literature and establish their psychometric properties. The findings underscore the need to advance research on measures of facilitator competent adherence; reliable, valid, and high-quality implementation measures allow for evidence-based decisions regarding the delivery and scale-up of parenting programs. PROSPERO Registration Number: CRD42020167872.

The long-term indirect effect of the early Family Check-Up intervention on adolescent internalizing and externalizing symptoms via inhibitory control

This study examined the long-term effects of a randomized controlled trial of the Family Check-Up (FCU) intervention initiated at age 2 on inhibitory control in middle childhood and adolescent internalizing and externalizing problems. We hypothesized that the FCU would promote higher inhibitory control in middle childhood relative to the control group, which in turn would be associated with lower internalizing and externalizing symptomology at age 14. Participants were 731 families, with half (n = 367) of the families assigned to the FCU intervention. Using an intent-to-treat design, results indicate that the FCU intervention was indirectly associated with both lower internalizing and externalizing symptoms at age 14 via its effect on increased inhibitory control in middle childhood (i.e., ages 8.5-10.5). Findings highlight the potential for interventions initiated in toddlerhood to have long-term impacts on self-regulation processes, which can further reduce the risk for behavioral and emotional difficulties in adolescence.

The Family Check-Up 4 Health: Study protocol of a randomized type II hybrid effectiveness-implementation trial in integrated primary care (the healthy communities 4 healthy students study)

BACKGROUND

Parenting interventions like the Family Check-Up have demonstrated effects on child physical and behavioral health outcomes. However, access to these programs is limited, particularly for populations experiencing health disparities. Primary care settings have become recognized as a potential delivery system in which these programs may be implemented at scale. The purpose of this trial is to test the effectiveness of the Family Check-Up 4 Health (FCU4Health) program, an adaptation of the FCU for primary care, and assess program implementation in an integrated primary care setting.

METHODS

We will conduct a hybrid type 2 effectiveness-implementation trial in partnership with a primary care clinic in a low-income, majority Latino community. Families with 2- to 5-year-old children will be eligible to participate. Families will be randomized to receive the intervention (n = 130) or services as usual (n = 70) and will be assessed annually over three years. Outcomes are informed by the RE-AIM framework (i.e., reach, effectiveness, adoption, implementation, and maintenance). Effectiveness outcomes include child health behaviors (e.g., Dietary Screener Questionnaire), behavioral health (e.g., Strengths and Difficulties Questionnaire), and parenting (e.g., Proactive Parenting). Early stage implementation outcomes are also included (e.g., cost, acceptability, appropriateness, and feasibility). Effectiveness outcomes will be assessed via intent-to-treat (ITT) analyses. Implementation outcomes will be primarily descriptive with comparisons to prior trials of FCU4Health and the original FCU.

PROJECTED OUTCOMES

This trial will provide evidence related to the potential of integrated primary care settings to deliver evidence-based preventive interventions with a dual focus on behavioral and physical health.

Provider Readiness and Adaptations of Competency Drivers During Scale-Up of the Family Check-Up

We used provider (n = 112) data that staff at the agency disseminating the Family Check-Up (FCU; REACH Institute) collected to profile provider diversity in community settings and to examine whether provider profiles are related to implementation fidelity. Prior to FCU training, REACH Institute staff administered the FCU Provider Readiness Assessment (PRA), a provider self-report measure that assesses provider characteristics previously linked with provider uptake of evidence-based interventions. We conducted a latent class analysis using PRA subscale scores as latent class indicators. Results supported four profiles: experienced high readiness (ExHR), experienced low readiness (ExLR), moderate experience (ME), and novice. The ExHR class was higher than all other classes on: (1) personality variables (i.e., agreeableness, conscientiousness, openness, extraversion); (2) evidence-based practice attitudes; (3) work-related enthusiasm and engagement; and (4) their own well-being. The ExHR class was also higher than ExLR and ME classes on clinical flexibility. The ME class was lowest of all classes on conscientiousness, supervision, clinical flexibility, work-related enthusiasm and engagement, and well-being. During the FCU certification process, FCU Consultants rated providers' fidelity to the model. Twenty-three of the 112 providers that completed the PRA also participated in certification. We conducted follow-up regression analyses using fidelity data for these 23 providers to explore associations between probability of class membership and fidelity. The likelihood of being in the ExHR class was related to higher FCU fidelity, whereas the likelihood of being in the ExLR class was related to lower fidelity. We discuss how provider readiness assessment data can be used to guide the adaptation of provider selection, training, and consultation in community settings.

Motivational Interviewing and Caregiver Engagement in the Family Check-Up 4 Health

Motivational interviewing (MI) is a therapeutic style in which a provider elicits client motivation and helps strengthen commitment to change (Miller and Rollnick 2002). The original Family Check-Up (FCU; Dishion and Stormshak 2007)-and the adapted version for improving health behaviors in primary care, the Family Check-Up 4 Health (FCU4Health; Smith et al. 2018a)-are brief, assessment-driven, and family-centered preventive interventions that use MI to improve parent engagement in services to improve parenting and prevent negative child outcomes. This study examines the role of MI in the Raising Healthy Children project, a randomized trial to test the effectiveness of the FCU4Health for the prevention of obesity in pediatric primary care, with data from the 141 families assigned to receive the FCU4Health. Families were eligible for the study if the child was between 5.5 and 12 years of age at the time of identification and had a BMI ≥ 85th percentile for age and gender at the most recent visit to their primary care provider. MI skills at the first session predicted caregiver in-session active engagement, attendance at follow-up parenting sessions, and improvements in motivation to address child health and behavior goals. Baseline characteristics of the family (i.e., child health diagnosis, caregiver baseline depression, motivation, and Spanish language preference) had differential associations with responsiveness and MI skills. This study has implications for program development, provider training, and fidelity monitoring.

Evaluating the efficacy of the Family Check-Up Online: A school-based, eHealth model for the prevention of problem behavior during the middle school years

This study evaluated the efficacy of a family-centered preventive intervention, the Family Check-Up (FCU), delivered as an online, eHealth model to middle school families. To increase accessibility of family-centered prevention in schools, we adapted the evidence-based FCU to an online format, with the goal of providing a model of service delivery that is feasible, given limited staffing and resources in many schools. Building on prior research, we randomly assigned participants to waitlist control (n = 105), FCU Online as a web-based intervention (n = 109), and FCU Online with coaching support (n = 108). We tested the effects of the intervention on multiple outcomes, including parental self-efficacy, child self-regulation, and child behavior, in this registered clinical trial (NCT03060291). Families engaged in the intervention at a high rate (72% completed the FCU assessment) and completed 3-month posttest assessments with good retention (94% retained). Random assignment to the FCU Online with coaching support was associated with reduced emotional problems for children (p = .003, d = -0.32) and improved parental confidence and self-efficacy (p = .018, d = 0.25) when compared with waitlist controls. Risk moderated effects: at-risk youth showed stronger effects than did those with minimal risk. The results have implications for online delivery of family-centered interventions in schools.

Systematic literature review and meta-analysis of the relationship between adherence, competence and outcome in psychotherapy for children and adolescents

The extent to which therapist adherence to guidelines and clinician skill or competence may play a role in the prediction of therapeutic outcomes remains inconclusive. This systematic literature review and meta-analysis considers whether adherence or competence predicts youth outcome in child and adolescent psychotherapy, and whether there are any identifiable factors which moderate the strength or direction of this relationship. A systematic literature search identified 35 studies in 52 papers. The studies contained 29 effect sizes for the relationship between adherence and outcome, while nine effect sizes were extracted for competence, and a further five effects measured a composite of adherence and competence constructs, referred to as fidelity in this report. The meta-analysis indicated a small but significant relationship between therapist adherence and outcome, although the small size of effect suggests that outcomes are likely to be more strongly associated with factors other than adherence. No significant relationship was identified between competence or composite fidelity and outcome. Although variance was observed in effect sizes, no significant moderation by client group, intervention type, or implementation measure informant was identified. Further study is needed to understand the specific circumstances under which adherence and outcome are related.

Family-based prevention of adolescents' co-occurring internalizing/externalizing problems through early childhood parent factors

OBJECTIVE

We evaluated whether initiating the Family Check-Up (FCU) during early childhood prevented a severe form of psychopathology in adolescence-co-occurring internalizing and externalizing problems-and whether effects operated indirectly through early childhood maternal depression and parents' positive behavior support.

METHOD

Participants were drawn from a randomized controlled trial of the FCU (50.2% FCU; 49.5% girls; 46.6% Caucasian, and 27.6% Black; 13.4% Hispanic/Latino). At Ages 2 and 3, mothers self-reported depression, and primary caregivers' (PCs') positive behavior support was coded by trained observers. PCs, alternate caregivers (ACs), and teachers reported on 14-year-olds' problem behaviors. Latent profile analyses (LPAs) identified problem behavior groups for each reporter, which were outcomes in multinomial logistic regressions (PC, n = 672; AC, n = 652; teacher, n = 667).

RESULTS

LPAs identified a low-problem, internalizing-only, externalizing-only, and co-occurring-problem group for each reporter. For PC- and AC-reported outcomes, the FCU predicted a lower likelihood that adolescents belonged to the co-occurring group relative to the low-problem, externalizing-only (p < .05), and internalizing-only (p < .05 for PC, p < 0.10 for AC) groups; these effects operated through maternal depression (p < .05). For teacher-reported outcomes, the FCU predicted a lower likelihood that adolescents belonged to the co-occurring group relative to the low-problem, internalizing-only, and externalizing-only (p < 0.05) groups; effects operated through positive behavior support (p < 0.05).

CONCLUSIONS

Early delivery of the FCU indirectly prevented adolescents' co-occurring internalizing/externalizing problems in both home and school contexts by improving the quality of the early home environment. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Predictors of Participation in the Family Check-Up Program: a Randomized Trial of Yearly Services from Age 2 to 10 Years

A key challenge of community-based prevention programs is engaging families in the context of services settings involving children and families. The Family Check-Up (FCU) program is designed to engage families in parenting support appropriate to their level of need by use of assessment-enhanced motivational interviewing. This study involved families screened for risk who were seeking services at women, infant, and children's offices in three geographical regions (N = 731). Families in the randomized intervention group (N = 367) were offered the FCU yearly, from age 2 through 10. The results of multivariate modeling indicated that caregivers reporting high levels of perceived caregiving stress (i.e., depression, low parenting satisfaction, daily hassles) participated at a higher rate in two critical components (feedback and follow-up support interventions) of the FCU program over the 8-year trial period than caregivers reporting lesser degrees of stress. The implications of these findings are discussed in the context of family-centered programs for the prevention of child behavior problems and directions for future research.

Effectiveness and Efficiency of Observationally Assessing Fidelity to a Family-Centered Child Intervention: A Quasi-Experimental Study

Assessment of fidelity that is effective, efficient, and differentiates from usual practices is critical for effectively implementing evidence-based programs for families. This quasi-experiemntal study sought to determine whether observational ratings of fidelity to the Family Check-Up (FCU) could differentiate between levels of clinician training in the model, and from services as usual, and whether rating segments of sessions could be equivalent to rating complete sessions. Coders rated 75 videotaped sessions-complete and 20-min segments-for fidelity, using a valid and reliable rating system across three groups: (a) highly trained in FCU with universal, routine monitoring; (b) minimally trained in FCU with optional, variable monitoring; and (c) services as usual with no training in the FCU. We hypothesized that certain dimensions of fidelity would differ by training, whereas others would not. The results indicated that, as expected, one dimension of fidelity to the FCU, Conceptually accurate to the FCU, was reliably different between the groups (χ² = 44.63, p < .001). The differences observed were in the expected direction, showing higher scores for therapists with more training. The rating magnitude of session segments largely did not differ from those of complete session ratings; however, interrater reliabilities were low for the segments. Although observational ratings were shown to be sensitive to the degree of training in the FCU on a unique and theoretically critical dimension, observational coding of complete sessions is resource intensive and limits scalability. Additional work is needed to reduce the burden of assessing fidelity to family-centered programs.

George SM, Prado G, Mauricio AM, Chiapa A, Bruening MM, Dishion TJ. The Family Check-Up 4 Health (FCU4Health): Applying Implementation Science Frameworks to the Process of Adapting an Evidence-Based Parenting Program for Prevention of Pediatric Obesity and Excess Weight Gain in Primary Care

Implementation experts have recently argued for a process of "scaling out" evidence-based interventions, programs, and practices (EBPs) to improve reach to new populations and new service delivery systems. A process of planned adaptation is typically required to integrate EBPs into new service delivery systems and address the needs of targeted populations while simultaneously maintaining fidelity to core components. This process-oriented paper describes the application of an implementation science framework and coding system to the adaptation of the Family Check-Up (FCU), for a new clinical target and service delivery system-prevention of obesity and excess weight game in primary care. The original FCU has demonstrated both short- and long-term effects on obesity with underserved families across a wide age range. The advantage of adapting such a program is the existing empirical evidence that the intervention improves the primary mediator of effects on the new target outcome. We offer a guide for determining the levels of evidence to undertake the adaptation of an existing EBP for a new clinical target. In this paper, adaptation included shifting the frame of the intervention from one of risk reduction to health promotion; adding health-specific assessments in the areas of nutrition, physical activity, sleep, and media parenting behaviors; family interaction tasks related to goals for health and health behaviors; and coordinating with community resources for physical health. We discuss the multi-year process of adaptation that began by engaging the FCU developer, community stakeholders, and families, which was then followed by a pilot feasibility study, and continues in an ongoing randomized effectiveness-implementation hybrid trial. The adapted program is called the Family Check-Up 4 Health (FCU4Health). We apply a comprehensive coding system for the adaptation of EBPs to our process and also provide a side-by-side comparison of behavior change techniques for obesity prevention and management used in the original FCU and in the FCU4Health. These provide a rigorous means of classification as well as a common language that can be used when adapting other EBPs for context, content, population, or clinical target. Limitations of such an approach to adaptation and future directions of this work are discussed.

Effects of the Family Check-Up on reducing growth in conduct problems from toddlerhood through school age: An analysis of moderated mediation

OBJECTIVE

The Family Check-Up (FCU) is a preventive intervention found to significantly reduce child conduct problems (CP). This study examined the extent to which parents reported that their child's CP were a problem for them at baseline (baseline CP) as a moderator of FCU effects into middle childhood and moderated mediation models to explore positive parent-child dyadic interaction and maternal depressive symptoms as mediators.

METHOD

Participants included 731 mother-child dyads followed from child ages 2 to 9.5 (49% female; 28% African American, 50% European American, 13% biracial, and 9% other; 13% self-reported as Hispanic), with half assigned to the FCU. Maternal depressive symptoms, observed parent and child behavior (positive dyadic interaction), and CP were assessed annually.

RESULTS

Support was found for baseline CP as a moderator of the FCU, with significant decreases in CP for children in the FCU demonstrating high baseline CP. The following associations did not differ between those with high versus low baseline CP. The FCU significantly increased positive dyadic interaction. Lower maternal depressive symptoms were associated with significantly lower CP.

CONCLUSIONS

Findings add to existing evidence that preventive interventions are effective for high-risk families, and the FCU is especially beneficial for children whose parents report high levels of CP in early childhood. Further, the FCU significantly improved positive dyadic interaction for families of children with both high and low baseline CP. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Addressing Barriers to Recruitment and Retention in the Implementation of Parenting Programs: Lessons Learned for Effective Program Delivery in Rural and Urban Areas

Research has demonstrated the effectiveness of family-based programs for reducing adolescent risk behaviors and promoting adolescent health; however, parent engagement, specifically in terms of recruitment and retention, remains a consistent challenge. Recruitment rates for family-based prevention programs range from 3 to 35%, while, on average, 28% of caregivers drop out before program completion. Thus, engagement of parents in prevention programming is of utmost concern to ensure families and youth benefit from implementation of family-based programs. In this manuscript, two Centers for Disease Control and Prevention-funded projects share their experiences with engagement of parents in violence prevention programs. Problems related to parent engagement are reviewed, as are structural, attitudinal, and interpersonal barriers specific to recruitment and retention. Examples of successful implementation strategies identified across urban and rural sites are also analyzed and lessons learned are provided.

Randomized effectiveness Trial of the Family Check-Up versus Internet-delivered Parent Training (iComet) for Families of Children with Conduct Problems

We investigated the effectiveness of the Family Check-Up (FCU) and an Internet-based parent-training program (iComet), along with moderators and mediators of outcome. Families (N = 231) with a child with conduct problems were randomized to one of the conditions for 10 weeks of treatment. The drop-out rate was significantly higher in the iComet (39%) compared to FCU (23%). At post-treatment, both conditions resulted in significant improvement, based on parent-report, but no significant interaction between time and condition, with the exception of conduct problem subscale of the Strengths and Difficulties Questionnaire, slightly favoring the FCU. Neither child, nor teacher reports indicated any significant changes on any of the investigated variables. At 1-, and 2-years follow-up, the gains from the treatment were maintained in both conditions, with basically no significant time X condition interactions. A significantly larger proportion of children in the FCU recovered at post-treatment with regard to opposition defiant behavior, inattention, and conduct problems, compared to the iComet, but almost none of these differences remained significant at 1-, and 2-years follow-up. None of the moderators (child age, parental income or education, or pre-treatment level of motivation) or mediators (limit setting, and appropriate or harsh parenting) of outcome turned out to be significant.

Facilitators and Barriers in Cross-Country Transport of Evidence-based Preventive Interventions: a Case Study Using the Family Check-Up

This study is a qualitative analysis of facilitators and barriers in the dissemination of Family Check-Up (FCU), a U.S.-developed preventive intervention in Sweden. The FCU is inherently culturally flexible because it was designed to be tailored to each family's needs and context, including cultural norms and values. We present the FCU implementation framework (IF) as a conceptual framework for cross-country transport of the FCU and evidence-based programs (EBP) more generally. The FCU IF draws from implementation science literature and involves specifying barriers and facilitators related to implementation drivers (e.g., competency) at each implementation phase and applying these data to inform phase-specific, readiness-building activities for each driver. In addition to driver-related influences, barriers and facilitators specific to the FCU and the collaborative partnership between the U.S. and Swedish purveyors emerged in the data. The partnership's reliance on a hybrid bottom-up, top-down approach that balanced the Swedish purveyor's autonomy and cultural expertise with guidance from the U.S. purveyor facilitated adaptation of the FCU for Sweden. Relying on previously collected data, we also explored similarities and differences in barriers and facilitators to FCU scale-up in the United States versus Sweden. In general, across drivers, the same barriers and facilitators were salient. This study suggests that dissemination of culturally flexible EBPs guided by a dynamic implementation framework can facilitate cross-country transport of EBPs. This study promotes a culture of prevention by highlighting barriers, facilitators, and readiness-building strategies that influence the cross-cultural transportability of EBPs that prevent the onset and escalation of child problem behavior.

An individually tailored family-centered intervention for pediatric obesity in primary care: study protocol of a randomized type II hybrid effectiveness-implementation trial (Raising Healthy Children study)

BACKGROUND

Pediatric obesity is a multi-faceted public health concern that can lead to cardiovascular diseases, cancers, and early mortality. Small changes in diet, physical activity, or BMI can significantly reduce the possibility of developing cardiometabolic risk factors. Family-based behavioral interventions are an underutilized, evidence-based approach that have been found to significantly prevent excess weight gain and obesity in children and adolescents. Poor program availability, low participation rates, and non-adherence are noted barriers to positive outcomes. Effective interventions for pediatric obesity in primary care are hampered by low family functioning, motivation, and adherence to recommendations.

METHODS

This (type II) hybrid effectiveness-implementation randomized trial tests the Family Check-Up 4 Health (FCU4Health) program, which was designed to target health behavior change in children by improving family management practices and parenting skills, with the goal of preventing obesity and excess weight gain. The FCU4Health is assessment driven to tailor services and increase parent motivation. A sample of 350 families with children aged 6 to 12 years who are identified as overweight or obese (BMI ≥ 85th percentile for age and gender) will be enrolled at three primary care clinics [two Federally Qualified Healthcare Centers (FQHCs) and a children's hospital]. All clinics serve predominantly Medicaid patients and a large ethnic minority population, including Latinos, African Americans, and American Indians who face disparities in obesity, cardiometabolic risk, and access to care. The FCU4Health will be coordinated with usual care, using two different delivery strategies: an embedded approach for the two FQHCs and a referral model for the hospital-based clinic. To assess program effectiveness (BMI, body composition, child health behaviors, parenting, and utilization of support services) and implementation outcomes (such outcomes as acceptability, adoption, feasibility, appropriateness, fidelity, and cost), we use a multi-method and multi-informant assessment strategy including electronic health record data, behavioral observation, questionnaires, interviews, and cost capture methods.

DISCUSSION

This study has the potential to prevent excess weight gain, obesity, and health disparities in children by establishing the effectiveness of the FCU4Health and collecting information critical for healthcare decision makers to support sustainable implementation of family-based programs in primary care.

TRIAL REGISTRATION

NCT03013309 ClinicalTrials.gov.

Using implementation science to guide the integration of evidence-based family interventions into primary care

This article is a demonstration of how an implementation-science (IS) framework can be coupled with the measurement of implementation outcomes to effectively integrate evidence-based family interventions in primary care. The primary care environment presents a number of challenges for successfully integrating such interventions. However, IS methods can improve the prospect of successfully implementing a new intervention while simultaneously and rigorously evaluating the impact on salient outcomes. We used our experiences across 2 pilot trials in which the family check-up (Smith, Montaño, Mauricio, Berkel, & Dishion, 2016), an evidence-based family intervention, was integrated into primary care. In these pilot trials, the exploration, preparation, implementation, and sustainment (EPIS) framework and the Proctor et al. taxonomy of implementation outcomes were used to guide the implementation and evaluate its success. Grounding our presentation in our pilot work offers an illustration of applying the EPIS framework and outcomes measurement to real-world problems and contexts. When embarking on new efforts to integrate behavioral interventions into health-care settings, the application of IS frameworks and measurement strategies can create generalizable knowledge that substantively contributes to a sparse literature. Today, those "in the trenches" who are translating evidence-based interventions to their setting can contribute to the corpus of research in integrated care by using IS methods to plan a new program and evaluate its feasibility, adoption, and reach. (PsycINFO Database Record

Warm Parenting and Effortful Control in Toddlerhood: Independent and Interactive Predictors of School-Age Externalizing Behavior

Externalizing symptoms, such as aggression, impulsivity, and inattention, represent the most common forms of childhood maladjustment (Campbell et al. Development and Psychopathology, 12, 467-488, 2000). Several dimensions of parenting behavior, including overreactive and warm parenting, have been linked to children's conduct problems. However, the majority of these studies involve biologically-related family members, thereby limiting understanding of the role of genetic and/or environmental underpinnings of parenting on child psychopathology. This study extends previous research by exploring associations between overreactive and warm parenting during toddlerhood and school-age externalizing problems, as well as the potential moderating effects of child effortful control (EC) on such associations using a longitudinal adoption design. The sample consisted of 225 adoption-linked families (adoptive parents, adopted child [124 male and 101 female] and birth parent[s]), thereby allowing for a more precise estimate of environmental influences on the association between parenting and child externalizing problems. Adoptive mothers' warm parenting at 27 months predicted lower levels of child externalizing problems at ages 6 and 7. Child EC moderated this association in relation to teacher reports of school-age externalizing problems. Findings corroborate prior research with biological families that was not designed to unpack genetic and environmental influences on associations between parenting and child externalizing problems during childhood, highlighting the important role of parental warmth as an environmental influence.

Factors associated with the implementation of the Familias Unidas intervention in a type 3 translational trial

This study highlights how Familias Unidas, a Hispanic-specific, evidence-based, family centered preventive intervention, progressed from intervention development (type 1 translation; T1) through rigorous evaluation (T2) and examines the role of intervention fidelity-adherence and competence-in a T3 trial. Effects of participant, provider, and organizational variables on direct (observational) and indirect (self-reported) fidelity were examined as were effects of fidelity. Two structural equation models were estimated using data from 367 Hispanic parent-adolescent dyads randomized to Familias Unidas. Facilitator perceptions of parental involvement in schools, school performance grade, and school socioeconomic status predicted indirect adherence ratings, which were positively related to adolescent substance use. Facilitator openness to evidence-based practices was associated with indirect competence ratings, school performance grade and size were associated with direct competence ratings, and direct competence ratings were negatively associated with substance use. Findings highlight unique contributions of direct and indirect fidelity ratings in the implementation of Familias Unidas.

The long-term effectiveness of the Family Check-Up on school-age conduct problems: Moderation by neighborhood deprivation

Several studies suggest that neighborhood deprivation is a unique risk factor in child and adolescent development of problem behavior. We sought to examine whether previously established intervention effects of the Family Check-Up (FCU) on child conduct problems at age 7.5 would persist through age 9.5, and whether neighborhood deprivation would moderate these effects. In addition, we examined whether improvements in parent-child interaction during early childhood associated with the FCU would be related to later reductions in child aggression among families living in the highest risk neighborhoods. Using a multisite cohort of at-risk children identified on the basis of family, child, and socioeconomic risk and randomly assigned to the FCU, intervention effects were found to be moderated by neighborhood deprivation, such that they were only directly present for those living at moderate versus extreme levels of neighborhood deprivation. In addition, improvements in child aggression were evident for children living in extreme neighborhood deprivation when parents improved the quality of their parent-child interaction during the toddler period (i.e., moderated mediation). Implications of the findings are discussed in relation to the possibilities and possible limitations in prevention of early problem behavior for those children living in extreme and moderate levels of poverty.

The Predictive Utility of Early Childhood Disruptive Behaviors for School-Age Social Functioning

Research suggests that school-age children with disruptive behavior (DB) problems frequently demonstrate impaired social skills and experience rejection from peers, which plays a crucial role in the pathway to more serious antisocial behavior. A critical question is which DB problems in early childhood are prognostic of impaired social functioning in school-age children. This study examines the hypothesis that aggression in early childhood will be the more consistent predictor of compromised social functioning than inattentive, hyperactive-impulsive, or oppositional behavior. Participants included an ethnically diverse sample of 725 high-risk children from 3 geographically distinct areas followed from ages 2 to 8.5. Four latent growth models of DB from child ages 2 to 5, and potential interactions between dimensions, were used to predict latent parent and teacher ratings of school-age social dysfunction. Analyses were conducted in a multi-group format to examine potential differences between intervention and control group participants. Results showed that age 2 aggression was the DB problem most consistently associated with both parent- and teacher-rated social dysfunction for both groups. Early starting aggressive behavior may be particularly important for the early identification of children at risk for school-age social difficulties.

Process Evaluation of the Project SHINE Intervention for African American Families: An Integrated Positive Parenting and Peer Monitoring Approach to Health Promotion

This study describes the process evaluation of Project SHINE, a randomized family-based health promotion intervention that integrated parenting and peer monitoring for improving sedentary behavior, physical activity, and diet in African American families. Adolescent-parent dyads (n = 89) were randomized to a 6-week behavioral, positive parenting, and peer monitoring skills intervention or a general health education comparison condition. Process evaluation included observational ratings of fidelity, attendance records, psychosocial measures, and qualitative interviews. Results indicated that the intervention was delivered with high fidelity based on facilitator adherence (>98% of content delivered) and competent use of theoretically based behavior change and positive parenting skills (100% of ratings >3 on a 1-4 scale). Although only 43% of peers attended the "bring a friend" session, overall attendance was high (4.39 ± 1.51 sessions) as was the retention rate (88%). Parents in the intervention condition reported significant improvements in communication related to adolescents' engagement in health behaviors both on their own and with peers. These findings were supported by qualitative themes related to improvements in family communication and connectedness. This study provides an innovative example of how future family-based health promotion trials can expand their process evaluation approaches by assessing theoretically relevant positive parenting variables as part of ongoing monitoring.

An Experimental Study of Procedures to Enhance Ratings of Fidelity to an Evidence-Based Family Intervention

The valid and reliable assessment of fidelity is critical at all stages of intervention research and is particularly germane to interpreting the results of efficacy and implementation trials. Ratings of protocol adherence typically are reliable, but ratings of therapist competence are plagued by low reliability. Because family context and case conceptualization guide the therapist's delivery of interventions, the reliability of fidelity ratings might be improved if the coder is privy to client context in the form of an ecological assessment. We conducted a randomized experiment to test this hypothesis. A subsample of 46 families with 5-year-old children from a multisite randomized trial who participated in the feedback session of the Family Check-Up (FCU) intervention were selected. We randomly assigned FCU feedback sessions to be rated for fidelity to the protocol using the COACH rating system either after the coder reviewed the results of a recent ecological assessment or had not. Inter-rater reliability estimates of fidelity ratings were meaningfully higher for the assessment information condition compared to the no-information condition. Importantly, the reliability of the COACH mean score was found to be statistically significantly higher in the information condition. These findings suggest that the reliability of observational ratings of fidelity, particularly when the competence or quality of delivery is considered, could be improved by providing assessment data to the coders. Our findings might be most applicable to assessment-driven interventions, where assessment data explicitly guides therapist's selection of intervention strategies tailored to the family's context and needs, but they could also apply to other intervention programs and observational coding of context-dependent therapy processes, such as the working alliance.

The trajectory of fidelity in a multiyear trial of the family check-up predicts change in child problem behavior

OBJECTIVE

Therapist fidelity to evidence-based family interventions has consistently been linked to child and family outcomes. However, few studies have evaluated the potential ebb and flow of fidelity of therapists over time. We examined therapist drift in fidelity over 4 years in the context of a Family Check-Up prevention services in early childhood (ages 2-5 years).

METHOD

At age 2, families engaging in Women, Infants, and Children Nutritional Supplement Program services were randomized and offered annual Family Check-Ups. Seventy-nine families with a child in the clinical range of problem behaviors at age 2 years were included in this analysis.

RESULTS

Latent growth modeling revealed a significant linear decline in fidelity over time (M = -0.35, SD = 0.35) and that steeper declines were related to less improvement in caregiver-reported problem behaviors assessed at ages 7.5/8.5 years (b = -.69, p = .003; β = -.95, 95% CI [-2.11, -0.22]).

CONCLUSION

These findings add to the literature concerning the need to continually monitor therapist fidelity to an evidence-based practice over time to optimize family benefits. Limitations and directions for future research are discussed.

Results of a pragmatic effectiveness-implementation hybrid trial of the Family Check-up in community mental health agencies

This study reports the results of a pragmatic effectiveness-implementation hybrid trial of the Family Check-Up (FCU) conducted in three community mental health agencies with 40 participating therapists. Seventy-one families with children between 5 and 17 years of age participated. Intervention fidelity and level of adoption were acceptable; families reported high service satisfaction; and therapists reported high acceptability. Families in the FCU condition experienced significantly reduced youth conduct problems in comparison to usual care and completion of the FCU resulted in larger effects. This study provides promising evidence that implementing the FCU in community mental health agencies has the potential to improve youth behavior outcomes.

Comparison of intervention fidelity between COPE TEEN and an attention-control program in a randomized controlled trial

Fidelity in implementing an intervention is critical to accurately determine and interpret the effects of an intervention. It is important to monitor the manner in which the behavioral intervention is implemented (e.g. adaptations, delivery as intended and dose). Few interventions are implemented with 100% fidelity. In this study, high school health teachers implemented the intervention. To attribute study findings to the intervention, it was vital to know to what degree the intervention was implemented. Therefore, the purposes of this study were to evaluate intervention fidelity and to compare implementation fidelity between the creating opportunities for personal empowerment (COPE) Healthy Lifestyles TEEN (thinking, emotions, exercise, and nutrition) program, the experimental intervention and Healthy Teens, an attention-control intervention, in a randomized controlled trial with 779 adolescents from 11 high schools in the southwest region of the United States. Thirty teachers participated in this study. Findings indicated that the attention-control teachers implemented their intervention with greater fidelity than COPE TEEN teachers. It is possible due to the novel intervention and the teachers' unfamiliarity with cognitive-behavioral skills building, COPE TEEN teachers had less fidelity. It is important to assess novel skill development prior to the commencement of experimental interventions and to provide corrective feedback during the course of implementation.

Preventing weight gain and obesity: indirect effects of the family check-up in early childhood

The early signs of obesity are observable in early childhood. Although the most promising prevention approaches are family-centered, few relevant early prevention programs exist. This study evaluated the effects of an evidence-based, home-visiting intervention, the Family Check-Up (FCU), on the trajectory of children's weight gain. The FCU was designed to prevent the development of behavior problems by improving family management practices; children's weight has not been an explicit target. On the basis of previous research and conceptual models, we hypothesized that intervention effects on parenting practices, specifically caregivers' use of positive behavior support (PBS) strategies in toddlerhood, would mediate improvements in children's weight trajectories. A total of 731 indigent caregiver-child dyads from a multisite randomized intervention trial were examined. Observational assessment of parenting and mealtime behaviors occurred from age 2-5 years. The child's body mass index (BMI) was assessed yearly from age 5-9.5 years. Path analysis with a latent growth model revealed a significant indirect effect of the FCU on the trajectory of BMI in later childhood. Improvements in caregivers' PBS in toddlerhood, which was related to the nutritional quality of the meals caregivers served to the child during the mealtime task, served as the intervening process. Furthermore, findings indicate that the FCU prevents progression to overweight and obese status amongst at-risk children. These study results add to existing evidence that has demonstrated that family-based interventions aimed at improving general family management skills are effective at preventing weight gain. Future directions are discussed.

Family check-up effects across diverse ethnic groups: reducing early-adolescence antisocial behavior by reducing family conflict

Multicultural responsiveness and adaptation have been a recent area of emphasis in prevention and intervention science. The changing demographics of the United States demand the development of intervention strategies that are acceptable and effective for diverse cultural and ethnic groups. The Family Check-Up (FCU) was developed to be an intervention framework that is flexible and adaptive to diverse cultural groups (Dishion & Stormshak, 2007 ). We empirically evaluated the extent to which the intervention is effective for improving youth adjustment and parent-child interactions for diverse cultural groups. A sample of 1,193 families was drawn from 2 large-scale randomized prevention trials conducted in diverse urban middle schools. We formulated 3 groups on the basis of youth self-identification of ethnicity (European American, African American, Hispanic) and examined group differences in the hypothesized mediating effect of family conflict (FC) on later antisocial behavior (ASB). Path analysis revealed that youths in the intervention condition reported significantly less ASB over a 2-year period (Grades 6-8). Moreover, youth-reported reductions in FC at 12 months were an intervening effect. Ethnicity did not moderate this relationship. Consistent with one of the primary tenets of coercion theory, participation in the FCU acts on ASB through FC across diverse ethnic groups, lending support to the multicultural competence of the model. Limitations of this study are discussed, along with areas for future research.

Coercive family process and early-onset conduct problems from age 2 to school entry

The emergence and persistence of conduct problems (CPs) during early childhood is a robust predictor of behavior problems in school and of future maladaptation. In this study we examined the reciprocal influences between observed coercive interactions between children and caregivers, oppositional and aggressive behavior, and growth in parent report of early childhood (ages 2-5) and school-age CPs (ages 7.5 and 8.5). Participants were drawn from the Early Steps multisite randomized prevention trial that includes an ethnically diverse sample of male and female children and their families (N = 731). A parallel-process growth model combining latent trajectory and cross-lagged approaches revealed the amplifying effect of observed coercive caregiver-child interactions on children's noncompliance, whereas child oppositional and aggressive behaviors did not consistently predict increased coercion. The slope and initial levels of child oppositional and aggressive behaviors and the stability of caregiver-child coercion were predictive of teacher-reported oppositional behavior at school age. Families assigned to the Family Check-Up condition had significantly steeper declines in child oppositional and aggressive behavior and moderate reductions in oppositional behavior in school and in coercion at age 3. Results were not moderated by child gender, race/ethnicity, or assignment to the intervention condition. The implications of these findings are discussed with respect to understanding the early development of CPs and to designing optimal strategies for reducing problem behavior in early childhood with families most in need.

Early-starting conduct problems: intersection of conduct problems and poverty

The current article reviews extant literature on the intersection between poverty and the development of conduct problems (CP) in early childhood. Associations between exposure to poverty and disruptive behavior are reviewed through the framework of models emphasizing how the stressors associated with poverty indirectly influence child CP by compromising parent psychological resources, investments in children's welfare, and/or caregiving quality. We expand on the best-studied model, the family stress model, by emphasizing the mediating contribution of parent psychological resources on children's risk for early CP, in addition to the mediating effects of parenting. Specifically, we focus on the contribution of maternal depression, in terms of both compromising parenting quality and exposing children to higher levels of stressful events and contexts. Implications of the adapted family stress model are then discussed in terms of its implications for the prevention and treatment of young children's emerging CP.