iLookOut for Child Abuse: Conceptual and Practical Considerations in Creating an Online Learning Program to Engage Learners and Promote Behavior Change

Identifying what works for whom: Implementation outcomes following iLookOut, a child abuse identification and referral training program

Introduction

iLookOut, a web-based child abuse training for early childcare professionals (ECPs), has been shown to improve knowledge and attitudes related to correctly identifying and reporting suspected cases of child abuse. The overarching goal of the present study is to examine "what works for whom" for iLookOut in order to identify strategies for optimizing learner outcomes.

Methods

This prospective study enrolled 12,705 ECPs who completed iLookOut (November 2014-December 2018). We used structural equation models to test whether learner demographic and professional characteristics were differentially associated with implementation outcomes (i.e., acceptability and appropriateness) and whether these mediated subsequent indicators of training effectiveness (i.e., gains in knowledge).

Results

Consistent with previous research, individuals with lower baseline knowledge scores showed greater knowledge gains (β = -.57; p < .001). Greater knowledge gains were seen for learners who reported higher acceptability (β = .08; p < .001) or appropriateness (β = .14; p < .001). Implementation outcomes strongly associated with knowledge gains included acceptability for female learners and appropriateness for learners who had not completed high school or had >15 years of experience in childcare settings. Where mediation was found, for the majority of groups, appropriateness emerged as the driving mediator.

Conclusion

Implementation outcomes emerged as important drivers of knowledge change for most groups. The iLookOut Core Training's use of a multimedia learning environment, video-based storylines, and game-based techniques were endorsed by learners and correlated with increases in knowledge. Future work should explore why aspects of the iLookOut training are rated as less acceptable or appropriate by some groups and what changes would improve efficacy for low performing learners.

Integrating Validity Evidence to Revise a Child Abuse Knowledge Test for Early Childhood Education Providers: A Mixed Methods Approach

Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.

Child protection training for professionals to improve reporting of child abuse and neglect

BACKGROUND

Many nations require child-serving professionals to report known or suspected cases of significant child abuse and neglect to statutory child protection or safeguarding authorities. Considered globally, there are millions of professionals who fulfil these roles, and many more who will do so in future. Ensuring they are trained in reporting child abuse and neglect is a key priority for nations and organisations if efforts to address violence against children are to succeed.

OBJECTIVES

To assess the effectiveness of training aimed at improving reporting of child abuse and neglect by professionals and to investigate possible components of effective training interventions.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, 18 other databases, and one trials register up to 4 June 2021. We also handsearched reference lists, selected journals, and websites, and circulated a request for studies to researchers via an email discussion list.

SELECTION CRITERIA

All randomised controlled trials (RCTs), quasi-RCTs, and controlled before-and-after studies examining the effects of training interventions for qualified professionals (e.g. teachers, childcare professionals, doctors, nurses, and mental health professionals) to improve reporting of child abuse and neglect, compared with no training, waitlist control, or alternative training (not related to child abuse and neglect).

DATA COLLECTION AND ANALYSIS

We used methodological procedures described in the Cochrane Handbook for Systematic Reviews of Interventions. We synthesised training effects in meta-analysis where possible and summarised findings for primary outcomes (number of reported cases of child abuse and neglect, quality of reported cases, adverse events) and secondary outcomes (knowledge, skills, and attitudes towards the reporting duty). We used the GRADE approach to rate the certainty of the evidence.

MAIN RESULTS

We included 11 trials (1484 participants), using data from 9 of the 11 trials in quantitative synthesis. Trials took place in high-income countries, including the USA, Canada, and the Netherlands, with qualified professionals. In 8 of the 11 trials, interventions were delivered in face-to-face workshops or seminars, and in 3 trials interventions were delivered as self-paced e-learning modules. Interventions were developed by experts and delivered by specialist facilitators, content area experts, or interdisciplinary teams. Only 3 of the 11 included studies were conducted in the past 10 years. Primary outcomes Three studies measured the number of cases of child abuse and neglect via participants' self-report of actual cases reported, three months after training. The results of one study (42 participants) favoured the intervention over waitlist, but the evidence is very uncertain (standardised mean difference (SMD) 0.81, 95% confidence interval (CI) 0.18 to 1.43; very low-certainty evidence). Three studies measured the number of cases of child abuse and neglect via participants' responses to hypothetical case vignettes immediately after training. A meta-analysis of two studies (87 participants) favoured training over no training or waitlist for training, but the evidence is very uncertain (SMD 1.81, 95% CI 1.30 to 2.32; very low-certainty evidence).  We identified no studies that measured the number of cases of child abuse and neglect via official records of reports made to child protection authorities, or adverse effects of training. Secondary outcomes Four studies measured professionals' knowledge of reporting duty, processes, and procedures postintervention. The results of one study (744 participants) may favour the intervention over waitlist for training (SMD 1.06, 95% CI 0.90 to 1.21; low-certainty evidence). Four studies measured professionals' knowledge of core concepts in all forms of child abuse and neglect postintervention. A meta-analysis of two studies (154 participants) favoured training over no training, but the evidence is very uncertain (SMD 0.68, 95% CI 0.35 to 1.01; very low-certainty evidence). Three studies measured professionals' knowledge of core concepts in child sexual abuse postintervention. A meta-analysis of these three studies (238 participants) favoured training over no training or waitlist for training, but the evidence is very uncertain (SMD 1.44, 95% CI 0.43 to 2.45; very low-certainty evidence). One study (25 participants) measured professionals' skill in distinguishing reportable and non-reportable cases postintervention. The results favoured the intervention over no training, but the evidence is very uncertain (SMD 0.94, 95% CI 0.11 to 1.77; very low-certainty evidence). Two studies measured professionals' attitudes towards the duty to report child abuse and neglect postintervention. The results of one study (741 participants) favoured the intervention over waitlist, but the evidence is very uncertain (SMD 0.61, 95% CI 0.47 to 0.76; very low-certainty evidence).

AUTHORS' CONCLUSIONS

The studies included in this review suggest there may be evidence of improvements in training outcomes for professionals exposed to training compared with those who are not exposed. However, the evidence is very uncertain. We rated the certainty of evidence as low to very low, downgrading due to study design and reporting limitations. Our findings rest on a small number of largely older studies, confined to single professional groups. Whether similar effects would be seen for a wider range of professionals remains unknown. Considering the many professional groups with reporting duties, we strongly recommend further research to assess the effectiveness of training interventions, with a wider range of child-serving professionals. There is a need for larger trials that use appropriate methods for group allocation, and statistical methods to account for the delivery of training to professionals in workplace groups.

Child abuse and neglect: Are future medical doctors prepared?

Diagnosis of child abuse and neglect is a challenging matter: in case of misdiagnosis, the child cannot benefit from an early treatment; erroneous interpretation may generate legal issues. Some studies reported physicians' lack of knowledge in child abuse and neglect. However, it is not clear if the reasons of this lack relay on an insufficient preparation of students during medical school and/or a deficiency in continuing medical education during/after fellowships. For these reasons, the authors of the present manuscript administered a questionnaire to last year medical students to: evaluate the degree of knowledge on this thematic in a medical student sample; understand if the abovementioned lack may be due to insufficient preparation of students during medical school. Study population included 179 students. The 77.7% demonstrated a low knowledge of this thematic, but they showed a high insight of their lack. The authors pointed out that medical school education can represent a weak point in future medical doctor knowledge on child abuse and neglect. It also allowed to identify as study sample's medical students had high awareness of their lacks in this field. In addition, comparison of medical schools from different geographical areas suggested common issues independent of which accreditation system is implemented. Thus - independent of which corrective strategy will be planned - the study highlighted necessity for each medical school to define: its current ability to properly train students in child abuse and neglect; students' awareness of their level of expertise. This can help schools to identify the most suitable correctives.

A randomized control trial of a child abuse mandated reporter training: Knowledge and attitudes

BACKGROUND

Despite being well-positioned to identify maltreatment in the children that they provide care for and being legally required to report suspected child maltreatment, early childhood professionals (ECPs) make a limited proportion of reports to child protective services. It is critical to identify evidence-based interventions to improve the reporting practices of this group of mandated reporters allowing for the better protection of children from maltreatment.

OBJECTIVE

The goal of the present study was to determine if iLookOut, an online child abuse identification and reporting training for ECPs, results in differential gains in knowledge and attitudes towards child abuse and its reporting among ECPs, as compared to an online standard training.

PARTICIPANTS AND SETTING

Both interventions were completed online by participants recruited from licensed child care programs in Southern Maine from October 2017 to January 2020. Eligibility criteria included being at least 18 years of age, English-speaking, and working as paid or volunteer staff at a licensed child care program taking care of children 5 years of age or younger. Of the 1152 enrolled individuals, 1094 provided complete pre- and post-intervention data.

METHODS

A randomized controlled trial comparing iLookOut with an online standard training.

RESULTS

ECPs who completed iLookOut significantly outperformed those who completed Standard mandated reporter training in terms of both knowledge (d=1.09 vs. 0.67) and attitudes (d=0.67 vs. 0.54) relative to pre-test scores.

CONCLUSIONS

iLookOut is a promising candidate for widespread use in meeting the need for evidence-based training on child abuse and its reporting.

COGNITIVE MAPPING FOR ILOOKOUT FOR CHILD ABUSE: AN ONLINE TRAINING PROGRAM FOR EARLY CHILDHOOD PROFESSIONALS

This article delineates the theory and framework for an innovative child abuse training program for mandated reporters called 'iLookOut'. iLookOut is an online learning delivery system that utilizes mastery learning and self-determination theory in the Core Training program, along with spaced retrieval and retrieval practice in a follow-up micro-learning program that reinforces learning from the Core Training. A cognitive mapping model provides the structure for documenting and organizing the learning content in both the Core training and the follow-up micro-learning program. The article provides a conceptual framework for designing and implementing effective and efficient online learning programs.