Curbing Our Enthusiasm: An Analysis of the Check-In/Check-Out Literature Using the Council for Exceptional Children's Evidence-Based Practice Standards

A Comparison of Single-Case Effect Measures Using Check-In Check-Out Data

There are numerous effect measures researchers can select when conducting a meta-analysis of single-case experimental design research. These effect measures model different characteristics of the data, so it is possible that a researcher's choice of an effect measure could lead to different conclusions about the same intervention. The current study investigated the impact of effect measure selection on conclusions about the effectiveness of check-in check-out (CICO), a commonly used intervention within School-Wide Positive Behavior Interventions and Supports. Using a multilevel meta-analysis of seven different effect measures across 95 cases in 22 studies, findings suggested that all effect measures indicated statistically significant results of CICO in improving student behavior. However, the magnitude of the effects varied when comparing the results to interpretive guidelines, suggesting that the selection of effect measures may impact conclusions regarding the extent to which an intervention is effective. Implications, limitations, and future directions are discussed.

Distilling Check-in/Check-Out into Its Core Practice Elements Through an Expert Consensus Process

Check-in/Check-out (CICO) is a widely implemented evidence-based program for supporting students with at-risk levels of social and emotional behavior concerns. It is comprised of several core features described in the previous literature, including practice elements, which are the specific actions that are delivered directly to students, and implementation components, which are actions that support the implementation by adults. Practice elements and implementation components are both important to implementation but have been combined and conflated in descriptions of CICO implementation. Well-defined and differentiated practice elements could provide improved clarity in communicating implementation expectations to front-line implementers as well as support future research into essential active ingredients and measures of front-line intervention fidelity. The purpose of the present study was to distill, differentiate, and operationally define the student-facing practice elements of CICO. A panel of research experts and practice experts participated in a three-round modified e-Delphi process that led to the identification and operational definition of 19 discreet practice elements organized into five domains. Results are discussed in terms in implications for future development of measures of commitment and intervention fidelity, future research into active ingredients of CICO, and in terms of how well-defined practice elements can improve communication of implementation expectations for front-line implementers of CICO such as teachers.

A Systematic Review and Quality Appraisal of Applications of Direct Instruction with Children with Autism Spectrum Disorder

Developed by Siegfried ("Zig") Engelmann and colleagues, direct instruction (DI) has been recognized as an effective and replicable teaching model for decades. Although rooted in many principles of learning that behavior analysts utilize in daily practice, DI is not a common a component of behavior analytic services for learners with autism spectrum disorder (ASD). This may be attributed to behavior analysts' unfamiliarity with research evaluating the efficacy of DI with learners with ASD. This article synthesizes findings across studies evaluating DI with learners with ASD. The review addresses the contributions of the studies to date and identifies additional areas of research that may lead to more learners with ASD benefitting from DI.