Evaluation of treatment integrity errors on mand acquisition

Effects of omission and commission errors during tact instruction

The purpose of the current study was to compare the effects of omission and commission errors of reinforcement during tact instruction via telehealth with three children, 6 to 7 years of age, who were diagnosed with an autism spectrum disorder. We used an adapted alternating treatment design to evaluate skill acquisition of target stimuli across high-integrity, commission errors, and omission errors conditions. The high-integrity condition produced mastery criteria in fewer sessions compared with the integrity-error conditions in four of six comparisons, and the omission condition reached mastery criteria in fewer sessions than the commission condition in five of six comparisons.

Peter CC, Feng J, Long BP. Trends in Reporting Procedural Integrity: A Comparison

Procedural integrity refers to the extent to which an independent variable is implemented as described. Measuring procedural integrity is one important factor when considering internal and external validity of experiments. Experimental articles in behavior-analytic journals have rarely reported procedural-integrity data. The purpose of this study was to update previous reviews of whether articles published in the Journal of Applied Behavior Analysis reported procedural integrity, spanning a period from 1980 to 2020, and compare reporting in JABA to recent reviews of studies published in Behavior Analysis in Practice (2008-2019) and the Journal of Organizational Behavior Management (2000-2020). Procedural integrity continues to be underreported across all three journals, but an increasing trend in reporting procedural integrity is evident in the Journal of Applied Behavior Analysis and Behavior Analysis in Practice. In addition to our recommendations and implications for research and practice, we provide examples and resources to assist researchers and practitioners with recording and reporting integrity data.

Comparing Multiple Methods to Measure Procedural Fidelity of Discrete-trial Instruction

Procedural fidelity is the extent to which an intervention is implemented as designed and is an important component of research and practice. There are multiple ways to measure procedural fidelity, and few studies have explored how procedural fidelity varies based on the method of measurement. The current study compared adherence to discrete-trial instruction protocols by behavior technicians with a child with autism when observers used different procedural-fidelity measures. We collected individual-component and individual-trial fidelity with an occurrence-nonoccurrence data sheet and compared these scores to global fidelity and all-or-nothing, 3-point Likert scale, and 5-point Likert scale measurement methods. The all-or-nothing method required all instances of a component or trial be implemented without error to be scored correct. The Likert scales used a rating system to score components and trials. At the component level, we found that the global, 3-point Likert, and 5-point Likert methods were likely to overestimate fidelity and mask component errors, and the all-or-nothing method was unlikely to mask errors. At the trial level, we found that the global and 5-point Likert methods approximated individual-trial fidelity, the 3-point Likert method overestimated fidelity, and the all-or-nothing method underestimated fidelity. The occurrence-nonoccurrence method required the most time to complete, and all-or-nothing by trial required the least. We discuss the implications of measuring procedural fidelity with different methods of measurement, including false positives and false negatives, and provide suggestions for practice and research.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43494-023-00094-w.

Connecting animal trainers and behavior analysts through loopy training

The communities of behavior analysts and animal trainers remain relatively disconnected, despite potentially beneficial links between behavioral principles and the practices of animal training. Describing existing links between research by behavior analysts and practices used by animal trainers may foster connections. In this paper, we describe an approach used by many clicker trainers, referred to as loopy training. Loopy training is a teaching process built around the concept of movement cycles. Interactions between the animal learner and the handler are refined into predictable, cyclical patterns that can be expanded into complex sequences. These sequences include cues, target responses, conditioned reinforcers, and consummatory responses. We link the foundations of loopy training to existing work in the experimental analysis of behavior, compare loopy training to other shaping approaches, and describe areas for future research. We conclude with a series of recommendations for further developing connections between behavior analysts and animal trainers, using loopy training as the foundation for our suggestions.

Assessing Parameters of Reinforcement on Efficiency of Acquisition: A Systematic Review

Discrete-trial training (DTT) is a common method of instruction used in early intervention amongindividuals with autism spectrum disorder and related neurodevelopmental disorders and is an effective method of teaching different skills such as tacting, listener responding, and matching. Delivery of effective reinforcers is a key component of DTT. Although general recommendations have been made for effective reinforcement delivery in DTT, no review has synthesized the available research on the efficiency of various reinforcer parameters on efficiency of acquisition. The current systematic review assessed the efficiency of various reinforcer parameters on acquisition in DTT. Results were idiosyncratic, and a general paucity of repeated measures examining specific reinforcer parameters within and across studies was observed. In general, (1) maintaining high levels of treatment integrity, (2) delivery of tangible (i.e. leisure items) or edible reinforcers in comparison with contingent praise as a reinforcer, and (3) delivery of edible reinforcers in comparison with other topographies of reinforcement were the most successful reinforcer parameter manipulations and always resulted in more efficient skill acquisition. The results of this review provide clinicians with information regarding what reinforcer parameter manipulations may be more or less likely to support efficient acquisition. The present review also provides considerations and makes recommendations for future research.

Training supervisors to provide performance feedback using video modeling with voiceover instructions: A replication

Performance feedback is an effective strategy to improve and maintain therapist performance with implementing interventions. Shuler and Carroll (2019) successfully used video modeling with voiceover instructions (VMVO) to train supervisors to provide accurate performance feedback to a confederate therapist implementing guided compliance. In Study 1, we replicated Shuler and Carroll by using VMVO to train 5 supervisors to provide performance feedback to a confederate therapist on their guided-compliance integrity. Feedback accuracy increased following VMVO and maintained for 1 month. In Study 2, we extended Shuler and Carroll by demonstrating improvements in therapist guided-compliance integrity after they received performance feedback from supervisors from Study 1. The results of the current study support the use of VMVO to teach supervisory skills to behavior analysts.

Training Supervisors to Provide Performance Feedback Using Video Modeling with Voiceover Instructions

Supervisors commonly use feedback to teach staff members to implement behavioral interventions. However, few studies have evaluated methods to teach supervisors to provide effective feedback. We used a multiple-baseline design to evaluate the use of video modeling with voice-over instruction to train 4 supervisors to provide performance feedback to a confederate therapist implementing a guided-compliance procedure. We assessed supervisors' accuracy with implementing 8 feedback component skills during scripted role-plays before and after video modeling. We also assessed the extent to which supervisors' skills generalized when providing feedback to a confederate therapist implementing novel behavioral procedures (i.e., discrete-trial training and mand training) and an actual therapist implementing the guided-compliance procedure with a child with autism. All supervisors mastered the feedback component skills following video modeling. Overall, the results of the current study suggest that video modeling may be an efficacious and efficient method to train supervisors.

Empirical Application of Skinner's Verbal Behavior to Interventions for Children with Autism: A Review

Sundberg and Michael (2011) reviewed the contributions of Skinner's (1957) Verbal Behavior to the treatment of language delays in children with autism spectrum disorder (ASD) and discussed several aspects of interventions, including mand training, intraverbal repertoire development, and the importance of using Skinner's taxonomy of verbal behavior in the clinical context. In this article, we provide an update of Sundberg and Michael's review and expand on some discussion topics. We conducted a systematic review of studies that focused on Skinner's verbal operants in interventions for children with ASD that were published from 2001 to 2017 and discussed the findings in terms of journal source, frequency, and type of verbal operant studied.