Effects of telehealth‐mediated behavioral assessments and interventions on client outcomes: A quality review

Evaluation of telehealth administration of MMPI symptom validity scales

INTRODUCTION

Telehealth assessment (TA) is a quickly emerging practice, offered with increasing frequency across many different clinical contexts. TA is also well-received by most patients, and there are numerous guidelines and training opportunities which can support effective telehealth practice. Although there are extensive recommended practices, these guidelines have rarely been evaluated empirically, particularly on personality measures. While existing research is limited, it does generally support the idea that TA and in-person assessment (IA) produce fairly equitable test scores. The MMPI-3, a recently released and highly popular personality and psychopathology measure has been the subject of several of those experimental or student (non-client) based studies; however, no study to date has evaluated these trends within a clinical sample. This study empirically tests for differences in TA and IA test scores on the MMPI-3 validity scores when following recommended administration procedures.

METHOD

Data were from a retrospective chart review. Veterans (n = 550) who underwent psychological assessment in a Veterans Affairs Medical Center ADHD evaluation clinic were contrasted between in person and telehealth assessment modalities on the MMPI-2-RF and MMPI-3. Groups were compared using t tests, chi square, and base rates.

RESULTS

Results suggest that there were minimal differences in elevation rates or mean scores across modality, supporting the use of TA.

CONCLUSIONS

This study's findings support the use of the MMPI via TA with ADHD evaluations, Veterans, and in neuro/psychological evaluation settings more generally. Observed elevation rates and mean scores of this study were notably different from those seen in other VA service clinics sampled nationally, which is an area of future investigation.

Teaching Requesting to Individuals with Rett Syndrome Using Alternative Augmentative Communication (AAC) Through Caregiver Coaching via Telehealth

Rett syndrome is a severe neurodevelopmental disorder that results in both motor and language skill regression with a wide range of severity in symptom presentation. Communication intervention may be particularly challenging for this population due to the decline in speech, motor skills, and motor planning difficulties that characterize the disorder (Townend et al., 2020), often resulting in the need for augmentative and alternative communication (AAC) technology. Very limited research has evaluated communication interventions for individuals with Rett syndrome and even fewer have targeted expressive communication, an important skill required for improved autonomy and quality of life (Sigafoos et al., 2009; Townend et al., 2020). The current study sought to systematically replicate the Simacek et al. (2017) mand training procedures to teach three girls with Rett Syndrome to use AAC to make requests through caregiver coaching by researchers via telehealth. Results suggest that mand training was successful in increasing AAC use for all three participants. Barriers to intervention for this population and implications of results for future research and clinical practice are discussed.

Parent Implementation of DTT Following Telehealth Instruction

Discrete Trial Training (DTT) is a method of intervention for individuals with Autism Spectrum Disorder (ASD). Applications of DTT require prescribed repetitions of instruction. DTT is typically implemented via trained instructors or teachers. However, prior analysis has demonstrated the potential of parent-implemented DTT. Prior research demonstrated that DTT training can be implemented with a high degree of fidelity using a student teacher population. However, to date, no studies have evaluated the use of a DTT telehealth training with parents of children with ASD. The purpose of this study was to evaluate the feasibility of a remote parent training method to allow parents to implement DTT in home settings. To this end, three parent participants of children diagnosed with ASD were trained to implement DTT through a telehealth modality in a nonconcurrent multiple baseline design. Results suggested efficacy of this method at DTT skills acquisition.

Effects of omission and commission errors during tact instruction

The purpose of the current study was to compare the effects of omission and commission errors of reinforcement during tact instruction via telehealth with three children, 6 to 7 years of age, who were diagnosed with an autism spectrum disorder. We used an adapted alternating treatment design to evaluate skill acquisition of target stimuli across high-integrity, commission errors, and omission errors conditions. The high-integrity condition produced mastery criteria in fewer sessions compared with the integrity-error conditions in four of six comparisons, and the omission condition reached mastery criteria in fewer sessions than the commission condition in five of six comparisons.

Grandparent-Implemented Interventions to Reduce Challenging Behavior of an Adult With Autism: A Pilot Telehealth Case Study

Adults with autism spectrum disorder (ASD) often engage in challenging behavior that requires individualized intervention to remediate. However, access to high-quality services is limited for adults, leaving this population without necessary behavioral healthcare. This study addressed the needs of a 22-year-old man with ASD and intellectual disability (ID) who lived with his grandmother and engaged in tangibly maintained challenging behavior. The interventionist coached his grandmother via telehealth in the implementation of two behavior analytic interventions: signaled multiple schedule arrangement and a modified contingency contract. The effects of the interventions were evaluated using an alternating treatments design with baseline. While both interventions were effective at decreasing challenging behavior when compared to baseline, the signaled multiple schedule arrangement resulted in zero instances of challenging behavior. Both the participant and the grandparent completed post-intervention social validity assessments and reported overall positive satisfaction with the interventions. Practice recommendations are presented.

Outcomes and Acceptability of Telehealth-Based Coaching for Caregivers in Asian Countries

Recent studies evaluating the effectiveness of using telehealth to train caregivers across large geographical distances in the United States and internationally indicate that this modality can increase families' accessibility to evidence-based interventions for problem behavior. In this study, experimenters and interpreters in the United States remotely coached nine caregivers of children with disabilities residing in three countries in Asia to implement functional analyses (FA) and functional communication training (FCT). Five of the nine families were culturally matched to either the experimenter or the interpreter. Problem behavior was reduced to near-zero levels for all but one participant. Furthermore, all caregivers implemented the procedures with high levels of integrity and rated the assessment and treatment as highly acceptable, regardless of cultural matching or use of interpreters. Overall, findings suggest telehealth-based caregiver coaching and caregiver-implemented FA plus FCT is feasible and acceptable in Asia.

TeleRehabilitation of Social-Pragmatic Skills in Children with Autism Spectrum Disorder: A Principal Component Analysis

In many therapeutic settings, remote health services are becoming increasingly a viable strategy for behavior management interventions in children with autism spectrum disorder (ASD). However, there is a paucity of tools for recovering social-pragmatic skills. In this study, we sought to demonstrate the effectiveness of a new online behavioral training, comparing the performance of an ASD group carrying out an online treatment (n°8) with respect to a control group of demographically-/clinically matched ASD children (n°8) engaged in a traditional in-presence intervention (face-to-face). After a 4-month behavioral treatment, the pragmatic skills language (APL test) abilities detected in the experimental group were almost similar to the control group. However, principal component analysis (PCA) demonstrated that the overall improvement in socio-pragmatic skills was higher for ASD children who underwent in-presence training. In fact, dimensions defined by merging APL subscale scores are clearly separated in ASD children who underwent in-presence training with respect to those performing the online approach. Our findings support the effectiveness of remote healthcare systems in managing the social skills of children with ASD, but more approaches and resources are required to enhance remote services.

Effectiveness of a Brief Functional Analysis and Functional Communication Training Conducted Through Telehealth

This study evaluates the effectiveness of a brief functional analysis and functional communication training conducted via telehealth. Three interventionist-child dyads took part in the study including one speech and language pathologist and two school teaching assistants, each working with one child with autism spectrum disorder. Interventionists were trained using didactic training to implement a brief functional analysis as well as synchronous coaching from a BCBA^® to implement functional communication training. A multiple baseline across participants design was utilised to evaluate if interventionists could implement functional communication training to decrease challenging behaviours that included aggression, elopement and disruption. Sessions concluded earlier than planned due to school closures mandated by the COVID-19 outbreak for two of the three participants; however, existing data provide evidence that telehealth is a valid model for enabling clinicians to work in collaboration with school personnel to effectively deliver assessment and intervention procedures remotely via telehealth.

Using Telehealth to Program Generalization of Caregiver Behavior

Stokes and Baer, Journal of Applied Behavior Analysis, 10(2), 349-367 (1977) provided guidelines to assist practitioners with programming for the generalization of behavior change. Despite the suggestions provided in their seminal paper, generalization remains an often overlooked area within behavior analytic research and practice. In addition, few studies have described explicit strategies to program for the generalization of caregiver behaviors that are consistent with interventions to reduce child challenging behavior. In the current discussion, we describe how telehealth provides a potential avenue for practitioners to focus on generalization. Telehealth helps practitioners access behavior-change agents, materials, and contexts that they may not directly contact in educational and clinical environments. Using telehealth to target these areas early on, and throughout treatment for child challenging behavior, may facilitate more rapid treatment success and maintenance. We provide a case example to demonstrate the use of telehealth to program the generalization of a mother's treatment plan implementation to reduce the severe challenging behavior of an adolescent. We report clinically and socially significant outcomes related to caregiver fidelity and challenging behavior reduction.

Effects of an Adapted Telehealth Training Curriculum for Registered Behavior Technicians®

Objectives

We evaluated a telehealth training curriculum to prepare Registered Behavior Technicians® (RBTs®) to conduct caregiver coaching on behavior analytic skills via telehealth.

Methods

A non-concurrent multiple baseline across therapists design was used to evaluate the training procedures delivered by Board Certified Behavior Analysts® (BCBAs®). All therapists (RBTs) worked with one family during the baseline and training phases and an additional session was conducted with a different family during the novelty probe condition to see if therapists were able to perform the newly acquired skills without BCBA support.

Results

Seven therapists who received behavioral skills training on the curriculum reached mastery criteria within three sessions. All RBTs were able to provide caregiver coaching via telehealth with high degrees of fidelity and were able to independently conduct a telehealth session with a new family without support from the BCBA.

Conclusions

Results of the current study provide support for the use of the telehealth training curriculum to prepare RBTs to conduct ABA services via telehealth.

The Efficacy of Using Telehealth to Coach Parents of Children with Autism Spectrum Disorder on How to Use Naturalistic Teaching to Increase Mands, Tacts and Intraverbals

There is a growing body of evidence supporting the use of telehealth to provide parent training in behaviour analytic interventions and researchers have begun to focus on international demonstrations of this model. The current study assessed the efficacy of a training package focused on naturalistic teaching strategies designed to upskill parents of children with autism spectrum disorder and provide them with ready to use strategies to increase social communication behaviours across verbal operants. Two parent-child dyads were trained to increase mand, tact and intraverbals during play. Parents displayed increases in fidelity for each strategy and viewed the training favourably. Both children showed gains across verbal operants, as captured by a multiple baseline across behaviours design.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s10882-022-09859-4.

Utilizing Telehealth to Coach Parents to Implement Trial-Based Functional Analysis and Treatment

The trial-based functional analysis (TBFA) offers several advantages in natural settings, such as time efficiency and ecological validity. Previous studies have successfully trained or coached a variety of professionals and parents to conduct a TBFA utilizing in-person training procedures; however, no study has evaluated the effectiveness of telehealth coach or train others to implement a TBFA. Utilizing telehealth coaching, we coached three mothers of children with autism to conduct a TBFA in their home. The TBFA identified consequences maintaining challenging behavior for all three participants. Based on the results of the TBFA, we developed a functional communication training (FCT) intervention. Experimenters coached the mothers to implement the FCT intervention in their home. All interventions resulted in decreased challenging behavior and increased communication. The results suggest parents are capable of conducting a valid TBFA with telehealth coaching and support.

Towards the development of a curriculum to train behavior analysts to provide services via telehealth

The COVID-19 pandemic has led to a dramatic increase in behavior analysts' use of telehealth services. Nonetheless, no research has evaluated the skills or training needed for therapists to provide these services effectively. The purpose of this study was to develop and evaluate a curriculum for providing high-quality, parent-training telehealth services. Four in-service Board Certified Behavior Analysts® (BCBAs®) who received brief behavioral skills training on this curriculum reached 100% fidelity within four sessions. The skills generalized to a novel family and maintained nearly 1 year after the training. All participants rated the training as highly acceptable and effective. The independent ratings of 4 in-service BCBAs, blinded to the study conditions, also supported the social validity of the outcomes. This curriculum may be considered an initial step towards development of competency for interventionists providing ABA services via telehealth. Further research is warranted as demand for telehealth services continues to grow.

The impact of a telehealth platform on ABA-based parent training targeting social communication in children with autism spectrum disorder

Interventions based upon applied behaviour analysis (ABA) have been shown to be best practice for children with autism spectrum disorder. However, in many parts of the world there is a shortage of appropriately trained behaviour analysts. Telehealth is a potential solution to increasing access to ABA. Our study assessed the use of telehealth to provide parent training in naturalistic teaching strategies designed to increase child communication skills. Five parent child dyads took part in the training, utilising didactic training and synchronous coaching. Parents could be trained to a high level of fidelity and viewed the training favourably. Children showed variable gains in communication and improved positive affect. The project was cost effective in comparison with traditional training models.

Meta-analyses and effect sizes in applied behavior analysis: A review and discussion

For more than four decades, researchers have used meta-analyses to synthesize data from multiple experimental studies often to draw conclusions that are not supported by individual studies. More recently, single-case experimental design (SCED) researchers have adopted meta-analysis techniques to answer research questions with data gleaned from SCED experiments. Meta-analyses enable researchers to answer questions regarding intervention efficacy, generality, and condition boundaries. Here we discuss meta-analysis techniques, the rationale for their adaptation with SCED studies, and current indices used to quantify the effect of SCED data in applied behavior analysis.

Looking at Europe's recent behavioral telehealth practices for children and families impacted by neurodevelopmental disabilities

There is a widespread lack of behavioral professionals available to support children and families affected by neurodevelopmental disabilities. As a result of limited availability, services that can be provided from a distance have developed. Telehealth is a modality that can increase access to services, lessen financial constraints, and support assessments of generalization. Using either synchronous or asynchronous components it can foster evaluation and coaching. Guidelines for usage have surfaced in North America and been integrated into the continent's existing model of behavioral care. However, in Europe where all modalities of behavioral services are fighting to receive funding, frameworks are scarce. Understanding more about telehealth in behavioral care, its various applications throughout Europe, and the local context into which it can be applicable may promote system growth. To support this cause, a scoping review of recent behavioral telehealth practices for children and families impacted by neurodevelopmental disabilities in Europe was undertaken; looking specifically to assess types of studies, their targets and outcomes, telehealth modality components, barriers, and directions for future work. Although few studies surfaced, valuable conclusions can be drawn about the model's empirical validation, creating a groundwork for sustainability, and the need for developing policy and standardized application.