Single-case intervention research design standards: Additional proposed upgrades and future directions

Befriending, Loneliness, and Quality of Life of Older Adults: A Pilot Evaluation Study

OBJECTIVES

An aggregated interventional N-of-1 or single-case design was used to assess the impact of a befriending intervention on a) health-related quality of life (HR-QoL), and b) the association between loneliness on HR-QoL among older adults.

METHODS

Participants were n = 33 new users of the service, aged 60 + . Outcomes were measured at 13 timepoints across 26 weeks, and data were analyzed using generalized additive modeling (GAM) with a subset of data analyzed using supplementary visual analysis.

RESULTS

Results indicate that the befriending service may reduce decline of HR-QoL (i.e. HR-QoL declined in the baseline phase over time: edf = 3.893, F = 3.0, p = .002, while in the treatment phase, HR-QoL remained more stable: edf = 5.98, F = 2.98, p = .008). The intervention also suppressed the impact of loneliness on HR-QoL.

CONCLUSIONS

Befriending interventions may prevent declines in HR-QoL, and may moderate the impact of loneliness on HR-QoL.

CLINICAL IMPLICATIONS

Our preliminary findings suggest that befriending services may be useful if clinicians have concerns about the health impacts of loneliness for older people. It is difficult to evaluate community-based services, and we consider the challenges we faced, with a view to assisting others planning similar evaluations.

Guidelines for evaluating and reporting social isolation and loneliness interventions

Given the unpleasant nature of social isolation and loneliness (SIL) and their negative effects on health and wellbeing, interventions are needed. However, persistent issues in the design, evaluation, and reporting of SIL interventions preclude conclusive evidence and commentary on the effectiveness of SIL interventions. Here, we propose guidelines for evaluating SIL interventions, firstly by operationalising them into two categories: (1) interventions aiming to reduce SIL as a primary outcome and (2) interventions aiming to improve non-SIL outcomes in the lives of individuals experiencing SIL. Secondly, we evaluate instruments for measuring SIL and research designs for studying intervention effectiveness. Thirdly, guidelines for reporting information about the intervention, study design, results, and discussion in SIL intervention studies are presented. These guidelines will help researchers to better and more consistently report on SIL interventions and improve comparability of SIL interventions, ultimately contributing to the improvement of interventions and to the mitigation of SIL.

The role of single case experimental designs in evidence creation in rehabilitation

Randomized controlled trials (RCTs) are considered the gold standard of evidence guiding intervention selection in rehabilitation. However, conduct of sufficiently powered RCTs in rehabilitation can be expensive, pose ethical and attrition concerns when participants are assigned to ineffective treatment as usual conditions, and are infeasible with low-incidence populations. Single-case experimental designs (SCEDs), including N-of-1 RCTs are causal inference studies for small numbers of participants and not necessarily one participant as the name implies. These designs are increasingly used to evaluate the effectiveness of rehabilitation interventions in diverse clinical settings and employ design features including but not limited to randomization and each participant serving as their own control. These and other internal validity enhancements can increase the confidence in study results coming from these designs. This manuscript discusses the expanded application of SCEDs in rehabilitation contexts to answer everyday clinical rehabilitation research questions with emphasis on strategies to use: 1) to maximize internal validity of this family of designs; 2) improve utility, effectiveness, and acceptability of these designs for rehabilitation end-users (clinicians, policymakers, and participants); 3) build evidence bases in areas of rehabilitation where RCTs are uncommonly used. Primary considerations for situating SCEDs within the continuum of experimental designs include increasing internal validity within designs, improving transparency in conduct and reporting of these studies, and increasing access to advanced research methods training for rehabilitation professionals.

Positive effects of tactile massage for adolescents with Attention Deficit/Hyperactivity Disorder (ADHD) - A small scale study

BACKGROUND AND PURPOSE

Epidemiological studies show the prevalence of attention deficit hyperactivity disorder (ADHD) in adolescents is around 5 %. There is strong evidence for psychosocial interventions and medication for treatment of ADHD core symptoms, but these alone do not always reach a satisfactory outcome. The aim of this small-scale study was to evaluate the impact of tactile massage on ADHD core symptoms in adolescents in a clinical setting. Secondary outcome measures addressed pain perception, ability to fall asleep, and stress levels before, during, and after the intervention.

MATERIALS AND METHODS

Fourteen adolescents aged 15-17 and previously diagnosed with ADHD received tactile massage sessions in an experimental, single-subject ABA study combined with a group-based evaluation using descriptive statistics. The adolescents and their parents answered questionnaires to follow up on the primary and secondary outcomes.

RESULTS

The results showed a statistically significant reduction in hyperactivity/impulsivity and inattention, as well as oppositional defiant disorder (ODD). Participants reported that it was significantly easier to fall asleep. There was also a tendency to perceive less pain, but these results were not statistically significant. The compliance in this study was excellent.

CONCLUSION

In this study, tactile massage appears to have had a significantly positive impact on ADHD core symptoms and the ability to fall asleep. The absence of adverse physiological changes and the excellent compliance, coupled with positive results, supports the idea that tactile massage may be considered safe and beneficial for adolescents with ADHD. Our findings need to be further investigated in future research.

Extensions of open science for applied behavior analysis: Preregistration for single-case experimental designs

Open science practices are designed to enhance the utility, integrity, and credibility of scientific research. This article highlights how preregistration in open science practice can be leveraged to enhance the rigor and transparency of single-case experimental designs within an applied behavior analysis framework. We provide an overview of the benefits of preregistration including increased transparency, reduced risk of researcher bias, and improved replicability, and we review the specific contexts under which these practices most benefit the proposed framework. We discuss potential concerns with and unique considerations for preregistering experiments that use single-case designs, with practical guidance for researchers who are seeking to preregister their studies. We present a checklist as a tool for researchers in applied behavior analysis to use for preregistration and provide recommendations for our field to strengthen the contingencies for open science practices that include preregistration.

Type I error rates and power of two randomization test procedures for the changing criterion design

Single-case experimental design (SCED) data can be analyzed following different approaches. One of the first historically proposed options is randomizations tests, benefiting from the inclusion of randomization in the design: a desirable methodological feature. Randomization tests have become more feasible with the availability of computational resources, and such tests have been proposed for all major types of SCEDs: multiple-baseline, reversal/withdrawal, alternating treatments, and changing criterion designs. The focus of the current text is on the last of these, given that they have not been the subject of any previous simulation study. Specifically, we estimate type I error rates and statistical power for two different randomization procedures applicable to changing criterion designs: the phase change moment randomization and the blocked alternating criterion randomization. We include different series lengths, number of phases, levels of autocorrelation, and random variability. The results suggest that type I error rates are generally controlled and that sufficient power can be achieved with as few as 28-30 measurements for independent data, although more measurements are needed in case of positive autocorrelation. The presence of a reversal to a previous criterion level is beneficial. R code is provided for carrying out randomization tests following the two randomization procedures.

The effects of adding attention training to naming treatment for individuals with aphasia

AIM

Given the ever-increasing evidence for the co-occurrence of attention impairments and language disorders in chronic aphasia, this study aimed to compare the effects of two naming treatment programs, one with and one without attention training components, on the naming performance of participants with aphasia.

MATERIALS AND METHODS

This was a single-subject crossover study in which six people with chronic aphasia and different degrees of naming and attention impairments participated. Two treatment programs were implemented for each participant, with the sequence of the treatments with crossover design. Each program consisted of 12 treatment sessions plus pre- and post-treatment assessment sessions (15 weeks for each participant). The visual analysis and WEighted STatistics methods were employed for data analysis.

RESULTS

Based on visual analysis, both treatments improved in comparison to the baseline phase. Statistical analysis revealed that the number of participants with significant naming improvement following combined program (5 participants) was larger than the number of participants showing improvement following completion of the single, program.

CONCLUSION

Although integrating attention training into a conventional treatment for anomia can increase the effect of treatment on naming ability, more studies are required to clarify the role of attention in remediating naming impairments in aphasia.