Protocol for the Process Evaluation of the Online Remote Behavioural Intervention for Tics (ORBIT) randomized controlled trial for children and young people

Online remote behavioural intervention for tics in 9- to 17-year-olds: the ORBIT RCT with embedded process and economic evaluation

Background

Behavioural therapy for tics is difficult to access, and little is known about its effectiveness when delivered online.

Objective

To investigate the clinical and cost-effectiveness of an online-delivered, therapist- and parent-supported therapy for young people with tic disorders.

Design

Single-blind, parallel-group, randomised controlled trial, with 3-month (primary end point) and 6-month post-randomisation follow-up. Participants were individually randomised (1 : 1), using on online system, with block randomisations, stratified by site. Naturalistic follow-up was conducted at 12 and 18 months post-randomisation when participants were free to access non-trial interventions. A subset of participants participated in a process evaluation.

Setting

Two hospitals (London and Nottingham) in England also accepting referrals from patient identification centres and online self-referrals.

Participants

Children aged 9-17 years (1) with Tourette syndrome or chronic tic disorder, (2) with a Yale Global Tic Severity Scale-total tic severity score of 15 or more (or > 10 with only motor or vocal tics) and (3) having not received behavioural therapy for tics in the past 12 months or started/stopped medication for tics within the past 2 months.

Interventions

Either 10 weeks of online, remotely delivered, therapist-supported exposure and response prevention therapy (intervention group) or online psychoeducation (control).

Outcome

Primary outcome: Yale Global Tic Severity Scale-total tic severity score 3 months post-randomisation; analysis done in all randomised patients for whom data were available. Secondary outcomes included low mood, anxiety, treatment satisfaction and health resource use. Quality-adjusted life-years are derived from parent-completed quality-of-life measures. All trial staff, statisticians and the chief investigator were masked to group allocation.

Results

Two hundred and twenty-four participants were randomised to the intervention (n = 112) or control (n = 112) group. Participants were mostly male (n = 177; 79%), with a mean age of 12 years. At 3 months the estimated mean difference in Yale Global Tic Severity Scale-total tic severity score between the groups adjusted for baseline and site was -2.29 points (95% confidence interval -3.86 to -0.71) in favour of therapy (effect size -0.31, 95% confidence interval -0.52 to -0.10). This effect was sustained throughout to the final follow-up at 18 months (-2.01 points, 95% confidence interval -3.86 to -0.15; effect size -0.27, 95% confidence interval -0.52 to -0.02). At 18 months the mean incremental cost per participant of the intervention compared to the control was £662 (95% confidence interval -£59 to £1384), with a mean incremental quality-adjusted life-year of 0.040 (95% confidence interval -0.004 to 0.083) per participant. The mean incremental cost per quality-adjusted life-year gained was £16,708. The intervention was acceptable and delivered with high fidelity. Parental engagement predicted child engagement and more positive clinical outcomes.

Harms

Two serious, unrelated adverse events occurred in the control group.

Limitations

We cannot separate the effects of digital online delivery and the therapy itself. The sample was predominately white and British, limiting generalisability. The design did not compare to face-to-face services.

Conclusion

Online, therapist-supported behavioural therapy for young people with tic disorders is clinically and cost-effective in reducing tics, with durable benefits extending up to 18 months.

Future work

Future work should compare online to face-to-face therapy and explore how to embed the intervention in clinical practice.

Trial registration

This trial is registered as ISRCTN70758207; ClinicalTrials.gov (NCT03483493). The trial is now complete.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Health and Technology Assessment programme (project number 16/19/02) and will be published in full in Health and Technology Assessment; Vol. 27, No. 18. See the NIHR Journals Library website for further project information.

A Randomized Controlled Trial Comparing Videoconference vs. Face-to-Face Delivery of Behavior Therapy for Youths With Tourette Syndrome in the Time of COVID-19

OBJECTIVE

To evaluate the clinical effectiveness of online remote behavior therapy, compared with face-to-face therapy in reducing tics and co-occurring disorders associated with the tics in a sample of youths with Tourette Syndrome.

DESIGN

A randomized controlled trial. TS patients were randomized to receive face-to-face or online remote behavior therapy.

PARTICIPANTS

40 children aged between 9 and 16 years affected by Tourette Syndrome.

RESULTS

Online remote and face-to-face behavior therapy are equally effective in the treatment of tics and co-occurring disorders in children and adolescents affected by Tourette Syndrome. Both groups showed an improvement in the severity of tics, obsessive-compulsive symptoms, and anxiety symptoms, as assessed by neuropsychological findings. Online remote behavior therapy was more effective for reducing depressive symptoms than face-to-face behavior therapy.

CONCLUSIONS

Online remote behavior therapy is a promising tool for behavioral therapies for patients with Tourette Syndrome and may represents an alternative treatment option.

Process research: compare and contrast the recovery-orientated strengths model of case management and usual community mental health care

BACKGROUND

The strengths model of case management (SMCM), which was developed by Rapp and Goscha through collaborative efforts at the University of Kansas, assists individuals with mental illness in their recovery by mobilizing individual and environmental resources. Increasing evidence has shown that the utilization of the SMCM improves outcomes, including increased employment/educational attainment, reduced hospitalization rates, higher self-efficacy, and hope. However, little is known about the processes through which the SMCM improves outcomes for mental health service users. This study explores the views of case workers and service users on their experience of providing or receiving the SMCM intervention.

METHODS

A qualitative design was employed using individual interviews with service users and case workers drawn from two study conditions: the SMCM group and the control group (treatment as usual). For both study conditions, service users were recruited by either centres-in-charge or case workers from integrated community centres for mental wellness (ICCMWs) operated by three non-governmental organizations (NGOs) in different districts of Hong Kong. Through purposeful sampling, 24 service users and 14 case workers from the SMCM and control groups joined the study. We used an inductive approach to analyse the qualitative data.

RESULTS

We identified two overarching themes: service users' and case workers' (1) perceptions of the impacts of the interventions (SMCM and control group) and (2) experiences of the interventions, such as features of the interventions and the factors that facilitated the outcomes. The results showed that there were improvements in the functional recovery of the SMCM group in areas such as employment and family relationships, how self-identified goals were achieved, and how service users gained a better understanding of their own strengths and weaknesses. Regarding their experience of the interventions, participants in both the SMCM group and the control group reported that a good relationship between service users and case workers was vital. However, some concerns were raised about the use of SMCM tools, including the strengths assessment and the personal recovery plan (PRP) and the risk of case workers being subjective in the presentation of cases in group supervision sessions.

CONCLUSION

The results were promising in terms of supporting the use of the SMCM, with some refinements, in mental health services for Chinese clients.

TRIAL REGISTRATION

The Australian New Zealand Clinical Trials Registry (ANZCTR), ACTRN12617001435370 , registered on 10/10/2017.

Efficacy and cost-effectiveness of therapist-guided internet-delivered behaviour therapy for children and adolescents with Tourette syndrome: study protocol for a single-blind randomised controlled trial

Background

Treatment guidelines recommend behaviour therapy (BT) for patients with Tourette syndrome (TS) and chronic tic disorder (CTD). However, BT is rarely accessible due to limited availability of trained therapists and long travel distances to specialist clinics. Internet-delivered BT has the potential of overcoming these barriers through remote delivery of treatment with minimal therapist support. In the current protocol, we outline the design and methods of a randomised controlled trial (RCT) evaluating an internet-delivered BT programme referred to as BIP TIC. The trial’s primary objective is to determine the clinical efficacy of BIP TIC for reducing tic severity in young people with TS/CTD, compared with an active control intervention. Secondary objectives are to investigate the 12-month durability of the treatment effects and to perform a health economic evaluation of the intervention.

Methods

In this single-blind superiority RCT, 220 participants (9–17 years) with TS/CTD throughout Sweden will be randomised to 10–12 weeks of either therapist-supported internet-delivered BT based on exposure with response prevention (BIP TIC) or therapist-supported internet-delivered education. Data will be collected at baseline, 3 and 5 weeks into the treatment, at post-treatment, and 3, 6, and 12 months post-treatment. The primary endpoint is the 3-month follow-up. The primary outcome is tic severity as measured by the Yale Global Tic Severity Scale – Total Tic Severity Score. Treatment response is operationalised as scores of “Very much improved” or “Much improved” on the Clinical Global Impression – Improvement scale, administered at the primary endpoint. Outcome assessors will be blind to treatment condition at all assessment points. A health economic evaluation of BIP TIC will be performed, both in the short term (primary endpoint) and the long term (12-month follow-up). There are no planned interim analyses.

Discussion

Participant recruitment started on 26 April 2019 and finished on 9 April 2021. The total number of included participants was 221. The final participant is expected to reach the primary endpoint in September 2021 and the 12-month follow-up in June 2022. Data analysis for the primary objective will commence after the last participant reaches the primary endpoint.

Trial registration

ClinicalTrials.gov NCT03916055. Registered on 16 April 2019.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05592-z.

Fidelity of Delivery and Contextual Factors Influencing Children's Level of Engagement: Process Evaluation of the Online Remote Behavioral Intervention for Tics Trial

Background

The Online Remote Behavioral Intervention for Tics (ORBIT) study was a multicenter randomized controlled trial of a complex intervention that consisted of a web-based behavioral intervention for children and young people with tic disorders. In the first part of a two-stage process evaluation, we conducted a mixed methods study exploring the reach, dose, and fidelity of the intervention and contextual factors influencing engagement.

Objective

This study aims to explore the fidelity of delivery and contextual factors underpinning the ORBIT trial.

Methods

Baseline study data and intervention usage metrics from participants in the intervention arm were used as quantitative implementation data (N=112). The experiences of being in the intervention were explored through semistructured interviews with children (n=20) and parent participants (n=20), therapists (n=4), and referring clinicians (n=6). A principal component analysis was used to create a comprehensive, composite measure of children and young people’s engagement with the intervention. Engagement factor scores reflected relative uptake as assessed by a range of usage indices, including chapters accessed, number of pages visited, and number of log-ins. The engagement factor score was used as the dependent variable in a multiple linear regression analysis with various contextual variables as independent variables to assess if there were any significant predictors of engagement.

Results

The intervention was implemented with high fidelity, and participants deemed the intervention acceptable and satisfactory. The engagement was high, with child participants completing an average of 7.5 of 10 (SD 2.7) chapters, and 88.4% (99/112) of participants completed the minimum of the first four chapters—the predefined threshold effective dose. Compared with the total population of children with tic disorders, participants in the sample tended to have more educated parents and lived in more economically advantaged areas; however, socioeconomic factors were not related to engagement factor scores. Factors associated with higher engagement factor scores included participants enrolled at the London site versus the Nottingham site (P=.01), self-referred versus clinic referred (P=.04), higher parental engagement as evidenced by the number of parental chapters completed (n=111; ρ=0.73; P<.001), and more therapist time for parents (n=111; ρ=0.46; P<.001). A multiple linear regression indicated that parents’ chapter completion (β=.69; t₁₁₀=10.18; P<.001) and therapist time for parents (β=.19; t₁₁₀=2.95; P=.004) were the only significant independent predictors of child engagement factor scores.

Conclusions

Overall, the intervention had high fidelity of delivery and was evaluated positively by participants, although reach may have been constrained by the nature of the randomized controlled trial. Parental engagement and therapist time for parents were strong predictors of intervention implementation, which has important implications for designing and implementing digital therapeutic interventions in child and adolescent mental health services.

International Registered Report Identifier (IRRID)

RR2-10.1186/s13063-019-3974-3

Opportunities and challenges of delivering digital clinical trials: lessons learned from a randomised controlled trial of an online behavioural intervention for children and young people

BACKGROUND

Despite being the gold standard of research to determine effectiveness, randomised controlled trials (RCTs) often struggle with participant recruitment, engagement and retention. These issues may be exacerbated when recruiting vulnerable populations, such as participants with mental health issues. We aimed to update understanding of the scope of these problems in trials of health technology and identify possible solutions through reflecting on experiences from an exemplar trial (Online Remote Behavioural Intervention for Tics; ORBIT).

METHOD

We extracted anonymised data on recruitment, retention and requests for more funding and time from trials funded by the largest funder of health technology trials in the UK (the National Institute of Health Research Health Technology Assessment) between 2010 and 2020, and compared these with data from a recent, successful trial (ORBIT). ORBIT aimed to assess the clinical- and cost-effectiveness of blended online and human behavioural therapy for tics in young people. Many of the trial procedures, including recruitment, the intervention and data collection, were undertaken online.

RESULTS

Data were extracted on 51 trials conducted between 2010 and 2020. Sixty per cent of trials failed to reach their original recruitment target and only 44% achieved their follow-up in the specified time frame. In contrast, ORBIT recruited to target and achieved 90% follow-up. We posit that these achievements are related to (a) judicious use of digital technology for trial procedures and (b) adequate numbers of highly trained and motivated trial staff. We provide details of both these to help other research teams plan and cost for successful trials.

CONCLUSION

An approach combining human and online methods may be advantageous in facilitating trial delivery, particularly in paediatric mental health services. Given the importance of successful clinical trials in advancing healthcare delivery and the waste of human and economic resources associated with unsuccessfully delivered trials, it is imperative that trials are appropriately costed and future research focusses on improving trial design and delivery.

TRIAL REGISTRATION

The ORBIT trial is registered with ISRTCN ( ISRCTN70758207 ) Registered on March 20, 2018. and ClinicalTrials.gov ( NCT03483493 ). Registered on March 30, 2018.

Therapist-Supported Online Interventions for Children and Young People With Tic Disorders: Lessons Learned From a Randomized Controlled Trial and Considerations for Future Practice

In recent years, research into internet-based cognitive behavioral therapy (iCBT) has suggested that therapist-guided digital interventions have greater engagement, adherence, and effectiveness than self-directed digital therapies. While research has focused on the effectiveness of, and adherence to, these interventions, less attention has been paid to their implementation in practice and what aspects of the therapist role support success. An understanding of the key factors related to the therapist role and intervention delivery is required if these iCBTs are to be applied in routine clinical care and outcomes optimized. In light of the coronavirus disease 2019 (COVID-19) pandemic, there is greater emphasis on allowing patients access to remote therapies. We report the experiences and reflections of 4 therapists and their 2 supervisors in delivering an online, therapist-supported intervention in a randomized controlled trial for children and young people with tic disorders (the Online Remote Behavioural Intervention for Tics [ORBIT] trial). Themes discussed include the importance of training, supervision, creating support documents/manuals, and record keeping. Alongside this are communication strategies used by therapists to encourage patient adherence and treatment effectiveness. These include rapport building, treatment personalization, and suggestions for overcoming non-engagement. These reflections offer important considerations for the delivery of iCBTs as well as implications associated with the implementation of these interventions in existing services and future research studies. We share thoughts on where iCBTs may sit in a stepped care model, how services may deal with comorbid conditions, and the potential role of iCBTs in collecting clinical data.