Trial for the Prevention of Depression (TriPoD) in final-year secondary students: study protocol for a cluster randomised controlled trial

Protocol for the process evaluation of a complex intervention delivered in schools to prevent adolescent depression: the Future Proofing Study

INTRODUCTION

Process evaluations provide insight into how interventions are delivered across varying contexts and why interventions work in some contexts and not in others. This manuscript outlines the protocol for a process evaluation embedded in a cluster randomised trial of a digital depression prevention intervention delivered to secondary school students (the Future Proofing Study). The purpose is to describe the methods that will be used to capture process evaluation data within this trial.

METHODS AND ANALYSIS

Using a hybrid type 1 design, a mixed-methods approach will be used with data collected in the intervention arm of the Future Proofing Study. Data collection methods will include semistructured interviews with school staff and study facilitators, automatically collected intervention usage data and participant questionnaires (completed by school staff, school counsellors, study facilitators and students). Information will be collected about: (1) how the intervention was implemented in schools, including fidelity; (2) school contextual factors and their association with intervention reach, uptake and acceptability; (3) how school staff, study facilitators and students responded to delivering or completing the intervention. How these factors relate to trial effectiveness outcomes will also be assessed. Overall synthesis of the data will provide school cluster-level and individual-level process outcomes.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the University of New South Wales (NSW) Human Research Ethics Committee (HC180836; 21st January 2019) and the NSW Government State Education Research Applications Process (SERAP 2019201; 19th August 2019). Results will be submitted for publication in peer-reviewed journals and discussed at conferences. Our process evaluation will contextualise the trial findings with respect to how the intervention may have worked in some schools but not in others. This evaluation will inform the development of a model for rolling out digital interventions for the prevention of mental illness in schools.

TRIAL REGISTRATION NUMBER

ANZCTRN12619000855123; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377664&isReview=true.

Surveying the Role of Analytics in Evaluating Digital Mental Health Interventions for Transition-Aged Youth: Scoping Review

BACKGROUND

Consumer-facing digital health interventions provide a promising avenue to bridge gaps in mental health care delivery. To evaluate these interventions, understanding how the target population uses a solution is critical to the overall validity and reliability of the evaluation. As a result, usage data (analytics) can provide a proxy for evaluating the engagement of a solution. However, there is paucity of guidance on how usage data or analytics should be used to assess and evaluate digital mental health interventions.

OBJECTIVE

This review aimed to examine how usage data are collected and analyzed in evaluations of mental health mobile apps for transition-aged youth (15-29 years).

METHODS

A scoping review was conducted using the Arksey and O'Malley framework. A systematic search was conducted on 5 journal databases using keywords related to usage and engagement, mental health apps, and evaluation. A total of 1784 papers from 2008 to 2019 were identified and screened to ensure that they included analytics and evaluated a mental health app for transition-aged youth. After full-text screening, 49 papers were included in the analysis.

RESULTS

Of the 49 papers included in the analysis, 40 unique digital mental health innovations were evaluated, and about 80% (39/49) of the papers were published over the past 6 years. About 80% involved a randomized controlled trial and evaluated apps with information delivery features. There were heterogeneous findings in the concept that analytics was ascribed to, with the top 3 being engagement, adherence, and acceptability. There was also a significant spread in the number of metrics collected by each study, with 35% (17/49) of the papers collecting only 1 metric and 29% (14/49) collecting 4 or more analytic metrics. The number of modules completed, the session duration, and the number of log ins were the most common usage metrics collected.

CONCLUSIONS

This review of current literature identified significant variability and heterogeneity in using analytics to evaluate digital mental health interventions for transition-aged youth. The large proportion of publications from the last 6 years suggests that user analytics is increasingly being integrated into the evaluation of these apps. Numerous gaps related to selecting appropriate and relevant metrics and defining successful or high levels of engagement have been identified for future exploration. Although long-term use or adoption is an important precursor to realizing the expected benefits of an app, few studies have examined this issue. Researchers would benefit from clarification and guidance on how to measure and analyze app usage in terms of evaluating digital mental health interventions for transition-aged youth. Given the established role of adoption in the success of health information technologies, understanding how to abstract and analyze user adoption for consumer digital mental health apps is also an emerging priority.

Assessment of users' acceptability of a mobile-based embodied conversational agent for the prevention and detection of suicidal behaviour

The use of embodied conversational agents in mental health has increased in the last years. Several studies exist describing the benefits and advantages of this technology as a complement to psychotherapeutic interventions for the prevention and treatment of depression, anxiety, or post-traumatic stress disorder, to name a few. A small number of these works implement capabilities in the virtual agent focused on the detection and prevention of suicidality risks. The work presented in this paper describes the development of an embodied conversational agent used as the main interface in HelPath, a mobile-based application addressed to individuals detected with any of the suicidal behaviours: ideation, planning or attempt. The main objective of HelPath is to continuously collect user's information that, complemented with data from the electronic health record, supports the identification of risks associated with suicidality. Through the virtual agent, the users also receive information and suggestions based on cognitive behaviour therapy that would help them to maintain a healthy condition. The paper also presents the execution of an exploratory pilot to assess the acceptability, perception and adherence of users towards the virtual agent. The obtained results are presented and discussed, and some actions for further improvement of the embodied conversational agent are also identified.

Preventing Depression in Final Year Secondary Students: School-Based Randomized Controlled Trial

Background

Depression often emerges for the first time during adolescence. There is accumulating evidence that universal depression prevention programs may have the capacity to reduce the impact of depression when delivered in the school environment.

Objective

This trial investigated the effectiveness of SPARX-R, a gamified online cognitive behavior therapy intervention for the prevention of depression relative to an attention-matched control intervention delivered to students prior to facing a significant stressor—final secondary school exams. It was hypothesized that delivering a prevention intervention in advance of a stressor would reduce depressive symptoms relative to the control group.

Methods

A cluster randomized controlled trial was conducted in 10 government schools in Sydney, Australia. Participants were 540 final year secondary students (mean 16.7 [SD 0.51] years), and clusters at the school level were randomly allocated to SPARX-R or the control intervention. Interventions were delivered weekly in 7 modules, each taking approximately 20 to 30 minutes to complete. The primary outcome was symptoms of depression as measured by the Major Depression Inventory. Intention-to-treat analyses were performed.

Results

Compared to controls, participants in the SPARX-R condition (n=242) showed significantly reduced depression symptoms relative to the control (n=298) at post-intervention (Cohen d=0.29) and 6 months post-baseline (d=0.21) but not at 18 months post-baseline (d=0.33).

Conclusions

This is the first trial to demonstrate a preventive effect on depressive symptoms prior to a significant and universal stressor in adolescents. It demonstrates that an online intervention delivered in advance of a stressful experience can reduce the impact of such an event on the potential development or exacerbation of depression.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12614000316606; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=365986 (Archived by WebCite at http://www.webcitation.org/ 6u7ou1aI9)

Effectiveness of online and mobile telephone applications ('apps') for the self-management of suicidal ideation and self-harm: a systematic review and meta-analysis

BACKGROUND

Online and mobile telephone applications ('apps') have the potential to improve the scalability of effective interventions for suicidal ideation and self-harm. The aim of this review was therefore to investigate the effectiveness of digital interventions for the self-management of suicidal ideation or self-harm.

METHODS

Seven databases (Applied Science & Technology; CENTRAL; CRESP; Embase; Global Health; PsycARTICLES; PsycINFO; Medline) were searched to 31 March, 2017. Studies that examined the effectiveness of digital interventions for suicidal ideation and/or self-harm, or which reported outcome data for suicidal ideation and/or self-harm, within a randomised controlled trial (RCT), pseudo-RCT, or observational pre-test/post-test design were included in the review.

RESULTS

Fourteen non-overlapping studies were included, reporting data from a total of 3,356 participants. Overall, digital interventions were associated with reductions for suicidal ideation scores at post-intervention. There was no evidence of a treatment effect for self-harm or attempted suicide.

CONCLUSIONS

Most studies were biased in relation to at least one aspect of study design, and particularly the domains of participant, clinical personnel, and outcome assessor blinding. Performance and detection bias therefore cannot be ruled out. Digital interventions for suicidal ideation and self-harm may be more effective than waitlist control. It is unclear whether these reductions would be clinically meaningful at present. Further evidence, particularly with regards to the potential mechanisms of action of these interventions, as well as safety, is required before these interventions could recommended.

How do eHealth Programs for Adolescents With Depression Work? A Realist Review of Persuasive System Design Components in Internet-Based Psychological Therapies

Background

Major depressive disorders are common among adolescents and can impact all aspects of their daily life. Traditional therapies, cognitive behavioral therapy (CBT), and interpersonal psychotherapy (IPT) have been delivered face-to-face. However, Internet-based (online) delivery of these therapies is emerging as an option for adolescents. Internet-based CBT and IPT involve therapeutic content, interaction between the user and the system, and different technological features embedded into the online program (eg, multimedia). Studies of Internet-based CBT and IPT for adolescent depression differ on all three aspects, and variable, positive therapy effects have been reported. A better understanding of the treatment conditions that influence therapy outcomes is important to designing and evaluating these novel therapies.

Objective

Our aim was to examine the technological and program delivery features of Internet-based CBT and IPT for adolescent depression and to document their potential relation to treatment outcomes and program use.

Methods

We performed a realist synthesis. We started with an extensive search of published and gray literature. We included intervention studies that evaluated Internet-based CBT or IPT for adolescent depression. We included mixed-methods and qualitative studies, theoretical papers, and policy/implementation documents if they included a focus on how Internet-based psychological therapy is proposed to work for adolescents with depression/depressive symptoms. We used the Mixed-Methods Appraisal Tool to assess the methodological quality of studies. We used the Persuasive System Design (PSD) model as a framework for data extraction and analysis to examine how Internet-based CBT and IPT, as technology-based systems, influence the attitudes and behaviors of system users. PSD components described for the therapies were linked to reported outcomes using a cross-case comparison method and thematic synthesis.

Results

We identified 19 Internet-based CBT programs in 59 documents. Of those, 71% (42/59) were of moderate to high quality. The PSD features surface credibility (competent “look and feel”), dialogue support (online program + in-person support), liking and similarity (esthetics and content appeal to adolescent users), the reduction and tunneling of therapeutic content (reducing online content into simple tasks, guiding users), and use of self-monitoring were present in therapies that resulted in improved therapy engagement, satisfaction, and adherence, as well as symptom and functional impairments.

Conclusions

When incorporated into Internet-based CBT for adolescent depression, PSD features may improve adolescent adherence, satisfaction, and depression-related outcomes. Testing of these features using hypothesis-driven dismantling approaches is recommended to advance our understanding of how these features contribute to therapy effectiveness.

Embodied Conversational Agents for the Detection and Prevention of Suicidal Behaviour: Current Applications and Open Challenges

Embodied conversational agents (ECAs) are advanced computational interactive interfaces designed with the aim to engage users in the continuous and long-term use of a background application. The advantages and benefits of these agents have been exploited in several e-health systems. One of the medical domains where ECAs are recently applied is to support the detection of symptoms, prevention and treatment of mental health disorders. As ECAs based applications are increasingly used in clinical psychology, and due that one fatal consequence of mental health problems is the commitment of suicide, it is necessary to analyse how current ECAs in this clinical domain support the early detection and prevention of risk situations associated with suicidality. The present work provides and overview of the main features implemented in the ECAs to detect and prevent suicidal behaviours through two scenarios: ECAs acting as virtual counsellors to offer immediate help to individuals in risk; and ECAs acting as virtual patients for learning/training in the identification of suicide behaviours. A literature review was performed to identify relevant studies in this domain during the last decade, describing the main characteristics of the implemented ECAs and how they have been evaluated. A total of six studies were included in the review fulfilling the defined search criteria. Most of the experimental studies indicate promising results, though these types of ECAs are not yet commonly used in routine practice. The identification of some open challenges for the further development of ECAs within this domain is also discussed.

Prevention of Mental Health Disorders Using Internet- and Mobile-Based Interventions: A Narrative Review and Recommendations for Future Research

Although psychological interventions might have a tremendous potential for the prevention of mental health disorders (MHD), their current impact on the reduction of disease burden is questionable. Possible reasons include that it is not practical to deliver those interventions to the community en masse due to limited health care resources and the limited availability of evidence-based interventions and clinicians in routine practice, especially in rural areas. Therefore, new approaches are needed to maximize the impact of psychological preventive interventions. Limitations of traditional prevention programs could potentially be overcome by providing Internet- and mobile-based interventions (IMIs). This relatively new medium for promoting mental health and preventing MHD introduces a fresh array of possibilities, including the provision of evidence-based psychological interventions that are free from the restraints of travel and time and allow reaching participants for whom traditional opportunities are not an option. This article provides an introduction to the subject and narratively reviews the available evidence for the effectiveness of IMIs with regard to the prevention of MHD onsets. The number of randomized controlled trials that have been conducted to date is very limited and so far it is not possible to draw definite conclusions about the potential of IMIs for the prevention of MHD for specific disorders. Only for the indicated prevention of depression there is consistent evidence across four different randomized trial trials. The only trial on the prevention of general anxiety did not result in positive findings in terms of eating disorders (EDs), effects were only found in post hoc subgroup analyses, indicating that it might be possible to prevent ED onset for subpopulations of people at risk of developing EDs. Future studies need to identify those subpopulations likely to profit from preventive. Disorders not examined so far include substance use disorders, bipolar disorders, stress-related disorders, phobic disorders and panic disorder, obsessive-compulsive disorder, impulse-control disorders, somatic symptom disorder, and insomnia. In summary, there is a need for more rigorously conducted large scale randomized controlled trials using standard clinical diagnostic instruments for the selection of participants without MHD at baseline and the assessment of MHD onset. Subsequently, we discuss future directions for the field in order to fully exploit the potential of IMI for the prevention of MHD.