A trial protocol for the effectiveness of digital interventions for preventing depression in adolescents: The Future Proofing Study

Promoting mental health in children and adolescents through digital technology: a systematic review and meta-analysis

Background

The increasing prevalence of mental health issues among children and adolescents has prompted a growing number of researchers and practitioners to explore digital technology interventions, which offer convenience, diversity, and proven effectiveness in addressing such problems. However, the existing literature reveals a significant gap in comprehensive reviews that consolidate findings and discuss the potential of digital technologies in enhancing mental health.

Methods

To clarify the latest research progress on digital technology to promote mental health in the past decade (2013-2023), we conducted two studies: a systematic review and meta-analysis. The systematic review is based on 59 empirical studies identified from three screening phases, with basic information, types of technologies, types of mental health issues as key points of analysis for synthesis and comparison. The meta-analysis is conducted with 10 qualified experimental studies to determine the overall effect size of digital technology interventions and possible moderating factors.

Results

The results revealed that (1) there is an upward trend in relevant research, comprising mostly experimental and quasi-experimental designs; (2) the common mental health issues include depression, anxiety, bullying, lack of social emotional competence, and mental issues related to COVID-19; (3) among the various technological interventions, mobile applications (apps) have been used most frequently in the diagnosis and treatment of mental issues, followed by virtual reality, serious games, and telemedicine services; and (4) the meta-analysis results indicated that digital technology interventions have a moderate and significant effect size (g = 0.43) for promoting mental health.

Conclusion

Based on these findings, this study provides guidance for future practice and research on the promotion of adolescent mental health through digital technology.

Systematic review registration

https://inplasy.com/inplasy-2023-12-0004/, doi: 10.37766/inplasy2023.12.0004.

The relationship between cognitive and affective control and adolescent mental health

Background

Cognitive control problems have been implicated in the etiology and maintenance of mental health problems, including depression, in adults. Studies in adolescents have been more equivocal, with some showing changes in cognitive control in adolescents with mental health problems, whereas others fail to show an association. This study examines whether adolescent mental health is associated with affective control, the application of cognitive control in affective contexts, which shows more protracted development than cognitive control.

Methods

The present study investigated the association of cognitive and affective control with depressive symptomatology and self-reported diagnostic history of mental health problems in adolescents. The study included 1929 participants (M age = 13.89) from the Future Proofing Study (N = 6,388, 11-16 years), who completed affective (incl., affective stimuli) and/or cognitive (incl., neutral stimuli) versions of a working memory (backward digit-span) and/or shifting (card-sorting) task at least once within 3 weeks of assessing mental health.

Results

Poorer working memory was associated with greater depressive symptomatology in adolescents (β = -0.06, p = .004), similarly across cognitive and affective control conditions (β = -0.02, p = .269). Adolescents with self-reported diagnostic history of mental health problems had significantly poorer shifting ability in affective compared to cognitive control conditions (b = 0.05, p = .010), whereas for adolescents with no self-reported diagnoses, shifting ability did not differ between conditions (b = -0.00, p = .649).

Conclusions

The present analyses suggest that working memory difficulties, in particular, may be associated with the experience of current depressed mood in adolescents. Problems with affective shifting may be implicated in a range of mental health problems in adolescents. Given the ubiquitous need for efficient cognitive functioning in daily life, enhancing cognitive and affective control in adolescents may be a promising means of improving functioning across a range of domains, including affective functioning, and by extension, adolescent mental health.

Psychometric properties of the Distress Questionnaire-5 (DQ5) for measuring psychological distress in adolescents

Screening for psychological distress may assist in identifying at-risk adolescents. While several measures of adolescent psychological distress have been used, most have limited or suboptimal psychometric properties. This study aimed to assess the psychometric properties of the Distress Questionnaire-5 (DQ5), a brief measure of psychological distress, in a large community-based sample of adolescents. Data for the study (n = 3117) were drawn from the baseline and 6-week follow-up assessments of the Future Proofing Study, which collected data from three cohorts of Year 8 students (M = 13.9 years; 48% female) between August 2019 and May 2022. Participants completed the DQ5 at each measurement occasion, as well as measures of depression, generalised and social anxiety, and suicidal ideation. The DQ5 had good fit to a unidimensional construct, with standardised factor loadings ranging between 0.69 and 0.90. The scale had strong criterion (AUC ranged from 0.84 to 0.93) and predictive (AUC ranged from 0.81 to 0.87) validity when compared against indicators for depression, generalised anxiety, social anxiety and suicidal ideation. The DQ5 cut-point of ≥14 had 80% sensitivity and 90% specificity for identifying adolescents meeting symptom thresholds for any of the assessed mental health conditions. Changes in DQ5 scores over 6 weeks had moderate associations with changes in other symptom scales, suggesting sensitivity to change. In conclusion, the DQ5 demonstrates strong psychometric properties and is a reliable measure of psychological distress in adolescents. Given its brevity and ease of interpretation, the DQ5 could be readily used in schools to screen for psychological distress in students.

Implementing a Digital Depression Prevention Program in Australian Secondary Schools: Cross-Sectional Qualitative Study

BACKGROUND

Depression is common during adolescence and is associated with adverse educational, employment, and health outcomes in later life. Digital programs are increasingly being implemented in schools to improve and protect adolescent mental health. Although digital depression prevention programs can be effective, there is limited knowledge about how contextual factors influence real-world delivery at scale in schools.

OBJECTIVE

The purpose of this study was to examine the contextual factors that influence the implementation of the Future Proofing Program (FPP) from the perspectives of school staff. The FPP is a 2-arm hybrid type 1 effectiveness-implementation trial evaluating whether depression can be prevented at scale in schools, using an evidence-based smartphone app delivered universally to year 8 students (13-14 years of age).

METHODS

Qualitative interviews were conducted with 23 staff from 20 schools in New South Wales, Australia, who assisted with the implementation of the FPP. The interviews were guided by our theory-driven logic model. Reflexive thematic analysis, using both deductive and inductive coding, was used to analyze responses.

RESULTS

Staff perceived the FPP as a novel ("innovative approach") and appropriate way to address an unmet need within schools ("right place at the right time"). Active leadership and counselor involvement were critical for planning and engaging; teamwork, communication, and staff capacity were critical for execution ("ways of working within schools"). Low student engagement and staffing availability were identified as barriers for future adoption and implementation by schools ("reflecting on past experiences").

CONCLUSIONS

Four superordinate themes pertaining to the program, implementation processes, and implementation barriers were identified from qualitative responses by school staff. On the basis of our findings, we proposed a select set of recommendations for future implementation of digital prevention programs delivered at scale in schools. These recommendations were designed to facilitate an organizational change and help staff to implement digital mental health programs within their schools.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2020-042133.

Associations Between Smartphone Keystroke Metadata and Mental Health Symptoms in Adolescents: Findings From the Future Proofing Study

BACKGROUND

Mental disorders are prevalent during adolescence. Among the digital phenotypes currently being developed to monitor mental health symptoms, typing behavior is one promising candidate. However, few studies have directly assessed associations between typing behavior and mental health symptom severity, and whether these relationships differs between genders.

OBJECTIVE

In a cross-sectional analysis of a large cohort, we tested whether various features of typing behavior derived from keystroke metadata were associated with mental health symptoms and whether these relationships differed between genders.

METHODS

A total of 934 adolescents from the Future Proofing study undertook 2 typing tasks on their smartphones through the Future Proofing app. Common keystroke timing and frequency features were extracted across tasks. Mental health symptoms were assessed using the Patient Health Questionnaire-Adolescent version, the Children's Anxiety Scale-Short Form, the Distress Questionnaire 5, and the Insomnia Severity Index. Bivariate correlations were used to test whether keystroke features were associated with mental health symptoms. The false discovery rates of P values were adjusted to q values. Machine learning models were trained and tested using independent samples (ie, 80% train 20% test) to identify whether keystroke features could be combined to predict mental health symptoms.

RESULTS

Keystroke timing features showed a weak negative association with mental health symptoms across participants. When split by gender, females showed weak negative relationships between keystroke timing features and mental health symptoms, and weak positive relationships between keystroke frequency features and mental health symptoms. The opposite relationships were found for males (except for dwell). Machine learning models using keystroke features alone did not predict mental health symptoms.

CONCLUSIONS

Increased mental health symptoms are weakly associated with faster typing, with important gender differences. Keystroke metadata should be collected longitudinally and combined with other digital phenotypes to enhance their clinical relevance.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trial Registry, ACTRN12619000855123; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377664&isReview=true.

The impact of COVID-19 and bushfires on the mental health of Australian adolescents: a cross-sectional study

BACKGROUND

When COVID-19 spread to Australia in January 2020, many communities were already in a state of emergency from the Black Summer bushfires. Studies of adolescent mental health have typically focused on the effects of COVID-19 in isolation. Few studies have examined the impact of COVID-19 and other co-occurring disasters, such as the Black Summer bushfires in Australia, on adolescent mental health.

METHODS

We conducted a cross-sectional survey to examine the impact of COVID-19 and the Black Summer bushfires on the mental health of Australian adolescents. Participants (N = 5866; mean age 13.61 years) answered self-report questionnaires about COVID-19 diagnosis/quarantine (being diagnosed with and/or quarantined because of COVID-19) and personal exposure to bushfire harm (being physically injured, evacuated from home and/or having possessions destroyed). Validated standardised scales were used to assess depression, psychological distress, anxiety, insomnia, and suicidal ideation. Trauma related to COVID-19 and the bushfires was also assessed. The survey was completed in two large school-based cohorts between October 2020 and November 2021.

RESULTS

Exposure to COVID-19 diagnosis/quarantine was associated with increased probability of elevated trauma. Exposure to personal harm by the bushfires was associated with increased probability of elevated insomnia, suicidal ideation, and trauma. There were no interactive effects between disasters on adolescent mental health. Effects between personal risk factors and disasters were generally additive or sub-additive.

CONCLUSIONS

Adolescent mental health responses to community-level disasters are multi-faceted. Complex psychosocial factors associated with mental ill health may be relevant irrespective of disaster. Future research is needed to investigate synergistic effects of disasters on young mental health.

Protocol for a randomised controlled trial evaluating the effectiveness of a CBT-based smartphone application for improving mental health outcomes in adolescents: the MobiliseMe study

BACKGROUND

Depression is a leading cause of disability in adolescents, however few receive evidence-based treatment. Despite having the potential to overcome barriers to treatment uptake and adherence, there are very few CBT-based smartphone apps for adolescents. To address this gap, we developed ClearlyMe®, a self-guided CBT smartphone app for adolescent depression and anxiety. ClearlyMe® consists of 37 brief lessons containing core CBT elements, accessed either individually or as part of a 'collection'. Here, we describe the protocol for a randomised controlled trial aiming to evaluate the effect of ClearlyMe® on depressive symptoms and secondary outcomes, including engagement, anxiety and wellbeing, when delivered with and without guided support compared to an attention matched control.

METHODS

We aim to recruit 489 adolescents aged 12-17 years with mild to moderately-severe depressive symptoms. Participants will be screened for inclusion, complete the baseline assessment and are then randomly allocated to receive ClearlyMe® (self-directed use), ClearlyMe® with guided SMS support (guided use) or digital psychoeducation (attention-matched control). Depressive symptoms and secondary outcomes will be assessed at 6-weeks (primary endpoint) and 4-months post-baseline (secondary endpoint). Engagement, conceptualised as uptake, adherence and completion, will also be assessed 6-weeks post-baseline. Mixed-effects linear modelling will be used to conduct intention-to-treat analyses to determine whether reductions in depressive symptoms and secondary outcomes are greater for conditions receiving ClearlyMe® relative to control at 6-weeks and 4-months post-baseline and greater for intervention adherers relative to non-adherers. To minimise risk, participants will be encouraged to use the Get Help section of the app and can also opt to receive a call from the team clinical psychologist at baseline, and at the 6-week and 4-month post-baseline assessments when reporting suicidal ideation.

DISCUSSION

This is the first clinical trial examining a CBT smartphone app specifically designed for adolescent depression. It will provide empirical evidence on the effects of ClearlyMe® on depressive symptoms when used with and without guided support.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ACTRN12622000131752).

UNIVERSAL TRIAL NUMBER

U1111-1271-8519.

Human Support in App-Based Cognitive Behavioral Therapies for Emotional Disorders: Scoping Review

BACKGROUND

Smartphone app-based therapies offer clear promise for reducing the gap in available mental health care for people at risk for or people with mental illness. To this end, as smartphone ownership has become widespread, app-based therapies have become increasingly common. However, the research on app-based therapies is lagging behind. In particular, although experts suggest that human support may be critical for increasing engagement and effectiveness, we have little systematic knowledge about the role that human support plays in app-based therapy. It is critical to address these open questions to optimally design and scale these interventions.

OBJECTIVE

The purpose of this study is to provide a scoping review of the use of human support or coaching in app-based cognitive behavioral therapy for emotional disorders, identify critical knowledge gaps, and offer recommendations for future research. Cognitive behavioral therapy is the most well-researched treatment for a wide range of concerns and is understood to be particularly well suited to digital implementations, given its structured, skill-based approach.

METHODS

We conducted systematic searches of 3 databases (PubMed, PsycINFO, and Embase). Broadly, eligible articles described a cognitive behavioral intervention delivered via smartphone app whose primary target was an emotional disorder or problem and included some level of human involvement or support (coaching). All records were reviewed by 2 authors. Information regarding the qualifications and training of coaches, stated purpose and content of the coaching, method and frequency of communication with users, and relationship between coaching and outcomes was recorded.

RESULTS

Of the 2940 titles returned by the searches, 64 (2.18%) were eligible for inclusion. This review found significant heterogeneity across all of the dimensions of coaching considered as well as considerable missing information in the published articles. Moreover, few studies had qualitatively or quantitatively evaluated how the level of coaching impacts treatment engagement or outcomes. Although users tend to self-report that coaching improves their engagement and outcomes, there is limited and mixed supporting quantitative evidence at present.

CONCLUSIONS

Digital mental health is a young but rapidly expanding field with great potential to improve the reach of evidence-based care. Researchers across the reviewed articles offered numerous approaches to encouraging and guiding users. However, with the relative infancy of these treatment approaches, this review found that the field has yet to develop standards or consensus for implementing coaching protocols, let alone those for measuring and reporting on the impact. We conclude that coaching remains a significant hole in the growing digital mental health literature and lay out recommendations for future data collection, reporting, experimentation, and analysis.

School-based depression and anxiety prevention programs: An updated systematic review and meta-analysis

Depression and anxiety are often first experienced during childhood and adolescence, and interest in the prevention of these disorders is growing. The focus of this review was to assess the effectiveness of psychological prevention programs delivered in schools, and to provide an update to our previous review from five years ago (Werner-Seidler, Perry, Calear, Newby, & Christensen, 2017). Three electronic databases were systematically searched for published articles of randomised controlled trials (RCTs) evaluating the efficacy of school-based prevention programs until October 2020. There were 130 articles that met inclusion criteria, representing 118 unique trials and 45,924 participants. Small between-group effect sizes for depression (g = 0.21) and anxiety (g = 0.18) were detected immediately post-intervention. Subgroup analyses suggested that targeted prevention programs (for young people with risk factors or symptoms) were associated with significantly greater effect sizes relative to universal programs for depression, which was confirmed by meta-regression. There was also some evidence that external providers conferred some benefit over school-staff delivered programs. Overall, study quality was moderate and no association between risk of bias and effect size was detected. School-delivered psychological prevention programs have small effects in reducing symptoms of depression and anxiety. Refinement of these programs, and knowledge about how they can be sustainably delivered in schools beyond the trial period is now needed for population-level preventive effects. Systematic Review Registration Number: PROPSERO - CRD42020188323.

Factors That Help and Hinder the Implementation of Digital Depression Prevention Programs: School-Based Cross-sectional Study

Background

Digital prevention programs that are delivered in a school environment can inoculate young people against depression. However, little is known about the school-based factors that help and hinder the implementation of these programs. Staff members are integral for supporting mental health programs in schools and are likely to have a wealth of expertise and knowledge about the factors that affect implementation.

Objective

The primary objective of this study was to explore the barriers and facilitators to implementing a digital depression prevention program in Australian secondary schools with teachers, counselors, and principals. The secondary objective was to explore variations in these factors across different school contexts, including the school type (government or nongovernment), location (capital city, regional/or rural areas), and socioeconomic status (SES) (low, medium, high).

Methods

This quantitative cross-sectional survey study assessed the barriers and facilitators to implementing a hypothetical digital prevention program in Australian schools. The survey was taken by 97 teachers (average age 38.3 years), 93 counselors (average age 39.5 years), and 11 principals (average age 50.9 years) across Australia between November 2017 and July 2018.

Results

A range of barriers and facilitators relating to logistics and resources, staff support, and program factors were endorsed by the surveyed staff. Consistent with prior research, common barriers included a lack of time and resources (ie, staff and rooms). These barriers were particularly evident in government, rural/regional, and low socioeconomic schools. Other barriers were specific to digital delivery, including privacy issues and a lack of clarity around staff roles and responsibilities. Facilitators included upskilling staff through training, embedding the program into the curriculum, and other program factors including universal delivery, screening of students’ mental health, and clear referral pathways. Knowledge about the program efficacy was also perceived as important by a large proportion of the respondents.

Conclusions

The digital depression prevention program was perceived as suitable for use within different schools in Australia, although certain factors need to be considered to enable effective implementation. Logistics and resources, support, and program factors were identified as particularly important for school-based implementation. To maximize the effectiveness in delivering digital programs, implementation may need to be tailored to the staff roles and school types.

A cluster randomised controlled trial of a web-based youth mental health service in Australian schools

BACKGROUND

Secondary schools have attempted to address gaps in help-seeking for mental health problems with little success. This trial evaluated the effectiveness of a universal web-based service (Smooth Sailing) for improving help-seeking intentions for mental health problems and other related outcomes among students.

METHODS

A cluster randomised controlled trial was conducted to evaluate the 12-week outcomes of the Smooth Sailing service among 1841 students from 22 secondary schools in New South Wales, Australia. Assignment was conducted at the school level. The control condition received school-as-usual. The primary outcome was help-seeking intentions for general mental health problems at 12-weeks post-baseline. Secondary outcomes included help-seeking behaviour, anxiety and depressive symptoms, psychological distress, psychological barriers to help-seeking, and mental health literacy. Data were analysed using mixed linear models. This trial was registered with the Australian and New Zealand Clinical Trials Registry (ACTRN12618001539224).

FINDINGS

At 12-weeks post-baseline, there was a marginal statistical difference in the relative means of help-seeking intentions (effect size=0•10, 95%CI: -0•02-0•21) that favoured the intervention condition. Help-seeking from adults declined in both conditions. There was a greater reduction in the number of students who "needed support for their mental health but were not seeking help" in the intervention condition (OR: 2•08, 95%CI: 1•72-2.27, P<•0001). No other universal effects were found. Participants found the service easy to use and understand; However, low motivation, time, forgetfulness, and lack of perceived need were barriers to use.

INTERPRETATION

Smooth Sailing led to small improvements in help-seeking intentions. Refinements are needed to improve its effectiveness on other mental health outcomes and to increase student uptake and engagement.

FUNDING

HSBC and Graf Foundation.

DDCNNC: Dilated and depthwise separable convolutional neural Network for diagnosis COVID-19 via chest X-ray images

Purpose

As of December 21, 2020, a total of 77,670,400 cases of coronavirus disease 2019 (COVID-19) have been confirmed worldwide, 53,825,243 cases have been cured and 1,693,253 cases have died. Among the diagnostic methods of COVID-19, chest X-ray images have the advantages of fast imaging, low cost and high accuracy of single plane lesions recognition. The current COVID-19 detection models have shortcomings such as weak robustness, unreliable generalization ability, and long training time.

Methods

To solve the above problems, our team proposed two novel frameworks and five methods to diagnose COVID-19 based on chest X-ray images. (i) A novel framework – depthwise separable convolutional neural network (DCNN), and we tested Three methods, viz., using LeNet-5, VGG-16, and ResNet-18 as backbones. (ii) A novel framework – dilated and depthwise separable convolutional neural network (DDCNN), and we tested Two methods, viz., using VGG-16 and ResNet-18 as backbones.

Results

Experiment results show that our models not only improve the detection accuracy, but also reduce the training time.

Conclusions

Our methods are superior to state-of-the-art methods in both above aspects.

mHealth Interventions for Self-Harm: Scoping Review

Background

Self-harm is a growing issue with increasing prevalence rates; however, individuals who self-harm do not often receive treatment. Mobile health (mHealth) interventions are a possible solution to some of the barriers that individuals face when seeking support, and they have also been found to be effective in improving mental health. Thus far, reviews of mHealth interventions for self-harm have been limited by study type. Therefore, we determined that a broader scoping review will provide a more exhaustive understanding of mHealth interventions for self-harm.

Objective

This scoping review aims to identify mHealth interventions for self-harm within the literature, understand the types and features of interventions that have been developed and evaluated, highlight research findings around mHealth interventions for self-harm, and determine what outcomes are typically used to assess the efficacy of interventions.

Methods

A search was conducted using Embase, PubMed, PsycINFO, PsycEXTRA, Web of Science, and the Cochrane Library. Studies were included if they described an mHealth intervention designed to have a direct (ie, if the intervention was designed for self-harm or for people who self-harm) or indirect (ie, if self-harm was measured as an outcome) treatment effect and if the paper was available in English. There were no exclusion criteria based on the study design.

Results

A total of 36 papers were included in the review, and most of them were randomized controlled trials published within the last 4 years. The interventions were mostly smartphone apps and calling or texting services, with 62% (21/34) having underlying therapeutic models to inform the intervention content. They were generally shown to be promising and appealing, but only 5 were widely available for use. Outcomes focused on a reduction of self-harm and suicidality, mood, and the users’ experiences of the intervention. Samples were typically nondiverse, and there was limited variety in the study designs and in the measurements of self-harm recovery.

Conclusions

Promising and appealing mHealth interventions have been developed but are not widely available. Research could benefit from greater diversity as well as a broader and more nuanced understanding of recovery from self-harm.

Protocol for the process evaluation of a complex intervention delivered in schools to prevent adolescent depression: the Future Proofing Study

INTRODUCTION

Process evaluations provide insight into how interventions are delivered across varying contexts and why interventions work in some contexts and not in others. This manuscript outlines the protocol for a process evaluation embedded in a cluster randomised trial of a digital depression prevention intervention delivered to secondary school students (the Future Proofing Study). The purpose is to describe the methods that will be used to capture process evaluation data within this trial.

METHODS AND ANALYSIS

Using a hybrid type 1 design, a mixed-methods approach will be used with data collected in the intervention arm of the Future Proofing Study. Data collection methods will include semistructured interviews with school staff and study facilitators, automatically collected intervention usage data and participant questionnaires (completed by school staff, school counsellors, study facilitators and students). Information will be collected about: (1) how the intervention was implemented in schools, including fidelity; (2) school contextual factors and their association with intervention reach, uptake and acceptability; (3) how school staff, study facilitators and students responded to delivering or completing the intervention. How these factors relate to trial effectiveness outcomes will also be assessed. Overall synthesis of the data will provide school cluster-level and individual-level process outcomes.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the University of New South Wales (NSW) Human Research Ethics Committee (HC180836; 21st January 2019) and the NSW Government State Education Research Applications Process (SERAP 2019201; 19th August 2019). Results will be submitted for publication in peer-reviewed journals and discussed at conferences. Our process evaluation will contextualise the trial findings with respect to how the intervention may have worked in some schools but not in others. This evaluation will inform the development of a model for rolling out digital interventions for the prevention of mental illness in schools.

TRIAL REGISTRATION NUMBER

ANZCTRN12619000855123; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377664&isReview=true.