Examining the Usage, User Experience, and Perceived Impact of an Internet-Based Cognitive Behavioral Therapy Program for Adolescents With Anxiety: Randomized Controlled Trial

Outcomes of Best-Practice Guided Digital Mental Health Interventions for Youth and Young Adults with Emerging Symptoms: Part II. A Systematic Review of User Experience Outcomes

Although many young people demonstrate resilience and strength, research and clinical evidence highlight an upward trend in mental health concerns among those aged 12 to 25 years. Youth-specific digital mental health interventions (DMHIs) aim to address this trend by providing timely access to mental health support for young people (12-25 years). However, there is a considerable gap in understanding young people user experiences with digital interventions. This review, co-designed with Australia's leading mental health organization Beyond Blue, utilizes a systematic methodology to synthesize evidence on user experience in youth-oriented digital mental health interventions that are fully or partially guided. Five relevant online databases were searched for articles published from 2018 to 2023, yielding 22,482 articles for screening and 22 studies were included in the present analysis. User experience outcomes relating to satisfaction and engagement were assessed for each included intervention, with experience indicators relating to usefulness, usability, value, credibility, and desirability being examined. Elements associated with positive/negative outcomes were extracted. Elements shown to positively influence user experience included peer engagement, modern app-based delivery, asynchronous support, and personalized content. In contrast, users disliked static content, homework/log-keeping, the requirement for multiple devices, and social media integration. Asynchronous interventions showed high satisfaction but faced engagement issues, with combined asynchronous/synchronous interventions reporting better completion rates. DMHIs offer a promising platform for youth mental health support and has the potential to dramatically increase the reach of interventions through the adoption of technological and user experience best practices. While young people respond positively to many aspects of intervention modernization, such as interactive, app-based design, other concepts, such as social media integration, they need to be adopted by the field more cautiously to ensure trust and engagement.Trial Registration CRD42023405812.

Understanding Adolescents' Experiences With Menstrual Pain to Inform the User-Centered Design of a Mindfulness-Based App: Mixed Methods Investigation Study

BACKGROUND

Digital interventions are increasingly popular for the provision of nonpharmacological pain interventions, but few exist for adolescents with menstrual pain. User-centered design involves incorporating users across phases of digital health intervention design, development, and implementation and leads to improved user engagement and outcomes. A needs assessment is the first step of this approach.

OBJECTIVE

The goal of this study was to conduct a needs assessment to understand menstrual pain management needs and preferences and mindfulness experiences, preferences, and knowledge of adolescents with menstrual pain to inform the future development of an app for managing menstrual pain.

METHODS

We used an explanatory sequential mixed method design that included a survey followed by focus groups. Adolescents aged 13-17 years completed a survey (n=111) and participated in focus groups (n=16). Data were analyzed using descriptive statistics and thematic content analysis and synthesized to provide specific recommendations based on adolescent responses.

RESULTS

Adolescents (n=111) who completed the survey reported a moderate understanding of mindfulness and menstrual pain. Over three-quarters (n=87, 78%) of participants practiced some form of mindfulness and 87% (n=97) of survey participants used nonpharmacological pain management strategies. Teens had a moderate perception that mindfulness could help their menstrual pain (mean 4.51/10, SD 2.45, with higher scores suggesting more interest). Themes were generated related to mindfulness experiences, menstrual pain knowledge and experiences, and app functionality. These themes underscored adolescents' need for continued support and flexible access to mindfulness activities; their awareness of multiple influences to pain, with potential for further education in this area; and the need for menstrual pain-specific content, along with content relevant to typical day-to-day experiences of adolescents.

CONCLUSIONS

Adolescents with menstrual pain have an interest in using a mindfulness app for pain but have unique needs that need to be addressed to ensure app engagement and relevance for this population. Concrete recommendations for future app development are provided.

Outcomes of Best-Practice Guided Digital Mental Health Interventions for Youth and Young Adults with Emerging Symptoms: Part I. A Systematic Review of Socioemotional Outcomes and Recommendations

Youth-specific digital mental health interventions (DMHI) represent an emerging field of study, and aim to increase access, improve socioemotional outcomes, and, where required, support triage to targeted interventions. However, prior reviews have reported inconsistent findings on the clinical effectiveness of such interventions in young adults (12-25 years). Further, shortfalls remain for the impact of guided interventions based on the mode of delivery and the type of human support personnel (e.g., professional or peer) guiding the intervention. In response, this systematic review, co-designed with Australia's leading mental health organization, aims to assess the effectiveness of guided digital programs in improving youth socioemotional outcomes. Included studies involve young people experiencing mental ill-health, receiving brief (i.e., 1-12 sessions), digitally delivered (at least partially) psychological interventions that were guided or partially guided, tested in a type of experimental study, with a socioemotional outcome. Specific socioemotional outcomes examined were depression, anxiety, stress, wellbeing, mindfulness, and quality of life. A systematic search of the contemporary published and grey literature identified 22,482 records with 32 relevant records published between 2018 and 2023. A narrative synthesis guided integration of findings. Results demonstrated strong evidence for the effectiveness of guided interventions on socioemotional outcomes (i.e., depression, anxiety, stress) yet these effects were short-lived. When factoring in the use of different control groups (i.e., active vs. inactive), inconsistent effects were observed for the socioemotional outcomes of depression, anxiety, and stress. The mode of delivery (i.e., asynchronous, synchronous, combined) and the type of human support personnel did not appear to impact socioemotional outcomes. Results indicate efficacious brief digital interventions for depression and anxiety include refresher/follow-up content, goal setting content, and relapse prevention content. In contrast, poor efficacy is associated with interventions that include homework tasks, self-monitoring, and log-keeping content.PROSPERO, ID CRD42023405812.

Female youth and mental health service providers' perspectives on the JoyPop™ app: a qualitative study

Introduction

Mobile health (mHealth) apps are a promising adjunct to traditional mental health services, especially in underserviced areas. Developed to foster resilience in youth, the JoyPop™ app has a growing evidence base showing improvement in emotion regulation and mental health symptoms among youth. However, whether this novel technology will be accepted among those using or providing mental health services remains unknown. This study aimed to evaluate the JoyPop™ app's acceptance among (a) a clinical sample of youth and (b) mental health service providers.

Method

A qualitative descriptive approach involving one-on-one semi-structured interviews was conducted. Interviews were guided by the Technology Acceptance Model and were analyzed using a deductive-inductive content analysis approach.

Results

All youth (n = 6 females; Mage = 14.60, range 12-17) found the app easy to learn and use and expressed positive feelings towards using the app. Youth found the app useful because it facilitated accessibility to helpful coping skills (e.g., journaling to express their emotions; breathing exercises to increase calmness) and positive mental health outcomes (e.g., increased relaxation and reduced stress). All service providers (n = 7 females; Mage = 43.75, range 32-60) perceived the app to be useful and easy to use by youth within their services and expressed positive feelings about integrating the app into usual care. Service providers also highlighted various organizational factors affecting the app's acceptance. Youth and service providers raised some concerns about apps in general and provided recommendations to improve the JoyPop™ app.

Discussion

Results support youth and service providers' acceptance of the JoyPop™ app and lend support for it as an adjunctive resource to traditional mental health services for youth with emotion regulation difficulties.

Online randomised trials with children: A scoping review

BACKGROUND

Paediatric trials must contend with many challenges that adult trials face but often bring additional obstacles. Decentralised trials, where some or all trial methods occur away from a centralised location, are a promising strategy to help meet these challenges. This scoping review aims to (a) identify what methods and tools have been used to create and conduct entirely online-decentralised trials with children and (b) determine the gaps in the knowledge in this field. This review will describe the methods used in these trials to identify their facilitators and the gaps in the knowledge.

METHODS

The methods were informed by guidance from the Joanna Briggs Institute and the PRISMA extension for scoping reviews. We systematically searched MEDLINE, CENTRAL, CINAHL, and Embase databases, trial registries, pre-print servers, and the internet. We included randomised and quasi-randomised trials conducted entirely online with participants under 18 published in English. A risk of bias assessment was completed for all included studies.

RESULTS

Twenty-one trials met our inclusion criteria. The average age of participants was 14.6 years. Social media was the most common method of online recruitment. Most trials employed an external host website to store and protect their data. Duration of trials ranged from single-session interventions up to ten weeks. Fourteen trials compensated participants. Eight trials involved children in their trial design process; none reported compensation for this. Most trials had a low risk of bias in "random sequence generation", "selective reporting", and "other". Most trials had a high risk of bias in "blinding participants and personnel", "blinding of outcome assessment", and "incomplete outcome data". "Allocation concealment" was unclear in most studies.

CONCLUSIONS

There was a lack of transparent reporting of the recruitment, randomisation, and retention methods used in many of the trials included in this review. Patient and public involvement (PPI) was not common, and the compensation of PPI partners was not reported in any study. Consent methods and protection against fraudulent entries to trials were creative and thoroughly discussed by some trials and not addressed by others. More work and thorough reporting of how these trials are conducted is needed to increase their reproducibility and quality.

ETHICS AND DISSEMINATION

Ethical approval was not necessary since all data sources used are publicly available.

Towards Inclusive Diagnostics for Neglected Tropical Diseases: User Experience of a New Digital Diagnostic Device in Low-Income Settings

Designing new and inclusive diagnostic tools to detect Neglected Tropical Diseases (NTDs) to achieve rational disease control requires a co-design process where end-users’ input is important. Failure to involve all potential end-users in new diagnostics for NTDs can result in low use and adoption failure, leading to persistent infection hot spots and ineffective disease control. There are different categories of potential end-users of new diagnostic tools for NTD control, and it is unclear if there are differences between the user efficiency, effectiveness, perception, and acceptability across these end-user categories. This study evaluated the usability, user perception, contextual factors affecting the user’s experience, and acceptability of a new digital optical diagnostic device for NTDs across three types of potential end users. A total of 21 participants were tested. Laboratory scientists, technicians, and Community Health Extension Workers (CHEWs) in training achieved similar scores on the usability and user perception questionnaires with no statistically significant difference between end-user categories. All participants also have high scores for the user perception domains which strongly correlate with the acceptability of the AiDx NTDx Assist device. This study indicates that, by providing digital diagnostic tools in combination with minimal training and support, CHEWs undergoing training and, by extension, CHEWs post-training, can be involved in the diagnoses of NTDs, potentially enhancing a community’s capabilities to diagnose, treat, and control NTDs.

Self-management, self-care, and self-help in adolescents with emotional problems: a scoping review

This study aimed to review the existing published and grey literature describing the concepts of self-management, self-care, and self-help, and to capture strategies or techniques related to these concepts, for adolescents with emotional problems. Emotional problems are rising amongst adolescents, yet timely access to specialist mental health treatment is limited to those with greater severity of mental health difficulties. Self-management, self-care, and self-help strategies may be used by adolescents with emotional problems both in terms of those waiting for treatment and to prevent relapse. Given the overlap in existing definitions and the lack of clarity around these concepts in an adolescent mental health context, a scoping review of the literature is warranted to provide clarity. Eligible studies were those involving adolescents aged 10 to 19 years with symptoms of emotional problems. Studies referenced self-management, self-care, or self-help, not involving a professional, in this population. Quantitative, qualitative, economic, and mixed methods studies, as well as systematic, scoping, and literature reviews, from 2000 onwards and in the English language, were eligible for inclusion. A systematic search was conducted of both published and grey literature. Databases searched included PsycINFO, Medline, Embase, Web of Science, and CINAHL Plus. Mednar was also searched for unpublished studies and grey literature. Tables  of themes, terms, and associated strategies are presented alongside a thematic analysis of the results. 62 articles were included. These were 20 quantitative studies, 14 systematic reviews, 10 qualitative studies, five review papers, four book chapters, four mixed methods studies, two dissertations, two meta-analyses and one scoping review and systematic review. Most of the included articles referenced self-help (n = 51), followed by self-management (n = 17) and self-care (n = 6). A total of 12 themes were identified from a reflexive thematic analysis of descriptions (and associated strategies) of self-management, self-help, or self-care in included texts. This scoping review provides clarity on the similarities and differences between how these concepts are discussed, and the strategies which are associated with each of these concepts in the relevant literature. Implications for policy and intervention development for adolescents' self-management, self-help, and self-care of their mental health are discussed. There is considerable overlap in both the ways in which these concepts are described, and the strategies or approaches proposed in relation to them, supporting previous research suggesting these strategies should be grouped under a single term, such as "self or community approaches." More research is needed for self-management, self-help, and self-care amongst marginalized groups as these adolescents may have the highest unmet need for mental health support.

A randomized controlled trial evaluating the effect of an internet-based cognitive-behavioral program on anxiety symptoms in a community-based sample of adolescents

Adolescents' use of online resources to self-manage anxiety is growing. The objective of the current trial was to assess the effectiveness of an online, primarily self-led cognitive behavioral therapy (CBT) program in reducing anxiety symptoms compared to an active comparator, access to anxiety resources on a static website. A total of 563 adolescents (13-19 years) with self-identified anxiety concerns were enrolled. Self-reported anxiety symptoms were assessed pre- and post-intervention (6 weeks). Adolescents were further assessed 3 months post-intervention. Other outcomes assessed at the three time-points were quality of life (QOL) and healthcare utilization. Both interventions reduced anxiety symptoms after use. Group differences in symptom change were not significant post-intervention (p = 0.16), but were at 3 months (favouring online CBT; p = 0.04) with male participants reporting more symptom change (p = 0.03). Across time-points, as anxiety symptoms decreased, QOL increased (p < 0.001). Among participants that provided healthcare utilization before and after intervention use, the greatest changes in use were among online CBT users particularly for mental health provider visits (psychiatrist, -41.0 % vs. +18.5 %; social worker, -42.5 % vs. -22.1 %), hospital-based care (emergency department visits, -80.0 % vs. +79.4 %; hospital admissions, -76.1 % vs. +42.9 %), and use of self-help or alternative treatments (-60.0 % vs. +6.6 %). Results suggest that, over time, use of online CBT by adolescents can result in improved anxiety symptoms and fewer use of other healthcare resources compared to traditional online information seeking.

Appropriate Use and Operationalization of Adherence to Digital Cognitive Behavioral Therapy for Depression and Anxiety in Youth: Systematic Review

BACKGROUND

Digital, self-guided cognitive behavioral therapy (CBT) interventions circumvent many barriers to in-person therapy for young people (aged 12-24 years), although adherence to these interventions is low. The absence or insufficient disclosure of recommendations or instructions for appropriate use may account for this. As such, many young people may not self-administer these interventions appropriately or receive the optimal degree of treatment.

OBJECTIVE

This systematic review aims to synthesize the literature on digital CBT for depression and anxiety in young people to describe how appropriate use has been defined and communicated to users as instructions for use, to describe how adherence has been measured, and to determine the associations between adherence and treatment outcomes.

METHODS

A systematic review was conducted with 2 reviewers (SHL and MRA) extracting data independently. Overall, 4 electronic databases (Embase, MEDLINE, PsycINFO, and Cochrane Library) were searched in April 2021 for studies that met the following inclusion criteria: participants aged between 12 and 24 years, evaluated a digital CBT intervention targeting depression or anxiety, and reported instructions or recommendations for use or measures of adherence. Studies that evaluated non-CBT interventions or cognitive- or behavioral-only interventions were excluded. Methodological quality was assessed using the Cochrane Risk of Bias Tool and the Integrated Quality Criteria for the Review of Multiple Study Designs.

RESULTS

There were 32 manuscripts that met the inclusion criteria, of which 28 (88%) were unique studies (N=16,578 youths). Definitions of appropriate use varied among the different interventions in terms of intended recipients, duration and frequency of use, and the features used to support engagement and adherence to appropriate use definitions. Reporting of appropriate use definitions in studies was inconsistent, with no study systematically describing components of appropriate use or providing information on how recommendations for use were relayed to users. Most often, definitions of appropriate use were derived from the study protocol and descriptions of intervention features. Adherence was mostly operationalized as the degree of intervention completion; however, reporting of adherence data was heterogeneous. There was little evidence of an association between degree of use and outcomes in the 9 studies that examined this.

CONCLUSIONS

Definitions of appropriate use are unique to each digital CBT intervention. However, statements of appropriate use are not systematically reported in the literature. Furthermore, the extent to which recommendations for use are communicated to users is not routinely reported. Despite unique definitions of appropriate use, adherence was most often generically operationalized as the degree of intervention completion and was not consistently associated with outcomes. We proposed a framework to promote systematic reporting of definitions of appropriate use for digital interventions to provide guidance to users and to assist the development of appropriate and nuanced measures of adherence.

TRIAL REGISTRATION

PROSPERO CRD42020208668; https://tinyurl.com/4bu2yram.

A Perspective on How User-Centered Design Could Improve the Impact of Self-Applied Psychological Interventions in Low- or Middle-Income Countries in Latin America

Global technological progress has generated alternatives for psychological assistance, both for the evaluation and for the treatment of different emotional disorders. Evidence suggests that Internet-based treatments are effective for the treatment of anxiety and depression disorders. However, in Latin America online treatments are still scarce compared to developed countries and have similar problems as developed countries, such as high dropout rate. One possible solution to help decrease the dropout rate is to design and develop online interventions based on the needs and characteristics of the users. The user-centered design (UCD) is a fundamental concept to develop successful online interventions. The objective of this article is to provide a perspective overview on how UCD could improve the impact of self-applied psychological interventions in low- or middle-income countries in Latin America; however this proposal can also be applied in low- and middle-income countries in other regions of the world. The literature on UCD has demonstrated its efficacy when properly applied in online interventions; however, it is not common to see how this methodology has been applied in research in online interventions, and regarding Latin America, this is even more scarce with a very limited number of articles implementing the principles of UCD.

Establishing a Working Definition of User Experience for eHealth Interventions of Self-reported User Experience Measures With eHealth Researchers and Adolescents: Scoping Review

BACKGROUND

Across eHealth intervention studies involving children, adolescents, and their parents, researchers have measured user experience to assist with intervention development, refinement, and evaluation. To date, no widely accepted definitions or measures of user experience exist to support a standardized approach for evaluation and comparison within or across interventions.

OBJECTIVE

We conduct a scoping review with subsequent Delphi consultation to identify how user experience is defined and measured in eHealth research studies, characterize the measurement tools used, and establish working definitions for domains of user experience that could be used in future eHealth evaluations.

METHODS

We systematically searched electronic databases for published and gray literature available from January 1, 2005, to April 11, 2019. We included studies assessing an eHealth intervention that targeted any health condition and was designed for use by children, adolescents, and their parents. eHealth interventions needed to be web-, computer-, or mobile-based, mediated by the internet with some degree of interactivity. We required studies to report the measurement of user experience as first-person experiences, involving cognitive and behavioral factors reported by intervention users. We appraised the quality of user experience measures in included studies using published criteria: well-established, approaching well-established, promising, or not yet established. We conducted a descriptive analysis of how user experience was defined and measured in each study. Review findings subsequently informed the survey questions used in the Delphi consultations with eHealth researchers and adolescent users for how user experience should be defined and measured.

RESULTS

Of the 8634 articles screened for eligibility, 129 articles and 1 erratum were included in the review. A total of 30 eHealth researchers and 27 adolescents participated in the Delphi consultations. On the basis of the literature and consultations, we proposed working definitions for 6 main user experience domains: acceptability, satisfaction, credibility, usability, user-reported adherence, and perceived impact. Although most studies incorporated a study-specific measure, we identified 10 well-established measures to quantify 5 of the 6 domains of user experience (all except for self-reported adherence). Our adolescent and researcher participants ranked perceived impact as one of the most important domains of user experience and usability as one of the least important domains. Rankings between adolescents and researchers diverged for other domains.

CONCLUSIONS

Findings highlight the various ways in which user experience has been defined and measured across studies and what aspects are most valued by researchers and adolescent users. We propose incorporating the working definitions and available measures of user experience to support consistent evaluation and reporting of outcomes across studies. Future studies can refine the definitions and measurement of user experience, explore how user experience relates to other eHealth outcomes, and inform the design and use of human-centered eHealth interventions.

Online Indicated Preventive Mental Health Interventions for Youth: A Scoping Review

Objective: Between the ages of 12 and 25 the onset of mental disorders typically occurs, and the burden of mental health problems is greatest for this group. Indicated preventive interventions to target individuals with subclinical symptoms to prevent the transition to clinical levels of disorders have gained considerable traction. However, the threshold to seek help appears to be high even when help is needed. Online interventions could offer a solution, especially during the COVID-19 pandemic. This scoping review will present an overview of the recent research of indicated online preventive interventions for youth (12-25 years) experiencing the early stages of mental health complaints with the aim of identifying the nature and extent of the research evidence. Methods: The 5-stage framework by Arksey and O'Malley was used. Academic literature published from 2013 onwards in printed or electronic format was included from Scopus, PsychINFO, and Ovid MEDLINE(R) ALL. Results: The search yielded 11,122 results, with the final selection resulting in inclusion of 30 articles for this review. In total, the articles included 4,950 participants. 26.7% of the selected articles focused on youth between 12 and 25 years. Of the articles 60% did not screen for, nor exclude participants with clinical levels of symptoms. Most studies used a common evidence-based therapy for the disorder-category targeted. More than half of the online interventions included some form of human support. Adherence levels ranged between 27.9 and 98%. The results indicate general effectiveness, usability and acceptability of online indicated preventive interventions. The most commonly used approach was CBT (n = 12 studies). Studies varied in their size, rigor of study, effectiveness and outcome measures. Online interventions with a combination of clinical and peer moderation (n = 3 studies) appear to result in the most stable and highest effect sizes. Conclusion: Online indicated preventive mental health interventions for youth with emerging mental health issues show promise in reducing various mental health complaints, and increasing positive mental health indicators such as well-being and resilience. Additionally, high levels of usability and acceptability were found. However, the included studies show important methodological shortcomings. Also, the research has mainly focused on specific diagnostic categories, meaning there is a lack of transdiagnostic approaches. Finally, clear definitions of- as well as instruments to measure- emerging or subclinical mental health symptoms in youth remain are missing.

Tablet-Based Telerehabilitation Versus Conventional Face-to-Face Rehabilitation After Cochlear Implantation: Prospective Intervention Pilot Study

Background

Technologies allowing home-based rehabilitation may be a key means of saving financial resources while also facilitating people’s access to treatment. After cochlear implantation, auditory training is necessary for the brain to adapt to new auditory signals transmitted by the cochlear implant (CI). To date, auditory training is conducted in a face-to-face setting at a specialized center. However, because of the COVID-19 pandemic’s impact on health care, the need for new therapeutic settings has intensified.

Objective

The aims of this study are to assess the feasibility of a novel teletherapeutic auditory rehabilitation platform in adult CI recipients and compare the clinical outcomes and economic benefits of this platform with those derived from conventional face-to-face rehabilitation settings in a clinic.

Methods

In total, 20 experienced adult CI users with a mean age of 59.4 (SD 16.3) years participated in the study. They completed 3 weeks of standard (face-to-face) therapy, followed by 3 weeks of computer-based auditory training (CBAT) at home. Participants were assessed at three intervals: before face-to-face therapy, after face-to-face therapy, and after CBAT. The primary outcomes were speech understanding in quiet and noisy conditions. The secondary outcomes were the usability of the CBAT system, the participants’ subjective rating of their own listening abilities, and the time required for completing face-to-face and CBAT sessions for CI users and therapists.

Results

Greater benefits were observed after CBAT than after standard therapy in nearly all speech outcome measures. Significant improvements were found in sentence comprehension in noise (P=.004), speech tracking (P=.004) and phoneme differentiation (vowels: P=.001; consonants: P=.02) after CBAT. Only speech tracking improved significantly after conventional therapy (P=.007). The program’s usability was judged to be high: only 2 of 20 participants could not imagine using the program without support. The different features of the training platform were rated as high. Cost analysis showed a cost difference in favor of CBAT: therapists spent 120 minutes per week face-to-face and 30 minutes per week on computer-based sessions. For CI users, attending standard therapy required an average of approximately 78 (SD 58.6) minutes of travel time per appointment.

Conclusions

The proposed teletherapeutic approach for hearing rehabilitation enables good clinical outcomes while saving time for CI users and clinicians. The promising speech understanding results might be due to the high satisfaction of users with the CBAT program. Teletherapy might offer a cost-effective solution to address the lack of human resources in health care as well as the global challenge of current or future pandemics.