Systematic assessment of the quality and integrity of popular mental health smartphone apps using the American Psychiatric Association's app evaluation model

Toward a New Conceptual Framework for Digital Mental Health Technologies: Scoping Review

Background

Digital mental health technologies (DMHTs) are becoming more widely available and are seen as having the potential to improve the quality of mental health care. However, conversations around the potential impact of DMHTs can be impacted by a lack of focus on the types of technologies that are available. Several frameworks that could apply to DMHTs are available, but they have not been developed with comprehensive methods and have limitations.

Objective

To address limitations with current frameworks, we aimed to identify existing literature on the categorization of DMHTs, to explore challenges with categorizing DMHTs for specific purposes, and to develop a new conceptual framework.

Methods

We used an iterative approach to develop the framework. First, we completed a rapid review of the literature to identify studies that provided domains that could be used to categorize DMHTs. Second, findings from this review and associated issues were discussed by an expert working group, including professionals from a wide range of relevant settings. Third, we synthesized findings to develop a new conceptual framework.

Results

The rapid review identified 3603 unique results, and hand searching identified another 3 potentially relevant papers. Of these, 24 papers were eligible for inclusion, which provided 10 domains to categorize DMHTs. The expert working group proposed a broad framework and based on the findings of the review and group discussions, we developed a new conceptual framework with 8 domains that represent important characteristics of DMHTs. These 8 domains are population, setting, platform or system, purpose, type of approach, human interaction, human responsiveness, and functionality.

Conclusions

This conceptual framework provides a structure for various stakeholders to define the key characteristics of DMHTs. It has been developed with more comprehensive methods than previous attempts with similar aims. The framework can facilitate communication within the field and could undergo further iteration to ensure it is appropriate for specific purposes.

Mental Health Monitoring for Young People Through Mood Apps: Protocol for a Scoping Review and Systematic Search in App Stores

BACKGROUND

The researchers have used mobile phones to assist in monitoring, analyzing, and managing moods to acquire insight into mood patterns. There is a lack of evidence in their use as clinical tools and interventions, which necessitates a comprehensive review and quality assessment to understand barriers and facilitators for app implementation as an impactful clinical intervention.

OBJECTIVE

This review aims to (1) provide an overview of the recent evidence on mobile mood-monitoring apps that are intended for facilitating self-management and support of mental health in children, adolescents, and young people; and (2) investigate the quality of publicly available apps.

METHODS

The study will first involve a scoping review of the literature on mood-monitoring apps for children, adolescents, and young people followed by an evaluation of features of the apps available in the marketplace. The scoping review will follow the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines and search 6 databases- Embase, CINAHL, PubMed, ACM Digital Library, Scopus, and Springer LNCS-for relevant studies and reviews published in the last 3 years. The author will then screen the references, extract data from the included studies, and analyze them to synthesize the evidence on mood apps. Next, the Apple App Store and Google Play Store will be searched for mood apps. A total of 2 independent reviewers will screen the apps based on eligibility criteria, and disagreements will be resolved through consensus. The features of the selected apps will then be evaluated using the Mobile Health Index and Navigation framework, and descriptive analysis will be used to synthesize the findings.

RESULTS

Literature search and screening began soon after submission of the protocol and is expected to be completed by September 2024. The app evaluation will be completed by October 2024.

CONCLUSIONS

Combined, the scoping literature review and app evaluation will provide an in-depth overview of the most recent scientific evidence related to mood apps and the quality of apps actually available for use.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/56400.

Efficacy of Gamified Digital Mental Health Interventions for Pediatric Mental Health Conditions: A Systematic Review and Meta-Analysis

Importance

Anxiety, depression, and attention-deficit/hyperactivity disorder (ADHD) affect up to 20% of children and adolescents. Despite demonstrated efficacy, evidence-based treatments for these conditions are often inaccessible; innovative solutions are essential to meet the demand for pediatric mental health care.

Objective

To examine the efficacy and moderators of gamified DMHIs for anxiety, depression, and ADHD in randomized clinical trials (RCTs) for children and adolescents.

Data Sources

A systematic search of PubMed, PsycInfo, and Web of Science was conducted for RCTs published before March 20, 2024.

Study Selection

RCTs that evaluated the efficacy of gamified DMHIs for treating pediatric ADHD, depression, or anxiety were included. Studies were excluded if they did not use a gamified DMHI, provide sufficient data for effect sizes, or were unavailable in English.

Data Extraction and Synthesis

Efficacy data were extracted from rating scales for ADHD, depression, and anxiety. Extracted moderator variables included participant characteristics (eg, age and sex), intervention characteristics (eg, delivery modality and time limit), and trial design characteristics (eg, outcome measure and risk of bias).

Main Outcomes and Measures

The primary outcome was change in ADHD, depression, or anxiety severity in the treatment group compared to the control group. Hedges g quantified treatment effects.

Results

The search strategy identified 27 RCTs that included 2911 participants across ADHD, depression, and anxiety disorders. There were modest significant effects of gamified DMHIs on ADHD (g, 0.28; 95% CI, 0.09 to 0.48) and depression (g, 0.28; 95% CI, 0.08 to 0.47) but small, nonsignificant effects for anxiety disorders (g, 0.07; 95% CI, -0.02 to 0.17). Moderator analyses revealed that DMHIs for ADHD delivered on a computer and those RCTs that had a greater preponderance of male participants produced larger treatment effects. DMHIs for depressive disorders that used preset time limits for gamified DMHIs also exhibited larger treatment effects.

Conclusions and Relevance

The findings suggest a benefit of gamified DMHIs for youth with ADHD or depressive disorder. Pediatricians and other health care professionals have new information about novel, accessible, and efficacious options for pediatric mental health care.

Using science as a differentiator in a crowded digital mental health market

The digital mental health industry has seen remarkable growth in recent years. However, within this crowded landscape, many companies overlook a critical factor for gaining a competitive edge: the integration of science. In this context, "science" refers to the strategic collection and analysis of information (i.e., data) at digital mental health companies, aimed at guiding business decisions and achieving business objectives. This paper demonstrates that science is integral, yet underutilized in the digital mental health industry, with common misconceptions about its role. When science is integrated within a company, it enables them to (1) innovate, (2) understand customers, (3) make informed decisions, and (4) drive revenue. Digital mental health companies recognizing the multifaceted value of science may be better equipped for sustainable growth and success amid the crowded digital health market.

Efficacy of stand-alone digital mental health applications for anxiety and depression: A meta-analysis of randomized controlled trials

BACKGROUND

Anxiety and depressive disorders affect 20% of the population, cause functional impairment, and represent a leading cause of disability. Although evidence-based treatments exist, the shortage of trained clinicians and high demand for mental health services have resulted in limited access to evidence-based care. Digital mental health applications (DMHA) present innovative, scalable, and sustainable solutions to address disparities in mental health care.

METHODS

The present study used meta-analytic techniques to evaluate the therapeutic effect of DMHAs in randomized controlled trials (RCTs) for individuals experiencing anxiety and/or depressive symptoms. Search terms were selected based on concepts related to digital mental health applications, mental health/wellness, intervention type, trial design, and anxiety and/or depression symptoms/diagnosis outcomes to capture all potentially eligible results. Potential demographic, DMHA, and trial design characteristics were examined as moderators of therapeutic effects.

RESULTS

Random effects meta-analyses found that stand-alone DMHAs produced a modest reduction in anxiety (g = 0.31) and depressive (g = 0.35) symptom severity. Several moderators influenced the therapeutic effects of DMHAs for anxiety and/or depressive symptoms including treatment duration, participant inclusion criteria, and outcome measures.

LIMITATIONS

Minimal information was available on DMHA usability and participant engagement with DMHAs within RCTs.

CONCLUSIONS

While DMHAs have the potential to be scalable and sustainable solutions to improve access and availability of evidence-based mental healthcare, moderator analyses highlight the considerations for implementation of DMHAs in practice. Further research is needed to understand factors that influence therapeutic effects of DMHAs and investigate strategies to optimize its implementation and overcome the extant research-to-practice gap.

LovesCompany: evaluating the safety and feasibility of a mental health-focused online community for adolescents

Background: Adolescents are at risk for mental health (MH) disorders but are unlikely to seek services and may be reluctant to talk about their MH. An anonymous, online MH-focused community could help reduce suffering. However, online forums can also promote negative behaviours such as cyberbullying. This study aimed to evaluate the safety and feasibility of an online community - LovesCompany - to improve MH outcomes for adolescents.Methods: American adolescents (14-17 years) were recruited through social media. Eligible participants were randomised to LovesCompany or a placebo MH resource site. Outcomes were assessed every other week for six months, and at twelve months. Multilevel models assessed group differences in depression, anxiety, and suicidal ideation. A subgroup of participants participated in qualitative interviews.Results: Participants (N = 202) were mostly female (70%), White non-Hispanic (69%), and cisgender (80%). There were no instances of inappropriate behaviour such as bullying or posting explicit content. Symptoms for both groups improved over time. Participants appreciated hearing others' experiences and valued the opportunity to offer support.Conclusion: Although adolescents are often resistant to MH treatment, they appear to be interested in anonymous, online, MH-focused conversation, and can benefit from giving and seeking support. Finding a balance between an appealing user experience, ethical considerations, and resource needs is challenging.