Flip the Clinic: A Digital Health Approach to Youth Mental Health Service Delivery During the COVID-19 Pandemic and Beyond

The Urgent Need for an Evidence-Based Digital Mental Health Practice Model of Care for Youth

Australian providers of mental health services and support for young people include private and public allied health providers, government initiatives (eg, headspace), nongovernment organizations (eg, Kids Helpline), general practitioners (GPs), and the hospital system. Over 20 years of research has established that many young people prefer to seek mental health support online; however, clear client pathways within and between online and offline mental health services are currently lacking. The authors propose a Digital Mental Health Practice model of care for youth to assist with digital mental health service mapping. The proposed model offers accessible pathways for a client to engage with digital mental health services, provides clear navigation to access support for individual needs, and facilitates a seamless connection with offline mental health services using a transferable electronic health records system. This future-looking model also includes emerging technologies, such as artificial intelligence and the metaverse, which must be accounted for as potential tools to be leveraged for digital therapies and support systems. The urgent need for a user-centered Digital Mental Health Practice model of care for youth in Australia is discussed, highlighting the shortcomings of traditional and existing online triage models evident during the COVID-19 pandemic, and the complex challenges that must be overcome, such as the integration of diverse mental health care providers and establishment of a robust electronic health records system. Potential benefits of such a model include reduced pressure on emergency rooms, improved identification of immediate needs, enhanced referral practices, and the establishment of a cost-efficient national digital mental health care model with global applicability. The authors conclude by stressing the consequences of inaction, warning that delays may lead to more complex challenges as new technologies emerge and exacerbate the long-term negative consequences of poor mental health management on the economic and biopsychosocial well-being of young Australians.

HealthySMS Text Messaging System Adjunct to Adolescent Group Cognitive Behavioral Therapy in the Context of COVID-19 (Let's Text!): Pilot Feasibility and Acceptability Study

BACKGROUND

The widespread occurrence and devastating impact of adolescent depression warrant health service research focused on feasible and acceptable digital health tools to supplement evidence-based intervention (EBI) efforts, particularly in the context of shelter-in-place guidelines disrupting youth socialization and service use in the wake of the COVID-19 pandemic. Given the promise of SMS text message interventions to enhance EBI engagement, our team developed the HealthySMS system as an adjunct to one of the most empirically supported interventions for adolescent depression: cognitive behavioral therapy (CBT) group services. The system sends daily SMS text messages requesting responses assessing mood, thoughts, and activities; weekly attendance reminder messages; daily tips about adherence (eg, a prompt for activity completion); and personalized responses based on participants' texts.

OBJECTIVE

This study aims to evaluate the feasibility and acceptability of HealthySMS in a real-world setting and explore potential mechanisms of change in EBI engagement, before evaluating the system's impact on adolescents' group CBT engagement and, ultimately, depression outcomes.

METHODS

Over the course of 2020, we invited all 20 adolescents receiving CBT group services for depression at an outpatient psychiatry clinic to enroll in our HealthySMS study; ultimately, 17 (85%) adolescents agreed to participate. We tracked participant initiation and engagement with the HealthySMS system as well as the content of SMS text message responses to HealthySMS. We also invited each participant to engage in a semistructured interview to gather additional qualitative inputs on the system.

RESULTS

All (n=17, 100%) research participants invited agreed to receive HealthySMS messages, and 94% (16/17) of the participants maintained use during the first month without opting out. We uncovered meaningful qualitative themes regarding the feasibility and acceptability of HealthySMS, as well as its potential impact on EBI engagement.

CONCLUSIONS

Taken together, the results of this pilot study suggest that HealthySMS adjunct to adolescent CBT group depression services is feasible and acceptable, as evidenced by high rates of HealthySMS initiation and low rates of dropout, as well as meaningful themes uncovered from participants' qualitative feedback. In addition, the findings provide evidence regarding iterative improvements to the HealthySMS system and research protocol, as well as potential mechanisms of change for enhanced EBI engagement and, ultimately, adolescent depression outcomes, which can be used in future effectiveness research.

Implementation of an Electronic Mental Health Platform for Youth and Young Adults in a School Context Across Alberta, Canada: Thematic Analysis of the Perspectives of Stakeholders

BACKGROUND

Youth, aged 15 to 24 years, are more likely to experience mental health (MH) or substance use issues than other age groups. This is a critical period for intervention because MH disorders, if left unattended, may become chronic and serious and negatively affect many aspects of a young person's life. Even among those who are treated, poor outcomes will still occur for a percentage of youth. Electronic MH (eMH) tools have been implemented in traditional MH settings to reach youth requiring assistance with MH and substance use issues. However, the utility of eMH tools in school settings has yet to be investigated.

OBJECTIVE

The objective of this study was to gain an understanding of the perspectives of key school staff stakeholders regarding barriers and facilitators to the implementation of the Innowell eMH platform in secondary schools across the province of Alberta, Canada.

METHODS

Guided by a qualitative descriptive approach, focus groups were conducted to elicit stakeholder perspectives on the perceived implementation challenges and opportunities of embedding the Innowell eMH platform in secondary school MH services. In total, 8 focus groups were conducted with 52 key school staff stakeholders.

RESULTS

Themes related to barriers and facilitators to youth and school MH care professional (MHCP) capacity in implementing and using eMH tools were identified. With respect to youth capacity barriers, the following themes were inductively generated: (1) concerns about some students not being suitable for eMH services, (2) minors requiring consent from parents or caregivers to use eMH services as well as confidentiality and privacy concerns, and (3) limited access to technology and internet service among youth. A second theme related to school MHCP barriers to implementation, which included (1) feeling stretched with high caseloads and change fatigue, (2) concerns with risk and liability, and (3) unmasking MH issues in the face of limited resources. In contrast to the barriers to youth and MHCP capacity, many facilitators to implementation were discussed. Youth capacity facilitators included (1) the potential for youth to be empowered using eMH tools, (2) the platform fostering therapeutic relationships with school personnel, and (3) enhancing access to needed services and resources. MHCP capacity facilitators to implementation were (1) system transformation through flexibility and problem-solving, (2) opportunities for collaboration with youth and MHCPs and across different systems, and (3) an opportunity for the continuity of services.

CONCLUSIONS

Our findings highlight nuanced school MHCP perspectives that demonstrate critical youth and MHCP capacity concerns, with consideration for organizational factors that may impede or enhance the implementation processes for embedding eMH in a school context. The barriers and facilitators to implementation provide future researchers and decision makers with challenges and opportunities that could be addressed in the preimplementation phase.

Perceptions of mental health providers of the barriers and facilitators of using and engaging youth in digital mental-health-enabled measurement based care

Objectives

Increased rates of mental health disorders and substance use among youth and young adults have increased globally, furthering the strain on an already burdened mental health system. Digital solutions have been proposed as a potential option for the provision of timely mental health services for youth, with little research exploring mental health professional views about using such innovative tools. In Alberta, Canada, we are evaluating the implementation and integration of a digital mental health (dMH) platform into existing service pathways. Within this paper we seek to explore mental health professionals' perceptions of the barriers and facilitators that may influence their utilization of digital MH-enabled measurement-based care (MBC) with the youth who access their services.

Methods

A qualitative, descriptive methodology was used to inductively generate themes from focus groups conducted with mental health professionals from specialized mental health services and primary care networks in Alberta.

Results

As mental health professionals considered the barriers and facilitators of using dMH with youth, they referenced individual and family barriers and facilitators to consider. Providers highlighted perceived barriers, including: first, cultural stigma, family apprehension about mental health care, and parental access to dMH and MBC as deterrents to providers adopting digital platforms in routine care; second, perceptions of increased responsibility and liability for youth in crisis; third, perception that some psychiatric and neurodevelopmental disorders in youth are not amenable to dMH; fourth, professionals contemplated youth readiness to engage with dMH-enabled MBC. Participants also highlighted pertinent facilitators to dMH use, noting: first, the suitability of dMH for youth with mild mental health concerns; second, youth motivated to report their changes in mental health symptoms; and lastly, youth proficiency and preference for dMH options.

Conclusions

By identifying professionals' perceptions of barriers and facilitators for youth users, we may better understand how to address misconceptions about who is eligible and appropriate for dMH through training and education.

Integrated care for children living with complex care needs: an evolutionary concept analysis

Children with complex care needs (CCNs) are in need of improved access to healthcare services, communication, and support from healthcare professionals to ensure high-quality care is delivered to meet their needs. Integrated care is viewed as a key component of care delivery for children with CCNs, as it promotes the integration of healthcare systems to provide family and child-centred care across the entire health spectrum. There are many definitions and frameworks that support integrated care, but there is a lack of conceptual clarity around the term. Furthermore, it is often unclear how integrated care can be delivered to children with CCNs, therefore reinforcing the need for further clarification on how to define integrated care. An evolutionary concept analysis was conducted to clarify how integrated care for children with CCNs is defined within current literature. We found that integrated care for children with CCNs refers to highly specialised individualised care within or across services, that is co-produced by interdisciplinary teams, families, and children, supported by digital health technologies.  Conclusion: Given the variation in terms of study design, outcomes, and patient populations this paper highlights the need for further research into methods to measure integrated care. What is Known: • Children with complex care needs require long-term care, and are in need of improved services, communication, and information from healthcare professionals to provide them with the ongoing support they need to manage their condition. • Integrated care is a key component in healthcare delivery for children with complex care needs as it has the potential to improve access to family-centred care across the entire health spectrum. What is New: • Integrated care for children with CCNs refers to highly specialised individualised care within or across services, that is co-produced by interdisciplinary teams, families, and children, supported by digital health technologies. • There is a need for the development of measurement tools to effectively assess integrated care within practice.

Young Adults' Mental Health and Unmet Service Needs in the Context of the COVID-19 Pandemic Across Canada and France

While young adults experienced mental health challenges during the COVID-19 pandemic, little is known about how their mental health needs were subsequently met through access to mental health services (MHS). From October to December 2020, we conducted an online survey of young adults (18-29 years) living in Canada and France to investigate factors associated with unmet MHS needs. Of the 3222 participants expressing a need to access MHS (50.7% of the total sample), 58.2% in Canada and 74.8% in France reported unmet MHS needs. In both countries, those who identified as men and those who lost income due to COVID-19, were more likely to report unmet MHS needs. In Canada, participants from Quebec, those living in rural areas, and those who experienced ethno-racial discrimination had higher odds of reporting such unmet needs. Urgent investments are needed to improve access to MHS for young adults during and after the COVID-19 pandemic.

Therapist perceptions of the implementation of a new screening procedure using the ItFits-toolkit in an iCBT routine care clinic: A mixed-methods study using the consolidated framework for implementation research

Introduction

This study investigates the implementation of a new, more automated screening procedure using the ItFits-toolkit in the online clinic, Internet Psychiatry (iPsych) (www.internetpsykiatrien.dk), delivering guided iCBT for mild to moderate anxiety and depressive disorders. The study focuses on how the therapists experienced the process.

Methods

Qualitative data were collected from semi-structured individual interviews with seven therapists from iPsych. The interviews were conducted using an interview guide with questions based on the Consolidated Framework for Implementation Research (CFIR). Quantitative data on the perceived level of normalization were collected from iPsych therapists, administrative staff, and off-site professionals in contact with the target demographic at 10-time points throughout the implementation.

Results

The therapists experienced an improvement in the intake procedure. They reported having more relevant information about the patients to be used during the assessment and the treatment; they liked the new design better; there was a better alignment of expectations between patients and therapists; the patient group was generally a better fit for treatment after implementation; and more of the assessed patients were included in the program. The quantitative data support the interview data and describe a process of normalization that increases over time.

Discussion

The ItFits-toolkit appears to have been an effective mediator of the implementation process. The therapists were aided in the process of change, resulting in an enhanced ability to target the patients who can benefit from the treatment program, less expenditure of time on the wrong population, and more satisfied therapists.

Evaluation of the Use of Digital Mental Health Platforms and Interventions: Scoping Review

BACKGROUND

The increasing use of digital mental health (DMH) platforms and digital mental health interventions (DMHIs) is hindered by uncertainty over effectiveness, quality and usability. There is a need to identify the types of available evidence in this domain.

AIM

This study is a scoping review identifying evaluation of the (1) DMH platform/s used; and (2) DMHI/s applied on the DMH platform/s.

METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guided the review process. Empirical studies that focused on evaluation of the use and application of DMH platforms were included from journal articles (published 2012-2022). A literature search was conducted using four electronic databases (Scopus, ScienceDirect, Sage and ACM Digital Library) and two search engines (PubMed and Google Scholar).

RESULTS

A total of 6874 nonduplicate records were identified, of which 144 were analyzed and 22 met the inclusion criteria. The review included general/unspecified mental health and/or suicidality indications (n = 9, 40.9%), followed by depression (n = 5, 22.7%), psychosis (n = 3, 13.6%), anxiety and depression (n = 2, 9.1%), as well as anxiety, depression and suicidality (n = 1, 4.5%), loneliness (n = 1, 4.5%), and addiction (n = 1, 4.5%). There were 11 qualitative studies (50%), 8 quantitative studies (36.4%), and 3 mixed-methods studies (n = 3, 13.6%). The results contained 11 studies that evaluated the DMH platform/s and 11 studies that evaluated the DMHI/s. The studies focused on feasibility, usability, engagement, acceptability and effectiveness. There was a small amount of significant evidence (1 in each 11), notably the (cost-)effectiveness of a DMHI with significant long-term impact on anxiety and depression in adults.

CONCLUSION

The empirical research demonstrates the feasibility of DMH platforms and DMHIs. To date, there is mostly heterogeneous, preliminary evidence for their effectiveness, quality and usability. However, a scalable DMHI reported effectiveness in treating adults' anxiety and depression. The scope of effectiveness may be widened through targeted strategies, for example by engaging independent young people.

Interventions in Chinese Undergraduate Students' Mental Health: Systematic Review

BACKGROUND

Over 30% of university students from 8 countries were afflicted with mental distress according to a World Health Organization survey. Undergraduate students in increasing numbers in China have also been reported to suffer from different mental problems. Various psychological distresses significantly impact their academic and daily life, thereby causing role impairments and unsatisfactory academic achievements. While the prevalence of, diverse underlying factors for, and interventions of social support in college students' mental health have extensively been investigated in China, there is no study exclusively focusing on the impact of interventions on their psychological well-being.

OBJECTIVE

The aim of this review was to identify and synthesize the interventions in the mental health concerns of Chinese undergraduate students studying in China reported in the literature to inform educational authorities, college and university management, students' affairs counselors, and mental health providers.

METHODS

We performed a systematic review and reported the research findings of previous studies according to the protocol of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 statement. First, based on the predefined search strategy, keyword searches were performed in the PubMed and ProQuest databases to retrieve relevant studies. Subsequently, we screened the candidate articles based on predefined inclusion and exclusion criteria. Finally, we analyzed the included papers for qualitative synthesis.

RESULTS

We retrieved a total of 675 studies from the PubMed and ProQuest databases using the search strategy on March 15, 2022. Among these candidate studies, 15 that were not written in English, 76 duplicates, and 149 studies of other document types were removed before screening. An additional 313 studies were excluded in the screening process, with 73 articles ruled out for being not relevant to interventions, not related to mental health, or not focused on undergraduate students in the full-text review. As a result, 49 papers were eligible and included in this systematic review. In the qualitative synthesis, we divided the interventions reported in the selected studies into two categories: (1) social support from government authorities, university authorities, students' affairs counselors and teachers, family members, health care authorities and professionals, and the media (various online platforms), and (2) various coping strategies adopted by undergraduate students themselves. We identified further research on mental health interventions that may be delivered by digital medical platforms, conversational agents (eg, chatbots), and researchers.

CONCLUSIONS

This was the first systematic review of interventions to address the mental health concerns of Chinese undergraduate students studying in China. The categorization of reported interventions and the identification of new intervention channels can effectively inform stakeholders. Interventions for undergraduate students' mental health is a research topic worth further investigation.

Digital technology for addressing cognitive impairment in recent-onset psychosis: A perspective

Cognitive impairments in psychosis negatively impact functional recovery and quality of life. Existing interventions for improving cognitive impairment in recent-onset psychosis show inconsistent treatment efficacy, small effects, suboptimal engagement and limited generalizability to daily life functioning. In this perspective we explore how digital technology has the potential to address these limitations in order to improve cognitive and functional outcomes in recent-onset psychosis. Computer programs can be used for standardized, automated delivery of cognitive remediation training. Virtual reality provides the opportunity for learning and practicing cognitive skills in real-world scenarios within a virtual environment. Smartphone apps could be used for notification reminders for everyday tasks to compensate for cognitive difficulties. Internet-based technologies can offer psychoeducation and training materials for enhancing cognitive skills. Early findings indicate some forms of digital interventions for cognitive enhancement can be effective, with well-established evidence for human-supported computer-based cognitive remediation in recent-onset psychosis. Emerging evidence regarding virtual reality is favorable for improving social cognition. Overall, blending digital interventions with human support improves engagement and effectiveness. Despite the potential of digital interventions for enhancing cognition in recent-onset psychosis, few studies have been conducted to date. Implementation challenges affecting application of digital technologies for cognitive impairment in recent-onset psychosis are sustained engagement, clinical integration, and lack of quality in the commercial marketplace. Future opportunities lie in including motivational frameworks and behavioral change interventions, increasing service engagement in young people and lived experience involvement in digital intervention development.

Youth mental health and/or addiction concerns and service needs during the COVID-19 pandemic: a qualitative exploration of caregiver experiences and perspectives

The COVID-19 pandemic has undoubtedly had a significant impact on youth mental health and/or addiction concerns and exacerbated pre-existing gaps in access to mental health and/or addiction care. Caregivers can support their youth in seeking and participating in care, however, their experiences in doing so in the pandemic and their perspectives of their youth's care needs are not well-understood. A descriptive qualitative study was conducted to better understand youth's and caregivers' experiences accessing care during the pandemic, from the caregivers' standpoint. Participants completed semi-structured qualitative interviews that focused on experiences seeking and accessing mental health and/or addiction services, with specific questions regarding their experiences accessing services during the pandemic. A total of 46 interviews were included in the thematic analysis of the data. Study findings highlight the impacts of the pandemic on everyday life, on youth mental health and/or addiction needs, on caregiver's experiences seeking and accessing services for their youth, and on service access, including perceptions of virtual care modalities. The discussion highlights the importance of focusing on factors that enable youth's participation in care, to ensure accessibility of appropriate and timely care that meets youth's and families' needs. Also highlighted is the frustration and despair experienced by caregivers seeking critical mental health and addictions supports for their youth during the pandemic, as well as the sense of isolation and of being left behind by the system. Identifying caregiver perspectives of youth mental health and addiction needs and service access during the COVID-19 pandemic provided important insights that can help inform approaches to youth mental health and addictions care during the pandemic and beyond.

The gap between perceived mental health needs and actual service utilization in Australian adolescents

Despite being highly prevalent, adolescent mental health problems are undertreated. To better understand the mental health treatment gap, we assessed the prevalence and correlates of help-seeking, including perceived need for care and access to that care. Data were drawn from Young Minds Matter (YMM) survey-the second Australian child and adolescents survey of mental health and wellbeing. Parent-reported data and self-reported child data were combined into one dataset to analyse 2464 Australian adolescents aged 13-17 years. We employed bivariate and multivariate logistic regression models to assess the correlation between independent variables (professionally assessed with mental disorders only, self-reported self-harm/suicidality only and both) and their distribution over outcome variables (perceived need and service use). Mental disorders include depression, anxiety, ADHD and conduct disorder. Our study revealed 15.0%, 4.6% and 7.7% had professionally assessed with mental disorders only, self-reported self-harm/suicidality only and both, respectively. Overall, 47.4% and 27.5% of adolescents respectively perceived need for care and used services in the past-12-months. While among those only who perceived the need, only 53% of adolescents used any services. Professionally assessed with mental disorders only, self-reported self-harm/suicidality only and both were associated with higher likelihood of perceived need and service use (p < 0.001 for all). However, adolescents who self-reported self-harm/suicidality only were not found to be significantly associated with service use among those who perceived the need for care. Adolescents who perceived the need for mental health care but did not seek care represent a treatment gap. Our results suggest the importance of reducing the wide treatment gap that exists between need and care.

Informing the Future of Integrated Digital and Clinical Mental Health Care: Synthesis of the Outcomes From Project Synergy

BACKGROUND

Globally, there are fundamental shortcomings in mental health care systems, including restricted access, siloed services, interventions that are poorly matched to service users' needs, underuse of personal outcome monitoring to track progress, exclusion of family and carers, and suboptimal experiences of care. Health information technologies (HITs) hold great potential to improve these aspects that underpin the enhanced quality of mental health care.

OBJECTIVE

Project Synergy aimed to co-design, implement, and evaluate novel HITs, as exemplified by the InnoWell Platform, to work with standard health care organizations. The goals were to deliver improved outcomes for specific populations under focus and support organizations to enact significant system-level reforms.

METHODS

Participating health care organizations included the following: Open Arms-Veterans & Families Counselling (in Sydney and Lismore, New South Wales [NSW]); NSW North Coast headspace centers for youth (Port Macquarie, Coffs Harbour, Grafton, Lismore, and Tweed Heads); the Butterfly Foundation's National Helpline for eating disorders; Kildare Road Medical Centre for enhanced primary care; and Connect to Wellbeing North Coast NSW (administered by Neami National), for population-based intake and assessment. Service users, families and carers, health professionals, and administrators of services across Australia were actively engaged in the configuration of the InnoWell Platform to meet service needs, identify barriers to and facilitators of quality mental health care, and highlight potentially the best points in the service pathway to integrate the InnoWell Platform. The locally configured InnoWell Platform was then implemented within the respective services. A mixed methods approach, including surveys, semistructured interviews, and workshops, was used to evaluate the impact of the InnoWell Platform. A participatory systems modeling approach involving co-design with local stakeholders was also undertaken to simulate the likely impact of the platform in combination with other services being considered for implementation within the North Coast Primary Health Network to explore resulting impacts on mental health outcomes, including suicide prevention.

RESULTS

Despite overwhelming support for integrating digital health solutions into mental health service settings and promising impacts of the platform simulated under idealized implementation conditions, our results emphasized that successful implementation is dependent on health professional and service readiness for change, leadership at the local service level, the appropriateness and responsiveness of the technology for the target end users, and, critically, funding models being available to support implementation. The key places of interoperability of digital solutions and a willingness to use technology to coordinate health care system use were also highlighted.

CONCLUSIONS

Although the COVID-19 pandemic has resulted in the widespread acceptance of very basic digital health solutions, Project Synergy highlights the critical need to support equity of access to HITs, provide funding for digital infrastructure and digital mental health care, and actively promote the use of technology-enabled, coordinated systems of care.

Human-Computer Interaction in Digital Mental Health

Human-computer interaction (HCI) has contributed to the design and development of some efficient, user-friendly, cost-effective, and adaptable digital mental health solutions. But HCI has not been well-combined into technological developments resulting in quality and safety concerns. Digital platforms and artificial intelligence (AI) have a good potential to improve prediction, identification, coordination, and treatment by mental health care and suicide prevention services. AI is driving web-based and smartphone apps; mostly it is used for self-help and guided cognitive behavioral therapy (CBT) for anxiety and depression. Interactive AI may help real-time screening and treatment in outdated, strained or lacking mental healthcare systems. The barriers for using AI in mental healthcare include accessibility, efficacy, reliability, usability, safety, security, ethics, suitable education and training, and socio-cultural adaptability. Apps, real-time machine learning algorithms, immersive technologies, and digital phenotyping are notable prospects. Generally, there is a need for faster and better human factors in combination with machine interaction and automation, higher levels of effectiveness evaluation and the application of blended, hybrid or stepped care in an adjunct approach. HCI modeling may assist in the design and development of usable applications, and to effectively recognize, acknowledge, and address the inequities of mental health care and suicide prevention and assist in the digital therapeutic alliance.

Why are Patient Portals Important in the Age of COVID-19? Reflecting on Patient and Team Experiences From a Toronto Hospital Network

The COVID-19 pandemic has changed how care is being delivered in Canada. With conventional in-person care being transitioned to virtual care, the approach that patients are able to engage and access their care has dramatically changed. At the University Health Network (UHN), which is Canada's largest academic and teaching hospital network, we expanded the myUHN Patient Portal in 2017 after its early adopter phase to enable patients and family members to view parts of their clinical notes and test results. As the pandemic progressed, we observed high adoption of myUHN to support virtual care and rapid delivery of COVID-19 test results in real time. In this article, we share and reflect on our experience of adapting myUHN to support the demands of the pandemic, including portal adoption outcomes across multiple waves of the pandemic, the impetus for increased patient experience staff dedicated for myUHN support, and patients’ perceptions of the value of the portal and virtual care. Based on these reflections, we outline our perspectives on the future role of patient portals to support patient care and experience in a post-pandemic environment.

Evaluation of an Online System for Routine Outcome Monitoring: Cross-sectional Survey Study

BACKGROUND

The use of routine outcome monitoring (ROM) in the treatment of mental health has emerged as a method of improving psychotherapy treatment outcomes. Despite this, very few clinicians regularly use ROM in clinical practice. Online ROM has been suggested as a solution to increase adoption.

OBJECTIVE

The aim of this study is to identify the influence of moving ROM online on client completion rates of self-reported outcome measures and to identify implementation and utilization barriers to online ROM by assessing clinicians' views on their experience using the online system over previous paper-based methods.

METHODS

Client completion rates of self-reported outcome measures were compared pre- and postimplementation of an online system of ROM. In addition, a survey questionnaire was administered to 324 mental health service providers regarding their perception of the benefits with an online system of ROM.

RESULTS

Client completion rates of self-reported measures increased from 15.62% (427/2734) to 53.98% (1267/2347) after they were moved online. Furthermore, 57% (56/98) of service providers found the new system less time-consuming than the previous paper-based ROM, and 64% (63/98) found that it helped monitor clients. However, the perceived value of the system remains in doubt as only 23% (23/98) found it helped them identify clients at risk for treatment failure, and only 18% (18/98) found it strengthened the therapeutic alliance.

CONCLUSIONS

Although the current study suggests mixed results regarding service providers' views on their experience using an online system for ROM, it has identified barriers and challenges that are actionable for improvement.

Investigating the Persuasive Effects of Testimonials on the Acceptance of Digital Stress Management Trainings Among University Students and Underlying Mechanisms: A Randomized Controlled Trial

Objective: This experiment aims to investigate the influence of narrative information varying in the degree of perceived similarity and source credibility in supplemented testimonials on the acceptance of digital mental health services (digi-MHSs).

Methods: In fall 2020, n=231 university students were randomly assigned to an active control group (aCG, n=55, “information only”) or one of three intervention groups (IGs) receiving information plus different testimonials being presented either by nonacademic staff (IG1, n=60), university students (IG2, n=58) or experts (IG3, n=58). We assessed mediation effects of similarity and credibility on acceptance in terms of attitudes and usage intentions.

Results: Exposure to testimonials was associated with higher usage intentions (d=0.50) and more positive attitudes toward digi-MHSs (d=0.32) compared to mere information (aCG). Regarding source-related effects, one-way ANOVA showed group differences in intentions (ηp2=0.13) that were significantly higher after exposure to testimonials targeted at students than in the other groups after adjusting for baseline intentions (ηp2=0.24). Concerning underlying mechanisms, there were full mediation effects of similarity (IG1 versus IG2) on attitudes [95%CI (0.030, 0.441)] and intentions to use digi-MHSs [95%CI (0.100, 0.528)] and of credibility on attitudes [IG2 versus IG3; 95%CI (−0.217, −0.004)], all favoring students’ testimonials.

Conclusion: Overall, this study indicates that the acceptance of digi-MHSs can be substantially increased by providing a simple, context-sensitive information intervention, including testimonials by university students. Since we identified mediating effects of credibility on cognitive attitudes and similarity on affect-driven intentions, a future trial could vary these features using narrative versus statistic information on digi-MHSs.

Learning About the Current State of Digital Mental Health Interventions for Canadian Youth to Inform Future Decision-Making: Mixed Methods Study

Background

The COVID-19 pandemic has increased the demand for youth mental health services in Canada as disruptions to clinical care continue to persist due to the risk of transmission and exposure to the virus. Digital mental health interventions, including web-based resources and mobile apps, have provided opportunities to support youth mental health remotely across Canada. There is a need to better understand how these digital interventions are being selected, recommended, and used in various regions across Canada.

Objective

A national jurisdictional scan was completed to (1) determine what web-based programs, apps, and websites are promoted and licensed in Canada for youth mental health; (2) identify criteria and decision-making processes that Canadian jurisdictions use to select web-based programs, apps, and websites for youth mental health; and (3) identify upcoming trends, innovations, and digital mental health possibilities that are emerging in the youth sector.

Methods

The aims of the jurisdictional scan were addressed through a review of related academic and grey literature; stakeholder interviews, including individuals involved in various areas of the youth mental health sector; and a social media review of pertinent Twitter content.

Results

A total of 66 web-based resources and apps were identified for use by youth in Canada. 16 stakeholder interviews were completed and included discussions with researchers, clinicians, youth organizations, and others involved in digital interventions for youth mental health. These discussions identified a limited use of frameworks used to guide decision-making processes when selecting digital interventions. Many clinicians agreed on a similar set of eligibility requirements for youth mental health apps and digital resources, such as the evidence base and cultural relevance of the intervention. Stakeholders also identified upcoming trends and innovations in the youth digital mental health space, including artificial intelligence, digital phenotyping, and personalized therapy. Over 4 weeks, 2184 tweets were reviewed to identify and compare global and national trends and innovations involving digital mental health and youth. Key trends included the promotion of regional chat services as well as the effects of the COVID-19 pandemic on youth mental health and access to care.

Conclusions

As organizations begin to plan for the delivery of mental health care following the pandemic, there are concerns about the sustainability of these digital mental health interventions as well as a need for services to be more informed by the experiences and preferences of youth.

Privacy Practices of Health Information Technologies: Privacy Policy Risk Assessment Study and Proposed Guidelines

Background

Along with the proliferation of health information technologies (HITs), there is a growing need to understand the potential privacy risks associated with using such tools. Although privacy policies are designed to inform consumers, such policies have consistently been found to be confusing and lack transparency.

Objective

This study aims to present consumer preferences for accessing privacy information; develop and apply a privacy policy risk assessment tool to assess whether existing HITs meet the recommended privacy policy standards; and propose guidelines to assist health professionals and service providers with understanding the privacy risks associated with HITs, so that they can confidently promote their safe use as a part of care.

Methods

In phase 1, participatory design workshops were conducted with young people who were attending a participating headspace center, their supportive others, and health professionals and service providers from the centers. The findings were knowledge translated to determine participant preferences for the presentation and availability of privacy information and the functionality required to support its delivery. Phase 2 included the development of the 23-item privacy policy risk assessment tool, which incorporated material from international privacy literature and standards. This tool was then used to assess the privacy policies of 34 apps and e-tools. In phase 3, privacy guidelines, which were derived from learnings from a collaborative consultation process with key stakeholders, were developed to assist health professionals and service providers with understanding the privacy risks associated with incorporating HITs as a part of clinical care.

Results

When considering the use of HITs, the participatory design workshop participants indicated that they wanted privacy information to be easily accessible, transparent, and user-friendly to enable them to clearly understand what personal and health information will be collected and how these data will be shared and stored. The privacy policy review revealed consistently poor readability and transparency, which limited the utility of these documents as a source of information. Therefore, to enable informed consent, the privacy guidelines provided ensure that health professionals and consumers are fully aware of the potential for privacy risks in using HITs to support health and well-being.

Conclusions

A lack of transparency in privacy policies has the potential to undermine consumers’ ability to trust that the necessary measures are in place to secure and protect the privacy of their personal and health information, thus precluding their willingness to engage with HITs. The application of the privacy guidelines will improve the confidence of health professionals and service providers in the privacy of consumer data, thus enabling them to recommend HITs to provide or support care.

Supporting Clinicians to Use Technology to Deliver Highly Personalized and Measurement-Based Mental Health Care to Young People: Protocol for an Evaluation Study

BACKGROUND

Australia's mental health care system has long been fragmented and under-resourced, with services falling well short of demand. In response, the World Economic Forum has recently called for the rapid deployment of smarter, digitally enhanced health services to facilitate effective care coordination and address issues of demand. The University of Sydney's Brain and Mind Centre (BMC) has developed an innovative digital health solution that incorporates 2 components: a highly personalized and measurement-based (data-driven) model of youth mental health care and a health information technology (HIT) registered on the Australian Register of Therapeutic Goods. Importantly, research into implementation of such solutions considers education and training of clinicians to be essential to adoption and optimization of use in standard clinical practice. The BMC's Youth Mental Health and Technology Program has subsequently developed a comprehensive education and training program to accompany implementation of the digital health solution.

OBJECTIVE

This paper describes the protocol for an evaluation study to assess the effectiveness of the education and training program on the adoption and optimization of use of the digital health solution in service delivery. It also describes the proposed tools to assess the impact of training on knowledge and skills of mental health clinicians.

METHODS

The evaluation study will use the Kirkpatrick Evaluation Model as a framework with 4 levels of analysis: Reaction (to education and training), Learning (knowledge acquired), Behavior (practice change), and Results (client outcomes). Quantitative and qualitative data will be collected using a variety of tools, including evaluation forms, pre- and postknowledge questionnaires, skill development and behavior change scales, as well as a real-time clinical practice audit.

RESULTS

This project is funded by philanthropic funding from Future Generation Global. Ethics approval has been granted via Sydney Local Health District's Human Research Ethics Committee. At the time of this publication, clinicians and their services were being recruited to this study. The first results are expected to be submitted for publication in 2021.

CONCLUSIONS

The education and training program teaches clinicians the necessary knowledge and skills to assess, monitor, and manage complex needs; mood and psychotic syndromes; and trajectories of youth mental ill-health using a HIT that facilitates a highly personalized and measurement-based model of care. The digital health solution may therefore guide clinicians to help young people recover low functioning associated with subthreshold diagnostic presentations and prevent progression to more serious mental ill-health.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/24697.

Digital Clinics and Mobile Technology Implementation for Mental Health Care

PURPOSE OF REVIEW

Interest in digital mental health, especially smartphone apps, has expanded in light of limited access to mental health services and the need for remote care during COVID-19. Digital clinics, in which apps are blended into routine care, offer a potential solution to common implementation challenges including low user engagement and lack of clinical integration of apps.

RECENT FINDINGS

While the number of mental health apps available in commercial marketplaces continues to rise, there are few examples of successful implementation of these apps into care settings. We review one example of a digital clinic created within an academic medical center and another within the Department of Veterans Affairs. We then discuss how implementation science can inform new efforts to effectively integrate mental health technologies across diverse use cases. Integrating mental health apps into care settings is feasible but requires careful attention to multiple domains that will influence implementation success, including characteristics of the innovation (e.g., utility and complexity of the app), the recipients of the technology (e.g., patients and clinicians), and context (e.g., healthcare system buy-in, reimbursement, and regulatory policies). Examples of effective facilitation strategies that can be utilized to improve implementation efforts include co-production of technology involving all end users, specialized trainings for staff and patients, creation of new team members to aid in app usage (e.g., digital navigators), and re-design of clinical workflows.

Digital Mental Health Challenges and the Horizon Ahead for Solutions

The demand outstripping supply of mental health resources during the COVID-19 pandemic presents opportunities for digital technology tools to fill this new gap and, in the process, demonstrate capabilities to increase their effectiveness and efficiency. However, technology-enabled services have faced challenges in being sustainably implemented despite showing promising outcomes in efficacy trials since the early 2000s. The ongoing failure of these implementations has been addressed in reconceptualized models and frameworks, along with various efforts to branch out among disparate developers and clinical researchers to provide them with a key for furthering evaluative research. However, the limitations of traditional research methods in dealing with the complexities of mental health care warrant a diversified approach. The crux of the challenges of digital mental health implementation is the efficacy and evaluation of existing studies. Web-based interventions are increasingly used during the pandemic, allowing for affordable access to psychological therapies. However, a lagging infrastructure and skill base has limited the application of digital solutions in mental health care. Methodologies need to be converged owing to the rapid development of digital technologies that have outpaced the evaluation of rigorous digital mental health interventions and strategies to prevent mental illness. The functions and implications of human-computer interaction require a better understanding to overcome engagement barriers, especially with predictive technologies. Explainable artificial intelligence is being incorporated into digital mental health implementation to obtain positive and responsible outcomes. Investment in digital platforms and associated apps for real-time screening, tracking, and treatment offer the promise of cost-effectiveness in vulnerable populations. Although machine learning has been limited by study conduct and reporting methods, the increasing use of unstructured data has strengthened its potential. Early evidence suggests that the advantages outweigh the disadvantages of incrementing such technology. The limitations of an evidence-based approach require better integration of decision support tools to guide policymakers with digital mental health implementation. There is a complex range of issues with effectiveness, equity, access, and ethics (eg, privacy, confidentiality, fairness, transparency, reproducibility, and accountability), which warrant resolution. Evidence-informed policies, development of eminent digital products and services, and skills to use and maintain these solutions are required. Studies need to focus on developing digital platforms with explainable artificial intelligence-based apps to enhance resilience and guide the treatment decisions of mental health practitioners. Investments in digital mental health should ensure their safety and workability. End users should encourage the use of innovative methods to encourage developers to effectively evaluate their products and services and to render them a worthwhile investment. Technology-enabled services in a hybrid model of care are most likely to be effective (eg, specialists using these services among vulnerable, at-risk populations but not severe cases of mental ill health).