The Optimization of an eHealth Solution (Thought Spot) with Transition-Aged Youth in Postsecondary Settings: Participatory Design Research

Enhancing the value of digital health tools for mental health help-seeking in Canadian transitional aged youth during the pandemic: Qualitative study

While the COVID-19 pandemic has greatly exacerbated the mental health challenges of transition-aged youth (TAY) between 17 and 29 years old, it has also led to the rapid adoption of digital tools for mental health help-seeking and treatment. However, to date, there has been limited work focusing on how this shift has impacted perceptions, needs and challenges of this population in using digital tools. The current study aims to understand their perspectives on mental health help-seeking during the pandemic and emerging issues related to digital tools (e.g., digital health equity, inclusivity). A total of 16 TAY were invited from three post-secondary institutions in the Greater Toronto Area. A total of two streams of focus groups were held and participants were invited to share their perceptions, needs and experiences. Five main themes were identified: 1) Helpfulness of a centralized resource encompassing a variety of diverse mental health supports help-seeking; 2) The impact of the shift to online mental health support on the use of informal supports; 3) Digital tool affordability and availability; 4) Importance of inclusivity for digital tools; and 5) Need for additional support for mental health seeking and digital tool navigation. Future work should examine how these needs can be addressed through new and existing digital mental health help-seeking tools for TAY.

Evaluating the Psychometric Properties and Clinical Utility of a Digital Psychosocial Self-Screening Tool (HEARTSMAP-U) for Postsecondary Students: Prospective Cohort Study

BACKGROUND

Existing screening tools for mental health issues among postsecondary students have several challenges, including a lack of standardization and codevelopment by students. HEARTSMAP-U was adapted to address these issues.

OBJECTIVE

This study aimed to evaluate the suitability of HEARTSMAP-U as a self-screening tool for psychosocial issues among postsecondary students by evaluating its validity evidence and clinical utility.

METHODS

A prospective cohort study was conducted with University of British Columbia Vancouver students to evaluate HEARTSMAP-U's predictive validity and convergent validity. Participating students completed baseline and 3-month follow-up assessments via HEARTSMAP-U and a clinician-administered interview.

RESULTS

In a diverse student sample (n=100), HEARTSMAP-U demonstrated high sensitivity (95%-100%) in identifying any psychiatric concerns that were flagged by a research clinician, with lower specificity (21%-25%). Strong convergent validity (r=0.54-0.68) was demonstrated when relevant domains and sections of HEARTSMAP-U were compared with those of other conceptually similar instruments.

CONCLUSIONS

This preliminary evaluation suggests that HEARTSMAP-U may be suitable for screening in the postsecondary educational setting. However, a larger-scale evaluation is necessary to confirm and expand on these findings.

Canada's Student Mental Health Network: Protocol for a Comprehensive Program Evaluation

BACKGROUND

Prevalence estimates for mental health-related problems, including above-average stress, psychological distress, and symptoms of mental illnesses have increased significantly among Canadian postsecondary students. As demand for downstream mental treatment has surpassed many institutions' abilities to deliver timely care, there is a need for innovative upstream supports that foster mental health promotion and mental illness prevention among this population.

OBJECTIVE

Supported by an extensive network of student volunteers, Canada's Student Mental Health Network is a virtual, one-stop shop for centralized mental health education and evidence-based resources tailored to postsecondary students. This article describes a protocol for the comprehensive evaluation of the Network.

METHODS

Development of the Network was developed using a participatory action research framework. Network content is created and curated by students and reviewed by subject matter experts. The proposed program evaluation will include both a formative process evaluation and a summative impact assessment to determine the feasibility, acceptability, and utility of the Network in addition to assessing change in the 3 primary outcomes of interest: mental health literacy, perceived social support, and help-seeking behavior. Participants will be recruited directly from the Network website using a "rolling" recruitment approach to allow for continuous data collection and evaluation. A combination of qualitative (ie, interviews) and quantitative (ie, surveys) methods of data collection will be used.

RESULTS

The process of evaluation of the Network will begin in September 2022, collecting data for 1 year. In September 2023, the impact evaluation will begin using the same follow-up schedule. Data collection will then remain ongoing to facilitate the continued evaluation of the Network. Reports detailing evaluation data will be released annually.

CONCLUSIONS

The Network is a novel and innovative method of delivering universal mental health promotion to Canadian postsecondary students by providing centralized and freely accessible mental health education and resources, created by students and validated by subject matter experts. The continued creation and curation of resources for the Network will be ongoing to meet the evolving needs of the target population.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/41521.

Understanding the Barriers of Implementing a Self-Awareness Assessment in Occupational Therapy Practice within a Brain Injury Population: An Exploratory Study

Background

Self-awareness is seldom formally assessed by occupational therapists among individuals with traumatic brain injury (TBI). However, impaired self-awareness is prevalent and has a significant impact on rehabilitation outcomes. There is a need to understand clinician perspectives on self-awareness assessments and promote evidence-based practice in clinical settings.

Aims

(1) Explore how an education session impacts knowledge and use of self-awareness assessments in occupational therapists working with people with TBI; (2) Understand the barriers that occupational therapists experience when assessing self-awareness in clinical practice.

Materials and Methods

A single-group pre-post session design with an integrated knowledge translation approach was used. Occupational therapists working in neurorehabilitation were recruited from two rehabilitation centres through convenience sampling. Participants completed questionnaires before, after, and three months following an education session about the Self-Awareness of Deficits (SADI) assessment.

Results

14 occupational therapists participated in this study. A statistically significant increase in knowledge and confidence in using the SADI was observed both post-session and at 3-month follow-up.

Conclusion

Targeted and ongoing education promotes confidence and knowledge retention among occupational therapists. Further research should explore strategies to promote behaviour change. Significance. The barriers identified in this study can provide insights for knowledge translation across clinical contexts.

Moderated digital social therapy for young people with emerging mental health problems: A user-centered mixed-method design and usability study

Introduction

Over 25% of Dutch young people are psychologically unhealthy. Individual and societal consequences that follow from having mental health complaints at this age are substantial. Young people need care which is often unavailable. ENgage YOung people earlY (ENYOY) is a moderated digital social therapy-platform that aims to help youngsters with emerging mental health complaints. Comprehensive research is being conducted into the effects and to optimize and implement the ENYOY-platform throughout the Netherlands. The aim of this study is to explore the usability and user experience of the ENYOY-platform.

Methods

A user-centered mixed-method design was chosen. 26 young people aged 16-25 with emerging mental health complaints participated. Semi-structured interviews were conducted to explore usability, user-friendliness, impact, accessibility, inclusivity, and connection (Phase 1). Phase 2 assessed usability problems using the concurrent and retrospective Think Aloud-method. User experience and perceived helpfulness were assessed using a 10-point rating scale and semi-structured interviews (Phase 3). The Health Information Technology Usability Evaluation Scale (Health-ITUES; Phase 1) and System Usability Scale (SUS; Phase 2 and 3) were administered. Qualitative data was analyzed using thematic analysis. Task completion rate and time were tracked and usability problems were categorized using the Nielsen's rating scale (Phase 2).

Results

Adequate to high usability was found (Phase 1 Health-ITUES 4.0(0.34); Phase 2 SUS 69,5(13,70); Phase 3 SUS 71,6(5,63)). Findings from Phase 1 (N = 10) indicated that users viewed ENYOY as a user-friendly, safe, accessible, and inclusive initiative which helped them reduce their mental health complaints and improve quality of life. Phase 2 (N = 10) uncovered 18 usability problems of which 5 of major severity (e.g. troubles accessing the platform). Findings from Phase 3 (N = 6) suggested that users perceived the coaching calls the most helpful [9(0.71)] followed by the therapy content [6.25(1.41)]. Users liked the social networking aspect but rated it least helpful [6(2.1)] due to inactivity.

Conclusion

The ENYOY-platform has been found to have adequate to high usability and positive user experiences were reported. All findings will be transferred to the developmental team to improve the platform. Other evaluation methods and paring these with quantitative outcomes could provide additional insight in future research.

Optimizing Internet Use during Adolescence: eHealth Solutions

Internet offers an immense opportunity as a resource for education, training, and health promotion. This narrative review summarizes the opportunities for health promotion among adolescents through use of the Internet and technology (defined as eHealth). The details of technology and use of Internet for adolescent-health related topics such as nutrition, fitness, sexual health, adventure, and violence were searched through PubMed. The review reports few digital solutions to address key challenges during adolescence like promotion of nutrition and sexual reproductive health, prevention of noncommunicable diseases, substance abuse, and mental health issues. eHealth was concluded as a potential solution for preventive and promotional health practices during adolescence. However, concerns of Internet addiction, safety, privacy, mental health disorders, and misinformation need to be addressed and monitored during adolescence.

Developing an mHealth App for Empowering Cancer Survivors With Disabilities: Co-design Study

Background

The transition from active treatment to long-term cancer survivorship leaves the needs of many cancer survivors unaddressed as they struggle with physical, cognitive, psychological, and social consequences of cancer and its treatment. The lack of guidance after treatment has forced cancer survivors to manage long-term effects on their own, which has an impact on their overall health, quality of life, and social participation. Mobile health (mHealth) interventions can be used to promote self-management and evidence-informed education.

Objective

This study aims to design an mHealth app for cancer survivors with disabilities that will offer interventions to improve their quality of life and increase their self-efficacy to manage cancer as a chronic condition.

Methods

We organized 3 co-design workshops with cancer survivors (n=5). These workshops included persona development based on data from 25 interviews with cancer survivors with disabilities; prototype ideation, where we sketched ideas for the prototype; and prototype development, where participants critiqued, and suggested improvements for, the wireframes.

Results

These workshops helped us to define the challenges that cancer survivors with disabilities face as well as important considerations when designing an mHealth app for cancer survivors with disabilities, such as the need for including flexibility, engagement, socialization, and a minimalistic design. We also outline guidelines for other researchers to follow when planning their own co-design workshops, which include allowing more time for discussion among participants, having small participant groups, keeping workshops engaging and inclusive, and letting participants dream big.

Conclusions

Using a co-design process aided us in developing a prototype of an mHealth app for cancer survivors with disabilities as well as a list of guidelines that other researchers can use to develop their own co-design workshops and design their app. Furthermore, working together with cancer survivors ensured that the design team had a deeper sense of empathy toward the target users and kept the focus on our ultimate goal: creating something that cancer survivors would want to use and benefit from. Future work will include usability testing of a high-fidelity prototype based on the results of these workshops.

Best Practices and Lessons Learned for Action Research in eHealth Design and Implementation: Literature Review

BACKGROUND

Action research (AR) is an established research framework to introduce change in a community following a cyclical approach and involving stakeholders as coresearchers in the process. In recent years, it has also been used for eHealth development. However, little is known about the best practices and lessons learned from using AR for eHealth development.

OBJECTIVE

This literature review aims to provide more knowledge on the best practices and lessons learned from eHealth AR studies. Additionally, an overview of the context in which AR eHealth studies take place is given.

METHODS

A semisystematic review of 44 papers reporting on 40 different AR projects was conducted to identify the best practices and lessons learned in the research studies while accounting for the particular contextual setting and used AR approach.

RESULTS

Recommendations include paying attention to the training of stakeholders' academic skills, as well as the various roles and tasks of action researchers. The studies also highlight the need for constant reflection and accessible dissemination suiting the target group.

CONCLUSIONS

This literature review identified room for improvements regarding communicating and specifying the particular AR definition and applied approach.

Using Co-design in Mobile Health System Development: A Qualitative Study With Experts in Co-design and Mobile Health System Development

BACKGROUND

The proliferation of mobile devices has enabled new ways of delivering health services through mobile health systems. Researchers and practitioners emphasize that the design of such systems is a complex endeavor with various pitfalls, including limited stakeholder involvement in design processes and the lack of integration into existing system landscapes. Co-design is an approach used to address these pitfalls. By recognizing users as experts of their own experience, co-design directly involves users in the design process and provides them an active role in knowledge development, idea generation, and concept development.

OBJECTIVE

Despite the existence of a rich body of literature on co-design methodologies, limited research exists to guide the co-design of mobile health (mHealth) systems. This study aims to contextualize an existing co-design framework for mHealth applications and construct guidelines to address common challenges of co-designing mHealth systems.

METHODS

Tapping into the knowledge and experience of experts in co-design and mHealth systems development, we conducted an exploratory qualitative study consisting of 16 semistructured interviews. Thereby, a constructivist ontological position was adopted while acknowledging the socially constructed nature of reality in mHealth system development. Purposive sampling across web-based platforms (eg, Google Scholar and ResearchGate) and publications by authors with co-design experience in mHealth were used to recruit co-design method experts (n=8) and mHealth system developers (n=8). Data were analyzed using thematic analysis along with our objectives of contextualizing the co-design framework and constructing guidelines for applying co-design to mHealth systems development.

RESULTS

The contextualized framework captures important considerations of the mHealth context, including dedicated prototyping and implementation phases, and an emphasis on immersion in real-world contexts. In addition, 7 guidelines were constructed that directly pertain to mHealth: understanding stakeholder vulnerabilities and diversity, health behavior change, co-design facilitators, immersion in the mHealth ecosystem, postdesign advocates, health-specific evaluation criteria, and usage data and contextual research to understand impact.

CONCLUSIONS

System designers encounter unique challenges when engaging in mHealth systems development. The contextualized co-design framework and constructed guidelines have the potential to serve as a shared frame of reference to guide the co-design of mHealth systems and facilitate interdisciplinary collaboration at the nexus of information technology and health research.

Online mental health interventions designed for students in higher education: A user-centered perspective

BACKGROUND

Digital mental health interventions have been posited as a way of reducing the burden on mental health services in higher education institutions. However, low adherence and high attrition rates present a challenge that limits the effectiveness of these interventions. User-centered design has been proposed as a suitable approach in improving the adherence of users to these interventions.

OBJECTIVE

The objective of this scoping review was to examine digital mental health interventions that have been designed specifically for students in higher education. It aimed to summarize the published literature on digital mental health interventions which take a user-centered approach in developing interventions for students in higher education.

METHODS

A scoping review of peer-reviewed research papers from the following electronic databases was conducted: Embase, ACM digital library, Web of Science, IEEE Explore, SCOPUS, EBSCO Host (including APA PyscInfo, CINAHL PLUS, APA PsycArticles, Medline), PubMed and Google Scholar. Databases were searched from inception until 13 Jan and 14 Jan 2021. Of the 755 articles that were identified, 57 articles were selected for full review. 34 articles were excluded for not matching the inclusion criteria.

RESULTS

23 studies were included in this review. The included interventions targeted various areas of mental health including depression, anxiety, overall wellbeing, and mental health awareness. The interventions were commonly delivered through mobile apps, web-based apps, and desktop apps. In addition, we explore design methodologies applied in the development of the interventions: we note significant stakeholder engagement in the studies, the inclusion of multiple stakeholder types (students, health care professionals, university staff, and young people in the general population), and limited use of design frameworks. Finally, in exploring user engagement, attrition rates and user acceptance, we find that most of the studies have not progressed enough (i.e., at pilot/prototype stages of development) to determine the impact of design methodologies on the success of these interventions.

CONCLUSION

Our review revealed a need for further research on the impact of user-centered design practices on the success of digital mental health interventions in this population. Further, we provide recommendations that researchers/designers in this field of research should take into consideration when designing online mental health interventions for students in higher education. Some of the recommendations include: add personalization; improve user interfaces; take adequate steps to ensure anonymity/privacy/security; include peer engagement; and include access to mental health professionals.

Postsecondary Student Engagement With a Mental Health App and Online Platform (Thought Spot): Qualitative Study of User Experience

BACKGROUND

There is growing interest in using mobile apps and online tools to support postsecondary student mental health, but most of these solutions have suboptimal user engagement in real-world settings. Poor engagement can limit long-term effectiveness and usefulness of these tools. Previous literature has proposed several theories that link factors such as low usability and poor user-centered design to app disengagement. However, few studies provide direct evidence showing what factors contribute to suboptimal user engagement in the context of mobile mental health apps for postsecondary students.

OBJECTIVE

This study focuses on understanding postsecondary students' attitudes and behaviors when using Thought Spot, a co-designed mental health app and online platform, to understand factors related to engagement and user experience.

METHODS

Students who were given access to Thought Spot for 6 months during a randomized trial of the intervention were invited to participate in one-on-one semistructured interviews. The interviews explored participants' overall experiences and perceptions of the app, along with factors that affected their usage of various features. All interviews were recorded, and template analysis was used to analyze transcripts.

RESULTS

User satisfaction was mixed among users of Thought Spot. The degree of engagement with the app appeared to be affected by factors that can be grouped into 5 themes: (1) Students valued detailed, inclusive, and relevant content; (2) Technical glitches and a lack of integration with other apps affected the overall user experience and satisfaction with the app; (3) Using the app to support peers or family can increase engagement; (4) Crowdsourced information from peers about mental health resources drove user engagement, but was difficult to obtain; and (5) Users often turned to the app when they had an immediate need for mental health information, rather than using it to track mental health information over time.

CONCLUSIONS

Content, user experience, user-centeredness, and peer support are important determinants of user engagement with mobile mental health apps among postsecondary students. In this study, participants disengaged when the app did not meet their expectations on these determinants. Future studies on user engagement should further explore the effectiveness of different features and the relative importance of various criteria for high-quality apps. Further focus on these issues may inform the creation of interventions that increase student engagement and align with their mental health needs.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/resprot.6446.

Assessing the usability and user engagement of Thought Spot - A digital mental health help-seeking solution for transition-aged youth

OBJECTIVE

To evaluate the perceived usability of and user engagement with a digital platform (Thought Spot) designed to enhance mental health and wellness help-seeking among transition-aged youth (TAY; 17-29-years old).

MATERIALS AND METHODS

Survey responses and usage patterns were collected as part of a randomized controlled trial evaluating the efficacy of Thought Spot. Participants given Thought Spot completed an adapted Usefulness, Satisfaction, and Ease of Use (USE) Questionnaire to measure perceived usability of the platform. User engagement patterns on Thought Spot were examined using analytics data collected throughout the study (March 2018-June 2019).

RESULTS

A total of 131 transition-aged participants completed the USE questionnaire and logged on to Thought Spot at least once. Ease of learning scored higher than ease of use, usefulness and satisfaction. Participants identified numerous strengths and challenges related to usability, visual appeal, functionality and usefulness of the content. In terms of user engagement, most participants stopped using the platform after 3 weeks. Participants searched and were interested in a variety of resources, including mental health, counselling and social services.

DISCUSSION

Participants reported mixed experiences while using Thought Spot and exhibited low levels of long-term user engagement. User satisfaction, the willingness to recommend Thought Spot to others, and the willingness for future use appeared to be influenced by content relevance, ease of learning, available features, and other contextual factors. Analysis of the types of resources viewed and searches conducted by TAY end-users provided insight into their behaviour and needs.

CONCLUSION

Users had mixed perceptions about the usability of Thought Spot, which may have contributed to the high attrition rate. User satisfaction and engagement appears to be influenced by content relevance, ease of learning, and the types of features available. Further investigation to understand the contextual factors that affect TAYs' adoption and engagement with digital mental health tools is required.

Effects of a Mobile and Web App (Thought Spot) on Mental Health Help-Seeking Among College and University Students: Randomized Controlled Trial

Background

Mental health disorders are the most prevalent health issues among postsecondary students, yet few solutions to this emerging crisis exist. While mobile health technologies are touted as promising solutions for the unmet mental health needs of these students, the efficacy of these tools remains unclear. In response to these gaps, this study evaluates Thought Spot, a mobile and web app created through participatory design research.

Objective

The goal of the research is to examine the impact of Thought Spot on mental health and wellness help-seeking intentions, behaviors, attitudes, self-stigma, and self-efficacy among postsecondary students in Canada.

Methods

A 2-armed randomized controlled trial involving students from three postsecondary institutions was conducted. Students were eligible if they were aged 17 to 29 years, enrolled in full-time or part-time studies, functionally competent in English, and had access to a compatible digital device. The usual care group received a mental health services information pamphlet. The intervention group received the Thought Spot app on their digital device. Thought Spot is a standalone app that allows users to add, review, and search crowdsourced information about nearby mental health and wellness services. Users can also track their mood on the app. Outcomes were self-assessed through questionnaires collected at baseline and 3 and 6 months. The primary outcome was change in formal help-seeking intentions from baseline to 6 months, measured by the General Help-Seeking Questionnaire. A mixed-effects model was used to compare the impact of usual care and intervention on the primary outcome (formal help-seeking intentions). Secondary outcomes included changes in informal help-seeking intentions and help-seeking behaviors, help-seeking attitudes, self-stigma, and self-efficacy.

Results

A total of 481 students were randomized into two groups: 240 to usual care, and 241 to the intervention group. There were no significant differences in help-seeking intentions between the usual care and intervention groups over 6 months (F2,877=0.85; P=.43, f=0.04). Both groups demonstrated similar increases in formal help-seeking intentions at 3 and 6 months (F2,877=23.52; P<.001, f=0.21). Compared with males, females sought more help from formal resources (OR 1.86; 95% CI 1.22 to 2.83, P=.001). Females were less likely to seek help from informal sources than males (OR 0.80; 95% CI 0.22 to 0.73, P<.001).

Conclusions

Prompting postsecondary students about mental health and help-seeking appears to increase help-seeking intentions. mHealth interventions may be as effective as information pamphlets in increasing formal help-seeking but may confer a small advantage in driving help-seeking from informal sources. Although there is enthusiasm, developers and health policy experts should exercise caution and thoroughly evaluate these types of digital tools. Future studies should explore the cost-effectiveness of digital interventions and develop strategies for improving their efficacy.

Trial Registration

ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461

International Registered Report Identifier (IRRID)

RR2-10.2196/resprot.6446

Effects of a Mobile and Web App (Thought Spot) on Mental Health Help-Seeking Among College and University Students: Randomized Controlled Trial

Background

Mental health disorders are the most prevalent health issues among postsecondary students, yet few solutions to this emerging crisis exist. While mobile health technologies are touted as promising solutions for the unmet mental health needs of these students, the efficacy of these tools remains unclear. In response to these gaps, this study evaluates Thought Spot, a mobile and web app created through participatory design research.

Objective

The goal of the research is to examine the impact of Thought Spot on mental health and wellness help-seeking intentions, behaviors, attitudes, self-stigma, and self-efficacy among postsecondary students in Canada.

Methods

A 2-armed randomized controlled trial involving students from three postsecondary institutions was conducted. Students were eligible if they were aged 17 to 29 years, enrolled in full-time or part-time studies, functionally competent in English, and had access to a compatible digital device. The usual care group received a mental health services information pamphlet. The intervention group received the Thought Spot app on their digital device. Thought Spot is a standalone app that allows users to add, review, and search crowdsourced information about nearby mental health and wellness services. Users can also track their mood on the app. Outcomes were self-assessed through questionnaires collected at baseline and 3 and 6 months. The primary outcome was change in formal help-seeking intentions from baseline to 6 months, measured by the General Help-Seeking Questionnaire. A mixed-effects model was used to compare the impact of usual care and intervention on the primary outcome (formal help-seeking intentions). Secondary outcomes included changes in informal help-seeking intentions and help-seeking behaviors, help-seeking attitudes, self-stigma, and self-efficacy.

Results

A total of 481 students were randomized into two groups: 240 to usual care, and 241 to the intervention group. There were no significant differences in help-seeking intentions between the usual care and intervention groups over 6 months (F_2,877=0.85; P=.43, f=0.04). Both groups demonstrated similar increases in formal help-seeking intentions at 3 and 6 months (F_2,877=23.52; P<.001, f=0.21). Compared with males, females sought more help from formal resources (OR 1.86; 95% CI 1.22 to 2.83, P=.001). Females were less likely to seek help from informal sources than males (OR 0.80; 95% CI 0.22 to 0.73, P<.001).

Conclusions

Prompting postsecondary students about mental health and help-seeking appears to increase help-seeking intentions. mHealth interventions may be as effective as information pamphlets in increasing formal help-seeking but may confer a small advantage in driving help-seeking from informal sources. Although there is enthusiasm, developers and health policy experts should exercise caution and thoroughly evaluate these types of digital tools. Future studies should explore the cost-effectiveness of digital interventions and develop strategies for improving their efficacy.

Trial Registration

ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461

International Registered Report Identifier (IRRID)

RR2-10.2196/resprot.6446

Help-Seeking Behaviors of Transition-Aged Youth for Mental Health Concerns: Qualitative Study

Background

Transition-aged youth are particularly vulnerable to mental health problems, yet they are one of the least likely demographic groups to seek help.

Objective

The aim of this study is to explore the influences on and patterns in help-seeking for mental health concerns among transition-aged youth who attend postsecondary schools in Canada.

Methods

A qualitative research design was used, involving 12 semistructured focus groups with transition-aged youth (17-29 years) who attended postsecondary schools in Canada. A thematic analysis was conducted to code the transcripts and develop themes.

Results

Four main themes and subthemes regarding the process and experience of help-seeking were generated: (1) the influence of formal service providers (accessibility and experiences), (2) the influence of social factors (system navigation and stigma), (3) the influence of health literacy (symptom recognition, acting on symptoms, digital tools and the internet, and mental health awareness campaigns), and (4) the influence of low-intensity sources of support, namely, self-help.

Conclusions

Transition-aged youth seek help for mental health problems in different ways. Despite efforts to improve access to mental health services, transition-aged youth continue to face barriers to accessing these services, especially formal sources of support. The factors identified in this study that either hinder or facilitate help-seeking have pragmatic implications for developing help-seeking interventions and delivering mental health services for this population. In addition to other facilitators, family physicians are an important resource in the help-seeking process. Furthermore, digital help-seeking tools have unique characteristics that may make them an important source of support for transition-aged youth.

Surveying the Role of Analytics in Evaluating Digital Mental Health Interventions for Transition-Aged Youth: Scoping Review

BACKGROUND

Consumer-facing digital health interventions provide a promising avenue to bridge gaps in mental health care delivery. To evaluate these interventions, understanding how the target population uses a solution is critical to the overall validity and reliability of the evaluation. As a result, usage data (analytics) can provide a proxy for evaluating the engagement of a solution. However, there is paucity of guidance on how usage data or analytics should be used to assess and evaluate digital mental health interventions.

OBJECTIVE

This review aimed to examine how usage data are collected and analyzed in evaluations of mental health mobile apps for transition-aged youth (15-29 years).

METHODS

A scoping review was conducted using the Arksey and O'Malley framework. A systematic search was conducted on 5 journal databases using keywords related to usage and engagement, mental health apps, and evaluation. A total of 1784 papers from 2008 to 2019 were identified and screened to ensure that they included analytics and evaluated a mental health app for transition-aged youth. After full-text screening, 49 papers were included in the analysis.

RESULTS

Of the 49 papers included in the analysis, 40 unique digital mental health innovations were evaluated, and about 80% (39/49) of the papers were published over the past 6 years. About 80% involved a randomized controlled trial and evaluated apps with information delivery features. There were heterogeneous findings in the concept that analytics was ascribed to, with the top 3 being engagement, adherence, and acceptability. There was also a significant spread in the number of metrics collected by each study, with 35% (17/49) of the papers collecting only 1 metric and 29% (14/49) collecting 4 or more analytic metrics. The number of modules completed, the session duration, and the number of log ins were the most common usage metrics collected.

CONCLUSIONS

This review of current literature identified significant variability and heterogeneity in using analytics to evaluate digital mental health interventions for transition-aged youth. The large proportion of publications from the last 6 years suggests that user analytics is increasingly being integrated into the evaluation of these apps. Numerous gaps related to selecting appropriate and relevant metrics and defining successful or high levels of engagement have been identified for future exploration. Although long-term use or adoption is an important precursor to realizing the expected benefits of an app, few studies have examined this issue. Researchers would benefit from clarification and guidance on how to measure and analyze app usage in terms of evaluating digital mental health interventions for transition-aged youth. Given the established role of adoption in the success of health information technologies, understanding how to abstract and analyze user adoption for consumer digital mental health apps is also an emerging priority.

Generative Participatory Design Methodology to Develop Electronic Health Interventions: Systematic Literature Review

BACKGROUND

Generative participatory design (PD) may help in developing electronic health (eHealth) interventions. PD is characterized by the involvement of all stakeholders in creative activities. This is different from the traditional user-centered design, where users are less involved. When looking at PD from a research through design perspective, it is important to summarize the reasons for choosing a certain form of generative PD to further develop its methodology. However, the scientific literature is currently unclear about which forms of PD are used to develop eHealth and which arguments are used to substantiate the decision to use a certain form of generative PD.

OBJECTIVE

This study aimed to explore the reporting and substantiation of generative PD methodologies in empirical eHealth studies published in scientific journals to further develop PD methodology in the field of eHealth.

METHODS

A systematic literature review following the Cochrane guidelines was conducted in several databases (EMBASE, MEDLINE Ovid, Web of Science, and CINAHL EBSCOhost). Data were extracted on the recruitment and management of stakeholders, the use of tools, and the use of outcome measures.

RESULTS

Of the 3131 studies initially identified, 69 were selected for qualitative synthesis. The reporting was very variable, depending to a large extent on whether the study stated that reporting on the PD process was a major aim. The different levels of reporting and substantiation of the choices of a recruitment strategy, stakeholder management, and tools and outcome measures are presented. Only a few authors explicitly used arguments directly related to PD guiding principles such as democratic, mutual learning, tacit and latent knowledge, and collective creativity. Even though PD principles were not always explicitly discussed in the method descriptions of the studies, they were implicitly present, mostly in the descriptions of the use of PD tools. The arguments used to substantiate the choices made in stakeholder management, PD tools, and the type of outcome measures adopted point to the involvement of PD principles.

CONCLUSIONS

Studies that have used a PD research methodology to develop eHealth primarily substantiate the choice of tools made and much less the use of stakeholders and outcome measures.

Protocol for the development and validation procedure of the managing the link and strengthening transition from child to adult mental health care (MILESTONE) suite of measures

Background

Mental health disorders in the child and adolescent population are a pressing public health concern. Despite the high prevalence of psychopathology in this vulnerable population, the transition from Child and Adolescent Mental Health Services (CAMHS) to Adult Mental Health Services (AMHS) has many obstacles such as deficiencies in planning, organisational readiness and policy gaps. All these factors contribute to an inadequate and suboptimal transition process. A suite of measures is required that would allow young people to be assessed in a structured and standardised way to determine the on-going need for care and to improve communication across clinicians at CAMHS and AMHS. This will have the potential to reduce the overall health economic burden and could also improve the quality of life for patients travelling across the transition boundary. The MILESTONE (Managing the Link and Strengthening Transition from Child to Adult Mental Health Care) project aims to address the significant socioeconomic and societal challenge related to the transition process. This protocol paper describes the development of two MILESTONE transition-related measures: The Transition Readiness and Appropriateness Measure (TRAM), designed to be a decision-making aide for clinicians, and the Transition Related Outcome Measure (TROM), for examining the outcome of transition.

Methods

The TRAM and TROM have been developed and were validated following the US FDA Guidance for Patient-reported Outcome Measures which follows an incremental stepwise framework. The study gathers information from service users, parents, families and mental health care professionals who have experience working with young people undergoing the transition process from eight European countries.

Discussion

There is an urgent need for comprehensive measures that can assess transition across the CAMHS/AMHS boundary. This study protocol describes the process of development of two new transition measures: the TRAM and TROM. The TRAM has the potential to nurture better transitions as the findings can be summarised and provided to clinicians as a clinician-decision making support tool for identifying cases who need to transition and the TROM can be used to examine the outcomes of the transition process.

Trial registration

MILESTONE study registration: ISRCTN83240263 Registered 23-July-2015 - ClinicalTrials.gov NCT03013595 Registered 6 January 2017.

Usability Evaluations of Mobile Mental Health Technologies: Systematic Review

Background

Many mobile health (mHealth) apps for mental health have been made available in recent years. Although there is reason to be optimistic about their effect on improving health and increasing access to care, there is a call for more knowledge concerning how mHealth apps are used in practice.

Objective

This study aimed to review the literature on how usability is being addressed and measured in mHealth interventions for mental health problems.

Methods

We conducted a systematic literature review through a search for peer-reviewed studies published between 2001 and 2018 in the following electronic databases: EMBASE, CINAHL, PsycINFO, PubMed, and Web of Science. Two reviewers independently assessed all abstracts against the inclusion and exclusion criteria, following the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines.

Results

A total of 299 studies were initially identified based on the inclusion keywords. Following a review of the title, abstract, and full text, 42 studies were found that fulfilled the criteria, most of which evaluated usability with patients (n=29) and health care providers (n=11) as opposed to healthy users (n=8) and were directed at a wide variety of mental health problems (n=24). Half of the studies set out to evaluate usability (n=21), and the remainder focused on feasibility (n=10) or acceptability (n=10). Regarding the maturity of the evaluated systems, most were either prototypes or previously tested versions of the technology, and the studies included few accounts of sketching and participatory design processes. The most common reason referred to for developing mobile mental health apps was the availability of mobile devices to users, their popularity, and how people in general became accustomed to using them for various purposes.

Conclusions

This study provides a detailed account of how evidence of usability of mHealth apps is gathered in the form of usability evaluations from the perspective of computer science and human-computer interaction, including how users feature in the evaluation, how the study objectives and outcomes are stated, which research methods and techniques are used, and what the notion of mobility features is for mHealth apps. Most studies described their methods as trials, gathered data from a small sample size, and carried out a summative evaluation using a single questionnaire, which indicates that usability evaluation was not the main focus. As many studies described using an adapted version of a standard usability questionnaire, there may be a need for developing a standardized mHealth usability questionnaire.

Effectiveness of a Mental Health Service Navigation Website (Link) for Young Adults: Randomized Controlled Trial

BACKGROUND

Mental health and substance use disorders are the main causes of disability among adolescents and young adults yet fewer than half experiencing these problems seek professional help. Young people frequently search the Web for health information and services, suggesting that Web-based modalities might promote help-seeking among young people who need it. To support young people in their help-seeking, we developed a Web-based mental health service navigation website called Link. Link is based on the Theory of Planned Behavior and connects young people with treatment based on the type and severity of mental health symptoms that they report.

OBJECTIVE

The study aimed to investigate the effect of Link on young people's positive affect (PA) compared with usual help-seeking strategies immediately post intervention. Secondary objectives included testing the effect of Link on negative affect (NA), psychological distress, barriers to help-seeking, and help-seeking intentions.

METHODS

Young people, aged between 18 and 25 years, were recruited on the Web from an open access website to participate in a randomized controlled trial. Participants were stratified by gender and psychological distress into either the intervention arm (Link) or the control arm (usual help-seeking strategies). Baseline, immediate postintervention, 1-month, and 3-month surveys were self-reported and administered on the Web. Measures included the PA and NA scales, Kessler psychological distress scale (K10), barriers to adolescent help-seeking scale (BASH), and the general help-seeking questionnaire (GHSQ).

RESULTS

In total 413 young people were recruited to the trial (intervention, n=205; control, n=208) and 78% (160/205) of those randomized to the intervention arm visited the Link website. There was no evidence to support a difference between the intervention and control arms on the primary outcome, with PA increasing equally by approximately 30% between baseline and 3 months in both arms. NA decreased for the intervention arm compared with the control arm with a difference of 1.4 (95% CI 0.2-2.5) points immediately after the intervention and 2.6 (95% CI 1.1-4.1) at 1 month. K10 scores were unchanged and remained high in both arms. No changes were found on the BASH or GHSQ; however, participants in the intervention arm appeared more satisfied with their help-seeking process and outcomes at 1 and 3 months postintervention.

CONCLUSIONS

The process of prompting young people to seek mental health information and services appears to improve their affective state and increase help-seeking intentions, regardless of whether they use a Web-based dedicated youth-focused tool, such as Link, or their usual search strategies. However, young people report greater satisfaction using tools designed specifically for them, which may encourage future help-seeking. The ability of Web-based tools to match mental health needs with appropriate care should be explored further.

CLINICAL TRIAL

Australian New Zealand Clinical Trials Registry ACTRN12614001223628; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=366731.

The Female Athlete Triad: A Comparison of Knowledge and Risk in Adolescent and Young Adult Figure Skaters, Dancers, and Runners

STUDY OBJECTIVE

The female athlete triad is often found in sports that value leanness and aesthetics and can lead to adverse health effects. We aimed to compare knowledge and risk of the triad among adolescent figure skaters, dancers, and runners.

DESIGN, SETTING, PARTICIPANTS, AND MAIN OUTCOME MEASURES

We advertised our survey on social media platforms: sports-specific forums; Facebook; and Instagram. We received 928 responses. We included female figure skaters, dancers, and runners aged 25 years or younger (N = 712). We asked participants to name the triad components and dichotomized knowledge scores as high or low. We developed a 6-question triad risk scale and defined "at risk" if participants endorsed 3 or more questions.

RESULTS

Of 712 participants: 60% were figure skaters; 28% dancers; 12% runners; 78% were adolescents (≤17 years of age); 22% young adults (18-25 years); 12% had heard of the triad. A higher proportion of runners than figure skaters and dancers had high knowledge of the triad (16% vs 6% vs 5%, P < .01). Overall 60% of athletes were "at risk" of the triad, 25% skipped a period for 3 or more months, and 34% had a history of stress fractures or shin splints. Young adults vs adolescents and dancers vs figure skaters and runners had nearly twice the odds of triad risk.

CONCLUSION

Most athletes were at risk of the triad but few knew about it. Dancers were at higher risk compared with figure skaters and runners. Efforts should be made to raise awareness of the triad among athletes, parents, and coaches, with special attention paid to the dance community.

Recent developments in the use of smartphone interventions for mental health

PURPOSE OF REVIEW

The purpose of this update is to provide an overview of the breadth of research studies published from April 2017 to April 2018 on mobile-based interventions for mental health, with a special emphasis on smartphone-based interventions.

RECENT FINDINGS

Several studies during the review period have described the process of applying user-centred design in the development of mental health apps and novel approaches to enhance user-engagement. Studies on consumer perspectives indicate largely positive findings about open-ness to utilize mental health apps. There is a scarcity of similar studies on health providers. Efficacy studies have provided evidence for apps for a variety of psychiatric disorders. There are fewer studies on preventive and promotive interventions. Although a plethora of mental health apps is available for public, most have not undergone scientific evaluation. Many well researched apps are not accessible to public. The potential of smartphone technology in enhancing healthcare service delivery in low-resource settings has also been examined in a few studies.

SUMMARY

Evidence for acceptability, feasibility and efficacy of mobile-based mental health interventions for facilitating recovery is on the rise. More research is needed on implementation and integration of these interventions in diverse real-world clinical and community contexts.