1
|
Malik I, Mushquash AR. Acceptance of a mental health app (JoyPop TM) for postsecondary students: a prospective evaluation using the UTAUT2. Front Digit Health 2025; 7:1503428. [PMID: 40041123 PMCID: PMC11876143 DOI: 10.3389/fdgth.2025.1503428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2024] [Accepted: 01/28/2025] [Indexed: 03/06/2025] Open
Abstract
Introduction Mental health (MH) smartphone applications (MH apps) can support the increasing MH needs of postsecondary students and mitigate barriers to accessing support. Evaluating MH app acceptance using technology acceptance models is recommended to improve student engagement with MH apps. The JoyPopTM app was designed to improve youth resilience and emotion regulation. The JoyPopTM app is associated with improved student MH, but its acceptance has yet to be evaluated quantitatively. The present study used the Unified Theory of Acceptance and Use of Technology (UTAUT2) to evaluate and examine constructs and moderators influencing the acceptance (i.e., behavioural intention) and use of the JoyPopTM app. Method Participants were 183 postsecondary students attending a Canadian University who used the app for one week and completed measures before and after using the app. Relationships posited by the UTAUT2 were tested using partial least squares structural equation modelling (PLS-SEM). Results Most participants accepted the JoyPopTM app. The UTAUT2 model explained substantial variance in behavioural intention and app use. Performance expectancy, hedonic motivation, and facilitating conditions predicted behavioural intention, and behavioural intention and facilitating conditions predicted app use. Age moderated the association between facilitating conditions and behavioural intention. Experience moderated the relationship between performance expectancy, hedonic motivation, and social influence on behavioural intention. Discussion Results provide insight into factors influencing the acceptance of the JoyPopTM app and its ability to engage students. Results also provide valuable insights for evaluating and optimally designing MH apps.
Collapse
|
2
|
MacIsaac A, Neufeld T, Malik I, Toombs E, Olthuis JV, Schmidt F, Dunning C, Stasiuk K, Bobinski T, Ohinmaa A, Stewart SH, Newton AS, Mushquash AR. Increasing Access to Mental Health Supports for 18- to 25-Year-Old Indigenous Youth With the JoyPop Mobile Mental Health App: Study Protocol for a Randomized Controlled Trial. JMIR Res Protoc 2025; 14:e64745. [PMID: 39883939 PMCID: PMC11826949 DOI: 10.2196/64745] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2024] [Revised: 09/13/2024] [Accepted: 11/29/2024] [Indexed: 02/01/2025] Open
Abstract
BACKGROUND Transitional-aged youth have a high burden of mental health difficulties in Canada, with Indigenous youth, in particular, experiencing additional circumstances that challenge their well-being. Mobile health (mHealth) approaches hold promise for supporting individuals in areas with less access to services such as Northern Ontario. OBJECTIVE The primary objective of this study is to evaluate the effectiveness of the JoyPop app in increasing emotion regulation skills for Indigenous transitional-aged youth (aged 18-25 years) on a waitlist for mental health services when compared with usual practice (UP). The secondary objectives are to (1) evaluate the impact of the app on general mental health symptoms and treatment readiness and (2) evaluate whether using the app is associated with a reduction in the use (and therefore cost) of other services while one is waiting for mental health services. METHODS The study is a pragmatic, parallel-arm randomized controlled superiority trial design spanning a 4-week period. All participants will receive UP, which involves waitlist monitoring practices at the study site, which includes regular check-in phone calls to obtain any updates regarding functioning. Participants will be allocated to the intervention (JoyPop+UP) or control (UP) condition in a 1:1 ratio using stratified block randomization. Participants will complete self-report measures of emotion regulation (primary outcome), mental health, treatment readiness, and service use during 3 assessments (baseline, second [after 2 weeks], and third [after 4 weeks]). Descriptive statistics pertaining to baseline variables and app usage will be reported. Linear mixed modeling will be used to analyze change in outcomes over time as a function of condition assignment, while a cost-consequence analysis will be used to evaluate the association between app use and service use. RESULTS Recruitment began September 1, 2023, and is ongoing. In total, 2 participants have completed the study. CONCLUSIONS This study will assess whether the JoyPop app is effective for Indigenous transitional-aged youth on a waitlist for mental health services. Positive findings may support the integration of the app into mental health services as a waitlist management tool. TRIAL REGISTRATION ClinicalTrials.gov NCT05991154; https://clinicaltrials.gov/study/NCT05991154. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/64745.
Collapse
Affiliation(s)
- Angela MacIsaac
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Teagan Neufeld
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Ishaq Malik
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Elaine Toombs
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Janine V Olthuis
- Department of Psychology, University of New Brunswick, Fredericton, NB, Canada
| | - Fred Schmidt
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | | | - Kristine Stasiuk
- Dilico Anishinabek Family Care, Fort William First Nation, ON, Canada
| | - Tina Bobinski
- Ontario Native Women's Association, Thunder Bay, ON, Canada
| | - Arto Ohinmaa
- Department of Pediatrics, University of Alberta, Edmonton, AB, Canada
| | - Sherry H Stewart
- Department of Psychology, Neuroscience, and Behaviour, Dalhousie University, Halifax, NS, Canada
| | - Amanda S Newton
- Department of Pediatrics, University of Alberta, Edmonton, AB, Canada
| | | |
Collapse
|
3
|
Charlton J, Malik I, Ashley AM, Newton A, Toombs E, Schmidt F, Olthuis JV, Stasiuk K, Bobinski T, Mushquash A. Identifying the Minimal Clinically Important Difference in Emotion Regulation Among Youth Using the JoyPop App: Survey Study. JMIR Form Res 2025; 9:e64483. [PMID: 39847426 PMCID: PMC11803318 DOI: 10.2196/64483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2024] [Revised: 08/28/2024] [Accepted: 09/24/2024] [Indexed: 01/24/2025] Open
Abstract
BACKGROUND The minimal clinically important difference (MCID) is an important threshold to consider when evaluating the meaningfulness of improvement following an intervention. The JoyPop app is an evidence-based smartphone app designed to improve resilience and emotion regulation. Information is needed regarding the JoyPop app's MCID among culturally diverse youth. OBJECTIVE This study aims to calculate the MCID for youth using the JoyPop app and to explore how the MCID may differ for a subset of Indigenous youth. METHODS Youth (N=36; aged 12-18 years) were recruited to use the JoyPop app for up to 4 weeks as part of a larger pilot evaluation. Results were based on measures completed after 2 weeks of app use. The MCID was calculated using emotion regulation change scores (Difficulties in Emotion Regulation-Short Form [DERS-SF]) and subjective ratings on the Global Rating of Change Scale (GRCS). This MCID calculation was completed for youth overall and separately for Indigenous youth only. RESULTS A significant correlation between GRCS scores and change scores on the DERS-SF supported face validity (r=-0.37; P=.04). The MCID in emotion regulation following the use of the JoyPop app for youth overall was 2.80 on the DERS-SF. The MCID for Indigenous youth was 4.29 on the DERS-SF. In addition, most youth reported improved emotion regulation after using the JoyPop app. CONCLUSIONS These MCID findings provide a meaningful threshold for improvement in emotion regulation for the JoyPop app. They provide potential effect sizes and can aid in sample size estimations for future research with the JoyPop app or e-mental health technologies in general. The difference between overall youth and Indigenous youth MCID values also highlights the importance of patient-oriented ratings of symptom improvement as well as cultural considerations when conducting intervention research and monitoring new interventions in clinical practice.
Collapse
Affiliation(s)
- Jaidyn Charlton
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Ishaq Malik
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Angela M Ashley
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Amanda Newton
- Department of Pediatrics, University of Alberta, Edmonton, AB, Canada
| | - Elaine Toombs
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Fred Schmidt
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| | - Janine V Olthuis
- Department of Psychology, University of New Brunswick, Fredericton, NB, Canada
| | - Kristine Stasiuk
- Dilico Anishinabek Family Care, Fort William First Nation, ON, Canada
| | - Tina Bobinski
- Dilico Anishinabek Family Care, Fort William First Nation, ON, Canada
| | - Aislin Mushquash
- Department of Psychology, Lakehead University, Thunder Bay, ON, Canada
| |
Collapse
|
4
|
MacIsaac A, Mann V, Toombs E, Schmidt F, Olthuis JV, Stewart SH, Newton A, Ohinmaa A, Mushquash AR. Promoting mental health and wellbeing among post-secondary students with the JoyPop™ app: study protocol for a randomized controlled trial. Trials 2024; 25:576. [PMID: 39223596 PMCID: PMC11367905 DOI: 10.1186/s13063-024-08424-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 08/23/2024] [Indexed: 09/04/2024] Open
Abstract
BACKGROUND Technology use may be one strategy to promote mental health and wellbeing among young adults in post-secondary education settings experiencing increasing distress and mental health difficulties. The JoyPop™ app is mobile mental health tool with a growing evidence base. The objectives of this research are to (1) evaluate the effectiveness of the JoyPop™ app in improving emotion regulation skills (primary outcome), as well as mental health, wellbeing, and resilience (secondary outcomes); (2) evaluate sustained app use once users are no longer reminded and determine whether sustained use is associated with maintained improvements in primary and secondary outcomes; (3) determine whether those in the intervention condition have lower mental health service usage and associated costs compared to those in the control condition; and (4) assess users' perspectives on the quality of the JoyPop™ app. METHODS A pragmatic, parallel arm randomized controlled trial will be used. Participants will be randomly allocated using stratified block randomization in a 1:1 ratio to the intervention (JoyPop™) or control (no intervention) condition. Participants allocated to the intervention condition will be asked to use the JoyPop™ app at least twice daily for 4 weeks. Participants will complete outcome measures at four assessment time-points (first [baseline], second [after 2 weeks], third [after 4 weeks], fourth [after 8 weeks; follow-up]). Participants in the control condition will be offered access to the app after the fourth assessment time-point. DISCUSSION Results will determine the effectiveness of the JoyPop™ app for promoting mental health and wellbeing among post-secondary students. If effective, this may encourage more widespread adoption of the JoyPop™ app by post-secondary institutions as part of their response to student mental health needs. TRIAL REGISTRATION ClinicalTrials.gov NCT06154369 . Registered on November 23, 2023.
Collapse
Affiliation(s)
- Angela MacIsaac
- Department of Psychology, Lakehead University, Thunder Bay, Canada
| | - Vamika Mann
- Department of Psychology, Lakehead University, Thunder Bay, Canada
| | - Elaine Toombs
- Department of Psychology, Lakehead University, Thunder Bay, Canada
| | - Fred Schmidt
- Department of Psychology, Lakehead University, Thunder Bay, Canada
- Children's Centre Thunder Bay, Thunder Bay, Canada
| | - Janine V Olthuis
- Department of Psychology, University of New Brunswick, Fredericton, Canada
| | - Sherry H Stewart
- Departments of Psychiatry and Psychology & Neuroscience, Dalhousie University, Halifax, Canada
| | - Amanda Newton
- Department of Pediatrics, University of Alberta, Edmonton, Canada
| | - Arto Ohinmaa
- School of Public Health, University of Alberta, Edmonton, Canada
| | | |
Collapse
|
5
|
Mushquash AR, Neufeld T, Malik I, Toombs E, Olthuis JV, Schmidt F, Dunning C, Stasiuk K, Bobinski T, Ohinmaa A, Newton A, Stewart SH. Increasing access to mental health supports for 12-17-year-old Indigenous youth with the JoyPop mobile mental health app: study protocol for a randomized controlled trial. Trials 2024; 25:234. [PMID: 38575945 PMCID: PMC10993577 DOI: 10.1186/s13063-024-08076-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 03/27/2024] [Indexed: 04/06/2024] Open
Abstract
BACKGROUND Indigenous youth in Northwestern Ontario who need mental health supports experience longer waits than non-Indigenous youth within the region and when compared to youth in urban areas. Limited access and extended waits can exacerbate symptoms, prolong distress, and increase risk for adverse outcomes. Innovative approaches are urgently needed to provide support for Indigenous youth in Northwestern Ontario. Using a randomized controlled trial design, the primary objective of this study is to determine the effectiveness of the JoyPop app compared to usual practice (UP; monitoring) in improving emotion regulation among Indigenous youth (12-17 years) who are awaiting mental health services. The secondary objectives are to (1) assess change in mental health difficulties and treatment readiness between youth in each condition to better understand the app's broader impact as a waitlist tool and (2) conduct an economic analysis to determine whether receiving the app while waiting for mental health services reduces other health service use and associated costs. METHODS A pragmatic, parallel arm randomized controlled superiority trial will be used. Participants will be randomly allocated in a 1:1 ratio to the control (UP) or intervention (UP + JoyPop) condition. Stratified block randomization will be used to randomly assign participants to each condition. All participants will be monitored through existing waitlist practices, which involve regular phone calls to check in and assess functioning. Participants in the intervention condition will receive access to the JoyPop app for 4 weeks and will be asked to use it at least twice daily. All participants will be asked to complete outcome measures at baseline, after 2 weeks, and after 4 weeks. DISCUSSION This trial will evaluate the effectiveness of the JoyPop app as a tool to support Indigenous youth waiting for mental health services. Should findings show that using the JoyPop app is beneficial, there may be support from partners and other organizations to integrate it into usual care pathways. TRIAL REGISTRATION https://clinicaltrials.gov/study/NCT05898516 [registered on June 1, 2023].
Collapse
Affiliation(s)
- Aislin R Mushquash
- Department of Psychology, Lakehead University, Thunder Bay, Canada.
- Dilico Anishinabek Family Care, Fort William First Nation, Canada.
| | - Teagan Neufeld
- Department of Psychology, Lakehead University, Thunder Bay, Canada
| | - Ishaq Malik
- Department of Psychology, Lakehead University, Thunder Bay, Canada
| | - Elaine Toombs
- Department of Psychology, Lakehead University, Thunder Bay, Canada
| | - Janine V Olthuis
- Department of Psychology, University of New Brunswick, Fredericton, Canada
| | - Fred Schmidt
- Department of Psychology, Lakehead University, Thunder Bay, Canada
- Children's Centre Thunder Bay, Thunder Bay, Canada
| | | | - Kristine Stasiuk
- Dilico Anishinabek Family Care, Fort William First Nation, Canada
| | - Tina Bobinski
- Ontario Native Women's Association, Thunder Bay, Canada
| | - Arto Ohinmaa
- School of Public Health, University of Alberta, Edmonton, Canada
| | - Amanda Newton
- Department of Pediatrics, University of Alberta, Edmonton, Canada
| | - Sherry H Stewart
- Departments of Psychiatry and Psychology and Neuroscience, Dalhousie University, Halifax, Canada
| |
Collapse
|