1
|
O'Sullivan S, van Berkel N, Kostakos V, Schmaal L, D'Alfonso S, Valentine L, Bendall S, Nelson B, Gleeson JF, Alvarez-Jimenez M. Understanding What Drives Long-term Engagement in Digital Mental Health Interventions: Secondary Causal Analysis of the Relationship Between Social Networking and Therapy Engagement. JMIR Ment Health 2023; 10:e44812. [PMID: 37213197 DOI: 10.2196/44812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 03/02/2023] [Accepted: 04/01/2023] [Indexed: 05/23/2023] Open
Abstract
BACKGROUND Low engagement rates with digital mental health interventions are a major challenge in the field. Multicomponent digital interventions aim to improve engagement by adding components such as social networks. Although social networks may be engaging, they may not be sufficient to improve clinical outcomes or lead users to engage with key therapeutic components. Therefore, we need to understand what components drive engagement with digital mental health interventions overall and what drives engagement with key therapeutic components. OBJECTIVE Horyzons was an 18-month digital mental health intervention for young people recovering from first-episode psychosis, incorporating therapeutic content and a private social network. However, it is unclear whether use of the social network leads to subsequent use of therapeutic content or vice versa. This study aimed to determine the causal relationship between the social networking and therapeutic components of Horyzons. METHODS Participants comprised 82 young people (16-27 years) recovering from first-episode psychosis. Multiple convergent cross mapping was used to test causality, as a secondary analysis of the Horyzons intervention. Multiple convergent cross mapping tested the direction of the relationship between each pair of social and therapeutic system usage variables on Horyzons, using longitudinal usage data. RESULTS Results indicated that the social networking aspects of Horyzons were most engaging. Posting on the social network drove engagement with all therapeutic components (r=0.06-0.36). Reacting to social network posts drove engagement with all therapeutic components (r=0.39-0.65). Commenting on social network posts drove engagement with most therapeutic components (r=0.11-0.18). Liking social network posts drove engagement with most therapeutic components (r=0.09-0.17). However, starting a therapy pathway led to commenting on social network posts (r=0.05) and liking social network posts (r=0.06), and completing a therapy action led to commenting on social network posts (r=0.14) and liking social network posts (r=0.15). CONCLUSIONS The online social network was a key driver of long-term engagement with the Horyzons intervention and fostered engagement with key therapeutic components and ingredients of the intervention. Online social networks can be further leveraged to engage young people with therapeutic content to ensure treatment effects are maintained and to create virtuous cycles between all intervention components to maintain engagement. TRIAL REGISTRATION Australian New Zealand Clinical Trials Registry: ACTRN12614000009617; https://www.australianclinicaltrials.gov.au/anzctr/trial/ACTRN12614000009617.
Collapse
Affiliation(s)
- Shaunagh O'Sullivan
- Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
- Orygen, Parkville, Australia
| | - Niels van Berkel
- Department of Computer Science, Aalborg University, Aalborg, Denmark
| | - Vassilis Kostakos
- School of Computing and Information Systems, University of Melbourne, Melbourne, Australia
| | - Lianne Schmaal
- Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
- Orygen, Parkville, Australia
| | - Simon D'Alfonso
- School of Computing and Information Systems, University of Melbourne, Melbourne, Australia
| | - Lee Valentine
- Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
- Orygen, Parkville, Australia
| | - Sarah Bendall
- Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
- Orygen, Parkville, Australia
| | - Barnaby Nelson
- Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
- Orygen, Parkville, Australia
| | - John F Gleeson
- Healthy Brain and Mind Research Centre, Australian Catholic University, Melbourne, Australia
- School of Behavioural and Health Sciences, Australian Catholic University, Melbourne, Australia
| | - Mario Alvarez-Jimenez
- Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
- Orygen, Parkville, Australia
| |
Collapse
|
2
|
O'Sullivan S, Schmaal L, D'Alfonso S, Toenders YJ, Valentine L, McEnery C, Bendall S, Nelson B, Gleeson JF, Alvarez-Jimenez M. Characterizing Use of a Multicomponent Digital Intervention to Predict Treatment Outcomes in First-Episode Psychosis: Cluster Analysis. JMIR Ment Health 2022; 9:e29211. [PMID: 35389351 PMCID: PMC9030973 DOI: 10.2196/29211] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 06/18/2021] [Accepted: 01/10/2022] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND Multicomponent digital interventions offer the potential for tailored and flexible interventions that aim to address high attrition rates and increase engagement, an area of concern in digital mental health. However, increased flexibility in use makes it difficult to determine which components lead to improved treatment outcomes. OBJECTIVE This study aims to identify user profiles on Horyzons, an 18-month digital relapse prevention intervention for first-episode psychosis that incorporates therapeutic content and social networking, along with clinical, vocational, and peer support, and to examine the predictive value of these user profiles for treatment outcomes. A secondary objective is to compare each user profile with young people receiving treatment as usual (TAU). METHODS Participants comprised 82 young people (aged 16-27 years) with access to Horyzons and 84 receiving TAU, recovering from first-episode psychosis. In addition, 6-month use data from the therapy and social networking components of Horyzons were used as features for K-means clustering for joint trajectories to identify user profiles. Social functioning, psychotic symptoms, depression, and anxiety were assessed at baseline and 6-month follow-up. General linear mixed models were used to examine the predictive value of user profiles for treatment outcomes and between each user profile with TAU. RESULTS A total of 3 user profiles were identified based on the following system use metrics: low use, maintained use of social components, and maintained use of both therapy and social components. The maintained therapy and social group showed improvements in social functioning (F2,51=3.58; P=.04), negative symptoms (F2,51=4.45; P=.02), and overall psychiatric symptom severity (F2,50=3.23; P=.048) compared with the other user profiles. This group also showed improvements in social functioning (F1,62=4.68; P=.03), negative symptoms (F1,62=14.61; P<.001), and overall psychiatric symptom severity (F1,63=5.66; P=.02) compared with the TAU group. Conversely, the maintained social group showed increases in anxiety compared with the TAU group (F1,57=7.65; P=.008). No differences were found between the low use group and the TAU group on treatment outcomes. CONCLUSIONS Continued engagement with both therapy and social components might be key in achieving long-term recovery. Maintained social use and low use outcomes were broadly comparable with TAU, emphasizing the importance of maintaining engagement for improved treatment outcomes. Although the social network may be a key ingredient to increase sustained engagement, as users engaged with this more consistently, it should be leveraged as a tool to engage young people with therapeutic content to bring about social and clinical benefits.
Collapse
Affiliation(s)
- Shaunagh O'Sullivan
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - Lianne Schmaal
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - Simon D'Alfonso
- Orygen, Parkville, Australia.,School of Computing and Information Systems, University of Melbourne, Melbourne, Australia
| | - Yara Jo Toenders
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - Lee Valentine
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - Carla McEnery
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - Sarah Bendall
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - Barnaby Nelson
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - John F Gleeson
- Health Brain and Mind Research Centre, Australian Catholic University, Melbourne, Australia.,School of Behavioural and Health Sciences, Australian Catholic University, Melbourne, Australia
| | - Mario Alvarez-Jimenez
- Orygen, Parkville, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| |
Collapse
|
3
|
Crafoord MT, Fjell M, Sundberg K, Nilsson M, Langius-Eklöf A. Engagement in an Interactive App for Symptom Self-Management during Treatment in Patients With Breast or Prostate Cancer: Mixed Methods Study. J Med Internet Res 2020; 22:e17058. [PMID: 32663140 PMCID: PMC7445604 DOI: 10.2196/17058] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Revised: 05/05/2020] [Accepted: 05/20/2020] [Indexed: 12/17/2022] Open
Abstract
Background Using mobile technology for symptom management and self-care can improve patient-clinician communication and clinical outcomes in patients with cancer. The interactive app Interaktor has been shown to reduce symptom burden during cancer treatment. It includes symptom assessment, an alert system for contact with health care professionals, access to self-care advice, and visualization of symptom history. It is essential to understand how digital interventions operate; one approach is to examine engagement by assessing usage and exploring user experiences. Actual usage in relation to the intended use—adherence—is an essential factor of engagement. Objective This study aimed to describe engagement with the Interaktor app among patients with breast or prostate cancer during treatment. Methods Patients from the intervention groups of two separate randomized controlled trials were included: patients with breast cancer receiving neoadjuvant chemotherapy (n=74) and patients with locally advanced prostate cancer receiving treatment with radiotherapy (n=75). The patients reported their symptoms daily. Sociodemographic and clinical data were obtained from baseline questionnaires and medical records. Logged data usage was retrieved from the server and analyzed descriptively and with multiple regression analysis. Telephone interviews were conducted with patients about their perceptions of using the app and analyzed using content analysis. Results The median adherence percentage to daily symptom reporting was 83%. Most patients used the self-care advice and free text message component. Among the patients treated for breast cancer, higher age predicted a lower total number of free text messages sent (P=.04). Among the patients treated for prostate cancer, higher age (P=.01) and higher education level (P=.04), predicted an increase in total views on self-care advice, while higher comorbidity (P=.004) predicted a decrease in total views on self-care advice. Being married or living with a partner predicted a higher adherence to daily symptom reporting (P=.02). Daily symptom reporting created feelings of having continuous contact with health care professionals, being acknowledged, and safe. Being contacted by a nurse after a symptom alert was considered convenient and highly valued. Treatment and time-related aspects influenced engagement. Daily symptom reporting was perceived as particularly meaningful at the beginning of treatment. Requests were made for advice on diet and psychological symptoms, as well as for more comprehensive and detailed information as the patient progressed through treatment. Conclusions Patient engagement in the interactive app Interaktor was high. The app promoted patient participation in their care through continuous and convenient contact with health care professionals. The predictive ability of demographic variables differed between patient groups, but higher age and a higher educational level predicted usage of specific app functions for both patient groups. Patients’ experience of relevance and interactivity influenced their engagement positively.
Collapse
Affiliation(s)
- Marie-Therése Crafoord
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Maria Fjell
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Kay Sundberg
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Marie Nilsson
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Ann Langius-Eklöf
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|