1
|
Cha BS, Eikey EV, Mukamel DB, Palomares KJ, Schueller SM, Sorkin DH, Stadnick NA, Stoeckl SE, Zheng K, Schneider ML. Peer Perspectives on Challenges Encountered During a Multi-Site Digital Mental Health Intervention Project. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2025:10.1007/s10488-025-01441-2. [PMID: 40252192 DOI: 10.1007/s10488-025-01441-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/19/2025] [Indexed: 04/21/2025]
Abstract
Peers are individuals with lived experience of mental health challenges trained to provide support to others with similar challenges. Help@Hand was a multi-site project that integrated peers into digital mental health intervention (DMHI) implementation. This study uses the Consolidated Framework for Implementation Research (CFIR) to frame challenges reported by peers when implementing DMHIs. Individuals leading the local peer workforce completed quarterly online surveys about perceived challenges to DMHI implementation. Biannual interviews probed for details on survey-reported challenges. 103 quarterly surveys and 39 bi-annual interviews were collected from key informants at 11 Help@Hand sites between Summer 2020 and Fall 2022. One challenge was tied directly to DMHIs; namely, device distribution. Several related to the Implementation Process, including challenges with recruiting qualified peers and integrating peers into DMHI implementations; communication and collaboration; and translation. Challenges in the Individual domain included unclear peer roles and multi-tasking across various projects. Inner Setting challenges included structural barriers to hiring peers, issues with communication and project management, and workforce turnover. Outer Setting challenges related to environmental technology readiness, COVID-19, unclear decision-making processes across the collaborative, and uneven communication between sites' peers. Funding uncertainty bridged the Inner and Outer Settings. Using the CFIR model to frame challenges to DMHI implementation yielded useful lessons, especially when peers are engaged as partners in planning and implementation process. Successful implementation will be enhanced by ensuring adequate environmental readiness for tech-based interventions, clear role definition, streamlined peer hiring processes, and well-delineated lines of communication locally and across sites.
Collapse
Affiliation(s)
- Biblia S Cha
- Department of General Internal Medicine, University of California, Irvine, CA, USA.
- School of Medicine, University of California, 100 Theory, Suite 120, Irvine, CA, 92697, USA.
| | - Elizabeth V Eikey
- Herbert Wertheim School of Public Health and Human Longevity Science, University of California, San Diego, CA, USA
- The Design Lab, University of California, San Diego, CA, USA
| | - Dana B Mukamel
- Department of General Internal Medicine, University of California, Irvine, CA, USA
| | - Kristy J Palomares
- Department of Public Health, University of California, Berkeley, CA, USA
| | - Stephen M Schueller
- Department of Informatics, University of California, Irvine, CA, USA
- Department of Psychological Science, University of California, Irvine, CA, USA
| | - Dara H Sorkin
- Department of General Internal Medicine, University of California, Irvine, CA, USA
| | - Nicole A Stadnick
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
- Dissemination and Implementation Science Center, UC San Diego Altman Clinical and Translational Research Institute, La Jolla, CA, USA
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | | | - Kai Zheng
- Department of Informatics, University of California, Irvine, CA, USA
| | - Margaret L Schneider
- Joe C. Wen School of Population & Public Health, University of California, Irvine, CA, USA
| |
Collapse
|
2
|
Bradley G, Rehackova L, Devereaux K, Bruce TA, Nunn V, Gilfellon L, Burrows S, Cameron A, Watson R, Rumney K, Flynn D. Classifying the features of digital mental health interventions to inform the development of a patient decision aid. PLOS DIGITAL HEALTH 2025; 4:e0000752. [PMID: 40138606 PMCID: PMC11942417 DOI: 10.1371/journal.pdig.0000752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/29/2025]
Abstract
Digital mental health interventions (DMHIs) are a potential scalable solution to improve access to psychological support and therapies. DMHIs vary in terms of their features such as delivery systems (Websites or Apps) and function (information, monitoring, decision support or therapy) that are sensitive to the needs and preferences of users. A decision aid is warranted to empower people to make an informed preference-based choice of DMHIs. We conducted a review of features of DMHIs to embed within a patient decision aid to support shared decision-making. DMHIs, with evidence of availability in the United Kingdom (UK) at the time of the review, were identified from interactive meetings with a multi-disciplinary steering group, an online survey and interviews with adults with lived experience of using DMHIs in the UK. Eligible DMHIs targeted users age ≥16 years with a mental health condition(s), delivered through a digital system. A previous classification system for DMHIs was extended to eight dimensions (Target population; System; Function; Time; Facilitation; Duration and Intensity; and Research Evidence) to guide data extraction and synthesis of findings. Twenty four DMHIs were included in the review. More than half (n = 13, 54%) targeted people living with low mood, anxiety or depression and were primarily delivered via systems such as Apps or websites (or both). Most DMHIs offered one-way transmission of information (n = 21, 88%). Ten (42%) also had two-way communication (e.g., with a healthcare provider). Eighteen (75%) had a function of therapy, with seven and five DMHIs providing monitoring and decision support functions respectively. Most DMHIs were capable of being self-guided (n = 18,75%). Cost and access were primarily free, with some free via referral from the UK NHS or through corporate subscription for employees (n = 11). Eight (33%) DMHIs had evidence of effectiveness from randomised controlled trials. Six statements were developed to elicit user preferences on features of DMHIs: Target Population; Function; Time and Facilitation; System; Cost and Access; and Research Evidence. Preference elicitation statements have been embedded into a prototype decision aid for DMHIs, which will be subjected to acceptability and usability testing.
Collapse
Affiliation(s)
- Gemma Bradley
- Department of Social Work, Education and Community Wellbeing, Faculty of Health and Life Sciences, Northumbria University, United Kingdom
| | - Lucia Rehackova
- Department of Nursing, Midwifery and Health, Faculty of Health and Life Sciences, Northumbria University, United Kingdom
| | - Kayleigh Devereaux
- Psychological Wellbeing Practitioner, Newcastle upon Tyne, United Kingdom
| | - Tor Alexander Bruce
- Department of Nursing, Midwifery and Health, Faculty of Health and Life Sciences, Northumbria University, United Kingdom
| | - Victoria Nunn
- Patient and Public Involvement Contributor, Newcastle upon Tyne, United Kingdom
| | - Liam Gilfellon
- Everyturn Mental Health, Newcastle upon Tyne, United Kingdom
| | - Scott Burrows
- Patient and Public Involvement Contributor, Newcastle upon Tyne, United Kingdom
| | - Alisdair Cameron
- Recovery College Collective, Newcastle upon Tyne, United Kingdom
| | - Rose Watson
- Strathclyde Business School, University of Strathclyde, Glasgow, United Kingdom
| | - Katie Rumney
- Patient and Public Involvement Contributor, Newcastle upon Tyne, United Kingdom
| | - Darren Flynn
- Department of Nursing, Midwifery and Health, Faculty of Health and Life Sciences, Northumbria University, United Kingdom
| |
Collapse
|
3
|
Garcia-Rudolph A, Sánchez-Pinsach D, Gilabert A, Saurí J, Soler MD, Opisso E. Building Trust with AI: How Essential is Validating AI Models in the Therapeutic Triad of Therapist, Patient, and Artificial Third? Comment on What is the Current and Future Status of Digital Mental Health Interventions? THE SPANISH JOURNAL OF PSYCHOLOGY 2025; 28:e3. [PMID: 39988913 DOI: 10.1017/sjp.2024.32] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/25/2025]
Abstract
Since the publication of "What is the Current and Future Status of Digital Mental Health Interventions?" the exponential growth and widespread adoption of ChatGPT have underscored the importance of reassessing its utility in digital mental health interventions. This review critically examined the potential of ChatGPT, particularly focusing on its application within clinical psychology settings as the technology has continued evolving through 2023 and 2024. Alongside this, our literature review spanned US Medical Licensing Examination (USMLE) validations, assessments of the capacity to interpret human emotions, analyses concerning the identification of depression and its determinants at treatment initiation, and reported our findings. Our review evaluated the capabilities of GPT-3.5 and GPT-4.0 separately in clinical psychology settings, highlighting the potential of conversational AI to overcome traditional barriers such as stigma and accessibility in mental health treatment. Each model displayed different levels of proficiency, indicating a promising yet cautious pathway for integrating AI into mental health practices.
Collapse
Affiliation(s)
- Alejandro Garcia-Rudolph
- Universitat Autònoma de Barcelona, Spain
- Fundació Institut d'Investigació en Ciències de la Salut Germans Trias i Pujol, Spain
| | - David Sánchez-Pinsach
- Universitat Autònoma de Barcelona, Spain
- Fundació Institut d'Investigació en Ciències de la Salut Germans Trias i Pujol, Spain
| | - Anna Gilabert
- Universitat Autònoma de Barcelona, Spain
- Fundació Institut d'Investigació en Ciències de la Salut Germans Trias i Pujol, Spain
| | - Joan Saurí
- Universitat Autònoma de Barcelona, Spain
- Fundació Institut d'Investigació en Ciències de la Salut Germans Trias i Pujol, Spain
| | - Maria Dolors Soler
- Universitat Autònoma de Barcelona, Spain
- Fundació Institut d'Investigació en Ciències de la Salut Germans Trias i Pujol, Spain
| | - Eloy Opisso
- Universitat Autònoma de Barcelona, Spain
- Fundació Institut d'Investigació en Ciències de la Salut Germans Trias i Pujol, Spain
| |
Collapse
|
4
|
Hopkin G, Coole H, Edelmann F, Ayiku L, Branson R, Campbell P, Cooper S, Salmon M. Toward a New Conceptual Framework for Digital Mental Health Technologies: Scoping Review. JMIR Ment Health 2025; 12:e63484. [PMID: 39969824 PMCID: PMC11864090 DOI: 10.2196/63484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2024] [Revised: 12/05/2024] [Accepted: 12/26/2024] [Indexed: 02/20/2025] Open
Abstract
Background Digital mental health technologies (DMHTs) are becoming more widely available and are seen as having the potential to improve the quality of mental health care. However, conversations around the potential impact of DMHTs can be impacted by a lack of focus on the types of technologies that are available. Several frameworks that could apply to DMHTs are available, but they have not been developed with comprehensive methods and have limitations. Objective To address limitations with current frameworks, we aimed to identify existing literature on the categorization of DMHTs, to explore challenges with categorizing DMHTs for specific purposes, and to develop a new conceptual framework. Methods We used an iterative approach to develop the framework. First, we completed a rapid review of the literature to identify studies that provided domains that could be used to categorize DMHTs. Second, findings from this review and associated issues were discussed by an expert working group, including professionals from a wide range of relevant settings. Third, we synthesized findings to develop a new conceptual framework. Results The rapid review identified 3603 unique results, and hand searching identified another 3 potentially relevant papers. Of these, 24 papers were eligible for inclusion, which provided 10 domains to categorize DMHTs. The expert working group proposed a broad framework and based on the findings of the review and group discussions, we developed a new conceptual framework with 8 domains that represent important characteristics of DMHTs. These 8 domains are population, setting, platform or system, purpose, type of approach, human interaction, human responsiveness, and functionality. Conclusions This conceptual framework provides a structure for various stakeholders to define the key characteristics of DMHTs. It has been developed with more comprehensive methods than previous attempts with similar aims. The framework can facilitate communication within the field and could undergo further iteration to ensure it is appropriate for specific purposes.
Collapse
Affiliation(s)
- Gareth Hopkin
- Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence (NICE), Manchester, United Kingdom
| | - Holly Coole
- Software Team, Healthcare Quality and Access Group, Medicines and Healthcare products Regulatory Agency (MHRA), London, United Kingdom
| | - Francesca Edelmann
- Software Team, Healthcare Quality and Access Group, Medicines and Healthcare products Regulatory Agency (MHRA), London, United Kingdom
| | - Lynda Ayiku
- Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence (NICE), Manchester, United Kingdom
| | - Richard Branson
- Software Team, Healthcare Quality and Access Group, Medicines and Healthcare products Regulatory Agency (MHRA), London, United Kingdom
| | - Paul Campbell
- Software Team, Healthcare Quality and Access Group, Medicines and Healthcare products Regulatory Agency (MHRA), London, United Kingdom
| | - Sophie Cooper
- Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence (NICE), Manchester, United Kingdom
| | - Mark Salmon
- Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence (NICE), Manchester, United Kingdom
| |
Collapse
|
5
|
Malouin-Lachance A, Capolupo J, Laplante C, Hudon A. Does the Digital Therapeutic Alliance Exist? Integrative Review. JMIR Ment Health 2025; 12:e69294. [PMID: 39924298 PMCID: PMC11830484 DOI: 10.2196/69294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/26/2024] [Revised: 01/16/2025] [Accepted: 01/17/2025] [Indexed: 02/11/2025] Open
Abstract
Background Mental health disorders significantly impact global populations, prompting the rise of digital mental health interventions, such as artificial intelligence (AI)-powered chatbots, to address gaps in access to care. This review explores the potential for a "digital therapeutic alliance (DTA)," emphasizing empathy, engagement, and alignment with traditional therapeutic principles to enhance user outcomes. Objective The primary objective of this review was to identify key concepts underlying the DTA in AI-driven psychotherapeutic interventions for mental health. The secondary objective was to propose an initial definition of the DTA based on these identified concepts. Methods The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) for scoping reviews and Tavares de Souza's integrative review methodology were followed, encompassing systematic literature searches in Medline, Web of Science, PsycNet, and Google Scholar. Data from eligible studies were extracted and analyzed using Horvath et al's conceptual framework on a therapeutic alliance, focusing on goal alignment, task agreement, and the therapeutic bond, with quality assessed using the Newcastle-Ottawa Scale and Cochrane Risk of Bias Tool. Results A total of 28 studies were identified from an initial pool of 1294 articles after excluding duplicates and ineligible studies. These studies informed the development of a conceptual framework for a DTA, encompassing key elements such as goal alignment, task agreement, therapeutic bond, user engagement, and the facilitators and barriers affecting therapeutic outcomes. The interventions primarily focused on AI-powered chatbots, digital psychotherapy, and other digital tools. Conclusions The findings of this integrative review provide a foundational framework for the concept of a DTA and report its potential to replicate key therapeutic mechanisms such as empathy, trust, and collaboration in AI-driven psychotherapeutic tools. While the DTA shows promise in enhancing accessibility and engagement in mental health care, further research and innovation are needed to address challenges such as personalization, ethical concerns, and long-term impact.
Collapse
Affiliation(s)
| | - Julien Capolupo
- Faculté de Médecine, Université Laval, Québec City, QC, Canada
| | - Chloé Laplante
- Department of Psychiatry, Institut universitaire en santé mentale de Montréal, Montreal, QC, Canada
| | - Alexandre Hudon
- Department of Psychiatry, Institut universitaire en santé mentale de Montréal, Montreal, QC, Canada
- Centre de recherche de l'Institut universitaire en santé mentale de Montréal, Montreal, QC, Canada
- Department of Psychiatry, Institut nationale de psychiatrie légale Philippe-Pinel, Montreal, QC, Canada
- Department of Psychiatry, Faculty of Medicine, University of Montreal, Montreal, QC, Canada
| |
Collapse
|
6
|
Peláez Zuberbuhler J, Pietrantoni L, Mazzetti G, De Angelis M, Giusino D, San Román-Niaves M, Guglielmi D, Salanova M. A systematic realist synthesis of digital interventions for enhancing mental health at work: contexts, mechanisms, and outcomes. Int J Ment Health Syst 2025; 19:3. [PMID: 39780192 PMCID: PMC11715839 DOI: 10.1186/s13033-024-00655-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 11/25/2024] [Indexed: 01/11/2025] Open
Abstract
BACKGROUND Digital interventions (DIs) have emerged as promising tools for promoting mental health in the workplace. However, evidence on if, how, and under what circumstances they affect positive outcomes requires elucidation. This systematic realist review aimed to synthesize current knowledge on contexts, mechanisms, and outcomes of workplace DIs to enhance mental health at work. METHODS The review integrates elements of both systematic and realist review methodologies. Forty-four workplace mental health DIs studies were gathered through a systematic electronic search using PsycNet, Scopus, Web of Science, and PubPsych. RESULTS Results showed that demographics, previous mental health, and personal skills were the main individual context factors influencing the success of DIs. Key mechanisms were DIs usage, frequency, adherence, and relevance of content triggering positive perceptual shifts. Results showed improvements in psychological resources, wellbeing, and affect. Reduced ill-health symptoms were also evidenced. Five propositions were developed on the contexts and mechanisms under which digital interventions yield positive outcomes for mental health at work. CONCLUSIONS This study highlights several areas where future research can expand our understanding of DIs in the workplace by examining interactions between mechanisms and cultural aspects influencing implementation.
Collapse
Affiliation(s)
- Josefina Peláez Zuberbuhler
- WANT Research Team, Department of Social Psychology, Universitat Jaume I, Castelló de la Plana, Spain.
- Department of Leadership and Organization, Kristiania University College, Oslo, Norway.
| | - Luca Pietrantoni
- Department of Psychology "Renzo Canestrari", Alma Mater Studiorum - University of Bologna, Bologna, Italy.
| | - Greta Mazzetti
- Department of Education Studies "Giovanni Maria Bertin", Alma Mater Studiorum - University of Bologna, Bologna, Italy
| | - Marco De Angelis
- Department of Psychology "Renzo Canestrari", Alma Mater Studiorum - University of Bologna, Bologna, Italy
| | - Davide Giusino
- Department of Psychology "Renzo Canestrari", Alma Mater Studiorum - University of Bologna, Bologna, Italy
| | - Mabel San Román-Niaves
- WANT Research Team, Department of Social Psychology, Universitat Jaume I, Castelló de la Plana, Spain
- Department of Psychology "Renzo Canestrari", Alma Mater Studiorum - University of Bologna, Bologna, Italy
| | - Dina Guglielmi
- Department of Education Studies "Giovanni Maria Bertin", Alma Mater Studiorum - University of Bologna, Bologna, Italy
| | - Marisa Salanova
- WANT Research Team, Department of Social Psychology, Universitat Jaume I, Castelló de la Plana, Spain
| |
Collapse
|
7
|
Rupani N, Vasquez DH, Contreras C, Menacho L, Kolevic L, Franke MF, Galea JT. "Like Someone Is Paying Attention to You, Listening to You, and Guiding You": Acceptability of a Mental Health Chatbot Among Caregivers of Adolescents Living With HIV. J Int Assoc Provid AIDS Care 2025; 24:23259582251327911. [PMID: 40151964 PMCID: PMC11951883 DOI: 10.1177/23259582251327911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2024] [Revised: 02/24/2025] [Accepted: 02/28/2025] [Indexed: 03/29/2025] Open
Abstract
BackgroundThis study assessed the acceptability, among caregivers, of a mental health chatbot designed for adolescents living with HIV aged 10 to 19 years.MethodsFifteen caregivers interacted with the mental health chatbot. Pre-post assessments and semistructured interviews evaluated acceptability. Data were analyzed using a Framework Analysis approach.ResultsCaregivers aged 31 to 70 years found the chatbot acceptable on individual, interpersonal, and environmental levels. They appreciated the educational content and self-help tools, feeling the chatbot would benefit them personally. Caregivers also saw potential in the chatbot to improve communication with their children, particularly during critical periods like HIV diagnosis. Despite concerns about data costs or internet access, most viewed the chatbot as an accessible supplement to traditional mental health services.ConclusionThis study suggests that a mental health chatbot for Peruvian adolescents living with HIV was acceptable to their caregivers, potentially benefiting caregivers' mental health, enhancing caregiver-adolescent interactions, and fostering better communication.
Collapse
Affiliation(s)
- Neil Rupani
- Morsani College of Medicine, University of South Florida, Tampa, US
| | | | | | - Luis Menacho
- Universidad Peruana Cayetano Heredia, Instituto de Medicina Tropical Alexander Von Humboldt, Lima, Peru
| | - Lenka Kolevic
- Instituto Nacional de Salud del Niño, Lima, Peru
- Universidad Nacional Mayor de San Marcos, Lima, Peru
| | - Molly F. Franke
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, US
| | - Jerome T. Galea
- School of Social Work, College of Behavioral and Community Sciences, University of South Florida, Tampa, US
| |
Collapse
|
8
|
Loh PY, Martinengo L, Heaukulani C, Tan XY, Hng M, Cheah YY, Morris RJT, Tudor Car L, Lee J. Characteristics and Outcomes of mHealth Interventions in Psychosis: Systematic Mapping Review. J Med Internet Res 2024; 26:e55924. [PMID: 39714907 PMCID: PMC11704647 DOI: 10.2196/55924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Revised: 06/28/2024] [Accepted: 10/06/2024] [Indexed: 12/24/2024] Open
Abstract
BACKGROUND Mobile health (mHealth) interventions have gained popularity in augmenting psychiatric care for adults with psychosis. Interest has grown in leveraging mHealth to empower individuals living with severe mental illness and extend continuity of care beyond the hospital to the community. However, reported outcomes have been mixed, likely attributed in part to the intervention and adopted outcomes, which affected between-study comparisons. OBJECTIVE This study aimed to critically review outcome measures used to evaluate mHealth interventions for adults with psychosis in relation to the characteristics of mHealth interventions. METHODS A systematic mapping review was conducted. We searched PubMed, CINAHL, Embase, PsycINFO, and Cochrane Libraries from 1973 to the present. Selection criteria included randomized controlled studies of mHealth interventions in adults diagnosed with schizophrenia spectrum disorders. Reviewers worked in pairs to screen and extract data from included studies independently using a standardized form; disagreements were resolved by consensus with an independent reviewer. We report our findings in line with PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. RESULTS A total of 1703 citations were screened; 29 publications reporting on 23 studies were included in this review. mHealth interventions for psychosis span a wide range, with psychological therapy being the most-deployed intervention (12/23, 52%), followed by psychoeducation (8/23, 35%) and active self-monitoring (8/23, 35%). Several mHealth interventions for psychosis targeted multiple pillars of biopsychosocial well-being (10/23, 43%); the bulk of interventions (16/23, 70%) incorporated features promoting users' self-management. The majority of mHealth interventions were delivered through applications (14/23, 61%) as the main medium and smartphones (17/23, 74%) as the main channel of delivery. Interventions were primarily administered in the outpatient and community settings (16/23, 70%); many were also blended with in-person sessions (11/23, 48%) or guided remotely (6/23, 26%) by persons, including health care providers or trained peer supporters. The severity of psychosis-related symptoms (21/23, 91%) was the most prevalent outcome, of which positive symptoms (13/23, 57%), mood and anxiety (10/23, 43%), and overall psychopathology severity (9/23, 39%) were most commonly measured. Patient-centric outcomes, including well-being (17/23, 74%)-particularly quality of life (10/23, 43%)-and user experience (15/23, 65%), including feasibility (7/23, 30%), acceptability (7/23, 30%), and engagement (7/23, 26%). Notably, outcome choices remained diverse despite stratification by type of mHealth intervention. CONCLUSIONS mHealth interventions for psychosis encompass a wide range of modalities and use outcome measures that probe various social and behavioral determinants of health. These should be considered complex interventions, and a holistic evaluation approach combining clinical and patient-centric outcomes is recommended.
Collapse
Affiliation(s)
- Pei Yi Loh
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Laura Martinengo
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
- Centre for Behavioural and Implementation Sciences Interventions, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | | | - Xin Yang Tan
- Office for Healthcare Transformation, Ministry of Health, Singapore, Singapore
| | - Moses Hng
- Institute of Mental Health, Singapore, Singapore
| | | | - Robert J T Morris
- Office for Healthcare Transformation, Ministry of Health, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Lorainne Tudor Car
- Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom
| | - Jimmy Lee
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
- Institute of Mental Health, Singapore, Singapore
| |
Collapse
|
9
|
Wani C, McCann L, Lennon M, Radu C. Digital Mental Health Interventions for Adolescents in Low- and Middle-Income Countries: Scoping Review. J Med Internet Res 2024; 26:e51376. [PMID: 39471371 PMCID: PMC11558223 DOI: 10.2196/51376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Revised: 05/07/2024] [Accepted: 09/04/2024] [Indexed: 11/01/2024] Open
Abstract
BACKGROUND Digital mental health interventions (DMHIs) are increasingly recognized as potential solutions for adolescent mental health, particularly in low- and middle-income countries (LMICs). The United Nations' Sustainable Development Goals and universal health coverage are instrumental tools for achieving mental health for all. Within this context, understanding the design, evaluation, as well as the barriers and facilitators impacting adolescent engagement with mental health care through DMHIs is essential. OBJECTIVE This scoping review aims to provide insights into the current landscape of DMHIs for adolescents in LMICs. METHODS The Joanna Briggs Institute scoping review methodology was used, following the recommendations of the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews). Our search strategy incorporated 3 key concepts: population "adolescents," concept "digital mental health interventions," and context "LMICs." We adapted this strategy for various databases, including ACM Digital Library, APA PsycINFO, Cochrane Library, Google Scholar (including gray literature), IEEE Xplore, ProQuest, PubMed (NLM), ScienceDirect, Scopus, and Web of Science. The articles were screened against a specific eligibility criterion from January 2019 to March 2024. RESULTS We analyzed 20 papers focusing on DMHIs for various mental health conditions among adolescents, such as depression, well-being, anxiety, stigma, self-harm, and suicide ideation. These interventions were delivered in diverse formats, including group delivery and self-guided interventions, with support from mental health professionals or involving lay professionals. The study designs and evaluation encompassed a range of methodologies, including randomized controlled trials, mixed methods studies, and feasibility studies. CONCLUSIONS While there have been notable advancements in DMHIs for adolescents in LMICs, the research base remains limited. Significant knowledge gaps persist regarding the long-term clinical benefits, the maturity and readiness of LMIC digital infrastructure, cultural appropriateness, and cost-effectiveness across the heterogeneous LMIC settings. Addressing these gaps necessitates large-scale, co-designed, and culturally sensitive DMHI trials. Future work should address this.
Collapse
Affiliation(s)
- Carolina Wani
- Department of Computer and Information Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Lisa McCann
- Department of Computer and Information Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Marilyn Lennon
- Department of Computer and Information Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Caterina Radu
- Department of Computer and Information Sciences, University of Strathclyde, Glasgow, United Kingdom
| |
Collapse
|
10
|
Moretti F, Bortolini T, Hartle L, Moll J, Mattos P, Furtado DR, Fontenelle L, Fischer R. Engagement challenges in digital mental health programs: hybrid approaches and user retention of an online self-knowledge journey in Brazil. Front Digit Health 2024; 6:1383999. [PMID: 39386389 PMCID: PMC11461457 DOI: 10.3389/fdgth.2024.1383999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Accepted: 08/01/2024] [Indexed: 10/12/2024] Open
Abstract
Digital mental health interventions (DMHIs) have surged in popularity over the last few years. However, adherence to self-guided interventions remains a major hurdle to overcome. The current study utilized a phased implementation design, incorporating diverse samples and contexts to delve into the engagement challenges faced by a recently launched online mental health platform in Brazil with self-evaluation forms. Employing an iterative mixed-methods approach, including focus groups, online surveys, and think-aloud protocols, the research aims to evaluate user satisfaction, identify barriers to adherence, and explore potential hybrid solutions. Engagement in the platform was evaluated by descriptive statistics of the number of instruments completed, and qualitative interviews that were interpreted thematically. In the fully self-guided mode, 2,145 individuals registered, but a substantial majority (88.9%) engaged with the platform for only 1 day, and merely 3.3% completed all activities. In another sample of 50 participants were given a choice between online-only or a hybrid experience with face-to-face meetings. 40% of individuals from the hybrid group completed all activities, compared to 8% in the online-only format. Time constraints emerged as a significant barrier to engagement, with suggested improvements including app development, periodic reminders, and meetings with healthcare professionals. While the study identified weaknesses in the number and length of instruments, personalized results stood out as a major strength. Overall, the findings indicate high satisfaction with the mental health platform but underscore the need for improvements, emphasizing the promise of personalized mental health information and acknowledging persistent barriers in a digital-only setting.
Collapse
Affiliation(s)
- Felipe Moretti
- Cognitive and Neuroinformatics Unit, D’Or Institute for Research and Education, São Paulo, Brazil
| | - Tiago Bortolini
- Cognitive and Neuroinformatics Unit, D’Or Institute for Research and Education, Rio de Janeiro, Brazil
| | - Larissa Hartle
- Cognitive and Neuroinformatics Unit, D’Or Institute for Research and Education, Rio de Janeiro, Brazil
| | - Jorge Moll
- Neuroscience Unit, D'Or Institute for Research and Education, Rio de Janeiro, Brazil
| | - Paulo Mattos
- Neuroscience Unit, D'Or Institute for Research and Education, Rio de Janeiro, Brazil
| | - Daniel R. Furtado
- Open D'Or Unit, D'Or Institute for Research and Education, Rio de Janeiro, Brazil
| | - Leonardo Fontenelle
- Neuroscience Unit, D'Or Institute for Research and Education, Rio de Janeiro, Brazil
| | - Ronald Fischer
- Cognitive and Neuroinformatics Unit, D’Or Institute for Research and Education, São Paulo, Brazil
| |
Collapse
|
11
|
Gaina MA, Sbarcea SV, Popa BS, Stefanescu BV, Gaina AM, Szalontay AS, Bolos A, Stefanescu C. SAFEvR MentalVeRse.app: Development of a Free Immersive Virtual Reality Exposure Therapy for Acrophobia and Claustrophobia. Brain Sci 2024; 14:651. [PMID: 39061393 PMCID: PMC11274658 DOI: 10.3390/brainsci14070651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 06/13/2024] [Accepted: 06/24/2024] [Indexed: 07/28/2024] Open
Abstract
Background: Specific phobias impact over 400 million people worldwide. Digitalizing mental health could alleviate the burden. Still, although the corporate-driven Metaverse is expanding rapidly, there needs to be more momentum in harnessing virtual reality exposure therapy uptake. Objective: This study aims to conceptualize, develop, and deploy a free Virtual Reality Exposure Therapy (VRET) application specifically designed for treating acrophobia and claustrophobia. This pilot study, which holds the promise of a future where mental health is more accessible and effective, explores the feasibility of leveraging transdisciplinary collaboration among specialists to create a safe, accessible, and effective VRET solution. Methods: We conducted a Delphi heuristic approach involving bioethicists, neuroscientists, and tech developers. Second, we reviewed the existing psychological theories and therapeutic strategies for addressing phobias in VR. Third, we conceptualized a thematic analysis-derived framework for a safe, adaptive-gamified free exposure to virtual reality acrophobia and claustrophobia (SAFEvR ACT). Finally, we provide an overview of the iterative improvements made during 12 workshops and 76 weekly briefings on developmental implementations. Results: We developed the SAFEvR ACT into a proof-of-concept application freely deployed on the MentalVerse app platform. Our safety-focused approach can benefit from prevalidation perspectives within future randomized control trials. Conclusions: The resulting application derived from the SAFEvR ACT framework represents a blueprint to counter the current lack of iVR mental health uptake by offering a free VRET alternative. Future research should aim towards developing similar free platforms to lessen mental health burdens and gather quantitative data. We conclude with a call to action to researchers to fine-tune our current approach and take a stand for free digital mental health within MentalVeRse.app.
Collapse
Affiliation(s)
- Marcel-Alexandru Gaina
- Psychiatry, Department of Medicine III, Faculty of Medicine, Grigore T. Popa University of Medicine and Pharmacy of Iasi, 16 Universitatii Street, 700115 Iasi, Romania; (A.-S.S.); (A.B.); (C.S.)
- Institute of Psychiatry “Socola”, 36 Bucium Street, 700282 Iasi, Romania
- The Association of Integrative Psychotherapy and Clinical Psychology, 700469 Iasi, Romania
| | - Stefan-Vladimir Sbarcea
- Faculty of Computer Science, “Alexandru Ioan Cuza” University, 700483 Iasi, Romania; (S.-V.S.); (B.-S.P.)
| | - Bianca-Stefana Popa
- Faculty of Computer Science, “Alexandru Ioan Cuza” University, 700483 Iasi, Romania; (S.-V.S.); (B.-S.P.)
| | - Bogdan-Victor Stefanescu
- Faculty of Medicine, University of Medicine and Pharmacy “Grigore T. Popa” Iași, 700115 Iasi, Romania
| | - Alexandra-Maria Gaina
- PhD Department, University of Medicine and Pharmacy “Grigore T. Popa” Iași, 700115 Iasi, Romania;
| | - Andreea-Silvana Szalontay
- Psychiatry, Department of Medicine III, Faculty of Medicine, Grigore T. Popa University of Medicine and Pharmacy of Iasi, 16 Universitatii Street, 700115 Iasi, Romania; (A.-S.S.); (A.B.); (C.S.)
- Institute of Psychiatry “Socola”, 36 Bucium Street, 700282 Iasi, Romania
| | - Alexandra Bolos
- Psychiatry, Department of Medicine III, Faculty of Medicine, Grigore T. Popa University of Medicine and Pharmacy of Iasi, 16 Universitatii Street, 700115 Iasi, Romania; (A.-S.S.); (A.B.); (C.S.)
- Institute of Psychiatry “Socola”, 36 Bucium Street, 700282 Iasi, Romania
| | - Cristinel Stefanescu
- Psychiatry, Department of Medicine III, Faculty of Medicine, Grigore T. Popa University of Medicine and Pharmacy of Iasi, 16 Universitatii Street, 700115 Iasi, Romania; (A.-S.S.); (A.B.); (C.S.)
- Institute of Psychiatry “Socola”, 36 Bucium Street, 700282 Iasi, Romania
| |
Collapse
|
12
|
Miguel-Álvaro A, Estupiñá Puig FJ, Larroy C. Provision of Telepsychological Care Via Email during COVID-19 Confinement: An Exploratory Study. THE SPANISH JOURNAL OF PSYCHOLOGY 2024; 27:e14. [PMID: 38766779 DOI: 10.1017/sjp.2024.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Within teletherapy, email interventions have been studied scarcely. For this reason, this exploratory study aims to characterize the assistance provided by email in a university telepsychology service and to compare the data with the assistance provided by telephone in the same service and period. For this purpose, the records of 81 users assisted via email during the COVID-19 pandemic lockdown in Spain were analyzed. The data were compared with those of the 338 users assisted by telephone in the same period. Despite its many limitations, results indicate high satisfaction with the email modality. Users express that they prefer a preference for using email when they do not feel safe in other ways. We found a lot of variation between the number of emails exchanged and the days that each case was active. Additionally, differences were found with telephone users in aspects such as age (email users being younger) and in a depression screening (email users scoring more positively). This study concludes on the high potential of this channel for the application of certain techniques (e.g., psychoeducation) or for people with certain characteristics.
Collapse
|
13
|
Abouzeid N, Lal S. The role of sociodemographic factors on the acceptability of digital mental health care: A scoping review protocol. PLoS One 2024; 19:e0301886. [PMID: 38669278 PMCID: PMC11051634 DOI: 10.1371/journal.pone.0301886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 03/22/2024] [Indexed: 04/28/2024] Open
Abstract
INTRODUCTION Many individuals experiencing mental health complications face barriers when attempting to access services. To bridge this care gap, digital mental health innovations (DMHI) have proven to be valuable additions to in-person care by enhancing access to care. An important aspect to consider when evaluating the utility of DMHI is perceived acceptability. However, it is unclear whether diverse sociodemographic groups differ in their degree of perceived acceptability of DMHI. OBJECTIVE This scoping review aims to synthesize evidence on the role of sociodemographic factors (e.g., age, gender) in the perceived acceptability of DMHI among individuals seeking mental health care. METHODS Guided by the JBI Manual of Evidence Synthesis, chapter on Scoping Review, a search strategy developed according to the PCC framework will be implemented in MEDLINE and then adapted to four electronic databases (i.e., CINAHL, MEDLINE, PsycINFO, and EMBASE). The study selection strategy will be piloted by two reviewers on subsets of 30 articles until agreement among reviewers reaches 90%, after which one reviewer will complete the remaining screening of titles and abstracts. The full-text screening, data extraction strategy, and charting tool will be completed by one reviewer and then validated by a second member of the team. Main findings will be presented using tables and figures. EXPECTED CONTRIBUTIONS This scoping review will examine the extent to which sociodemographic factors have been considered in the digital mental health literature. Also, the proposed review may help determine whether certain populations have been associated with a lower level of acceptability within the context of digital mental health care. This investigation aims to favor equitable access to DMHI among diverse populations.
Collapse
Affiliation(s)
- Nagi Abouzeid
- School of Rehabilitation, University of Montréal, Montréal, Québec, Canada
- Youth Mental Health and Technology Lab, University of Montréal Hospital Research Centre, Montréal, Québec, Canada
| | - Shalini Lal
- School of Rehabilitation, University of Montréal, Montréal, Québec, Canada
- Youth Mental Health and Technology Lab, University of Montréal Hospital Research Centre, Montréal, Québec, Canada
- Douglas Research Centre, Montréal, Québec, Canada
| |
Collapse
|
14
|
Yeo G, Reich SM, Liaw NA, Chia EYM. The Effect of Digital Mental Health Literacy Interventions on Mental Health: Systematic Review and Meta-Analysis. J Med Internet Res 2024; 26:e51268. [PMID: 38421687 PMCID: PMC10941000 DOI: 10.2196/51268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 10/25/2023] [Accepted: 12/25/2023] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Accelerated by technological advancements and the recent global pandemic, there is burgeoning interest in digital mental health literacy (DMHL) interventions that can positively affect mental health. However, existing work remains inconclusive regarding the effectiveness of DMHL interventions. OBJECTIVE This systematic review and meta-analysis investigated the components and modes of DMHL interventions, their moderating factors, and their long-term impacts on mental health literacy and mental health. METHODS We used a random-effects model to conduct meta-analyses and meta-regressions on moderating effects of DMHL interventions on mental health. RESULTS Using 144 interventions with 206 effect sizes, we found a moderate effect of DMHL interventions in enhancing distal mental health outcomes (standardized mean difference=0.42, 95% CI -0.10 to 0.73; P<.001) and a large effect in increasing proximal mental health literacy outcomes (standardized mean difference=0.65, 95% CI 0.59-0.74; P<.001). Uptake of DMHL interventions was comparable with that of control conditions, and uptake of DMHL interventions did not moderate the effects on both proximal mental health literacy outcomes and distal mental health outcomes. DMHL interventions were as effective as face-to-face interventions and did not differ by platform type or dosage. DMHL plus interventions (DMHL psychoeducation coupled with other active treatment) produced large effects in bolstering mental health, were more effective than DMHL only interventions (self-help DMHL psychoeducation), and were comparable with non-DMHL interventions (treatment as usual). DMHL interventions demonstrated positive effects on mental health that were sustained over follow-up assessments and were most effective in enhancing the mental health of emerging and older adults. CONCLUSIONS For theory building, our review and meta-analysis found that DMHL interventions are as effective as face-to-face interventions. DMHL interventions confer optimal effects on mental health when DMHL psychoeducation is combined with informal, nonprofessional active treatment components such as skills training and peer support, which demonstrate comparable effectiveness with that of treatment as usual (client-professional interactions and therapies). These effects, which did not differ by platform type or dosage, were sustained over time. Additionally, most DMHL interventions are found in Western cultural contexts, especially in high-income countries (Global North) such as Australia, the United States, and the United Kingdom, and limited research is conducted in low-income countries in Asia and in South American and African countries. Most of the DMHL studies did not report information on the racial or ethnic makeup of the samples. Future work on DMHL interventions that target racial or ethnic minority groups, particularly the design, adoption, and evaluation of the effects of culturally adaptive DMHL interventions on uptake and mental health functioning, is needed. Such evidence can drive the adoption and implementation of DMHL interventions at scale, which represents a key foundation for practice-changing impact in the provision of mental health resources for individuals and the community. TRIAL REGISTRATION PROSPERO International Prospective Register of Systematic Reviews CRD42023363995; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023363995.
Collapse
Affiliation(s)
- GeckHong Yeo
- N.1 Institute for Health, National University of Singapore, Singapore, Singapore
| | - Stephanie M Reich
- School of Education, University of California, Irvine, Irvine, CA, United States
| | - Nicole A Liaw
- SHINE Children and Youth Services, Singapore, Singapore, Singapore
| | | |
Collapse
|
15
|
Maurer K, Kimyaci M, Konyk K, Wekerle C. Building resilience through daily smartphone app use: results of a pilot study of the JoyPop app with social work students. Front Digit Health 2023; 5:1265120. [PMID: 38053917 PMCID: PMC10694474 DOI: 10.3389/fdgth.2023.1265120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 09/13/2023] [Indexed: 12/07/2023] Open
Abstract
Background The JoyPop™ smartphone app is a digital intervention designed to enhance day-to-day resilience in youth, particularly those exposed to traumatogenic events [adverse childhood experiences (ACEs)]. Processes of adaptation that foster resilience in response to high stress include affect, cognitive, and behavioral regulation, and social interaction. Digital interventions have application for youth and those who provide them support, including social work trainees navigating the stressors of university studies concurrent with practice internships. Research on resilience-enhancing apps is needed to understand the underlying mechanisms by which change occurs and who is most likely to benefit from these interventions. Methods Social work student participants (N = 91) were invited to use the JoyPop app two times daily for 28 days. Baseline ACE exposure and change-over-time in affect regulation, stress responsivity, and social support were evaluated after 2 and 4 weeks of app use with t-tests and generalized estimating equation (GEE) modeling. Results Participants identified predominantly as cisgender women of European descent, mean age 26 years (SD = 6.78), 70% undergraduates, and reported consistent daily app use (Mean days = 26.9, SD = 1.90). Self-reported baseline ACE exposure was high (30% ≥ 5+). We tested change-over-time with generalized estimating equation and saw improvement in affect regulation in the Abbreviated Dysregulation Inventory scale (β = -3.38, p = <.001), and subscales of behavioral (β = -1.63, p = <.001), affect (β = -3.24, p = <.001), and cognitive regulation (β = 1.50, p = .009). Perceived stress decreased with app use (β = -2.65, p = <.001) and even more so for participants with reported exposure to more than 4 ACEs (β = -3.786, p = .030). Conclusions The exploratory findings from our pilot study suggest that consistent use of the app may enhance multidimensional resilience amongst university students who self-report higher than average levels of baseline traumatogenic exposures. Our findings support an approach modeling resilience as a complex, dynamic, multicomponent process supported by resources within and between individuals. Further testing of the mechanisms of adaptation in response to high stress that enhance resilience and identification of the JoyPop™ app features that influence this change is needed to validate that daily app use could help youth with experiences of past and current high stress to better regulate their affect, reduce stress reactivity, and increase resilience.
Collapse
Affiliation(s)
- Katherine Maurer
- School of Social Work, Centre for Research on Children and Families, McGill University, Montreal, QC, Canada
| | - Mert Kimyaci
- School of Social Work, Centre for Research on Children and Families, McGill University, Montreal, QC, Canada
| | - Katy Konyk
- School of Social Work, Centre for Research on Children and Families, McGill University, Montreal, QC, Canada
| | | |
Collapse
|
16
|
Babbott KM, Serlachius A. Developing digital mental health tools for youth with diabetes: an agenda for future research. FRONTIERS IN CLINICAL DIABETES AND HEALTHCARE 2023; 4:1227332. [PMID: 37497385 PMCID: PMC10367007 DOI: 10.3389/fcdhc.2023.1227332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 06/26/2023] [Indexed: 07/28/2023]
Abstract
Youth living with diabetes face a concurrent challenge: managing a chronic health condition and managing the psychosocial and developmental changes that are characteristic of adolescence and young adulthood. Despite these unique challenges, psychological support is often difficult for youth with diabetes to access due to a lack of trained mental health professionals and other resource constraints. Digital wellbeing tools offer the potential to improve access to psychological support for this population. However, very few digital wellbeing tools exist for youth with diabetes. Of those that do exist, very few are evidence-based therapies, undermining their contribution to the field. Given the increasing global prevalence of diabetes in young people, the support necessitated by the challenges experienced by this population is not always accessible in a face-to-face setting and cannot be effectively scaled to meet demand. To support the health and wellbeing of youth with diabetes, there is a clear need to develop digital interventions that are widely accessible to users, but, more saliently, grounded in empirical evidence that supports their efficacy. Thus, the purpose of this paper is to offer an agenda for future research, including insights into which psychological techniques and behavioral change theories may be a good conceptual fit for digital mental health interventions, and how these tools may be best developed and utilized by the individuals that need them. Scalable, evidence-based wellbeing tools for this population are urgently required to improve psychological outcomes, and potentially, improve the equity of service access.
Collapse
|
17
|
Liu XQ, Guo YX, Zhang XR, Zhang LX, Zhang YF. Digital interventions empowering mental health reconstruction among students after the COVID-19 pandemic. World J Psychiatry 2023; 13:397-401. [PMID: 37383289 PMCID: PMC10294129 DOI: 10.5498/wjp.v13.i6.397] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 05/13/2023] [Accepted: 05/24/2023] [Indexed: 06/19/2023] Open
Abstract
With the gradual end of the coronavirus disease 2019 (COVID-19) pandemic, the reconstruction of students' mental health is urgently necessary. Digital interventions offer advantages such as high accessibility, anonymity, and accurate identification, which can promote the reconstruction of students' mental health through the provision of psychological support platforms, psychological assessment tools, and online mental health activities. However, we recognize that digital interventions must undergo many adjustments, and corresponding ethical norms require further clarification. It is crucial for different stakeholders to collaborate and work toward maximizing the effectiveness of digital interventions for the reconstruction of mental health after the COVID-19 pandemic.
Collapse
Affiliation(s)
- Xin-Qiao Liu
- School of Education, Tianjin University, Tianjin 300350, China
| | - Yu-Xin Guo
- School of Education, Tianjin University, Tianjin 300350, China
| | - Xin-Ran Zhang
- School of Education, Tianjin University, Tianjin 300350, China
| | - Lin-Xin Zhang
- School of Education, Tianjin University, Tianjin 300350, China
| | - Yi-fan Zhang
- School of Education, Tianjin University, Tianjin 300350, China
| |
Collapse
|
18
|
Cascalheira CJ, Flinn RE, Zhao Y, Klooster D, Laprade D, Hamdi SM, Scheer JR, Gonzalez A, Lund EM, Gomez IN, Saha K, De Choudhury M. Models of Gender Dysphoria Using Social Media Data for Use in Technology-Delivered Interventions: Machine Learning and Natural Language Processing Validation Study. JMIR Form Res 2023; 7:e47256. [PMID: 37327053 DOI: 10.2196/47256] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Revised: 04/28/2023] [Accepted: 05/15/2023] [Indexed: 06/17/2023] Open
Abstract
BACKGROUND The optimal treatment for gender dysphoria is medical intervention, but many transgender and nonbinary people face significant treatment barriers when seeking help for gender dysphoria. When untreated, gender dysphoria is associated with depression, anxiety, suicidality, and substance misuse. Technology-delivered interventions for transgender and nonbinary people can be used discretely, safely, and flexibly, thereby reducing treatment barriers and increasing access to psychological interventions to manage distress that accompanies gender dysphoria. Technology-delivered interventions are beginning to incorporate machine learning (ML) and natural language processing (NLP) to automate intervention components and tailor intervention content. A critical step in using ML and NLP in technology-delivered interventions is demonstrating how accurately these methods model clinical constructs. OBJECTIVE This study aimed to determine the preliminary effectiveness of modeling gender dysphoria with ML and NLP, using transgender and nonbinary people's social media data. METHODS Overall, 6 ML models and 949 NLP-generated independent variables were used to model gender dysphoria from the text data of 1573 Reddit (Reddit Inc) posts created on transgender- and nonbinary-specific web-based forums. After developing a codebook grounded in clinical science, a research team of clinicians and students experienced in working with transgender and nonbinary clients used qualitative content analysis to determine whether gender dysphoria was present in each Reddit post (ie, the dependent variable). NLP (eg, n-grams, Linguistic Inquiry and Word Count, word embedding, sentiment, and transfer learning) was used to transform the linguistic content of each post into predictors for ML algorithms. A k-fold cross-validation was performed. Hyperparameters were tuned with random search. Feature selection was performed to demonstrate the relative importance of each NLP-generated independent variable in predicting gender dysphoria. Misclassified posts were analyzed to improve future modeling of gender dysphoria. RESULTS Results indicated that a supervised ML algorithm (ie, optimized extreme gradient boosting [XGBoost]) modeled gender dysphoria with a high degree of accuracy (0.84), precision (0.83), and speed (1.23 seconds). Of the NLP-generated independent variables, Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) clinical keywords (eg, dysphoria and disorder) were most predictive of gender dysphoria. Misclassifications of gender dysphoria were common in posts that expressed uncertainty, featured a stressful experience unrelated to gender dysphoria, were incorrectly coded, expressed insufficient linguistic markers of gender dysphoria, described past experiences of gender dysphoria, showed evidence of identity exploration, expressed aspects of human sexuality unrelated to gender dysphoria, described socially based gender dysphoria, expressed strong affective or cognitive reactions unrelated to gender dysphoria, or discussed body image. CONCLUSIONS Findings suggest that ML- and NLP-based models of gender dysphoria have significant potential to be integrated into technology-delivered interventions. The results contribute to the growing evidence on the importance of incorporating ML and NLP designs in clinical science, especially when studying marginalized populations.
Collapse
Affiliation(s)
- Cory J Cascalheira
- Department of Counseling & Educational Psychology, New Mexico State University, Las Cruces, NM, United States
- Department of Psychology, Syracuse University, Syracuse, NY, United States
| | - Ryan E Flinn
- Augusta University, Augusta, GA, United States
- University of North Dakota, Grand Forks, ND, United States
| | - Yuxuan Zhao
- Department of Counseling & Educational Psychology, New Mexico State University, Las Cruces, NM, United States
| | | | - Danica Laprade
- Northern Arizona University, Flagstaff, AZ, United States
| | - Shah Muhammad Hamdi
- Department of Computer Science, Utah State University, Logan, UT, United States
| | - Jillian R Scheer
- Department of Psychology, Syracuse University, Syracuse, NY, United States
| | | | - Emily M Lund
- University of Alabama, Tuscaloosa, AL, United States
- Ewha Women's University, Seoul, Republic of Korea
| | - Ivan N Gomez
- Department of Counseling & Educational Psychology, New Mexico State University, Las Cruces, NM, United States
| | - Koustuv Saha
- University of Illinois at Urbana-Champaign, Champaign, IL, United States
| | | |
Collapse
|
19
|
Maechling C, Yrondi A, Cambon A. Mobile health in the specific management of first-episode psychosis: a systematic literature review. Front Psychiatry 2023; 14:1137644. [PMID: 37377474 PMCID: PMC10291100 DOI: 10.3389/fpsyt.2023.1137644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Accepted: 05/23/2023] [Indexed: 06/29/2023] Open
Abstract
Purpose The purpose of this systematic literature review is to assess the therapeutic efficacy of mobile health methods in the management of patients with first-episode psychosis (FEP). Method The participants are patients with FEP. The interventions are smartphone applications. The studies assess the preliminary efficacy of various types of application. Results One study found that monitoring symptoms minimized relapses, visits to A&E and hospital admissions, while one study showed a decrease in positive psychotic symptoms. One study found an improvement in anxiety symptoms and two studies noted an improvement in psychotic symptoms. One study demonstrated its efficacy in helping participants return to studying and employment and one study reported improved motivation. Conclusion The studies suggest that mobile applications have potential value in the management of young patients with FEP through the use of various assessment and intervention tools. This systematic review has several limitations due to the lack of randomized controlled studies available in the literature.
Collapse
Affiliation(s)
- Claire Maechling
- Pôle de Psychiatrie, Centre Hospitalier Universitaire de Toulouse, Toulouse, France
| | - Antoine Yrondi
- Service de Psychiatrie et de Psychologie Médicale, Centre Expert Dépression Résistante Fonda Mental, CHU de Toulouse, Hôpital Purpan, ToNIC Toulouse NeuroImaging Centre, Université de Toulouse, INSERM, UPS, Toulouse, France
| | - Amandine Cambon
- Programme d'intervention précoce RePeps, réseau Transition, Clinique Aufrery, Toulouse, France
| |
Collapse
|
20
|
Ting A, McLachlan C. Dr. Smartphone, can you support my trauma? An informatics analysis study of App Store apps for trauma- and stressor-related disorders. PeerJ 2023; 11:e15366. [PMID: 37187512 PMCID: PMC10178213 DOI: 10.7717/peerj.15366] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 04/16/2023] [Indexed: 05/17/2023] Open
Abstract
Background Psychological trauma is prevalent in developed countries, with prevalence rates and treatment needs exceeding health system capacity. As telemedicine and out-of-patient care are promoted, there has been an expansion of digital apps to compliment therapeutic stages in psychological trauma. To date there are no reviews that have compared these apps and their clinical utility. This study aims to identify the availability of trauma- and stressor-related mhealth apps, assess their functionality, and review their therapeutic abilities. Methodology The authors conducted a systematic search using an iPhone 13 Pro in the Australian IOS App Store to extract trauma- and stressor-related apps that resulted from the search criteria. A cross-adaptation of the Mobile App Rating Scale (MARS) and the Comprehensive App Evaluation Model (CAEM) were used as a framework to produce the mTrauma App Evaluation Conceptual Model and Informatics Framework. App content descriptors were analysed based on their general characteristics, usability, therapeutic focus, clinical utility, data integration. Following an applicability in concordance with psychological trauma-informed delivery. Results A total of 234 apps resulting from the search strategy were screened, with 81 apps that met the inclusion criteria. The majority of apps were marketed to 4+ to 17+ years of age, categorised as 'health and fitness', with the highest target markets observed for adolescents, children, parents, clinicians, and clients. A total of 43 apps (53.1%) contained a trauma-informed specified section, and 37 (45.7%) incorporated a section useful to support trauma-related symptoms. A significant number of apps there was an absence of therapeutic utility (in 32 apps (39.5%)). Most apps were supporting post-traumatic stress disorder-informed, cognitive behavioural therapy and eye movement desensitisation and reprocessing. Provision of psychoeducation, courses, guided sessions, trainings, self-reflection/journaling, symptom management and progress tracking were highly present. Conclusions Trauma-informed mobile apps are available in the App Store, expanding in its target market reach and usability, with an increase of creative psychotherapies being introduced alongside conventional modalities. However, based on the app descriptors, the scarcity of evidenced-based testimonials and therapeutic applicability remains questionable for clinical validity. Although mhealth tools are marketed as trauma-related, current available apps employ a multifunctional approach to general psychological symptomatology, through to associated comorbid conditions and emphasizes on passive activity. For higher uptake on user engagement, clinical application and validity, trauma-apps require curated specification to fulfil its role as complimentary psychological treatment.
Collapse
Affiliation(s)
- Amanda Ting
- Centre for Healthy Futures, Torrens University Australia, Surry Hills, New South Wales, Australia
| | - Craig McLachlan
- Centre for Healthy Futures, Torrens University Australia, Surry Hills, New South Wales, Australia
| |
Collapse
|
21
|
Stephenson C, Moghimi E, Gutierrez G, Jagayat J, Layzell G, Patel C, Omrani M, Alavi N. User experiences of an online therapist-guided psychotherapy platform, OPTT: A cross-sectional study. Internet Interv 2023; 32:100623. [PMID: 37273941 PMCID: PMC10235428 DOI: 10.1016/j.invent.2023.100623] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 04/17/2023] [Accepted: 04/20/2023] [Indexed: 06/06/2023] Open
Abstract
Introduction In the last few years, online psychotherapy programs have burgeoned since they are a more accessible and scalable treatment option compared to in-person therapies. While these online programs are promising, understanding the user experience and perceptions of care is essential for program optimization. Methods This study investigated the experiences of end-users who had previously received online psychotherapy through a web-based platform. A 35-item multiple-choice survey was developed by the research team and distributed to past users to capture their perceptions of the program. Results The survey yielded 163 responses, with a 90 % completion rate. Participants were predominantly white and female, with an average age of 42 years. While most participants preferred in-person therapy, they also reported the benefits of the online psychotherapy program. Participants had positive perceptions of the platform, the quality and interaction of their therapist, and the homework assignments and skills covered. Lack of motivation to complete weekly homework assignments was cited as a common struggle. Discussion The findings support online psychotherapy as a beneficial digital mental health tool and highlight some areas for improvement. Scalability and accessibility are key benefits of the platform. At the same time, improvements in participant engagement, including those from equity-seeking and equity-deserving groups, may enhance the efficacy of the programs offered.
Collapse
Affiliation(s)
- Callum Stephenson
- Department of Psychiatry, Faculty of Health Sciences, Queen's University, 166 Brock Street, Kingston, Ontario K7L 5G2, Canada
| | - Elnaz Moghimi
- Department of Psychiatry, Faculty of Health Sciences, Queen's University, 166 Brock Street, Kingston, Ontario K7L 5G2, Canada
- Waypoint Research Institute, Waypoint Centre for Mental Health Care, 500 Church Street, Penetanguishene, Ontario L9M 1G3, Canada
| | - Gilmar Gutierrez
- Department of Psychiatry, Faculty of Health Sciences, Queen's University, 166 Brock Street, Kingston, Ontario K7L 5G2, Canada
| | - Jasleen Jagayat
- Centre for Neuroscience Studies, Faculty of Health Sciences, Queen's University, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
| | - Georgina Layzell
- Centre for Neuroscience Studies, Faculty of Health Sciences, Queen's University, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
| | - Charmy Patel
- Department of Psychiatry, Faculty of Health Sciences, Queen's University, 166 Brock Street, Kingston, Ontario K7L 5G2, Canada
| | - Mohsen Omrani
- Department of Psychiatry, Faculty of Health Sciences, Queen's University, 166 Brock Street, Kingston, Ontario K7L 5G2, Canada
- OPTT Inc., DMZ 10 Dundas Street East, Toronto, Ontario M5B 2G9, Canada
| | - Nazanin Alavi
- Department of Psychiatry, Faculty of Health Sciences, Queen's University, 166 Brock Street, Kingston, Ontario K7L 5G2, Canada
- Centre for Neuroscience Studies, Faculty of Health Sciences, Queen's University, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- OPTT Inc., DMZ 10 Dundas Street East, Toronto, Ontario M5B 2G9, Canada
| |
Collapse
|
22
|
Digital Treatment Paths for Substance Use Disorders (SUDs). INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19127322. [PMID: 35742572 PMCID: PMC9224394 DOI: 10.3390/ijerph19127322] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 06/10/2022] [Indexed: 11/29/2022]
|
23
|
Bernard RM, Toppo C, Raggi A, de Mul M, de Miquel C, Pugliese MT, van der Feltz-Cornelis CM, Ortiz-Tallo A, Salvador-Carulla L, Lukersmith S, Hakkaart-van Roijen L, Merecz-Kot D, Staszewska K, Sabariego C. Strategies for Implementing Occupational eMental Health Interventions: Scoping Review. J Med Internet Res 2022; 24:e34479. [PMID: 35648457 PMCID: PMC9201704 DOI: 10.2196/34479] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Revised: 03/02/2022] [Accepted: 03/30/2022] [Indexed: 12/16/2022] Open
Abstract
BACKGROUND The implementation of eMental health interventions, especially in the workplace, is a complex process. Therefore, learning from existing implementation strategies is imperative to ensure improvements in the adoption, development, and scalability of occupational eMental health (OeMH) interventions. However, the implementation strategies used for these interventions are often undocumented or inadequately reported and have not been systematically gathered across implementations in a way that can serve as a much-needed guide for researchers. OBJECTIVE The objective of this scoping review was to identify implementation strategies relevant to the uptake of OeMH interventions that target employees and detail the associated barriers and facilitation measures. METHODS A scoping review was conducted. The descriptive synthesis was guided by the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework and the Consolidated Framework for Implementation Research. RESULTS A total of 31 of 32,916 (0.09%) publications reporting the use of the web-, smartphone-, telephone-, and email-based OeMH interventions were included. In all, 98 implementation strategies, 114 barriers, and 131 facilitators were identified. The synthesis of barriers and facilitators produced 19 facilitation measures that provide initial recommendations for improving the implementation of OeMH interventions. CONCLUSIONS This scoping review represents one of the first steps in a research agenda aimed at improving the implementation of OeMH interventions by systematically selecting, shaping, evaluating, and reporting implementation strategies. There is a dire need for improved reporting of implementation strategies and combining common implementation frameworks with more technology-centric implementation frameworks to fully capture the complexities of eHealth implementation. Future research should investigate a wider range of common implementation outcomes for OeMH interventions that also focus on a wider set of common mental health problems in the workplace. This scoping review's findings can be critically leveraged by discerning decision-makers to improve the reach, effectiveness, adoption, implementation, and maintenance of OeMH interventions.
Collapse
Affiliation(s)
| | - Claudia Toppo
- Neurology, Public Health and Disability Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milano, Italy
| | - Alberto Raggi
- Neurology, Public Health and Disability Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milano, Italy
| | - Marleen de Mul
- Erasmus School of Health Policy & Management, Erasmus University, Rotterdam, Netherlands
| | - Carlota de Miquel
- Research, Innovation and Teaching Unit, Parc Sanitari Sant Joan de Déu, Universitat de Barcelona, Sant Boi de Llobregat, Spain
- Instituto de Salud Carlos III, Centro de Investigación Biomédica en Red de Salud Mental, Madrid, Spain
| | - Maria Teresa Pugliese
- Neurology, Public Health and Disability Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milano, Italy
| | | | - Ana Ortiz-Tallo
- Instituto de Salud Carlos III, Centro de Investigación Biomédica en Red de Salud Mental, Madrid, Spain
- Department of Psychiatry, School of Medicine, Universidad Autónoma de Madrid, Madrid, Spain
| | - Luis Salvador-Carulla
- Health Research Institute, Faculty of Health, University of Canberra, Canberra, Australia
| | - Sue Lukersmith
- Health Research Institute, Faculty of Health, University of Canberra, Canberra, Australia
| | | | | | - Kaja Staszewska
- Department of Health and Work Psychology, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Carla Sabariego
- Swiss Paraplegic Research, Nottwil, Switzerland
- Department of Health Sciences and Medicine, University of Lucerne, Lucerne, Switzerland
- Center for Rehabilitation in Global Health Systems, World Health Organization Collaborating Center, University of Lucerne, Lucerne, Switzerland
| |
Collapse
|
24
|
Funnell EL, Spadaro B, Benacek J, Martin-Key NA, Metcalfe T, Olmert T, Barton-Owen G, Bahn S. Learnings from user feedback of a novel digital mental health assessment. Front Psychiatry 2022; 13:1018095. [PMID: 36339864 PMCID: PMC9630572 DOI: 10.3389/fpsyt.2022.1018095] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 09/12/2022] [Indexed: 11/30/2022] Open
Abstract
Digital mental health interventions (DMHI) have the potential to address barriers to face-to-face mental healthcare. In particular, digital mental health assessments offer the opportunity to increase access, reduce strain on services, and improve identification. Despite the potential of DMHIs there remains a high drop-out rate. Therefore, investigating user feedback may elucidate how to best design and deliver an engaging digital mental health assessment. The current study aimed to understand 1304 user perspectives of (1) a newly developed digital mental health assessment to determine which features users consider to be positive or negative and (2) the Composite International Diagnostic Interview (CIDI) employed in a previous large-scale pilot study. A thematic analysis method was employed to identify themes in feedback to three question prompts related to: (1) the questions included in the digital assessment, (2) the homepage design and reminders, and (3) the assessment results report. The largest proportion of the positive and negative feedback received regarding the questions included in the assessment (n = 706), focused on the quality of the assessment (n = 183, 25.92% and n = 284, 40.23%, respectively). Feedback for the homepage and reminders (n = 671) was overwhelmingly positive, with the largest two themes identified being positive usability (i.e., ease of use; n = 500, 74.52%) and functionality (i.e., reminders; n = 278, 41.43%). The most frequently identified negative theme in results report feedback (n = 794) was related to the report content (n = 309, 38.92%), with users stating it was lacking in-depth information. Nevertheless, the most frequent positive theme regarding the results report feedback was related to wellbeing outcomes (n = 145, 18.26%), with users stating the results report, albeit brief, encouraged them to seek professional support. Interestingly, despite some negative feedback, most users reported that completing the digital mental health assessment has been worthwhile (n = 1,017, 77.99%). Based on these findings, we offer recommendations to address potential barriers to user engagement with a digital mental health assessment. In summary, we recommend undertaking extensive co-design activities during the development of digital assessment tools, flexibility in answering modalities within digital assessment, customizable additional features such as reminders, transparency of diagnostic decision making, and an actionable results report with personalized mental health resources.
Collapse
Affiliation(s)
- Erin Lucy Funnell
- Cambridge Centre for Neuropsychiatric Research, Department of Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, United Kingdom.,Psyomics Ltd., Cambridge, United Kingdom
| | - Benedetta Spadaro
- Cambridge Centre for Neuropsychiatric Research, Department of Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, United Kingdom
| | - Jiri Benacek
- Cambridge Centre for Neuropsychiatric Research, Department of Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, United Kingdom
| | - Nayra A Martin-Key
- Cambridge Centre for Neuropsychiatric Research, Department of Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, United Kingdom
| | - Tim Metcalfe
- Independent Researcher, Cambridge, United Kingdom
| | - Tony Olmert
- Cambridge Centre for Neuropsychiatric Research, Department of Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, United Kingdom
| | | | | |
Collapse
|