Using Participatory Design Methodologies to Co-Design and Culturally Adapt the Spanish Version of the Mental Health eClinic: Qualitative Study

Evaluating the Usability of an mHealth App for Empowering Cancer Survivors With Disabilities: Heuristic Evaluation and Usability Testing

BACKGROUND

More than 18 million cancer survivors are living in the United States. The effects of cancer and its treatments can have cognitive, psychological, physical, and social consequences that many survivors find incredibly disabling. Posttreatment support is often unavailable or underused, especially for survivors living with disabilities. This leaves them to deal with new obstacles and struggles on their own, oftentimes feeling lost during this transition. Mobile health (mHealth) interventions have been shown to effectively aid cancer survivors in dealing with many of the aftereffects of cancer and its treatments; these interventions hold immense potential for survivors living with disabilities. We developed a prototype for WeCanManage, an mHealth-delivered self-management intervention to empower cancer survivors living with disabilities through problem-solving, mindfulness, and self-advocacy training.

OBJECTIVE

Our study conducted a heuristic evaluation of the WeCanManage high-fidelity prototype and assessed its usability among cancer survivors with known disabilities.

METHODS

We evaluated the prototype using Nielsen's 10 principles of heuristic evaluation with 22 human-computer interaction university students. On the basis of the heuristic evaluation findings, we modified the prototype and conducted usability testing on 10 cancer survivors with a variety of known disabilities, examining effectiveness, efficiency, usability, and satisfaction, including a completion of the modified System Usability Scale (SUS).

RESULTS

The findings from the heuristic evaluation were mostly favorable, highlighting the need for a help guide, addressing accessibility concerns, and enhancing the navigation experience. After usability testing, the average SUS score was 81, indicating a good-excellent design. The participants in the usability testing sample expressed positive reactions toward the app's design, educational content and videos, and the available means of connecting with others. They identified areas for improvement, such as improving accessibility, simplifying navigation within the community forums, and providing a more convenient method to access the help guide.

CONCLUSIONS

Overall, usability testing showed positive results for the design of WeCanManage. The course content and features helped participants feel heard, understood, and less alone.

A systematic review and meta-analysis of the effectiveness of co-designed, in-person, mental health interventions for reducing anxiety and depression symptoms

BACKGROUND

Co-design is recommended in mental health fields and has been associated with improved intervention efficacy. Despite its growing popularity, syntheses of evidence on the effectiveness of co-designed interventions are scarce, and little is known about their impact on anxiety and depression.

METHODS

The purpose of this systematic review and meta-analysis was to consolidate evidence on the effectiveness of in-person, co-designed mental health interventions for reducing anxiety and depression symptoms. An exhaustive search was conducted across six electronic databases (PubMed, PsycINFO, Embase, CINAHL, CENTRAL, and ProQuest) and grey literature. Criteria for inclusion comprised studies utilizing randomized or quasi-randomized methods, implementing non-digital/in-person, co-designed interventions for mental health enhancement, and assessing anxiety and/or depression. Intervention impacts were evaluated using random-effects meta-analyses.

RESULTS

The review identified 20 studies, with only three using the term 'co-design'. Other terminologies included 'co-developed' (n = 2), 'co-produced' (n = 2), and 'CBPR' (n = 11). Seventeen studies exhibited moderate risk of bias, while three demonstrated high risk. Meta-analyses demonstrated a moderate non-significant effect size of 0.5 (95 % CI: -0.8, 1.08; p = 0.08) on depression outcomes, and a small non-significant effect size of 0.12 (95 % CI: -0.1, 0.33; p = 0.23) on anxiety outcomes.

LIMITATIONS

The majority of studies lacked sufficient statistical power to detect between-group differences. Following GRADE criteria, confidence in estimates was low.

CONCLUSIONS

Notwithstanding widespread enthusiasm for co-design, the current evidence base is inadequate to confirm the impact of in-person, co-designed mental health interventions on anxiety and depression. More full-scale evaluation trials of higher quality are urgently needed, along with uniform terminology and measurement.

Implementing and Evaluating a National Integrated Digital Registry and Clinical Decision Support System in Early Intervention in Psychosis Services (Early Psychosis Informatics Into Care): Co-Designed Protocol

BACKGROUND

Early intervention in psychosis (EIP) services are nationally mandated in England to provide multidisciplinary care to people experiencing first-episode psychosis, which disproportionately affects deprived and ethnic minority youth. Quality of service provision varies by region, and people from historically underserved populations have unequal access. In other disease areas, including stroke and dementia, national digital registries coupled with clinical decision support systems (CDSSs) have revolutionized the delivery of equitable, evidence-based interventions to transform patient outcomes and reduce population-level disparities in care. Given psychosis is ranked the third most burdensome mental health condition by the World Health Organization, it is essential that we achieve the same parity of health improvements.

OBJECTIVE

This paper reports the protocol for the program development phase of this study, in which we aimed to co-design and produce an evidence-based, stakeholder-informed framework for the building, implementation, piloting, and evaluation of a national integrated digital registry and CDSS for psychosis, known as EPICare (Early Psychosis Informatics into Care).

METHODS

We conducted 3 concurrent work packages, with reciprocal knowledge exchange between each. In work package 1, using a participatory co-design framework, key stakeholders (clinicians, academics, policy makers, and patient and public contributors) engaged in 4 workshops to review, refine, and identify a core set of essential and desirable measures and features of the EPICare registry and CDSS. Using a modified Delphi approach, we then developed a consensus of data priorities. In work package 2, we collaborated with National Health Service (NHS) informatics teams to identify relevant data currently captured in electronic health records, understand data retrieval methods, and design the software architecture and data model to inform future implementation. In work package 3, observations of stakeholder workshops and individual interviews with representative stakeholders (n=10) were subject to interpretative qualitative analysis, guided by normalization process theory, to identify factors likely to influence the adoption and implementation of EPICare into routine practice.

RESULTS

Stage 1 of the EPICare study took place between December 2021 and September 2022. The next steps include stage 2 building, piloting, implementation, and evaluation of EPICare in 5 demonstrator NHS Trusts serving underserved and diverse populations with substantial need for EIP care in England. If successful, this will be followed by stage 3, in which we will seek NHS adoption of EPICare for rollout to all EIP services in England.

CONCLUSIONS

By establishing a multistakeholder network and engaging them in an iterative co-design process, we have identified essential and desirable elements of the EPICare registry and CDSS; proactively identified and minimized potential challenges and barriers to uptake and implementation; and addressed key questions related to informatics architecture, infrastructure, governance, and integration in diverse NHS Trusts, enabling us to proceed with the building, piloting, implementation, and evaluation of EPICare.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/50177.

Developing a web-based app for non-mental health nurses to assess the mental health needs and risks of children and young people

There is high demand for specialist mental health services for children and young people in the UK. Non-mental health nurses are well-placed to assess the mental health needs and risks of children and young people to maximise opportunities for early intervention and relieve the pressure on child and adolescent mental health services. This article provides an overview of a service development project to develop a web-based application (app) to support non-mental health nurses when assessing the mental health needs and risks of children and young people. The article describes the development, testing and evaluation process, which involved consultation with children and young people as well as interviews, focus groups and an online survey with a range of professionals working with children and young people. Overall, the findings suggest that the app is appropriate for use by non-mental health nurses in terms of quality, functionality and acceptability.

Using co-design to develop the Adolescent Health Literacy Questionnaire for adolescents in Ireland

Health literacy measurement studies are important for the success of health promotion efforts targeting adolescents. However, the majority of health literacy measurement tools were originally developed for adult populations and may not be reflective of health literacy in the context of adolescence. The present study sought to co-design a health literacy questionnaire and vignettes for adolescents in Ireland aged 12-18 years. This article describes the qualitative phase of the study. In 2019-2021, eight adolescents from the Irish Heart Foundation's Youth Advisory Panel participated in two concept mapping workshops during which they defined healthy living. Results of the thematic analysis indicated that adolescents defined 'healthy living' as a life that was balanced, prioritizing mental health and sleep. According to their definition, healthy living was comprised of six main constructs, namely, knowledge; sources of quality health information; facilitators and barriers; influence of others; self-efficacy, self-management and resilience; and citizenship and communication. These constructs were used to develop vignettes and items for the Adolescent Health Literacy Questionnaire (AHLQ). These were tested on a sample of 80 adolescents to check whether the respondents understood the items and vignettes as intended. Results of the nine cognitive interviews indicated that the adolescents understood the content of the 10 vignettes and 41 items. While the vignettes and AHLQ were developed with Irish adolescents, the approaches taken can be generalized to adolescents living in other countries. This will allow for the development of tailored and relevant solutions for health literacy development and health promotion for this sub-population.

A cross-sectional study exploring equity of access to telehealth in culturally and linguistically diverse communities in a major health service

Objectives The utilisation of telehealth among culturally and linguistically diverse communities in Australia remains unexplored. We aimed to describe telehealth (telephone and videoconference) utilisation within a major health service and identify sociodemographic factors that may contribute to limited telehealth access. Methods A cross-sectional study was performed using service activity data from four metropolitan hospitals in Queensland, Australia. Outpatient department data (January to December 2021) were examined. These data included patients (N  = 153 427) of all ages who had an outpatient appointment within 10 speciality services (i.e. Hepatology, Gastroenterology, Immunology and Psychology) that were the most frequent videoconference users. This study measured telehealth utilisation across the four tertiary hospitals and its association with sociodemographic factors. Descriptive statistics and regression analysis were used. Multivariate regression models were adjusted by sex, socioeconomic level and language use. Results Overall, 39% of appointments were delivered through telehealth, with 65% of all reported telehealth services involving a telephone consultation. People who required interpreter services were 66% less likely to use telehealth services (OR adjusted 0.33, 95% CI 0.31-0.36, P  P  Conclusion There is a gap in Australian telehealth service use for people with culturally diverse backgrounds and limited English proficiency. This study highlights a critical need to determine how people from culturally diverse backgrounds would like to engage with digital care options such as telehealth and the necessary support to enable this.

Review: Patient engagement in child, adolescent, and youth mental health care research - a scoping review

BACKGROUND

Youth and children's lived experiences are rarely considered in studies seeking to improve or evaluate their mental health care. We conducted a scoping review to identify approaches to child, adolescent, and youth engagement in mental health studies as well as study-reported barriers, constraints, and facilitators to engagement.

METHOD

We systematically searched six electronic databases for literature. We included studies of mental health care service design, development, or evaluation that involved engagement of children, adolescents, and/or youth with mental disorders or who intentionally self-harm. Studies could be of any design as long as patient engagement was used at any point during its design and/or conduct. Engagement could include co-designing health services/interventions and/or participating as a co-researcher. We assessed the reporting of patient engagement using the Guidance for Reporting Involvement of Patients and the Public 2 Long-Form (GRIPP2-LF) checklist and used the Experience Based Co-design (EBCD) framework to guide data extraction and analysis.

RESULTS

Sixteen articles were included in the review. Most studies used engagement to develop or adapt a mental health service (75%) and utilized a participatory or co-design approach (69%). Participants were namely adolescents and youth (aged 10-24 years) with some studies including young adults (up to 29 years old). Most studies followed less than 50% of the EBCD framework, and the commonly reported study barriers were related to aspects addressed in EBCD: time restrictions, recruitment, and generalizability. Frequently reported study facilitators included study methodology, youth engagement, and having a diverse participant sample.

CONCLUSIONS

Findings from this review suggest that the EBCD framework is not commonly used to guide patient engagement in studies of mental health care services. Future initiatives should consider following the framework to ensure meaningful evaluation and improvements to youth and children's mental health care services.

Digital Health for Migrants, Ethnic and Cultural Minorities and the Role of Participatory Development: A Scoping Review

Digital health interventions (DHIs) are increasingly used to address the health of migrants and ethnic minorities, some of whom have reduced access to health services and worse health outcomes than majority populations. This study aims to give an overview of digital health interventions developed for ethnic or cultural minority and migrant populations, the health problems they address, their effectiveness at the individual level and the degree of participation of target populations during development. We used the methodological approach of the scoping review outlined by Tricco. We found a total of 2248 studies, of which 57 were included, mostly using mobile health technologies, followed by websites, informational videos, text messages and telehealth. Most interventions focused on illness self-management, mental health and wellbeing, followed by pregnancy and overall lifestyle habits. About half did not involve the target population in development and only a minority involved them consistently. The studies we found indicate that the increased involvement of the target population in the development of digital health tools leads to a greater acceptance of their use.

Access to Virtual Mental Healthcare and Support for Refugee and Immigrant Groups: A Scoping Review

Immigrant and refugee populations face multiple barriers to accessing mental health services. This scoping review applies the (Levesque et al. in Int J Equity Health 12:18, 2013) Patient-Centred Access to Healthcare model in exploring the potential of increased access through virtual mental healthcare services VMHS for these populations by examining the affordability, availability/accommodation, and appropriateness and acceptability of virtual mental health interventions and assessments. A search in CINAHL, MEDLINE, PSYCINFO, EMBASE, SOCINDEX and SCOPUS following (Arksey and O'Malley in Int J Soc Res Methodol 8:19-32, 2005) guidelines found 44 papers and 41 unique interventions/assessment tools. Accessibility depended on individual (e.g., literacy), program (e.g., computer required) and contextual/social factors (e.g., housing characteristics, internet bandwidth). Participation often required financial and technical support, raising important questions about the generalizability and sustainability of VMHS' accessibility for immigrant and refugee populations. Given limitations in current research (i.e., frequent exclusion of patients with severe mental health issues; limited examination of cultural dimensions; de facto exclusion of those without access to technology), further research appears warranted.

Supporting the Respiratory Health of Migrants and Refugees

Migrants and refugees are at risk of developing acute and chronic respiratory diseases at their destination countries. Yet, people from these populations are also least likely to access care within the current health care system across the world. Although biological, psychological, and social factors play a role in influencing risk of respiratory diseases among these populations, the influences from cultural differences on health behaviors cannot be ignored. Cultural differences are influential in affecting an individual's level of health literacy. Health professionals can contribute to the provision of equitable care to diverse communities through addressing issues related to linguistic and cultural differences.

Mobile Technologies for Supporting Mental Health in Youths: Scoping Review of Effectiveness, Limitations, and Inclusivity

BACKGROUND

Over the past decade, there has been growing support for the use of mobile health (mHealth) technologies to improve the availability of mental health interventions. While mHealth is a promising tool for improving access to interventions, research on the effectiveness and efficacy of mHealth apps for youths is limited, particularly for underrepresented populations, including youths of color and economically marginalized youths.

OBJECTIVE

This scoping review study sought to evaluate the following research questions: (1) What is the extent of the current literature on mHealth apps that provide intervention for mental health problems in children and adolescents? (2) What is known from the existing literature about the effectiveness or efficacy of delivering mental health services via mHealth apps? (3) What are the gaps in the knowledge base in the fields of technology and mental health? (4) Do the reviewed mHealth apps address issues of cultural sensitivity or have they been tested with underrepresented groups (ie, youths of color or economically marginalized groups)?

METHODS

An electronic database search was conducted using relevant search terms. Seven independent reviewers screened identified studies, including title and abstract review to determine if studies met the following inclusion criteria: (1) targeted samples with mental health symptomology or disorders, (2) studied youth participants aged 6-17 years, and (3) examined the use of a mobile app-based platform for intervention. Relevant studies were subjected to full-text review to extract and chart relevant data based on a priori research questions.

RESULTS

The initial database search yielded 304 papers published from 2010 to 2021. After screening and selection, the final review included 10 papers on the effectiveness and efficacy of mental health intervention apps for youths aged 8 to 17 years. Identified apps targeted a broad range of mental health challenges in youths (ie, depression, self-harm, autism spectrum disorder, anxiety, and obsessive-compulsive disorder). Results identified only a small number of studies suggesting that current effectiveness and efficacy research in this area are limited. While some studies provided general support for the effectiveness of mHealth apps in improving mental health outcomes in youths, several notable limitations were present across the literature, reducing the generalizability of findings. Additionally, considerations around racial, ethnic, and socioeconomic diversity were scarce across studies.

CONCLUSIONS

Although some studies cited in this scoping review provide support for the effectiveness and efficacy of mHealth apps targeting mental health concerns in youths, the overall body of literature remains quite limited. Moreover, mHealth apps expressly developed to be culturally responsive are almost nonexistent. Further efforts are needed to recruit youths who are typically underrepresented in research and invite stakeholder participation and collaborative input in the early stages of the mHealth app development process.

Barriers to and Facilitators of Digital Health Among Culturally and Linguistically Diverse Populations: Qualitative Systematic Review

BACKGROUND

Health care systems have become increasingly more reliant on patients' ability to navigate the digital world. However, little research has been conducted on why some communities are less able or less likely to successfully engage with digital health technologies (DHTs), particularly among culturally and linguistically diverse (CaLD) populations.

OBJECTIVE

This systematic review aimed to determine the barriers to and facilitators of interacting with DHTs from the perspectives of CaLD population groups, including racial or ethnic minority groups, immigrants and refugees, and Indigenous or First Nations people.

METHODS

A systematic review and thematic synthesis of qualitative studies was conducted. Peer-reviewed literature published between January 2011 and June 2022 was searched across 3 electronic databases. Terms for digital health were combined with terms for cultural or linguistic diversity, ethnic minority groups, or Indigenous and First Nations people and terms related to barriers to accessing digital technologies. A qualitative thematic synthesis was conducted to identify descriptive and analytical themes of barriers to and facilitators of interacting with DHTs. Quality appraisal was performed using the Mixed Methods Appraisal Tool.

RESULTS

Of the 1418 studies identified in the electronic search, a total of 34 (2.4%) were included in this review. Half of the included studies (17/34, 50%) were conducted in the United States. There was considerable variation in terms of the CaLD backgrounds of the participants. In total, 26% (9/34) of the studies focused on Indigenous or First Nations communities, 41% (14/34) were conducted among ethnic minority populations, 15% (5/34) of the studies were conducted among immigrants, and 18% (6/34) were conducted in refugee communities. Of the 34 studies, 21 (62%) described the development or evaluation of a digital health intervention, whereas 13 (38%) studies did not include an intervention but instead focused on elucidating participants' views and behaviors in relation to digital health. From the 34 studies analyzed, 18 descriptive themes were identified, each describing barriers to and facilitators of interacting with DHTs, which were grouped into 7 overarching analytical themes: using technology, design components, language, culture, health and medical, trustworthiness, and interaction with others.

CONCLUSIONS

This study identified several analytic and descriptive themes influencing access to and uptake of DHTs among CaLD populations, including Indigenous and First Nations groups. We found that cultural factors affected all identified themes to some degree and that cultural and linguistic perspectives should be considered in the design and delivery of DHTs, with this best served through the inclusion of the target communities at all stages of development. This may improve the potential of DHTs to be more acceptable, appropriate, and accessible to population groups currently at risk of not obtaining the full benefits of digital health.

The Effect of Mental Health Intervention before English Test on College Students' English Test Scores

It is necessary to pay attention to and study the physical and mental health development of college students. On the basis of statistical analysis of the questionnaire, this paper studies the impact of pretest mental health intervention on college students' English test scores, summarizes the problems and characteristics of college students' mental health, and explores the reasons for psychological problems. Based on the research results and related survey data of the mental health status of college students by scholars, this paper believes that these reasons mainly include students' personal reasons, school and social environment pressure, and insufficient family support factors. The data analysis shows that in the relationship between English education and mental health in colleges and universities, the amount of mental health intervention of students' extracurricular exercise has a stable and low negative correlation with the scores of each factor of SCL-90 (Symptom Checklist 90) and is negatively correlated with the scores of each subscale. The experimental results show that there are extremely significant differences in academic performance (F = 5.084, P < 0.01), and there is a certain linear relationship between students' mental health level and students' English exercise feeling. The lower the fatigue score, the higher the mental health level of the students, which effectively promotes the mental health development of college students.

Developing an mHealth App for Empowering Cancer Survivors With Disabilities: Co-design Study

Background

The transition from active treatment to long-term cancer survivorship leaves the needs of many cancer survivors unaddressed as they struggle with physical, cognitive, psychological, and social consequences of cancer and its treatment. The lack of guidance after treatment has forced cancer survivors to manage long-term effects on their own, which has an impact on their overall health, quality of life, and social participation. Mobile health (mHealth) interventions can be used to promote self-management and evidence-informed education.

Objective

This study aims to design an mHealth app for cancer survivors with disabilities that will offer interventions to improve their quality of life and increase their self-efficacy to manage cancer as a chronic condition.

Methods

We organized 3 co-design workshops with cancer survivors (n=5). These workshops included persona development based on data from 25 interviews with cancer survivors with disabilities; prototype ideation, where we sketched ideas for the prototype; and prototype development, where participants critiqued, and suggested improvements for, the wireframes.

Results

These workshops helped us to define the challenges that cancer survivors with disabilities face as well as important considerations when designing an mHealth app for cancer survivors with disabilities, such as the need for including flexibility, engagement, socialization, and a minimalistic design. We also outline guidelines for other researchers to follow when planning their own co-design workshops, which include allowing more time for discussion among participants, having small participant groups, keeping workshops engaging and inclusive, and letting participants dream big.

Conclusions

Using a co-design process aided us in developing a prototype of an mHealth app for cancer survivors with disabilities as well as a list of guidelines that other researchers can use to develop their own co-design workshops and design their app. Furthermore, working together with cancer survivors ensured that the design team had a deeper sense of empathy toward the target users and kept the focus on our ultimate goal: creating something that cancer survivors would want to use and benefit from. Future work will include usability testing of a high-fidelity prototype based on the results of these workshops.

The use of co-production, co-design and co-creation to mobilise knowledge in the management of health conditions: a systematic review

Background

Knowledge mobilisation is a term used in healthcare research to describe the process of generating, sharing and using evidence. ‘Co’approaches, such as co-production, co-design and co-creation, have been proposed as a way of overcoming the knowledge to practice gap. There is a need to understand why researchers choose to adopt these approaches, how they achieve knowledge mobilisation in the management of health conditions, and the extent to which knowledge mobilisation is accomplished.

Methods

Studies that explicitly used the terms co-production, co-design or co-creation to mobilise knowledge in the management of health conditions were included. Web of Science, EMBASE via OvidSP, MEDLINE via OvidSP and CINHAL via EBSCO databases were searched up to April 2021. Quality assessment was carried out using the Joanna Briggs Institute qualitative quality assessment checklist. Pluye and Hong’s seven steps for mixed studies reviews were followed. Data were synthesised using thematic synthesis.

Results

Twenty four international studies were included. These were qualitative studies, case studies and study protocols. Key aspects of ‘co’approaches were bringing people together as active and equal partners, valuing all types of knowledge, using creative approaches to understand and solve problems, and using iterative prototyping techniques. Authors articulated mechanisms of action that included developing a shared understanding, identifying and meeting needs, giving everyone a voice and sense of ownership, and creating trust and confidence. They believed these mechanisms could produce interventions that were relevant and acceptable to stakeholders, more useable and more likely to be implemented in healthcare. Varied activities were used to promote these mechanisms such as interviews and creative workshops. There appeared to be a lack of robust evaluation of the interventions produced so little evidence in this review that ‘co’approaches improved the management of health conditions.

Conclusion

Those using ‘co’approaches believed that they could achieve knowledge mobilisation through a number of mechanisms, but there was no evidence that these led to improved health. The framework of key aspects and mechanisms of ‘co’approaches developed here may help researchers to meet the principles of these approaches. There is a need for robust evaluation to identify whether ‘co’approaches produce improved health outcomes.

Trial Registration

PROSPERO CRD42020187463.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08079-y.

A Perspective on How User-Centered Design Could Improve the Impact of Self-Applied Psychological Interventions in Low- or Middle-Income Countries in Latin America

Global technological progress has generated alternatives for psychological assistance, both for the evaluation and for the treatment of different emotional disorders. Evidence suggests that Internet-based treatments are effective for the treatment of anxiety and depression disorders. However, in Latin America online treatments are still scarce compared to developed countries and have similar problems as developed countries, such as high dropout rate. One possible solution to help decrease the dropout rate is to design and develop online interventions based on the needs and characteristics of the users. The user-centered design (UCD) is a fundamental concept to develop successful online interventions. The objective of this article is to provide a perspective overview on how UCD could improve the impact of self-applied psychological interventions in low- or middle-income countries in Latin America; however this proposal can also be applied in low- and middle-income countries in other regions of the world. The literature on UCD has demonstrated its efficacy when properly applied in online interventions; however, it is not common to see how this methodology has been applied in research in online interventions, and regarding Latin America, this is even more scarce with a very limited number of articles implementing the principles of UCD.

Co-design for indigenous and other children and young people from priority social groups: A systematic review

Background

Co-design has increasingly been posited as a useful approach for Indigenous peoples and other social groups that experience inequities. However, the relatively rapid rise in co-design rhetoric has not necessarily been accompanied by increased understanding of whether co-design works for these social groups, and how equity is addressed.

Methods

We conducted a systematic review to identify the current state of co-design as theory and praxis within the context of health and/or disability related interventions or services, with a specific focus on equity considerations for Indigenous and other children and young people from priority social groups. Six electronic databases were searched systematically to identify peer-reviewed papers and grey literature (dissertation and theses) published between January 1, 2000 to December 31, 2020, and a hand-search of reference lists for selected full texts was undertaken.

Results

Fifteen studies met the inclusion criteria. Although all studies used the term ‘co-design’, only three provided a definition of what they meant by use of the term. Nine studies described one or more theory-based frameworks and a total of 26 methods, techniques and tools were reported, with only one study describing a formal evaluation. The key mechanism by which equity was addressed appeared to be the inclusion of participants from a social group experiencing inequities within an area of interest.

Conclusion

A dearth of information limits the extent to which the literature can be definitive as to whether co-design works for Indigenous and other children and young people from priority social groups, or whether co-design reduces health inequities. It is critical for quality reporting to occur regarding co-design definitions, theory, and praxis. There is an urgent requirement for evaluation research that focuses on co-design impacts and assesses the contribution of co-design to achieving equity. We also recommend culturally safe ethical processes be implemented whenever undertaking co-design.

•

Limited studies report co-design contribution to positive outcomes.

•

Evaluatin Evaluation of co-design impacts and contribution to equity is urgently required.

•

Culturally safe ethical processes must be implemented in co-design.

eHealth Tools That Assess and Track Health and Well-being in Children and Young People: Systematic Review

Background

eHealth tools that assess and track health outcomes in children or young people are an emerging type of technology that has the potential to reform health service delivery and facilitate integrated, interdisciplinary care.

Objective

The aim of this review is to summarize eHealth tools that have assessed and tracked health in children or young people to provide greater clarity around the populations and settings in which they have been used, characteristics of digital devices (eg, health domains, respondents, presence of tracking, and connection to care), primary outcomes, and risks and challenges of implementation.

Methods

A search was conducted in PsycINFO, PubMed or MEDLINE, and Embase in April 2020. Studies were included if they evaluated a digital device whose primary purpose was to assess and track health, focused on children or young people (birth to the age of 24 years), reported original research, and were published in peer-reviewed journals in English.

Results

A total of 39 papers were included in this review. The sample sizes ranged from 7 to 149,329 participants (median 163, mean 5155). More studies were conducted in urban (18/39, 46%) regions than in rural (3/39, 8%) regions or a combination of urban and rural areas (8/39, 21%). Devices were implemented in three main settings: outpatient health clinics (12/39, 31%), hospitals (14/39, 36%), community outreach (10/39, 26%), or a combination of these settings (3/39, 8%). Mental and general health were the most common health domains assessed, with a single study assessing multiple health domains. Just under half of the devices tracked children’s health over time (16/39, 41%), and two-thirds (25/39, 64%) connected children or young people to clinical care. It was more common for information to be collected from a single informant (ie, the child or young person, trained health worker, clinician, and parent or caregiver) than from multiple informants. The health of children or young people was assessed as a primary or secondary outcome in 36% (14/39) of studies; however, only 3% (1/39) of studies assessed whether using the digital tool improved the health of users. Most papers reported early phase research (formative or process evaluations), with fewer outcome evaluations and only 3 randomized controlled trials. Identified challenges or risks were related to accessibility, clinical utility and safety, uptake, data quality, user interface or design aspects of the device, language proficiency or literacy, sociocultural barriers, and privacy or confidentiality concerns; ways to address these barriers were not thoroughly explored.

Conclusions

eHealth tools that assess and track health in children or young people have the potential to enhance health service delivery; however, a strong evidence base validating the clinical utility, efficacy, and safety of tools is lacking, and more thorough investigation is needed to address the risks and challenges of using these emerging technologies in clinical care. At present, there is greater potential for the tools to facilitate multi-informant, multidomain assessments and longitudinally track health over time and room for further implementation in rural or remote regions and community settings around the world.

Data Visualization for Chronic Neurological and Mental Health Condition Self-management: Systematic Review of User Perspectives

BACKGROUND

Remote measurement technologies (RMT) such as mobile health devices and apps are increasingly used by those living with chronic neurological and mental health conditions. RMT enables real-world data collection and regular feedback, providing users with insights about their own conditions. Data visualizations are an integral part of RMT, although little is known about visualization design preferences from the perspectives of those living with chronic conditions.

OBJECTIVE

The aim of this review was to explore the experiences and preferences of individuals with chronic neurological and mental health conditions on data visualizations derived from RMT to manage health.

METHODS

In this systematic review, we searched peer-reviewed literature and conference proceedings (PubMed, IEEE Xplore, EMBASE, Web of Science, Association for Computing Machinery Computer-Human Interface proceedings, and the Cochrane Library) for original papers published between January 2007 and September 2021 that reported perspectives on data visualization of people living with chronic neurological and mental health conditions. Two reviewers independently screened each abstract and full-text article, with disagreements resolved through discussion. Studies were critically appraised, and extracted data underwent thematic synthesis.

RESULTS

We identified 35 eligible publications from 31 studies representing 12 conditions. Coded data coalesced into 3 themes: desire for data visualization, impact of visualizations on condition management, and visualization design considerations. Data visualizations were viewed as an integral part of users' experiences with RMT, impacting satisfaction and engagement. However, user preferences were diverse and often conflicting both between and within conditions.

CONCLUSIONS

When used effectively, data visualizations are valuable, engaging components of RMT. They can provide structure and insight, allowing individuals to manage their own health more effectively. However, visualizations are not "one-size-fits-all," and it is important to engage with potential users during visualization design to understand when, how, and with whom the visualizations will be used to manage health.

Differences in access to virtual and in-person primary care by race/ethnicity and community social vulnerability among adults diagnosed with COVID-19 in a large, multi-state health system

Background

Research exploring telehealth expansion during the COVID-19 pandemic has demonstrated that groups disproportionately impacted by COVID-19 also experience worse access to telehealth. However, this research has been cross-sectional or short in duration; geographically limited; has not accounted for pre-existing access disparities; and has not examined COVID-19 patients. We examined virtual primary care use by race/ethnicity and community social vulnerability among adults diagnosed with COVID-19 in a large, multi-state health system. We also assessed use of in-person primary care to understand whether disparities in virtual access may have been offset by improved in-person access.

Methods

Using a cohort design, electronic health records, and Centers for Disease Control and Prevention Social Vulnerability Index, we compared changes in virtual and in-person primary care use by race/ethnicity and community social vulnerability in the year before and after COVID-19 diagnosis. Our study population included 11,326 adult patients diagnosed with COVID-19 between March and July 2020. We estimated logistic regression models to examine likelihood of primary care use. In all regression models we computed robust standard errors; in adjusted models we controlled for demographic and health characteristics of patients.

Results

In a patient population of primarily Hispanic/Latino and non-Hispanic White individuals, and in which over half lived in socially vulnerable areas, likelihood of virtual primary care use increased from the year before to the year after COVID-19 diagnosis (3.6 to 10.3%); while in-person use remained stable (21.0 to 20.7%). In unadjusted and adjusted regression models, compared with White patients, Hispanic/Latino and other race/ethnicity patients were significantly less likely to use virtual care before and after COVID-19 diagnosis; Hispanic/Latino, Native Hawaiian/Pacific Islander, and other race/ethnicity patients, and patients living in socially vulnerable areas were also significantly less likely to use in-person care during these time periods.

Conclusions

Newly expanded virtual primary care has not equitably benefited individuals from racialized groups diagnosed with COVID-19, and virtual access disparities have not been offset by improved in-person access. Health systems should employ evidence-based strategies to equitably provide care, including representative provider networks; targeted, empowering outreach; co-developed culturally and linguistically appropriate tools and technologies; and provision of enabling resources and services.

From Digital Health to Digital Well-being: Systematic Scoping Review

Background

Digital health refers to the proper use of technology for improving the health and well-being of people and enhancing the care of patients through the intelligent processing of clinical and genetic data. Despite increasing interest in well-being in both health care and technology, there is no clear understanding of what constitutes well-being, which leads to uncertainty in how to create well-being through digital health. In an effort to clarify this uncertainty, Brey developed a framework to define problems in technology for well-being using the following four categories: epistemological problem, scope problem, specification problem, and aggregation problem.

Objective

This systematic scoping review aims to gain insights into how to define and address well-being in digital health.

Methods

We followed the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. Papers were identified from 6 databases and included if they addressed the design or evaluation of digital health and reported the enhancement of patient well-being as their purpose. These papers were divided into design and evaluation papers. We studied how the 4 problems in technology for well-being are considered per paper.

Results

A total of 117 studies were eligible for analysis (n=46, 39.3% design papers and n=71, 60.7% evaluation papers). For the epistemological problem, the thematic analysis resulted in various definitions of well-being, which were grouped into the following seven values: healthy body, functional me, healthy mind, happy me, social me, self-managing me, and external conditions. Design papers mostly considered well-being as healthy body and self-managing me, whereas evaluation papers considered the values of healthy mind and happy me. Users were rarely involved in defining well-being. For the scope problem, patients with chronic care needs were commonly considered as the main users. Design papers also regularly involved other users, such as caregivers and relatives. These users were often not involved in evaluation papers. For the specification problem, most design and evaluation papers focused on the provision of care support through a digital platform. Design papers used numerous design methods, whereas evaluation papers mostly considered pre-post measurements and randomized controlled trials. For the aggregation problem, value conflicts were rarely described.

Conclusions

Current practice has found pragmatic ways of circumventing or dealing with the problems of digital health for well-being. Major differences exist between the design and evaluation of digital health, particularly regarding their conceptualization of well-being and the types of users studied. In addition, we found that current methodologies for designing and evaluating digital health can be improved. For optimal digital health for well-being, multidisciplinary collaborations that move beyond the common dichotomy of design and evaluation are needed.

Informing the Future of Integrated Digital and Clinical Mental Health Care: Synthesis of the Outcomes From Project Synergy

BACKGROUND

Globally, there are fundamental shortcomings in mental health care systems, including restricted access, siloed services, interventions that are poorly matched to service users' needs, underuse of personal outcome monitoring to track progress, exclusion of family and carers, and suboptimal experiences of care. Health information technologies (HITs) hold great potential to improve these aspects that underpin the enhanced quality of mental health care.

OBJECTIVE

Project Synergy aimed to co-design, implement, and evaluate novel HITs, as exemplified by the InnoWell Platform, to work with standard health care organizations. The goals were to deliver improved outcomes for specific populations under focus and support organizations to enact significant system-level reforms.

METHODS

Participating health care organizations included the following: Open Arms-Veterans & Families Counselling (in Sydney and Lismore, New South Wales [NSW]); NSW North Coast headspace centers for youth (Port Macquarie, Coffs Harbour, Grafton, Lismore, and Tweed Heads); the Butterfly Foundation's National Helpline for eating disorders; Kildare Road Medical Centre for enhanced primary care; and Connect to Wellbeing North Coast NSW (administered by Neami National), for population-based intake and assessment. Service users, families and carers, health professionals, and administrators of services across Australia were actively engaged in the configuration of the InnoWell Platform to meet service needs, identify barriers to and facilitators of quality mental health care, and highlight potentially the best points in the service pathway to integrate the InnoWell Platform. The locally configured InnoWell Platform was then implemented within the respective services. A mixed methods approach, including surveys, semistructured interviews, and workshops, was used to evaluate the impact of the InnoWell Platform. A participatory systems modeling approach involving co-design with local stakeholders was also undertaken to simulate the likely impact of the platform in combination with other services being considered for implementation within the North Coast Primary Health Network to explore resulting impacts on mental health outcomes, including suicide prevention.

RESULTS

Despite overwhelming support for integrating digital health solutions into mental health service settings and promising impacts of the platform simulated under idealized implementation conditions, our results emphasized that successful implementation is dependent on health professional and service readiness for change, leadership at the local service level, the appropriateness and responsiveness of the technology for the target end users, and, critically, funding models being available to support implementation. The key places of interoperability of digital solutions and a willingness to use technology to coordinate health care system use were also highlighted.

CONCLUSIONS

Although the COVID-19 pandemic has resulted in the widespread acceptance of very basic digital health solutions, Project Synergy highlights the critical need to support equity of access to HITs, provide funding for digital infrastructure and digital mental health care, and actively promote the use of technology-enabled, coordinated systems of care.

An overview of and recommendations for more accessible digital mental health services

Mental health concerns are common, and various evidence-based interventions for mental health conditions have been developed. However, many people have difficulty accessing appropriate mental health care and this has been exacerbated by the COVID-19 pandemic. Digital mental health services, such as those delivered by mobile phone or web-based platforms, offer the possibility of expanding the reach and accessibility of mental health care. To achieve this goal, digital mental health interventions and plans for their implementation must be designed with the end users in mind. In this Review, we describe the evidence base for digital mental health interventions across various diagnoses and treatment targets. Then, we explain the different formats for digital mental health intervention delivery, and offer considerations for their use across key age groups. We discuss the role that the COVID-19 pandemic has played in emphasizing the value of these interventions, and offer considerations for ensuring equity in access to digital mental health interventions among diverse populations. As healthcare providers continue to embrace the role that technology can play in broadening access to care, the design and implementation of digital mental healthcare solutions must be carefully considered to maximize their effectiveness and accessibility.

Developing a Web-Based App to Assess Mental Health Difficulties in Secondary School Pupils: Qualitative User-Centered Design Study

BACKGROUND

Secondary schools are an ideal setting to identify young people experiencing mental health difficulties such as anxiety or depression. However, current methods of identification rely on cumbersome paper-based assessments, which are lengthy and time-consuming to complete and resource-intensive for schools to manage. Artemis-A is a prototype web app that uses computerized adaptive testing technology to shorten the length of the assessment and provides schools with a simple and feasible solution for mental health assessment.

OBJECTIVE

The objectives of this study are to coproduce the main components of the Artemis-A app with stakeholders to enhance the user interface, to carry out usability testing and finalize the interface design and functionality, and to explore the acceptability and feasibility of using Artemis-A in schools.

METHODS

This study involved 2 iterative design feedback cycles-an initial stakeholder consultation to inform the app design and user testing. Using a user-centered design approach, qualitative data were collected through focus groups and interviews with secondary school pupils, parents, school staff, and mental health professionals (N=48). All transcripts were thematically analyzed.

RESULTS

Initial stakeholder consultations provided feedback on preferences for the user interface design, school administration of the assessment, and outcome reporting. The findings informed the second iteration of the app design and development. The unmoderated usability assessment indicated that young people found the app easy to use and visually appealing. However, school staff suggested that additional features should be added to the school administration panel, which would provide them with more flexibility for data visualization. The analysis identified four themes relating to the implementation of the Artemis-A in schools, including the anticipated benefits and drawbacks of the app. Actionable suggestions for designing mental health assessment apps are also provided.

CONCLUSIONS

Artemis-A is a potentially useful tool for secondary schools to assess the mental health of their pupils that requires minimal staff input and training. Future research will evaluate the feasibility and effectiveness of Artemis-A in a range of UK secondary schools.

Online self-exclusion from multiple gambling venues: Stakeholder co-design of a usable and acceptable self-directed website

Gambling self-exclusion programs are under-utilised and barriers to entry include shame and embarrassment with face-to-face registration, and complex and effortful procedures. The current study aimed to facilitate self-exclusion from gambling venues via an online self-directed website. A co-design approach was used to elicit key stakeholders' perspectives on required website features, functionality, and to identify variables potentially impacting on development and implementation. Semi-structured focus groups and interviews were conducted across four stakeholders (N = 25): self-exclusion end users (consumers, n = 5), gambling counsellors (n = 7), venue staff (n = 6), and policy makers (n = 7). Overall, stakeholder perspectives were consistent with content analysis indicating the importance of website user-friendliness, flexibility, supportiveness, and trustworthiness. Importantly, these attributes were linked to target end users': perceived vulnerabilities, diverse backgrounds and individual expectations. Participants believed that the entire self-exclusion process should be conducted online, including identity verification, whilst expecting high-level data security measures to protect their personal privacy. A separate webpage was also suggested containing relevant information and links to additional help services, such as counselling. This study describes an adaptable co-design framework for developing a usable and acceptable self-exclusion website. Future studies should empirically test system usability and acceptability to refine and maximise system uptake upon implementation. Findings may have broader implications for digital health intervention design.

Adapting a Mental Health Intervention for Adolescents During the COVID-19 Pandemic: Web-Based Synchronous Focus Group Study

Background

Although focus groups are a valuable qualitative research tool, face-to-face meetings may be difficult to arrange and time consuming. This challenge has been further compounded by the global COVID-19 pandemic and the subsequent lockdown and physical distancing measures implemented, which caused exceptional challenges to human activities. Online focus groups (OFGs) are an example of an alternative strategy and require further study. At present, OFGs have mostly been studied and used in high-income countries, with little information relating to their implementation in low- and middle-income countries (LMICs).

Objective

The aim of this study is to share our experiences of conducting OFGs through a web conferencing service and provide recommendations for future research.

Methods

As part of a broader study, OFGs were developed with adults and adolescents in Colombia during the COVID-19 pandemic. Through a convenience sampling method, we invited eligible participants via email in two different cities of Colombia to participate in OFGs conducted via Microsoft Teams. Researcher notes and discussion were used to capture participant and facilitator experiences, as well as practical considerations.

Results

Technical issues were encountered, but various measures were taken to minimize them, such as using a web conferencing service that was familiar to participants, sending written instructions, and performing a trial meeting prior to the OFG. Adolescent participants, unlike their adult counterparts, were fluent in using web conferencing platforms and did not encounter technical challenges.

Conclusions

OFGs have great potential in research settings, especially during the current and any future public health emergencies. It is important to keep in mind that even with the advantages that they offer, technical issues (ie, internet speed and access to technology) are major obstacles in LMICs. Further research is required and should carefully consider the appropriateness of OFGs in different settings.

'Five hours to sort out your life': qualitative study of the experiences of university students who access mental health support

BACKGROUND

Previous qualitative research suggests that university students feel that current service provision does not meet their needs. Exploring the reasons for this may help to promote service change, encourage the uptake of care, improve outcomes and increase satisfaction within university services.

AIMS

This study aimed to improve the understanding of how students experience the process of accessing and using mental health support, barriers and facilitators to treatment, and how students would adapt provision to improve experiences.

METHOD

Semi-structured interviews were conducted with 16 full-time students who had used mental health services at university. Data were analysed using thematic analysis.

RESULTS

Five higher-order themes were identified: personalisation and informed choice, simplifying the process, feeling abandoned ignored or invisible, stigma, and superiority of private and external services. Sixteen subthemes were identified within these themes.

CONCLUSIONS

Findings indicate that access to mental health support should be simplified, with collaboration across university and external health and care services, to prevent students feeling lost or abandoned when seeking care. An inclusive approach to support access and provision of services for all presentations of mental health problems should be developed.

Ensuring patient and public involvement in the transition to AI-assisted mental health care: A systematic scoping review and agenda for design justice

Background

Machine‐learning algorithms and big data analytics, popularly known as ‘artificial intelligence’ (AI), are being developed and taken up globally. Patient and public involvement (PPI) in the transition to AI‐assisted health care is essential for design justice based on diverse patient needs.

Objective

To inform the future development of PPI in AI‐assisted health care by exploring public engagement in the conceptualization, design, development, testing, implementation, use and evaluation of AI technologies for mental health.

Methods

Systematic scoping review drawing on design justice principles, and (i) structured searches of Web of Science (all databases) and Ovid (MEDLINE, PsycINFO, Global Health and Embase); (ii) handsearching (reference and citation tracking); (iii) grey literature; and (iv) inductive thematic analysis, tested at a workshop with health researchers.

Results

The review identified 144 articles that met inclusion criteria. Three main themes reflect the challenges and opportunities associated with PPI in AI‐assisted mental health care: (a) applications of AI technologies in mental health care; (b) ethics of public engagement in AI‐assisted care; and (c) public engagement in the planning, development, implementation, evaluation and diffusion of AI technologies.

Conclusion

The new data‐rich health landscape creates multiple ethical issues and opportunities for the development of PPI in relation to AI technologies. Further research is needed to understand effective modes of public engagement in the context of AI technologies, to examine pressing ethical and safety issues and to develop new methods of PPI at every stage, from concept design to the final review of technology in practice. Principles of design justice can guide this agenda.

Last mile research: a conceptual map

Background: The term 'last mile' has been used across disciplines to refer to populations who are farthest away, most difficult to reach, or last to benefit from a program or service. However, last mile research lacks a shared understanding around its conceptualization.Objectives: This project used a concept mapping process to answer the questions: what is last mile research in global health and, how can it be used to make positive change for health equity in the last mile?Methods: Between July and December 2019, a five-stage concept mapping exercise was undertaken using online concept mapping software and an in-person consensus meeting. The stages were: establishment of an expert group and focus prompt; idea generation; sorting and rating; initial analysis and final consensus meeting.Results: A group of 15 health researchers with experience working with populations in last mile contexts and who were based at the Matariki Network institutions of Queen's University, CAN and Dartmouth College, USA took part. The resulting concept map had 64 unique idea statements and the process resulted in a map with five clusters. These included: (1) Last mile populations; (2) Research methods and approaches; (3) Structural and systemic factors; (4) Health system factors, and (5) Broader environmental factors. Central to the map were the ideas of equity, human rights, health systems, and contextual sensitivity.Conclusion: This is the first time 'last mile research' has been the focus of a formal concept mapping exercise. The resulting map showed consensus about who last mile populations are, how research should be undertaken in the last mile and why last mile health disparities exist. The map can be used to inform research training programs, however, repeating this process with researchers and members from different last mile populations would also add further insight.

A Systematic Review of Design Workshops for Health Information Technologies

Background: Design workshops offer effective methods in eliciting end-user participation from design inception to completion. Workshops unite stakeholders in the utilization of participatory methods, coalescing in the best possible creative solutions. Objective: This systematic review aimed to identify design approaches whilst providing guidance to health information technology designers/researchers in devising and organizing workshops. Methods: A systematic literature search was conducted in five medical/library databases identifying 568 articles. The initial duplication removal resulted in 562 articles. A criteria-based screening of the title field, abstracts, and pre-full-texts reviews resulted in 72 records for full-text review. The final review resulted in 10 article exclusions. Results: 62 publications were included in the review. These studies focused on consumer facing and clinical health information technologies. The studied technologies involved both clinician and patients and encompassed an array of health conditions. Diverse workshop activities and deliverables were reported. Only seven publications reported workshop evaluation data. Discussion: This systematic review focused on workshops as a design and research activity in the health informatics domain. Our review revealed three themes: (1) There are a variety of ways of conducting design workshops; (2) Workshops are effective design and research approaches; (3) Various levels of workshop details were reported.

Marketplace and Literature Review of Spanish Language Mental Health Apps

Language differences between patients and providers remains a barrier to accessing health care, especially mental health services. One potential solution to reduce inequities for patients that speak different languages and improve their access to care is through the delivery of healthcare through mobile technology. Given that the Latinx community serves as the largest ethnic minority in the United States, this two-phased review examines Spanish app development, feasibility and efficacy. Phase 1 explored the commercial marketplace for apps available in Spanish, while phase 2 involved a literature review of published research centered around the creation, functions, and usability of these apps using the PubMed and Google Scholar electronic databases. Of the apps available on the database, only 14.5% of them had Spanish operability. The literature search uncovered 629 results, of which 12 research articles that tested or described 10 apps met the inclusion criteria. Of the 10 apps studied in this literature review, only four apps were translated to Spanish. Our study reveals that despite increasing interest in Spanish-language apps to address mental health, the commercial marketplace is not currently meeting the demand.

Recommendations for Designing Health Information Technologies for Mental Health Drawn From Self-Determination Theory and Co-design With Culturally Diverse Populations: Template Analysis

Background

Culturally diverse populations (including Aboriginal and Torres Strait Islander people, people of diverse genders and sexualities, and culturally and linguistically diverse people) in nonurban areas face compounded barriers to accessing mental health care. Health information technologies (HITs) show promising potential to overcome these barriers.

Objective

This study aims to identify how best to improve a mental health and well-being HIT for culturally diverse Australians in nonurban areas.

Methods

We conducted 10 co-design workshops (N=105 participants) in primary youth mental health services across predominantly nonurban areas of Australia and conducted template analysis on the workshop outputs. Owing to local (including service) demographics, the workshop participants naturalistically reflected culturally diverse groups.

Results

We identified 4 main themes: control, usability, affirmation, and health service delivery factors. The first 3 themes overlap with the 3 basic needs postulated by self-determination theory (autonomy, competence, and relatedness) and describe participant recommendations on how to design an HIT. The final theme includes barriers to adopting HITs for mental health care and how HITs can be used to support care coordination and delivery. Hence, it describes participant recommendations on how to use an HIT.

Conclusions

Although culturally diverse groups have specific concerns, their expressed needs fall broadly within the relatively universal design principles identified in this study. The findings of this study provide further support for applying self-determination theory to the design of HITs and reflect the tension in designing technologies for complex problems that overlap multiple medical, regulatory, and social domains, such as mental health care. Finally, we synthesize the identified themes into general recommendations for designing HITs for mental health and provide concrete examples of design features recommended by participants.

Telemedicine and healthcare disparities: a cohort study in a large healthcare system in New York City during COVID-19

OBJECTIVE

Through the coronavirus disease 2019 (COVID-19) pandemic, telemedicine became a necessary entry point into the process of diagnosis, triage, and treatment. Racial and ethnic disparities in healthcare have been well documented in COVID-19 with respect to risk of infection and in-hospital outcomes once admitted, and here we assess disparities in those who access healthcare via telemedicine for COVID-19.

MATERIALS AND METHODS

Electronic health record data of patients at New York University Langone Health between March 19th and April 30, 2020 were used to conduct descriptive and multilevel regression analyses with respect to visit type (telemedicine or in-person), suspected COVID diagnosis, and COVID test results.

RESULTS

Controlling for individual and community-level attributes, Black patients had 0.6 times the adjusted odds (95% CI: 0.58-0.63) of accessing care through telemedicine compared to white patients, though they are increasingly accessing telemedicine for urgent care, driven by a younger and female population. COVID diagnoses were significantly more likely for Black versus white telemedicine patients.

DISCUSSION

There are disparities for Black patients accessing telemedicine, however increased uptake by young, female Black patients. Mean income and decreased mean household size of a zip code were also significantly related to telemedicine use.

CONCLUSION

Telemedicine access disparities reflect those in in-person healthcare access. Roots of disparate use are complex and reflect individual, community, and structural factors, including their intersection-many of which are due to systemic racism. Evidence regarding disparities that manifest through telemedicine can be used to inform tool design and systemic efforts to promote digital health equity.

Developing a Suicide Prevention Social Media Campaign With Young People (The #Chatsafe Project): Co-Design Approach

BACKGROUND

Young people commonly use social media platforms to communicate about suicide. Although research indicates that this communication may be helpful, the potential for harm still exists. To facilitate safe communication about suicide on social media, we developed the #chatsafe guidelines, which we sought to implement via a national social media campaign in Australia. Population-wide suicide prevention campaigns have been shown to improve knowledge, awareness, and attitudes toward suicide. However, suicide prevention campaigns will be ineffective if they do not reach and resonate with their target audience. Co-designing suicide prevention campaigns with young people can increase the engagement and usefulness of these youth interventions.

OBJECTIVE

This study aimed to document key elements of the co-design process; to evaluate young people's experiences of the co-design process; and to capture young people's recommendations for the #chatsafe suicide prevention social media campaign.

METHODS

In total, 11 co-design workshops were conducted, with a total of 134 young people aged between 17 and 25 years. The workshops employed commonly used co-design strategies; however, modifications were made to create a safe and comfortable environment, given the population and complexity and sensitivity of the subject matter. Young people's experiences of the workshops were evaluated through a short survey at the end of each workshop. Recommendations for the campaign strategy were captured through a thematic analysis of the postworkshop discussions with facilitators.

RESULTS

The majority of young people reported that the workshops were both safe (116/131, 88.5%) and enjoyable (126/131, 96.2%). They reported feeling better equipped to communicate safely about suicide on the web and feeling better able to identify and support others who may be at risk of suicide. Key recommendations for the campaign strategy were that young people wanted to see bite-sized sections of the guidelines come to life via shareable content such as short videos, animations, photographs, and images. They wanted to feel visible in campaign materials and wanted all materials to be fully inclusive and linked to resources and support services.

CONCLUSIONS

This is the first study internationally to co-design a suicide prevention social media campaign in partnership with young people. The study demonstrates that it is feasible to safely engage young people in co-designing a suicide prevention intervention and that this process produces recommendations, which can usefully inform suicide prevention campaigns aimed at youth. The fact that young people felt better able to safely communicate about suicide on the web as a result of participation in the study augurs well for youth engagement with the national campaign, which was rolled out across Australia. If effective, the campaign has the potential to better prepare many young people to communicate safely about suicide on the web.

Generative Participatory Design Methodology to Develop Electronic Health Interventions: Systematic Literature Review

BACKGROUND

Generative participatory design (PD) may help in developing electronic health (eHealth) interventions. PD is characterized by the involvement of all stakeholders in creative activities. This is different from the traditional user-centered design, where users are less involved. When looking at PD from a research through design perspective, it is important to summarize the reasons for choosing a certain form of generative PD to further develop its methodology. However, the scientific literature is currently unclear about which forms of PD are used to develop eHealth and which arguments are used to substantiate the decision to use a certain form of generative PD.

OBJECTIVE

This study aimed to explore the reporting and substantiation of generative PD methodologies in empirical eHealth studies published in scientific journals to further develop PD methodology in the field of eHealth.

METHODS

A systematic literature review following the Cochrane guidelines was conducted in several databases (EMBASE, MEDLINE Ovid, Web of Science, and CINAHL EBSCOhost). Data were extracted on the recruitment and management of stakeholders, the use of tools, and the use of outcome measures.

RESULTS

Of the 3131 studies initially identified, 69 were selected for qualitative synthesis. The reporting was very variable, depending to a large extent on whether the study stated that reporting on the PD process was a major aim. The different levels of reporting and substantiation of the choices of a recruitment strategy, stakeholder management, and tools and outcome measures are presented. Only a few authors explicitly used arguments directly related to PD guiding principles such as democratic, mutual learning, tacit and latent knowledge, and collective creativity. Even though PD principles were not always explicitly discussed in the method descriptions of the studies, they were implicitly present, mostly in the descriptions of the use of PD tools. The arguments used to substantiate the choices made in stakeholder management, PD tools, and the type of outcome measures adopted point to the involvement of PD principles.

CONCLUSIONS

Studies that have used a PD research methodology to develop eHealth primarily substantiate the choice of tools made and much less the use of stakeholders and outcome measures.

Project Synergy: co-designing technology-enabled solutions for Australian mental health services reform

Project Synergy aims to test the potential of new and emerging technologies to enhance the quality of mental health care provided by traditional face-to-face services. Specifically, it seeks to ensure that consumers get the right care, first time (delivery of effective mental health care early in the course of illness). Using co-design with affected individuals, Project Synergy has built, implemented and evaluated an online platform to assist the assessment, feedback, management and monitoring of people with mental disorders. It also promotes the maintenance of wellbeing by collating health and social information from consumers, their supportive others and health professionals. This information is reported back openly to consumers and their service providers to promote genuine collaborative care. The online platform does not provide stand-alone medical or health advice, risk assessment, clinical diagnosis or treatment; instead, it supports users to decide what may be suitable care options. Using an iterative cycle of research and development, the first four studies of Project Synergy (2014-2016) involved the development of different types of online prototypes for young people (i) attending university; (ii) in three disadvantaged communities in New South Wales; (iii) at risk of suicide; and (iv) attending five headspace centres. These contributed valuable information concerning the co-design, build, user testing and evaluation of prototypes, as well as staff experiences during development and service quality improvements following implementation. Through ongoing research and development (2017-2020), these prototypes underpin one online platform that aims to support better multidimensional mental health outcomes for consumers; more efficient, effective and appropriate use of health professional knowledge and clinical skills; and quality improvements in mental health service delivery.

Involving End Users in Adapting a Spanish Version of a Web-Based Mental Health Clinic for Young People in Colombia: Exploratory Study Using Participatory Design Methodologies

BACKGROUND

Health information technologies (HITs) hold enormous promise for improving access to and providing better quality of mental health care. However, despite the spread of such technologies in high-income countries, these technologies have not yet been commonly adopted in low- and middle-income countries. People living in these parts of the world are at risk of experiencing physical, technological, and social health inequalities. A possible solution is to utilize the currently available HITs developed in other counties.

OBJECTIVE

Using participatory design methodologies with Colombian end users (young people, their supportive others, and health professionals), this study aimed to conduct co-design workshops to culturally adapt a Web-based Mental Health eClinic (MHeC) for young people, perform one-on-one user-testing sessions to evaluate an alpha prototype of a Spanish version of the MHeC and adapt it to the Colombian context, and inform the development of a skeletal framework and alpha prototype for a Colombian version of the MHeC (MHeC-C).

METHODS

This study involved the utilization of a research and development (R&D) cycle including 4 iterative phases: co-design workshops; knowledge translation; tailoring to language, culture, and place (or context); and one-on-one user-testing sessions.

RESULTS

A total of 2 co-design workshops were held with 18 users-young people (n=7) and health professionals (n=11). Moreover, 10 users participated in one-on-one user-testing sessions-young people (n=5), supportive others (n=2), and health professionals (n=3). A total of 204 source documents were collected and 605 annotations were coded. A thematic analysis resulted in 6 themes (ie, opinions about the MHeC-C, Colombian context, functionality, content, user interface, and technology platforms). Participants liked the idea of having an MHeC designed and adapted for Colombian young people, and its 5 key elements were acceptable in this context (home page and triage system, self-report assessment, dashboard of results, booking and video-visit system, and personalized well-being plan). However, to be relevant in Colombia, participants stressed the need to develop additional functionality (eg, phone network backup; chat; geolocation; and integration with electronic medical records, apps, or electronic tools) as well as an adaptation of the self-report assessment. Importantly, the latter not only included language but also culture and context.

CONCLUSIONS

The application of an R&D cycle that also included processes for adaptation to Colombia (language, culture, and context) resulted in the development of an evidence-based, language-appropriate, culturally sensitive, and context-adapted HIT that is relevant, applicable, engaging, and usable in both the short and long term. The resultant R&D cycle allowed for the adaptation of an already available HIT (ie, MHeC) to the MHeC-C-a low-cost and scalable technology solution for low- and middle-income countries like Colombia, which has the potential to provide young people with accessible, available, affordable, and integrated mental health care at the right time.

Back to the Future: Achieving Health Equity Through Health Informatics and Digital Health

The rapid proliferation of health informatics and digital health innovations has revolutionized clinical and research practices. There is no doubt that these fields will continue to have accelerated growth and a substantial impact on population health. However, there are legitimate concerns about how these promising technological advances can lead to unintended consequences such as perpetuating health and health care disparities for underresourced populations. To mitigate this potential pitfall, it is imperative for the health informatics and digital health scientific communities to understand the challenges faced by disadvantaged groups, including racial and ethnic minorities, which hinder their achievement of ideal health. This paper presents illustrative exemplars as case studies of contextually tailored, sociotechnical mobile health interventions designed with community members to address health inequities using community-engaged research approaches. We strongly encourage researchers and innovators to integrate community engagement into the development of data-driven, modernized solutions for every sector of society to truly achieve health equity for all.

Exploring People's Candidacy for Mobile Health-Supported HIV Testing and Care Services in Rural KwaZulu-Natal, South Africa: Qualitative Study

BACKGROUND

The use of mobile communication technologies (mHealth: mobile health) in chronic disease management has grown significantly over the years. mHealth interventions have the potential to decentralize access to health care and make it convenient, particularly in resource-constrained settings. It is against this backdrop that we aimed to codevelop (with potential users) a new generation of mobile phone-connected HIV diagnostic tests and Web-based clinical care pathways needed for optimal delivery of decentralized HIV testing, prevention, and care in low- and middle-income countries.

OBJECTIVE

The aim of this study was to understand ways in which an mHealth intervention could be developed to overcome barriers to existing HIV testing and care services and promote HIV self-testing and linkage to prevention and care in a poor, HIV hyperendemic community in rural KwaZulu-Natal, South Africa.

METHODS

A total of 54 in-depth interviews and 9 focus group discussions were conducted with potential users (including health care providers) in 2 different communities. Theoretically informed by the candidacy framework, themes were identified from the interview transcripts, manually coded, and thematically analyzed.

RESULTS

Participants reported barriers, such as fear of HIV identity, stigma, long waiting hours, clinic space, and health care workers' attitudes, as major impediments to effective uptake of HIV testing and care services. People continued to reassess their candidacy for HIV testing and care services on the basis of their experiences and how they or others were treated within the health systems. Despite the few concerns raised about new technology, mobile phone-linked HIV testing was broadly acceptable to potential users (particularly men and young people) and providers because of its privacy (individual control of HIV testing over health provider-initiated testing), convenience (individual time and place of choice for HIV testing versus clinic-based testing), and time saving.

CONCLUSIONS

Mobile phone-connected HIV testing and Web-based clinical care and prevention pathways have the potential to support access to HIV prevention and care, particularly for young people and men. Although mHealth provides a way for individuals to test their candidacy for HIV services, the barriers that can make the service unattractive at the clinic level will also need to be addressed if potential demand is to turn into actual demand.