The Importance of Systematically Reporting and Reflecting on eHealth Development: Participatory Development Process of a Virtual Reality Application for Forensic Mental Health Care

Exploring the added value of virtual reality biofeedback game DEEP in forensic psychiatric inpatient care-A qualitative study

Background

Low motivation and suboptimal cognitive skills are common among forensic psychiatric patients. By focusing on doing and experiencing, innovative technologies could offer an alternative to existing treatment for this patient group. One promising technology is DEEP, a VR biofeedback game that teaches diaphragmatic breathing, which has shown its potential in reducing stress in other populations. This exploratory study aimed at identifying if, how and for whom DEEP can be of added value in forensic mental healthcare.

Methods

This study used a qualitative approach. Six focus groups with 24 healthcare providers and 13 semi-structured interviews with forensic psychiatric inpatients were conducted in two Dutch forensic mental healthcare organizations. All healthcare providers and patients experienced DEEP before participating. The data were coded inductively, using the method of constant comparison.

Results

The data revealed six themes with accompanying (sub)codes, including (1) the possible advantages and (2) disadvantages of DEEP, (3) patient characteristics that could make DEEP more or (4) less suitable and beneficial, (5) ways DEEP could be used in current treatment, and (6) conditions that need to be met to successfully implement DEEP in forensic mental healthcare. The results showed that DEEP can offer novel ways to support forensic psychiatric patients in coping with negative emotions by practicing diaphragmatic breathing. Its appealing design might be suitable to motivate a broad range of forensic psychiatric patient groups. However, DEEP cannot be personalized, which might decrease engagement and uptake of DEEP long-term. Regarding its place in current care, DEEP could be structurally integrated in existing treatment programs or used ad hoc when the need arises. Finally, this study showed that both healthcare providers and patients would need practical support and information to use DEEP.

Conclusion

With its experience-based and gamified design, DEEP could be useful for forensic mental healthcare. It is recommended that patients and healthcare providers are included in the evaluation and implementation from the start. Besides, a multilevel approach should be used for formulating implementation strategies. If implemented well, DEEP can offer new ways to provide forensic psychiatric patients with coping strategies to better control their anger.

Development of an eHealth Tool for Capturing and Analyzing the Immune-related Adverse Events (irAEs) in Cancer Treatment

Introduction

Immunotherapy has revolutionized the treatment of many different types of cancer, but it is associated with a myriad of immune-related adverse events (irAEs). Patient-reported outcome (PRO) measures have been identified as valuable tools for continuously collecting patient-centered data and are frequently used in oncology trials. However, few studies still research an ePRO follow-up approach on patients treated with Immunotherapy, potentially reflecting a lack of support services for this population.

Methods

The team co-developed a digital platform (V-Care) using ePROs to create a new follow-up pathway for cancer patients receiving immunotherapy. To operationalize the first 3 phases of the CeHRes roadmap, we employed multiple methods that were integrated throughout the development process, rather than being performed in a linear fashion. The teams employed an agile approach in a dynamic and iterative manner, engaging key stakeholders throughout the process.

Results

The development of the application was categorized into 2 phases: "user interface" (UI) and "user experience" (UX) designs. In the first phase, the pages of the application were segmented into general categories, and feedback from all stakeholders was received and used to modify the application. In phase 2, mock-up pages were developed and sent to the Figma website. Moreover, the Android Package Kit (APK) of the application was installed and tested multiple times on a mobile phone to proactively detect and fix any errors. After resolving some technical issues and adjusting errors on the Android version to improve the user experience, the iOS version of the application was developed.

Discussion

By incorporating the latest technological developments, V-Care has enabled cancer patients to have access to more comprehensive and personalized care, allowing them to better manage their condition and be better informed about their health decisions. These advances have also enabled healthcare professionals to be better equipped with the knowledge and tools to provide more effective and efficient care. In addition, the advances in V-Care technology have allowed patients to connect with their healthcare providers more easily, providing a platform to facilitate communication and collaboration. Although usability testing is necessary to evaluate the efficacy and user experience of the app, it can be a significant investment of time and resources.

Conclusion

The V-Care platform can be used to investigate the reported symptoms experienced by cancer patients receiving Immune checkpoint inhibitors (ICIs) and to compare them with the results from clinical trials. Furthermore, the project will utilize ePRO tools to collect symptoms from patients and provide insight into whether the reported symptoms are linked to the treatment.

Clinical Relevance

V-Care provides a secure, easy-to-use interface for patient-clinician communication and data exchange. Its clinical system stores and manages patient data in a secure environment, while its clinical decision support system helps clinicians make decisions that are more informed, efficient, and cost-effective. This system has the potential to improve patient safety and quality of care, while also helping to reduce healthcare costs.

How to use participatory design to develop an eHealth intervention to reduce preprocedural stress and anxiety among children visiting the hospital: The Hospital Hero app multi-study and pilot report

BACKGROUND

Medical procedures can cause considerable stress and anxiety among children. Current interventions mainly diminish stress and anxiety during procedures, while stress and anxiety often build up at home. Moreover, interventions often focus on either distraction or preparation. eHealth can combine multiple strategies and provide a low-cost solution that can be used outside the hospital.

OBJECTIVE

To develop an eHealth solution to diminish preprocedural stress and anxiety, and to evaluate the app on use, usability and user experience in practice. We also aimed to gain in-depth insights in children's and caregivers' opinions and experiences to inform future improvements.

METHODS

This is a multi-study report on the development (Study 1) and evaluation (Study 2) of a first version of the developed app. In study 1 we adopted a participatory design approach in which children's experiences were central to the design process. We performed an experience journey session with stakeholders (n = 13) to map the child's outpatient journey, identify pains and gains, and formulate the desired experience journey. Iterative development and testing with children (n = 8) and caregivers (n = 6) resulted in a working prototype. The prototype was tested with children, resulting in a first version of the Hospital Hero app. The app was evaluated on use, user-experience and usability during an eight-week pilot study in practice (Study 2). We triangulated data from online interviews with children and caregivers (n = 21) and online questionnaires (n = 46).

RESULTS

Multiple stress and anxiety experience touchpoints were identified. The Hospital Hero app supports children in their hospital journey by facilitating preparation at home and providing distraction at the hospital. The pilot study showed that the app was evaluated positively on usability and user-experience and is considered feasible. Qualitative data showed five themes: (1) user-friendliness, (2) coherence and power of storytelling, (3) motivation and reward, (4) fit with real hospital journey, (5) procedural comfort.

DISCUSSION

Using participatory design, we developed a child-centered solution that supports children in the entire hospital journey and may diminish preprocedural stress and anxiety. Future efforts should create a more tailored journey, define an optimal engagement window and formulate implementation strategies.

Strength Back - A qualitative study on the co-creation of a positive psychology digital health intervention for spinal surgery patients

Introduction

Spinal surgery patients often experience pain as well as stress, anxiety or even depression before surgery, highlighting the need for better mental preparation before undergoing surgery. Acceptance and Commitment Therapy and positive psychology have proven effective in coping with chronic pain and providing long-term skills that enhance psychological flexibility and mental well-being.The aim of this study is to develop a digital intervention (app) based on Acceptance and Commitment Therapy and positive psychology in co-creation with all stakeholders, including patients and professionals. The aim of the intervention is to increase psychological flexibility and positive skills of spinal surgery patients to promote long-term resilience.

Materials and methods

In this qualitative study, individual, semi-structured interviews were held with healthcare professionals (N = 9) and spinal surgery patients (N = 12) to identify contextual factors and needs for the app. Subsequently, three focus-group sessions were held with healthcare professionals and newly recruited patients to specify relevant values. Also, a first version of the app, named Strength Back, was developed using a participatory design.

Results

The interviews confirmed the need for information and digital support to cope with insecurity, anxiety and pain, both before and after surgery. Based on iterative steps in the focus-group sessions, thirteen modules were developed focusing on procedural information, pain education, psychological flexibility and mental well-being.

Discussion

The intervention Strength Back, containing information as well as Acceptance and Commitment Therapy and positive psychology exercises, has the potential to increase psychological flexibility, enhance well-being and improve postoperative recovery after spinal surgery.

The Limitations of User-and Human-Centered Design in an eHealth Context and How to Move Beyond Them

Human-centered design (HCD) is widely regarded as the best design approach for creating eHealth innovations that align with end users’ needs, wishes, and context and has the potential to impact health care. However, critical reflections on applying HCD within the context of eHealth are lacking. Applying a critical eye to the use of HCD approaches within eHealth, we present and discuss 9 limitations that the current practices of HCD in eHealth innovation often carry. The limitations identified range from limited reach and bias to narrow contextual and temporal focus. Design teams should carefully consider if, how, and when they should involve end users and other stakeholders in the design process and how they can combine their insights with existing knowledge and design skills. Finally, we discuss how a more critical perspective on using HCD in eHealth innovation can move the field forward and offer 3 directions of inspiration to improve our design practices: value-sensitive design, citizen science, and more-than-human design. Although value-sensitive design approaches offer a solution to some of the biased or limited views of traditional HCD approaches, combining a citizen science approach with design inspiration and imagining new futures could widen our view on eHealth innovation. Finally, a more-than-human design approach will allow eHealth solutions to care for both people and the environment. These directions can be seen as starting points that invite and support the field of eHealth innovation to do better and to try and develop more inclusive, fair, and valuable eHealth innovations that will have an impact on health and care.

I Need to Know: Using the CeHRes Roadmap to Develop a Treatment Feedback Tool for Youngsters with Mental Health Problems

Patient-Reported Outcome Measures (PROMs) are often used to monitor treatment outcomes in youth mental health care. Unfortunately, youngsters are rarely informed about the results of their PROMs or, when they are, it is in an insufficient manner. Therefore, a web application was developed-together with youngsters-aimed at giving them feedback about their PROMs. The aim of this study is to describe the development process of the application. An expert panel consisting of youngsters, web designers and researchers, as well as a representative from a client organisation, developed the e-health application INK (short for 'I Need to Know') in an iterative process based on the Centre for eHealth Research roadmap (CeHRes roadmap). Youngsters prefer, among other aspects, a simple, easy-to-use e-health application with a colourful appearance and want to be able to compare their results across different time points and informants. The INK tool provides youngsters with insight into their PROM results. Based on the youngsters' preferences, INK users can choose which feedback information is visible. INK facilitates youngsters' active participation in their treatment as well as shared decision-making with their professional caregivers.

Virtual reality interventions for victims of crime: A systematic review

In the forensic field, most studies employing virtual reality (VR) interventions have focused on offenders. The validity and safety of VR applications for victims of crime are still unclear. Following PRISMA guidelines, a systematic review on VR interventions for crime victims was performed to assess the efficacy, acceptability by patients, and cost-effectiveness of these interventions compared to in-person care. We identified 34 potentially eligible studies from 188 records obtained from database searches (Medline/Pubmed, CINAHL, PsycINFO, Web of Science, and Scopus); four additional articles were identified via alternative sources. In total, nine articles were included for the qualitative synthesis. Patient satisfaction with VR interventions was found to be equivalent to face-to-face interventions. Both VR exposure and control groups found relief from posttraumatic symptoms, with differences either statistically insignificant or in favor of VR. Despite the increased costs linked to the technology required, VR appears to be a promising alternative to in vivo exposure, but further research is needed. Limitations of the review include the varied experimental protocols, which did not allow us to conduct a quantitative analysis and comparison of findings across different studies, and the generally poor quality of the studies included. Further research, preferably in larger groups, is needed to shed more light on the effectiveness of VR interventions for traumatized victims of crime.

Improving the Development and Implementation of Audit and Feedback Systems to Support Health Care Workers in Limiting Antimicrobial Resistance in the Hospital: Scoping Review

Background

For eHealth technologies in general and audit and feedback (AF) systems specifically, integrating interdisciplinary theoretical underpinnings is essential, as it increases the likelihood of achieving desired outcomes by ensuring a fit among eHealth technology, stakeholders, and their context. In addition, reporting on the development and implementation process of AF systems, including substantiations of choices, enables the identification of best practices and accumulation of knowledge across studies but is often not elaborated on in publications.

Objective

This scoping review aims to provide insights into the development and implementation strategies for AF systems for a real-world problem that threatens modern health care—antimicrobial resistance—and provide an interdisciplinary conceptual framework that can serve as a checklist and guidance for making informed choices in the development and implementation of future AF systems.

Methods

A scoping review was conducted by querying PubMed, Scopus, Web of Science, IEEE Xplore Digital Library, and Embase (≥2010) for studies describing either the development or implementation process, or both, of an AF system for antimicrobial resistance or infections in hospitals. Studies reporting only on effectiveness or impact were excluded. A total of 3 independent reviewers performed the study selection, and 2 reviewers constructed the conceptual framework through the axial and selective coding of often-used theories, models, and frameworks (TMFs) from the literature on AF and eHealth development and implementation. Subsequently, the conceptual framework was used for the systematic extraction and interpretation of the studies’ descriptions of AF systems and their development and implementation.

Results

The search resulted in 2125 studies that were screened for eligibility, of which 12 (0.56%); 2012-2020) were included. These studies described the development and implementation processes heterogeneously in terms of study aims, study targets, target groups, methods, and theoretical underpinnings. Few studies have explicitly explained how choices for the development and implementation of AF systems were substantiated by the TMFs. The conceptual framework provided insights into what is reported on the development and implementation process and revealed underreported AF system constructs (eg, AF system design; engagement with the AF system; and comparison, goal setting, and action planning) and development and implementation (eg, champions) constructs.

Conclusions

This scoping review showed the current heterogeneous reporting of AF systems and their development and implementation processes and exemplified how interdisciplinary TMFs can (and should) be balanced in a conceptual framework to capture relevant AF systems and development and implementation constructs. Thereby, it provides a concrete checklist and overall guidance that supports the professionalization and harmonization of AF system development and implementation. For the development and implementation of future AF systems and other eHealth technologies, researchers and health care workers should be supported in selecting and integrating TMFs into their development and implementation process and encouraged to explicitly report on theoretical underpinnings and the substantiation of choices.

A mobile self-control training app to improve self-control and physical activity in people with severe mental illness: Protocol for two single-case experiment designs (Preprint)

BACKGROUND

Lack of physical activity is a common issue with detrimental consequences for the health of people with severe mental illness (SMI). Existing physical activity interventions show suboptimal effects as they require substantial cognitive skills, including goal setting and writing, whereas cognitive deficits are common in this population. To bolster the effectiveness of physical activity interventions, self-control training (SCT), in which users practice the ability to override unwanted thoughts and behaviors, can be used in addition. Recent research has demonstrated the initial effectiveness of a mobile SCT app, but this has not been studied in psychiatric clinical practice.

OBJECTIVE

This study aims to evaluate to what extent adding a mobile SCT app designed for and with people with SMI to a mobile lifestyle intervention aimed at increasing physical activity increases physical activity and self-control levels.

METHODS

A mixed methods approach incorporating 2 single-case experimental designs (SCEDs) and qualitative interviews was used to evaluate and optimize SCT. Overall, 12 participants with SMI will be recruited from 2 organizations offering outpatient and inpatient care to people with SMI. Each experiment will include 6 patients. SCED I is a concurrent multiple-baseline design across participants that explores initial effectiveness and optimal intervention duration. Using accelerometry and experience sampling questionnaires, participants' physical activity and self-control will be monitored for ≥5 days from baseline, followed by the sequential introduction of Google Fit, the physical activity intervention, for 7 days and the addition of SCIPP: Self-Control Intervention App for 28 days. SCED II is an introduction/withdrawal design in which optimized SCT will be introduced and withdrawn to validate the findings from SCED I. In both experiments, the daily average of total activity counts per hour and the state level of self-control will serve as the primary and secondary outcome measures. Data will be analyzed using visual analysis and piecewise linear regression models.

RESULTS

The study was designated as not subject to the Dutch Medical Research Involving Human Subjects Act by the Medical Research Ethical Committee Oost-Nederland and approved by the Ethics Committee/domain Humanities and Social Sciences of the Faculty of Behavioural, Management, and Social Sciences at the University of Twente. Participant recruitment started in January 2022, and we expect to publish the results in early 2023.

CONCLUSIONS

The mobile SCT app is expected to be feasible and effective. It is self-paced and scalable and can increase patient motivation, making it a suitable intervention for people with SMI. SCED is a relatively novel yet promising method for gaining insights into whether and how mobile apps work that can handle heterogeneous samples and makes it possible to involve a diverse population with SMI without having to include a large number of participants.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/37727.

Methods for Human-Centered eHealth Development: Narrative Scoping Review

Background

Thorough holistic development of eHealth can contribute to a good fit among the technology, its users, and the context. However, despite the availability of frameworks, not much is known about specific research activities for different aims, phases, and settings. This results in researchers having to reinvent the wheel. Consequently, there is a need to synthesize existing knowledge on research activities for participatory eHealth development processes.

Objective

The 3 main goals of this review are to create an overview of the development strategies used in studies based on the CeHRes (Center for eHealth Research) Roadmap, create an overview of the goals for which these methods can be used, and provide insight into the lessons learned about these methods.

Methods

We included eHealth development studies that were based on the phases and/or principles of the CeHRes Roadmap. This framework was selected because of its focus on participatory, iterative eHealth design in context and to limit the scope of this review. Data were extracted about the type of strategy used, rationale for using the strategy, research questions, and reported information on lessons learned. The most frequently mentioned lessons learned were summarized using a narrative, inductive approach.

Results

In the included 160 papers, a distinction was made between overarching development methods (n=10) and products (n=7). Methods are used to gather new data, whereas products can be used to synthesize previously collected data and support the collection of new data. The identified methods were focus groups, interviews, questionnaires, usability tests, literature studies, desk research, log data analyses, card sorting, Delphi studies, and experience sampling. The identified products were prototypes, requirements, stakeholder maps, values, behavior change strategies, personas, and business models. Examples of how these methods and products were applied in the development process and information about lessons learned were provided.

Conclusions

This study shows that there is a plethora of methods and products that can be used at different points in the development process and in different settings. To do justice to the complexity of eHealth development, it seems that multiple strategies should be combined. In addition, we found no evidence for an optimal single step-by-step approach to develop eHealth. Rather, researchers need to select the most suitable research methods for their research objectives, the context in which data are collected, and the characteristics of the participants. This study serves as a first step toward creating a toolkit to support researchers in applying the CeHRes Roadmap to practice. In this way, they can shape the most suitable and efficient eHealth development process.

Developing mHealth to the Context and Valuation of Injured Patients and Professionals in Hospital Trauma Care: Qualitative and Quantitative Formative Evaluations (Preprint)

Background

Trauma care faces challenges to innovating their services, such as with mobile health (mHealth) app, to improve the quality of care and patients’ health experience. Systematic needs inquiries and collaborations with professional and patient end users are highly recommended to develop and prepare future implementations of such innovations.

Objective

This study aimed to develop a trauma mHealth app for patient information and support in accordance with the Center for eHealth Research and Disease Management road map and describe experiences of unmet information and support needs among injured patients with trauma, barriers to and facilitators of the provision of information and support among trauma care professionals, and drivers of value of an mHealth app in patients with trauma and trauma care professionals.

Methods

Formative evaluations were conducted using quantitative and qualitative methods. Ten semistructured interviews with patients with trauma and a focus group with 4 trauma care professionals were conducted for contextual inquiry and value specification. User requirements and value drivers were applied in prototyping. Furthermore, a complementary quantitative discrete choice experiment (DCE) was conducted with 109 Dutch trauma surgeons, which enabled triangulation on value specification results. In the DCE, preferences were stated for hypothetical mHealth products with various attributes. Panel data from the DCE were analyzed using conditional and mixed logit models.

Results

Patients disclosed a need for more psychosocial support and easy access to more extensive information on their injury, its consequences, and future prospects. Health care professionals designated workload as an essential issue; a digital solution should not require additional time. The conditional logit model of DCE results suggested that access to patient app data through electronic medical record integration (odds ratio [OR] 3.3, 95% CI 2.55-4.34; P<.001) or a web viewer (OR 2.3, 95% CI 1.64-3.31; P<.001) was considered the most important for an mHealth solution by surgeons, followed by the inclusion of periodic self-measurements (OR 2, 95% CI 1.64-2.46; P<.001), the local adjustment of patient information (OR 1.8, 95% CI 1.42-2.33; P<.001), local hospital identification (OR 1.7, 95% CI 1.31-2.10; P<.001), complication detection (OR 1.5, 95% CI 1.21-1.84; P<.001), and the personalization of rehabilitation through artificial intelligence (OR 1.4, 95% CI 1.13-1.62; P=.001).

Conclusions

In the context of trauma care, end users have many requirements for an mHealth solution that addresses psychosocial functioning; dependable information; and, possibly, a prediction of how a patient’s recovery trajectory is evolving. A structured development approach provided insights into value drivers and facilitated mHealth prototype enhancement. The findings imply that iterative development should move on from simple and easily implementable mHealth solutions to those that are suitable for broader innovations of care pathways that most—but plausibly not yet all—end users in trauma care will value. This study could inspire the trauma care community.

A Perspective on the Integration of eHealth in Treatment of Offenders: Combining Technology and the Risk-Need-Responsivity Model

While there are multiple ways in which eHealth interventions such as online modules, apps and virtual reality can improve forensic psychiatry, uptake in practice is low. To overcome this problem, better integration of eHealth in treatment is necessary. In this perspective paper, we describe how the possibilities of eHealth can be connected to the risk-need-responsivity (RNR) model. To account for the risk-principle, stand-alone eHealth interventions might be used to offer more intensive treatment to high-risk offenders. The need-principle can be addressed by connecting novel experience-based interventions such as VR and apps to stable and acute dynamic risk factors. Finally, using and combining personalized interventions is in line with the responsivity-principle. Based on research inside and outside of forensic psychiatry, we conclude that there are many possibilities for eHealth to improve treatment-not just based on RNR, but also on other models. However, there is a pressing need for more development, implementation and evaluation research.