Using Exploratory Trials to Identify Relevant Contexts and Mechanisms in Complex Electronic Health Interventions: Evaluating the Electronic Patient-Reported Outcome Tool

Operationalizing the Chronic Care Model with Goal-Oriented Care

The Chronic Care Model has guided quality improvement in health care for almost 20 years, using a patient-centered, disease management approach to systems and care teams. To further advance efforts in person-centered care, we propose strengthening the Chronic Care Model with the goal-oriented care approach. Goal-oriented care is person-centered in that it places the focus on what matters most to each person over the course of their life. The person's goals inform care decisions, which are arrived at collaboratively between clinicians and the person. In this paper, we build on each of the elements of the Chronic Care Model with person-centered, goal-oriented care and provide clinical examples on how to operationalize this approach. We discuss how this adapted approach can support our health care systems, in particular in the context of growing multi-morbidity.

Rethinking early intervention rehabilitation services for children with motor difficulties: engaging stakeholders in the conceptualization of telerehabilitation primary care

PURPOSE

Rehabilitation services for children with mild motor difficulties are limited. Telehealth could be a novel avenue through which to provide these services. With the input of various stakeholder groups, this study aimed to develop a logic model for a new primary care telerehabilitation intervention and to identify influencing implementation factors.

METHODS AND MATERIALS

A participatory research design was used. A logic model, developed in consultation with five healthcare managers, was discussed with four stakeholder groups. Focus groups were conducted with clinicians (n = 9), pediatric healthcare managers (n = 5), and technology information consultants (n = 2), while parents (n = 4) were interviewed to explore their perceptions of the proposed intervention, and factors influencing implementation. Transcribed discussions were analyzed using reflexive thematic analysis.

RESULTS

Stakeholders supported the delivery of telerehabilitation services for children with mild motor difficulties. Although agreement was generated for each logic model component, important recommendations were voiced related to service relevance and sustainability, parent and community capacity building, and platform dependability, security, and support. Identified factors influencing the implementation encompassed consumer, provider, technological, systemic and contextual barriers and facilitators. Strategies to address them were also suggested.

CONCLUSION

This study demonstrates the value of, and a process to engage stakeholders in the designing of pediatric telerehabilitation services and its implementation.IMPLICATIONS FOR PRACTICEPediatric telerehabilitation service are complex interventions which operate in complicate systems.Designing telerehabilitation services with stakeholders is recommended, yet how to do so often not clear.This study demonstrated that the development of a logic model can provide a systematic framework to helps guide the co-design process with stakeholders.Resulting recommendation underscored a broader vision for the intervention and identified crucial factors and strategies required for its successful implementation and sustainability.

Effects and Processes of an mHealth Intervention for the Management of Chronic Diseases: Prospective Observational Study

Background

Mobile health (mHealth) interventions for self-management are a promising way to meet the needs of patients with chronic diseases in primary care practices. Therefore, an mHealth intervention, TelePraCMan, was developed and evaluated for patients with type 2 diabetes mellitus, chronic obstructive pulmonary disease, high blood pressure, or heart failure in a German primary care setting. TelePraCMan entails a symptom diary, an appointment manager, a manager to document goals, and a warning system. The app should foster the self-management of participating patients.

Objective

We aimed to examine the effects of TelePraCMan on patient activation and quality of life and explored the underlying contextual factors, impacts, and degree of implementation.

Methods

In a prospective observational study design, we collected data by using interviews and written questionnaires from participating patients (intervention and control groups) and primary care workers (physicians and practice assistants). The primary outcomes of interest were patient-reported quality of life (12-Item Short Form Survey) and patient activation (patient activation measure). The quantitative analysis focused on differences between patients in the intervention and control groups, as well as before (T0) and after (T1) the intervention. Interviews were analyzed by using qualitative content analysis via MAXQDA (VERBI GmbH).

Results

At baseline, 25 patients and 24 primary care workers completed the questionnaire, and 18 patients and 21 primary care workers completed the follow-up survey. The patients were predominantly male and, on average, aged 64 (SD 11) years (T0). The primary care workers were mostly female (62%) and, on average, aged 47 (SD 10) years (T0). No differences were observed in the outcomes before and after the intervention or between the intervention and control groups. In the additional interviews, 4 patients and 11 primary care workers were included. The interviewees perceived that the intervention was useful for some patients. However, contextual factors and problems with implementation activities negatively affected the use of the app with patients. The main reasons for the low participation were the COVID-19 pandemic and the target group, which seemed to have less interest in mHealth; the interviewees attributed this to the older age of patients. However, the respondents felt that the app would be better accepted in 5 or 10 years.

Conclusions

Although the TelePraCMan app was rated as very good and important by the participants, few patients used it. The digital intervention was hardly implemented and had limited impact in the current setting of German primary care.

Trial Registration

German Clinical Trials Register DRKS00017320; https://tinyurl.com/4uwrzu85

An Electronic Patient-Reported Outcomes Tool for Older Adults With Complex Chronic Conditions: Cost-Utility Analysis

Background

eHealth technologies for self-management can improve quality of life, but little is known about whether the benefits gained outweigh their costs. The electronic patient-reported outcome (ePRO) mobile app and portal system supports patients with multiple chronic conditions to collaborate with primary health care providers to set and monitor health-related goals.

Objective

This study aims to estimate the cost of ePRO and the cost utility of the ePRO intervention compared with usual care provided to patients with multiple chronic conditions and complex needs living in the community, from the perspective of the publicly funded health care payer in Ontario, Canada.

Methods

We developed a decision tree model to estimate the incremental cost per quality-adjusted life year (QALY) gained for the ePRO tool versus usual care over a time horizon of 15 months. Resource utilization and effectiveness of the ePRO tool were drawn from a randomized clinical trial with 6 family health teams involving 45 participants. Unit costs associated with health care utilization (adjusted to 2020 Canadian dollars) were drawn from literature and publicly available sources. A series of sensitivity analyses were conducted to assess the robustness of the findings.

Results

The total cost of the ePRO tool was CAD $79,467 (~US $ 63,581; CAD $1733 [~US $1386] per person). Compared with standard care, the ePRO intervention was associated with higher costs (CAD $1710 [~US $1368]) and fewer QALYs (–0.03). The findings were consistent with the clinical evidence, suggesting no statistical difference in health-related quality of life between ePRO and usual care groups. However, the tool would be considered a cost-effective option if it could improve by at least 0.03 QALYs. The probability that the ePRO is cost-effective was 17.3% at a willingness-to-pay (WTP) threshold of CAD $50,000 (~US $40,000)/QALY.

Conclusions

The ePRO tool is not a cost-effective technology at the commonly used WTP value of CAD $50,000 (~US $40,000)/QALY, but long-term and the societal impacts of ePRO were not included in this analysis. Further research is needed to better understand its impact on long-term outcomes and in real-world settings. The present findings add to the growing evidence about eHealth interventions’ capacity to respond to complex aging populations within finite-resourced health systems.

Trial Registration

ClinicalTrials.gov NCT02917954; https://clinicaltrials.gov/ct2/show/NCT02917954

Exploring the relationship between the usability of a goal-oriented mobile health application and non-usage attrition in patients with multimorbidity: A blended data analysis approach

Background

Mobile health applications are increasingly used to support the delivery of health care services to a variety of patients. Based on data obtained from a pragmatic trial of the electronic Patient Reported Outcome (ePRO) app designed to support goal-oriented care primary care, this study aims to (1) examine how patient-reported usability changed over the one-year intervention period, and (2) explore participant attrition rate of the electronic Patient Reported Outcome app over one year study period.

Methods

We performed a secondary analysis of 44 older adults with complex chronic needs enrolled in the electronic Patient Reported Outcome-digital health intervention. App usage and attrition were measured using device-generated usage logs; usability was measured using the patient-reported post-study system usability questionnaire collected at 3, 6, 9, and 12 months. Research memos were used to interpret potential contextual contributing factors to patients' overall usage and usability score pattern. A data triangulation method of both quantitative and qualitative data was used to analyze and interpret study findings.

Results

While there was gradual attrition in the use of the ePRO app, patients' usability scores remained consistent throughout the study period. Qualitative memos suggested patients' encounters with technical difficulties and relationship dynamics with primary providers influenced patients' adherence to the ePRO app.

Conclusion

This study highlights that the patient-provider relationship is a key determining factor that influences complex patients' continued engagement with a Mobile health app. The finding calls attention to the measurement of usability of a Mobile health app, its impact on attrition, and contributing factors that influence patients' attrition. Trial registration: Clinicaltrials.gov Identified NCT02917954.

Assessing the Implementation and Effectiveness of the Electronic Patient-Reported Outcome Tool for Older Adults With Complex Care Needs: Mixed Methods Study

Background

Goal-oriented care is being adopted to deliver person-centered primary care to older adults with multimorbidity and complex care needs. Although this model holds promise, its implementation remains a challenge. Digital health solutions may enable processes to improve adoption; however, they require evaluation to determine feasibility and impact.

Objective

This study aims to evaluate the implementation and effectiveness of the electronic Patient-Reported Outcome (ePRO) mobile app and portal system, designed to enable goal-oriented care delivery in interprofessional primary care practices. The research questions driving this study are as follows: Does ePRO improve quality of life and self-management in older adults with complex needs? What mechanisms are likely driving observed outcomes?

Methods

A multimethod, pragmatic randomized controlled trial using a stepped-wedge design and ethnographic case studies was conducted over a 15-month period in 6 comprehensive primary care practices across Ontario with a target enrollment of 176 patients. The 6 practices were randomized into either early (3-month control period; 12-month intervention) or late (6-month control period; 9-month intervention) groups. The primary outcome measure of interest was the Assessment of Quality of Life-4D (AQoL-4D). Data were collected at baseline and at 3 monthly intervals for the duration of the trial. Ethnographic data included observations and interviews with patients and providers at the midpoint and end of the intervention. Outcome data were analyzed using linear models conducted at the individual level, accounting for cluster effects at the practice level, and ethnographic data were analyzed using qualitative description and framework analysis methods.

Results

Recruitment challenges resulted in fewer sites and participants than expected; of the 176 target, only 142 (80.6%) patients were identified as eligible to participate because of lower-than-expected provider participation and fewer-than-expected patients willing to participate or perceived as ready to engage in goal-setting. Of the 142 patients approached, 45 (32%) participated. Patients set a variety of goals related to self-management, mental health, social health, and overall well-being. Owing to underpowering, the impact of ePRO on quality of life could not be definitively assessed; however, the intervention group, ePRO plus usual care (mean 15.28, SD 18.60) demonstrated a nonsignificant decrease in quality of life (t₂₄=−1.20; P=.24) when compared with usual care only (mean 21.76, SD 2.17). The ethnographic data reveal a complex implementation process in which the meaningfulness (or coherence) of the technology to individuals’ lives and work acted as a key driver of adoption and tool appraisal.

Conclusions

This trial experienced many unexpected and significant implementation challenges related to recruitment and engagement. Future studies could be improved through better alignment of the research methods and intervention to the complex and diverse clinical settings, dynamic goal-oriented care process, and readiness of provider and patient participants.

Trial Registration

ClinicalTrials.gov NCT02917954; https://clinicaltrials.gov/ct2/show/NCT02917954

Health information technology to improve care for people with multiple chronic conditions

OBJECTIVE

To review evidence regarding the use of Health Information Technology (health IT) interventions aimed at improving care for people living with multiple chronic conditions (PLWMCC) in order to identify critical knowledge gaps.

DATA SOURCES

We searched MEDLINE, CINAHL, PsycINFO, EMBASE, Compendex, and IEEE Xplore databases for studies published in English between 2010 and 2020.

STUDY DESIGN

We identified studies of health IT interventions for PLWMCC across three domains as follows: self-management support, care coordination, and algorithms to support clinical decision making.

DATA COLLECTION/EXTRACTION METHODS

Structured search queries were created and validated. Abstracts were reviewed iteratively to refine inclusion and exclusion criteria. The search was supplemented by manually searching the bibliographic sections of the included studies. The search included a forward citation search of studies nested within a clinical trial to identify the clinical trial protocol and published clinical trial results. Data were extracted independently by two reviewers.

PRINCIPAL FINDINGS

The search yielded 1907 articles; 44 were included. Nine randomized controlled trials (RCTs) and 35 other studies including quasi-experimental, usability, feasibility, qualitative studies, or development/validation studies of analytic models were included. Five RCTs had positive results, and the remaining four RCTs showed that the interventions had no effect. The studies address individual patient engagement and assess patient-centered outcomes such as quality of life. Few RCTs assess outcomes such as disability and none assess mortality.

CONCLUSIONS

Despite a growing body of literature on health IT interventions or multicomponent interventions including a health IT component for chronic disease management, current evidence for applying health IT solutions to improve care for PLWMCC is limited. The body of literature included in this review provides critical information on the state of the science as well as the many gaps that need to be filled for digital health to fulfill its promise in supporting care delivery that meets the needs of PLWMCC.

Evaluation is Key: Providing Appropriate Evaluation Measures for Participatory and User-Centred Design Processes of Healthcare IT

INTRODUCTION

The increasing availability of healthcare IT has the potential to improve the integration of health services. Existing projects developing healthcare IT mostly disregard the potential and importance of incorporating user feedback and proper evaluation measures to gain user feedback throughout the development process. We therefore provide methodological guidance for evaluation in a stepwise user-centred design process.

METHODS

Based on a literature review we propose adequate methods for data collection in each phase of participatory and user-centred healthcare IT development. In order to provide an orientation within the plethora of development processes used in practice, we consolidate a generic blueprint process from the literature review. The applicability of our methodological guidance is shown in three diverse use cases from the field of integrated care.

RESULTS

From 14 literature items, we identified common evaluation methods including, among others, interviews, focus groups, and surveys. These methods can be associated to six typical development phases that could be derived from research: State of the Art Research, Requirement Analysis, Conceptual Prototype, Preliminary Prototype, Full Prototype, Full Application. The use cases demonstrate the value of qualitative methods and mixed methods designs.

DISCUSSION

Our methodological guidance has proven applicable for designing healthcare IT solutions from scratch - both for patient and professional settings - and to develop a platform for combining existing component-based solutions. In integrated care settings, where a wide range of stakeholders with multiple needs exist, we thus provide methodological guidance on how to involve users in the development process.

CONCLUSION

Our stepwise methodological guidance helps to design and properly evaluate healthcare IT solutions, which meet the user needs and requirements, for integrated care settings.

Building a Digital Bridge to Support Patient-Centered Care Transitions From Hospital to Home for Older Adults With Complex Care Needs: Protocol for a Co-Design, Implementation, and Evaluation Study

BACKGROUND

Older adults with multimorbidity and complex care needs (CCN) are among those most likely to experience frequent care transitions between settings, particularly from hospital to home. Transition periods mark vulnerable moments in care for individuals with CCN. Poor communication and incomplete information transfer between clinicians and organizations involved in the transition from hospital to home can impede access to needed support and resources. Establishing digitally supported communication that enables person-centered care and supported self-management may offer significant advantages as we support older adults with CCN transitioning from hospital to home.

OBJECTIVE

This protocol outlines the plan for the development, implementation, and evaluation of a Digital Bridge co-designed to support person-centered health care transitions for older adults with CCN. The Digital Bridge builds on the foundation of two validated technologies: Care Connector, designed to improve interprofessional communication in hospital, and the electronic Patient-Reported Outcomes (ePRO) tool, designed to support goal-oriented care planning and self-management in primary care settings. This project poses three overarching research questions that focus on adapting the technology to local contexts, evaluating the impact of the Digital Bridge in relation to the quadruple aim, and exploring the potential to scale and spread the technology.

METHODS

The study includes two phases: workflow co-design (phase 1), followed by implementation and evaluation (phase 2). Phase 1 will include iterative co-design working groups with patients, caregivers, hospital providers, and primary care providers to develop a transition workflow that will leverage the use of Care Connector and ePRO to support communication through the transition process. Phase 2 will include implementation and evaluation of the Digital Bridge within two hospital systems in Ontario in acute and rehab settings (600 patients: 300 baseline and 300 implementation). The primary outcome measure for this study is the Care Transitions Measure-3 to assess transition quality. An embedded ethnography will be included to capture context and process data to inform the implementation assessment and development of a scale and spread strategy. An Integrated Knowledge Translation approach is taken to inform the study. An advisory group will be established to provide insight and feedback regarding the project design and implementation, leading the development of the project knowledge translation strategy and associated outputs.

RESULTS

This project is underway and expected to be complete by Spring 2024.

CONCLUSIONS

Given the real-world implementation of Digital Bridge, practice changes in the research sites and variable adherence to the implementation protocols are likely. Capturing and understanding these considerations through a mixed-methods approach will help identify the range of factors that may influence study results. Should a favorable evaluation suggest wide adoption of the proposed intervention, this project could lead to positive impact at patient, clinician, organizational, and health system levels.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04287192; https://clinicaltrials.gov/ct2/show/NCT04287192.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/20220.

Goal-Oriented Care: A Catalyst for Person-Centred System Integration

Introduction

Person-centred integrated care is often at odds with how current health care systems are structured, resulting in slower than expected uptake of the model worldwide. Adopting goal-oriented care, an approach which uses patient priorities, or goals, to drive what kinds of care are appropriate and how care is delivered, may offer a way to improve implementation.

Description

This case report presents three international cases of community-based primary health care models in Ottawa (Canada), Vermont (USA) and Flanders (Belgium) that adopted goal-oriented care to stimulate clinical, professional, organizational and system integration. The Rainbow Model of Integrated Care is used to demonstrate how goal-oriented care drove integration at all levels.

Discussion

The three cases demonstrate how goal-oriented care has the potential to catalyse integrated care. Exploration of these cases suggests that goal-oriented care can serve to activate formative and normative integration mechanisms; supporting processes that enable integrated care, while providing a framework for a shared philosophy of care.

Lessons learned

By establishing a common vision and philosophy to drive shared processes, goal-oriented care can be a powerful tool to enable integrated care delivery. Offering plenty of opportunities for training in goal-oriented care within and across teams is essential to support this shift.

Seeking Meaningful Innovation: Lessons Learned Developing, Evaluating, and Implementing the Electronic Patient-Reported Outcome Tool

Digital health solutions, in particular information communication technologies, often experience implementation failures leading to slower adoption than expected. This implementation challenge has spurred the development of frameworks to help navigate this uncertain and messy process. These frameworks point to environmental, organizational, individual, and technological factors that can drive or hinder implementation, with some in the field suggesting that perceived value may play a pivotal role. However, the concept of value can have varying meanings and be challenging to operationalize as a means to support implementation. Attending to philosophical and psychological meaningfulness for users and organizations in which technologies are adopted may offer a useful lens, by linking perceived value to individual behavior changes often required as part of implementing digital health technologies. Lessons learned from developing, evaluating, and implementing the electronic Patient-Reported Outcome (ePRO) tool demonstrate how qualitative methods can be used to uncover meaningfulness. By drawing from this example and other similar studies, this viewpoint offers suggestions on how future inquiry could deepen an understanding of meaningful innovation to help drive the implementation of digital health technologies.