Planning for patient-reported outcome implementation: Development of decision tools and practical experience across four clinics

Selecting patient-reported outcome measures: "what" and "for whom"

Patient-reported outcomes (PROMs) are becoming more widely implemented across health care for important reasons. However, with thousands of PROMs available and the science of psychometrics becoming more widely applied in health measurement, choosing the right ones to implement can be puzzling. This article provides a framework of the different types of PROMs by organizing them into 4 categories based upon "what" is being measured and "from whom" the questions are asked: (1) condition-specific and domain-specific, (2) condition-specific and global, (3) universal and global, and (4) universal and domain-specific. We delve deeper into each category with clinical examples. This framework can empower health care leaders and policymakers to make more informed decisions when selecting the best PROMs to implement, ensuring PROMs deliver on their potential to promote high quality, patient-centered care.

Seamless Integration of Computer-Adaptive Patient Reported Outcomes into an Electronic Health Record

BACKGROUND

Patient-reported outcome (PRO) measures have become an essential component of quality measurement, quality improvement, and capturing the voice of the patient in clinical care. In 2004, the National Institutes of Health endorsed the importance of PROs by initiating the Patient-Reported Outcomes Measurement Information System (PROMIS), which leverages computer-adaptive tests (CATs) to reduce patient burden while maintaining measurement precision. Historically, PROMIS CATs have been used in a large number of research studies outside the electronic health record (EHR), but growing demand for clinical use of PROs requires creative information technology solutions for integration into the EHR.

OBJECTIVES

This paper describes the introduction of PROMIS CATs into the Epic Systems EHR at a large academic medical center using a tight integration; we describe the process of creating a secure, automatic connection between the application programming interface (API) which scores and selects CAT items and Epic.

METHODS

The overarching strategy was to make CATs appear indistinguishable from conventional measures to clinical users, patients, and the EHR software itself. We implemented CATs in Epic without compromising patient data security by creating custom middleware software within the organization's existing middleware framework. This software communicated between the Assessment Center API for item selection and scoring and Epic for item presentation and results. The middleware software seamlessly administered CATs alongside fixed-length, conventional PROs while maintaining the display characteristics and functions of other Epic measures, including automatic display of PROMIS scores in the patient's chart. Pilot implementation revealed differing workflows for clinicians using the software.

RESULTS

The middleware software was adopted in 27 clinics across the hospital system. In the first 2 years of hospital-wide implementation, 793 providers collected 70,446 PROs from patients using this system.

CONCLUSION

This project demonstrated the importance of regular communication across interdisciplinary teams in the design and development of clinical software. It also demonstrated that implementation relies on buy-in from clinical partners as they integrate new tools into their existing clinical workflow.

Implementing patient-centred outcome measures in palliative care clinical practice for adults (IMPCOM): Protocol for an update systematic review of facilitators and barriers

Background: Despite the development of patient-centred or patient-reported outcome measures (PCOMs or PROMs) in palliative and end-of-life care over recent years, their routine use in practice faces continuing challenges. Objective: To update a highly cited literature review, identify and synthesise new evidence on facilitators, barriers, lessons learned, PCOMs used, models of implementation, implementation outcomes, costs, and consequences of implementing PCOMs in palliative care clinical practice. Methods: We will search MEDLINE, PsycINFO, CINAHL, Embase, Emcare, SCI-Expanded, SSCI, ESCI, and BNI. The database search will be supplemented by a list of studies from the expert advisory committee, hand-searching of reference lists for included articles, and citations of the original review. We will include primary studies using a PCOM during clinical care of adult patients with advanced disease in palliative care settings and extract data on reported models of implementation, PCOMs, facilitators, barriers, lessons learned, costs, and implementation outcomes. Gough's Weight of Evidence Framework will be used to assess the robustness and relevance of the studies. We will narratively synthesise and tabulate the findings. This review will follow PRISMA, PRISMA-Abstract, PRISMA-P, and PRISMA-Search as the reporting guidelines. Source of funding: Marie Curie. The funder is not involved in designing or conducting this study. Protocol registration: CRD42023398653 (13/02/2023).

An Evidence-Based Framework for Creating Inclusive and Personalized mHealth Solutions-Designing a Solution for Medicaid-Eligible Pregnant Individuals With Uncontrolled Type 2 Diabetes

Mobile health (mHealth) apps can be an evidence-based approach to improve health behavior and outcomes. Prior literature has highlighted the need for more research on mHealth personalization, including in diabetes and pregnancy. Critical gaps exist on the impact of personalization of mHealth apps on patient engagement, and in turn, health behaviors and outcomes. Evidence regarding how personalization, engagement, and health outcomes could be aligned when designing mHealth for underserved populations is much needed, given the historical oversights with mHealth design in these populations. This viewpoint is motivated by our experience from designing a personalized mHealth solution focused on Medicaid-enrolled pregnant individuals with uncontrolled type 2 diabetes, many of whom also experience a high burden of social needs. We describe fundamental components of designing mHealth solutions that are both inclusive and personalized, forming the basis of an evidence-based framework for future mHealth design in other disease states with similar contexts.

System-wide integration of patient reported outcome measure collection through an electronic medical record system: A state-wide retrospective study

BACKGROUND AND PURPOSE

In spine neurosurgery practice, patient-reported outcome measures (PROMs) are tools used to convey information about a patient's health experience and are an integral component of a clinician's decision-making process as they help guide treatment strategies to improve outcomes and minimize pain. Currently, there is limited research showing effective integration strategies of PROMs into electronic medical records. This study aims to provide a framework for other healthcare systems by outlining the process from start to finish in seven Hartford Healthcare Neurosurgery outpatient spine clinics throughout the state of Connecticut.

METHODS

On March 1, 2021, a pilot implementation program began in one clinic and on July 1, 2021, all outpatient clinics were implementing the revised clinical workflow that included the electronic collection of PROMs within the electronic health record (EHR). A retrospective chart analysis studied all adult (18+) new patient visits in seven outpatient clinics by comparing the rates of PROMs collection in Half 1 (March 1, 2021-August 31, 2022) and in Half 2 (September 1, 2022-February 28, 2022) across all sites. Additionally, patient characteristics were studied to identify any variables that may lead to higher rates of collection.

RESULTS

During the study period, 3528 new patient visits were analyzed. There was a significant change in rates of PROMs collection across all departments between H1 and H2 (p < 0.05). Additional significant predictors for PROMs collection were the sex and ethnicity of the patient as well as the provider type for the visit (p < 0.05).

CONCLUSIONS

This study proved that implementing the electronic collection of PROMs into an already existing clinical workflow reduces previously identified collection barriers and enables PROMs collection rates that meet or exceed current benchmarks. Our results provide a successful step-by-step framework for other spine neurosurgery clinics to implement a similar approach.

Patient and clinician-reported experiences of using electronic patient reported outcome measures (ePROMs) as part of routine cancer care

BACKGROUND

Cancer and its treatment can have significant impacts on health status, quality of life and functioning of patients. Direct information from patients regarding these aspects can be collected via electronic platforms in the form of electronic Patient Reported Outcome Measures (ePROMs). Research has shown that the use of ePROMS in cancer care leads to improved communication, better symptom control, prolonged survival and a reduction in hospital admissions and emergency department attendance. Acceptability and feasibility of routine ePROM collection has been reported by both patients and clinicians but to date their use has predominantly been limited to clinical trials. MyChristie-MyHealth is an initiative from a UK comprehensive cancer centre The Christie NHS Foundation Trust which incorporates the regular collection of ePROMs into routine cancer care. This study, carried out as part of a service evaluation, explores patient and clinician experiences of using the MyChristie-MyHealth ePROMs service.

RESULTS

100 patients with lung and head and neck cancers completed a Patient Reported Experience questionnaire. All patients reported that MyChristie-MyHealth was easy to understand and, almost all found it timely to complete and easy to follow. Most patients (82%) reported it improved their communication with their oncology team and helped them to feel more involved with their care (88%). A large proportion of clinicians (8/11) felt ePROMs helped communication with their patients and over half (6/10) felt they led to consultations being more patient focused. Clinicians also felt that the use of ePROMs resulted in patients being more engaged in consultations (7/11) and their cancer care in general (5/11). Five clinicians reported that the use of ePROMs altered their clinical decision making.

CONCLUSIONS

Regular ePROMs collection as part of routine cancer care is acceptable to both patients and clinicians. Both patients and clinicians feel their use improved communication and increased the feeling of patient involvement with their care. Further work is needed to explore the experiences of patients that did not complete the ePROMs as part of the initiative and to continue to optimize the service for both patients and clinicians.

Patient-Reported Outcomes Measurement Information System Is Not as Responsive as Legacy Scores in Detecting Patient Outcomes in Hip Preservation: A Systematic Review

PURPOSE

To evaluate publication trends of Patient-Reported Outcomes Measurement Information System (PROMIS) in hip preservation literature, assess the usage of PROMIS as an outcome measure, and evaluate correlations of all available published PROMIS domains with legacy patient-reported outcomes (PROs).

METHODS

The PubMed, Scopus, Cochrane Central Register of Controlled Trials, and Google Scholar databases were queried for articles evaluating PROMIS scores among hip preservation populations. Inclusion criteria consisted of studies with Level IV evidence or above (per the Sackett et al. levels of evidence), such as case series and cohort studies, reporting on perioperative use of hip PROMIS scores. Exclusion criteria consisted of arthroplasty and trauma studies. Patient demographics, PROMIS usage, and PROMIS Pearson or Spearman correlation coefficients to historic PROs were recorded for each study.

RESULTS

Fifteen articles published between 2017 and 2021 were included in the analysis, with the majority (75%) published between 2020 and 2021. Studies assessing postoperative outcomes had follow-up periods ranging from 6 months to 5 years. The most common PROMIS domain reported was Physical Function (PF), and there was varying usage of other domains including Pain Intensity, Anxiety, and Depression. PROMIS validity was most often assessed in comparison to the modified Harris Hip Score (mHHS) by calculating the Pearson coefficient, which assumes normal data distribution, or Spearman coefficient, which is rank-based and does not require normal data distribution. Studies comparing PROMIS-PF with mHHS reported Pearson coefficients ranging from 0.49 to 0.72 and Spearman coefficients ranging from 0.67 to 0.71.

CONCLUSIONS

There has been a chronologic increase in PROMIS usage in hip preservation literature. PROMIS demonstrates moderate-to-strong correlations with legacy PROs, but there is substantial heterogeneity in follow-up periods, PROMIS domains used, and statistical methodology. The current data show that PROMIS is not as responsive as historically used, validated PROs in quantitatively assessing function and pain in hip preservation patients.

CLINICAL RELEVANCE

Surgeons using PROMIS solely should be aware that the score may not be as responsive as legacy PROs in closely assessing improvements or deterioration in patient performance after hip preservation surgery. Rather than being used alone, PROMIS may be useful as a replacement for a group of legacy PROs. Thus, when used alongside select legacy PROs, overall questionnaire burden can be reduced while maintaining a high level of accuracy in assessing health status.

Developing and testing an integrated patient mHealth and provider dashboard application system for type 2 diabetes management among Medicaid-enrolled pregnant individuals based on a user-centered approach: Mixed-methods study

Background

A tailored and integrated technology solution (patient mHealth application and provider dashboard) can provide a 360° view of Medicaid-enrolled patients with type 2 diabetes (T2D) during pregnancy that could improve health outcomes and address health inequities.

Objectives

To develop a set of user specifications for the mHealth and dashboard applications, develop prototypes based on user needs, and collect initial impressions of the prototypes to subsequently develop refined tools that are ready for deployment.

Methods

Study activities followed a double-diamond framework with a participatory design mindset. Activities were divided into two phases focused on a qualitative inquiry about participant needs and values (phase 1) and design, development, and usability testing of low and high-fidelity prototypes (phase 2).

Results

We identified themes that exemplified pregnancy experience among Medicaid-enrolled individuals with T2D. Patients (n  =  7) and providers (n  =  7) expressed a core set of expectations for the mHealth and dashboard applications. Participants provided feedback to improve the mHealth and dashboard. For both applications, participants reported scores for the NASA Task load Survey (TLX) that were in the 20th percentile of national TLX scores.

Conclusions

Digital health tools have the ability to transform health care among Medicaid-enrolled patients with T2D during pregnancy, with the goal of managing their blood glucose levels, which is a precursor to experiencing a successful pregnancy and birth. Distilling patient and provider needs and preferences-then using them, along with prior studies and theory, to develop applications-holds great potential in tackling complicated health care issues.

Implementation and Feasibility of an Electronic Health Record-Integrated Patient-Reported Outcomes Symptom and Needs Monitoring Pilot in Ambulatory Oncology

PURPOSE

Describe the feasibility and implementation of an electronic health record (EHR)-integrated symptom and needs screening and referral system in a diverse racial/ethnic patient population in ambulatory oncology.

METHODS

Data were collected from an ambulatory oncology clinic at the University of Miami Health System from October 2019 to January 2021. Guided by a Patient Advisory Board and the Exploration, Preparation, Implementation, and Sustainment model, My Wellness Check was developed to assess physical and psychologic symptoms and needs of ambulatory oncology patients before appointments to triage them to supportive services when elevated symptoms (eg, depression), barriers to care (eg, transportation and childcare), and nutritional needs were identified. Patients were assigned assessments at each appointment no more than once in a 30-day period starting at the second visit. Assessments were available in English and Spanish to serve the needs of the predominantly Spanish-speaking Hispanic/Latino population.

RESULTS

From 1,232 assigned assessments, more than half (n = 739 assessments; 60.0%) were initiated by 506 unique patients. A total of 65.4% of English and 49.9% of Spanish assessments were initiated. Among all initiated assessments, the majority (85.1%) were completed at home via the patient portal. The most common endorsed items were nutritional needs (32.9%), followed by emotional symptoms (ie, depression and anxiety; 27.8%), practical needs (eg, financial concerns; 21.7%), and physical symptoms (17.6%). Across the physical symptom, social work, and nutrition-related alerts, 77.1%, 99.7%, and 78.8%, were addressed, respectively, by the corresponding oncology health professional, social work team member, or nutritionist.

CONCLUSION

The results demonstrate encouraging feasibility and initial acceptability of implementing an EHR-integrated symptom and needs screening and referral system among diverse oncology patients. To our knowledge, this is the first EHR-integrated symptom and needs screening system implemented in routine oncology care for Spanish-speaking Hispanics/Latinos.

Implementing an Application Programming Interface for PROMIS Measures at Three Medical Centers

BACKGROUND

There is an increasing body of literature advocating for the collection of patient-reported outcomes (PROs) in clinical care. Unfortunately, there are many barriers to integrating PRO measures, particularly computer adaptive tests (CATs), within electronic health records (EHRs), thereby limiting access to advances in PRO measures in clinical care settings.

OBJECTIVE

To address this obstacle, we created and evaluated a software integration of an Application Programming Interface (API) service for administering and scoring Patient-Reported Outcomes Measurement Information System (PROMIS) measures with the EHR system.

METHODS

We created a RESTful API and evaluated the technical feasibility and impact on clinical workflow at three academic medical centers.

RESULTS

Collaborative teams (i.e., clinical, information technology [IT] and administrative staff) performed these integration efforts addressing issues such as software integration as well as impact on clinical workflow. All centers considered their implementation successful based on the high rate of completed PROMIS assessments (between January 2016 and January 2021) and minimal workflow disruptions.

CONCLUSION

These case studies demonstrate not only the feasibility but also the pathway for the integration of PROMIS CATs into the EHR and routine clinical care. All sites utilized diverse teams with support and commitment from institutional leadership, initial implementation in a single clinic, a process for monitoring and optimization, and use of custom software to minimize staff burden and error.

Enhancing the use of EHR systems for pragmatic embedded research: lessons from the NIH Health Care Systems Research Collaboratory

OBJECTIVE

We identified challenges and solutions to using electronic health record (EHR) systems for the design and conduct of pragmatic research.

MATERIALS AND METHODS

Since 2012, the Health Care Systems Research Collaboratory has served as the resource coordinating center for 21 pragmatic clinical trial demonstration projects. The EHR Core working group invited these demonstration projects to complete a written semistructured survey and used an inductive approach to review responses and identify EHR-related challenges and suggested EHR enhancements.

RESULTS

We received survey responses from 20 projects and identified 21 challenges that fell into 6 broad themes: (1) inadequate collection of patient-reported outcome data, (2) lack of structured data collection, (3) data standardization, (4) resources to support customization of EHRs, (5) difficulties aggregating data across sites, and (6) accessing EHR data.

DISCUSSION

Based on these findings, we formulated 6 prerequisites for PCTs that would enable the conduct of pragmatic research: (1) integrate the collection of patient-centered data into EHR systems, (2) facilitate structured research data collection by leveraging standard EHR functions, usable interfaces, and standard workflows, (3) support the creation of high-quality research data by using standards, (4) ensure adequate IT staff to support embedded research, (5) create aggregate, multidata type resources for multisite trials, and (6) create re-usable and automated queries.

CONCLUSION

We are hopeful our collection of specific EHR challenges and research needs will drive health system leaders, policymakers, and EHR designers to support these suggestions to improve our national capacity for generating real-world evidence.