Advancing the use of patient-reported outcomes in practice: understanding challenges, opportunities, and the potential of health information technology

Lived experiences of patients with advanced pancreatic cancer on patient-reported outcomes (PROs) management: a qualitative phenomenological study in Southwest China

OBJECTIVES

To explore the lived experiences of patients with advanced pancreatic cancer enrolled in a patient-reported outcomes (PROs) management programme and to preliminarily understand how PROs management influences various aspects of patient care and overall quality of life.

DESIGN

A qualitative phenomenological study.

SETTING

A national cancer care centre in Southwest China specialised in cancer care, with a comprehensive PROs management programme.

PARTICIPANTS

15 participants diagnosed with advanced pancreatic cancer.

RESULTS

Five key themes emerged from our interviews, including enhanced communication with healthcare providers, attributed to the structured nature of PROs; increased perceived sense of care, with patients feeling more valued and heard; PROs management facilitated better treatment decision-making, with patients feeling more involved and empowered; improved communication with family members, aiding in better understanding and support; and varied perceptions of the impact on quality of life, with some noting improvements in specific aspects like symptom management, while others were uncertain about the overall benefit.

CONCLUSIONS

PROs management plays a significant role in improving communication between patients with advanced pancreatic cancer and their healthcare providers, enhancing patients' involvement in treatment decisions, and potentially improving family dynamics. However, the impact of PROs management on the overall quality of life of patients remains complex and individualised. The findings suggest that further research with a more diverse patient population is needed to fully understand the implications of PROs management in advanced cancer care.

Patient-Reported Outcomes in Metabolic Dysfunction-Associated Steatotic Liver Disease

Metabolic dysfunction-associated steatotic liver disease (MASLD) is the most common chronic liver disease worldwide and can progress to serious complications, including metabolic dysfunction-associated steatohepatitis (MASH), cirrhosis, end-stage liver disease, and hepatocellular carcinoma. Predisposing risk factors for MASH include obesity, type 2 diabetes, dyslipidemia, and metabolic syndrome. Patients with MASH often experience significant impairments in their health-related quality of life and other patient-reported outcomes (PROs), particularly in physical functioning domains, fatigue, and vitality. Incorporating PROs offers valuable insights into patients' perspectives on their symptoms, treatment efficacy, and overall well-being, thereby guiding more holistic and patient-centered care strategies. This review aims to investigate the utilization of patient-reported outcome measures (PROMs) in the context of MASLD and MASH care, identify which PROMs are employed, and summarize the outcomes reported.

How Does CLEFT-Q Change the Way We Practice? A Prospective Study Integrating Patient-Reported Outcomes

BACKGROUND

The CLEFT-Q is a validated instrument designed to elicit patient-reported outcomes among people affected by cleft lip and/or palate. However, it has not been reported how use of CLEFT-Q data alters routine cleft care. This study analyzed the impact of CLEFT-Q data integration on patient care and clinical decision-making.

METHODS

Patients were sequentially, prospectively evaluated during scheduled cleft team visits. The CLEFT-Q was completed before the clinic encounter, but results were initially masked from the surgeon and family. In the encounter, a study observer characterized patients' verbalized attitudes across 7 specific domains of appearance and function, and the provisional assessment and plan was noted. CLEFT-Q data were then introduced into the clinical encounter and discussed. Discordance between patients' initially verbalized attitudes and their self-reported scores on the CLEFT-Q was documented along with any resultant modifications to their care plan.

RESULTS

Seventy patient visits were observed; the mean patient age was 12.7 years (range, 8 to 19 years). Forty-one patients (59%) had cleft lip and palate/alveolus and 29 (41%) had isolated cleft palate. Discordance was observed in 36% of visits and in 9.2% of specific domains assessed. Highest discordance rates were observed in domains of psychosocial function (12.5%), speech function/distress (11.6%), and lips/lip scar appearance (11.6%). No age group or sex was associated with increased discordance. Integration of CLEFT-Q results altered the assessment and plan in 11 visits (16%).

CONCLUSION

The CLEFT-Q provides clinically relevant insight into patient perspectives that are not captured by routine interview and examination alone, and regularly leads to a change in the management plan.

Measuring Symptoms Across the Spectrum of Chronic Kidney Disease: Strategies for Incorporation Into Kidney Care

Many people across the spectrum of chronic kidney disease (CKD) experience a large symptom burden. Measuring symptoms can be a way of responding to the concerns of patients and their priorities of care and may help to improve overall outcomes, including health-related quality of life. The objective of this article is to discuss approaches to measuring symptoms across the spectrum of CKD and to highlight strategies to facilitate the incorporation of routine symptom assessment into kidney care. Specifically, we discuss the use of validated patient-reported outcome measures in CKD as they relate to measuring symptoms, including their benefits and limitations, and describe commonly used patient-reported outcome measures. We discuss potential barriers that should be considered when contemplating the development of a program to routinely measure and address symptoms. Finally, we outline a systematic, stepwise approach to measuring symptoms with implementation strategies to address the common barriers. Although the principles outlined in this article can be applied to research and audit, the principal focus is on symptom measurement aimed at informing clinical practice and directly improving patient outcomes.

Patient perspectives on recall period and response options in patient-reported outcome measures for chronic rhinosinusitis symptomatology: An international multi-centered study

BACKGROUND

Existing patient-reported outcome measures (PROMs) for chronic rhinosinusitis (CRS) use a variety of recall periods and response scales to assess CRS symptom burden. Global perspectives of CRS patients regarding optimal recall periods and response scales for CRS PROMs are unknown.

METHODS

This was a multi-center, cross-sectional study recruiting 461 CRS patients from sites across the United States, Saudi Arabia, New Zealand, and Austria. Participants chose which CRS symptom recall period (1 day, 2 weeks, 1 month, >1 month) was most reflective of their current disease state and upon which to best base treatment recommendations (including surgery). Participants also chose which of six response scales (one visual analogue scale and five Likert scales ranging from four to eight items) was easiest to use, understand, and preferred.

RESULTS

A plurality of participants (40.0%) felt their CRS symptoms' current state was best reflected by a 1-month recall period. However, most patients (56.9%) preferred treatment recommendations to be determined by symptoms experienced over a >1 month period. The four- and five-item Likert scales were the easiest to understand (26.0% and 25.4%, respectively) and use (23.4% and 26.7%, respectively). The five-item (26.4% rating it most preferred and 70.9% rating it preferred) and four-item Likert (22.3% rating it most preferred and 56.4% rating it preferred) response scales were most preferred.

CONCLUSION

Future PROMs for CRS should consider assessment of symptoms over a 1-month period and use a four- or five-item Likert response scale to reflect global patient preferences. These findings also inform interpretation of current CRS PROMs.

Developing a shortened spine functional index (SFI-10) for patients with sub-acute/chronic spinal disorders: a cross-sectional study

BACKGROUND

Brief whole-spine patient-reported outcome measures (PROMs) provide regional solutions and future directions for quantifying functional status, evidence, and effective interventions. The whole-spine regional Spine Functional Index (SFI-25) is used internationally in clinical and scientific contexts to assess general sub-acute/chronic spine populations. However, to improve structural validity and practicality a shortened version is recommended. This study developed a shortened-SFI from the determined optimal number of item questions that: correlated with criteria PROMs being highly with whole-spine, moderately with regional-spine, condition-specific and patient-specific, and moderately-low with general-health and pain; retained one-dimensional structural validity and high internal consistency; and improved practicality to reduce administrative burden.

METHODS

A cross-sectional study (n = 505, age = 18-87 yrs., average = 40.3 ± 10.1 yrs) of sub-acute/chronic spine physiotherapy outpatients from an international sample of convenience. Three shortened versions of the original SFI-25 were developed using 1) qualitative 'content-retention' methodology, 2) quantitative 'factorial' methodology, and 3) quantitative 'Rasch' methodology, with a fourth 'random' version produced as a comparative control. The clinimetric properties were established for structural validity with exploratory (EFA) and confirmatory (CFA) factorial analysis, and Rasch analysis. Criterion validity used the: whole-spine SFI-25 and Functional Rating Index (FRI); regional-spine Neck Disability Index (NDI), Oswestry Disability Index (ODI), and Roland Morris Questionnaire (RMQ), condition-specific Whiplash Disability Questionnaire (WDQ); and patient-specific functional scale (PSFS); and determined floor/ceiling effect. A post-hoc pooled international sub-acute/chronic spine sample (n = 1433, age = 18-91 yrs., average = 42.0 ± 15.7 yrs) clarified the findings and employed the general-health EuroQuol-Index (EQ-5D), and 11-point Pain Numerical Rating Scale (P-NRS) criteria.

RESULTS

A 10-item SFI retained structural validity with optimal practicality requiring no computational aid. The SFI-10 concept-retention-version demonstrated preferred criterion validity with whole-spine criteria (SFI-25 = 0.967, FRI = 0.810) and exceeded cut-off minimums with regional-spine, condition-specific, and patient-specific measures. An unequivocal one-dimensional structure was determined. Internal consistency was satisfactory (α = 0.80) with no floor/ceiling effect. Post-hoc analysis of the international sample confirmed these findings.

CONCLUSION

The SFI-10 qualitative concept-retention version was preferred to quantitative factorial and Rasch versions, demonstrated structural and criterion validity, and preferred correlation with criteria measures. Further longitudinal research is required for reliability, error, and responsiveness, plus an examination of the practical characteristics of readability and administrative burden.

Development of a communication platform for patients with head and neck cancer for effective information delivery and improvement of doctor-patient relationship: application of treatment journey-based service blueprint

BACKGROUND

Effective communication and information delivery enhance doctor-patient relationships, improves adherence to treatment, reduces work burden, and supports decision-making. The study developed a head and neck cancer (HNC) communication platform to support effective delivery of information about HNC treatment and improve the doctor-patient relationship.

METHODS

This study was structured in three main phases: 1) The requirement elicitation phase sought an understanding of the HNC treatment journey and service failure points (FPs) obtained through patient/medical staff interviews and observations, along with a review of the electronic health record system; 2) The development phase involved core needs analysis, solutions development through a co-creation workshop, and validation of the solutions through focus groups; and 3) the proposed HNC communication platform was integrated with the current treatment system, and the flow and mechanism of the interacting services were structured using a service blueprint (SB).

RESULTS

Twenty-two service FPs identified through interviews and observations were consolidated into four core needs, and solutions were proposed to address each need: an HNC treatment journey map, cancer survivor stories, operation consent redesign with surgical illustrations, and a non-verbal communication toolkit. The communication platform was designed through the SB in terms of the stage at which the solution was applied and the actions and interactions of the service providers.

CONCLUSIONS

The developed platform has practical significance, reflecting a tangible service improvement for both patients and medical staff, making it applicable in hospital settings.

Using Implementation Science Frameworks to Guide the Use of Electronic Patient-Reported Outcome Symptom Monitoring in Routine Cancer Care

PURPOSE

Electronic patient-reported outcomes (ePROs) are an evidence-based means of detecting symptoms earlier and improving patient outcomes. However, there are few examples of successful implementation in routine cancer care. We conducted a qualitative study to identify barriers and facilitators to implementing ePRO symptom monitoring in routine cancer care using the Consolidated Framework for Implementation Research (CFIR).

METHODS

Participants were adult patients with cancer, their caregivers, or health care professionals involved in ePRO monitoring or processes. Focus groups or individual interviews were conducted using a semistructured approach informed by the CFIR. Data were analyzed deductively using the CFIR. Barriers were matched to theory-informed implementation strategies using the CFIR-Expert Recommendations for Implementing Change (ERIC) matching tool.

RESULTS

Thirty participants were interviewed: 22 females (73%), aged 31-70 years (28, 94%), comprising patients (n = 8), caregivers (n = 2), medical oncologists (n = 4), nurses (n = 4), hospital leaders (n = 6), clinic administrators (n = 2), pharmacists (n = 2), and information technology specialists (n = 2). Barriers pertaining to four CFIR domains were identified and several were novel, including the challenge of adapting ePROs for different anticancer treatments. Facilitators pertaining to all CFIR domains were identified, such as leveraging acceptability of remote care post-COVID-19 to drive implementation. Conducting consensus discussions with stakeholders to tailor ePROs to the local setting, identifying/preparing individual and group-level champions, and assessing readiness for change (including leveraging technological advances and increased confidence in using remote monitoring post-COVID-19) were the most frequently recommended implementation strategies.

CONCLUSION

The CFIR facilitated identification of known and novel barriers and facilitators to implementing ePRO symptom monitoring in routine cancer care. Implementation strategies summarized in a conceptual framework will be used to codesign an ePRO symptom monitoring system for immunotherapy side effects.

The implementation, use and impact of patient reported outcome measures in value-based healthcare programmes: A scoping review

BACKGROUND

Value-Based Healthcare (VBHC) focuses on the value of patient outcomes and is achieved by ensuring resources already available are managed to realise the best possible individual and population health outcomes. Patient reported outcome measures (PROMs) measure the impact of illnesses from the patient perspective. We conducted a scoping review to understand how PROMs were implemented and used, and their impact in the context of VBHC.

METHODS

Arksey and O'Malley's overarching framework supplemented by principles from mixed-methods Framework Synthesis were used. CINAHL, Cochrane Library, EMBASE, MEDLINE, PsycINFO, Web of Science, Google Scholar and reference lists were searched. An a priori data extraction framework was created using the review question and objectives as key domains against which to extract data. Mixed-methods data were organised, integrated and preserved in original format and reported for each domain.

RESULTS

Forty-three studies were included with 60,200 participants. Few studies reported a well-developed programme theory and we found little robust evidence of effect. PROMs were universally considered to have the potential to increase patient satisfaction with treatment and services, enhance patient awareness of symptoms and self-management, and improve health outcomes such as quality of life and global health status. Evidence is currently limited on how PROMs work and how best to optimally implement PROMs to achieve the target outcome. Implementation challenges commonly prevented the realisation of optimal outcomes and patients generally needed better and clearer communication about why PROMs were being given and how they could optimally be used to support their own self-management.

CONCLUSION

PROMSs have yet to demonstrate their full potential in a VBHC context. Optimal PROMs implementation is poorly understood by clinicians and patients. Future studies should explore different models of PROM implementation and use within VBHC programmes to understand what works best and why for each specific context, condition, and population.

Impact of Co-occurring Cancer-Related and Wound-Specific Symptoms on Functional Performance Among Patients With Advanced Cancer and Malignant Fungating Wounds: An Exploratory, Observational Study

PURPOSE

The purpose of this study was to examine the impact of co-occurring symptoms in patients with advanced cancer and malignant fungating wounds (MFWs) on palliative and functional performance, and the feasibility of collecting self-reported data in this population.

DESIGN

This was an exploratory, observational study. Quantitative surveys and qualitative semistructured interviews using a phenomenological approach were employed.

SUBJECTS AND SETTING

The sample comprised 5 adults with advanced breast, oral, and ovarian cancer and MFWs. Participants were recruited from an urban outpatient cancer center, hospice, and wound center located in the Northeastern United States.

METHODS

Demographic and clinical characteristics were collected, and self-reported symptom and functional performance data measured. Descriptive statistics, T scores, confidence intervals, and standard deviation were calculated for quantitative data. One-to-one semistructured interviews were conducted by the first author to gain deeper understanding of participants' symptom experience. Qualitative data were analyzed using an iterative and inductive thematic data analysis method to identify major themes.

RESULTS

The mean cancer-related and wound-specific symptom occurrence was 17 (SD = 5.56) and 4 (SD = 1.26), respectively. Distressing, extensive co-occurring symptom burdens were experienced by all participants; they also reported poor functional performance and diminished palliative performance. Qualitative findings supported quantitative results.

CONCLUSIONS

Findings suggest that co-occurring cancer-related and wound-specific symptoms have incremental and negative impact on functional performance. The use of multiple data collection methods was feasible, including self-reported data in this advanced cancer population.

Using bookmarking methods with orthopedic clinicians and patients with fractures produces score interpretation labels for patient-reported outcome measures

OBJECTIVE

The objective of this study was to determine the patient-reported outcome measure (PROM) score ranges associated with descriptive labels (i.e., within normal limits, mild, moderate, severe) by using bookmarking methods with orthopedic clinicians and patients who have experienced a bone fracture.

STUDY DESIGN AND SETTING

We created vignettes comprised of six items and responses from the Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity Function, Physical Function, and Pain Interference item banks reflecting different levels of severity. Two groups of patients with fractures (n = 11) and two groups of orthopedic clinicians (n = 16) reviewed the vignettes and assigned descriptive labels independently and then discussed as a group until reaching consensus via a videoconference platform.

RESULTS

PROMIS Physical Function and Pain Interference thresholds (T = 50, 40, 25/30 and T = 50/55, 60, 65/70, respectively) for patients with bone fractures were consistent with the results from other patient populations. Upper Extremity thresholds were about 10 points (1 SD) more severe (T = 40, 30, 25/20) compared to the other measures. Patient and clinician perspectives were similar.

CONCLUSION

Bookmarking methods generated meaningful score thresholds for PROMIS measures. These thresholds between severity categories varied by domain. Threshold values for severity represent important supplemental information to interpret PROMIS scores clinically.

Evaluating a web-based personalized decision report for total knee or hip replacement: Lessons learned from patients

RATIONALE

Patient-reported outcomes (PROs) are increasingly used in the context of clinical care, but evaluation of patients' perspectives of PRO-based applications in routine care remains limited.

AIMS AND OBJECTIVES

This paper investigates patients' acceptability of a personalized web-based decision report for total knee or hip replacement and identifies opportunities to refine the report.

METHOD

This qualitative evaluation was embedded in a pragmatic cluster randomized trial of the report. We interviewed 25 patients with knee and hip osteoarthritis about their experiences using the personalized decision report in the context of a surgical consultation. The web-based report contained current descriptive PRO scores of pain, function and general physical health; tailored predicted postoperative PRO scores (i.e., personalized likely outcomes based on actual knee or hip replacement outcomes of similar patients in a national registry); and information about alternative nonoperative treatments. Two trained researchers analysed the interview data qualitatively using a combination of inductive and deductive coding.

RESULTS

We identified three major categories for evaluation: content of report, presentation of data in report and engagement with report. Patients generally liked the report overall but specifically valued different pages of the report based on where they were in the surgical decision-making process. Patients identified areas of confusion in data presentation related to graph orientation, terminology and interpretation of T-scores. Patients also highlighted support needs to meaningfully engage with the information in the report.

CONCLUSION

Our findings highlight areas of opportunity to further refine this personalized web-based decision report and similar patient-facing PRO applications for routine clinical care. Specific examples include additional tailoring of reports via filterable web-based dashboards and scalable educational supports to facilitate more independent patient understanding and use.

Big Data in Oncology Nursing Research: State of the Science

OBJECTIVE

To review the state of oncology nursing science as it pertains to big data. The authors aim to define and characterize big data, describe key considerations for accessing and analyzing big data, provide examples of analyses of big data in oncology nursing science, and highlight ethical considerations related to the collection and analysis of big data.

DATA SOURCES

Peer-reviewed articles published by investigators specializing in oncology, nursing, and related disciplines.

CONCLUSION

Big data is defined as data that are high in volume, velocity, and variety. To date, oncology nurse scientists have used big data to predict patient outcomes from clinician notes, identify distinct symptom phenotypes, and identify predictors of chemotherapy toxicity, among other applications. Although the emergence of big data and advances in computational methods provide new and exciting opportunities to advance oncology nursing science, several challenges are associated with accessing and using big data. Data security, research participant privacy, and the underrepresentation of minoritized individuals in big data are important concerns.

IMPLICATIONS FOR NURSING PRACTICE

With their unique focus on the interplay between the whole person, the environment, and health, nurses bring an indispensable perspective to the interpretation and application of big data research findings. Given the increasing ubiquity of passive data collection, all nurses should be taught the definition, characteristics, applications, and limitations of big data. Nurses who are trained in big data and advanced computational methods will be poised to contribute to guidelines and policies that preserve the rights of human research participants.

Facing the challenges of PROM implementation in Dutch dialysis care: Patients' and professionals' perspectives

BACKGROUND

Patient Reported Outcome Measures (PROMs) are increasingly used in routine clinical practice to facilitate patients in sharing and discussing health-related topics with their clinician. This study focuses on the implementation experiences of healthcare professionals and patients during the early implementation phase of the newly developed Dutch set of dialysis PROMs and aims to understand the process of early implementation of PROMs from the users' perspectives.

METHODS

This is a qualitative study among healthcare professionals (physicians and nursing staff: n = 13) and patients (n = 14) of which 12 were receiving haemodialysis and 2 peritoneal dialysis. Semi-structured interviews were used to understand the barriers and facilitators that both professionals and patients encounter when starting to implement PROMs.

RESULTS

The early PROM implementation process is influenced by a variety of factors that we divided into barriers and facilitators. We identified four barriers: patient´s indifference to PROMs, scepticism on the benefits of aggregated PROM data, the limited treatment options open to doctors and organizational issues such as mergers, organizational problems and renovations. We also describe four facilitators: professional involvement and patient support, a growing understanding of the use of PROMs during the implementation, quick gains from using PROMs such as receiving instant feedback and a clear ambition on patient care such as a shared view on patient involvement and management support.

CONCLUSIONS

In this qualitative study carried out during the early implementation phase of the Dutch dialysis PROM set, we found that patients did not yet consider the PROM set to be a useful additional tool to share information with their doctor. This was despite the professionals' primary reason for using PROMs being to improve patient-doctor communication. Furthermore, the perceived lack of intervention options was frustrating for some of the professionals. We found that nurses could be important enablers of further implementation because of their intensive relationship with dialysis patients.

One report, multiple aims: orthopedic surgeons vary how they use patient-reported outcomes with patients

PURPOSE

We conducted semi-structured qualitative interviews with surgeons to assess their goals for incorporating a patient-reported outcome measure (PROM)-based shared decision report into discussions around surgical and non-surgical treatment options for osteoarthritis of the knee and hip.

METHODS

Surgeons actively enrolling patients into a study incorporating a standardized PROM-based shared decision report were invited to participate in a semi-structured interview lasting 30 min. Open-ended questions explored how the surgeon used report content, features that were helpful, confusing, or could be improved, and how use of the report fit into the surgeon's workflow. We used a conventional content analysis approach.

RESULTS

Of the 16 eligible surgeons, 11 agreed to participate with 9 completing the interview and 2 withdrawing due to work demands. We identified 8 themes related to PROM-based report use: Acceptability, Patient Characteristics, Communication Goals, Useful Content, Not Useful Content, Challenges, Training Needs, and Recommended Improvements. Additional sub-themes emerged for Communication Goals (7) and Challenges (8). All surgeons shared positive feedback about using the report as part of clinical care. Whereas surgeons described the use of the report to achieve different goals, the most common uses related to setting expectations for post-surgical outcomes (89%) and educating patients (100%).

CONCLUSION

Surgeons tailor their use of a PROM-based report with individual patients to achieve a range of aims. This study suggests multiple opportunities to further our understanding of the ways PROMs can be used in clinical practice. The way PROM information is visually displayed and multi-component reports are assembled can facilitate diverse aims.

Implementing an Electronic Patient-Reported Outcome and Decision Support Tool in Early Intervention

OBJECTIVE

The aim of the study is to identify and prioritize early intervention (EI) stakeholders' perspectives of supports and barriers to implementing the Young Children's Participation and Environment Measure (YC-PEM), an electronic patient-reported outcome (e-PRO) tool, for scaling its implementation across multiple local and state EI programs.

METHODS

An explanatory sequential (quan > QUAL) mixed-methods study was conducted with EI families (n = 6), service coordinators (n = 9), and program leadership (n = 7). Semi-structured interviews and focus groups were used to share select quantitative pragmatic trial results (e.g., percentages for perceived helpfulness of implementation strategies) and elicit stakeholder perspectives to contextualize these results. Three study staff deductively coded transcripts to constructs in the Consolidated Framework for Implementation Research (CFIR). Data within CFIR constructs were inductively analyzed to generate themes that were rated by national early childhood advisors for their relevance to longer term implementation.

RESULTS

All three stakeholder groups (i.e., families, service coordinators, program leadership) identified thematic supports and barriers across multiple constructs within each of four CFIR domains: (1) Six themes for "intervention characteristics," (2) Six themes for "process," (3) three themes for "inner setting," and (4) four themes for "outer setting." For example, all stakeholder groups described the value of the YC-PEM e-PRO in forging connections and eliciting meaningful information about family priorities for efficient service plan development ("intervention characteristics"). Stakeholders prioritized reaching families with diverse linguistic preferences and user navigation needs, further tailoring its interface with automated data capture and exchange processes ("process"); and fostering a positive implementation climate ("inner setting"). Service coordinators and program leadership further articulated the value of YC-PEM e-PRO results for improving EI access ("outer setting").

CONCLUSION

Results demonstrate the YC-PEM e-PRO is an evidence-based intervention that is viable for implementation. Optimizations to its interface are needed before undertaking hybrid type-2 and 3 multisite trials to test these implementation strategies across state and local EI programs with electronic data capture capabilities and diverse levels of organizational readiness and resources for implementation.

Establishing severity levels for patient-reported measures of functional communication, participation, and perceived cognitive function for adults with acquired cognitive and language disorders

PURPOSE

To empirically assign severity levels (e.g., mild, moderate) to four relatively new patient-reported outcome measures (PROMs) for adults with acquired cognitive/language disorders. They include the Communicative Participation Item Bank, the Aphasia Communication Outcome Measure, and Neuro-QoL's item banks of Cognitive Function (v2.0) and Ability to Participate in Social Roles and Activities (v1.0).

METHOD

We conducted 17 focus groups that comprised 22 adults with an acquired cognitive/language disorder from stroke, Parkinson's disease, or traumatic brain injury; 30 care partners of an adult with an acquired cognitive/language disorder; and 42 speech-language pathologists who had experience assessing/treating individuals with those and other cognitive/language disorders. In a small, moderated focus-group format, participants completed "PROM-bookmarking" procedures: They discussed hypothetical vignettes based on PROM item responses about people with cognitive/language disorders and had to reach consensus regarding whether their symptoms/function should be categorized as within normal limits or mild, moderate, or severe challenges.

RESULTS

There was generally good agreement among the stakeholder groups about how to classify vignettes, particularly when they reflected very high or low functioning. People with aphasia described a larger range of functional communication challenges as "mild" compared to other stakeholder types. Based on a consensus across groups, we present severity levels for specific score ranges for each PROM.

CONCLUSION

Standardized, stakeholder-informed severity levels that aid interpretation of PROM scores can help clinicians and researchers derive better clinical meaning from those scores, for example, by identifying important clinical windows of opportunity and assessing when symptoms have returned to a "normal" range.

Association of Function, Symptoms, and Social Support Reported in Standardized Outpatient Clinic Questionnaires With Subsequent Hospital Discharge Disposition and 30-Day Readmissions

OBJECTIVE

To determine whether patient-reported information, routinely collected in an outpatient setting, is associated with readmission within 30 days of discharge and/or the need for post-acute care after a subsequent hospital admission.

DESIGN

Retrospective cohort study. Six domains of patient-reported information collected in the outpatient setting (psychological distress, respiratory symptoms, musculoskeletal pain, family support, mobility, and activities of daily living [ADLs]) were linked to electronic health record hospitalization data. Mixed effects logistic regression models with random intercepts were used to identify the association between the 6 domains and outcomes.

SETTING

Outpatient clinics and hospitals in a Midwestern health system.

PARTICIPANTS

7671 patients who were hospitalized 11,445 times between May 2004 and May 2014 (N=7671).

INTERVENTION

None.

MAIN OUTCOME MEASURES

30-day hospital readmission and discharge home vs facility.

RESULTS

Domains were significantly associated with 30-day readmission and placement in a facility. Specifically, mobility (odds ratio [OR]=1.30; 95% confidence interval [CI], 1.16, 1.46), ADLs (OR=1.27; 95% CI, 1.13, 1.42), respiratory symptoms (OR=1.26; 95% CI, 1.12, 1.41), and psychological distress (OR=1.20; 95% CI, 1.07, 1.35) had the strongest associations with 30-day readmission. The ADL (OR=2.52; 95% CI, 2.26, 2.81), mobility (OR=2.35; 95% CI, 2.10, 2.63), family support (OR=2.28; 95% CI, 1.98, 2.62), and psychological distress (OR=1.38; 95% CI, 1.25, 1.52) domains had the strongest associations with discharge to an institution.

CONCLUSIONS

Patient-reported function, symptoms, and social support routinely collected in outpatient clinics are associated with future 30-day readmission and discharge to an institutional setting. Whether these data can be leveraged to guide interventions to address patient needs and improve outcomes requires further research.

Managing Critical Patient-Reported Outcome Measures in Oncology Settings: System Development and Retrospective Study

BACKGROUND

Remote monitoring programs based on the collection of patient-reported outcome (PRO) data are being increasingly adopted in oncology practices. Although PROs are a great source of patient data, the management of critical PRO data is not discussed in detail in the literature.

OBJECTIVE

This first-of-its-kind study aimed to design, describe, and evaluate a closed-loop alerting and communication system focused on managing PRO-related alerts in cancer care.

METHODS

We designed and developed a novel solution using an agile software development methodology by incrementally building new capabilities. We evaluated these new features using participatory design and the Fit between Individuals, Task, and Technology framework.

RESULTS

A total of 8 questionnaires were implemented using alerting features, resulting in an alert rate of 7.82% (36,838/470,841) with 13.28% (10,965/82,544) of the patients triggering at least one alert. Alerts were reviewed by 501 staff members spanning across 191 care teams. All the alerts were reviewed with a median response time of 1 hour (SD 185 hours) during standard business hours. The most severe (red) alerts were documented 56.83% (2592/4561) of the time, whereas unlabeled alerts were documented 27.68% (1298/4689) of the time, signaling clinician concordance with the alert thresholds.

CONCLUSIONS

A PRO-based alert and communication system has some initial benefits in reviewing clinically meaningful PRO data in a reasonable amount of time. We have discussed key system design considerations, workflow integration, and the mitigation of potential impact on the burden of care teams. The introduction of a PRO-based alert and communication system provides a reliable mechanism for care teams to review and respond to patient symptoms quickly. The system was standardized across many different oncology settings, demonstrating system flexibility. Future studies should focus on formally evaluating system usability through qualitative methods.

Is the Promise of PROMs Being Realized? Implementation Experience in a Large Orthopedic Practice

Patient-reported outcome measures (PROMs), increasingly used for research and quality measurement, are lauded for their potential to improve patient-centered care, both through aggregate reporting and when integrated into clinical practice. However, there are few published studies of the resultant use of PROMs in clinical practice. This case study describes the implementation and use of PROMS in a Midwestern multispecialty medical group orthopedic practice among patients undergoing total knee and hip surgery. Specifically, rates of PROMs use by care teams are tracked over time once made available in the electronic health record. During this time, the orthopedics department achieved a patient PROMS survey response rate of 68% at baseline, 58% 3 months post-surgery, and 55% 12 months post-surgery. However, these data were only accessed by the care teams for fewer than 1% of associated clinical encounters. This suggests that making PROMs available for care team review in the electronic health record, even when coupled with relatively high response rates from patients and departmental leadership support is not enough to encourage integration of PROMs into clinical care for patients. Additional effort is required to identify barriers to PROMs use in clinical care and to test methods to enhance use.

Health information exchange through a Device-to-Device protocol supporting lossless encoding and decoding

Despite the availability of secure electronic data transfers, most medical information is still stored on paper, and it is usually shared by mail, fax or the patients themselves. Today's technologies aim to the challenge of sharing healthcare information, since exchanging inaccurate data leads to inefficiency and errors. Currently, there exist numerous techniques for exchanging data, which however require continuous internet connection, thus lacking generic applicability in healthcare, in the cases where no internet connection is available. In this paper, a new Device-to-Device (D2D) protocol is proposed, specifying a series of Bluetooth messages regarding the healthcare information that is being exchanged in short-range distances, between a healthcare-practitioner and a citizen. This information refers to structured and unstructured data, which can be directly exchanged through a globally used communication protocol, extending it for the permission of exchanging HL7 FHIR Bluetooth structured messages. Moreover, for high volume data, the D2D protocol can support lossless compression and decompression, improving its overall efficiency. The protocol is firstly evaluated through exchanging sample data in a real-world scenario, whereas an overall comparison of exchanging multiple sized data either using lossless compression or not is being provided. According to the evaluation results, the D2D protocol specification was strictly followed, successfully providing the ability to exchange healthcare-related data, with Bluetooth being considered the most suitable technology for current needs. For small-sized data, the D2D protocol performs better without the provided lossless compression mechanism, whereas in the case of large-sized data lossless compression is considered as the only option.

The Charlotte Project: Recommendations for patient-reported outcomes and clinical parameters in Dravet syndrome through a qualitative and Delphi consensus study

Objective

The appropriate management of patients with Dravet Syndrome (DS) is challenging, given the severity of symptoms and the burden of the disease for patients and caregivers. This study aimed to identify, through a qualitative methodology and a Delphi consensus-driven process, a set of recommendations for the management of DS to guide clinicians in the assessment of the clinical condition and quality of life (QoL) of DS patients, with a special focus on patient- and caregiver-reported outcomes (PROs).

Methods

This study was conducted in five phases, led by a multidisciplinary scientific committee (SC) including pediatric neurologists, epileptologists, a neuropsychologist, an epilepsy nurse, and members of DS patient advocates. In phases 1 and 2, a questionnaire related to patients' QoL was prepared and answered by caregivers and the SC. In phase 3, the SC generated, based on these answers and on a focus group discussion, a 70-item Delphi questionnaire, covering six topic categories on a nine-point Likert scale. In phase 4, 32 panelists, from different Spanish institutions and with a multidisciplinary background, answered the questionnaire. Consensus was obtained and defined as strong or moderate if ≥80% and 67–79% of panelists, respectively, rated the statement with ≥7. Phase 5 consisted of the preparation of the manuscript.

Results

The panelists agreed on a total of 69 items (98.6%), 54 (77.14%), and 15 (21.43%) with strong and moderate consensus, respectively. The experts' recommendations included the need for frequent assessment of patient and caregivers QoL parameters. The experts agreed that QoL should be assessed through specific questionnaires covering different domains. Likewise, the results showed consensus regarding the regular evaluation of several clinical parameters related to neurodevelopment, attention, behavior, other comorbidities, and sudden unexpected death in epilepsy (SUDEP). A consensus was also reached on the instruments, specific parameters, and caregivers' education in the routine clinical management of patients with DS.

Conclusions

This consensus resulted in a set of recommendations for the assessment of clinical and QoL parameters, including PROs, related to the general evaluation of QoL, neurodevelopment, attention, behavior, other comorbidities affecting QoL, SUDEP, and QoL of caregivers/relatives and patients with DS.

A Smartphone Application Using Artificial Intelligence Is Superior To Subject Self-Reporting When Assessing Stool Form

INTRODUCTION

Stool form assessment relies on subjective patient reports using the Bristol Stool Scale (BSS). In a novel smartphone application (app), trained artificial intelligence (AI) characterizes digital images of users' stool. In this study, we evaluate this AI for accuracy in assessing stool characteristics.

METHODS

Subjects with diarrhea-predominant irritable bowel syndrome image-captured every stool for 2 weeks using the app, which assessed images for 5 visual characteristics (BSS, consistency, fragmentation, edge fuzziness, and volume). In the validation phase, using 2 expert gastroenterologists as a gold standard, sensitivity, specificity, accuracy, and diagnostic odds ratios of subject-reported vs AI-graded BSS scores were compared. In the implementation phase, agreements between AI-graded and subject-reported daily average BSS scores were determined, and subject BSS and AI stool characteristics scores were correlated with diarrhea-predominant irritable bowel syndrome symptom severity scores.

RESULTS

In the validation phase (n = 14), there was good agreement between the 2 experts and AI characterizations for BSS (intraclass correlation coefficients [ICC] = 0.782-0.852), stool consistency (ICC = 0.873-0.890), edge fuzziness (ICC = 0.836-0.839), fragmentation (ICC = 0.837-0.863), and volume (ICC = 0.725-0.851). AI outperformed subjects' self-reports in categorizing daily average BSS scores as constipation, normal, or diarrhea. In the implementation phase (n = 25), the agreement between AI and self-reported BSS scores was moderate (ICC = 0.61). AI stool characterization also correlated better than subject reports with diarrhea severity scores.

DISCUSSION

A novel smartphone application can determine BSS and other visual stool characteristics with high accuracy compared with the 2 expert gastroenterologists. Moreover, trained AI was superior to subject self-reporting of BSS. AI assessments could provide more objective outcome measures for stool characterization in gastroenterology.

Effect of routinely assessing and addressing depression and diabetes distress on clinical outcomes among adults with type 2 diabetes: a systematic review

OBJECTIVES

This study examined the effect of using patient-reported outcome measures (PROMs) routinely to assess and address depressive symptoms and diabetes distress among adults with type 2 diabetes.

DESIGN

A systematic review of published peer-reviewed studies.

DATA SOURCES

Medline, Embase, CINAHL Complete, PsycINFO, The Cochrane Library and Cochrane Central Register of Controlled Trials were searched.

ELIGIBILITY CRITERIA

Studies including adults with type 2 diabetes, published in English, from the inception of the databases to 24 February 2022 inclusive; and where the intervention included completion of a PROM of depressive symptoms and/or diabetes distress, with feedback of the responses to a healthcare professional.

DATA EXTRACTION AND SYNTHESIS

Using Covidence software, screening and risk of bias assessment were conducted by two reviewers independently with any disagreements resolved by a third reviewer.

RESULTS

The search identified 4512 citations, of which 163 full-text citations were assessed for eligibility, and nine studies met the inclusion criteria. Five studies involved assessment of depressive symptoms only, two studies assessed diabetes distress only, and two studies assessed both. All studies had an associated cointervention. When depressive symptoms were assessed (n=7), a statistically significant between-group difference in depressive symptoms was observed in five studies; with a clinically significant (>0.5%) between-group difference in HbA1c in two studies. When diabetes distress was assessed (n=4), one study demonstrated statistically significant difference in depressive symptoms and diabetes distress; with a clinically significant between-group difference in HbA1c observed in two studies.

CONCLUSION

Studies are sparse in which PROMs are used to assess and address depressive symptoms or diabetes distress during routine clinical care of adults with type 2 diabetes. Further research is warranted to understand how to integrate PROMs into clinical care efficiently and determine appropriate interventions to manage identified problem areas.

PROSPERO REGISTRATION NUMBER

CRD42020200246.

Patient reported outcomes in oncology: changing perspectives-a systematic review

In public health context, oncology is associated with severe negative impact on patients and on their relatives’ quality of life. Over the last decades, survival has remained at 50% worldwide for some tumor locations. Patient reported outcomes (PROs) assessment and, the corresponding use in clinical practice, help establishing patient individualized profiling involving caregivers. The purpose of this systematic review was to examine critical success factors for PROs assessment in daily clinical oncology practice. Additionally, we investigated how PROs collection can change oncology perspectives for patients and caregivers. According to PRISMA guidelines, 83 studies were included in this systematic review, whether related with implementation in daily clinical practice or associated with its use in oncology. PROs assessment gathers multi-professional teams, biomedical and clinical expertise, patients, families and caregivers. Institutional involvement, first line for caregiver’s adherence, team continuous formation, encompassing training and support, design of clear workflows, continuous monitoring, and data analysis are crucial for implementation. PROs measures are decisive in oncology. Several items were improved, including caregiver–patient–physician communication, patient risk groups identification, unmet problems and needs detection, disease course and treatment tracking, prognostic markers, cost-effectiveness measurement and comfort/support provision for both patients and caregivers. Routine assessment and implementation of PROs in clinical practice are a major challenge and a paradigm transformation for future.

Paving the Way for Electronic Patient-Centered Measurement in Team-Based Primary Care: Integrated Knowledge Translation Approach

Background

Patient-centered measurement (PCM) aims to improve the overall quality of care through the collection and sharing of patient values, outcomes, and perspectives. However, the use of PCM in care team decisions remains limited. Integrated knowledge translation (IKT) offers a collaborative, adaptive approach to explore best practices for incorporating PCM into primary care practices by involving knowledge users, including patients and providers, in the exploratory process.

Objective

This study aims to test the feasibility of using patient-generated data in team-based care; describe the use of these data for team-based mental health care; and summarize patient and provider care experiences with PCM.

Methods

We conducted a multi-method exploratory study in a rural team-based primary care clinic using IKT to co-design, implement, and evaluate the use of PCM in team-based mental health care. Care pathways, workflows, and quality improvement activities were adjusted iteratively to improve integration efforts. Patient and provider experiences were evaluated using individual interviews relating to the use of PCM and patient portals in practice. All meeting notes, interview summaries, and emails were analyzed to create a narrative evaluation.

Results

During co-design, a care workflow was developed to incorporate electronically collected patient-generated data from the patient portal into the electronic medical record, and customized educational tools and resources were added. During implementation, care pathways and patient workflows for PCM were developed. Patients found portal use easy, educational, and validating, but data entries were not used during care visits. Providers saw the portal as extra work, and the lack of portal and electronic medical record integration was a major barrier. The IKT approach was invaluable for addressing workflow changes and understanding the ongoing barriers to PCM use and quality improvement.

Conclusions

Although the culture toward using PCM is changing, the use of PCM during care has not been successful. Patients felt validated and supported through portal use and could be empowered to bring these data to their visits. Training, modeling, and adaptable PCM methods are required before PCM can be integrated into routine care.

Examining perspectives on the adoption and use of computer-based patient-reported outcomes among clinicians and health professionals: a Q methodology study

OBJECTIVE

To determine factors that influence the adoption and use of patient-reported outcomes (PROs) in the electronic health record (EHR) among users.

MATERIALS AND METHODS

Q methodology, supported by focus groups, semistructured interviews, and a review of the literature was used for data collection about opinions on PROs in the EHR. An iterative thematic analysis resulted in 49 statements that study participants sorted, from most unimportant to most important, under the following condition of instruction: "What issues are most important or most unimportant to you when you think about the adoption and use of patient-reported outcomes within the electronic health record in routine clinical care?" Using purposive sampling, 50 participants were recruited to rank and sort the 49 statements online, using HTMLQ software. Principal component analysis and Varimax rotation were used for data analysis using the PQMethod software.

RESULTS

Participants were mostly physicians (24%) or physician/researchers (20%). Eight factors were identified. Factors included the ability of PROs in the EHR to enable: efficient and reliable use; care process improvement and accountability; effective and better symptom assessment; patient involvement for care quality; actionable and practical clinical decisions; graphical review and interpretation of results; use for holistic care planning to reflect patients' needs; and seamless use for all users.

DISCUSSION

The success of PROs in the EHR in clinical settings is not dependent on a "one size fits all" strategy, demonstrated by the diversity of viewpoints identified in this study. A sociotechnical approach for implementing PROs in the EHR may help improve its success and sustainability.

CONCLUSIONS

PROs in the EHR are most important to users when the technology is used to improve patient outcomes. Future research must focus on the impact of embedding this EHR functionality on care processes.

Performance of a Rasch-based method for group comparisons of longitudinal change and response shift at the item level in PRO data: A simulation study

The growing interest in patient perception and experience in healthcare has led to an increase in the use of patient-reported outcomes (PRO) data. However, chronically ill patients may regularly adapt to their disease and, as a consequence, might change their perception of the PRO being measured. This phenomenon named response shift (RS) may occur differently depending on clinical and individual characteristics. The RespOnse Shift ALgorithm at the Item level (ROSALI), a method for RS analysis at the item level based on Rasch models, has recently been extended to explore heterogeneity of item-level RS between two groups of patients. The performances of ROSALI in terms of RS detection at the item level and biases of estimated differences in latent variable means were assessed. A simulation study was performed to investigate four scenarios: no RS, RS in only one group, RS affecting both groups either in a similar or a different way. Performances of ROSALI were assessed using rates of false detection of RS when no RS was simulated and a set of criteria (presence of RS, correct identification of items and groups affected by RS) when RS was simulated. Rates of false detection of RS were low indicating that ROSALI satisfactorily prevents from mistakenly inferring RS. ROSALI is able to detect RS and identify the item and group(s) affected when RS affects all response categories of an item in the same way. The performances of ROSALI depend mainly on the sample size and the degree of heterogeneity of item-level RS.

Patient-reported outcome measures can advance population health, but is access to instruments and use equitable?

Patient reported outcome measures (PROM) can engage patients and clinicians to improve health outcomes. Their population health impact may be limited by systematic barriers inhibiting access to completion. In this analysis we evaluated the association between individual parent/child characteristics and clinic factors with parental completion of a locally developed PROM, the Early Healthy Lifestyles (EHL) questionnaire. Participants included parent-child dyads who presented at 14 pediatric clinics for regularly scheduled well-child visits (WCV) prior to age 26 months. EHL items include feeding practices, diet, play time, screen exposure, and sleep. Completion was categorized at patient- (i.e., parent-child dyad) and clinic-levels. Parents completed the 15-item EHL in the patient portal before arrival or in the clinic; ninety-three percent of EHL questionnaires were completed in the clinic vs. 7% in the patient portal. High-completers completed EHL for half of WCVs; low-completers completed at least once; and non-completers never completed. Clinics were classified by EHL adoption level (% high completion): High-adoption: >50%; Moderate-adoption: 10%-50%; and Low-adoption: <10%. Individual-level factors had negligible impact on EHL completion within moderate/low EHL adoption sites; high-adoption sites were used to evaluate infant and maternal factors in association with EHL completion using hierarchical logistic regression. Noncompletion of EHL was significantly associated (p < 0.05) with infant use of public insurance (OR = 1.92 [1.42, 2.59]), >1 clinic site for WCV (OR = 1.83 [1.34, 2.50]), non-White birth mother (OR = 1.78 [1.28, 2.47]), and body weight <2,500 grams or gestational age <34 weeks (OR = 1.74 [1.05, 2.90]). The number of WCVs, a proxy for clinic size, was evaluated but was not associated with completion. Findings indicate potential disparities between populations exposed to, completing, and benefitting from these tools.

Clinical Outcome Assessment in Cancer Rehabilitation and the Central Role of Patient-Reported Outcomes

The aim of cancer rehabilitation is to help patients regain functioning and social participation. In order to evaluate and optimize rehabilitation, it is important to measure its outcomes in a structured way. In this article, we review the different types of clinical outcome assessments (COAs), including Clinician-Reported Outcomes (ClinROs), Observer-Reported Outcomes (ObsROs), Performance Outcomes (PerfOs), and Patient-Reported Outcomes (PROs). A special focus is placed on PROs, which are commonly defined as any direct report from the patient about their health condition without any interpretation by a third party. We provide a narrative review of available PRO measures (PROMs) for relevant outcomes, discuss the current state of PRO implementation in cancer rehabilitation, and highlight trends that use PROs to benchmark value-based care. Furthermore, we provide examples of PRO usage, highlight the benefits of electronic PRO (ePRO) collection, and offer advice on how to select, implement, and integrate PROs into the cancer rehabilitation setting to maximize efficiency.

Launching an Electronic Patient-Reported Outcomes Initiative in Real-Time Clinical Practice

Patient-reported outcomes play an essential role in improving care across the cancer continuum. This paper reports on the experience of a tertiary care center to standardize the use, collection, and reporting of patient-reported outcomes (PROs) in 10 disease-specific survivorship clinics. To minimize the burden of patients to complete surveys, an institutional committee with oversight on all patient surveys required an application be reviewed and approved before their distribution in a clinic. To begin collecting PROs, each clinic submitted an application tailored to its clinical operations, staffing, and scheduling characteristics. The dates for the submission of each application were staggered over a 2-year period, which contributed to a lack of uniformity in the project (ie, approval dates, start dates, collection and reporting of results). The delays were primarily due to the time and resources required to build the electronic version of the PRO survey into the institutional electronic medical record. To date, 6 of 10 survivorship clinics submitted applications, 5 were approved, and 4 launched the electronic MD Anderson Symptom Inventory (eMDASI) through the patient portal. Metrics collected between January 2019 and December 2020 for the thyroid, bone marrow transplant, genitourinary, and head and neck clinics indicated the numbers of eMDASIs sent to patients varied by clinic, with the lowest from the bone marrow transplant survivorship clinic (6) and the highest (746) in the thyroid Clinic. The total number of eMDASIs returned by the patients ranged from 2 (bone marrow transplant) to 429 (thyroid). Overall, patients' return rates of the eMDASI ranged from 33.3% to 57.7%. Several strategies were implemented to increase the delivery, submission, and completion of eMDASIs. Our findings indicate the integration and implementation of PROs in survivorship clinics are achievable. Further work is needed to enhance the ePROs web-based process to adequately compare PROs across diverse cohorts of cancer survivors .

A predictive algorithm using clinical and laboratory parameters may assist in ruling out and in diagnosing MDS

We present a noninvasive Web-based app to help exclude or diagnose myelodysplastic syndrome (MDS), a bone marrow (BM) disorder with cytopenias and leukemic risk, diagnosed by BM examination. A sample of 502 MDS patients from the European MDS (EUMDS) registry (n > 2600) was combined with 502 controls (all BM proven). Gradient-boosted models (GBMs) were used to predict/exclude MDS using demographic, clinical, and laboratory variables. Area under the receiver operating characteristic curve (AUC), sensitivity, and specificity were used to evaluate the models, and performance was validated using 100 times fivefold cross-validation. Model stability was assessed by repeating its fit using different randomly chosen groups of 502 EUMDS cases. AUC was 0.96 (95% confidence interval, 0.95-0.97). MDS is predicted/excluded accurately in 86% of patients with unexplained anemia. A GBM score (range, 0-1) of less than 0.68 (GBM < 0.68) resulted in a negative predictive value of 0.94, that is, MDS was excluded. GBM ≥ 0.82 provided a positive predictive value of 0.88, that is, MDS. The diagnosis of the remaining patients (0.68 ≤ GBM < 0.82) is indeterminate. The discriminating variables: age, sex, hemoglobin, white blood cells, platelets, mean corpuscular volume, neutrophils, monocytes, glucose, and creatinine. A Web-based app was developed; physicians could use it to exclude or predict MDS noninvasively in most patients without a BM examination. Future work will add peripheral blood cytogenetics/genetics, EUMDS-based prospective validation, and prognostication.

Clinical Use of PROMIS, Neuro-QoL, TBI-QoL, and Other Patient-Reported Outcome Measures for Individual Adult Clients with Cognitive and Language Disorders

Patient-reported outcome measures (PROMs) assess health outcomes from the patient's perspective. The National Institutes of Health has invested in the creation of numerous PROMs that comprise the PROMIS, Neuro-QoL, and TBI-QoL measurement systems. Some of these PROMs are potentially useful as primary or secondary outcome measures, or as contextual variables for the treatment of adults with cognitive/language disorders. These PROMs were primarily created for clinical research and interpretation of group means. They also have potential for use with individual clients; however, at present there is only sparse evidence and direction for this application of PROMs. Previous research by Cohen and Hula (2020) described how PROMs could support evidence-based practices in speech-language pathology. This companion article extends upon that work to present clinicians with implementation information about obtaining, administering, scoring, and interpreting PROMs for individual clients with cognitive/language disorders. This includes considerations of the type and extent of communication support that is appropriate, implications of the relatively large measurement error that accompanies individual scores and pairs of scores, and recommendations for applying minimal detectable change values depending on the clinician's desired level of measurement precision. However, more research is needed to guide the interpretation of PROM scores for an individual client.

Measuring Atopic Dermatitis Disease Severity: The Potential for Electronic Tools to Benefit Clinical Care

Severity of atopic dermatitis (AD) correlates with impact on health-related quality of life (HRQoL), work productivity, and burden on health systems. Tools to measure severity inform regulatory approval, drug access, and value- or measurement-based care. A core set of instruments for measuring AD has been established. Clinician-reported tools are divided broadly into multi-item global estimates or precise calculators that also weigh affected corporeal surfaces. Increasingly, subjective patient-reported outcomes are valued, with the potential to capture vast amounts of health-related data. Patient-reported outcomes can be disease-agnostic, skin-related, or AD-specific, and evaluate global disease, itch severity, long-term control, or overall HRQoL. Patient-reported outcomes are expansive in number; therefore, item banks and adaptive digital user interfaces will be increasingly needed, along with capacity to store and analyze data. Technologies for AD include tools for communication, severity assessment, or data exchange, as well as electronic health records (EHRs). For clinicians, a limited number of applications exist, with relatively poor interoperability with EHRs to date. For patients, a growing number of mobile health (mHealth) applications exhibit variable compliance with international guidelines for self-management. Data privacy and information security governance are key considerations in the development of information technologies for AD. Integrated and streamlined digital operational processes for disease measurements may build capacity for high value and efficient care of patients with AD across the globe.

Making the Case for Patient-Reported Outcome Measures in Big-Data Rehabilitation Research: Implications for Optimizing Patient-Centered Care

Advances in data science and timely access to health informatics provide a pathway to integrate patient-reported outcome measures (PROMs) into clinical workflows and optimize rehabilitation service delivery. With the shift toward value-based care in the United States health care system, as highlighted by the recent Centers for Medicare and Medicaid Services incentive and penalty programs, it is critical for rehabilitation providers to systematically collect and effectively use PROMs to facilitate evaluation of quality and outcomes within and across health systems. This editorial discusses the potential of PROMs to transform clinical practice, provides examples of health systems using PROMs to guide care, and identifies barriers to aggregating data from PROMs to conduct health services research. The article proposes 2 priority areas to help advance rehabilitation health services research: (1) standardization of collecting PROMs data in electronic health records to facilitate comparing health system performance and quality and (2) increased partnerships between rehabilitation providers, researchers, and payors to accelerate health system learning. As health care reform continues to emphasize value-based payment strategies, it is essential for the field of physical medicine and rehabilitation to be at the forefront of demonstrating its value in the care continuum.

Informational Gaps, Needs, and Preferences of Adults With Chronic Health Conditions and Their Family Caregivers

The purpose of this cross-sectional, qualitative study was to determine unmet educational needs, preferences, and barriers experienced by individuals with chronic illness and their caregivers. A survey containing fixed-choice selections and open-ended questions was sent to persons with cancer and other chronic diseases who had been seen within a large national private health system. Between 20% and 25% of participants had difficulty obtaining health care information and/or felt overwhelmed with managing their condition. Coping, managing symptoms, and making treatment decisions were areas of need in both patients and caregivers. Preferences for receiving information were diverse. Existing methods of communication including secure Web sites where patients can access their medical records posed significant challenges.

Attitudes towards using electronic health records of patients with psoriasis and dermatologists: a cross-sectional study

BACKGROUND

Electronic health records (EHRs) offer various advantages for healthcare delivery, especially for chronic and complex diseases such as psoriasis. However, both patients' and physicians' acceptability is required for EHRs to unfold their full potential. Therefore, this study compares patients' and physicians' attitudes towards using EHRs in routine psoriasis care.

METHODS

For the purpose of this study, a questionnaire was developed based on literature research and analyses of previously conducted focus groups. Participants completed either a paper-based or an electronic version of the questionnaire. Patient recruitment took place at an dermatological outpatient clinic and via several online pathways (patient associations, and social media). Physicians were recruited via a mailing list of a dermatological association and at a dermatological conference. Patients' and physicians' responses were compared using χ2 tests and Fisher's exact tests.

RESULTS

The study consisted of 187 patients and 44 dermatologists. Patients compared to physicians rated almost all potential EHR uses as significantly more important and expected significantly more potential benefits from EHRs.

CONCLUSIONS

Patients showed positive expectations towards using EHRs, whereas there was more scepticism in the physician sample. This aligns with previous findings. These differences illustrate the necessity to involve all stakeholders, especially patients and physicians, into the process of developing and implementing EHRs.

Using an implementation science approach to implement and evaluate patient-reported outcome measures (PROM) initiatives in routine care settings

Purpose

Patient-reported outcome and experience measures (PROMs/PREMs) are well established in research for many health conditions, but barriers persist for implementing them in routine care. Implementation science (IS) offers a potential way forward, but its application has been limited for PROMs/PREMs.

Methods

We compare similarities and differences for widely used IS frameworks and their applicability for implementing PROMs/PREMs through case studies. Three case studies implemented PROMs: (1) pain clinics in Canada; (2) oncology clinics in Australia; and (3) pediatric/adult clinics for chronic conditions in the Netherlands. The fourth case study is planning PREMs implementation in Canadian primary care clinics. We compare case studies on barriers, enablers, implementation strategies, and evaluation.

Results

Case studies used IS frameworks to systematize barriers, to develop implementation strategies for clinics, and to evaluate implementation effectiveness. Across case studies, consistent PROM/PREM implementation barriers were technology, uncertainty about how or why to use PROMs/PREMs, and competing demands from established clinical workflows. Enabling factors in clinics were context specific. Implementation support strategies changed during pre-implementation, implementation, and post-implementation stages. Evaluation approaches were inconsistent across case studies, and thus, we present example evaluation metrics specific to PROMs/PREMs.

Conclusion

Multilevel IS frameworks are necessary for PROM/PREM implementation given the complexity. In cross-study comparisons, barriers to PROM/PREM implementation were consistent across patient populations and care settings, but enablers were context specific, suggesting the need for tailored implementation strategies based on clinic resources. Theoretically guided studies are needed to clarify how, why, and in what circumstances IS principles lead to successful PROM/PREM integration and sustainability.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02564-9) contains supplementary material, which is available to users.

Patient-reported outcome measures (PROMs): can they be used to guide patient-centered care and optimize outcomes in total knee replacement?

PURPOSE

As patient-reported outcome measures (PROMs) are increasingly integrated into clinical practice, there is a need to translate collected data into valuable information to guide and improve the quality and value of patient care. The purpose of this study was to investigate health-related quality-of-life (QoL) trajectories in the 5 years following total knee replacement (TKR) and the patient characteristics associated with these trajectories. The feasibility of translating QoL trajectories into valuable information for guiding patient-centered care was also explored.

METHODS

Data on patients who underwent TKR between 2006 and 2011 from a single-institution registry were extracted including patient-reported QoL (captured using the Short Form Survey (SF-12) instrument) up to 5 years post-surgery. QoL trajectories were modelled using latent class growth analysis. Quality-adjusted life-years (QALYs) were calculated to illustrate longer term health benefit. Multinomial logistic regression analyses were performed to examine the association between trajectory groups and baseline patient characteristics.

RESULTS

After exclusions, 1553 patients out of 1892 were included in the analysis. Six unique QoL trajectories were identified; with differing levels at baseline and improvement patterns post-surgery. Only 18.4% of patients were identified to be in the most positive QoL trajectory (low baseline, large sustainable improvement after surgery) associated with the greatest gain in QALY. These patients were likely to be younger, have no co-morbidities and report greater pain at pre-surgery than most in other QoL trajectories.

CONCLUSIONS

Our findings demonstrate the importance of underlying heterogeneity in QoL trajectories, resulting in variable QALY gains. There is scope in translating routinely collected PROMs to improve shared decision-making allowing for more patient engagement. However, further research is required to identify suitable approaches of its implementation into practice to guide clinical care and maximize patient outcomes.

Innovations in research and clinical care using patient-generated health data

Patient-generated health data (PGHD), or health-related data gathered from patients to help address a health concern, are used increasingly in oncology to make regulatory decisions and evaluate quality of care. PGHD include self-reported health and treatment histories, patient-reported outcomes (PROs), and biometric sensor data. Advances in wireless technology, smartphones, and the Internet of Things have facilitated new ways to collect PGHD during clinic visits and in daily life. The goal of the current review was to provide an overview of the current clinical, regulatory, technological, and analytic landscape as it relates to PGHD in oncology research and care. The review begins with a rationale for PGHD as described by the US Food and Drug Administration, the Institute of Medicine, and other regulatory and scientific organizations. The evidence base for clinic-based and remote symptom monitoring using PGHD is described, with an emphasis on PROs. An overview is presented of current approaches to digital phenotyping or device-based, real-time assessment of biometric, behavioral, self-report, and performance data. Analytic opportunities regarding PGHD are envisioned in the context of big data and artificial intelligence in medicine. Finally, challenges and solutions for the integration of PGHD into clinical care are presented. The challenges include electronic medical record integration of PROs and biometric data, analysis of large and complex biometric data sets, and potential clinic workflow redesign. In addition, there is currently more limited evidence for the use of biometric data relative to PROs. Despite these challenges, the potential benefits of PGHD make them increasingly likely to be integrated into oncology research and clinical care.

Achieving the Quadruple Aim to deliver value-based allergy care in an ever-evolving health care system

OBJECTIVE

To define the concept of value-based care in allergy, and to review challenges and opportunities in value-based health care delivery for allergists and immunologists.

DATA SOURCES

Articles describing practice variation, health care financing and reimbursement, shared decision-making, cost-effective health care delivery, patient-reported outcome measures, social determinants of health, and screening.

STUDY SELECTIONS

A narrative review detailing concepts and approaches to improve value-based health care in the context of the Quadruple Aim to address the patient and physician experience, cost, and population health.

RESULTS

Efforts to improve cost-effective care can be informed by understanding unwarranted geographic practice variation and benchmarking best practices. Although evidence suggests that shared decision-making and addressing social determinants of health have critical roles in high-quality care, some practices such as routine laboratory screening for urticaria, premedication to prevent recurrent low- or iso-osmolar contrast reactions, extended observation of resolved anaphylaxis, food allergy screening, and penicillin allergy overdiagnosis have high costs in relation to overall societal benefit. Food allergy prevention, newborn screening for severe combined immune deficiency, and penicillin delabeling are examples of population-based opportunities in which allergists and immunologists can assist in creating health care value. Although efforts to incentivize value-based care have emerged in recent years, the degree to which process measures improve patient-important outcomes remain uncertain. Clinician wellness must be made a priority for continued effective practice.

CONCLUSION

As health care systems continue to evolve, allergists and immunologists will play a key role in optimizing value by translating emerging evidence into practice and communicating novel approaches to prevent and treat allergic diseases.

Planning for patient-reported outcome implementation: Development of decision tools and practical experience across four clinics

INTRODUCTION

Many institutions are attempting to implement patient-reported outcome (PRO) measures. Because PROs often change clinical workflows significantly for patients and providers, implementation choices can have major impact. While various implementation guides exist, a stepwise list of decision points covering the full implementation process and drawing explicitly on a sociotechnical conceptual framework does not exist.

METHODS

To facilitate real-world implementation of PROs in electronic health records (EHRs) for use in clinical practice, members of the EHR Access to Seamless Integration of Patient-Reported Outcomes Measurement Information System (PROMIS) Consortium developed structured PRO implementation planning tools. Each institution pilot tested the tools. Joint meetings led to the identification of critical sociotechnical success factors.

RESULTS

Three tools were developed and tested: (1) a PRO Planning Guide summarizes the empirical knowledge and guidance about PRO implementation in routine clinical care; (2) a Decision Log allows decision tracking; and (3) an Implementation Plan Template simplifies creation of a sharable implementation plan. Seven lessons learned during implementation underscore the iterative nature of planning and the importance of the clinician champion, as well as the need to understand aims, manage implementation barriers, minimize disruption, provide ample discussion time, and continuously engage key stakeholders.

CONCLUSIONS

Highly structured planning tools, informed by a sociotechnical perspective, enabled the construction of clear, clinic-specific plans. By developing and testing three reusable tools (freely available for immediate use), our project addressed the need for consolidated guidance and created new materials for PRO implementation planning. We identified seven important lessons that, while common to technology implementation, are especially critical in PRO implementation.

Capturing the patient voice: implementing patient-reported outcomes across the health system

PURPOSE

Supporting the capture and use of patient-reported outcomes (PROs) at the point-of-care enriches information about important clinical and quality of life outcomes. Yet the ability to scale PROs across healthcare systems has been limited by knowledge gaps around how to manage the diversity of PRO uses and leverage health information technology. In this study, we report learnings and practice insights from UW Medicine's practice transformation efforts to incorporate patient voice into multiple areas of care.

METHODS

Using a participatory, action research approach, we engaged with UW Medicine clinical and administrative stakeholders experienced with PRO implementation to inventory PRO implementations across the health system, characterize common clinical uses for PROs, and develop recommendations for system-wide governance and implementation of PROs.

RESULTS

We identified a wide breadth of PRO implementations (n = 14) in practice and found that nearly half (47%) of employed PRO measures captured shared clinical domains (e.g., depression). We developed three vignettes (use cases) that illustrate how users interact with PROs, characterize common ways PRO implementations support clinical care across the health system (1) Preventive care, (2) Chronic/Specialty care, and (3) Surgical/Interventional care), and elucidate opportunities to enhance efficient PRO implementations through system-level standards and governance.

CONCLUSIONS

Practice transformation efforts increasingly require integration of the patient voice into clinical care, often through the use of PROs. Learnings from our work highlight the importance of proactively considering how PROs will be used across the layers of healthcare organizations to optimize the design and governance of PROs.

Opportunities and challenges to advance the use of electronic patient-reported outcomes in clinical care: a report from AMIA workshop proceedings

Despite the demonstrated value of patient-centered care, health systems have been slow to integrate the patient’s voice into care delivery through patient-reported outcomes (PROs) with electronic tools. This is due in part to the complex interplay of technology, workflow, and human factors that shape the success of electronic PROs (ePROs) use. The 2018 American Medical Informatics Association Annual Symposium served as the setting for a half-day interactive workshop with diverse stakeholders to discuss proposed best practices for the planning, design, deployment, and evaluation of ePROs. We provide this collective commentary that synthesizes participant feedback regarding critical challenges that prohibit the scale and spread of ePROs across healthcare delivery systems, including governance and leadership, workflow and human factors, informatics, and data science. In order to realize the promise of ePROs at scale, adaptable approaches are critical to balance the needs of individual users with health systems at large.